Introduction to this Course: What is an Interaction Technique and Why are they Important?

Slides for Lecture 1

Recommended Readings:

• Brad A. Myers. "Challenges of HCI Design and Implementation," ACM Interactions. vol. 1, no. 1. January, 1994. pp. 73-83. pdf

History of Personal Computers and their Interaction Techniques

Slides for Lecture 2

Required Readings:

• Brad A. Myers. "A Brief History of Human Computer Interaction Technology." ACM interactions. Vol. 5, no. 2, March, 1998. pp. 44-54. pdf
• Ivan Sutherland's Sketchpad Demo, 20:42 min Video, 1964. mpg download or Youtube
• Bill Moggridge, "Designing Interactions" excerpt #1, pp. 17 – 111. (on Canvas--only accessible to class members)

Recommended Readings:

• William L. Bewley, Teresa L. Roberts and William L. Verplank David Schroit. “Human Factors Testing in the Design of Xerox's 8010 'Star' Office Workstation,” Proceedings SIGCHI'83: Human Factors in Computing Systems, Boston, MA, Dec, 1983. pp. 72-77. ACM ref
• Ivan E. Sutherland. “Sketchpad: A Man-Machine Graphical Communication System,” AFIPS Spring Joint Computer Conference, 1963. pp. 329-346. ACM ref
• Larry Tesler. “The Smalltalk Environment,” Byte Magazine. Aug, 1981. 6(8). pp. 90-147. archive.org version
• Gregg Williams. “The Lisa Computer System,” Byte Magazine. Feb, 1983. 8(2). pp. 33-50. archive.org version

Start on Homework 1

No Class: MLK Day

Pointing Devices and Fitts' Law

Slides for Lecture 3

Required Readings:

• Card, S.K., English, W.K., & Burr, B.J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics, 21(8), pp. 601-613. 1978. pdf
• Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. "Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices." Proceedings CHI'2002: Human Factors in Computing Systems. Minneapolis, Minnesota, April 20-25, 2002. pp. 33-40. pdf.
• Video of guest lecture by Ted Selker to 2014 class about the IBM Pointing Stick: Slides for his lecture, link to the video shown during the talk, and Panopto video of the talk

Recommended Readings:

• Wobbrock, J. O., Shinohara, K. and Jansen, A. (2011). The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 1639-1648. ACM ref
• Soukoreff, R. W. and MacKenzie, I. S. (2004). Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61 (6), pp. 751-789. ScienceDirect

History of Handhelds (PDAs to Smartphones) and their Interaction Techniques

Slides for Lecture 4

Required Readings:

• Bill Moggridge, "Designing Interactions" excerpt #2, pp. 180-235. (on Canvas--only accessible to class members)

Recommended Readings:

• Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on Canvas--only accessible to class members)
• GO Corporation - Introducing PenPoint (1991), 15:20 video on YouTube

Mon. January 28 - Semester Course Add Deadline

Deep Dive: Desktop Metaphors, Icons, Window Managers

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Introduction" (0:00 - 02:30), and "Icons and windows", "Manipulating windows", "Conclusion and credits" (1:39:15 - 2:14:54 (end)).
• Brad A. Myers. “A Taxonomy of User Interfaces for Window Managers,” IEEE Computer Graphics and Applications. Sept, 1988. 8(5). pp. 65-84. IEEE DL or local pdf
  

Recommended Readings:

• Video of guest lecture by David Canfield Smith to 2014 class about the invention of icons and the Star UI: Slides for his lecture and Panopto video of the talk
• Video of guest lecture by Norm Cox to 2016 class about the graphic design of the icons: Slides for his talk (pdf), and Panopto video of the talk
• Video of guest lecture by Tandy Trower to 2016 class about the design of Microsoft Windows: Slides for his lecture and Panopto video of the talk (but the audio is a little garbled).
• Sara A. Bly and Jarrett K. Rosenberg. “A Comparison of Tiled and Overlapping Windows,” Human Factors in Computing Systems, Proceedings SIGCHI'86. Boston, Mass, Apr, 1986, 1986. pp. 101-106. ACM DL or pdf
• David Canfield Smith, DigiBarn TV: Xerox Star 8010 Final Demo - Live Demo, YouTube Video
  

Guest Lecture #1: Bill Atkinson

See Bill Atkinson's Lisa development polaroids
See video of Bill's talk

Bill Atkinson was the principal designer and developer of the graphical user interface (GUI) of the Apple Lisa and Apple Macintosh. He was the creator of the ground-breaking MacPaint application and its novel interaction techniques, and he also designed and implemented QuickDraw, the fundamental toolbox that the Lisa and Macintosh used for graphics. He also conceived, designed and implemented HyperCard, the first popular hypermedia system. He invented many now-common interaction techniques, including the menu bar, the marching ants selection used in painting programs, the Selection lasso, FatBits, pull-off menus (where a menu becomes a palette), and many others.

Recommended Readings:

• Bill Atkinson, "Joining Apple Computer", Facebook post, April 27, 2018. Facebook, or local pdf

Deep Dive: Menus

Slides for Lecture 7
Interesting menus found by students

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Menus", "Palettes", "Buttons", "Radio buttons", "Checkboxes" (00:17:16 - 01:01:14), and "Forms and dialog boxes" (01:21:31 - 01:30:05)
• J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), J. J. O'Hare (Ed.). ACM, New York, NY, USA, 95-100. ACM ref or local pdf.

Recommended Readings:

• Benjamin B. Bederson. 2000. "Fisheye menus". In Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST '00). ACM, New York, NY, USA, 217-225. ACM DL
• Gordon Kurtenbach and William Buxton. 1993. "The limits of expert performance using hierarchic marking menus." In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 482-487. ACM DL
  
• Gordon Kurtenbach and William Buxton. 1994. "User learning and performance with marking menus." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258-264. ACM DL

Homework 1 Due.
Start on Homework 2

Guest Lecture #2: Don Hopkins (by Skype)
(See also his web page on Medium)

See video of Don's talk

Don Hopkins was one of the original developers of Pie Menus, and helped contribute to their popularity in games. He published a frequently cited paper about pie menus at CHI'88 with John Raymond Callahan, Ben Shneiderman and Mark Weiser. He then developed and refined pie menus for many platforms and applications including window managers, the Emacs text editors, universal remote controls, TV guide browsers, web browsers, visual programming interfaces, SimCity, The Sims. These took advantage of many kinds of hardware including desktop, mobile, VR, OLPC, mouse, stylus and touch screens. He has published many free and open source software implementations of pie menus for X10, X11, NeWS, Tcl/TK, ScriptX, ActiveX, OpenLaszlo, Python, JavaScript, C#, and Unity3D.

Required Readings (already required for previous lecture!)

• J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. "An empirical comparison of pie vs. linear menus", In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), ACM, 95-100. ACM DL.
  

Deep Dive: Selecting and Creating Objects across Different Kinds of Views

Slides for Lecture 9

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Selecting text" (01:01:43 - 01:13:26) and "Selecting graphical objects", "Editing graphical objects" (01:30:07 - 01:39:15)

Recommended Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)
  

Deep Dive: Scrolling Techniques & Sliders

Slides for Lecture 10

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Scroll bars" (00:02:30 - 00:17:16)
• William Buxton and Brad Myers. "A Study in Two-Handed Input," Proceedings SIGCHI '86: Human Factors in Computing Systems. Boston, MA. April 13-17, 1986. pp. 321-326. pdf or html and video.
• Brad Myers, Kin Pou ("Leo") Lie and Bo-Chieh ("Jerry") Yang, "Two-Handed Input Using a PDA and a Mouse", Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 41-48. local pdf .

Homework 2 Due.
Start on Homework 3

Guest Lecture #3: Dan Bricklin (by Skype)

See video of Dan's talk

Dan Bricklin is the co-creator, with Bob Frankston, of VisiCalc, which was the first spreadsheet program, in 1979. He also founded Software Garden, Inc., in 1985, which created “Dan Bricklin's Demo Program”, which was one of the first programs to enable the layout and prototyping of UIs by drawing them. His book, Bricklin on Technology, was published by Wiley in May 2009.

Required Readings:

• TED Talk on the "VisiCalc story" (12:01 minutes long): https://www.ted.com/talks/dan_bricklin_meet_the_inventor_of_the_electronic_spreadsheet
• Idea page of his website: http://www.bricklin.com/history/saiidea.htm

See also:

• Emulator for the original VisiCalc written in JavaScript: https://www.pcjs.org/apps/pcx86/1981/visicalc/

Past to Future: Text Entry for Computers and Handhelds, and Text Editing

Slides for Lecture 12

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Entering input" (01:13:26 - 01:21:31)
• Jacob O. Wobbrock and Brad A. Myers. 2006. Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Trans. Comput.-Hum. Interact. 13, 4 (December 2006), pp. 458-489. ACM DL or local pdf.
  Note: You can skip section 4 -- you do not need to read about the algorithms.
  

Recommended Readings:

• Video of guest lecture by Larry Tesler to 2014 class about the invention of copy and paste and other text editing ideas: Slides from his lecture in pdf or in keynote and Panopto video of lecture.

Guest Lecture #4: Shumin Zhai (by Google Meet)

Slides for Lecture 13 (Google Slides)
Video of Guest Lecture

Shumin Zhai is Principal Scientist at Google where he leads and directs research, design, and development of human-device input methods and haptics systems. Previously, he was at IBM, where he invented the "ShapeWriter" text entry method for smartphones (which is a predecssor to Swype). At Google, he helped invent the Pixel phone squeeze interactions ("Active Edge"). In addition, his research career has contributed to both foundational models and understandings of human-computer interaction (HCI) and practical user interface designs, inventions, and flagship products. His publications have won the ACM UIST Lasting Impact Award and the IEEE Computer Society Best Paper Award, among others. He was the Editor-in-Chief of the ACM Transactions on Computer-Human Interaction (2009-2015). He received his Ph.D. degree at the University of Toronto in 1995. In 2006, he was named one of ACM's inaugural class of Distinguished Scientists. In 2010 he was named Member of the CHI Academy and Fellow of the ACM.

Required Readings:

• Shumin Zhai and Per Ola Kristensson. 2012. The word-gesture keyboard: reimagining keyboard interaction. Communications of the ACM 55, 9 (September 2012), 91-101. ACM DL.

Recommended Readings:

• Per-Ola Kristensson and Shumin Zhai. 2004. SHARK2: a large vocabulary shorthand writing system for pen-based computers. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST '04). ACM, 43-52. Winner, UIST lasting impact award. ACM DL.

Ergonomics and Human Factors for Interaction Techniques

Slides for Lecture 14

Required Readings:

• Scott R. Klemmer, Bjorn Hartmann, and Leila Takayama. 2006. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, pp. 140-149. ACM DL

Homework 3 Due.
Start on Homework 4

(Brad away)

Mid Term Exam in class
(see information about the midterm)

(Mid-Semester Grades Due by 4:00 p.m. on Mon. March 11, 2019)

Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

Slides for Lecture 16

Recommended Readings:

• Rick Carey, Tony Fields, Andries van Dam, Dan Venolia. 1994. Why is 3-D interaction so hard and what can we really do about it? (panel). In Proceedings SIGGRAPH '94. ACM, pp. 492-493. ACM DL.
• Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A study in interactive 3-D rotation using 2-D control devices. In Proceedings SIGGRAPH '88. ACM pp. 121-129. ACM DL.

Homework 4 Due.
Start on Final Project

Formal Models and Design Spaces for Interaction Techniques

Slides for Lecture 17

Recommended Readings:

• William Buxton, "Lexical and Pragmatic Considerations of Input Structures," Computer Graphics, January, 1983, (17)1, pp. 31-37.  ACM DL  or local html.
• Brad A. Myers. 1990. A new model for handling input. ACM Trans. Inf. Syst. 8, 3 (July 1990), pp. 289-320. ACM DL or local pdf.

Topics for Final Projects due

Past to Future: Interactions for Game Control & Consumer Electronics

Slides for Lecture 18

Required Readings:

• Steve Swink. Game Feel. CRC Press. Chapters 1, 6, and 7. (on Canvas--only accessible to class members)
  (Note: Game Feel is written by a game designer rather than a traditional HCI practitioner, so he doesn't practice the formal study of interaction techniques. Think about how our class techniques and his approach relate as you're reading. Because he is a game designer, he may reference video games in passing with which you may be unfamiliar. If you're interested, YouTube is filled with demo videos that can show you what the game looks like and how it plays, especially if you add "review" or "gameplay" to your search.)

Recommended Readings:

• Steve Swink. Game Feel. CRC Press. Chapter 15. (on Canvas--only accessible to class members)
• Video of Game Controllers from 1972 to 2006. http://youtu.be/Q-03HmcjOPs
• Video about the camera design of Super Mario World (2d predecessor to
  Super Mario 64): http://youtu.be/TCIMPYM0AQg

Form Final Project Groups due

Physical Gadgets and their Interaction Techniques

Slides for Lecture 19

Required Readings:

• Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, pp. 209-218. ACM DL or local pdf
  NOTE: only pages 209-211 and 215-218 (not the architecture)

Recommended Readings:

• Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (January 2012), 38-51. ACM DL

Legal Issues Around Interaction Techniques such as Patents

Slides for Lecture 20

Required Readings:

• Brad A. Myers, "Legal and Intellectual Property Issues," sidebar in The UX Book: Process and Guidelines for Ensuring a Quality User Experience, by: Rex Hartson & Pardha S. Pyla. Waltham, MA: Elsevier/Morgan Kaufmann, 2012. pp. 851-852. (on Canvas--only accessible to class members)

Recommended Readings:

• Jacob O. Wobbrock and Brad A. Myers. "Using Edges and Corners for Character Input." US Patent No. 7,729,542, issued June 1, 2010, Filed March 29, 2004, claiming priority to provisional filed April 4, 2003. pdf

Two-page proposal for Projects due

Past to Future: Various Undo Models, Interaction Histories, and Macro Recording

Slides for Lecture 21

Required Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)

Recommended Readings:

• Kurlander, D. and Feiner, S. Editable Graphical Histories. Proc. 1988 IEEE Workshop on Visual Languages. (Pittsburgh, Oct. t0-12, 1988). 127-134. IEEE DL, or pdf and video (2:42)

Implementation Techniques and Tools for Interaction Techniques

Slides for Lecture 22

Recommended Readings:

• Brad Myers, Scott E. Hudson, and Randy Pausch, "Past, Present and Future of User Interface Software Tools," ACM Transactions on Computer Human Interaction. March, 2000. Vol. 7, no. 1. pp. 3-28. ACM ref or local pdf

Guest Lecture #5: Rob Haitani (by Skype)

Slides for Lecture 23,
Video of guest lecture.

Rob Haitani was a UI designer on the orginal Palm Pilot. He is the co-author of the definitive article about the UI design in Information Appliances and Beyond. E. Bergman, Ed. and in the section on portable devices in Bill Moggridge, Designing Interactions. (Both of which were assigned for lecture 4 above, and are on Canvas). Currently, he is Principal UX Designer, Alexa @ Amazon Japan.

Required Readings:

• Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on Canvas--only accessible to class members)

Interim Reports on Final Projects due

(Brad out of town)

Past to Future: Gesture Recognition and Its Algorithms
(Guest lecture by Jacob Wobbrock by Zoom)

Slides for Lecture 24 from Dr. Wobbrock:

• Slides on 1$
• Slides on Gestures
• http://depts.washington.edu/madlab/proj/dollar/
• http://depts.washington.edu/madlab/proj/dollar/impact.html

Required Readings:

• Video: Dean Rubine. 1992. Combining gestures and direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), ACM, actual video or (ACM Ref for description)

Recommended Readings:

• Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). 159-168. ACM DL or local pdf
• Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, 1083-1092. ACM DL or local pdf.
  
• Paper: Dean Rubine. 1991. Specifying gestures by example. In Proceedings of the 18th annual conference on Computer graphics and interactive techniques (SIGGRAPH '91). ACM, 329-337. ACM DL

(Brad out of town)

Interaction Techniques for Accessibility
Guest lecture by Jeffrey Bigham

Slides for Lecture 20

Required Readings:

• Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. "Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques." In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (Assets '08). ACM, pp. 73-80. ACM DL.
• W3C, "Introduction to Web Accessibility," on-line

Recommended Readings:

• Brad A. Myers, Jacob O. Wobbrock, Sunny Yang, Brian Yeung, Jeffrey Nichols, and Robert Miller. "Using Handhelds to Help People with Motor Impairments", Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS 2002. July 8-10, 2002. Edinburgh, Scotland. pp. 89-96. local pdf

Past to Future: Artificial Intelligence (AI) in Interaction Techniques

Final Project Presentations, 1.

Here is the form to evaluate the project presentations.

Final Project Presentations, 2

Everyone please fill out the Course Survey and also the official CMU course evaluations).

Final Project Presentations, 3

(Final day of classes = May 3, 2019.)

Everyone please fill out the peer evaluation for your project.

(Final grades due by 4:00 p.m. on May 16, 2019 for Seniors.)