Schedule for 05-640: Interaction Techniques, Spring, 2019

  Date Class Content
1. Monday,
Jan. 14, 2019

Introduction to this Course: What is an Interaction Technique and Why are they Important?

Slides for Lecture 1

Recommended Readings:

  • Brad A. Myers. "Challenges of HCI Design and Implementation," ACM Interactions. vol. 1, no. 1. January, 1994. pp. 73-83. pdf
2. Wednesday,
Jan. 16, 2019

History of Personal Computers and their Interaction Techniques

Slides for Lecture 2

Required Readings:

  • Brad A. Myers. "A Brief History of Human Computer Interaction Technology." ACM interactions. Vol. 5, no. 2, March, 1998. pp. 44-54. pdf
  • Ivan Sutherland's Sketchpad Demo, 20:42 min Video, 1964. mpg download or Youtube
  • Bill Moggridge, "Designing Interactions" excerpt #1, pp. 17 – 111. (on Canvas--only accessible to class members)

Recommended Readings:

  • William L. Bewley, Teresa L. Roberts and William L. Verplank David Schroit. “Human Factors Testing in the Design of Xerox's 8010 'Star' Office Workstation,” Proceedings SIGCHI'83: Human Factors in Computing Systems, Boston, MA, Dec, 1983. pp. 72-77. ACM ref
  • Ivan E. Sutherland. “Sketchpad: A Man-Machine Graphical Communication System,” AFIPS Spring Joint Computer Conference, 1963. pp. 329-346. ACM ref
  • Larry Tesler. “The Smalltalk Environment,” Byte Magazine. Aug, 1981. 6(8). pp. 90-147. archive.org version
  • Gregg Williams. “The Lisa Computer System,” Byte Magazine. Feb, 1983. 8(2). pp. 33-50. archive.org version

Start on Homework 1

x Monday,
Jan. 21, 2019

No Class: MLK Day

3. Wednesday,
Jan. 23, 2019

Pointing Devices and Fitts' Law

Slides for Lecture 3

Required Readings:

  • Card, S.K., English, W.K., & Burr, B.J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics, 21(8), pp. 601-613. 1978. pdf
  • Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. "Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices." Proceedings CHI'2002: Human Factors in Computing Systems. Minneapolis, Minnesota, April 20-25, 2002. pp. 33-40. pdf.
  • Video of guest lecture by Ted Selker to 2014 class about the IBM Pointing Stick: Slides for his lecture, link to the video shown during the talk, and Panopto video of the talk

Recommended Readings:

  • Wobbrock, J. O., Shinohara, K. and Jansen, A. (2011). The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 1639-1648. ACM ref
  • Soukoreff, R. W. and MacKenzie, I. S. (2004). Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61 (6), pp. 751-789. ScienceDirect
4. Monday,
Jan. 28, 2019

History of Handhelds (PDAs to Smartphones) and their Interaction Techniques

Slides for Lecture 4

Required Readings:

  • Bill Moggridge, "Designing Interactions" excerpt #2, pp. 180-235. (on Canvas--only accessible to class members)

Recommended Readings:

  • Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on Canvas--only accessible to class members)
  • GO Corporation - Introducing PenPoint (1991), 15:20 video on YouTube

Mon. January 28 - Semester Course Add Deadline

5. Wednesday,
Jan. 30, 2019

Deep Dive: Desktop Metaphors, Icons, Window Managers

Required Readings:

  • All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Introduction" (0:00 - 02:30), and "Icons and windows", "Manipulating windows", "Conclusion and credits" (1:39:15 - 2:14:54 (end)).
  • Brad A. Myers. “A Taxonomy of User Interfaces for Window Managers,” IEEE Computer Graphics and Applications. Sept, 1988. 8(5). pp. 65-84. IEEE DL or local pdf

Recommended Readings:

6. Monday,
Feb. 4, 2019

Bill Atkinson with Steve Jobs Guest Lecture #1: Bill Atkinson

See Bill Atkinson's Lisa development polaroids
See video of Bill's talk

Bill Atkinson was the principal designer and developer of the graphical user interface (GUI) of the Apple Lisa and Apple Macintosh. He was the creator of the ground-breaking MacPaint application and its novel interaction techniques, and he also designed and implemented QuickDraw, the fundamental toolbox that the Lisa and Macintosh used for graphics. He also conceived, designed and implemented HyperCard, the first popular hypermedia system. He invented many now-common interaction techniques, including the menu bar, the marching ants selection used in painting programs, the Selection lasso, FatBits, pull-off menus (where a menu becomes a palette), and many others.

Recommended Readings:

  • Bill Atkinson, "Joining Apple Computer", Facebook post, April 27, 2018. Facebook, or local pdf
7. Wednesday,
Feb. 6, 2019

Deep Dive: Menus

Slides for Lecture 7
Interesting menus found by students

Required Readings:

  • All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Menus", "Palettes", "Buttons", "Radio buttons", "Checkboxes" (00:17:16 - 01:01:14), and "Forms and dialog boxes" (01:21:31 - 01:30:05)
  • J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), J. J. O'Hare (Ed.). ACM, New York, NY, USA, 95-100. ACM ref or local pdf.

Recommended Readings:

  • Benjamin B. Bederson. 2000. "Fisheye menus". In Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST '00). ACM, New York, NY, USA, 217-225. ACM DL
  • Gordon Kurtenbach and William Buxton. 1993. "The limits of expert performance using hierarchic marking menus." In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 482-487. ACM DL
  • Gordon Kurtenbach and William Buxton. 1994. "User learning and performance with marking menus." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258-264. ACM DL

Homework 1 Due.
Start on Homework 2

8. Monday,
Feb. 11, 2019

picture of Don Hopkins Guest Lecture #2: Don Hopkins (by Skype)
(See also his web page on Medium)

See video of Don's talk

Don Hopkins was one of the original developers of Pie Menus, and helped contribute to their popularity in games. He published a frequently cited paper about pie menus at CHI'88 with John Raymond Callahan, Ben Shneiderman and Mark Weiser. He then developed and refined pie menus for many platforms and applications including window managers, the Emacs text editors, universal remote controls, TV guide browsers, web browsers, visual programming interfaces, SimCity, The Sims. These took advantage of many kinds of hardware including desktop, mobile, VR, OLPC, mouse, stylus and touch screens. He has published many free and open source software implementations of pie menus for X10, X11, NeWS, Tcl/TK, ScriptX, ActiveX, OpenLaszlo, Python, JavaScript, C#, and Unity3D.

Required Readings (already required for previous lecture!)

  • J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. "An empirical comparison of pie vs. linear menus", In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), ACM, 95-100. ACM DL.
9. Wednesday,
Feb. 13, 2019

Deep Dive: Selecting and Creating Objects across Different Kinds of Views

Slides for Lecture 9

Required Readings:

  • All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Selecting text" (01:01:43 - 01:13:26) and "Selecting graphical objects", "Editing graphical objects" (01:30:07 - 01:39:15)

Recommended Readings:

  • Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)
10. Monday,
Feb. 18, 2019

Deep Dive: Scrolling Techniques & Sliders

Slides for Lecture 10

Required Readings:

  • All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Scroll bars" (00:02:30 - 00:17:16)
  • William Buxton and Brad Myers. "A Study in Two-Handed Input," Proceedings SIGCHI '86: Human Factors in Computing Systems. Boston, MA. April 13-17, 1986. pp. 321-326. pdf or html and video.
  • Brad Myers, Kin Pou ("Leo") Lie and Bo-Chieh ("Jerry") Yang, "Two-Handed Input Using a PDA and a Mouse", Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 41-48. local pdf .

Homework 2 Due.
Start on Homework 3

11. Wednesday,
Feb. 20, 2019

Dan Bricklin headshot Guest Lecture #3: Dan Bricklin (by Skype)

See video of Dan's talk

Dan Bricklin is the co-creator, with Bob Frankston, of VisiCalc, which was the first spreadsheet program, in 1979. He also founded Software Garden, Inc., in 1985, which created “Dan Bricklin's Demo Program”, which was one of the first programs to enable the layout and prototyping of UIs by drawing them. His book, Bricklin on Technology, was published by Wiley in May 2009.

Required Readings:

See also:

12. Monday,
Feb. 25, 2019

Past to Future: Text Entry for Computers and Handhelds, and Text Editing

Slides for Lecture 12

Required Readings:

  • All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Entering input" (01:13:26 - 01:21:31)
  • Jacob O. Wobbrock and Brad A. Myers. 2006. Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Trans. Comput.-Hum. Interact. 13, 4 (December 2006), pp. 458-489. ACM DL or local pdf.
    Note: You can skip section 4 -- you do not need to read about the algorithms.

Recommended Readings:

  • Video of guest lecture by Larry Tesler to 2014 class about the invention of copy and paste and other text editing ideas: Slides from his lecture in pdf or in keynote and Panopto video of lecture.
13. Wednesday,
Feb. 27, 2019

Picture of Shumin Zhai Guest Lecture #4: Shumin Zhai (by Google Meet)

Slides for Lecture 13 (Google Slides)
Video of Guest Lecture

Shumin Zhai is Principal Scientist at Google where he leads and directs research, design, and development of human-device input methods and haptics systems. Previously, he was at IBM, where he invented the "ShapeWriter" text entry method for smartphones (which is a predecssor to Swype). At Google, he helped invent the Pixel phone squeeze interactions ("Active Edge"). In addition, his research career has contributed to both foundational models and understandings of human-computer interaction (HCI) and practical user interface designs, inventions, and flagship products. His publications have won the ACM UIST Lasting Impact Award and the IEEE Computer Society Best Paper Award, among others. He was the Editor-in-Chief of the ACM Transactions on Computer-Human Interaction (2009-2015). He received his Ph.D. degree at the University of Toronto in 1995. In 2006, he was named one of ACM's inaugural class of Distinguished Scientists. In 2010 he was named Member of the CHI Academy and Fellow of the ACM.

Required Readings:

  • Shumin Zhai and Per Ola Kristensson. 2012. The word-gesture keyboard: reimagining keyboard interaction. Communications of the ACM 55, 9 (September 2012), 91-101. ACM DL.

Recommended Readings:

  • Per-Ola Kristensson and Shumin Zhai. 2004. SHARK2: a large vocabulary shorthand writing system for pen-based computers. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST '04). ACM, 43-52. Winner, UIST lasting impact award. ACM DL.

14. Monday,
Mar 4, 2019

Ergonomics and Human Factors for Interaction Techniques

Slides for Lecture 14

Required Readings:

  • Scott R. Klemmer, Bjorn Hartmann, and Leila Takayama. 2006. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, pp. 140-149. ACM DL

Homework 3 Due.
Start on Homework 4

15. Wednesday,
Mar. 6, 2019

(Brad away)

Mid Term Exam in class
(see information about the midterm)

(Mid-Semester Grades Due by 4:00 p.m. on Mon. March 11, 2019)

x Monday,
Mar. 11, 2019
Spring Break -- no class
x Wednesday,
Mar. 13, 2019
Spring Break -- no class
16. Monday,
Mar. 18, 2019

Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

Slides for Lecture 16

Recommended Readings:

  • Rick Carey, Tony Fields, Andries van Dam, Dan Venolia. 1994. Why is 3-D interaction so hard and what can we really do about it? (panel). In Proceedings SIGGRAPH '94. ACM, pp. 492-493. ACM DL.
  • Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A study in interactive 3-D rotation using 2-D control devices. In Proceedings SIGGRAPH '88. ACM pp. 121-129. ACM DL.

Homework 4 Due.
Start on Final Project

17. Wednesday,
Mar. 20, 2019

Formal Models and Design Spaces for Interaction Techniques

Slides for Lecture 17

Recommended Readings:

  • William Buxton, "Lexical and Pragmatic Considerations of Input Structures," Computer Graphics, January, 1983, (17)1, pp. 31-37.  ACM DL  or local html.
  • Brad A. Myers. 1990. A new model for handling input. ACM Trans. Inf. Syst. 8, 3 (July 1990), pp. 289-320. ACM DL or local pdf.

Topics for Final Projects due

18. Monday,
Mar. 25, 2019

Past to Future: Interactions for Game Control & Consumer Electronics

Slides for Lecture 18

Required Readings:

  • Steve Swink. Game Feel. CRC Press. Chapters 1, 6, and 7. (on Canvas--only accessible to class members)
    (Note: Game Feel is written by a game designer rather than a traditional HCI practitioner, so he doesn't practice the formal study of interaction techniques. Think about how our class techniques and his approach relate as you're reading. Because he is a game designer, he may reference video games in passing with which you may be unfamiliar. If you're interested, YouTube is filled with demo videos that can show you what the game looks like and how it plays, especially if you add "review" or "gameplay" to your search.)

Recommended Readings:

Form Final Project Groups due

19. Wednesday,
Mar. 27, 2019

Physical Gadgets and their Interaction Techniques

Slides for Lecture 19

Required Readings:

  • Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, pp. 209-218. ACM DL or local pdf
    NOTE: only pages 209-211 and 215-218 (not the architecture)

Recommended Readings:

  • Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (January 2012), 38-51. ACM DL
20. Monday,
Apr. 1, 2019

Legal Issues Around Interaction Techniques such as Patents

Slides for Lecture 20

Required Readings:

  • Brad A. Myers, "Legal and Intellectual Property Issues," sidebar in The UX Book: Process and Guidelines for Ensuring a Quality User Experience, by: Rex Hartson & Pardha S. Pyla. Waltham, MA: Elsevier/Morgan Kaufmann, 2012. pp. 851-852. (on Canvas--only accessible to class members)

Recommended Readings:

  • Jacob O. Wobbrock and Brad A. Myers. "Using Edges and Corners for Character Input." US Patent No. 7,729,542, issued June 1, 2010, Filed March 29, 2004, claiming priority to provisional filed April 4, 2003. pdf

Two-page proposal for Projects due

21. Wednesday,
Apr. 3, 2019

Past to Future: Various Undo Models, Interaction Histories, and Macro Recording

Slides for Lecture 21

Required Readings:

  • Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)

Recommended Readings:

  • Kurlander, D. and Feiner, S. Editable Graphical Histories. Proc. 1988 IEEE Workshop on Visual Languages. (Pittsburgh, Oct. t0-12, 1988). 127-134. IEEE DL, or pdf and video (2:42)
22. Monday,
Apr. 8, 2019

Implementation Techniques and Tools for Interaction Techniques

Slides for Lecture 22

Recommended Readings:

  • Brad Myers, Scott E. Hudson, and Randy Pausch, "Past, Present and Future of User Interface Software Tools," ACM Transactions on Computer Human Interaction. March, 2000. Vol. 7, no. 1. pp. 3-28. ACM ref or local pdf
23. Wednesday,
Apr. 10, 2019

Rob Haitani headshot Guest Lecture #5: Rob Haitani (by Skype)

Slides for Lecture 23,
Video of guest lecture.

Rob Haitani was a UI designer on the orginal Palm Pilot. He is the co-author of the definitive article about the UI design in Information Appliances and Beyond. E. Bergman, Ed. and in the section on portable devices in Bill Moggridge, Designing Interactions. (Both of which were assigned for lecture 4 above, and are on Canvas). Currently, he is Principal UX Designer, Alexa @ Amazon Japan.

Required Readings:

  • Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on Canvas--only accessible to class members)

Interim Reports on Final Projects due

24. Monday,
Apr. 15, 2019

(Brad out of town)

Past to Future: Gesture Recognition and Its Algorithms
(Guest lecture by Jacob Wobbrock by Zoom)

Slides for Lecture 24 from Dr. Wobbrock:

Required Readings:

  • Video: Dean Rubine. 1992. Combining gestures and direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), ACM, actual video or (ACM Ref for description)

Recommended Readings:

  • Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). 159-168. ACM DL or local pdf
  • Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, 1083-1092. ACM DL or local pdf.
  • Paper: Dean Rubine. 1991. Specifying gestures by example. In Proceedings of the 18th annual conference on Computer graphics and interactive techniques (SIGGRAPH '91). ACM, 329-337. ACM DL
25. Wednesday,
Apr. 17, 2019

(Brad out of town)

Interaction Techniques for Accessibility
Guest lecture by Jeffrey Bigham

Slides for Lecture 20

Required Readings:

  • Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. "Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques." In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (Assets '08). ACM, pp. 73-80. ACM DL.
  • W3C, "Introduction to Web Accessibility," on-line

Recommended Readings:

  • Brad A. Myers, Jacob O. Wobbrock, Sunny Yang, Brian Yeung, Jeffrey Nichols, and Robert Miller. "Using Handhelds to Help People with Motor Impairments", Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS 2002. July 8-10, 2002. Edinburgh, Scotland. pp. 89-96. local pdf
26. Monday,
Apr. 22, 2019

Past to Future: Artificial Intelligence (AI) in Interaction Techniques

27. Wednesday,
Apr. 24, 2019

Final Project Presentations, 1.

Wed, 4/24
4
IxT Book Project Bobbie Chen,Wanling Ding
Wed, 4/24
5
Celsian: A reader for research paper Chuankai Zhang,Yuntao Zhou,Yanzun Huang
Wed, 4/24
7
Momentum - "Gesture and Menus" Aniruddh Iyer,Won-Woo Chung,Advita Adyanthaya
Wed, 4/24
10
The Leap Motion Group Yoo Jin Shin,Emily Ding

Here is the form to evaluate the project presentations.

28. Monday,
Apr. 29, 2019

Final Project Presentations, 2

Mon, 4/29
2
2D Drawing Evaluation Huayun Huang,Erin Fuller
Mon, 4/29
6
Shumin Zhai Wikipedia Rajitha Pulivarthy,Menghan Zhang,Kearnie Lin
Mon, 4/29
8
PalmPrint: Precise Text Entry for VR Yang Zhang,Haojian Jin,Yifan Zhu

Everyone please fill out the Course Survey and also the official CMU course evaluations).

29. Wednesday,
May 1, 2019

Final Project Presentations, 3

Wed, 5/1
1
Interaction models for foldable phone Yi Cheng,Zeqian Peng,Peng Zheng
Wed, 5/1
3
IxT Museum on Website Jason Deng,Tiffany Chen,Dylan Hyun
Wed, 5/1
9
Scrolling Test Emily Porat,Cem Ergin,Sijia Li,Chun Wang

(Final day of classes = May 3, 2019.)

x Monday,
May 6, 2019
Written Reports for Final Projects Due

Everyone please fill out the peer evaluation for your project.

(Final grades due by 4:00 p.m. on May 16, 2019 for Seniors.)