05-830, Advanced User Interface Software, Spring, 2013

1. Course organization; Evaluating Tools

See slides for the lecture 1

Required Readings:

• Clarke, Steve, “Measuring API Usability.” Dr. Dobb's Journal; Special Windows/.NET Supplement, May, 2004. pp. S6-S9. html
• Jeffrey Stylos and Brad Myers, "Mapping the Space of API Design Decisions," 2007 IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC'07. Sept 23-27, 2007, Coeur d'Alene, Idaho. pp. 50-57. ieee or local pdf
• Jakob Nielsen, Heuristic Evaluation. On line in html format. Includes list of 10 heuristics.
• Brian Ellis, Jeffrey Stylos, and Brad Myers. "The Factory Pattern in API Design: A Usability Evaluation". International Conference on Software Engineering (ICSE'2007). May 20-26, 2007. Minneapolis, MN. pp. 302-312. ACM DL or local pdf
• T.R.G. Green, Cognitive Dimensions of Notations. Cognitive Dimensions of Notations Resource Site

Recommended Readings:

• Nielsen Text: Chapter 5 (Heuristic Evaluation)
• Jeffrey Stylos, Brad A. Myers. "The Implications of Method Placement on API Learnability," Sixteenth ACM SIGSOFT Symposium on Foundations of Software Engineering (FSE 2008). Atlanta, GA, November 9-14, 2008. 105-112. ACM DL or  local pdf
• Jeffrey Stylos and Steven Clarke. "Usability Implications of Requiring Parameters in Objects' Constructors". International Conference on Software Engineering (ICSE 2007). May 20-26, 2007. Minneapolis, MN. pp. 529-539. ACM DL or local pdf
• Jack Beaton, Sae Young Jeong, Yingyu Xie, Jeffrey Stylos, Brad A. Myers. "Usability Challenges for Enterprise Service-Oriented Architecture APIs," 2008 IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC'08. Sept 15-18, 2008, Herrsching am Ammersee, Germany. pp. 193-196. local pdf
• Green, T.R.G. and Petre, M., “Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework.” Journal of Visual Languages and Computing, 1996. 7(2): pp. 131-174. ScienceDirect
  Includes an analysis of HyperCard
• Matthew Conway, et. al., "Alice: lessons learned from building a 3D system for novices", CHI'2000. pp. 486-493. ACM DL or see this html summary.
  Alice was informed by many user studies over the years.
• Ko A.J. and Myers B.A. (2009). "Finding Causes of Program Output with the Java Whyline." ACM Conference on Human Factors in Computing Systems (CHI '09), Boston, MA, to appear. local pdf

Start on Homework 1

2. Basic Computer Graphics

See slides for the lecture 2

Required Readings:

• New Foley & van Dam, pp. 25-40, 52-60
• old Foley & van Dam, pp. 132-134 (color maps)
• These are combined into one pdf (link only works from CMU or with VPN, but also available on Blackboard under Course Content)

In-class presentation of UI Evaluations from HW1 -- each student gets 5 minutes

Homework 1 Due
Start on Homework 2

In-class presentation of UI Evaluations from HW1 -- each student gets 5 minutes

3. Other Output Models: Structured Graphics; Object-Oriented Techniques

See slides for the lecture 3

Required Readings:

• Brad A. Myers, Richard G. McDaniel, Robert C. Miller, Alan Ferrency,  Andrew Faulring, Bruce D. Kyle, Andrew Mickish, Alex Klimovitski, and Patrick Doane. "The Amulet Environment: New Models for Effective User  Interface Software Development", IEEE Transactions on Software Engineering, Vol. 23, no. 6. June, 1997. pp. 347-365. local pdf or IEEE Explore Ref.
• Brad A. Myers, Dario A. Giuse, and Brad Vander Zanden. "Declarative Programming in a Prototype-Instance System: Object-Oriented Programming Without Writing Methods," Proceedings OOPSLA'92: ACM Conference on Object-Oriented Programming Systems, Languages, and Applications. October 18-22, 1992. Vancouver, BC, Canada.  SIGPLAN Notices, vol. 27, no. 10. pp. 184-200. ACM DL Reference.

• Calder, P.R. and Linton, M.A. “Glyphs: Flyweight Objects for User Interfaces,” in  Proceedings UIST'90: ACM SIGGRAPH Symposium on User Interface Software and Technology. 1990. Snowbird, Utah: pp. 92-101. ACM DL Ref

4. Why are user interfaces hard to design and implement? and Types of User Interfaces

See slides for the lecture 4

• Brad A. Myers. "Challenges of HCI Design and Implementation," ACM Interactions. vol. 1, no. 1. January, 1994. pp. 73-83. ACM DL
  Discusses why user interfaces are important, and why they are hard to design and implement.
• Brad A. Myers. "A Brief History of Human Computer Interaction Technology." ACM interactions. Vol. 5, no. 2, March, 1998. pp. 44-54. ACM DL

• Brad A. Myers and Mary Beth Rosson. "Survey on User Interface Programming," Proceedings SIGCHI'92: Human Factors in Computing Systems. Monterrey, CA, May 3-7, 1992. pp. 195-202. ACM DL or local copy
  Discusses what percent of the time and effort went into the UI part. (Outdated).
• Nielsen Text: Chapters 1,  2 and 3

• Tyson R. Henry, Scott E. Hudson, Andrey K. Yeatts, Brad A. Myers and Steven Feiner; "A nose gesture interface device: extending virtual realities," Proceedings of the fourth annual ACM symposium on User interface software and technology, UIST'1991, Pages 65 - 68. ACM DL or local copy.

5. Conventional Input Models for Window Managers and Toolkits

See slides for the lecture 5

Required Readings:

• Unfortunately, there are no particularly good readings for this topic, so nothing is "required".

• Java event tutorial - if you are not familiar with how Java handles events.

6. Garnet & Amulet input models: “Interactor” Objects

See slides for the lecture 6

Required Readings:

• Brad A. Myers. "A New Model for Handling Input," ACM Transactions on Information Systems, vol. 8, No. 3. July, 1990. pp. 289-320. ACM DL Reference.
• Brad A. Myers and David Kosbie. "Reusable Hierarchical Command Objects," Proceedings CHI'96: Human Factors in Computing Systems. Vancouver, BC, Canada. April 14-18, 1996. ACM DL Reference
• Brad A. Myers. "Scripting Graphical Applications by Demonstration," Proceedings CHI'98: Human Factors in Computing Systems. Los Angeles, CA, April 18-23, 1998. pp. 534-541. ACM DL Reference and local pdf and video. (Topaz)

• Brad Myers, David A. Weitzman, Andrew J. Ko, and Duen Horng Chau, "Answering Why and Why Not Questions in User Interfaces," Proceedings CHI'2006: Human Factors in Computing Systems. Montreal, Canada, April 22-27, 2006. pp. 397-406. pdf and video 

7. SubArctic and its input models:
(Guest Lecture by Scott Hudson)

(Brad Away, DARPA ISAT Meeting)

See slides for the lecture 7

Required Readings:

• Scott E. Hudson, Jennifer Mankoff, Ian Smith. "Extensible Input Handling in the subArctic Toolkit", CHI'2005. pp. 381 - 390. ACM DL Reference.
• Jennifer Mankoff, Scott E. Hudson, Gregory D. Abowd. "Providing integrated toolkit-level support for ambiguity in recognition-based interfaces". CHI'2000. pp. 368 - 375. ACM DL Reference.

• http://doi.acm.org/10.1145/237091.237112 (ultra-lightweight
  constraints)
• http://doi.acm.org/10.1145/263407.263542 (debugging lenses)
• http://doi.acm.org/10.1145/263407.263537 (systematic output modification)
• http://doi.acm.org/10.1145/263407.263539 (styles)
• Also, the documentation for the toolkit (including the manual, JavaDoc, and source) might be useful:
  http://www.cs.cmu.edu/~hudson/teaching/05-631-f00/sub_arctic/
• Another reference for Jennifer Mankoff's work is:
  http://doi.acm.org/10.1145/354401.354407 (interaction techniques)

Homework 2 Due
Start on Homework 3

8. Overview of UI Software and Tools

See slides for the lecture 8

Required Readings:

• Brad A. Myers. "Graphical User Interface Programming," chapter 48 of Computer Science Handbook -- Second Edition. Allen B. Tucker, editor in chief. Boca Raton, FL: Chapman & Hall/CRC Press, Inc., 2004. pp. 48-1 - 48-29. pdf  (This is a revision of Brad A. Myers. "User Interface Software Tools," ACM Transactions on Computer-Human Interaction. vol. 2, no. 1, March, 1995. pp. 64-103. ACM DL Reference)
• Brad A. Myers, Scott Hudson and Randy Pausch. "Past Present and Future of User Interface Software Tools," ACM Transactions on Computer Human Interaction, (Mar. 2000). Volume 7 , Issue 1. pp. 3-28. ACM DL Reference.

9. Software Organization: Lexical-Syntax-Semantics, Seeheim Model, MVC

See slides for the lecture 9

Required Readings:

• William Buxton, "Lexical and Pragmatic Considerations of Input Structures," Computer Graphics, January, 1983, (17)1, pp. 31-37. (lexical, syntactic, semantic, etc.). html

• Mark Green, "Report on Dialogue Specification Tools," User Interface Management Systems, G. Pfaff, ed. Berlin: Springer-Verlag, 1985. pp. 9-20. (Seeheim model)
  (Here is a pdf scan of the book chapter, but it is not generally available on the web. It is also on the course's Blackboard "course content" page.)
• Glenn Krasner and Stephen T. Pope, "A Cookbook for Using the Model-View-Controller User Interface Paradigm in Smalltalk-80", Journal of Object-Oriented Programming (JOOP). August-September, 1988. vol. 1, no. 3. pp. 26-49. pdf scan at UCI
• Stuart K. Card, Jock D. Mackinlay, and George G. Robertson. 1990. The design space of input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90), ACM, New York, NY, USA, 117-124. ACM DL Ref

• Bass, R. Faneuf, R. Little, N. Mayer, B. Pellegrino, S. Reed, R. Seacord, S. Sheppard, and M. Szczur, 1992. “A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop”, ACM SIGCHI Bulletin. 24 (1), 32–37. Jan, 1992. ACM DL ref

10. Toolkits: intrinsics, callbacks, resources, widget hierarchies, geometry management

See slides for the lecture 10

Optional Readings.

• Linton, M.A., Vlissides, J.M., and Calder, P.R., “Composing user interfaces with InterViews.” IEEE Computer, Feb, 1989. 22(2): pp. 8-22. pdf at Georgia Tech
• Funny flash animation about using Java Grid Bag layout: http://madbean.com/blog/2004/17/totallygridbag.html

11. Constraints
(including guest presentation by Stephen Oney on ConstraintJS)

See slides for the lecture 11 and
Stephen Oney's slides

Required Readings:

• Brad Vander Zanden, Brad A. Myers, Dario Giuse and Pedro Szekely. "Integrating Pointer Variables into One-Way Constraint Models," ACM Transactions on Computer-Human Interaction. vol. 1, no. 2, June, 1994. pp. 161-213. ACM DL Reference

• Stephen Oney, Brad A. Myers, Joel Brandt, "ConstraintJS: Programming Interactive Behaviors for the Web by Integrating Constraints and States", UIST'2012: ACM Symposium on User Interface Software and Technology, October 7-10, 2012. Cambridge, MA. pp. 229-238. ACM DL or local pdf and video
• Brad Vander Zanden, "An Incremental Algorithm for Satisfying Hierarchies of Multi-way, Dataflow Constraints", ACM Transactions on Programming Languages and Systems, 18(1), January, 1996. pp. 30-72. ACM DL Reference
• Brad A. Myers, Robert C. Miller, Rich McDaniel, and Alan Ferrency, "Easily Adding Animations to Interfaces Using Constraints." ACM Symposium on User Interface Software and Technology, UIST'96, November 6-8, 1996. Seattle, WA. pp. 119-128. ACM DL Reference

12. Guest Lecture by Scott Hudson -- Advanced Constraints

See slides for the lecture 12

Required Readings:

• Scott E. Hudson. "Incremental attribute evaluation: a flexible algorithm for lazy update," ACM Transactions on Programming Languages and Systems, Volume 13 , Issue 3 (1991), Pages 315-341.  ACM DL Reference
• Bjorn N. Freeman-Benson, John Maloney and Alan Borning. "An incremental constraint solver," Communications of the ACM . Volume 33 , Issue 1 (1990). Pages 54-63. ACM DL Reference

13. UIMS Techniques: Menu trees, transition networks, grammars, Event Languages, HyperTalk, production systems, declarative Languages

See slides for the lecture 13

Required Readings:

• Mark Green, "A Survey of Three Dialogue Models," ACM Transactions on Graphics (5)3, Jul, 1986, pp 244-275. ACM DL Reference
• chapter 10 from Olsen's book: "Editing Dialog Models". User Interface Management Systems: Models and Algorithms.Morgan Kaufmann; (November 1991) (pdf of the chapter, but this is not generally available on the web), or Amazon listing for bookk,

• Robert J.K. Jacob,  "A Specification Language for Direct Manipulation Interfaces," ACM Transactions on Graphics, Oct, 1986, vol. 5, no. 4, pp. 283-317. ACM DL Reference.
• Ralph D. Hill, "Supporting Concurrency, Communication and Synchronization in Human-Computer Interaction - The Sassafras UIMS", ACM Transactions on Graphics, Jul, 86, vol. 5, no. 3, pp. 179-210. ACM DL Reference
• Philip J. Hayes, Pedro A. Szekely, and Richard A. Lerner, "Design Alternatives for User Interface Management Systems Based on Experience with COUSIN", Proceedings SIGCHI'85: Human Factors in Computing Systems, San Francisco, CA, Apr, 1985, pp. 169-175. ACM DL Reference

14. Model-based tools: Creating the UI Automatically

See slides for the lecture 14

Required Readings:

• Dan R. Olsen, Jr., "A Programming Language Basis for User Interface Management," Proceedings SIGCHI'89, Austin, TX, Apr, 1989, pp. 171-176. ACM DL Reference
• Jeffrey Nichols, Brad A. Myers, Michael Higgins, Joe Hughes, Thomas K. Harris, Roni Rosenfeld, Mathilde Pignol. "Generating Remote Control Interfaces for Complex Appliances." CHI Letters: ACM Symposium on User Interface Software and Technology, UIST'02, 27-30 Oct. 2002, Paris, France. pp. 161-170. pdf
• Angel Puerta, "A Model-Based Interface Development Environment", IEEE Software, 14(4), July/August 1997, pp. 41-47. pdf

• Brad Vander Zanden and Brad A. Myers,  "Automatic, Look-and-Feel Independent Dialog Creation for Graphical User Interfaces," Proceedings SIGCHI'90: Human Factors in Computing Systems.  Seattle, WA, April 1-5, 1990. pp. 27-34. ACM DL Reference
• Pedro Szekely, Ping Luo, and Robert Neches, "Beyond Interface Builders: Model-Based Interface Tools, Proceedings INTERCHI'93: Human Factors in Computing Systems. Amsterdam, The Netherlands, April 24-29, 1993. pp. 383-390. ACM DL Reference.
• Paterno, F., Mancini, C. & Meniconi, S. (1997), "ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models," in Proceedings of Interact-97, Sydney, Australia, pp.362-369. pdf
• Dan R. Olsen Jr., Sean Jefferies, Travis Nielsen, William Moyes and Paul Fredrickson. “Cross-modal Interaction using Xweb,” Proceedings UIST'00: ACM SIGGRAPH Symposium on User Interface Software and Technology, San Diego, CA, 2000. pp. 191-200. ACM DL Reference
• S. R. Ponnekanti, B. Lee, A. Fox, P. Hanrahan and T.Winograd. “ICrafter: A service framework for ubiquitous computing environments,” UBICOMP 2001, Atlanta, Georgia, 2001. pp. 56-75. URL
• K. Gajos, Weld, D. “SUPPLE: Automatically Generating User Interfaces,”
  IUI'04: Intelligent User Interfaces, Funchal, Portugal, 2004. pp. 93-100. pdf. See also the video.
• Jeffrey Nichols, Duen Horng Chau, Brad A. Myers, "Demonstrating the Viability of Automatically Generated User Interfaces" Proceedings CHI'2007: Human Factors in Computing Systems. San Jose, CA, April 28 - May 3, 2007. pp. 1283-1292. pdf

Homework 3 Due (postponed until Mar. 19)
Start on Homework 4

CMU Holiday - Spring Break, no classes

CMU Holiday - Spring Break, no classes

15. Interactive Tools: Prototypers (HyperCard, Director, Visual Basic), Interface Builders, Sketching Tools

See slides for the lecture 15

Required Readings:

• James Landay and Brad A. Myers. "Interactive Sketching for the Early Stages of User Interface Design," Proceedings CHI'95: Human Factors in Computing Systems. Denver, CO. May, 1995. pp. 43-50. (html) or ACM DL Ref
• James Lin, Michael Thomsen, and James A. Landay, "A Visual Language for Sketching Large and Complex Interactive Designs." In CHI Letters: Human Factors in Computing Systems, CHI 2002, 2002. 4(1): pp. 307-314. ACM DL Ref
  See also the DENIM Video (better version of video in a temporary place), (longer video, no sound)

• Brad A. Myers. "Separating Application Code from Toolkits:  Eliminating the Spaghetti of Call-Backs,"  ACM Symposium on User Interface Software and Technology: UIST'91, Hilton Head, SC, Nov. 11-13, 1991. pp. 211-220. ACM DL Reference
• Walker, M., Takayama, L., and Landay, J. (2002) High-fidelity or low-fidelity, paper or computer medium? Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (in press). 
  PDF
• James A. Landay and Brad A. Myers. Just Draw It! Programming by Sketching Storyboards.   Carnegie Mellon University School of Computer Science Technical Report, no. CMU-CS-95-199 and Human Computer Interaction Institute Technical Report CMU-HCII-95-106. November, 1995. html or PDF

16. Demonstrational Tools

See slides for the lecture 16

Required Readings:

• Brad A. Myers, Richard G. McDaniel, and David S. Kosbie. "Marquise: Creating Complete User Interfaces by Demonstration," Proceedings INTERCHI'93: Human Factors in Computing Systems. Amsterdam, The Netherlands, April 24-29, 1993. pp.  293-300. ACM DL Reference. (pdf)
• Richard G. McDaniel and Brad A. Myers, "Getting More Out Of Programming-By-Demonstration." Proceedings CHI'99: Human Factors in Computing Systems. Pittsburgh, PA, May 15-20, 1999. pp. 442-449. (Gamut) ACM DL Reference. (pdf)
• Brad Myers, Richard McDaniel and David Wolber. "Programming by example: Intelligence in Demonstrational Interfaces," Communications of the ACM. March, 2000. vol. 43, no. 3. pp. 82-89. ACM DL Reference. (pdf)

• Brad A. Myers. "Creating User Interfaces Using Programming-by-Example, Visual Programming, and Constraints," ACM Transactions on Programming Languages and Systems. vol. 12, no. 2, April, 1990. pp. 143-177.  (Peridot) ACM DL Reference
• Brad A. Myers, Brad Vander Zanden, and Roger B. Dannenberg. "Creating Graphical Interactive Application Objects by Demonstration," ACM Symposium on User Interface Software and Technology: UIST'89, Williamsburg, VA, Nov. 13-15, 1989. pp. 95-104. (Lapidary) ACM DL Reference. (see also the video excerpt)

17. Component Techniques: Andrew, OLE, OpenDoc, Java Beans, Service-Oriented Architecture (SOA)

See slides for the lecture 17

Required Readings:

• Andrew J. Palay, Fred Hansen, Mike Kazar, Mark Sherman, Maria Wadlow, Thomas Neuendorffer, Zalman Stern, Miles Bader, and Thom Peters. "The Andrew Toolkit - An Overview", Published in Proceedings USENIX Technical Conference, Winter 1988. Reproduced as ITC Technical Report 061. pdf
• Chad Vawter and Ed Roman, "J2EE vs. Microsoft.NET: A comparison of building XML-based web services," June 2001. http://www.theserverside.com/tt/articles/article.tss?l=J2EE-vs-DOTNET

• JavaBeans Web Pages, especially, the official JavaBeans tutorial, and an unofficial "NetBeans JavaBeans Tutorial": http://wiki.netbeans.org/NetBeansJavaBeansTutorial

Students Present

5) Toolkits for Mobile Devices & SmartPhones / starting with legacy devices and then focusing on iPhone and Android development - Michael Helmbrecht, Ramya Balaraman

Readings from Ramya Balaraman: "Toolkits/Frameworks available for cross-platform mobile development":

Slides for Ramya's talk

Required Readings:

• IBM, Native,web or hybrid mobile app development, 2012. IBM Software Thought Leadership White Paper, pdf on blackboard.
• Gustavo Hartmann, Geoff Stead, Asi DeGani, "Cross platform mobile development", technical report, March, 2011, Tribal, Lincoln House, The Paddocks, 347 Cherry Hinton Road, Cambridge, CB1 8DH, United Kingdom, m-learning@tribalgroup.com, pdf on blackboard
• Ohrt, J.; Turau, V., "Cross-Platform Development Tools for Smartphone Applications," IEEE Computer , vol.45, no.9, pp.72,79, Sept. 2012. IEEE dl or pdf on blackboard

• Mel Beckman, "Native, web or Hybrid - How to choose your mobile development path", InfoWorld.com (Oct 8, 2012), http://search.proquest.com/docview/1095142163 or
  http://www.infoworld.com/d/application-development/native-web-or-hybrid-how-choose-your-mobile-development-path-204079
• Inderjeet Singh, Manuel Palmieri, "Comparison of cross-platform mobile development tools", online, or pdf on blackboard

Slides for Michael's talk

Required Readings:

• An overview of what Auto Layout is and the easiest way to use it: http://blog.teamtreehouse.com/designing-user-interface-using-auto-layout
• A slightly more technical demonstration showing various use cases: http://blogs.captechconsulting.com/blog/raymond-robinson/ios-6-tutorial-series-dynamic-interfaces-auto-layout
• An example implementation: http://www.think-in-g.net/ghawk/blog/2012/09/practicing-auto-layout-an-example-of-keyboard-sensitive-layout/

• A backwards port of the system to previous versions of iOS: https://github.com/RolandasRazma/RRAutoLayout

Students Present

2) Overview of one or more of the current Microsoft architecture: WinForms, WPF, Silverlight, Windows Mobile, Live Mesh, etc. - YoungSeok Yoon

Readings from YoungSeok Yoon: "Overview of UI Development for Windows Store Apps":

Slides for YoungSeok's talk

Required Readings:

• "Quickstart: Defining layouts (Windows Store apps using C#/VB/C++ and XAML) (Windows)"
  http://msdn.microsoft.com/en-us/library/windows/apps/xaml/hh465337.aspx
• Jared Barneck, "Tutorial – Binding one element property to another"
  http://www.rhyous.com/2010/04/13/tutorial-binding-one-element-property-to-another/

Optional Readings:

• "Building apps using what you know - Windows 8 Product Guide for Developers"
  http://msdn.microsoft.com/en-us/windows/apps/hh852650#Build_apps_using_what_you_know
• "Quickstart: adding SemanticZoom controls (Windows Store apps using C#/VB/C++ and XAML) (Windows)"
  http://msdn.microsoft.com/en-us/library/windows/apps/xaml/hh781234.aspx
• "Data binding overview (Windows Store apps using C#/VB/C++ and XAML) (Windows)"
  http://msdn.microsoft.com/en-us/library/windows/apps/xaml/hh758320.aspx
• "Dependency properties overview (Windows Store apps using C#/VB/C++ and XAML) (Windows)"
  http://msdn.microsoft.com/en-us/library/windows/apps/xaml/hh700353.aspx

4) Toolkits for CSCW - Jason Tsay

Readings from Jason Tsay: "Mobile-based Groupware":

Slides for Jason's talk

Required Readings:

• Brad A. Myers, Herb Stiel, and Robert Gargiulo. "Collaboration Using Multiple PDAs Connected to a PC," Proceedings CSCW'98: ACM Conference on Computer-Supported Cooperative Work, November 14-18, 1998, Seattle, WA. pp. 285-294. local pdf
• Roth, J., 2002. Seven Challenges for Developers of Mobile Groupware. In: Workshop "Mobile Ad Hoc Collaboration", CHI 2002, Minneapolis.
  http://deposit.fernuni-hagen.de/2231/1/Seven_Challenges_for_Developers_of_Mobile_Groupware.pdf

Optional Readings:

• Greenberg, S. and Roseman, M., 1999. Groupware Toolkits for Synchronous Work. In: Beaudouin-Lafon, M. (Ed.), Trends In CSCW'99, No. 7 in Trends in Software, John Wiley & Sons, New York, NY, USA, ch. 6, pp. 135–168. pdf
• Peter Tandler. Software Infrastructure for Ubiquitous Computing Environments Supporting Synchronous Collaboration with Multiple Single- and Multi-User Devices. UbiComp'2001; Sept 30 - Oct 2, 2001; Atlanta, Georgia. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.21.7316
• Herskovic, Valeria, Sergio F. Ochoa, and Jose A. Pino. "Modeling groupware for mobile collaborative work." Computer Supported Cooperative Work in Design, 2009. CSCWD 2009. 13th International Conference on. IEEE, 2009. http://vherskov.ing.puc.cl/index.php/download_file/view/27/75/CSCWD2009-Modelinggroupware.pdf

Students Present

6) Simple User Interface Toolkits and EUP for UIs - Vishal Dwivedi

Simple UI Toolkits Vishal Slides

Required readings

• Morch, A., Stevens, G., et al. (2004) Component-based technologies for end-user development. Communications of the ACM, 47(9), pp. 59-62. ACM DL Ref
• F.H. Post and W. Barth, Construction Techniques of Graphic, Direct-Manipulation User Interfaces, EUROGRAPHICS ’91 / Elsevier Science Publishers B.V. Eurographics Association, 1991. Cite seer link

Optional Readings:

• Brad A. Myers, John F. Pane and Andy Ko, "Natural Programming Languages and Environments". Communications of the ACM. 47(9), pp. 47-52. ACM DL Ref
• Conway, M., Audia, S., Burnette, T., Cosgrove, D., Christiansen, K., Deline, R., et al. (2000, Apr 1-6). Alice: Lessons Learned from Building a 3D System For Novices. Paper presented at the Proceedings of CHI 2000, The Hague, The Netherlands. ACM DL Ref
• Pausch, R., Conway, M., & DeLine, R. (1992). Lesson Learned from SUIT, the Simple User Interface Toolkit. ACM Transactions on Information Systems, 10(4), 320-344. ACM DL Ref
• Fabio Casati: How End-User Development Will Save Composition Technologies from Their Continuing Failures. IS-EUD 2011: 4-6.  SpringerLink

End User Architecting - Vishal Dwivedi (extra credit)

EU Architecting Vishal Slides

Required papers

• Mark A. Linton, John M. Vlissides, Paul R. Calder: Composing User Interfaces with InterViews. IEEE Computer 22(2): 8-22 (1989) WebLink
• Anders I. Mørch: Application Units: Basic Building Blocks of Tailorable Applications. EWHCI 1995: 45-62 Springer Link
• David Garlan,Vishal Dwivedi,Ivan Ruchkin and Bradley Schmerl. Foundations and Tools for End-User Architecting. In Proc. 17th Monterey Workshop, Oxford, 2012, UK, Springer Ref

Optional Readings:

• LaToza, T. D. (2006). Using architecture to change code: studying information needs. In Companion To the 21st ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA) - Student Research Competition, Portland, Oregon, October 22-26. ACM link
• Nikolay Mehandjiev, Abdallah Namoune, Usman Wajid, Linda A. Macaulay, Alistair G. Sutcliffe: End User Service Composition: Perceptions and Requirements. ECOWS 2010: 139-146. IEEE DL Link
• Perla Velasco-Elizondo, Vishal Dwivedi, David Garlan, Bradley Schmerl and Jose Maria Fernandes. Resolving Data Mismatches in End-User Compositions, In Fourth International Symposium on End-User Development (ISEUD), 2013, Denmark. Web Link

14) Plug-In architectures (Photoshop, Illustrator?, Mozilla, Office, Eclipse, COM, etc.) - Yanan Qi

Students Present

8) Toolkit support for games and 3D programming - Erik Harpstead

Slides for Erik's talk

Required:

• J. Blow, “Game development: Harder Than You Think”, ACM Queue, ACM, New York, 2004, pp. 29-37. ACM DL REF
• Luis Valente and Aura Conci. Guff: A Game Development Tool. In SIBGRAPI 2005 Workshop of Theses and Dissertations in Computer Graphics and Image Processing. pdf
• Folmer, E. Component Based Game Development – A Solution to Escalating Costs and Expanding Deadlines? Proceedings 10th International ACM SIGSOFT Symposium on Component-Based Software Engineering, (2007), 65–73. (pdf on blackboard)
• Fox, M. Game Engines 101: The Entity/Component Model. Gamasutra (Oct. 12, 2010); http://www.gamasutra.com/blogs/MeganFox/20101208/88590/Game_Engines_101_The_EntityComponent_Model.php

• Unity Game Engine: http://unity3d.com/ there really isn't a good about page for Unity so I would mainly just recommend poking around and looking into the workflow description.

Optional:

• Lewis, C. and Whitehead, J. The whats and the whys of games and software engineering. Proceeding of the 1st international workshop on Games and software engineering - GAS  ’11, (2011), 1. ACM DL Ref
• Campbell, B. Swiss Army Chainsaw: A Common Sense Approach to Tool Development. Gamasutra (Sept. 21, 2006); http://www.gamasutra.com/view/feature/1819/swiss_army_chainsaw_a_common_.php
• Nelson, M.J. and Mateas, M. A requirements analysis for videogame design support tools. Proceedings of the 4th International Conference on Foundations of Digital Games - FDG  ’09, (2009), 137. ACM DL Ref (this one deals more with the design aspects no so much the development)

10) Programming for Web Services, Service Oriented Architecture (SOA): SOAP vs. REST - Lia Qu

Slides for Lia's talk

Required:

• Web Services: REST vs. SOAP/WSDL, https://www.ibm.com/developerworks/mydeveloperworks/blogs/woolf/entry/web_services_rest_vs_soap?lang=en

Optional:

• Service-oriented high level architecture, http://dl.acm.org/citation.cfm?id=2367656.2367672&coll=DL&dl=ACM&CFID=193684040&CFTOKEN=54503668
• XPath Tutorial, http://docs.oracle.com/javase/tutorial/jaxp/xslt/xpath.html
• Learn REST: A tutorial, http://rest.elkstein.org/2008/02/what-is-rest.html

7) Toolkit support for Gestural Input Techniques, Handwriting - Amber McConahy

Homework 4 Due
Start on Homework 5

Students Present

17) Declarative Visualization Toolkits - Truc Nguyen

Slides for Truc's talk

Required

• Protovis: A Graphical Toolkit for Visualization, Michael Bostock, Jeffrey Heer. IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis'09), 15(6), pp. 1121-1128, Nov/Dec 2009. http://vis.stanford.edu/papers/protovis
• Overview: http://www.d3js.org/

Other Readings

• Declarative Language Design for Interactive Visualization, Jeffrey Heer and Michael Bostock. IEEE Transactions on Visualization and Computer Graphics (Proc. InfoVis'10), Oct 2010. http://vis.stanford.edu/papers/protovis-design
• Michael Bostock, Vadim Ogievetsky, Jeffrey Heer. D3: Data-Driven Documents. IEEE Trans. Visualization & Comp. Graphics (Proc. InfoVis), 2011. http://vis.stanford.edu/files/2011-D3-InfoVis.pdf
• Chris Stolte and Pat Hanrahan. “Polaris: A System for Query, Analysis and Visualization of Multi-dimensional Relational Databases” Proceedings of the Sixth IEEE Symposium on Information Visualization, October 2000. http://graphics.stanford.edu/papers/polaris/polaris.pdf
• J.D Fekete. “The InfoVis Toolkit”, IEEE Symposium on Information Visualization 2004, pp. 167-174, 2004. https://www.lri.fr/~fekete/ps/ivtk-04.pdf
• Jeffrey Heer, Stuart Card, James Landay. “prefuse: a toolkit forinteractive information visualization” Proceedings of CHI 2005, http://vis.stanford.edu/files/2005-prefuse-CHI.pdf
• Ed Chi. A Taxonomy of Visualization Techniques using the Data State Reference Model. Proceedings of the IEEE Symposium on Information Visualization 2000 http://www-users.cs.umn.edu/~echi/papers/infovis00/Chi-TaxonomyVisualization.pdf
• www.thejit.org - JavaScript Infovis Toolkit

Graphics & Animation in Android - Juan Gonzalez

Slides for Juan's talk

Required

• http://developer.android.com/training/building-graphics.html
• Romain Guy and Chet Haase , Android 4.0 Graphics and Animations http://android-developers.blogspot.com/2011/11/android-40-graphics-and-animations.html
• Android development team, OpenGL in Android. http://developer.android.com/guide/topics/graphics/opengl.html

• Chet Haase, Android Rendering Options, http://graphics-geek.blogspot.com/2011/06/android-rendering-options.html

12) Toolkits for supporting vision, image recognition, pattern recognition from cameras as part of a user interface - Mark Baldwin (extra credit)

Slides for Mark's talk

Required Readings:

• OASIS Paper: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6070380&tag=1
• CarSafe: http://www.cs.dartmouth.edu/~campbell/carsafe.pdf
• Overview of SimpleCV: http://simplecv.org/learn/index.html

Additional Information:

• Kinect SDK Documentation: http://msdn.microsoft.com/en-us/library/hh855347.aspx
• Toolkits:
  • IVT: http://ivt.sourceforge.net/
  • OpenCV: http://opencv.org/
  • SimpleCV http://www.simplecv.org/
• Videos:
  • OASIS Video: http://vimeo.com/10756866
  • CarSafe Video: http://www.youtube.com/watch?feature=player_detailpage&v=tAd_sSfhZTw

Students Present

9) Tool support for Web programming - Yang Piao, Steve Gardiner, Jenny Kim

Yang Piao's presentation, "HTML5 & Friends And How They Change A Developer’s Life":

Slides for Yang's talk

Required Readings:

• Transforming the web into a real application platform: new technologies, emerging trends and missing pieces: http://dl.acm.org/citation.cfm?id=1982185.1982357&coll=DL&dl=ACM&CFID=170304300&CFTOKEN=56451813
• An Introduction To HTML5: http://robertnyman.com/2009/10/14/an-introduction-to-html5/
• The No-Pressure Introduction to CSS3: http://www.onextrapixel.com/2011/02/14/the-no-pressure-introduction-to-css3/

Optional Readings:

• HTML5 Semantics: http://coding.smashingmagazine.com/2011/11/18/html5-semantics/
• Articles on [HTML5 Rocks] (http://www.html5rocks.com/en/) or [HTML5 Doctor] (http://html5doctor.com/)
• and maybe documents on [WebPlatform] (http://www.webplatform.org/)

Steve Gardiner's presentation: "Tools for Javascript programming, especially libraries"

Slides for Steve's talk

Required:

• A brief tutorial on basic use of jQuery
• Nick Nikiforakis, Luca Invernizzi, Alexandros Kapravelos, Steven Van Acker, Wouter Joosen, Christopher Kruegel, Frank Piessens, and Giovanni Vigna. 2012. You are what you include: large-scale evaluation of remote javascript inclusions. CCS ’12. ACM, New York, NY, USA, 736–747
• Asger Feldthaus, Todd Millstein, Anders Møller, Max Schäfer, and Frank Tip. 2011. Refactoring towards the good parts of javascript. SPLASH ’11. ACM, New York, NY, USA, 189–190

Optional

• Douglas Crockford, “JavaScript: The World’s Most Misunderstood Programming Language”
• John Resig and Bear Bibeault, “Enter the Ninja”

• John Resig, “JavaScript Testing Does Not Scale”
• Rosson, M.B.; Ballin, J.; Rode, J., “Who, what, and how: a survey of informal and professional Web developers,” VL/HCC pp.199–206, 20–24 Sept. 2005

Jenny Kim's presentation. "Cross browser web development"

Slides for Jenny's talk

Required:

• http://www.vanseodesign.com/css/cross-browser-css/
• http://www.1stwebdesigner.com/design/tools-browser-compatibility-check/
• http://www.ece.ubc.ca/~amesbah/docs/icse11.pdf
• http://www.cc.gatech.edu/~shauvik/pubs/roychoudhary11icse_src.pdf

Optional:

• https://developer.mozilla.org/en-US/docs/Using_Web_Standards_in_your_Web_Pages/Developing_cross-browser_and_cross-platform_pages
• https://developer.mozilla.org/en-US/docs/Mobile/Mobile_Web_Development
• http://www.sandiegowebstudio.com/cross-browser-compatibility.html

CMU Holiday -- No class -- Spring Carnival

Students Present

13) Toolkits for physical objects - Kerry Chang

Slides for Kerry's talk

Required:

• Saul Greenberg, Chester Fitchett. "Phidgets: easy development of physical interfaces through physical widgets,"Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida. http://dl.acm.org/citation.cfm?doid=502348.502388

• Scott R. Klemmer, Jack Li, James Lin, James A. Landay. "Papier-Mache: toolkit support for tangible input,"Proceedings of the 2004 conference on Human factors in computing systems, p.399-406, April 24-29, 2004, Vienna, Austria, http://dl.acm.org/citation.cfm?doid=985692.985743

Optional

• Hartmann, B., Klemmer, S.R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., Gee, J. "Reflective physical prototyping through integrated design, test, and analysis." Proceedings of UIST 2006, http://dl.acm.org/citation.cfm?id=1166253.1166300&coll=DL&dl=ACM&CFID=204841319&CFTOKEN=27253311

• Brygg Ullmer , Hiroshi Ishii , Robert J. K. Jacob, "Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer-Human Interaction" (TOCHI), v.12 n.1, p.81-118, March 2005, http://dl.acm.org/citation.cfm?id=1057237.1057242&coll=DL&dl=ACM&CFID=204841319&CFTOKEN=27253311
• Kato, J., Sakamoto, D., Igarashi, T. "Phybots: a toolkit for making robotic things." Proceedings of DIS 2012, pp. 248-257
  http://dl.acm.org/citation.cfm?id=2317956.2317996&coll=DL&dl=ACM&CFID=204841319&CFTOKEN=27253311

16) Toolkit support for Usability Evaluation - Karin Tsai

Slides for Karin's talk

Required:

• David M. Hilbert and David F. Redmiles. 2000. Extracting usability information from user interface events. ACM Comput. Surv. 32, 4 (December 2000), 384-421. http://doi.acm.org/10.1145/371578.371593

14) Plug-In architectures (Photoshop, Illustrator?, Mozilla, Office, Eclipse, COM, etc.) - Truc Nguyen (extra credit)

Slides for Truc's talk

Required:

Students Present

15) Toolkits for intelligent and adaptive interfaces - Julia Schwarz

Slides for Julia's talk

Required

• Principles of Mixed-Initiative User Interfaces: http://research.microsoft.com/en-us/um/people/horvitz/chi99horvitz.pdf
• Agents that Reduce Work and Information Overload: http://portal.surrey.ac.uk/pls/portal/docs/PAGE/COMPUTING/PEOPLE/N.ANTONOPOULOS/TEACHING/CSM13%20SOFTWARE%20AGENTS/CSM13%20COURSEWORK%202006/PAPER2.PDF
• Automatically Personalizing User Interfaces: http://homes.cs.washington.edu/~etzioni/papers/weld-ijcai03.pdf

Optional

• Responsive typography experiment: http://webdesign.maratz.com/lab/responsivetypography/realtime/
• “Personalization is Overrated” http://www.nngroup.com/articles/personalization-is-over-rated/
• “Why People Hate the Paperclip: Labels, Appearance, Behavior, and Social Responses to User Interface Agents.” Chapter 2 gives good overview of literature httphttp://xenon.stanford.edu/~lswartz/paperclip/paperclip.pdf

11) Toolkits for supporting sound and speech recognition and generation - Mark Baldwin

Slides for Mark's talk

• Lee, K.-F.; Hon, H.-W.; Reddy, R., "An overview of the SPHINX speech recognition system," Acoustics, Speech and Signal Processing, IEEE Transactions on , vol.38, no.1, pp.35,45, Jan 1990. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=45616
• Automatic Speech Recognition – A Brief History of the Technology Development, http://www.ece.ucsb.edu/Faculty/Rabiner/ece259/Reprints/354_LALI-ASRHistory-final-10-8.pdf
• Resources for Toolkits discussed: http://msdn.microsoft.com/en-us/library/ee125663(v=vs.85).aspx, http://cmusphinx.sourceforge.net/wiki/tutorial

7) Toolkit support for Gestural Input Techniques, Handwriting - Lia Qu, (extra credit)

Slides for Lia's talk

Required

• T. Westeyn, H. Brashear, A. Atrash, and T. Starner. "Georgia tech gesture toolkit: supporting experiments in gesture recognition." In Proceedings of the 5th international conference on Multimodal interfaces, pages 85-92. ACM Press, 2003. (http://dl.acm.org/citation.cfm?doid=958432.958452)
• J. A. Landay and B. A. Myers. "Extending an existing user interface toolkit to support gesture recognition." In INTERACT ’93 and CHI ’93 conference companion on Human factors in computing systems, pages 91-92. ACM Press, 1993. (http://dl.acm.org/citation.cfm?doid=259964.260123)
• Jennifer Mankoff, Scott E. Hudson, Gregory D. Abowd, "Providing Integrated Toolkit-Level Support for Ambiguity in Recognition-Based Interfaces", CHI 2000: CHI Letters, vol. 2, issue 1, p. 368-375. (http://dl.acm.org/citation.cfm?doid=332040.332459)

Optional

• A look inside Leap Motion, the 3D gesture control that's like Kinect on steroids. http://www.theverge.com/2012/6/26/3118592/leap-motion-gesture-controls

No class -- during CHI'2013

No class -- during CHI'2013

Special Class, presentation of Student Constraints and Final Project Designs
Note different room and time: NSH 3002, 11:00am-1:00pm

Lunch will be provided. (Let the professor know of any diatary constraints.)

Presenters:

1. Truc Nguyen
2. Steven Gardiner
3. Vishal Dwivedi
4. Juan Gonzalez Restrepo
5. Erik Harpstead
6. Julia Schwarz
7. Karin Tsai
8. YoungSeok Yoon

Each presenter can take up to about 10 minutes.

Everyone please fill out the official university Faculty Course Evaluation and
the special evaluation for this course: http://www.surveymonkey.com/s/S3DX9XX