CALL FOR PARTICIPATION
AIED-2001 Workshop on Tutorial Dialog Systems
Sunday, May 20, 2001
San Antonio, TX
To be held during AI-ED
2001, the 10th International Conference on Artificial Intelligence
in Education, San Antonio, Texas, May 19-23, 2001.
Deadline for paper submissions: March 15, 2001
General Topic
Special Focus
Paper Submissions
Intended Audience
Workshop Format
Outcome
Submission Information
Important Dates
Organizing Committee
GENERAL TOPIC
Human one-on-one tutoring is the most effective form of instruction. Although
the best intelligent tutoring systems have been shown to be more effective
than classroom instruction, they are only half as effective as human tutors.
Much of the success of human tutors seems to hinge on their ability to
engage students in dialog. It is therefore an interesting and promising
hypothesis that intelligent tutoring systems will be more effective if
they engage students in dialog or support effective dialog between learners.
This raises a number of broad research questions:
-
what is good tutorial dialog?
-
why is it effective?
-
what kind of architectures can support good tutorial dialog?
The workshop will deal with all issues related to these broad questions,
including (but not limited to) empirical studies of tutorial discourse,
the use of natural language understanding and generation technologies,
the representation of pedagogical strategies and knowledge, the use of
dialog and text planning, and studies of the effectiveness of tutorial
dialog systems.
Although the field of AI & Education has a long-standing interest
in these questions, they are more in the foreground now than before, due
to advances in technologies such as natural language processing, knowledge
representation, virtual reality, and multi-modal interfaces. The recent
AAAI Fall Symposium on the topic of tutorial dialog systems reflects the
surge of interest in both the AI & Education and computational linguistics
communities.
SPECIAL FOCUS: UNDERSTANDING THE TRADE-OFFS BETWEEN ARCHITECTURAL COMPLEXITY
AND PEDAGOGICAL EFFECTIVENESS
The workshop will focus on understanding the trade-offs between the complexity
of a tutorial dialog system and its pedagogical effectiveness. Tutorial
dialog systems tend to be complex. They contain not just the components
found traditionally in intelligent tutoring systems, but many other components
as well, such as a parser, semantic analyzer, dialog planner, text planner,
natural language realization component, and a virtual reality module. In
the face of this complexity, it is good to ask, where is the biggest bang
for the buck? What level of architectural complexity gives the greatest
pedagogical pay-off? Is adding complexity always a good thing? What minimum
level of complexity is required? Complexity can be measured, among other
ways, in terms of development effort or the elaborateness of the architecture.
Effectiveness on the other hand can be measured as the range of dialog
phenomena that the system supports, the generality of the approach, the
ease of maintenance, or, ultimately, the students' learning gains.
It may well be that the trade-offs differ depending on the application
domain, the overall pedagogical approach of the system, and the purpose
for which it uses natural language processing. Nonetheless, it is likely
that some common trade-offs, and ways of dealing with them, can be found
that hold across domains.
PAPER SUBMISSIONS
We invite papers dealing with a broad range of topics related to the empirical
analysis of educational dialog and the development of tutorial dialog systems.
We especially encourage paper submissions that fall within the special
focus of the workshop.
In order to facilitate discussion during the workshop, we strongly encourage
authors who choose to focus on architectural trade-offs to:
-
Place their system in the following taxonomy (of course, only those aspects
that are relevant need to be considered):
-
strong/weak parsing,
-
strong/weak semantic interpretation,
-
strong/weak dialog planning,
-
strong/weak domain reasoning,
-
strong/weak student modeling,
-
strong/weak text/gesture/graphics generation.
-
Give a motivation for their placement decision. For example, does the choice
reflect a research hypothesis? A development strategy? Anything else?
-
Discuss the tradeoffs of their decision, highlighting the strengths as
well as the limitations. Empirical evidence of the system's performance
is especially welcome, for instance in the form of examples or evaluation
of the learning gains of students who worked with the system.
In focusing on the special theme, we encourage authors to look beyond
their own domain and use examples from other researchers as well. Individuals
from separate labs are encouraged to submit collaborative and/or comparative
papers. One way of doing this would be to team up with a colleague working
from a different institution, and write a paper comparing and contrasting
the respective approaches or systems.
INTENDED AUDIENCE
The intended audience for this workshop are, in the first place, researchers
working on the development of educational systems that support dialog.
Researchers working on issues related to the analysis or modeling of tutorial
dialog may also find this workshop of interest.
WORKSHOP FORMAT
The workshop will consist of paper presentations, discussion sessions,
and possibly a demo session.
The workshop will be organized thematically. Approximately three themes
will be selected based on the paper submissions. Possible themes include
(but are not limited to):
-
natural language understanding v. generation,
-
statistical v. knowledge-based approaches to natural language understanding
and generation,
-
reactive planning v. finite state machines,
-
use of AI planning algorithms v. production system approaches to dialog
management,
-
multi-level dialog management and planning v. a single level,
-
separate tutorial and domain planning/reasoning v. integrated, and
-
domain-dependent v. domain-independent tutorial strategies.
There will be one session per theme, led by a person knowledgeable in that
area. During each session, there will be a small number of paper presentations
followed by a discussion and a brief wrap-up by the session leader. The
discussion will focus on comparing and contrasting the approaches and on
exploring whether and when certain positions along the various tradeoffs
are more promising than others.
The presenters will be asked to relate their papers to the session theme
as part of their presentation. Further, presenters will be asked to study
the other papers in their session, so that during their presentation, they
can compare and contrast their approach to others, as a way to kick off
the discussion. We plan to make available the accepted papers to all workshop
participants
beforehand in order to ensure an informed discussion.
OUTCOME
All accepted papers and abstracts will be made available on the workshop
web site, which will be lined to the AI-ED main conference web site. Short
summaries of each session will also be posted on the web site.
SUBMISSION INFORMATION
We invite two types of submissions: 1-2 page abstracts and 8-10 page long
papers. Authors of long papers are requested to include a 200-word abstract.
Those interested in doing a demo of their system during the workshop are
asked to submit a 1-2 page demo abstract, or if they submit a long paper,
to indicate that they would like to demo their system.
In all submissions, please use fonts that are 10 points or larger and
margins that are 1 inch or wider. Please include contact information for
the first author. All paper submissions will be reviewed by members of
the organizing committee. Authors of accepted long papers will be invited
to give a presentation during the workshop. Authors of accepted abstracts
may be invited to give a presentation, as time permits.
Electronic submissions are especially encouraged, preferably in PDF
format. Please send electronic submissions to aleven@cs.cmu.edu. When submitting
in hardcopy form, please send four paper copies to:
Vincent Aleven
Human Computer Interaction Institute
Carnegie Mellon University
5000 Forbes Ave
Pittsburgh, PA 15213
USA
IMPORTANT DATES
15 March Papers submissions due
5 April Notification
of acceptance
25 April Camera-ready copy due
FOR FURTHER INFORMATION
For any inquiries related to this workshop, please contact Vincent Aleven
(aleven@cs.cmu.edu).
ORGANIZING COMMITTEE
Vincent Aleven
Human Computer-Interaction Institute
Carnegie Mellon University
aleven@cs.cmu.edu
Mark Core
Human Communication Research Centre
University of Edinburgh
markc@cogsci.ed.ac.uk
Jerome Lehuen
Equipe Langue et Dialogue
Laboratoire d'Informatique
Universite du Maine
Jerome.Lehuen@lium.univ-lemans.fr
Rachel Pilkington
Computer Based Learning Unit,
The University of Leeds,
R.M.Pilkington@cbl.leeds.ac.uk
Carolyn Penstein Rose
Learning Research and Development Center
University of Pittsburgh
rosecp+@pitt.edu
Florence M. Reeder
George Mason University /
The MITRE Corporation
freeder@mitre.org
Jeff Rickel
USC Information Sciences Institute
rickel@ISI.EDU
Peter Wiemer-Hastings
Human Communications Research Centre
University of Edinburgh
peterwh@cogsci.ed.ac.uk
Beverly Park Woolf
Department of Computer Science
University of Massachusetts
bev@cs.umass.edu