CORAL Research Publications

By DateBy Publication TypeBy Research CategoryBy Author (Currently at CMU)By Author (Past and Current CORAL Contributors)

Using Sparse Visual Data to Model Human Activities in Meetings

Paul Rybski and Manuela Veloso. Using Sparse Visual Data to Model Human Activities in Meetings. In Modeling Other Agents from Observations workshop at AAMAS, New York, NY, July 2004.

Download

[PDF]2.2MB  

Abstract

We have recently engaged on the challenging development of an agent to assist users in everyday office-related tasks. In particular, the agent needs to keep track of the state of their users so it can anticipate the user's needs and proactively address them. The state of the user may be easily available when the user directly interacts with their agent through a PC or PDA interface. However, when the user attends a meeting and interacts with other people, PC and PDA interfaces are not sufficient to give the agents a general view of the environment in which their users are interacting. In this paper, we introduce the CAMEO, the Camera Assisted Meeting Event Observer, which is a physical awareness system designed for use by an agent-based electronic assistant. We then present a particular aspect of CAMEO and main contribution of the paper, namely how CAMEO addresses the problem of extracting and reasoning about high-level features from real-time and continuous observation of a meeting environment. Contextual information about meetings and the interactions that take place with them is used to define Dynamic Bayesian Network classifiers to effectively infer the state of the users as well as a higher-level state of the meeting. We present and show results of the state inference algorithm.

BibTeX Entry

@InProceedings{04aamas-moo-workshop-cameo,
  author = 	 "Paul Rybski and Manuela Veloso",
  title = 	 "Using Sparse Visual Data to Model Human Activities in Meetings",
  booktitle = "Modeling Other Agents from Observations workshop at AAMAS",
  year = 	 2004,
  address = 	 "New York, NY",
  abstract="We have recently engaged on the challenging development of an agent
  to assist users in everyday office-related tasks. In particular, the
  agent needs to keep track of the state of their users so it can
  anticipate the user's needs and proactively address them. The state
  of the user may be easily available when the user directly interacts
  with their agent through a PC or PDA interface.  However, when the
  user attends a meeting and interacts with other people, PC and PDA
  interfaces are not sufficient to give the agents a general view of
  the environment in which their users are interacting. In this paper,
  we introduce the CAMEO, the Camera Assisted Meeting
  Event Observer, which is a physical awareness system designed for
  use by an agent-based electronic assistant. We then present a
  particular aspect of CAMEO and main contribution of the paper,
  namely how CAMEO addresses the problem of extracting and reasoning
  about high-level features from real-time and continuous observation
  of a meeting environment.  Contextual information about meetings and
  the interactions that take place with them is used to define Dynamic
  Bayesian Network classifiers to effectively infer the state of the
  users as well as a higher-level state of the meeting. We present and
  show results of the state inference algorithm.",
  bib2html_pubtype = {Workshop},
  bib2html_rescat = {CAMEO},
}

Generated by bib2html.pl (written by Patrick Riley ) on Tue Oct 09, 2007 00:00:14

 

 
[home] [news] [people] [robosoccer] [projects] [multimedia] [download] [publications] [contact us]