|
Research Interests Dr. De la Torre's research interests include machine learning, signal processing and computer vision, with a focus on understanding human behavior from multimodal sensors (e.g. video, body sensors). I am particularly interested in three main topics: · Human Sensing: Modeling and understanding human behavior from sensory data (e.g. video, motion capture, audio). This work is motivated by applications in the fields of human health, computer graphics, machine vision, biometrics, and human-machine interface. I co-lead the human sensing lab at CMU, for more information see Human Sensing Lab. · Component Analysis (CA): CA (e.g. kernel PCA, Normalized Cuts, Multidimensional Scaling) are a set of algebraic techniques that decompose a signal into relevant components for classification, clustering, modeling, or visualization. I am keen on using CA methods to efficiently and robustly learn models from large amounts of high dimensional data. The theoretical focus of my work is to develop a unification theory for many component analysis methods. I lead the component analysis lab at CMU, which can be found at Component Analysis Lab. · Face Analysis: Developing algorithms for real-time face tracking, recognition, and expression/emotion analysis. Current projects |
|
|
|
|
|
|
|
Human Sensing This project aims to compute quantitative behavioral measures related to depression severity from facial expression, body gestures and vocal prosody in clinical interviews. Learning facial indicators of deception. Machine learning algorithms to detect hot flashes in women
using physiological measures.
Use of machine learning techniques to predict the injury
pattern of the Anterior Cruciate Ligament (ACL) using non-invasive methods.
We are working to create an intelligent assistant to help
patients and clinicians work together to manage diabetes at a personal and
social level. This project uses machine learning to predict the effect that
patient specific behaviors have on blood glucose. Tracking multiple people in indoor environments with the
connectivity of Bluetooth devices.
QoLT is a unique partnership between Carnegie Mellon and
the A multimodal database of subjects performing the tasks
involved in cooking, captured with several sensors (audio, video, motion
capture, accelerometer/gyroscope). Component
Analysis (CA) Methods
This project aims to find the fundamental
set of equations that unifies all component analysis methods. A convex
optimization relaxation framework for feature selection |
|
|
|
Finding low dimensional embeddings of signals optimal for modeling, classification, visualization and clustering. |
|
|
|
Learning optimal
representations Learning optimal representations for classification, image alignment, visualization and clustering. |
|
|
|
|
|
|
|
Face Analysis
Image
Alignment with Parameterized Appearance Models (PAMs) Image alignment with parameterized appearance models (e.g. Active Appearance Model, Morphable Models, Eigentracking) Recognizing people from images and videos. Detecting facial features in
images. |
|
|
|
|
|
|
|
Temporal Segmentation
Temporal
segmentation of human motion |
|
|
|
A two-step approach temporally segment facial gestures from video sequences. It can register the rigid and non-rigid motion of the face |
|
|
|
Summarization
of daily activity from multimodal data (audio, video, body sensors and
computer monitoring) |
|
|
|
|
|
|