I'm interested in humanity.
I am an engineering guy, so I take an engineering approach to it.
What is Emotion?
To evaluate the external world, human beings
observe it through several information channels.
The most important thing to consider is the evaluation organ called "emotion".
"Emotion" is the mechanism which gives the
specific color to the information from every information
channels such as dangerous, pleasant, etc., whose entity is actually
the excitment distribution of the nerve systems
in the reticular nuclei of the brainstem, this nerve system
extends to the entire brain including the cerebral cortex, the frontal
lobe etc., accordingly it has great influence on the rational thinking way particularly seen in human,
and also creative activities.
Now, from the engineering point of view, this "emotion" can be treated
in the shape of 'imitating' human real
emotion by clarifying the relation
between the physical signal such as visual and acoustic signals
and the perceived emotion from them .
In terms of this 'imitaion' approach, as given in Descartes's
(1596-1650) dualism, based on the proposition that human beings solely
distinguishes self and other, the face that human cannot distinguish between the 'imitated'
emotion by the machine and the emotion expressed by other
people is supposed to be introduced, which supported the
assumption mentioned above.
Emotion & Facial Image
[Abstract] This is a test
Semi-automated
AU recognition system has developed, which integrates the
geometrical information and the appearance information on the target
face and is very useful for psychological consideration of the face
such as emotional expression.
This is at the same time an example of human
identification, which may include many kinds of aspects of human
behavior, the way of walking, talking, expressing emotions and up to
trivial habits.
[Representative articles]
[Related links]
- Top
Emotion & Speech
[Abstract]
Human has several channels to grasp the environmental state.
And I believe that the most important evaluation mechanism is EMOTION.
From the viewpoint of digital signal processing, audio infomation
doesn't have so much information as visual does, but audio component
should be indispensable for human. Suppose we don't have auditory
perception, we can't recognize invisible coming crisis, we lose music
and we even can't talk. Audio channel is very important than
recognized. :-)
[Representative articles]
-
A measurement of human vocal emotion using fuzzy control
- Evaluation of the relation between emotional concepts and emotional parameters on speech
- IEEE ICASSP 97, April 1997.
T.Moriyama,
H.Saito and
S.Ozawa
Download: pdf[100KB], ps.gz[79KB], copyrighted
- IEICE Journal Vol.J82-D-II, No.10, pp.1710-1720, October 1999.
T.Moriyama,
H.Saito and
S.Ozawa
Download: pdf[697KB], ps.gz[230KB], copyrighted
- Emotion
recognition and synthesis system on speech
- A measurement
of emotional content in speech and its application to cyber commerce
- Top
Emotion & Video on TV
[Abstract]
Focused on drama video, we human enjoy the mental unfolding
with its context. In the previous studies, in order to summarize the
content, this mental component has NEVER considered in their
methods. I think this component IS the most important one for
summarizing drama video.
[Representative articles]
- Video summarization based on the psychological unfolding of a drama
- Top
Top page
E-mail:
tmoriyam@cs.cmu.edu
< Last updated on
May/16/2001 17:59
>
