Motion Synthesis of Conversations for Background Characters
Friday, April 12th, 2019 from 12-1 pm in GHC 6501.
Social scenes are common in many video games and movies. To realistically recreate such scenes in computer graphics, it is critical to animate the conversing human characters. A social scene typically contains foreground characters and background characters. While foreground characters are the focus of the scene and thus are carefully created by artists, the sole purpose of background characters is to render the atmosphere and to add realism to the environment. However, with traditional content creation tools, the artists often need to spend as much time animating the background characters as the foreground characters, despite that the exact behavior of the background characters is not critical to the experience -- they only need behave naturally so that they do not detract the audience. In this talk, I will introduce a system I have developed that helps artists to rapidly generate the animations for the talking characters in the background. The system automatically generates the body motions for two talking characters from an audio recording of a conversation. In order to produce natural looking animations, the system must ensure that the characters’ body motions are smooth and are synchronized with the rhythm of the audio. For example, a speaker often uses hand gestures as they are stating an important point, and a listener will nod to acknowledge what the speaker is saying.
The Student Seminar Series is an informal research seminar by and for SCS graduate students from noon to 1 pm on Mondays and Fridays. Lunch is provided by the Computer Science Department (personal thanks to Debbie Cavlovich!). At each meeting, a different student speaker will give an informal, 40-minute talk about his/her research, followed by questions/suggestions/brainstorming. We try to attract people with a diverse set of interests, and encourage speakers to present at a very general, accessible level.
So why are we doing this and why take part? In the best case scenario, this will lead to some interesting cross-disciplinary work among people in different fields and people may get some new ideas about their research. In the worst case scenario, a few people will practice their public speaking and the rest get together for a free lunch.
Note: Step #1 below are applicable to all SSS speakers. You can schedule AT MOST THREE talks per semester.
SSS is an ideal forum for SCS students to give presentations that count toward fulfilling their speaking requirements. The specifics, though, vary with each department. For instance, students in CSD will need to be familiar with the notes in Section 8 of the Ph.D. document and follow the instructions outlined on the Speakers Club homepage. Roughly speaking, these are the steps:
Qing Zheng, CSD