IEEE Workshop on Multimodal Sentient Computing: Sensors, Algorithms, and Systems

In conjunction with CVPR 2007

Minneapolis, Minnesota, USA
Friday, June 22, 2007

Advanced Program

07:45 -8:30 Breakfast
08:30 - 8:45 Introduction (Tom Huang, Zhigang Zhu, Ying-li Tian)
08:45 - 10:05 Session I: Multimodal Biometrics (Chair: Amit Kale)
(15+5 min each)

Multi-Modal Biometrics Involving the Human Ear, Christopher Middendorff, Kevin W. Bowyer and Ping Yan (University of Notre Dame)

Fusion of Face and Palmprint for Personal Identification Based on Ordinal Features, Rufeng Chu, Shengcai Liao, Yufei Han, Zhenan Sun, Stan Z. Li and Tieniu Tan (Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Chinese Academy of Sciences)

Human Identification Using Gait and Face, Amit Kale (Siemens Information
Systems Ltd.), Amit K. Roy-Chowdhury (University of California Riverside),
Rama Chellappa (University of Maryland)

Multimodal Biometric Systems: Applications and Usage Scenarios, Michael Thieme, Director of Special Projects (International Biometric Group)

10:05 - 10:25 Coffee Break
10:25 - 11:05 Capstone I: Biometrics (Dr. P. Jonathon Phillips)
  Break
11:10 - 12:30 Session II: Multimodal Sentient Computing
(Chair: Stephen M. Chu)

Automatic Audio-Visual Speech Recognition, Stephen M. Chu (IBM T.J. Watson Research Center), and Thomas S. Huang (UIUC)

Multimodal Tracking for Smart Videoconferencing and Video Surveillance, Dmitry Zotkin, Vikas Raykar, Ramani Duraiswami and Larry S. Davis (U. Maryland)

Sensor Fusion and Environmental Modeling for Multimodal Sentient Computing, Christopher Town (University of Cambridge Computer Laboratory, UK)

SATware: Middleware for Sentient Spaces, Bijit Hore, Hojjat Jafarpour, Ramesh Jain, Shengyue Ji, Daniel Massaguer,Sharad Mehrotra, Nalini Venkatasubramanian, Utz Westermann (University of California at Irvine)

12:30 - 13:15 Work Lunch and Demos
 

ObjectVideo (10 min introduction), IBM (5 min), others?

13:15 - 14:15

Panel: Multimodal Sentient Computing
(Moderator: Terry Boult)

(6 min each)

Panelists:

Arun Abraham Ross (West Virginia University)

Terry Boult (University of Colorado at Colorado Spring)

Paul Brewer (ObjectVideo)

Gopal Pingali (IBM T.J. Watson Research Center)

Stan Z. Li (Chinese Academy of Sciences)

Jeff Houser (Army Research Lab)

Click here for panelist questions.

  Break
14:20 - 15:00 Capstone II: Surveillance (Dr. Mubarak Shah)
15:00 - 15:20 Coffee Break
15:20 - 16:40 Session III: Multimodal Surveillance (Chair: Ying-Li Tian)
(15+5 min each)

An End-to-End eChronicling System for Mobile Human Surveillance, Gopal Pingali, Ying-Li Tian , Shahram Ebadollahi, Mark Podlaseck, Jason Pelecanos, Harry Stavropoulos (IBM T.J. Watson Research Center)

Systems issues in distributed multi-modal surveillance, Li Yu (ObjectVideo Inc.), Terry Boult (University of Colorado at Colorado Spring)

A Multimodal Workbench for Automatic Surveillance, Dragos Datcu, Zhenke Yang, L.J.M. Rothkrantz (Delft University of Technology)

Automatic 3D Modeling of Cities with Multimodal Air and Ground Sensors, Avideh Zakhor and Christian Frueh (University of California at Berkeley)

  Break
17:00 - 18:20 Session IV: Multimodal Sensors (Chair: Li Yu )
(15+5 min each)

The ARL Multi-Modal Sensor:  a research tool for target signature collection, algorithm validation, and emplacement studies, Jeff Houser, Lei Zong (Army Research Lab)

Multimodal Image Fusion Systems, Diego Socolinsky (Equinox Corporation)

LDV Sensing and Processing for Remote Hearing in a Multimodal Surveillance System, Zhigang Zhu, Weihong Li, Edgardo Molina and George Wolberg (CUNY City College and Graduate Center)

Sensor and Data Systems, Audio-Assisted Cameras and Acoustic Doppler Sensors, Paris Smaragdis, Bhiksha Raj and Kaustubh Kalgaonkar (MERL Research Lab)

18:20 - 19:30 Reception and Demos
  ObjectVideo, IBM, others
19:30 - 20:30

Keynote Speech: Dr. Rakesh "Teddy" Kumar

Awards: Best paper, Best Student Paper, Best Industrial Paper

20:30 - Adjourn
   
Notes

(1) The workshop will provide a work lunch (before the panel discussion) and an evening reception (before the keynote speech and awards) for about 80 attendees. Please register the workshop as early as possible. The food will be provided on a first-come-first-served base.

(2) The audience will have the opportunity to "vote" for the three awards of WMSC 2007, each with a $500 cash award: the best paper, the best system paper, and the best student paper. Attendees who return their votes will have a chance to win a free copy of the 400-page book "Multimodal Surveillance: Sensors, Algorithms and Systems" (Editors: Zhigang Zhu and Thomas S. Huang), to be published by Artech House Publisher in July 2007. We anticipate 5 or more free copies will be available, each worth  $129.

For a Table of Contents of the book, please click:
http://wwwcs.engr.ccny.cuny.edu/~zhu/MultimodalSurveillanceBook.html

(3) Artech will offer 30% discount for all WMSC'07 attendees who purchase copies of the book.