“Existing mobile face trackers give only an approximate position and scale of the face,” said Dr. Phil Tresadern, lead researcher on the project. “Our model runs in real-time and accurately tracks a number of landmarks on and around the face such as the eyes, nose, mouth and jaw line. A mobile phone with a camera on the front captures a video of your face and tracks twenty-two facial features. This can make face recognition more accurate, and has great potential for novel ways of interacting with your phone.”

Originally intended as part of a face- and voice-verification system for access to mobile internet applications such as e-mail, social networking, and online banking, alternative uses for the device could include fun applications that, for instance, attach virtual objects to the user’s face as they move around.

“At this stage, we’re particularly interested in demonstrating uses for the face-tracking part of the technology, which is the area The University of Manchester is involved in,” said Tresadern, who is based in Manchester’s School of Cancer and Enabling Sciences. “It is very fast and I can’t find anything that can rival it on a mobile phone.”

Face verification is already used in laptops, Webcams, and the Xbox 360 Kinect, but this is the first time the technology is being used with such sophistication in mobile devices such as smartphones.

The new software, built on twenty years of research at the university, has been demonstrated on a Nokia N900 for the EU-funded “Mobile Biometrics” (MoBio) project.

For more information about the project, visit the MOBIO Web site. A video of the mobile face tracker can be viewed on YouTube at http://www.youtube.com/watch?v=5TDO9ok4sWI