In-flight surveillance could foil terrorists in the sky

CCTV cameras are bringing more and more public places under surveillance, and passenger aircraft could be next. A prototype European system uses multiple cameras and Big Brother software to try and automatically detect terrorists or other dangers caused by passengers. The European Union’s Security of Aircraft in the Future European Environment (SAFEE) project uses a camera in every passenger’s seat, with six wide-angle cameras to survey the aisles. Software then analyses the footage to detect developing terrorist activity or air-rage incidents by tracking passengers’ facial expressions. The system performed well in tests this January which simulated terrorist and unruly passenger behaviour scenarios in a fake Airbus A380 fuselage, say the researchers that built it. Systems to analyse CCTV footage — for example, to detect violence (with video) or alert CCTV operators to unusual events — have been designed before, but the SAFEE software must cope with the particularly challenging environment of a full aircraft cabin.

New Scientist’s Michael Reilly writes that as crew and passengers move around they often obscure one another, causing a risk the computer will lose track of some of the hundreds of people it must monitor. To get around this, the software constantly matches views of people from different cameras to track their movements. “It looks for running in the cabin, standing near the cockpit for long periods of time, and other predetermined indicators that suggest a developing threat,” says James Ferryman of the University of Reading, one of the system’s developers. Other behaviors could include a person nervously touching their face, or sweating excessively. One such behavior will not trigger the system to alert the crew, only certain combinations of them. Ferryman is not ready to reveal specifically which behaviors were most likely to trigger the system. Much of the computer’s ability to detect threats relies on sensitive information gleaned from security analysts in the intelligence community, he tells New Scientist.

Mohan Trivedi of the University of California, San Diego, is sceptical. He has built systems that he says can track and recognize individual people as they appear and disappear on different floors of his laboratory building. It correctly identifies people about 70 percent of the time, and then only under “optimal conditions” that do not exist inside an airplane cabin, he says. “[Ferryman’s] research shows that a system detects threats in a very limited way. But it’s a very different thing using it day in and day out.” Trivedi says. “Lighting and reflections change in the cabin every time someone turns on a light or closes a window shade. They haven’t shown that they have overcome these challenges.” Ferryman admits that his system will require thousands of tests on everyday passengers before it can be declared reliable at detecting threats.

The team’s work is being presented at the International Conference on Computer Vision Systems in Greece.