Computer vision equips surveillance software with ‘privacy protection’
26 April 2024
Image: Assistant Professor Yogesh Rawat | University of Central Florida
New software employs computer vision to safeguard individuals' privacy, while speeding up the process of surveillance.
Computer vision can be a valuable tool for anyone tasked with analysing hours of footage because it can speed up the process of identifying individuals. For example, law enforcement may use it to perform a search for individuals with a simple query, such as “Locate anyone wearing a red scarf over the past 48 hours.”
With video surveillance becoming more and more ubiquitous, Assistant Professor Yogesh Rawat, a researcher at the UCF Center for Research in Computer Vision (CRCV), is working to address privacy issues with advanced software installed on video cameras. His work is supported by $200,000 in funding from the U.S. National Science Foundation’s Accelerating Research Translation (NSF ART) programme.
“Automation allows us to watch a lot of footage, which is not possible by humans,” Rawat says. “Surveillance is important for society, but there are always privacy concerns. This development will enable surveillance with privacy preservation.”
His video monitoring software protects the privacy of those recorded by obscuring select elements, such as faces or clothing, both in recordings and in real time. Rawat explains that his software adds perturbations to the RGB pixels in the video feed – the red, green and blue colours of light – so that human eyes are unable to recognise them.
“Mainly we are interested in any identifiable information that we can visually interpret,” Rawat says. “For example, for a person’s face, I can say ‘This is that individual’, just by identifying the face.
“It could be the height as well, maybe hair colour, hair style, body shape – all those things that can be used to identify any person. All of this is private information.”
Since Rawat aims to have the technology available in edge devices, devices that are not dependent on an outside server such as drones and public surveillance cameras, he and his team are also working on developing the technology so that it’s fast enough to analyse the feed as it is received.
This poses the additional challenge of developing algorithms that can process the data as quickly as possible, so that graphics processing units (GPUs) and central processing units (CPUs) can handle the workload of analysing footage as it is captured.
To that end, his main considerations in implementing the software are speed and size.
“We want to do this very efficiently and very quickly in real time,” Rawat says. “We don't want to wait for a year, a month or days.
“We also don't want to take a lot of computing power. We don't have a lot of computing power in very small GPUs or very small CPUs. We are not working with large computers there, but very small devices.”
The funding from the NSF ART program will allow Rawat to identify potential users of the technology, including nursing homes, childcare centres and authorities using surveillance cameras.
Rawat says his work in computer vision is motivated by a drive to improve our world. “I'm really interested in understanding how we can easily navigate in this world as humans,” he says.
“Visual perception is something I'm very interested in studying, including how we can bring it to machines and make things easy for us as humans and as a society.”