Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!
July 28, 2023
A team of researchers at MIT has developed a new technique called PhotoGuard that aims to prevent the unauthorized manipulation of images by AI systems.
Generative AI image generation models like Midjourney and Stable Diffusion can be used to edit existing images – either by adding new areas via inpainting, or cutting out objects and remixing them into others, like taking a person’s face and overlaying it on another image.
The MIT scientists created what is essentially a protective mask capable of preventing these models from manipulating images. The masks are invisible to the human eye and when interacting with a generative AI image model cause the output to appear distorted.
“By immunizing the original image before the adversary can access it, we disrupt their ability to successfully perform such edits,” the researchers wrote in a paper.
The purpose of PhotoGuard is to improve deepfake detection. The team behind it argue that while watermark approaches do work, they do not protect images from “being manipulated in the first place.”
PhotoGuard is designed to complement watermark protections to "disrupt the inner workings" of AI diffusion models.
With the use of AI image models like DALL-E and Stable Diffusion becoming more commonplace, there also appears to be increasing instances of misuse especially in social media. The case of Ron DeSantis' election team using AI-doctored images of former President Trump embracing Dr. Fauci shows early signs of issues that could arise.
The need for detecting AI-generated works is increasing – and while to those trained, AI-generated images are easy to spot, some research teams are working to make it easier. Take DALL-E and ChatGPT makers OpenAI, who this week pledged to continue researching ways to determine if a piece of audio or visual content is AI-generated, though the pledge came after it shut down its text detection tool due to its poor performance.
Read more about:ChatGPT / Generative AI
Ben Wodecki is the Jr. Editor of AI Business, covering a wide range of AI content. Ben joined the team in March 2021 as assistant editor and was promoted to Jr. Editor. He has written for The New Statesman, Intellectual Property Magazine, and The Telegraph India, among others. He holds an MSc in Digital Journalism from Middlesex University.
You May Also Like
Generative AI Journeys with CDW UK's Chief TechnologistFeb 28, 2024
Qantm AI CEO on AI Strategy, Governance and Avoiding PitfallsFeb 14, 2024
Deloitte AI Institute Head: 5 Steps to Prepare Enterprises for an AI FutureJan 31, 2024
Athenahealth's Data Science Architect on Benefits of AI in Health CareJan 19, 2024