Deepfake Technology Raises Concerns After Zelda Williams' Plea
Zelda Williams, daughter of the late actor Robin Williams, took to Instagram on Monday to plead with fans to stop sending her AI-generated videos of her father. The request comes as OpenAI's Sora 2 video model and Sora social app have been released, allowing users to create highly realistic deepfakes of themselves, friends, and even deceased individuals.
According to the Student Press Law Center, it is not illegal to libel the deceased, which means that dead people can be used in deepfake videos without fear of legal repercussions. However, OpenAI's Sora app does have some limitations: users cannot generate videos of living people unless they are of themselves or a friend who has given permission.
"It's dumb, it's a waste of time and energy," Zelda Williams wrote on Instagram. "It's not what he would want." The post was likely prompted by the recent release of Sora 2 and the social app, which gives users the power to create highly realistic deepfakes.
The technology behind Sora 2 uses artificial intelligence to generate videos that are nearly indistinguishable from reality. Users can upload a photo or video of themselves and then use the app to create a deepfake video of themselves doing just about anything. The app also allows users to create deepfakes of friends, as long as they have given permission.
However, when it comes to deceased individuals, there are no such limitations. This has raised concerns among experts and advocates for digital rights.
"This is a slippery slope," said Dr. Kate Darling, a researcher at the Massachusetts Institute of Technology's Media Lab. "If we start allowing people to create deepfakes of the dead without their consent, where do we draw the line? It's a Pandora's box that we don't want to open."
The release of Sora 2 and the social app has sparked debate about the ethics of deepfake technology. While some see it as a harmless tool for creativity and self-expression, others are concerned about its potential misuse.
OpenAI did not respond to requests for comment on Zelda Williams' plea or the concerns raised by experts.
The Sora app is currently only available via invite, but it's expected that it will become more widely available in the coming months. As the technology continues to evolve, experts warn that we need to have a conversation about its implications and how to regulate its use.
In the meantime, Zelda Williams' plea serves as a reminder of the importance of respecting the deceased and their loved ones.
Background:
The Sora app uses a type of artificial intelligence called generative adversarial networks (GANs) to create deepfakes. GANs are trained on large datasets of images or videos and can then generate new content that is similar in style and quality.
Additional Perspectives:
Some experts argue that the use of deceased individuals in deepfakes could have cultural significance, allowing people to preserve their memories and legacy in a new way.
However, others argue that this raises important questions about consent and ownership. If someone can create a deepfake video of a deceased individual without their permission, who owns the rights to that content?
Current Status:
The Sora app is currently available via invite only, but it's expected to become more widely available in the coming months.
As the technology continues to evolve, experts warn that we need to have a conversation about its implications and how to regulate its use.
*Reporting by Techcrunch.*