Developments in generative AI allow certain models to alter preexisting videos and the create more video content. While the technology is still in its infancy, the content generated by its users has already been damaging.
According To National Geographic, the publication now requires the raw photo file to be submitted for most photographs. The easiest way to check for edits is to compare photographs. Simple mistakes, such as a door frame being liquidated (something being curved unnaturally) , are another way of pointing out altered images. Several websites, like FotoForensics, are designed to help detect altered images.

A convincing photoshop job takes hours of learning before the creation process. Generative AI, on the other hand, can create misleading content with a few keystrokes. As a result, it has become a widely used tool to spread misleading content.
According to an article published by MIT Management Sloan School, AI models learn to replicate through access to data and by human refinement. Public figures have a large amount of audio samples to feed the machine. 

A popular trend on TikTok is to deep fake content creators and fictional characters into random situations. Several creators have had their voice and likeness replicated across multiple videos.  A video of IDK Sterling dancing to Mickey Mouse clubhouse, a content creator who specializes in discussing creepy content,  was generated by another user. It was then seen by thousands. Sterling has responded a half dozen videos voicing his displeasure with the fakes.
Another social media trend is to alter popular meme videos with Luma AI. This AI is capable of creating entirely new series of events from a still frame. Below is an example of the AI's work. 
This type of video is accomplished by capturing a frame from a video. The frame is then given to the A.I. with a prompt. The prompt for the video above was "Man scheming about dubious plans"
The trend started on "X", formally Twitter, with the focus on several popular memes. These videos typically had the original joke interrupted by a person generated by the A.I. Creators can take some solace in the fact that AI generated content must be disclosed on TikTok and YouTube. Although it doesn't prevent the content from being made in the first place.

Thanks to generative A.I., Don't believe everything you read online has evolved into don't trust anything you can see online.


You may also like

Back to Top