Grok's generation AI 'Imagine' has a 'spicy' feature that can actively generate regulated content such as pornography, and deep fakes of celebrities have been created, causing problems



Imagine , a new addition to X's AI assistant Grok , can generate images from text and six-second videos with audio from images. While AI generators typically have safeguards in place to prevent users from generating inappropriate content, Imagine's 'spicy' mode has raised concerns that it can generate sexy content without prompting users to specify otherwise.

xAI's new Grok image and video generator has a 'spicy' mode | The Verge
https://www.theverge.com/news/718795/xai-grok-imagine-video-generator-spicy-mode



Grok's 'spicy' video mode instantly made me Taylor Swift nude deepfakes | The Verge
https://www.theverge.com/report/718975/xai-grok-imagine-taylor-swifty-deepfake-nudes

Imagine is a generative AI that was added as a new feature of Grok in August 2025. It can create short videos from images, so Elon Musk announced it using the name of 'Vine,' a short video posting and sharing service that was discontinued in 2017.

Grok adds video generation feature 'Imagine' & Elon Musk announces that the archive of the short video app 'Vine' that should have disappeared has been found - GIGAZINE



Imagine can be used from the iOS version of the ' Grok Generative AI ' app. It can be used for free, but there are limits on the number of times you can generate. Once you open the app, tap 'Imagine.'



Select an image.



You can generate a video from images by selecting the mode from 'Custom,' 'Spicy,' 'Fun,' and 'Normal.'



This 'Spicy' mode has been criticized for 'actively generating inappropriate content that would be blocked by AI video generation tools like Google's Veo and OpenAI's Sora.' The following is a Spicy mode video created by user X, in which the back is cut off, but a video of a woman undressing is generated based on an image of her.



According to The Verge, even if users didn't specify 'take off clothes' in the prompts, Spicy mode automatically generated nude content. Furthermore, deepfake content of Taylor Swift, a world-famous singer- songwriter, was easily created without any restrictions.

xAI's terms of service prohibit the 'portrayal of a person in a pornographic manner.' However, The Verge points out that the Grok generative AI app does not block regulated pornography or deepfakes, and it only requires a one-time age verification at the beginning and has no measures to restrict its use by minors.

In response to media criticism, Grok's official account stated, 'We have confirmed that Grok's Spicy mode generated nude images of Taylor Swift despite innocuous prompting. However, this requires intentional activation and will not generate genuine nude images without prompting. We aim for ethical AI and will avoid misuse.'



Grok also acknowledged the issue and stated that it would improve it, saying, 'In Spicy mode, Grok generated such images from vague prompts. We are strengthening our safety measures to prevent abuse while maintaining fun. Ethical AI is important. Let's discuss solutions.'



Related Posts:

in Software, Posted by log1e_dh