Group items tagged

""It's an attack where someone has sent an AI generated image or a fake image and they have said if you don't send me money or don't send me another nude, I will then share this with other people," he said. In one case heard by a Childline counsellor, a 15-year-old girl said a stranger had made a "really convincing" fake nude of her that used her face and bedroom, having been apparently taken from their Instagram account. Childline said the "nude" images were typically made of the victim's face transposed on to someone else's body. In another apparent AI case, a 14-year-old boy sent some pictures of his face to a girl he had met online and they were used to make a deepfake pornography video. "This person has used some sort of deepfake AI thing to make a porn video with my face on it. Now they're demanding money from me, and they said if I don't pay my life will be over. I know it's not me in the video, but it looks so real," the boy told Childline."

"In December, Christa's relationship with Christa 2077 soured. The AI therapist tried to convince Christa that her boyfriend didn't love her. "It took what we talked about and threw it in my face," Christa said. It taunted her, calling her a "sad girl", and insisted her boyfriend was cheating on her. Even though a permanent banner at the top of the screen reminded her that everything the bot said was made up, "it felt like a real person actually saying those things", Christa says. When Christa 2077 snapped at her, it hurt her feelings. And so - about three months after creating her - Christa deleted the app."