#DidYouKnow

Stay Safe on the Internet: AI, Deepfakes, and Predators

The internet is getting riskier with AI and new predators. Here’s how to stay safe.

The internet is our hangout spot, study buddy, and even our therapy space. But we don’t talk enough about its darker side. It’s not all trending TikTok dances and #HopeCore vibes. Creeps, scammers, and now AI-driven predators are making it harder than ever to stay safe on the internet. There’s a lot going on that is straight up scary. Technology’s evolving so fast we might as well be living in a Black Mirror episode. From deepfakes to child sexual abuse material (CSAM), the risks are growing, and we need to stay ahead.

What is CSAM? Why does it matter?

CSAM stands for ‘Child Sexual Abuse Material‘. It’s a term used by UNICEF and the Malaysian government, in line with international standards, to emphasize the seriousness of this issue. Why not just call it ‘child pornography’? Because it’s not ‘just porn’. It’s evidence of a crime, a violation of a child’s dignity and safety. CSAM includes sexually explicit images or videos of children in situations they never agreed to and should never be in.

Sadly, CSAM is easier to find than we’d like to think. Apparently, there are social media platforms selling  access to these materials for as little as RM1. In one joint Royal Malaysia Police and MCMC operation, over 40,000 files were seized at the end of 2024.

If you ever come across CSAM, please don’t just scroll past it; report it. Under the Sexual Offences Against Children Act 2017, making, sharing or possessing CSAM can result in up to 30 years in jail and at least six strokes of the rotan.

The dangers of AI: Deepfakes are here!

As if human predators weren’t enough, now we have AI in the mix. Welcome to the twisted world of deepfakes – images, videos, or audio made using artificial intelligence to mimic real people.

In South Korea, students were caught for creating and sharing Deepfake nudes of their classmates or family members on Telegram. A similar case happened at the Singapore Sports School where male students used deepfake technology to make fake nudes of their female classmates. Notice a toxic pattern, yet?

What’s scarier is that these apps – called “nudify apps” – aren’t hidden on the dark web – they’re easily accessible. If that doesn’t raise some red flags, I don’t know what will. Imagine how unsafe this makes the internet for children and young people, especially girls.

How to Stay Safe on the Internet

So, what can we do to protect ourselves? The first step is awareness.

    • Protect your peace. Keep your personal info locked. Don’t overshare, even if someone seems chill.
    • If it feels off, it probably is. Trust your gut and don’t let anyone make you feel uncomfortable. The block button exists (not just for your exes).
    • Private, not secret. Don’t let random people have access to your life. Have a finsta, it’s more fun. 
    • Stay vigilant. Don’t fall for random links, fake giveaways, or “too good to be true” offers.
    • Keep an eye out for deepfakes. If a video or pic seems off, trust it’s probably fake. AI can’t match your level of wit, don’t fall for it.
    • Speak up. If you feel like something’s shady, tell a trusted adult. You’re not being dramatic about it, trust me.
    • Report CSAM: Use the Internet Watch Foundation’s portal to report anything you suspect is harmful.

If someone creates deepfake nudes of you or non-consensually leaks your nudes (or a friend’s), make a police report immediately. Share everything you know, including screenshots, as evidence. After that, report the incident to the Malaysian Communications and Multimedia Commission (MCMC). Legal action can be taken against the offender under Malaysian law.

What happens then: The leaked pictures will likely be taken down. However, it’s important to understand that this doesn’t guarantee the material will be fully removed from the internet.

Building a safer digital world

Keeping the internet safe shouldn’t be entirely on us young people.

For starters, tech companies must do better. We need strict laws requiring platforms to proactively detect, block, takedown and report CSAM. Nudify apps shouldn’t even exist let alone be so easily accessible. The 2024 arrest of Telegram CEO in France sent a strong message: Tech companies that ignore their role in keeping young people safe should face serious consequences. It’s time the ICT sector prioritized protecting young people over convenience or profit.

Schools also play a crucial role. Quality age-appropriate comprehensive sex education can empower children and young people with knowledge about consent, boundaries, and harmful behaviours without shame or judgement. Teachers must create a safe and open learning space where girls and boys can learn about their sexuality without stigma.

The internet is amazing, but let’s not ignore the very real risks. Staying safe on the internet takes effort, but it’s worth it. Use your power to block, report and speak up for better policies and enforcement. Together we can make the digital world safer for everyone.


Need Help? Reach Out.

If you or someone you know is affected, support is available:

4.5 2 votes
Article Rating
What’s your Reaction?
0%
0%
0%
67%
33%
0%
0%
Show More

Riot Rose

I am a Klang Valley-residing 20-something aiming to resonate with other fellow youth on matters like children's rights, mental health, and other things that keep me fuelled!
Subscribe
Notify of
guest

0 Comments
Inline Feedbacks
View all comments

Related Articles

Back to top button