Understanding the Risk of AI-Generated Content for Children’s Internet Safety

As artificial intelligence continues to improve, so does its use for creating online content. AI can certainly be of great assistance to improve efficiency and quality for us as humans.  However, in the wrong hands AI-generated content can also target is already being employed to bring harm in deceptive ways.

If children are using the internet, they do can become victims or cyber criminals and predators.  Most U.S. teens spend the majority of their waking hours in front of screens, according to Common Sense and the American Academy of Child and Adolescent Psychiatry.  It’s on parents to stay in the loop about what their kids do online. Knowing what they see, who they’re talking to, and what they’re sharing makes a big difference.

Beyond that, there’s no tech tool better than a good conversation. Experts at Mindful Browsing suggest, parents should block inappropriate websites to safeguard their kids from explicit content that is improper for their age.

AI is here to stay, and the jury is still “in” about how it will be controlled by companies and policy makers.  When handled properly is can help personalize learning tools for educators.  It can help create interactive educational programs.

The AI Threat Landscape

Before we can explore resourceful safeguards that parents can put into effect to protect kids online, let’s first let’s review the threats.

1. Deepfake Videos

Deepfake technology, which uses AI to create hyper-realistic video content, has started targeting young audiences. With little experience, malicious creators can quickly produce videos featuring beloved cartoon characters or influencers in inappropriate or misleading scenarios. For example, a deepfake video might show a trusted character promoting harmful behaviors or ideas, leaving children confused and vulnerable.

2. AI-Generated Chatbots

AI chatbots are increasingly mimicking the tone and style of children or trusted adults in online platforms. These bots can engage children in conversations that may seem innocent at first but can lead to unsafe interactions, such as revealing personal information or being directed to harmful websites. Unlike older scams, these interactions are harder to detect because of the sophistication of the AI.

3. Hyper-Targeted Advertising

AI algorithms now use vast amounts of data to craft ads tailored specifically to individual users. For children, this can result in the promotion of age-inappropriate content, manipulative messages, or even products disguised as games or videos. This form of targeted advertising is especially concerning as children often lack the skills to distinguish between genuine content and sponsored material.

Steps Parents and Educators Can Take

1. Teach Kids Media Literacy

Helping children recognize manipulative or harmful content is critical to ensuring children are prepared.  This is basic critical thinking 101, which applies to anything they may see, read, or hear.

Parents can teach their kids to:

• Question the authenticity of videos and images.
• Spot inconsistencies in chat interactions, including texts and social media messages.
• Understand the concept of sponsored content and its purpose.
• Be aware that even a caller may be an AI generated voice.

2. Protect Devices and Personal Info

Make sure devices are up to date. Software updates often include security patches that protect against hackers. Antivirus software is another must-have.

Cameras and webcams should stay covered when not in use. Hackers can access them, and that’s an easy way to increase safety.

Set privacy settings on social media to make accounts private. Limit who can see posts or send friend requests. These steps might seem small, but they’re huge for keeping your child’s info safe.  Make sure your family uses strong passwords—a mix of numbers, symbols, and letters. Consider two-step verification for an added layer of safety.

3. Use AI-Enhanced Parental Controls

Modern parental control apps, such as Qustodio now incorporate AI-driven features to flag harmful or suspicious content. Parents should explore these tools to monitor their children’s online activity and receive alerts about potentially dangerous interactions.

Solutions for Educators and Policymakers

1. Advocate for Improved AI Regulation

Governments and advocacy groups must push for stronger regulations to govern the use of AI in creating and distributing online content. Policies should require platforms to invest in AI detection tools capable of identifying deepfakes and harmful AI-generated material.

2. Develop Educational Programs

Schools can include digital literacy courses that specifically address the risks of AI-generated content. This would empower children to navigate the internet safely and critically.

Teach kids the basics of cybersecurity.  A good way to educate yourself is to take our three-part series on scams.   You can begin here.

3. Hold Platforms Accountable

Parents and educators alike can pressure tech companies to must take greater responsibility for the content on their platforms. Some are already using AI to fight the bad actors who are using AI for deviant purposes.  This does not mean companies should not also invest in human moderation teams and work transparently with experts to address emerging risks.