Making AI Safer for Kids: Introducing KidRails for LLMs
The internet wasn’t built with kids in mind—but we’re changing that.
AngelQ and Arcee AI have just launched KidRails for LLMs, an open-source framework designed to make AI-generated responses age-appropriate, safe, and transparent for kids.
At its core, KidRails for LLMs is a groundbreaking approach to training AI to engage with children responsibly. The first test model, fine-tuned using a model-agnostic process, is based on Llama 3.1 8B, but the framework is open to anyone who wants to build on it.
Our goal? A safer, smarter AI that understands what’s appropriate for young users.
(Tim Estes and Mark McQuade sit down to discuss KidRails for LLMs.)
Why KidRails Matters
Kids are spending more time online, but much of what they encounter isn’t designed for them.
“The internet is a powerful resource, but it wasn’t built with children in mind,” says Tim Estes, CEO of AngelQ. “We’re making sure that changes—so parents can trust AI to support their kids, not expose them to harmful content.”
With a shared commitment to transparency, KidRails for LLMs is model-agnostic and available as an open-source project. It includes:
Training data used to ensure the model's child-friendly responses
Evaluation criteria and validation scores to measure its effectiveness and appropriateness
Complete process for fine-tuning KidRails or adapting it to other models
“This isn’t just about one model,” says Mark McQuade, CEO of Arcee AI. “We’re creating an open standard for how AI systems can interact safely with kids.”
“AngelQ believes there are no competitors in this field; however, we can’t achieve our goals alone. Making the internet safer for kids requires a collective effort. That’s why we’ve made our process open for anyone to develop and enhance the models of their choice,” continued Estes.
KidRails' introduction establishes a new standard for transparent and accountable AI, serving as a trusted tool for educators, parents, and developers. But this is just the start—technology companies and others must build upon this foundation to ensure AI remains safe for kids today and in the future.
AngelQ is a mission-driven technology company focused on developing innovative AI systems that prioritize children's well-being. With a focus on ethical AI, the company works to create models that ensure safe, age-appropriate interactions with technology, making it a trusted resource for parents, educators, and developers. To learn more about AngelQ, please visit: https://www.angelq.ai/
About Arcee AI
Arcee AI is at the forefront of AI innovation and specializes in developing and deploying language models. The company focuses on creating highly specialized, efficient, and effective AI solutions tailored to the needs of various industries. Through continuous research and development, Arcee AI is committed to pushing the boundaries of what AI can achieve. To learn more about Arcee, please visit: https://www.arcee.ai/
