Safeworld raises $12 million to address safety concerns in GenAI-powered robots

Safeworld has emerged from stealth with a seed round of more than $12 million, led by Shine Capital and a16z Speedrun, with additional investment from Box Group, Carnegie Mellon University Endowment, Innovation Endeavors, and SV Angel. The company is focused on addressing the safety concerns that arise when generative AI models are used to control robots. This move comes as the robotics industry increasingly relies on AI to manage complex tasks, raising questions about predictability and control.

Dr. Ding Zhao, who directs the Safe AI lab at Carnegie Mellon University, has been working on this problem for nearly his entire career. Along with veteran startup executive Kyle Wong and machine learning engineer Simo Rachidi, he has founded Safeworld to tackle the challenges of ensuring safety in AI-powered robotics. The company aims to develop industry-wide standards that can be applied during the design and deployment of robots, ensuring that they operate safely and predictably.

The time to build an industry safety standard is now while robots are being designed and deployed, according to a16z Speedrun partner Jonathan Lai. This sentiment is echoed by many in the field, who recognize that as AI becomes more integrated into robotics, the need for robust safety protocols becomes more urgent. Safeworld's approach involves creating a framework that can be adopted by manufacturers and developers to ensure that AI-driven robots are safe and reliable.

The implications of Safeworld's efforts extend beyond the immediate need for safety standards. As AI becomes more deeply integrated into robotics, the cost of ensuring safety could rise, potentially affecting the overall cost of robotic systems. Additionally, the development of industry standards may lead to increased vendor lock-in, as companies may rely on specific frameworks or tools provided by Safeworld or its partners. Governance and regulatory considerations will also play a significant role in shaping the future of AI-powered robotics, influencing how these systems are developed, deployed, and monitored.

Safeworld is still in the early stages of its development, with much work ahead to establish its vision for AI safety in robotics. The company's success will depend on its ability to collaborate with industry leaders, regulators, and academic institutions to create a comprehensive and widely adopted safety framework. As the field continues to evolve, Safeworld's efforts may set a precedent for how AI-driven robotics are managed in the years to come.