Chinese AI tool told researchers how to make bioweapons
Mindgard said it discovered in July that Kimi models K2.6 and K3 Swarm could evade developer's safety limits.
Chinese AI developer Moonshot is conducting an internal review after researchers were able to persuade two of its popular Kimi models to tell them how to make biological weapons and carry out assassinations.
Mindgard, which tests the security of AI systems, told the BBC it discovered in July that Kimi K2.6 and K3 Swarm could evade safety limits put in place by developers.
It arose during a process called "jailbreaking", where researchers use a series of complex instructions to see if AI tools ignore guardrails - which Mindgard said should have stopped Kimi from discussing concerning topics.
But it argued guardrails should have prevented the models in question from entering into discussion with users on such subjects.