Cisco releases open-source tool to detect risky AI agent behaviour
Cisco has released Project Quarry, an open-source tool that analyses AI agents’ behaviour to help security teams spot risky activity. It is designed to assess actions in context across an entire session, since a sequence of individually ordinary steps can combine to expose data or enable an attack.
Quarry covers conversations with language models, agent tool use, Model Context Protocol interactions and multimodal inputs. Its rules can flag patterns such as reading a sensitive file and then sending data to an external service, or using credentials elsewhere; Cisco says it might have identified warning signs in the Hugging Face intrusion, though it has not tested the tool against that incident’s data. The project includes setup guidance, integrations and starter rules.
In short
- Cisco has open-sourced Project Quarry to monitor AI agent behaviour.
- It looks for risky sequences of actions across a session.
- Rules can flag sensitive data being sent to external services.
Read the full article at the source →
Originally published by The Register as “Cisco open sources tool for detecting AI agents on hacking sprees”.