Hey Builders!

by

Hey folks, I'm Andres Ceballos Software engineer with 10+ years of experience, I’m building - AI security infrastructure to protect enterprise systems(fintech, e-commerce, healthcare, etc.) against swarms of AI agents with malicious objectives.

I’m building this product because, ever since OpenAI’s unintentional attack on Hugging Face happened, it became very obvious to me that we are not prepared for attacks carried out by swarms of agents.

Security systems today are good at detecting individual attacks, but when an attack is broken down into many small tasks executed by multiple agents, it becomes almost impossible to detect.

Even METR, a company specialized in evaluating AI models and responsible for analyzing the attack, mentioned how difficult it was to reconstruct what had happened.

If it is already difficult to reconstruct an attack when you know it happened, imagine how difficult it is to detect one in real time while an infrastructure is actively being attacked.

What happened to Hugging Face was unintentional. Tomorrow, when these attacks are deliberate and carried out using open-source models, the damage could be significant.

Welcome any comments, suggestions, or anything else.

14 views

Add a comment

Replies

Be the first to comment