AI Security - Learning Resources
This resource is brought to you by Tejas Cyber Network which is a global, open to all, vendor agnostic, self-sustaining community of elite cyber professionals as part of its AI Security - Global Cyber Hackathon.
We are also looking for CISO, CTO, CPO, CMO, CRO, VC Advisors for the hackathon (submit your interest here), Sponsors (Sponsorship Opportunity Document) and University Campus Ambassadors (apply here). Instructions to join the community are on this website - www.tejascybernetwork.com
Frameworks
-
OWASP Top 10 for LLMs
​
Online Trainings
​
Other Resources
​
Papers
-
CSA - Securing LLM Backed Systems: Essential Authorization Practices
-
Automated Red Teaming with GOAT : the Generative Offensive Agent Tester
Articles
-
The Software Analyst Newsletter - Deep Dive Into The Security for AI Ecosystem
-
AI Security Shared Responsibility Model: Navigating Risks in AI Deployment
-
Innovation Ventures - How foundation models reshape cybersecurity tooling?
-
Menlo Ventures - Security for AI: The New Wave of Startups Racing to Secure the AI Stack
​​
GitHub repos with resources
​
Talks
-
TL;DR: Every AI Talk from BSidesLV, Black Hat, and DEF CON 2024
-
Cisco Devnet - Generative AI & Security, OWASP Top 10 for LLMs
​​
Tools
-
Microsoft - The Python Risk Identification Tool for generative AI (PyRIT)
-
MITRE - ALDERA plugin for adversary emulation of AI-enabled systems
-
Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security
-
PAIG - Open-source project designed to protect Generative AI (GenAI)
-
AI Goat - Learn AI security through a series of vulnerable LLM CTF challenges
​​
Industry Bodies
​
Games/Challenges