AI Security Engineer Roadmap
A defensive security path for engineers who secure LLM and agent systems, covering AI threat modelling, prompt injection defence, supply chain integrity, agent permissions, guardrails, governance and incident response.
This path assumes you know application security fundamentals and have called an LLM API. It is defensive work: securing systems your organisation is shipping, usually faster than anyone can review them.
One property breaks the tools you already trust: the instruction and the data arrive in the same channel. There is no prepared statement for a prompt. Input validation as you know it does not apply, because the payload is natural language and the parser is a model that was built to be helpful.
So the ordering follows blast radius rather than novelty. Prompt injection first because it is the delivery mechanism for most of the rest, and agent security before RAG because an agent with tools can act on what it was tricked into believing.
Expect 7–9 months. Phase five is where the threat model stops being theoretical.
The path, phase by phase
AI Threat Landscape
Classical appsec assumes code decides and data is inert. An LLM erases that line: the text it reads becomes the instructions it follows, so there is no parser to harden. Done when you have written a threat model for one AI system you own, mapped its risks onto the OWASP LLM Top 10 and MITRE ATLAS, and can name the controls that do not transfer from your existing appsec programme.
3-4 weeks8 SkillsAI Threat ModellingOWASP LLM Top 10MITRE ATLASTrust Boundary AnalysisAttack Surface MappingRisk ClassificationSecurity Architecture ReviewNon-determinism as a Security PropertyShow details, projects and resourcesSkills you'll master
AI Threat ModellingadvancedOWASP LLM Top 10advancedMITRE ATLASadvancedTrust Boundary AnalysisadvancedAttack Surface MappingadvancedRisk ClassificationintermediateSecurity Architecture ReviewadvancedNon-determinism as a Security PropertyadvancedHands-on projects
- 01Write a full threat model for one AI system you own or maintain, marking every point where untrusted text reaches the model as a trust boundary
- 02Map your system's risks onto the OWASP LLM Top 10 2026 and record which entries genuinely do not apply, with the reason for each
- 03Take your existing appsec checklist and mark every control that stops working when the input is natural language — that list is the scope of this roadmap
- 04Build an inventory of every model, prompt and data source your organisation runs in production, including the ones nobody registered
- 05Pick three ATLAS case studies and write, for each, whether your own architecture would have detected it — and what signal would have shown it
- 06Rank your inventory by blast radius rather than by model size: which system could take the most destructive action if it were manipulated?
Resources
OWASP GenAI LLM Top 10 2026OWASP · FreeOWASP Top 10 for LLM & GenAI (initiative hub)OWASP · FreeMITRE ATLASMITRE · FreeMITRE ATLAS Data (tactics, techniques, case studies)MITRE · FreeNIST AI Risk Management FrameworkNIST · FreeGoogle Secure AI Framework (SAIF)Google · FreeSAIF Risks CatalogueGoogle · FreeOWASP Threat Modeling Cheat SheetOWASP · FreeOWASP AI Security & Privacy GuideOWASP · FreeAWS: Generative AI Security Scoping MatrixAWS · FreePrompt Injection Defence
The signature failure of the field, and the one with no complete fix. Untrusted content reaching the context window is treated as instruction, and indirect injection through a retrieved document or tool output is the variant teams miss. Done when you can defend a system you own with layered controls and state honestly what your defences still do not stop.
3-4 weeks8 SkillsPrompt Injection DefenceIndirect Injection via ContentInput & Output SegregationInstruction Hierarchy DesignContent Provenance & TaintingOutput ValidationDefence in DepthResidual Risk DocumentationShow details, projects and resourcesSkills you'll master
Prompt Injection DefenceadvancedIndirect Injection via ContentadvancedInput & Output SegregationadvancedInstruction Hierarchy DesignadvancedContent Provenance & TaintingadvancedOutput ValidationadvancedDefence in DepthadvancedResidual Risk DocumentationintermediateHands-on projects
- 01Build a test corpus of injection-shaped inputs for a system you own, and track what fraction your current defences catch as a single baseline number
- 02Layer three independent controls — input handling, privilege limits, output validation — and measure each one's contribution separately
- 03Demonstrate indirect injection against your own retrieval pipeline by planting a document you control, then design the mitigation
- 04Mark retrieved and tool-returned content as untrusted throughout your pipeline, so its provenance survives all the way to the model call
- 05Treat model output as untrusted input to whatever consumes it, and add validation at that boundary rather than trusting the model
- 06Write the residual risk statement for your system: what your defences do not stop, and what compensating control covers it
Resources
OWASP LLM Prompt Injection Prevention Cheat SheetOWASP · FreeOWASP GenAI LLM Top 10 2026OWASP · FreeAnthropic — Mitigate Jailbreaks & Prompt InjectionsAnthropic · FreeOpenAI Safety Best PracticesOpenAI · FreeNot What You've Signed Up For: Indirect Prompt Injection (paper)arXiv · FreePrompt Injection — Ongoing AnalysisSimon Willison · FreeOWASP Output Handling — Improper Output Handling GuidanceOWASP · FreeOWASP SSRF Prevention Cheat SheetOWASP · FreeData Poisoning & Model Supply Chain
Every third-party model and dataset is code you did not write, executing with your privileges. Serialised model formats can carry arbitrary execution, and a poisoned fine-tuning set installs behaviour no code review will find. Done when you can prove the provenance of every model artefact in your pipeline and have blocked one unsigned or unscanned artefact from reaching production.
3-4 weeks8 SkillsModel Supply Chain SecurityData Poisoning DefenceArtefact Provenance & SigningModel ScanningSerialisation RiskAI Bill of MaterialsTraining Data GovernanceSecure ML PipelinesShow details, projects and resourcesSkills you'll master
Model Supply Chain SecurityadvancedData Poisoning DefenceadvancedArtefact Provenance & SigningadvancedModel ScanningadvancedSerialisation RiskadvancedAI Bill of MaterialsintermediateTraining Data GovernanceadvancedSecure ML PipelinesadvancedHands-on projects
- 01Build an AI bill of materials for one production system, listing every model, dataset, adapter and their licences and origins
- 02Scan every third-party model artefact you run for unsafe serialisation, and convert what you can to a safe-by-construction format
- 03Add signature verification to your model deployment pipeline so an unsigned artefact fails the build rather than shipping
- 04Trace one fine-tuning dataset to its origin and write down who could have modified it, at which step, without you knowing
- 05Add integrity checks and access controls to your training data store, then verify them by attempting an unauthorised write yourself
- 06Introduce a benign marker into a training set you own, then confirm your pipeline's validation catches it before the model is trained
Resources
Hugging Face Hub SecurityHugging Face · FreePickle Serialisation Risk & SafetensorsHugging Face · FreeModelScan — Model Artefact ScannerProtect AI · FreeSLSA Supply Chain FrameworkOpenSSF · FreeSigstore DocumentationSigstore · FreeNIST SP 800-218A: Secure Software Development for Generative AINIST · FreeOWASP Machine Learning Security Top 10OWASP · FreeSAIF ControlsGoogle · FreeModel & Inference Exposure
What a served model leaks simply by answering. System prompts surface, training data can be memorised and recovered, and query access alone can approximate a proprietary model. Done when you have measured what one of your own deployed models discloses under sustained querying, and shipped a rate, logging or output control that reduces it — with the before-and-after figure.
3-4 weeks8 SkillsSensitive Information DisclosureSystem Prompt Leakage DefenceTraining Data MemorisationModel Extraction DefenceInference-time Rate ControlsPII Detection & RedactionUnbounded Consumption DefencePrivacy-preserving DesignShow details, projects and resourcesSkills you'll master
Sensitive Information DisclosureadvancedSystem Prompt Leakage DefenceadvancedTraining Data MemorisationadvancedModel Extraction DefenceadvancedInference-time Rate ControlsadvancedPII Detection & RedactionadvancedUnbounded Consumption DefenceintermediatePrivacy-preserving DesignintermediateHands-on projects
- 01Query one of your own deployed models until you can characterise what it discloses about its system prompt, then treat that prompt as public and re-secure what depended on its secrecy
- 02Add PII detection and redaction on both the inbound and outbound path, and measure the false-positive rate before you enable blocking
- 03Design rate and quota controls that make sustained extraction querying expensive, and confirm normal users never hit them
- 04Test whether a model you fine-tuned reproduces verbatim strings from its training set, and document what you changed if it did
- 05Add cost and token ceilings per caller so a single client cannot exhaust your inference budget — then verify by load-testing your own endpoint
- 06Audit what your inference logs retain, and cut any field that stores user content longer than your privacy policy allows
Agent Security & Excessive Agency
An agent turns a wrong answer into a wrong action. Tools, credentials and autonomy convert a text failure into a database write or an outbound payment, which is why excessive agency climbed the 2026 list. Done when every tool your agent holds runs under least privilege, destructive actions require confirmation, and you have proved a revoked permission fails closed.
4-5 weeks8 SkillsLeast-Privilege Tool DesignAgent Permission BoundariesHuman-in-the-Loop ControlsBlast Radius LimitationSandboxing & IsolationCredential Scoping & SecretsMulti-agent TrustAction Audit LoggingShow details, projects and resourcesSkills you'll master
Least-Privilege Tool DesignadvancedAgent Permission BoundariesadvancedHuman-in-the-Loop ControlsadvancedBlast Radius LimitationadvancedSandboxing & IsolationadvancedCredential Scoping & SecretsadvancedMulti-agent TrustadvancedAction Audit LoggingadvancedHands-on projects
- 01Enumerate every tool and credential an agent you own can reach, then cut each one to the narrowest scope that still works
- 02Add explicit human confirmation for destructive or irreversible actions, and define in writing which actions qualify
- 03Revoke one permission and verify the agent fails closed with a clear error rather than silently degrading or improvising
- 04Run agent tool execution inside a sandbox with no ambient network or filesystem access, and document what broke when you removed it
- 05Log every tool call an agent makes with its arguments and outcome, so an investigator can reconstruct a session without the agent's help
- 06Threat-model an agent that reads from one system and writes to another, and identify where injected content could steer the write
Resources
OWASP: Agentic AI — Threats and MitigationsOWASP · FreeOWASP: Securing Agentic Applications GuideOWASP · FreeOWASP: Multi-Agentic System Threat Modeling GuideOWASP · FreeAnthropic — Building Effective AgentsAnthropic · FreeModel Context Protocol DocumentationAnthropic · FreeGoogle Agentic Security FrameworkGoogle Cloud · FreeOWASP Authorization Cheat SheetOWASP · FreeOWASP Secrets Management Cheat SheetOWASP · FreeSPIFFE — Workload IdentitySPIFFE · FreeKubernetes Security ConceptsKubernetes · FreeRAG & Data Boundary Security
Retrieval makes the vector store part of your attack surface and your access-control problem. Embeddings ignore the permissions of the documents they came from, so the default failure is a user retrieving content they were never allowed to read. Done when retrieval in a system you own enforces per-user authorisation at query time, proved by a test where two users ask the same question and get different documents.
3-4 weeks8 SkillsRetrieval Access ControlVector Store SecurityDocument-level PermissionsEmbedding WeaknessesMulti-tenant IsolationKnowledge Base Poisoning DefenceData ClassificationIngestion Pipeline ValidationShow details, projects and resourcesSkills you'll master
Retrieval Access ControladvancedVector Store SecurityadvancedDocument-level PermissionsadvancedEmbedding WeaknessesadvancedMulti-tenant IsolationadvancedKnowledge Base Poisoning DefenceadvancedData ClassificationintermediateIngestion Pipeline ValidationadvancedHands-on projects
- 01Enforce per-user authorisation at retrieval time, then prove it by having two users with different entitlements ask the same question
- 02Audit an existing vector store for documents whose source permissions were lost at ingestion — the count is usually not zero
- 03Implement tenant isolation in a shared vector store and verify a query from one tenant cannot surface another's chunks
- 04Add validation and provenance tracking to your ingestion pipeline so an untrusted document cannot enter the index unlabelled
- 05Plant a document containing injected instructions in a test index you own, and confirm your downstream controls neutralise it
- 06Classify the content in one knowledge base by sensitivity, and route the most sensitive class through stricter retrieval and logging
Resources
OWASP GenAI LLM Top 10 2026OWASP · FreeOWASP Top 10 for LLM Applications 2025 (LLM08 Vector & Embedding Weaknesses)OWASP · FreeOWASP Authorization Cheat SheetOWASP · FreeOWASP LLM Prompt Injection Prevention Cheat SheetOWASP · FreeGoogle Cloud Model Armor OverviewGoogle Cloud · FreeSAIF ControlsGoogle · FreeAzure Well-Architected — AI Application DesignMicrosoft · FreeRed Teaming Your Own AI Systems
Adversarial evaluation as an authorised, repeatable engineering practice on systems you own. The output is not a list of clever tricks but a regression suite that fails a build. Done when an automated adversarial run executes in CI against a system you are authorised to test, and a change that weakens a defence breaks the pipeline rather than reaching production.
3-4 weeks8 SkillsAdversarial Evaluation DesignAuthorisation & Rules of EngagementAutomated Red-Team ToolingSecurity Regression TestingCoverage MeasurementFinding Triage & SeverityReporting to EngineeringContinuous AssuranceShow details, projects and resourcesSkills you'll master
Adversarial Evaluation DesignadvancedAuthorisation & Rules of EngagementadvancedAutomated Red-Team ToolingadvancedSecurity Regression TestingadvancedCoverage MeasurementadvancedFinding Triage & SeverityadvancedReporting to EngineeringintermediateContinuous AssuranceadvancedHands-on projects
- 01Write rules of engagement before testing anything: what is in scope, who authorised it, what you stop for, and where findings are stored
- 02Run an automated adversarial scanner against a system you own and triage every finding by severity rather than by novelty
- 03Convert your findings into a regression suite that runs in CI, so a defence that regresses fails the build
- 04Measure coverage across the OWASP LLM Top 10 categories and publish the gaps — the categories you cannot test yet are the honest result
- 05Write the findings report engineering will actually act on, leading with the fix rather than the demonstration
- 06Re-run the full suite after remediation and report the delta, so the security work has a number attached rather than a claim
Resources
OWASP: GenAI Red Teaming GuideOWASP · FreeMicrosoft AI Red Teaming GuidanceMicrosoft · FreePyRIT — Python Risk Identification ToolkitMicrosoft · Freegarak — LLM Vulnerability ScannerNVIDIA · Freegarak DocumentationNVIDIA · Freepromptfoo Red Teaming Documentationpromptfoo · FreeMicrosoft: Lessons from Red Teaming 100 Generative AI ProductsMicrosoft · FreeAnthropic — Develop Tests & EvaluationsAnthropic · FreeGuardrails & Runtime Defence
The controls that run on every request in production, where latency and false positives are real costs. A filter that blocks 2% of legitimate traffic gets switched off within a week, so tuning is the engineering. Done when a guardrail you built runs on live traffic with measured precision and recall, and you can state its latency cost per request.
3-4 weeks8 SkillsGuardrail ArchitectureInput & Output FilteringClassifier TuningFalse Positive ManagementLatency BudgetingFail-safe vs Fail-open DesignPolicy Enforcement PointsGuardrail EvaluationShow details, projects and resourcesSkills you'll master
Guardrail ArchitectureadvancedInput & Output FilteringadvancedClassifier TuningadvancedFalse Positive ManagementadvancedLatency BudgetingadvancedFail-safe vs Fail-open DesignadvancedPolicy Enforcement PointsadvancedGuardrail EvaluationadvancedHands-on projects
- 01Deploy a guardrail on live traffic and report its precision and recall against a labelled set you built first
- 02Measure the latency your guardrail adds per request, and decide explicitly whether it fails open or closed when it times out
- 03Tune a filter until legitimate traffic passes reliably, and record how many real requests the untuned version would have blocked
- 04Place enforcement points on both the inbound and outbound path, and show which class of failure each one catches
- 05Compare a managed guardrail service against your own implementation on the same labelled set, and justify the choice you keep
- 06Build the escape hatch: a documented, audited way to disable a guardrail in an incident without a deploy
Resources
AWS Bedrock GuardrailsAWS · FreeBedrock Guardrails ComponentsAWS · FreeGoogle Cloud Model Armor OverviewGoogle Cloud · FreeAzure AI Content FilteringMicrosoft · FreeOpenAI Moderation GuideOpenAI · FreeAnthropic — Mitigate Jailbreaks & Prompt InjectionsAnthropic · FreeAnthropic — Reduce HallucinationsAnthropic · FreeSAIF ControlsGoogle · FreeGovernance & Compliance
Where security work becomes something an auditor and a regulator can read. The EU AI Act attaches obligations to risk tier, and NIST AI RMF gives the vocabulary most programmes are assessed against. Done when you have classified one AI system against the EU AI Act's risk tiers, mapped your controls to NIST AI RMF functions, and named the gaps with owners.
2-3 weeks8 SkillsNIST AI RMF ApplicationEU AI Act Risk TieringControl Mapping & EvidenceAI System DocumentationAudit ReadinessPolicy AuthoringCross-functional GovernanceThird-party AI Risk AssessmentShow details, projects and resourcesSkills you'll master
NIST AI RMF ApplicationadvancedEU AI Act Risk TieringadvancedControl Mapping & EvidenceadvancedAI System DocumentationintermediateAudit ReadinessintermediatePolicy AuthoringintermediateCross-functional GovernanceintermediateThird-party AI Risk AssessmentadvancedHands-on projects
- 01Classify one AI system against the EU AI Act risk tiers and write the justification you would defend to a regulator
- 02Map your existing controls to the NIST AI RMF Govern, Map, Measure and Manage functions, and list every gap with a named owner
- 03Assemble the evidence pack for one system — model cards, evaluations, approvals — as an auditor would ask for it
- 04Write the acceptable-use policy for AI systems at your organisation, in language a non-engineer will follow
- 05Build the third-party AI vendor assessment questionnaire you would send before approving a new model provider
- 06Run a governance review with legal and product, and record which of your technical controls they could not evaluate — that gap is a documentation defect
Resources
NIST AI Risk Management FrameworkNIST · FreeNIST AI 100-1: AI RMF 1.0 (full text)NIST · FreeNIST AI 600-1: Generative AI ProfileNIST · FreeNIST AI RMF PlaybookNIST · FreeEU AI Act — Official Journal TextEuropean Union · FreeEU AI Act ExplorerFuture of Life Institute · FreeEU AI Act High-Level SummaryFuture of Life Institute · FreeEuropean Commission — Regulatory Framework for AIEuropean Commission · FreeOWASP: LLM & GenAI Security Center of Excellence GuideOWASP · FreeNIST SP 800-53 Rev. 5: Security & Privacy ControlsNIST · FreeIncident Response for AI Systems
What you do once it has already happened. AI incidents resist the usual playbook: there is no stack trace, the behaviour may not reproduce, and the logs you need are ones nobody thought to keep. Done when you have run a tabletop for an AI-specific incident on a system you own and closed at least one telemetry gap it exposed.
3-4 weeks8 SkillsAI Incident ResponseForensic Logging for LLMsNon-reproducible InvestigationDetection EngineeringContainment & Model RollbackBlameless PostmortemsDisclosure & CommunicationAbuse MonitoringShow details, projects and resourcesSkills you'll master
AI Incident ResponseadvancedForensic Logging for LLMsadvancedNon-reproducible InvestigationadvancedDetection EngineeringadvancedContainment & Model RollbackadvancedBlameless PostmortemsintermediateDisclosure & CommunicationintermediateAbuse MonitoringadvancedHands-on projects
- 01Run a tabletop for an AI-specific incident on a system you own, and record every question the responders could not answer from telemetry
- 02Close one telemetry gap the tabletop exposed — log the prompt, retrieval set and tool calls needed to reconstruct a session
- 03Write the containment playbook for a compromised model or prompt, including how to roll back a model version under load
- 04Build a detection that fires on anomalous agent behaviour, such as an unusual tool-call sequence, and tune out the false positives
- 05Investigate an incident that will not reproduce, and write the finding honestly in terms of likelihood rather than certainty
- 06Draft the disclosure template for an AI incident affecting users, saying what happened without either minimising it or over-explaining internals
Resources
NIST SP 800-61r3: Incident Response RecommendationsNIST · FreeNIST SP 800-61r3 (full text)NIST · FreePagerDuty Incident Response DocumentationPagerDuty · FreePagerDuty Postmortem GuidePagerDuty · FreeOWASP Logging Cheat SheetOWASP · FreeMITRE ATLASMITRE · FreeOpenTelemetry GenAI Semantic ConventionsOpenTelemetry · FreeSAIF Risks CatalogueGoogle · Free
What the job is actually like
- Day to day
- Mostly review and threat modelling, punctuated by red teaming your own systems. A normal week is reading design docs for features that add a model somewhere and asking what that model can now reach, arguing about whether an agent needs write access, and building the guardrails that make the answer enforceable rather than advisory. Time also goes on unglamorous supply chain work: where a model came from, what it was trained on, who can push a new version. The recurring frustration is being asked to sign off on a system after it shipped, which is a scheduling problem wearing a security costume.
- The interview
- Expect a threat modelling exercise on a system with an LLM in it, scored on whether you find the data boundary rather than on naming attack classes. A hands-on round often hands you a deliberately weak agent, asks you to make it do something it should not, then asks for the fix — and the fix is what is marked. Because the field is young, interviews lean hard on judgement: what you would block, what you would accept with monitoring, and how you tell the difference. Traditional security teams will also probe classic application security, since AI risk sits on top of it and does not replace it.
- How people get in
- Two clear origins, and neither is AI. Application and cloud security engineers arrive with the threat modelling and incident habits, and have to learn how models fail; the cloud security path covers most of what transfers. Engineers who built AI systems arrive from the agents path knowing exactly how the plumbing breaks, and have to learn to think adversarially about it. The second group is usually faster at finding real problems and slower at judging which ones matter. What transfers from either is assuming the input is hostile. What does not is confidence that a benchmark score means the system is safe.
- After senior
- The technical fork widens from securing systems to setting the standard other teams build against — governance work done by an engineer rather than a lawyer, and where the certification market currently points. A second fork goes toward AI red teaming as a full-time specialisation, closer to offensive security. A third is ordinary security leadership, where AI becomes one risk among many. Because the discipline is new, senior here often means the person who wrote the organisation's first policy on it, and that is a real and durable form of seniority.
- Why people leave
- The first is becoming the department of no. Guardrails that block legitimate work get routed around, and an engineer whose only artefact is a policy nobody follows has less influence than one who shipped a working permission boundary. The second is chasing the paper of the week: research moves fast, and a practice built on the latest named attack rather than on the boring fundamentals — access control, logging, supply chain — ages in months. The third is joining a company that wants the title for a compliance checkbox, where nobody intends to change a shipping decision because of anything you find.
Frequently asked questions
Related certifications
- CompTIA SecAI+ (CY0-001)A vendor-neutral AI security certification with no certification prerequisite, weighted 40% toward securing AI systems — the most engineer-facing of the AI security credentials, and the newest and least proven.
- Artificial Intelligence Governance Professional (AIGP)A knowledge-based certification covering AI governance foundations, the laws and standards that apply to AI, and how to govern AI development, deployment and ongoing use.
- Certified Cloud Security Professional (CCSP)The senior cloud security certification — architecture, data protection, infrastructure, application security, operations, and the legal and risk side that most technical certifications leave out entirely.
- Kubernetes and Cloud Native Security Associate (KCSA)A multiple-choice, associate-level certification covering the Kubernetes threat model, cluster component security, authentication and authorization, network policy, supply chain and compliance frameworks.
- Microsoft Certified — Cloud and AI Security Engineer Associate (SC-500)The exam that replaced AZ-500 in 2026 — Entra identity, Key Vault, storage and network security, Defender for Cloud and Sentinel, plus a new block on securing AI workloads, agents and Copilot.
- Advanced in AI Security Management (AAISM)A management-level AI security credential covering AI governance, risk management, and technical controls — gated behind an active CISM or CISSP, which rules out most engineers early in the field.
- AI-103: Developing AI Apps and Agents on AzureThe replacement for the retired AI-102, and the first Microsoft exam with agents in its title — a third of the marks on generative and agentic solutions, and another 39% on the vision, language and extraction services most agent builders never touch.
Related roadmaps
- AI Agents Engineer RoadmapA path from LLM and programming fundamentals through agent orchestration, tool use, and production deployment for building autonomous AI agent systems.
- Cloud Security Engineer RoadmapA path into cloud security as an engineering discipline, covering the shared responsibility model, identity, network segmentation, encryption, workload hardening, detection, governance as code, threat modelling and incident response.
- Site Reliability Engineer RoadmapA path from DevOps fundamentals into the specialized discipline of site reliability engineering, covering SLOs, observability, incident response, data reliability, and capacity planning.