Designing for the inevitable: System prompt leakage and mitigations in generative AI applications

Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.

Originaltext der Quelle (nicht übersetzt) – die deutsche Zusammenfassung findest du im Tab „Kurzfassung".

System prompts form the foundation of generative AI applications. A system prompt is a collection of instructions and operational context provided to a large language model (LLM) that shapes how the model behaves and interacts with users and tools. System prompts often contain proprietary information, including role definitions, behavioral guidelines, tool descriptions and usage instructions, placeholders for conversation history and user metadata, Retrieval-Augmented Generation (RAG) context, and API responses. As organizations build increasingly sophisticated AI applications, protecting system prompts becomes an important aspect of securing generative AI applications. System prompt leakage is one of the frequently reported security findings in generative AI applications and appears in the recent 2025 OWASP LLM Top 10 as LLM07. In this post, I explore why system prompt leakage doesn’t currently have a complete remediation, how to design applications with this reality in mind, and practical mitigation controls you can implement using Amazon Bedrock Guardrails and other mechanisms to reduce exposure and help increase applications resistance against system prompt leakage. This post covers LLM07‘s recommended defenses, and introduces additional defense-in-depth mechanisms that you can implement using Amazon Web Services (AWS). What are system prompt leaks? System prompt leaks occurs when a generative AI application discloses its instructions or operational contextual information. A common technique is prompt injection, where carefully crafted inputs from threat …

Vollständiger Originalartikel ↗

• Betroffenheit im eigenen Stack prüfen: Versionen/Komponenten abgleichen.
• Originalquelle / Hersteller-Advisory lesen: https://aws.amazon.com/blogs/security/designing-for-the-inevitable-system-prompt-leakage-and-mitigations-in-generative-ai-applications/
• Verfügbaren Patch oder Workaround einspielen und dokumentieren.