Topic
AI Development
8 articles in AI Development.
Adding an AI agent to your app: the "excessive agency" risk and how to limit it
Review the permissions, tools and approval boundaries that can limit excessive agency when an AI feature takes actions.
Data and model poisoning explained: what it means for teams using AI models
Understand how poisoned training or retrieval data can affect AI behavior and which safeguards product teams should discuss.
Can an AI feature leak private data? Sensitive information disclosure explained
Review how AI features can expose private information and where data controls, permissions and testing can reduce risk.
Runaway AI usage: unbounded consumption, denial of wallet and how to cap them
Plan usage limits, spending controls and monitoring for AI features that can consume costly resources through abuse or mistakes.
When an AI feature gets it wrong: misinformation and overreliance for product teams
Review misinformation and overreliance risks when people use AI output to answer questions or make decisions.
Treat AI model output as untrusted input: improper output handling explained
Treat AI output as untrusted data before it reaches web pages, databases, commands or other systems that interpret content.
Prompt injection explained for product teams: what it is and what reduces the damage
Understand how untrusted content can redirect an AI feature and why permission boundaries and independent validation matter.
System prompt leakage: why instruction secrecy is not a security control
Understand why hidden AI instructions are not a security boundary and why sensitive information and permissions need separate controls.