Prompt Injection Flaw in GitHub Actions Hits Fortune 500 Firms
Recent research by Aikido Security has identified a new class of vulnerabilities called "PromptPwnd" affecting GitHub Actions and GitLab CI/CD pipelines integrated with AI agents. These vulnerabilities have been confirmed to impact multiple Fortune 500…
Recent research by Aikido Security has identified a new class of vulnerabilities called "PromptPwnd" affecting GitHub Actions and GitLab CI/CD pipelines integrated with AI agents. These vulnerabilities have been confirmed to impact multiple Fortune 500 companies and are believed to be widespread.
The vulnerabilities involve untrusted user input being injected into AI prompts, enabling the AI agents to execute unauthorized commands. This can result in the exposure of sensitive information or the manipulation of workflows. Aikido Security has released open-source Opengrep rules to assist security vendors in detecting these vulnerabilities.
The issue arises when untrusted content from sources such as GitHub issue titles is used directly in AI prompts. Malicious instructions can be embedded within this content, leading the AI model to execute these as commands rather than interpreting them as data. This can lead to unauthorized actions, such as editing pull requests or leaking sensitive credentials.
These vulnerabilities have been confirmed to impact multiple Fortune 500 companies and are believed to be widespread.
An example of this vulnerability was found in Google's Gemini CLI repository. Aikido Security demonstrated a proof-of-concept by submitting a malicious issue with hidden instructions, which the AI agent executed, leading to the exposure of sensitive API keys. Following responsible disclosure, Google addressed the vulnerability within four days.
Restrict the toolset available to AI agents, avoiding tools that can write to issues or pull requests. Avoid injecting untrusted user input into AI prompts, or sanitize and validate it if unavoidable. Treat all AI-generated output as untrusted code and validate it before execution. Limit GitHub token access by IP address to mitigate potential damage from credential leaks.
Aikido Security provides a free tool to scan GitHub and GitLab repositories for these vulnerabilities. Additionally, developers can use open-source tools to check their .yml files.
Based on reporting by Cyber Security News.
