AI Chatbot Bug Bounty: Recon and Prompt-Injection Testing

· 17:58 · Watch on YouTube ↗

Summary

A bug bounty walkthrough demonstrates finding AI features in program scopes, inspecting chatbot requests, and probing system-prompt and rendering behavior. It also sets a challenge to find indirect prompt-injection paths.

Key points

  • The presenter uses the HackerOne API to find accessible bug bounty programs mentioning AI features; the example output redacts private programs.
  • The video recommends asking chatbots about their capabilities and inspecting network requests and responses through a proxy to understand their backend behavior.
  • In an Adobe Firefly demonstration, the presenter observes a Gemini Flash model identifier and image-generation requests. A job-result link required authentication when opened.
  • Testing suggestions include probing for prompt injection, system-prompt disclosure, tool information, and markdown or HTML rendering.
  • A HubSpot chatbot returned prompt-like instructions after repeated prompts. The presenter explicitly says this disclosure alone is not a vulnerability.
  • The chatbot rendered a markdown hyperlink and some HTML formatting; image rendering did not work in the demonstration. No data exfiltration was demonstrated.
  • The guest's challenge is to find an indirect prompt-injection location that causes a chatbot to respond in a pirate voice.

Article Details

Topics
  • [00:00] Series premise: learning AI chatbot security through bug bounty demonstrations and guest challenges.
  • [01:26] Finding AI features in bug bounty scopes using the HackerOne API and keyword-based program discovery.
  • [04:41] Reconnaissance of chatbot requests and responses through a proxy, including the Adobe Firefly example.
  • [09:20] Suggested chatbot tests, including capability discovery, tool probing, prompt injection, and rendering behavior.
  • [11:31] A testing framework covering prompt injection, system-prompt extraction, jailbreaks, data exposure, and indirect injection.
  • [13:31] Testing a HubSpot chatbot for prompt disclosure and markdown or HTML rendering.
  • [16:12] Challenge to identify an indirect prompt-injection location that changes a chatbot's response.