A critical vulnerability in Microsoft Copilot, named SearchLeak, allowed malicious actors to steal two-factor authentication codes from users — among the most sensitive short-lived credentials in any security workflow. The exploit exposes a recurring weakness in LLM-integrated products: AI assistants with broad data access create novel attack surfaces that conventional security models fail to contain. Ars Technica frames the incident as evidence of the AI industry's persistent, systemic inability to get ahead of LLM-specific security threats.
The title suggests Gemini may have unexpectedly output its system prompt during use. Since no source text is provided, the trigger, interface, reproducibility, leaked content, and any Google response cannot be verified. Treat it as a cautious prompt-leakage incident signal relevant to LLM safety, product security, and developers building on hidden system instructions.
With the explosive growth of large language models (LLMs) such as ChatGPT, AI safety and ethics have become the most pressing concerns in the industry. This…