Kitboga posted an interesting guide on how to mess with scam chatbots
Summary
Kitboga shares a guide on tricking scam chatbots with recursive instructions that cause excessive token usage and hallucination.
Similar Articles
Kitboga shows how you can break AI phone scammers with just a few questions and prompts.
Kitboga demonstrates how to identify AI phone scammers by commanding them to read punctuation, then break the model through nonsense repetition (e.g., 'Albuquerque, New Mexico') to waste scammers' costs.
Hackers influence ChatGPT and Gemini to direct users to scam centers
Hackers are poisoning AI systems like ChatGPT and Gemini with malicious content to trick users into scams, highlighting critical vulnerabilities in AI's reliance on web data.
Prompt injection works on Telegram romance scam bots
Researchers demonstrate that prompt injection can be used to manipulate Telegram romance scam bots, revealing a security vulnerability in AI-powered chatbots.
How we cut AI chatbot hallucinations: what actually worked (and what didn't)
作者分享在客户聊天机器人中降低幻觉的实战经验,按影响力排序总结了 RAG、允许模型说不知道、来源引用、缩小作用域、外部护栏、低温度、人工介入、严谨评测和透明声明九个关键做法。
Have a laugh at AI’s expense by roleplaying as a chatbot
The article introduces 'Your AI Slop Bores Me,' a web-based activity where users roleplay as AI chatbots by responding to prompts within a time limit, using a credit system to mimic LLM behavior.