When AI Agents Spend Real Money

About this video

AI agents are starting to spend real money autonomously, from purchasing supplies to even buying cars. In this video, we explore the emerging world of agent wallets, the risks of fraud and prompt injection attacks, and the critical need for controls. Chapters: 00:00 Harmless Chatbots? 00:16 Who Controls the Money? 00:30 AI in Procurement by 2025 00:45 Agent Wallets 01:01 APIs Enable Purchases 01:16 AI Agents in Procurement 01:31 The First Exploits 01:47 Unauthorized Purchase 02:01 AI Agent Adoption in Procurement 02:17 No Permission Needed 02:33 Instant Transaction 02:48 Escalating Stakes 03:02 AI Payment Tools 03:17 Vulnerabilities Found 03:33 30% by 2025 03:49 FTC Acts 04:01 Global Scramble 04:14 Consumer Risk 04:29 Founder's Concern 04:44 Alarm Sounded 04:59 The Permission Gap 05:15 Human-in-the-Loop 05:31 Real-World Test 05:47 Context Blindness 06:03 Not Just Purchases 06:19 Crypto on the Rise 06:35 The Human Factor 06:51 The Trust Fallacy 07:07 Hidden Commands 07:23 The Scale Problem 07:39 The Real Cost Sources & further reading: • OpenAI Plugins Documentation — https://platform.openai.com/docs/plugins/introduction • Anthropic Tool Use Documentation — https://docs.anthropic.com/en/docs/build-with-claude/tool-use • FTC Warning on AI and Consumer Protection — https://www.ftc.gov/news-events/news/press-releases/2024/02/ftc-warns-about-ai-agents-making-unauthorized-purchases • Gartner Predicts AI Agents in Procurement — https://www.gartner.com/en/newsroom/press-releases/2023-10-16-gartner-says-30-percent-of-large-organizations-will-use-ai-agents-for-purchasing-by-2025 • Center for AI Safety Report on Autonomous AI Risks — https://www.safe.ai/ai-risk-report • EU AI Act Text — https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52021PC0206

From the video

Harmless Chatbots?
Harmless Chatbots?
Autonomous Purchase
Autonomous Purchase
AI Wallets Are Real
AI Wallets Are Real
The Trade-Off
The Trade-Off
Agent Wallet Startups
Agent Wallet Startups
APIs Enable Purchases
APIs Enable Purchases
Researcher Demo 2024
Researcher Demo 2024
Controls Lagging
Controls Lagging
Prompt Injection Attack
Prompt Injection Attack
Unauthorized Purchase
Unauthorized Purchase
Discount Hack
Discount Hack
Closing Window
Closing Window

More from The Tool Shelf

When AI Agents Spend Real Money