Artificial Intelligence
How Not to Buy Stupid AI: A Practical Guide to Evaluating AI Products and Tools
Led by: Santiago Garces
Agencies face increasing pressure to “use AI,” but not every automation or predictive tool is appropriate, and not every product delivers what it promises. Building on lessons learned from how researchers evaluate the effectiveness and fairness of AI tools, this session offers practical strategies for government. Participants will discuss how to interrogate vendor claims, what to demand of those selling us AI, work with partners in academia and industry to measure outcomes, and avoid paying for systems that don’t perform in practice or, worse, cause more harm than good. We discuss the limitations of AI auditing and practical strategies for getting smarter about what we buy.
-
Use evidence-based methods for evaluating vendor claims and proposals.
-
Identify red flags such as black-box models and unverifiable performance metrics.
-
Come away with a “buyer’s guide” grounded in scientific rigor
This workshop is part of an InnovateUS Series called Prediction, Automation, and Decision Making
View more workshops from Prediction, Automation, and Decision MakingOther workshops in the Artificial Intelligence collection
Artificial Intelligence
Co-Designing with Communities: Building AI Tools with Residents and Frontline Staff
April 30, 2026
Artificial Intelligence
Simpler Services, Stronger Access: Designing Better Systems with AI
April 27, 2026
Artificial Intelligence
Innovations in Action: Inspiring projects from around the country
April 20, 2026
Artificial Intelligence
The Identity Challenge: Tackling User Disambiguation and Data Integration Across Programs
April 13, 2026
Artificial Intelligence
Governing and Funding Public AI: Standards, Oversight, and Sustainable Investment
April 8, 2026
Artificial Intelligence
AI Sovereignty: Sweden, Switzerland, and Beyond
April 1, 2026
Want to be a part of our community of innovators?
We'd love to keep in touch!
