Resources
Responsible AI for Public Professionals
Building AI That Works: Implementation Strategies for Public Service
You can find the resources mentioned in the online course by selecting a module from the dropdown menu below. Have more questions? Contact us at hello@innovate-us.org
See how other public professionals are applying AI in their organization
Ready for a deeper dive? Take a course to
- Learn how to use GenAI in your day to day task
- Learn how to apply GenAI to identify ‘what works’ in other jurisdictions
Module 2: Overview of AI approaches
Learn more
-
Prof Narayan’s (author of AI Snakeoil) guide to thinking through what tasks more complicated neural networks are good for: How to Recognize AI Snake Oil Professor Arvind Narayanan (video, slides) [Archive]
-
PAIR Guide Ch. 4 Explainability & Trust from Google - while written w/ private sector companies in mind, provide good overview of thinking through explainability and trust in AI systems
-
Different Approaches - Generative AI
-
An accessible animated explainer of how generative works under the hood from
-
A more technical interactive explainer of how generative AI predicts the next word from PAIR (People, AI, Research) group at Google.
-
IBM Blog Post + Video - What is Generative AI
Citations
-
InnovateUS Course: Responsible AI for Public Professionals: Using GenAI at Work - https://bit.ly/genai-at-work
-
Washington Post - Is artificial intelligence about to transform the mammogram? - https://wapo.st/3UZF5hV
-
MIT News - Using AI to predict breast cancer and personalize care - https://bit.ly/mit-ai-cancer
- Public Safety Assessment (PSA) tool - https://bit.ly/psa-tool
Module 3: Surfacing and selecting AI projects for scale
Learn more
-
Problem Definition
-
InnovateUS Course: Innovation Skills Accelerator - Module 2 Introduction to Problem Definition
-
InnovateUS Course: Human Centered Design - Module 3 Define
-
Surfacing and selecting projects - Common problem type or ‘typology’
-
Blog series from DataSF on how they run their DataScienceSF program (Part 1, Part 2, Part 3, Part 4) [Archive]
-
Blog by Nolaytics on their problem typology (blog) [Archive]
- InnovateUS Workshop: Delivering Data Scient Projects in Government by Joy Bonaguro (video link)
-
Surfacing and selecting projects - Bottom up experimentation and crowd sourcing
-
InnovateUS Course: Innovation Skills Accelerator - Module 6 Collective Intelligence: co-creation, collaboration, and crowdsourcing
-
Surfacing and selecting projects - Fast field scanning
-
InnovateUS Course: What Works: Fast Field Scanning
-
Lists of government use cases
-
HHS AI use cases [Archive]
-
DOL AI use cases [Archive]
-
Commerce AI use cases [Archive]
-
Pilots
-
InnovateUS Workshop: Effective Measurement and Pilots by Carin Clary & Kate Lawyer
Citations
-
InnovateUS Course: Innovation Skills Accelerator https://bit.ly/skills-accel-course
-
InnovateUS Course: Human Centered Design https://bit.ly/hcd-course
-
Nolaytics - Types of analytics projects https://bit.ly/nolaytics
-
DataSF - Data Science Typology https://bit.ly/datasciencesf
-
DataSF - https://bit.ly/datasf
-
Nolaytic - https://bit.ly/nolaytics
-
InnovateUS Course: Responsible AI for Public Professionals: GenAI at Work https://bit.ly/genai-at-work
-
InnovateUS Course: What Works: Fast Field Scanning https://bit.ly/ffs-course
-
AlertCalifornia - https://alertcalifornia.org
Module 4: Data quality
Learn more
-
Data quality characteristics
-
Blog: Data camp data quality dimension cheat sheet w/ examples
-
Blog: IBM data quality explainer
-
Toolkit: Data culture maturity assessment guide by Beeck center
-
Guidebook: DataSF Guides: How to Ensure Quality Data (gitbook.io)
-
InnovateUS Workshop - Empowering Data Quality: A Metrics-Based Approach for Agency Excellence
Citations
-
Detroit Free Press - Data glitch was apparent factor in false fraud charges against jobless claimants https://bit.ly/mi-ui-data
-
DM-BOK - https://bit.ly/dmbok-site
-
DCAM - https://bit.ly/dcam-site
-
DataSF - https://bit.ly/datasf-dq
Module 5: People and talent
Learn more
-
InnovateUS workshop: Bringing AI and Tech Talent into government by of Tech Talent Project
-
Article: Bias and retraining interactive explainer- Datasets Have Worldviews (pair.withgoogle.com) [Archive]
-
Guidebook: GSA’s AI Guide for Government
-
Chapter 2: How to structure an organization to embrace AI https://bit.ly/gsa-ai-org
-
Chapter 4: Developing the AI workforce bit.ly/gsa-workforce
-
Blog: See this blog from Kim Hicks at DataSF to get a window of the culture differences and motivation of private sector data scientist coming to public sector
-
Organizations
-
Tech Talent Project - Tech Talent Project
-
US Digital Response - Talent Division
Citations
-
GSA AI Guide for Government - https://bit.ly/gsa-ai-org
-
Meritalk - OPM Reclassifies Data Scientist Criteria for Agency Hiring - https://bit.ly/opm-reclass
Module 6: AI risk management frameworks and toolkits
Learn more
-
InnovateUS Workshop: An Ethics Ecosystem for AI and Big Data: Why? What? How? By John Basl
-
Workshop: ACM FAccT Conference Tutorial 2: Using the NIST AI Risk Management Framework (note: audio issue during section covering Govern function)
-
Interactive explainers of core AI ethics concepts
-
Fairness - Measuring Fairness (pair.withgoogle.com)
-
Hidden Bias - Hidden Bias (pair.withgoogle.com)
-
Diversity - Measuring Diversity (pair.withgoogle.com)
-
AI Ethics toolkits with government focus
-
Government specific AI project team toolkits https://ethicstoolkit.ai
-
Governance maturity assessment toolkits
-
Workshop: Managing AI Risks: Reflections on NIST AI Risk Management Framework and Beyond - Jeanna Matthews
-
Article: Evolving AI Risk Management: A Maturity Model based on the NIST AI Risk Management Framework
-
State Data maturity framework - Beeck Center - https://bit.ly/beeck-data
-
Governance committee formation toolkit -Ethics Institute at Northeastern University - https://bit.ly/ethic-committee
-
Organizations
-
National Institute of Standards and Technology (NIST) - https://www.nist.gov/about-nist
Citations
-
NIST AI RMF https://bit.ly/nist-ai-rmf
-
NIST AI RMF Playbook https://bit.ly/ai-rmf-playbook
-
NIST GenAI Profile https://bit.ly/nist-genai
-
Techbetter - Evaluating AIGovernance Insights from Public Disclosures - https://bit.ly/techbetter-study
-
About NIST - https://www.nist.gov/about-nist
-
Reuters - Insight - Amazon scraps secret AI recruiting tool that showed bias against women - https://reut.rs/4aKpnNu
-
NPR - An eating disorders chatbot offered dieting advice, raising fears about AI in health - https://n.pr/4bJcMvo
-
NYTimes - Microsoft Created a Twitter Bot to Learn From Users. It Quickly Became a Racist Jerk - https://nyti.ms/3yBABXl
-
Techcrunch - Blackbox welfare fraud detection system breaches human rights, Dutch court rules - https://tcrn.ch/3KmZGbn
-
Guardian - Royal Free breached UK data law in 1.6m patient deal with Google's DeepMind - https://bit.ly/guardian-deepmind
-
Science - Dissecting racial bias in an algorithm used to manage the health of populations - https://bit.ly/science-health-algo
-
Nextgov - NIST delivers draft AI guidance, generative AI pilot program - https://bit.ly/nextgov-nist-genai
-
Nextgov - NIST’s new AI safety institute to focus on synthetic content, international outreach - https://bit.ly/nextgov-aisi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Sign up to learn more about Building AI That Works: Implementation Strategies for Public Service
This course is designed specifically for AI decision-makers and business leaders and provides an overview of several key building blocks needed to responsibly leverage AI on key business processes.