Responsible AI for Public Organizations
Implementing AI Projects in Government - Resources
Find all the resources mentioned in the online course by selecting a module from the dropdown menu below. Have questions? Contact us
Ready for a deeper dive? Take a course to
Module 2: AI foundations: Data quality
This module emphasizes the critical role of data quality in AI projects, explaining why it is especially impactful for AI systems. It defines data quality in the public sector and discusses the impact of data quality issues on AI projects. The module also explores the common causes of data quality issues in public sector organizations and provides practical steps for improving data quality for responsible and ethical AI deployment.
Learn more
-
Data quality characteristics
-
Blog: Data camp data quality dimension cheat sheet w/ examples
-
Blog: IBM data quality explainer
-
Toolkit: Data culture maturity assessment guide by Beeck center
-
Guidebook: DataSF Guides: How to Ensure Quality Data (gitbook.io)
-
InnovateUS Workshop - Empowering Data Quality: A Metrics-Based Approach for Agency Excellence
Citations
-
Detroit Free Press - Data glitch was apparent factor in false fraud charges against jobless claimants https://bit.ly/mi-ui-data
-
DM-BOK - https://bit.ly/dmbok-site
-
DCAM - https://bit.ly/dcam-site
-
DataSF - https://bit.ly/datasf-dq
Module 3: AI foundations: People & talent
This module discusses the importance of understanding different types of AI organizations and their talent needs for making informed decisions about an organization's AI strategy. It explores the key competencies required for AI talent, particularly in the critical role of data scientist, and discusses the collaborative effort required from various teams. The module also presents three main avenues for developing an AI-ready workforce.
Learn more
-
InnovateUS workshop: Bringing AI and Tech Talent into government by of Tech Talent Project
-
Article: Bias and retraining interactive explainer- Datasets Have Worldviews (pair.withgoogle.com) [Archive]
-
Guidebook: GSA’s AI Guide for Government
-
Chapter 2: How to structure an organization to embrace AI https://bit.ly/gsa-ai-org
-
Chapter 4: Developing the AI workforce bit.ly/gsa-workforce
-
Blog: See this blog from Kim Hicks at DataSF to get a window of the culture differences and motivation of private sector data scientist coming to public sector
-
Organizations
-
Tech Talent Project - Tech Talent Project
-
US Digital Response - Talent Division
Citations
-
GSA AI Guide for Government - https://bit.ly/gsa-ai-org
-
Meritalk - OPM Reclassifies Data Scientist Criteria for Agency Hiring - https://bit.ly/opm-reclass
Module 4: Ethical risk frameworks & toolkits
This module introduces the critical importance of robust AI risk management and the role of the National Institute of Standards and Technology (NIST) AI Risk Management Framework (AI RMF) in ensuring responsible and safe AI deployment. It explores the seven key characteristics of trustworthy AI and the four functions outlined in the AI RMF that can help reduce risk and maximize benefits. The module also discusses the unique risks posed by Generative AI (GenAI) and provides practical next steps for implementing AI risk management in an organization.
Learn more
-
InnovateUS Workshop: An Ethics Ecosystem for AI and Big Data: Why? What? How? By John Basl
-
Workshop: ACM FAccT Conference Tutorial 2: Using the NIST AI Risk Management Framework (note: audio issue during section covering Govern function)
-
Interactive explainers of core AI ethics concepts
-
Fairness - Measuring Fairness (pair.withgoogle.com)
-
Hidden Bias - Hidden Bias (pair.withgoogle.com)
-
Diversity - Measuring Diversity (pair.withgoogle.com)
-
AI Ethics toolkits with government focus
-
Government specific AI project team toolkits https://ethicstoolkit.ai
-
Governance maturity assessment toolkits
-
Workshop: Managing AI Risks: Reflections on NIST AI Risk Management Framework and Beyond - Jeanna Matthews
-
Article: Evolving AI Risk Management: A Maturity Model based on the NIST AI Risk Management Framework
-
State Data maturity framework - Beeck Center - https://bit.ly/beeck-data
-
Governance committee formation toolkit -Ethics Institute at Northeastern University - https://bit.ly/ethic-committee
-
Organizations
-
National Institute of Standards and Technology (NIST) - https://www.nist.gov/about-nist
Citations
-
NIST AI RMF https://bit.ly/nist-ai-rmf
-
NIST AI RMF Playbook https://bit.ly/ai-rmf-playbook
-
NIST GenAI Profile https://bit.ly/nist-genai
-
Techbetter - Evaluating AIGovernance Insights from Public Disclosures - https://bit.ly/techbetter-study
-
About NIST - https://www.nist.gov/about-nist
-
Reuters - Insight - Amazon scraps secret AI recruiting tool that showed bias against women - https://reut.rs/4aKpnNu
-
NPR - An eating disorders chatbot offered dieting advice, raising fears about AI in health - https://n.pr/4bJcMvo
-
NYTimes - Microsoft Created a Twitter Bot to Learn From Users. It Quickly Became a Racist Jerk - https://nyti.ms/3yBABXl
-
Techcrunch - Blackbox welfare fraud detection system breaches human rights, Dutch court rules - https://tcrn.ch/3KmZGbn
-
Guardian - Royal Free breached UK data law in 1.6m patient deal with Google's DeepMind - https://bit.ly/guardian-deepmind
-
Science - Dissecting racial bias in an algorithm used to manage the health of populations - https://bit.ly/science-health-algo
-
Nextgov - NIST delivers draft AI guidance, generative AI pilot program - https://bit.ly/nextgov-nist-genai
-
Nextgov - NIST’s new AI safety institute to focus on synthetic content, international outreach - https://bit.ly/nextgov-aisi