Books

• Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor, by Virginia Eubanks St. Martin’s Press 2018
• Algorithms of Oppression, by Safiya Umoja Noble, 2018
• Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, by Cathy O’Neil Crown Publishers 2016
• The Black Box Society: The Secret Algorithms that Control Money and Information, by Frank Pasquale Harvard University Press 2015

Research

• How algorithms can strengthen democracy: Ariel Procaccia on designing citizens’ assemblies, UofT Schwartz Reisman Institute March 24, 2022
• Building Algorithms that Work for Everyone: Natural Language Processing Tools for Bias Reduction in Child Welfare Systems, UofT Centre for Ethics March 30, 2022
• Why we shouldn’t “move fast and break things”: Shion Guha on the benefits of human-centered data science, UofT Schwartz Reisman Institute February 22, 2022
• Actionable Audting: Investigating the Impact of Biased Performance Results of Commercial AI Products, Algorithmic Justice League January 24, 2022
• Detecting Discrimination Risk in Automated Decision-Making Systems with Balance Measures on Input Data, Nexa Center for Internet and Society January 13, 2022
• Regional Negative Bias in Word Embeddings Predicts Racial Animus–but only via Name Frequency, Human-Centred AI (Stanford University) 2022
• Bug Bounties for Algorithmic Harms, Algorithmic Justice League January 2022
• Tackling racial bias in automated online hate detection: Towards fair and accurate detection of hateful users with geometric deep learning, Oxford Internet Institute January 2022
• Mitigating bias in algorithmic decision-making calls for an interdisciplinary effort, UofT Schwartz Reisman Institute December 16, 2021
• Integrating SQuARE data quality model with ISO 31000 risk management to measure and mitigate software bias, Nexa Center for Internet and Society December 8, 2021
• Imbalanced data as risk factor of discriminating automated decisions: a measurement-based approach, Nexa Center for Internet and Society December 2, 2021
• A data quality approach to the identification of discrimination risk in automated decision making systems, Nexa Center for Internet and Society September 4, 2021
• Beyond Algorithmic Bias: A Socio-Computational Interrogation of the Google Search by Image Algorithm, Princeton University July 2021
• Combatting Anti-Blackness in the AI Community, UofT Centre for Ethics February 9, 2021
• Suspect Development Systems: Databasing Marginality and Enforcing Discipline, NYU AI Now Institute January 2021
• Redistribution and Rekognition: A Feminist Critique of Algorithmic Fairness, NYU AI Now Institute November 17, 2020
• To Surveil and Predict: A Human Rights Analysis of Algorithmic Policing in Canada, The Citizen Lab September 2020
• Facial Recognition Technologies in the Wild: A Call for a Federal Office, Algorithmic Justice League May 29, 2020
• Facial Recognition Technologies: A Primer, Algorithmic Justice League May 29, 2020
• The Commercialization of Decision-Making: Towards a Regulatory Framework to Address Machine Bias over the Internet, Harvard Kennedy School Shorenstein Center on Media Politics & Public Policy April 24, 2020
• The Unnoticed Cognitive Bias Secretly Shaping the AI Agenda, Montreal AI Ethics Lab 2020
• Representation Learning with Statistical Independence to Mitigate Bias, Human-Centred AI (Stanford University) 2020
• Disability, Bias, and AI, NYU AI Now Institute November 20, 2019
• Bots at the Gate: A Human Rights Analysis of Automated Decision-Making in Canada’s Immigration and Refugee System, The Citizen Lab September 2018
• Mapping the Movement of AI into the Marketplace with Patent Data, Block Center for Technology and Society March 2018
• Gender Shades: Uncovering Gender and Skin-Type Bias in Commercial AI Products, Algorithmic Justice League 2018
• A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamics, Center for Human Compatible Artificial Intelligence 2018
• Bias on the Web, CACM 2018
• Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification, Proc. Machine Learning Research 2018
• Investigating the Impact of Gender on Rank in Résumé Search Engines, Proc. CHI’2018 2018
• K.W. v. Armstrong, ACLU of Idaho 2018
• The Accuracy, Fairness, and Limits of Predicting Recidivism, Science Advances 2018
• Algorithms in the Criminal Justice System: Assessing the Use of Risk Assessments in Sentencing, Responsive Communities Initiative, Harvard University August 25, 2017
• Fair prediction with disparate impact: A study of bias in recidivism prediction instruments, Block Center for Technology and Society February 9, 2017
• Pitfalls of Artificial Intelligence Decision-making Highlighted in Idaho ACLU Case, ACLU June 2, 2017
• The Paradox of Automation as Anti-Bias Intervention, I. Ajunwa March 10, 2016
• Big Data’s Disparate Impact, California Law Review 2016
• How Big Data Enables Economic Harm to Consumers, Especially to Low-Income and Other Vulnerable Sectors of the Population, Journal of Internet Law December 2014

Law Review Articles

• Artificial Intelligence in Canadian Healthcare: Will the Law Protect Us from Algorithmic Bias Resulting in Discrimination? Canadian Journal of Law and Techology 2022
• Governing by Algorithm? No Noise and (Potentially) Less Bias, Duke Law Journal 2022
• Big Data’s Disparate Impact, California Law Review 2016

Laws

Essays/Blogs

• Semantics Derived Automatically from Language Corpora Contain Human-Like Biases, Science 2017
• Bias in Criminal Risk Scores Is Mathematically Inevitable, Researchers Say, ProPublica December 30, 2016
• Machine Bias: There’s Software Used Across the Country to Predict Future Criminals. And It’s Biased Against Blacks, ProPublica May 23, 2016
• There’s Software Used Across the Country to Predict Future Criminals. And It’s Biased Against Blacks, ProPublica May 23, 2016
• Twitter Taught Microsoft’s AI Chatbot to Be a Racist Asshole in Less than a Day, The Verge March 24, 2016

News

• Group Backed by Top Companies Moves to Combat A.I. Bias in Hiring, NYTimes December 8, 2021
• Ride-Hailing Algorithms Questioned as Black Woman Quoted More than White Man for Same Toronto Trip, CTV News August 24, 2021
• Stopping AI Bias Starts With Diverse Product Teams, Forbes August 17, 2021
• Black Woman Charged More Than White Man for the Exact Same Uber Ride in Toronto, blogTO August 16, 2021
• Using A.I. to Find Bias in A.I., NYTimes June 30, 2021
• Disparate Effect of Artificial Intelligence Bias in Ridehailing Economy’s Price Discrimination Algorithms, Proc. AIES’21 May, 2021
• Biases in AI Systems, CACM 2021
• The (Im)possibility of Fairness: Different Value Systems Require Different Mechanisms for Fair Decision Making, CACM 2021
• Racial Disparities in Automatic Speech-Recognition, PNAS April 7, 2020
• A Snapshot of the Frontiers of Fairness in Machine Learning, CACM 2020
• Coded Bias’ Review: When the Bots are Racist, NYTimes November 11, 2020
• Is An Algorithm Less Racist Than a Loans Officer? NYTimes September 18, 2020
• How Automated Background Checks Freeze Out Renters, NYTimes May 28, 2020
• An Algorithm That Grants Freedom, or Takes It Away, NYTimes February 6, 2020
• Beware of Automated Hiring, NYTimes October 8, 2019
• When an Algorithm Helps Send You to Prison, NYTimes October 26, 2018
• Amazon Ditched AI Recruiting Tool That Favored Men for Technical Jobs, The Guardian October 11, 2018
• Biased bots: Human prejudices sneak into artificial intelligence systems, ScienceDaily April 13, 2017

Websites

• Loomis v. Wisconsin, Wikipedia
• O’Neil Risk Consulting & Algorithmic Auditing, ORCAA
• Coded Bias (film) 2020