An Intelligence in
The Risks of Bias and Errors in
Osonde Osoba, William Welser IV
C O R P O R AT I O N
For more information on this publication, visit www.rand.org/t/RR1744
Library of Congress Cataloging-in-Publication Data is available for this publication.
Published by the RAND Corporation, Santa Monica, Calif.
© Copyright 2017 RAND Corporation
R® is a registered trademark.
Cover: the-lightwriter/iStock/Getty Images Plus
Limited Print and Electronic Distribution Rights
This document and trademark(s) contained herein are protected by law. This representation
of RAND intellectual property is provided for noncommercial use only. Unauthorized
posting of this publication online is prohibited. Permission is given to duplicate this
document for personal use only, as long as it is unaltered and complete. Permission is
required from RAND to reproduce, or reuse in another form, any of its research documents
for commercial use. For information on reprint and linking permissions, please visit
The RAND Corporation is a research organization that develops solutions to public
policy challenges to help make communities throughout the world safer and more secure,
healthier and more prosperous. RAND is nonprofit, nonpartisan, and committed to the
RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors.
Make a tax-deductible charitable contribution at
Algorithms and artificial intelligence agents (or, jointly, artificial agents)
influence many aspects of life: the news articles read, access to credit,
and capital investment, among others. Because of their efficiency and
speed, algorithms make decisions and take actions on the behalf of
humans in these and many other domains. Despite these gains, there
are concerns about the rapid automation of jobs (even cognitive jobs,
such as journalism and radiology). This trend shows no signs of abating.
As reliance on artificial agents continues to grow, what are the
consequences and risk of such dependence? A better understanding
of attitudes toward and interactions with algorithms is essential precisely because of the aura of objectivity and infallibility today’s culture
ascribes to algorithms. This report illustrates some of the shortcomings
of algorithmic decisionmaking, identifies key themes around the problem of algorithmic errors and bias (e.g., data diet, algorithmic disparate
impact), and examines some approaches for combating these problems.
This report should be of interest to decisionmakers and implementers looking for a b...