benchmarks.wiki / Public workspace
LongBench v2 / 66f55d66821e116aacb33734 / Regarding the experimental methods in this article, the following statement is…
Problem
Answer published by the source. Consult the official source to check your work against its answer.
question
Regarding the experimental methods in this article, the following statement is correct:
context · full text (66,137 characters)
American Economic Journal: Applied Economics 2017, 9(2): 1–22
https://doi.org/10.1257/app.20160213
1
Racial Discrimination in the Sharing Economy:
Evidence from a Field Experiment†
By Benjamin Edelman, Michael Luca, and Dan Svirsky*
In an experiment on Airbnb, we find that applications from guests
with distinctively African American names are 16 percent less likely
to be accepted relative to identical guests with distinctively white
names. Discrimination occurs among landlords of all sizes, includ-
ing small landlords sharing the property and larger landlords with
multiple properties. It is most pronounced among hosts who have
never had an African American guest, suggesting only a subset of
hosts discriminate. While rental markets have achieved significant
reductions in discrimination in recent decades, our results sug-
gest that Airbnb’s current design choices facilitate discrimination
and raise the possibility of erasing some of these civil rights gains.
(JEL C93, J15, L83)
O
ver the past 50 years, there have been considerable societal efforts to reduce
the level of discrimination against African Americans in the United States. In
the context of housing and rental accommodations, antidiscrimination laws have
sought to eliminate discrimination through regulation. While racial discrimination
continues to exist in rental markets, it has improved in the last two decades (Yinger
1998, US Department of Housing and Urban Development 2013; compare Zhao,
Ondrich, and Yinger 2005 to Ondrich, Stricker, and Yinger 1999).
Yet in recent years, markets have changed dramatically, with a growing share
of transactions moving online. In the context of housing, Airbnb has created a new
market for short-term rentals that did not previously exist, allowing small landlords
to increasingly enter the market. Whereas antidiscrimination laws ban the landlord
of a large apartment building from discriminating based on race, the prevailing view
among legal scholars is that such laws likely do not reach many of the smaller land-
lords using Airbnb (Belzer and Leong forthcoming; Todisco 2015).
In this paper, we investigate the existence and extent of racial discrimination
on Airbnb, the canonical example of the sharing economy. Airbnb allows hosts
* Edelman: Harvard Business School, Morgan 462, 25 Harvard Way, Boston, MA 02163 (e-mail: bedelman@
hbs.edu); Luca: Harvard Business School, Baker Library 457, 10 Harvard Way, Boston, MA 02163 (e-mail: mluca@
hbs.edu); Svirsky: Harvard Business School and Harvard University Department of Economics, Baker Library 420A,
25 Harvard Way, Boston MA 02163 (e-mail: dsvirsky@hbs.edu). We thank Ian Ayres, Larry Katz, Kevin Lang,
Sendhil Mullainathan, Devah Pager, and seminar participants at eBay, Harvard Law School, Hong Kong University
of Science and Technology, Indiana University, New York University, Northwestern University, Stanford University,
and University at Albany for valuable feedback. We thank Haruka Uchida for tireless research assistance. Our
Institutional Review Board approved our methods before we began collecting data. IRB# 15-2226.
† Go to https://doi.org/10.1257/app.20160213 to visit the article page for additional materials and author
disclosure statement(s) or to comment in the online discussion forum.
2
American Economic Journal: applied economics
april 2017
to rent out houses, apartments, or rooms within an apartment. To facilitate these
transactions, Airbnb promotes properties to prospective guests, facilitates commu-
nication, and handles payment and some aspects of customer service. Airbnb allows
hosts to decide whether to accept or reject a guest after seeing his or her name and
often a picture—a market design choice that may further enable discrimination.
To test for discrimination, we conduct a field experiment in which we inquire about
the availability of roughly 6,400 listings on Airbnb across five cities. Specifically,
we create guest accounts that differ by name but are otherwise identical. Drawing
on the methodology of a labor market experiment by Bertrand and Mullainathan
(2004), we select two sets of names—one distinctively African American and the
other distinctively white.1
We find widespread discrimination against guests with distinctively African
American names. African American guests received a positive response roughly
42 percent of the time, compared to roughly 50 percent for white guests.2 This
8 percentage point (roughly 16 percent) penalty for African American guests is par-
ticularly noteworthy when compared to the discrimination-free setting of competing
short-term accommodation platforms such as Expedia. The penalty is consistent
with the racial gap found in contexts ranging from labor markets to online lending
to classified ads to taxicabs.3
Combining our experimental results with observational data from Airbnb’s site,
we investigate whether different types of hosts discriminate more, and whether dis-
crimination is more common at certain types of properties based on price or local
demographics. Our results are remarkably persistent. Both African American and
white hosts discriminate against African American guests; both male and female
hosts discriminate; both male and female African American guests are discrimi-
nated against. Effects persist both for hosts that offer an entire property and for
hosts who share the property with guests. Discrimination persists among experi-
enced hosts, including those with multiple properties and those with many reviews.
Discrimination persists and is of similar magnitude in high- and low-priced units, in
diverse and homogeneous neighborhoods.
Because hosts’ profile pages contain reviews (and pictures) from recent guests,
we can cross-validate our experimental findings using observational data on whether
the host has recently had an African American guest. We find that discrimination is
concentrated among hosts with no African American guests in their review history.
When we restrict our analysis to hosts who have had an African American guest in
1 We build on the large literature using audit studies to test for discrimination. Past research considers African
Americans and applicants with prison records in the labor market (Pager 2003), immigrants in the labor market
(Oreopoulos 2011), Arabic job seekers (Carlsson and Rooth 2007), gender (Lahey 2008), long-term unemployment
(Ghayad 2014), and going to a for-profit college (Deming et al. 2016), among many others.
2 Some caution is warranted here. We only observe a gap between distinctively white and distinctively African
American names, which differ not only by suggested ethnicity but also potentially by socioeconomic status (Fryer
and Levitt 2004). For ease of exposition, we describe our results in terms of differences among the “African
American guests” or the “white guests,” or use the term “race gap,” without also specifying that our results may
better be described as a “race and socioeconomic status gap.” Section V discusses this issue in more detail.
3 Doleac and Stein (2013) find a 62 percent to 56 percent gap in offer rates for online classified postings.
Bertrand and Mullainathan (2004) find a 10 percent to 6 percent gap in callback rates for jobs. Pope and Sydnor
(2011) find a 9 percent to 6 percent gap in lending rates in an online lending market. Ayres, Vars, and Zakariya
(2005) find a 20 percent to 13 percent gap in how often taxi drivers receive a tip.
Vol. 9 No. 2
3
Edelman et al.: Racial Discrimination in the Sharing Economy
the recent past, discrimination disappears—reinforcing the external validity of our
main results, and suggesting that discrimination is concentrated among a subset of
hosts.
To explore the cost to a host of discriminating, we check whether each listing
is ultimately rented for the weekend we inquired about. Combining that informa-
tion with the price of each listing, we estimate that a host incurs a cost of roughly
$65–$100 in foregone revenue by rejecting an African American guest.
Overall, our results suggest a cause for concern. While discrimination has
shrunk in more regulated offline markets, it arises and persists in online markets.
Government agencies at both the federal and state level have routinely conducted
audit studies to test for racial discrimination since 1955 in offline markets. One
might imagine implementing regular audits in online markets as well; indeed, online
audits might be easier to run at scale due to improved data access and reduced
implementation cost.
Our results also reflect the design choices that Airbnb and other online market-
places use. It is not clear a priori how online markets will affect discrimination.
To the extent that online markets can be more anonymous than in-person trans-
actions, there may actually be less room for discrimination. For example, Ayres
and Siegelman (1995) find that African American car buyers pay a higher price
than white car buyers at dealerships, whereas Morton, Zettelmeyer, and Silva-Risso
(2003) find no such racial difference in online purchases. Similarly, platforms such
as Amazon, eBay, and Expedia offer little scope for discrimination, as sellers effec-
tively
pre-commit to accept all buyers regardless of race or ethnicity. However, these
advantages are by no means guaranteed, and in fact they depend on design choices
made by each online platform. In this situation, Airbnb’s design choices enable
widespread discrimination.
I. About Airbnb
Airbnb is a popular online marketplace for short-term rentals. Founded in 2008,
the site gained traction quickly and, as of November 2015, it offers 2,000,000 listings
worldwide.4 This is more than 3 times as many as Marriott’s 535,000 rooms world-
wide. Airbnb reports serving over 40 million guests in more than 190 countries.
While the traditional hotel industry is dominated by hotels and inns that each
offer many rooms, Airbnb enables anyone to post even a single room that is vacant
only occasionally. Hosts provide a wealth of information about each listing, includ-
ing the type of property (house, apartment, boat, or even castle, of which there are
over 1,400 listed), the number of bedrooms and bathrooms, the price, and location.
Each host also posts information about herself. An interested guest can see a host’s
profile picture as well as reviews from past guests. Airbnb encourages prospective
guests to confirm availability by clicking a listing’s “Contact” button to write to the
host.5 In our field experiments (described in the next section), we use that method to
evaluate a host’s receptiveness to a booking from a given guest.
4 https://www.airbnb.com/about/about-us.
5 See “How do I know if a listing is available,” https://www.airbnb.com/help/question/137.
4
American Economic Journal: applied economics
april 2017
II. Experimental Design
A. Sample and Data Collection
We collected data on all properties offered on Airbnb in Baltimore, Dallas, Los
Angeles, St. Louis, and Washington, DC as of July 2015. Our goal was to collect
data from the top 20 metropolitan areas from the 2010 census. We started with these
five cities because they had varying levels of Airbnb usage and came from diverse
geographic regions. Baltimore, Dallas, and St. Louis offer several hundred listings
each, while Los Angeles and Washington, DC have several thousand. We stopped
data collection after these five cities because Airbnb became increasingly rapid in
blocking our automated tools which logged into guest accounts and communicated
with hosts. (We considered taking steps to conceal our methods from Airbnb, but
ultimately declined to do so.)
Because some hosts offer multiple listings, we selected only one listing per host
using a random number generator. This helped to reduce the burden on any given
host, and it also prevented a single host from receiving multiple identical e-mails.
Each host was contacted for no more than one transaction in our experiment.
We also collected data from each host’s profile page. This allowed us to analyze
host characteristics in exceptional detail. First, we saved the host’s profile image. We
then employed Mechanical Turk workers to assess each host image for race (white,
African American, Asian, Hispanic, multiracial, unknown), gender (male, female,
two people of the same gender, two people of different genders, unknown), and age
(young, middle-aged, old). We hired two Mechanical Turk workers to assess each
image, and if the workers disagreed on race or gender, we hired a third to settle the
dispute. If all three workers disagreed (as happened, for example, for a host whose
profile picture was an image of a sea turtle), we manually coded the picture. We
coded race as “unknown” when the picture did not show a person. Through this
procedure, we roughly categorized hosts by race, gender, and age.
Profile pages also revealed other variables of interest. We noted the number of
properties each host offers on Airbnb, anticipating that professional hosts with mul-
tiple properties might discriminate less often than others. We retrieved the number
of reviews the host has received, a rough measure of whether the host is an avid
Airbnb user or a casual one. We further checked the guests who had previously
reviewed each host. Airbnb posts the photo of each such guest, so we used Face++,
a
face-detection API, to categorize past guests by race, gender, and age.6 This allows
us to examine relationships between a host’s prior experience with African American
guests and the host’s rejection of new African American requests.
We also collected information about each listing. We recorded the price of the
listing, the number of bedrooms and bathrooms, the cancellation policy, any clean-
ing fee, and the listing’s ratings from past guests. We also measured whether the
6 In addition to detecting race, gender, and age, Face++ estimates its confidence for each trait. When Face++
was unable to make a match or its confidence was below 95 out of 100, we used Mechanical Turk to categorize the
past guest via the method described above.
Vol. 9 No. 2
5
Edelman et al.: Racial Discrimination in the Sharing Economy
listing offered an entire unit versus a room in a larger unit, yielding a proxy for how
much the host interacts with the guest.
Each listing included a longitude and latitude, which allowed us to link to census
demographic data to assess the relationship between neighborhood demographics
and discrimination. After linking the latitude and longitude to a census tract, we
used census data on the number of African American, Hispanic, Asian, and white
individuals. Table 1 presents summary statistics about the hosts and listings as well
as balanced treatment tests.
We later checked each listing to see whether hosts were ultimately able to fill open-
ings. Our guests inquired about reservations eight weeks in advance. Thus, if a guest
sent a message on August 1 about the weekend of September 25, we checked on
Friday, September 24 to see whether the specified listing was still listed as available.
B. Treatment Groups
Our analysis used four main treatment groups based on the perceived race and
gender of the test guest accounts. Hosts were contacted by guests with names that
signaled African American males, African American females, white males, and
white females, drawn from Bertrand and Mullainathan (2004). The list was based
on the frequency of names from birth certificates of babies born between 1974 and
1979 in Massachusetts. Distinctively white names are those that are most likely to
be white, conditional on the name, and similarly for distinctively African American
names. To validate the list, we conducted a survey in which we asked participants
to quickly categorize each name as white or African American. With just three sec-
onds permitted for a response, survey takers had little time to think beyond a gut
response. The survey results, presented in Appendix Table 1, confirm that the names
continue to signal race.7
7 On a scale of 0 to 1, where 0 is African American, the white female names each had an average survey response
of 0.90 or above, and the African American female names all had an average score of 0.10 or below. The male
Table 1— Summary Statistics
Variables
Mean
SD
25th
percentile
75th
percentile
Observations
Mean, white
accounts
Mean,
African
American
accounts
p-value
Host is white
0.63
0.48
0
1
6,392
0.64
0.63
0.15
Host is African American
0.08
0.27
0
0
6,392
0.08
0.08
0.97
Host is female
0.38
0.48
0
1
6,392
0.38
0.37
0.44
Host is male
0.30
0.46
0
1
6,392
0.3
0.3
0.90
Price ($)
181.11
1,280.23
75
175
6,302
166.43
195.81
0.36
Number of bedrooms
3.18
2.26
2
4
6,242
3.18
3.18
0.96
Number of bathrooms
3.17
2.26
2
4
6,285
3.17
3.17
0.93
Number of reviews
30.87
72.51
2
29
6,390
30.71
31.03
0.86
Host has multiple listings
0.16
0.36
0
0
6,392
0.32
0.33
0.45
Host has 1+ reviews from
African American guests
0.29
0.45
0
1
6,390
0.29
0.28
0.38
Airbnb listings per
census tract
9.51
9.28
2
14
6,392
9.49
9.54
0.85
Percent population African
American (census tract)
0.14
0.2
0.03
0.14
6,378
0.14
0.14
0.92
6
American Economic Journal: applied economics
april 2017
We then created 20 Airbnb accounts, identical in all respects except for guest
names. Our names included ten that are distinctively African American and ten dis-
tinctively white names, divided into five male and five female names within each
group. To avoid the confounds that would result from pictures, we use only names;
our Airbnb profiles include no picture of the putative guest. From these 20 guest
accounts, we sent messages to prospective hosts. Each host was randomly assigned
one of our 20 guest accounts. Figure 1 presents a representative e-mail from one of
our guests to an Airbnb host. The name and dates changed depending on the mes-
sage sender and when the message was sent.8 In choosing the dates, we asked hosts
about a weekend that was approximately eight weeks distant from when the mes-
sage was sent. We limited our search to those properties that were listed as available
during the weekend in question.
names showed slightly more variation but tell the same story: all the white male names scored 0.88 or above, and
all the African American male names except for Jermaine Jones scored 0.10 or below. The Appendix presents the
full results of the survey.
8 No more than 48 hours elapsed between our first contact to a host in a given city, and the completion of our
contacting hosts in that city. Furthermore, no hosts in our sample had listings in more than one of the five cities we
tested. Hence, it is unlikely that a host contacted later on in the study would have learned about the experiment.
Figure 1. Sample Treatment
Vol. 9 No. 2
7
Edelman et al.: Racial Discrimination in the Sharing Economy
C. Experimental Procedure
We sent roughly 6,400 messages to hosts between July 7, 2015 and July 30, 2015.9
Each message inquired about availability during a specific weekend in September.
When a host replied to a guest, we replied to the host with a personal message clar-
ifying that we (as the guest) were still not sure if we would visit the city or if we
would need a place to stay. We sent this reply in order to reduce the likelihood of a
host holding inventory for one of our hypothetical guests.
We tracked host responses over the 30 days that followed each request. A research
assistant then coded each response into categories. The majority of responses were
in 1 of 6 groups: “No response” (if the host did not respond within 30 days); “No or
listing is unavailable;” “Yes;” “Request for more information” (if the host responded
with questions for the guest); “Yes, with questions” (if the host approved the stay
but also asked questions); “Check back later for definitive answer;” and “I will get
back to you.” As these categories show, our initial categorizations used subtle dis-
tinctions between possible responses. In our analyses below, however, we restrict
our attention to the simplest response—“Yes”—though all of our results are robust
to using “No” instead, as well as to ignoring nonresponses or to using broader defi-
nitions of “Yes.”
We collected all data using scrapers we built for this purpose. We sent inquiries to
Airbnb hosts using web browser automation tools we built for this purpose.
III. Results
Table 2 presents the main effect. We find that inquiries from guests with
white-sounding names are accepted roughly 50 percent of the time. In contrast,
guests with African American-sounding names are accepted roughly 42 percent of
the time. Columns 2 and 3 introduce additional control variables related to the host
or the property. The effect stays constant at a roughly 8 percentage point gap across
these specifications, controlling for the host’s gender, race, an indicator for whether
the host has multiple listings, an indicator for whether the property is shared, host
experience (whether the host has more than ten reviews), and the log of the listing
price.
As noted, we break down hosts’ responses into 11 categories. Figure 2 shows
the frequency of each response by race. One might worry that results are driven
by differences in host responses that are hard to classify, such as conditional “Yes”
responses. Similarly, we would be concerned if our findings were driven by differ-
ences in response rate. African American accounts might be more likely to be catego-
rized as spam, or hosts may believe that African American accounts are more likely
to be fake, in which case one might expect higher nonresponse rates for African
9 Our initial goal was to collect roughly 10,000 responses. This was based on a power analysis, which in turn
used an effect size calculated from Edelman and Luca (2014). To find a similar effect size, we would need a sample
size of roughly 3,000 hosts. But, to calculate an effect among a subgroup of hosts, like African American hosts,
which represent roughly 7 percent of the Airbnb population, we would need a sample size closer to 10,000. We fell
short of this goal for an exogenous reason: Airbnb shut down the experimental accounts after we collected roughly
6,400 responses.
8
American Economic Journal: applied economics
april 2017
American accounts. But as Figure 2 shows, the discrimination results occur because
of differences in simple “Yes” or “No” responses, not because of
nonresponses or
intermediate responses (like a conditional “Yes”).
In the rest of this section, we use the wealth of data available on Airbnb about the
host and location for each listing to look for factors that influence the gap between
Table 2— The Impact of Race on Likelihood of Acceptance
Dependent variable: 1(host accepts)
Guest is African American
−0.08
(0.02)
−0.08
(0.02)
−0.09
(0.02)
Host is African American
0.07
(0.02)
0.09
(0.02)
Host is male
−0.05
(0.01)
−0.05
(0.01)
Host has multiple listings
0.09
(0.02)
Shared property
−0.07
(0.02)
Host has 10+ reviews
0.12
(0.01)
ln(price)
−0.06
(0.01)
Constant
0.49
(0.01)
0.50
(0.01)
0.76
(0.07)
Observations
6,235
6,235
6,168
Adjusted R2
0.006
0.009
0.040
Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race and
various host and location characteristics. Standard errors are clustered by (guest name) × (city)
and are reported in parentheses.
Figure 2. Host Responses by Race
1,200
900
600
300
0
Yes
Conditional yes
No response
Conditional no
No
Guest is African American
Guest is white
Vol. 9 No. 2
9
Edelman et al.: Racial Discrimination in the Sharing Economy
white and African American names. Does the identity of the host matter? Does the
location of the property matter? Generally, we find that the discrimination is remark-
ably robust.
A. Effects by Host Characteristics
We first check whether our finding changes based on the identity of the host. If
discrimination is driven by homophily (in-group bias), then the host’s race should
matter. According to this theory, hosts might simply prefer guests of the same race.
If homophily were the primary factor driving differential guest acceptance rates,
then African American guests would face higher acceptance rates from African
American hosts. Table 3 presents regressions that include guest race, host race, and
an interaction term. Across the entire sample of hosts, the interaction between the
race and guest of the host is not significantly different from zero, but the point esti-
mate is noisy. This result masks heterogeneity across genders. Columns 2 and 3 of
Table 3 report the same regression limited to male hosts and female hosts, respec-
tively. Among male hosts, the interaction between the host’s race and guest’s race
shows a widening of the race gap by 11 percentage points, whereas among females,
the race gap narrows by 11 percentage points. Both estimates are noisy; we cannot
reject coefficients of zero.10
10 Table 4 explores the effect of the host’s race with more nuance. It shows the proportion of “Yes” responses
from each gender/race cell among hosts in response to each gender/race cell among guests. African American male
hosts discriminate against African American male and female guests. White hosts of both genders are more likely
to accept white guests of either gender. African American female hosts are the only exception: they accept African
American female guests more than any other group. Thus, with the exception of African American females, the data
Table 3—Race Gap by Race of the Host
Dependent variable: 1(host accepts)
All hosts
Male hosts
Female hosts
Other hosts
Guest is African American
−0.08
(0.02)
−0.09
(0.02)
−0.09
(0.02)
−0.07
(0.03)
Host is African American
0.06
(0.03)
0.19
(0.05)
−0.00
(0.04)
0.03
(0.09)
Host is African American × guest is
African American
0.01
(0.05)
−0.11
(0.08)
0.11
(0.06)
−0.06
(0.14)
Constant
0.48
(0.01)
0.44
(0.02)
0.50
(0.02)
0.50
(0.02)
Observations
6,235
1,854
2,336
2,045
Adjusted R2
0.007
0.015
0.007
0.003
Implied coefficient on guest is African American + host
is African American × guest is African American
−0.07
(0.05)
−0.19
(0.08)
0.02
(0.06)
−0.12
(0.14)
Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, the host’s race, and
the interaction between the two. Other hosts are hosts we could not classify as male or female. Of the 2,045 host pic-
tures we could not classify for gender, 972 had a picture of a mixed-gender couple, 259 had a same-gender couple,
603 had a picture without a human in it, and the rest could not be classified. Standard errors are clustered by (guest
name) × (city) and are reported in parentheses.
10
American Economic Journal: applied economics
april 2017
Discrimination may also be influenced by a host’s proximity to the guest. For
example, Becker (1957) formalizes racial discrimination as distaste for interactions
with individuals of a certain race. On Airbnb, a host must classify each listing as offer-
ing an entire unit, a room within a unit, or a shared room. We classify anything other
than an entire unit as a “shared property.” Column 1 of Table 5 shows that the race gap
is roughly the same whether or not a property is shared. (In unreported results, we find
that the race gap stays roughly the same in shared properties with only one bathroom.)
One might expect a distinction between casual Airbnb hosts who occasion-
ally rent out their homes, versus professional hosts who offer multiple properties.
Roughly a sixth of Airbnb hosts manage multiple properties, and roughly 40 percent
of hosts have at least ten reviews from past guests. Columns 2 and 3 explore the
extent of discrimination among hosts with multiple locations, and those with more
than ten reviews. Across these specifications, the race gap persists with roughly the
same magnitude.11
To the extent that discrimination rates are changing over time, one might expect
discrimination to be less common among younger hosts. To assess this possibility,
we employed Mechanical Turk workers to categorize hosts as young, middle-aged,
or old. Column 4 shows that discrimination also persists across the age categories
with roughly the same magnitude.
B. Effects by Listing Characteristics
Just as discrimination was robust across host characteristics, we find that dis-
crimination does not vary based on the cost or location of the property. Column 1 of
Table 6 shows that, overall, listings above the median price are more likely to reject
is inconsistent with homophily. Table 4 focuses on race/gender subgroups, but we present a more systematic break-
down of the raw results in Appendix Table 2. We ultimately focused on race/gender cells for ease of presentation.
11 Hosts with at least ten reviews still have a race gap, but the acceptance rates for both races are higher among
these hosts. Instead of the 50 percent to 42 percent gap we see among all hosts, the race gap among hosts with at
least 10 reviews, or hosts with multiple properties, is closer to 60 percent to 52 percent. Hence, the racial gap is the
same in terms of percentage points, but not in terms of percent. The same is true in a later specification, where we
look at the race gap among hosts with at least one review from an African American guest. In all these specifica-
tions, the change in the odds ratio is not economically significant. We have insufficient statistical power to reject the
possibility that the odds ratios remain constant while the gap changes slightly.
Table 4—Proportion of Positive Responses by Race and Gender
Guest race/gender
Host race/gender
White
male
African
American
male
White
female
African
American
female
White male
0.42
0.35
0.49
0.32
African American male
0.64
0.40
0.59
0.43
White female
0.46
0.35
0.49
0.44
African American female
0.43
0.38
0.53
0.59
Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to
guests of a certain race/gender.
Vol. 9 No. 2
11
Edelman et al.: Racial Discrimination in the Sharing Economy
inquiries. However, discrimination remains both among more expensive and less
expensive listings.
We can also check whether the listing was eventually filled (for the nights in
question) to create a proxy for the desirability of the listing. First, we fit a Probit
model to predict the likelihood that the listing was filled, controlling for a fixed city
effect and a host of covariates.12 Then we assign each listing a probability of being
filled. This lets us test whether discrimination changes based on the listing’s desir-
ability.13 It does not.
We also hypothesized that the extent of discrimination might vary with the diver-
sity of a neighborhood. More generally, one might expect that geography matters
and that discrimination is worse in some areas than others, due to market structure
12 The covariates are as follows: the host’s race and gender, the price, number of bedrooms, whether the property
is shared, whether the bathroom is shared, the number of reviews, the age of the host, whether the host operates mul-
tiple listings, the proportion of white people in the census tract, and the number of Airbnb listings in the census tract.
13 We thank an anonymous reviewer for suggesting this approach.
Table 5—Are Effects Driven by Host Characteristics?
Dependent variable: 1(host accepts)
Guest is African American
−0.07
(0.02)
−0.08
(0.02)
−0.09
(0.02)
−0.11
(0.02)
−0.09
(0.02)
Shared property
0.00
(0.01)
Shared property × guest is African American
−0.02
(0.03)
Host has multiple listings
0.14
(0.02)
Host has multiple listings × guest is African American
−0.01
(0.03)
Host has ten+ reviews
0.14
(0.02)
Host has ten+ reviews × guest is African American
0.01
(0.02)
Host looks young
−0.03
(0.02)
Host looks young × guest is African American
−0.01
(0.02)
Host has 1+ reviews from an African American guest
0.10
(0.01)
Host has 1+ reviews from an African American guest
× guest is African American
0.06
(0.02)
Constant
0.49
(0.01)
0.46
(0.01)
0.42
(0.01)
0.50
(0.01)
0.46
(0.01)
Observations
6,235
6,235
6,235
6,235
6,235
Adjusted R2
0.006
0.014
0.027
0.011
0.019
Implied coefficient on guest is African American
+ host trait × guest is African American
−0.09
(0.02)
−0.09
(0.03)
−0.08
(0.02)
−0.08
(0.03)
−0.04
(0.03)
Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various host char-
acteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are
reported in parentheses.
12
American Economic Journal: applied economics
april 2017
or underlying rates of discrimination among a population. Merging data on neigh-
borhoods by census tract, column 2 shows that the extent of discrimination does not
vary with the proportion of nearby residents who are African American. Column 3
shows that discrimination is ubiquitous: it does not vary with the number of Airbnb
listings within the census tract. We also find discrimination in all cities in our sam-
ple, as shown in Appendix Table 3.
C. Robustness—Effects by Name
Table 7 shows the proportion of positive responses broken down by name. The
effect is robust across choice of names. For example, the African American female
name with the most positive responses (Tamika) received fewer positive responses
than the white female name with the fewest positive responses (Kristen), though this
difference is not statistically significant. Similarly, the African American males with
the most positive responses (Darnell and Rasheed) received fewer acceptances than
the white male with the fewest positive responses (Brad).
D. Comparing Experimental Results with Observational Patterns
Each listing page includes reviews from previous guests, along with profile pic-
tures for these guests. This allows us to see which hosts previously accepted African
Table 6— Are Effects Driven by Location Characteristics?
Dependent variable = 1(host accepts)
Guest is African American
−0.09
(0.02)
−0.08
(0.02)
−0.09
(0.02)
−0.12
(0.06)
Price > median
−0.07
(0.02)
Guest is African American × (price > median)
0.01
(0.03)
Share of African American population in census tract
0.05
(0.05)
Guest is African American × (share of African American
population in census tract)
0.02
(0.08)
Airbnb listings per census tract
−0.0007
(0.0009)
Guest is African American × (Airbnb listings per census tract)
0.0008
(0.001)
Probability listing is filled 8 weeks later
0.56
(0.08)
Guest is African American × (probability listing is filled
eight weeks later)
0.09
(0.12)
Constant
0.52
(0.02)
0.48
(0.01)
0.49
(0.02)
0.24
(0.03)
Observations
6,235
6,223
6,235
6,101
Adjusted R2
0.01
0.006
0.006
0.030
Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various location
characteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are
reported in parentheses.
Vol. 9 No. 2
13
Edelman et al.: Racial Discrimination in the Sharing Economy
American guests (although not all guests leave reviews and not all guests have pho-
tos that reveal their race). We use this data to assess the external validity of our
results.
We collected profile pictures from the ten most recent reviews on each listing
page. We categorized these past guests by race and gender, finding that 29 percent
of hosts in our sample had at least one review from an African American guest. We
then regressed the likelihood of a host responding positively to our inquiry on the
race of the guest, whether the host has at least one recent review from an African
American guest, and an interaction between these variables. Column 5 of Table 5
reports the results. We find that the race gap drops sharply among hosts with at least
one recent review from an African American guest. We cannot reject zero
difference
for requests from our African American test accounts versus requests from our white
test accounts, though this result is only significant at the 10 percent level.14
This finding reinforces our interpretation of our main effects, including the role
of race and the interpretation that observed differences reflect racial discrimina-
tion by Airbnb hosts. Put another way, if our findings are driven by a quirk of our
14 These findings are robust to alternative specifications of a host’s past guests. The same substantive results
hold if we look at the raw number of reviews from African Americans, rather than whether there is at least one such
review. The same is true if we use the proportion of reviews from African American guests.
Table 7— Proportion of Positive Responses, by Name
Entire sample
0.43
(6,390)
White female
African American female
Allison Sullivan
0.49
(306)
Lakisha Jones
0.42
(324)
Anne Murphy
0.56
(344)
Latonya Robinson
0.35
(331)
Kristen Sullivan
0.48
(325)
Latoya Williams
0.43
(327)
Laurie Ryan
0.50
(327)
Tamika Williams
0.47
(339)
Meredith O’Brien
0.49
(303)
Tanisha Jackson
0.40
(309)
White male
African American male
Brad Walsh
0.41
(317)
Darnell Jackson
0.38
(285)
Brent Baker
0.48
(332)
Jamal Jones
0.33
(328)
Brett Walsh
0.44
(279)
Jermaine Jones
0.36
(300)
Greg O’Brien
0.45
(312)
Rasheed Jackson
0.38
(313)
Todd McCarthy
0.43
(314)
Tyrone Robinson
0.36
(254)
Notes: The table reports the proportion of “Yes” responses by name. The number of messages
sent by each guest name is shown in parentheses.
14
American Economic Journal: applied economics
april 2017
experimental design, rather than race, then it is difficult to explain why the race
gap disappears precisely among hosts with a history of accepting African American
guests.
E. Importance of Profile Pictures and More Complete Profiles
A related concern is that we used guest profiles that were relatively bare. A host
may hesitate to accept a guest without a profile picture or past reviews. Of course,
this alone cannot explain the race gap, since both white and African American guests
had bare profiles. But it does raise the question of whether more complete profiles
could mitigate discrimination.15
Internal data from Airbnb and observational data on Airbnb users both suggest that
profile pictures alone are unlikely to make much difference. With access to internal
Airbnb data, Fradkin (2015) looks at roughly 17,000 requests sent to hosts and finds
that guests are rejected 49 percent of the time. Notably, these requests from ordinary
Airbnb users, with typical Airbnb profiles, were rejected at a rate similar to that of
our guests. In our experiment, as detailed in Appendix Table 4, 44 percent of guests
were rejected or received no response. Another 11 percent received a message from
a host requesting more information. The remaining 46 percent were accepted. The
similarity in rejection rates suggests that incompleteness of our guests’ profiles is
not likely to be causing a change in the rejection rate, and reinforces the ecological
validity of our experimental design.
Other methods indicate that profile pictures seem to have little impact on accep-
tance decisions. In a logistic regression estimating the probability of receiving a
rejection from a host, again using internal Airbnb data, Fradkin (2015) finds that
including a profile picture has no significant effect. This matches the observational
data we collect: in a random selection of Airbnb users, we found that only 44 per-
cent have a profile picture. The proportion of guests with a profile picture is higher
among users who have left a review, but nonetheless both analyses indicate that the
existence of profile pictures plays a small role in host decision-making. Further,
even if profile pictures impact rejection rates, it is not clear that the impact should
be differential by race. For example, one might expect that pictures would make a
guest’s race more salient. If our results are driven by race, then our findings would
be a lower bound on the true effect.
One limitation of our experiment is that we do not observe the effect of past
reviews on discrimination. If our findings are driven by statistical discrimination,
positive reviews from previous hosts may reduce the extent of discrimination.
However, three factors suggest that reviews are an incomplete response to a discrim-
ination problem. First, our acceptance rates are similar to overall acceptance rates
15 Similarly, our experiment does not assess whether discrimination occurs because of race or social class.
Hanson and Hawley (2011) find, in a field experiment on Craigslist’s housing market using similar methodology,
that renters with African American names face a penalty, but that the penalty decreases if the e-mail sent to a
landlord signals higher social class. Under some specifications, African Americans face a statistically significant
penalty based on race and an additional penalty for signaling low class, also statistically significant. Under other
specifications, the racial gap is not statistically significant when comparing white and African American guests who
both signal high social class. On the whole, the paper indicates that social class and race both play a role.
Vol. 9 No. 2
15
Edelman et al.: Racial Discrimination in the Sharing Economy
on Airbnb (Fradkin 2015), which indicates that hosts are not treating our test guest
accounts differently for lack of reviews, meaning that reviews would be unlikely
to eliminate discrimination. Indeed, for reviews to eliminate discrimination, they
would need to provide a 16 percent differential increase in acceptance rates for
African Americans, relative to white guests. Second, all Airbnb users necessarily
start without past reviews, so a review system would not address any initial barri-
ers to entry that guests face. Third, a subjective review system can itself allow or
facilitate discrimination. (See, e.g., Goldin and Rouse 2000, finding that visually
confirming a musician’s gender may influence an expert’s judgment of her work.)
Whatever mechanism is causing a lower acceptance rate for the African American
guests may also cause a worse rating.
F. How Much Does Discrimination Cost Hosts?
A host incurs a cost for discriminating when rejecting a guest causes a unit to
remain empty. The expected cost depends on the likelihood of the property remain-
ing vacant, which in turn depends on the thickness of the market. If a host can easily
find a replacement guest, then discrimination is nearly costless for the host. But if a
property remains vacant after the host rejects a guest, then discrimination imposes a
more significant cost. In other words, the impact on net revenue from discriminating
depends on the likelihood of filling a unit with someone of the host’s preferred race
after rejecting a guest of a disfavored race.
Because we collect data about each property’s availability after a host declines a
guest, we can estimate the cost in net revenue from discrimination. Suppose a host
charges price p for a listing and pays listing fees f to Airbnb. Let
π
replace
be the prob-
ability of filling the property after rejecting a guest in our study. Then the cost in net
revenue of discrimination is as follows:
ΔNet Revenue = (
p − f
) −
π
replace
·
(
p − f
) = (1 −
π
replace
) · (
p − f
).
That is, the cost of discrimination, in terms of net revenue, is the revenue that the
host forgoes if the listing remains empty multiplied by the probability that the listing
remains empty.
In our data, hosts who rejected or never responded to our inquiries had properties
with a median price of $163 and a mean price of $295.16 The numbers are similar
and slightly higher if we restrict the sample further to those hosts who rejected
African American guests, or if we expand the sample to hosts who responded “Yes”
to our accounts.17 Airbnb charges each host a fee equal to 3 percent of the listing
price.
16 In calculating price, we sum the listing price and any cleaning fee.
17 An anonymous reviewer correctly points out that the host we are interested in is the host on the margin of
discriminating. But there are hosts far from this margin both within the group of hosts who said yes and within the
group of hosts who said no. Nonetheless, our calculations in this section are not sensitive to which group of hosts
we include. When including hosts who said yes, the median price drops from $163 to 10 or $20
16
American Economic Journal: applied economics
april 2017
After our inquiries, roughly 25.9 percent of the listings in our study remained
vacant on the dates we requested after rejecting or not responding to one of our
guests. Another 37.9 percent remained listed but were no longer available on those
dates, suggesting that the host either found another guest or decided to no longer
make the property available on the specified dates. The remaining 36.1 percent
of properties were no longer listed on Airbnb. Because it is unclear whether the
hosts who exit should be excluded from the sample or treated as not having found a
replacement, we develop two estimates.
If we exclude these disappearing hosts from our calculation, 59.4 percent of hosts
found a replacement guest. Setting p equal to the median price ($163) and fees at
3 percent of the median price:
ΔNet Revenue = (1 − 0.594) · ($163 − 0.03 · $163) ≈ $64.19.
If we treat disappearing listings as vacancies, in effect assuming that the host of
a dropped listing was not able to find a replacement guest, then only 37.9 percent of
hosts found a replacement guest. The cost of discrimination rises as a result:
ΔNet Revenue = (1 − 0.379) · ($163 − 0.03 · $163) ≈ $98.19.
In this analysis, we focus on the net revenue, which does not incorporate the
marginal cost of each night the listing is rented, since we do not directly observe
costs. The cost of hosting includes various types of host effort or wear-and-tear to
the property. In principle, hosting also entails a risk of damage by a guest, though
throughout the relevant period Airbnb automatically provided all hosts with prop-
erty insurance, which reduces the risk. Our calculation also excludes unobserved
benefits of hosting, such as the possibility that a positive review draws more guests
in the future and improves the listing position on Airbnb. A full estimate of profit
would also need to consider the time cost of looking for new guests after rejecting
someone on the basis of race.18
While these estimates are clearly noisy, they suggest that hosts incur a real cost
by discriminating. The median host who rejects a guest because of race is turning
down between 100 of revenue.
IV. Discussion
Online platforms such as Airbnb create new markets by eliminating search fric-
tions, building trust, and facilitating transactions (Lewis 2011, Luca 2016). With
the rise of the sharing economy, however, comes a level of discrimination that
among hosts who say yes, and therefore either did not discriminate against the African American accounts or did
not get a chance to do so.
18 Our calculation also ignores other factors that cut in both directions. Responding with a “Yes” to a guest does
not provide 100 percent certainty of a paid booking; the guest may choose another option or may not make the trip.
In that case, our estimates overstate the revenue loss. Similarly, we have imperfect information about whether a
host found a replacement guest. Among other complexities, our guests requested two-night stays; we treat a host as
having filled a listing if the host found a replacement guest for at least one of the nights, though a host who filled
only one of the nights has nonetheless lost one night of revenue.
Vol. 9 No. 2
17
Edelman et al.: Racial Discrimination in the Sharing Economy
is
impossible in the online hotel reservations process. Clearly, the manager of a
Holiday Inn cannot examine names of potential guests and reject them based on race
or socioeconomic status, or some combination of the two. Yet, this is commonplace
on Airbnb, which now accounts for a growing share of the short-term rental market.
Our results contribute to a small but growing body of literature suggesting that
discrimination persists—and we argue may even be exacerbated—in online plat-
forms. Edelman and Luca (2014) show that African American hosts on Airbnb seek
and receive lower prices than white hosts, controlling for the observable attributes of
each listing. Pope and Sydnor (2011) find that loan listings with pictures of African
Americans on Prosper.com are less likely to be funded than similar listings with pic-
tures of white borrowers. Doleac and Stein (2013) show that buyers are less likely
to respond to Craigslist listings showing an iPod held by a Black hand compared to
an identical ad with a white hand. In contrast, Morton, Zettelmeyer, and Silva-Risso
(2003) find no difference by race in price paid for cars in online purchases—a sharp
contrast to traditional channels (see, e.g., List 2004; Zhao, Ondrich, and Yinger
2005).
One important limitation of our experiment is that we cannot identify the mecha-
nism causing worse outcomes for guests with distinctively African American names.
Prior research shows that distinctively African American names are correlated with
lower socioeconomic status (Fryer and Levitt 2004). Our findings cannot identify
whether the discrimination is based on race, socioeconomic status, or a combination
of these two. That said, we note that discrimination disappears among hosts who
have previously accepted African American guests. One might worry that discrimi-
nation against our test guest accounts results from our choice of names and, hence,
does not represent patterns that affect genuine Airbnb guests. However, we find that
discrimination is limited to hosts who have never had an African American guest,
which suggests that our results are consistent with any broader underlying patterns
of discrimination.
Similarly, our experiment does not provide a sharp test of alternative models
of discrimination. The theoretical literature on discrimination often distinguishes
between statistical and taste-based discrimination. While our experimental design
cannot reject either mechanism, our findings suggest a more nuanced story than
either of the classic models. For one, we find homophily among African American
females, but not among other race/gender combinations. Furthermore, we find that
discrimination is not sensitive to a measure of proximity between the host and guest.
Both findings are in tension with pure taste-based discrimination. But we also find
some evidence against pure statistical discrimination. As noted above, we find that
hosts who have had an African American guest in the past exhibit less
discrimination
than other hosts. This suggests that, at the very least, hosts are using different statis-
tical models as they evaluate potential guests.
A. Designing a Discrimination-Free Marketplace
Because online platforms choose which information is available to parties during
a transaction, they can prevent the transmission of information that is irrelevant
or potentially pernicious. Our results highlight a platform’s role in
preventing
18
American Economic Journal: applied economics
april 2017
discrimination or facilitating discrimination, as the case may be. If a platform
aspires to provide a discrimination-free environment, its rules must be designed
accordingly.
Airbnb has several options to reduce discrimination. For example, it could con-
ceal guest names, just as it already prevents transmission of e-mail addresses and
phone numbers, so that guests and hosts cannot circumvent Airbnb’s platform and
its fees. Communications on eBay’s platform have long used pseudonyms and auto-
matic salutations, so Airbnb could easily implement that approach.
Alternatively, Airbnb might further expand its “Instant Book” option, in which
hosts accept guests without screening them first. Closer to traditional hotels and bed
and breakfasts, this system would eliminate the opportunity for discrimination. This
change also offers convenience benefits for guests, who can count on their booking
being confirmed more quickly and with fewer steps. However, in our sample, only a
small subset of hosts currently allow instant booking. Airbnb could push to expand
the use of this feature, which would also serve the company’s broader goal of reduc-
ing search frictions.
More generally, our results suggest an important tradeoff for market designers,
who set the rules of online platforms, including the pricing mechanisms (Einav et al.
2013) and the information that is available and actionable at the time of transaction
(Luca 2016). Market design principles have generally focused on increasing the
information flow within a platform (Bolton et al. 2013, Che and HÖrner 2014, Dai
et al. 2014, Fradkin et al. 2014), but we highlight a situation in which platforms may
be providing too much information.
B. Policy Implications
Because the legal system grants considerable protection to online marketplaces,
Airbnb is unlikely to be held liable for allowing discrimination on its platform.
Within the United States, the Civil Rights Act of 1964 prohibits discrimination in
hotels (and other public accommodations) based on race, color, religion, or national
origin. But these laws appear to be a poor fit for the informal sharing economy,
where private citizens rent out a room in their home (Belzer and Leong forthcoming;
Todisco 2015). As discussed in Edelman and Luca (2014), any changes by Airbnb
would likely be driven by ethical considerations or public pressure rather than law.
In contrast, offline rental markets and hotels have been subject to significant regula-
tion (as well as audit studies to test for discrimination) for decades. This contributes
to worry among policymakers that online short-term rental markets like Airbnb may
be displacing offline markets, which are more heavily regulated (Schatz, Feinstein,
and Warren 2016). One clear policy implication is that regulators may want to audit
Airbnb hosts using an approach based on our paper—much like longstanding efforts
to reduce discrimination in offline rental markets.
One might have hoped that online markets would cure discrimination, and it
seems a different design might indeed do so. Regrettably, our analysis indicates that
at Airbnb, this is not yet the case.
Vol. 9 No. 2
19
Edelman et al.: Racial Discrimination in the Sharing Economy
Invited Postscript: Airbnb Implements Market Design Changes
Prior to this paper, Airbnb repeatedly ignored allegations of discrimination
on the platform (Finley 2016; Larson and Harris 2016). In response to our
study and growing user complaints, the company put together a task force
including former attorney general Eric Holder to propose a set of market
design changes to reduce discrimination on the platform (Benner 2016).
On the same day this paper was accepted for publication in this journal,
Airbnb announced the company’s planned changes. Changes include a
goal of increasing the proportion of hosts who offer Instant Book (letting
guests book instantly, without the host first seeing the guest’s picture or
name), a reminder to all users of the company’s
anti-discrimination pol-
icy, increased training for Airbnb staff to assist users who report discrim-
ination, and testing reduced prominence of guests’ photos. However, as of
the time of publication, Airbnb continued to reject suggestions to conceal
guest photos and names before booking.
Appendix
Table A1—Results of Survey Testing Races Associated with Names
White female
African American female
Meredith O’Brien
0.93
Tanisha Jackson
0.03
Anne Murphy
0.95
Lakisha Jones
0.05
Laurie Ryan
0.97
Latoya Williams
0.05
Allison Sullivan
0.98
Latonya Robinson
0.07
Kristen Sullivan
1.00
Tamika Williams
0.07
White male
African American male
Greg O‘Brien
0.88
Tyrone Robinson
0.00
Brent Baker
0.90
Rasheed Jackson
0.06
Brad Walsh
0.91
Jamal Jones
0.07
Brett Walsh
0.93
Darnell Jackson
0.10
Todd McCarthy
0.98
Jermaine Jones
0.26
Notes: “White” is coded as 1. “African American” is coded as 0. Sample size = 62.
Table A2—Raw Discrimination across All Race and Gender Groups
Guest race/gender
Host race/gender
White
male
(1)
African
American
male
(2)
White
female
(3)
African
American
female
(4)
Male
(5)
Female
(6)
p-value
(7)
White
(8)
African
American
(9)
White male
0.42
0.35
0.49
0.32
0.39
0.4
0.72
0.45
0.34
African American male
0.64
0.40
0.59
0.43
0.52
0.51
0.99
0.62
0.42
White female
0.46
0.35
0.49
0.44
0.41
0.46
0.06
0.48
0.39
African American female
0.43
0.38
0.53
0.59
0.41
0.56
0.02
0.48
0.50
White
0.45
0.36
0.50
0.40
0.41
0.45
0.02
0.47
0.38
African American
0.49
0.40
0.58
0.52
0.45
0.55
0.02
0.53
0.46
Other or uncertain
0.45
0.38
0.51
0.43
0.41
0.47
0.03
0.48
0.40
Male
0.43
0.36
0.47
0.35
0.40
0.41
0.80
0.45
0.35
Female
0.47
0.34
0.51
0.45
0.41
0.48
0.004
0.49
0.40
Other or uncertain
0.45
0.41
0.54
0.45
0.43
0.50
0.003
0.50
0.43
Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to guests of a certain
race/gender.
20
American Economic Journal: applied economics
april 2017
References
Ayres, Ian, and Peter Siegelman. 1995. “Race and Gender Discrimination in Bargaining for a New
Car.” American Economic Review 85 (3): 304–21.
Ayres, Ian, Fredrick E. Vars, and Nasser Zakariya. 2005. “To Insure Prejudice: Racial Disparities in
Taxicab Tipping.” Yale Law Journal 114 (7): 1613–74.
Becker, Gary S. 1957. The Economics of Discrimination. Chicago: University of Chicago Press.
Belzer, Aaron, and Nancy Leong.
Forthcoming. “The New Public Accommodations.” Georgetown Law
Journal.
Benner, Katie. 2016. “Airbnb Adopts Rules to Fight Discrimination by Its Hosts.” New York Times,
September 8, A1.
Bertrand, Marianne, and Sendhil Mullainathan. 2004. “Are Emily and Greg More Employable Than
Lakisha and Jamal? A Field Experiment on Labor Market Discrimination.” American Economic
Review 94 (4): 991–1013.
Table A3—Discrimination by City
Dependent variable: 1(host accepts)
All
cities
Baltimore
(N = 347)
Dallas
(N = 415)
Los Angeles
(N = 3,913)
St. Louis
(N = 151)
Washington, DC
(N = 1,559)
Guest is African American
−0.08
−0.07
(0.02)
−0.08
(0.02)
−0.10
(0.02)
−0.08
(0.03)
−0.08
(0.02)
City
—
0.07
(0.03)
0.04
(0.03)
−0.00
(0.03)
0.02
(0.05)
−0.03
(0.04)
City × guest is
African American
—
−0.12
(0.05)
−0.01
(0.04)
0.03
(0.04)
0.02
(0.07)
−0.01
(0.05)
Constant
0.49
0.48
(0.01)
0.49
(0.01)
0.49
(0.02)
0.49
(0.01)
0.50
(0.01)
Observations
6,235
6,235
6,235
6,235
6,235
6,235
Adjusted R2
0.006
0.007
0.006
0.006
0.006
0.007
Implied coefficient on guest is
African American + city
× guest is African American
—
−0.19
(0.04)
−0.09
(0.04)
−0.07
(0.02)
−0.06
(0.06)
−0.09
(0.05)
Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, a city, and the inter-
action of city and guest race. Standard errors are clustered by (guest name) × (city) and are reported in parentheses.
Table A4—Host Responses to Guest Inquiries, by Race of the Guest
White
guests
African American
guests
Yes
1,152
940
Yes, but request for more information
375
308
Yes, with lower price if booked now
11
10
Yes, if guest extends stay
10
15
Yes, but in a different property
18
8
Yes, at a higher price
4
0
Request for more information
339
323
Not sure or check back later
154
175
No response
429
423
No unless more information is provided
12
15
No
663
873
Notes: The table reports the frequency of each type of host response to a guest inquiry, by race of
the guest. Likelihood-ratio chi-squared = 68.61 (
p < 0.01). Null hypothesis is that the columns
will have equal proportions for each type of response.
Vol. 9 No. 2
21
Edelman et al.: Racial Discrimination in the Sharing Economy
Bolton, Gary, Ben Greiner, and Axel Ockenfels. 2013. “Engineering Trust: Reciprocity in the Produc-
tion of Reputation Information.” Management Science 59 (2): 265–85.
Carlsson, Magnus, and Dan-Olof Rooth. 2007. “Evidence of ethnic discrimination in the Swedish
labor market using experimental data.” Labour Economics 14 (4): 716–29.
Che, Yeon-Koo, and Johannes Hörner. 2014. “Optimal Design for Social Learning.” http://liberalarts.
utexas.edu/_files/ms37643/Che-Horner03-04-14.pdf.
Dai, Weijia, Ginger Z. Jin, Jungmin Lee, and Michael Luca. 2014. “Optimal Aggregation of Consumer
Ratings: An Application to Yelp.com.” National Bureau of Economic Research (NBER) Working
Paper 18567.
Deming, David J., Noam Yuchtman, Amira Abulafi, Claudia Golding, and Lawrence F. Katz. 2016.
“The Value of Postsecondary Credentials in the Labour Market: An Experimental Study.” American
Economic Review 106 (3): 778–806.
Doleac, Jennifer L., and Luke C. D. Stein. 2013. “The Visible Hand: Race and Online Market Out-
comes.” Economic Journal 123 (572): F469–92.
Edelman, Benjamin G., and Michael Luca. 2014. “Digital Discrimination: The Case of Airbnb.com.”
Harvard Business School Working Paper 14-054.
Edelman, Benjamin, Michael Luca, and Dan Svirsky. 2017. “Racial Discrimination in the Sharing
Economy: Evidence from a Field Experiment: Dataset.” American Economic Journal: Applied Eco-
nomics. https://doi.org/10.1257/app.20160213.
Einav, Liran, Chiara Farronato, Jonathan D. Levin, and Neel Sundaresan. 2013. “Sales Mechanisms
in Online Markets: What Happened to Internet Auctions?” National Bureau of Economic Research
(NBER) Working Paper 19021.
Finley, Taryn. 2016. “These Airbnb Alternatives Want To Make Travel More Welcoming For Black
People.” Huffington Post, August 18. http://www.huffingtonpost.com/entry/innclusive-noirbnb-
airbnb-alternatives_us_5768462ae4b0853f8bf1c675.
Fradkin, Audrey. 2015. “Search Frictions and the Design of Online Marketplaces.” http://andreyfradkin.
com/assets/SearchFrictions.pdf.
Fradkin, Audrey, Elena Grewal, Dave Holtz, and Matthew Pearson. 2014. “Bias and Reciprocity in
Online Reviews: Evidence from Field Experiments on Airbnb.” Unpublished.
Fryer, Roland G., Jr., and Steven D. Levitt. 2004. “The Causes and Consequences of Distinctively
Black Names.” Quarterly Journal of Economics 119 (3): 767–805.
Ghayad, Rand. 2014. “The Jobless Trap.” http://www.lexissecuritiesmosaic.com/gateway/FEDRES/
SPEECHES/ugd_576e9a_f6cf3b6661e44621ad26547112f66691.pdf.
Goldin, Claudia, and Cecilia Rouse. 2000. “Orchestrating Impartiality: The Impact of ‘Blind’ Audi-
tions on Female Musicians.” American Economic Review 90 (4): 715–41.
Hanson, Andrew, and Zackary Hawley. 2011. “Do landlords discriminate in the rental housing mar-
ket? Evidence from an internet field experiment in U.S. cities.” Journal of Urban Economics 70
(2–3): 99–114.
Lahey, Joanna N. 2008. “Age, Women, and Hiring: An Experimental Study.” Journal of Human
Resources 43 (1): 30–56.
Larson, Erik, and Andrew M. Harris. 2016. “Airbnb Sued, Accused of Ignoring Hosts’ Race Discrim-
ination.” Bloomberg, May 18. http://www.bloomberg.com/news/articles/2016-05-18/airbnb-sued-
over-host-s-alleged-discrimination-against-black-man.
Lewis, Gregory. 2011. “Asymmetric Information, Adverse Selection and Online Disclosure: The Case
of eBay Motors.” American Economic Review 101 (4): 1535–46.
List, John A. 2004. “The Nature and Extent of Discrimination in the Marketplace: Evidence from the
Field.” Quarterly Journal of Economics 119 (1): 49–89.
Luca, Michael.
2016. “User-Generated Content and Social Media.” In Handbook of Media Economics,
Vol. 1B, edited by Simon Anderson, Joel Waldfogel, and David Strömberg, 563–92. Amsterdam:
North-Holland.
Morton, Fiona Scott, Florian Zettelmeyer, and Jorge Silva-Risso. 2003. “Consumer Information and
Discrimination: Does the Internet Affect the Pricing of New Cars to Women and Minorities?”
Quantitative Marketing and Economics 1 (1): 65–92.
Ondrich, Jan, Alex Stricker, and John Yinger. 1999. “Do Landlords Discriminate? The Incidence and
Causes of Racial Discrimination in Rental Housing Markets.” Journal of Housing Economics 8 (3):
185–204.
Oreopoulos, Philip. 2011. “Why Do Skilled Immigrants Struggle in the Labor Market? A Field Exper-
iment with Thirteen Thousand Resumes.” American Economic Journal: Economic Policy 3 (4):
148–71.
22
American Economic Journal: applied economics
april 2017
Pager, Devah. 2003. “The Mark of a Criminal Record.” American Journal of Sociology 108 (5): 937–75.
Pope, Devon G., and Justin R. Sydnor. 2011. “What’s in a Picture?: Evidence of Discrimination from
Prosper.com.” Journal of Human Resources 46 (1): 53–92.
Schatz, Brian, Dianne Feinstein, and Elizabeth Warren. 2016. “Letter to Edith Ramirez, Chairwoman
of the Federal Trade Commission.” http://www.warren.senate.gov/files/documents/2016-7-13-
letter-to-FTC.pdf.
Todisco, Michael. 2015. “Share and Share Alike? Considering Racial Discrimination in the Nascent
Room-Sharing Economy.” Stanford Law Review Online 67: 121–29.
U.S. Department of Housing and Urban Development. 2013. Housing Discrimination against Racial
and Ethnic Minorities 2012. Office of Policy Development and Research. Washington, DC, June.
Yinger, John. 1998. “Evidence on Discrimination in Consumer Markets.” Journal of Economic Per-
spectives 12 (2): 23–40.
Zhao, Bo, Jon Ondrich, and John Yinger. 2005. “Why Do Real Estate Brokers Continue to Discrimi-
nate? Evidence from the 2000 Housing Discrimination Study.” Syracuse University Center for Pol-
icy Research Paper 96.Plain-text mathematical notation (without MathML)
American Economic Journal: Applied Economics 2017, 9(2): 1–22 https://doi.org/10.1257/app.20160213 1 Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment† By Benjamin Edelman, Michael Luca, and Dan Svirsky* In an experiment on Airbnb, we find that applications from guests with distinctively African American names are 16 percent less likely to be accepted relative to identical guests with distinctively white names. Discrimination occurs among landlords of all sizes, includ- ing small landlords sharing the property and larger landlords with multiple properties. It is most pronounced among hosts who have never had an African American guest, suggesting only a subset of hosts discriminate. While rental markets have achieved significant reductions in discrimination in recent decades, our results sug- gest that Airbnb’s current design choices facilitate discrimination and raise the possibility of erasing some of these civil rights gains. (JEL C93, J15, L83) O ver the past 50 years, there have been considerable societal efforts to reduce the level of discrimination against African Americans in the United States. In the context of housing and rental accommodations, antidiscrimination laws have sought to eliminate discrimination through regulation. While racial discrimination continues to exist in rental markets, it has improved in the last two decades (Yinger 1998, US Department of Housing and Urban Development 2013; compare Zhao, Ondrich, and Yinger 2005 to Ondrich, Stricker, and Yinger 1999). Yet in recent years, markets have changed dramatically, with a growing share of transactions moving online. In the context of housing, Airbnb has created a new market for short-term rentals that did not previously exist, allowing small landlords to increasingly enter the market. Whereas antidiscrimination laws ban the landlord of a large apartment building from discriminating based on race, the prevailing view among legal scholars is that such laws likely do not reach many of the smaller land- lords using Airbnb (Belzer and Leong forthcoming; Todisco 2015). In this paper, we investigate the existence and extent of racial discrimination on Airbnb, the canonical example of the sharing economy. Airbnb allows hosts * Edelman: Harvard Business School, Morgan 462, 25 Harvard Way, Boston, MA 02163 (e-mail: bedelman@ hbs.edu); Luca: Harvard Business School, Baker Library 457, 10 Harvard Way, Boston, MA 02163 (e-mail: mluca@ hbs.edu); Svirsky: Harvard Business School and Harvard University Department of Economics, Baker Library 420A, 25 Harvard Way, Boston MA 02163 (e-mail: dsvirsky@hbs.edu). We thank Ian Ayres, Larry Katz, Kevin Lang, Sendhil Mullainathan, Devah Pager, and seminar participants at eBay, Harvard Law School, Hong Kong University of Science and Technology, Indiana University, New York University, Northwestern University, Stanford University, and University at Albany for valuable feedback. We thank Haruka Uchida for tireless research assistance. Our Institutional Review Board approved our methods before we began collecting data. IRB# 15-2226. † Go to https://doi.org/10.1257/app.20160213 to visit the article page for additional materials and author disclosure statement(s) or to comment in the online discussion forum. 2 American Economic Journal: applied economics april 2017 to rent out houses, apartments, or rooms within an apartment. To facilitate these transactions, Airbnb promotes properties to prospective guests, facilitates commu- nication, and handles payment and some aspects of customer service. Airbnb allows hosts to decide whether to accept or reject a guest after seeing his or her name and often a picture—a market design choice that may further enable discrimination. To test for discrimination, we conduct a field experiment in which we inquire about the availability of roughly 6,400 listings on Airbnb across five cities. Specifically, we create guest accounts that differ by name but are otherwise identical. Drawing on the methodology of a labor market experiment by Bertrand and Mullainathan (2004), we select two sets of names—one distinctively African American and the other distinctively white.1 We find widespread discrimination against guests with distinctively African American names. African American guests received a positive response roughly 42 percent of the time, compared to roughly 50 percent for white guests.2 This 8 percentage point (roughly 16 percent) penalty for African American guests is par- ticularly noteworthy when compared to the discrimination-free setting of competing short-term accommodation platforms such as Expedia. The penalty is consistent with the racial gap found in contexts ranging from labor markets to online lending to classified ads to taxicabs.3 Combining our experimental results with observational data from Airbnb’s site, we investigate whether different types of hosts discriminate more, and whether dis- crimination is more common at certain types of properties based on price or local demographics. Our results are remarkably persistent. Both African American and white hosts discriminate against African American guests; both male and female hosts discriminate; both male and female African American guests are discrimi- nated against. Effects persist both for hosts that offer an entire property and for hosts who share the property with guests. Discrimination persists among experi- enced hosts, including those with multiple properties and those with many reviews. Discrimination persists and is of similar magnitude in high- and low-priced units, in diverse and homogeneous neighborhoods. Because hosts’ profile pages contain reviews (and pictures) from recent guests, we can cross-validate our experimental findings using observational data on whether the host has recently had an African American guest. We find that discrimination is concentrated among hosts with no African American guests in their review history. When we restrict our analysis to hosts who have had an African American guest in 1 We build on the large literature using audit studies to test for discrimination. Past research considers African Americans and applicants with prison records in the labor market (Pager 2003), immigrants in the labor market (Oreopoulos 2011), Arabic job seekers (Carlsson and Rooth 2007), gender (Lahey 2008), long-term unemployment (Ghayad 2014), and going to a for-profit college (Deming et al. 2016), among many others. 2 Some caution is warranted here. We only observe a gap between distinctively white and distinctively African American names, which differ not only by suggested ethnicity but also potentially by socioeconomic status (Fryer and Levitt 2004). For ease of exposition, we describe our results in terms of differences among the “African American guests” or the “white guests,” or use the term “race gap,” without also specifying that our results may better be described as a “race and socioeconomic status gap.” Section V discusses this issue in more detail. 3 Doleac and Stein (2013) find a 62 percent to 56 percent gap in offer rates for online classified postings. Bertrand and Mullainathan (2004) find a 10 percent to 6 percent gap in callback rates for jobs. Pope and Sydnor (2011) find a 9 percent to 6 percent gap in lending rates in an online lending market. Ayres, Vars, and Zakariya (2005) find a 20 percent to 13 percent gap in how often taxi drivers receive a tip. Vol. 9 No. 2 3 Edelman et al.: Racial Discrimination in the Sharing Economy the recent past, discrimination disappears—reinforcing the external validity of our main results, and suggesting that discrimination is concentrated among a subset of hosts. To explore the cost to a host of discriminating, we check whether each listing is ultimately rented for the weekend we inquired about. Combining that informa- tion with the price of each listing, we estimate that a host incurs a cost of roughly $65–$100 in foregone revenue by rejecting an African American guest. Overall, our results suggest a cause for concern. While discrimination has shrunk in more regulated offline markets, it arises and persists in online markets. Government agencies at both the federal and state level have routinely conducted audit studies to test for racial discrimination since 1955 in offline markets. One might imagine implementing regular audits in online markets as well; indeed, online audits might be easier to run at scale due to improved data access and reduced implementation cost. Our results also reflect the design choices that Airbnb and other online market- places use. It is not clear a priori how online markets will affect discrimination. To the extent that online markets can be more anonymous than in-person trans- actions, there may actually be less room for discrimination. For example, Ayres and Siegelman (1995) find that African American car buyers pay a higher price than white car buyers at dealerships, whereas Morton, Zettelmeyer, and Silva-Risso (2003) find no such racial difference in online purchases. Similarly, platforms such as Amazon, eBay, and Expedia offer little scope for discrimination, as sellers effec- tively pre-commit to accept all buyers regardless of race or ethnicity. However, these advantages are by no means guaranteed, and in fact they depend on design choices made by each online platform. In this situation, Airbnb’s design choices enable widespread discrimination. I. About Airbnb Airbnb is a popular online marketplace for short-term rentals. Founded in 2008, the site gained traction quickly and, as of November 2015, it offers 2,000,000 listings worldwide.4 This is more than 3 times as many as Marriott’s 535,000 rooms world- wide. Airbnb reports serving over 40 million guests in more than 190 countries. While the traditional hotel industry is dominated by hotels and inns that each offer many rooms, Airbnb enables anyone to post even a single room that is vacant only occasionally. Hosts provide a wealth of information about each listing, includ- ing the type of property (house, apartment, boat, or even castle, of which there are over 1,400 listed), the number of bedrooms and bathrooms, the price, and location. Each host also posts information about herself. An interested guest can see a host’s profile picture as well as reviews from past guests. Airbnb encourages prospective guests to confirm availability by clicking a listing’s “Contact” button to write to the host.5 In our field experiments (described in the next section), we use that method to evaluate a host’s receptiveness to a booking from a given guest. 4 https://www.airbnb.com/about/about-us. 5 See “How do I know if a listing is available,” https://www.airbnb.com/help/question/137. 4 American Economic Journal: applied economics april 2017 II. Experimental Design A. Sample and Data Collection We collected data on all properties offered on Airbnb in Baltimore, Dallas, Los Angeles, St. Louis, and Washington, DC as of July 2015. Our goal was to collect data from the top 20 metropolitan areas from the 2010 census. We started with these five cities because they had varying levels of Airbnb usage and came from diverse geographic regions. Baltimore, Dallas, and St. Louis offer several hundred listings each, while Los Angeles and Washington, DC have several thousand. We stopped data collection after these five cities because Airbnb became increasingly rapid in blocking our automated tools which logged into guest accounts and communicated with hosts. (We considered taking steps to conceal our methods from Airbnb, but ultimately declined to do so.) Because some hosts offer multiple listings, we selected only one listing per host using a random number generator. This helped to reduce the burden on any given host, and it also prevented a single host from receiving multiple identical e-mails. Each host was contacted for no more than one transaction in our experiment. We also collected data from each host’s profile page. This allowed us to analyze host characteristics in exceptional detail. First, we saved the host’s profile image. We then employed Mechanical Turk workers to assess each host image for race (white, African American, Asian, Hispanic, multiracial, unknown), gender (male, female, two people of the same gender, two people of different genders, unknown), and age (young, middle-aged, old). We hired two Mechanical Turk workers to assess each image, and if the workers disagreed on race or gender, we hired a third to settle the dispute. If all three workers disagreed (as happened, for example, for a host whose profile picture was an image of a sea turtle), we manually coded the picture. We coded race as “unknown” when the picture did not show a person. Through this procedure, we roughly categorized hosts by race, gender, and age. Profile pages also revealed other variables of interest. We noted the number of properties each host offers on Airbnb, anticipating that professional hosts with mul- tiple properties might discriminate less often than others. We retrieved the number of reviews the host has received, a rough measure of whether the host is an avid Airbnb user or a casual one. We further checked the guests who had previously reviewed each host. Airbnb posts the photo of each such guest, so we used Face++, a face-detection API, to categorize past guests by race, gender, and age.6 This allows us to examine relationships between a host’s prior experience with African American guests and the host’s rejection of new African American requests. We also collected information about each listing. We recorded the price of the listing, the number of bedrooms and bathrooms, the cancellation policy, any clean- ing fee, and the listing’s ratings from past guests. We also measured whether the 6 In addition to detecting race, gender, and age, Face++ estimates its confidence for each trait. When Face++ was unable to make a match or its confidence was below 95 out of 100, we used Mechanical Turk to categorize the past guest via the method described above. Vol. 9 No. 2 5 Edelman et al.: Racial Discrimination in the Sharing Economy listing offered an entire unit versus a room in a larger unit, yielding a proxy for how much the host interacts with the guest. Each listing included a longitude and latitude, which allowed us to link to census demographic data to assess the relationship between neighborhood demographics and discrimination. After linking the latitude and longitude to a census tract, we used census data on the number of African American, Hispanic, Asian, and white individuals. Table 1 presents summary statistics about the hosts and listings as well as balanced treatment tests. We later checked each listing to see whether hosts were ultimately able to fill open- ings. Our guests inquired about reservations eight weeks in advance. Thus, if a guest sent a message on August 1 about the weekend of September 25, we checked on Friday, September 24 to see whether the specified listing was still listed as available. B. Treatment Groups Our analysis used four main treatment groups based on the perceived race and gender of the test guest accounts. Hosts were contacted by guests with names that signaled African American males, African American females, white males, and white females, drawn from Bertrand and Mullainathan (2004). The list was based on the frequency of names from birth certificates of babies born between 1974 and 1979 in Massachusetts. Distinctively white names are those that are most likely to be white, conditional on the name, and similarly for distinctively African American names. To validate the list, we conducted a survey in which we asked participants to quickly categorize each name as white or African American. With just three sec- onds permitted for a response, survey takers had little time to think beyond a gut response. The survey results, presented in Appendix Table 1, confirm that the names continue to signal race.7 7 On a scale of 0 to 1, where 0 is African American, the white female names each had an average survey response of 0.90 or above, and the African American female names all had an average score of 0.10 or below. The male Table 1— Summary Statistics Variables Mean SD 25th percentile 75th percentile Observations Mean, white accounts Mean, African American accounts p-value Host is white 0.63 0.48 0 1 6,392 0.64 0.63 0.15 Host is African American 0.08 0.27 0 0 6,392 0.08 0.08 0.97 Host is female 0.38 0.48 0 1 6,392 0.38 0.37 0.44 Host is male 0.30 0.46 0 1 6,392 0.3 0.3 0.90 Price ($) 181.11 1,280.23 75 175 6,302 166.43 195.81 0.36 Number of bedrooms 3.18 2.26 2 4 6,242 3.18 3.18 0.96 Number of bathrooms 3.17 2.26 2 4 6,285 3.17 3.17 0.93 Number of reviews 30.87 72.51 2 29 6,390 30.71 31.03 0.86 Host has multiple listings 0.16 0.36 0 0 6,392 0.32 0.33 0.45 Host has 1+ reviews from African American guests 0.29 0.45 0 1 6,390 0.29 0.28 0.38 Airbnb listings per census tract 9.51 9.28 2 14 6,392 9.49 9.54 0.85 Percent population African American (census tract) 0.14 0.2 0.03 0.14 6,378 0.14 0.14 0.92 6 American Economic Journal: applied economics april 2017 We then created 20 Airbnb accounts, identical in all respects except for guest names. Our names included ten that are distinctively African American and ten dis- tinctively white names, divided into five male and five female names within each group. To avoid the confounds that would result from pictures, we use only names; our Airbnb profiles include no picture of the putative guest. From these 20 guest accounts, we sent messages to prospective hosts. Each host was randomly assigned one of our 20 guest accounts. Figure 1 presents a representative e-mail from one of our guests to an Airbnb host. The name and dates changed depending on the mes- sage sender and when the message was sent.8 In choosing the dates, we asked hosts about a weekend that was approximately eight weeks distant from when the mes- sage was sent. We limited our search to those properties that were listed as available during the weekend in question. names showed slightly more variation but tell the same story: all the white male names scored 0.88 or above, and all the African American male names except for Jermaine Jones scored 0.10 or below. The Appendix presents the full results of the survey. 8 No more than 48 hours elapsed between our first contact to a host in a given city, and the completion of our contacting hosts in that city. Furthermore, no hosts in our sample had listings in more than one of the five cities we tested. Hence, it is unlikely that a host contacted later on in the study would have learned about the experiment. Figure 1. Sample Treatment Vol. 9 No. 2 7 Edelman et al.: Racial Discrimination in the Sharing Economy C. Experimental Procedure We sent roughly 6,400 messages to hosts between July 7, 2015 and July 30, 2015.9 Each message inquired about availability during a specific weekend in September. When a host replied to a guest, we replied to the host with a personal message clar- ifying that we (as the guest) were still not sure if we would visit the city or if we would need a place to stay. We sent this reply in order to reduce the likelihood of a host holding inventory for one of our hypothetical guests. We tracked host responses over the 30 days that followed each request. A research assistant then coded each response into categories. The majority of responses were in 1 of 6 groups: “No response” (if the host did not respond within 30 days); “No or listing is unavailable;” “Yes;” “Request for more information” (if the host responded with questions for the guest); “Yes, with questions” (if the host approved the stay but also asked questions); “Check back later for definitive answer;” and “I will get back to you.” As these categories show, our initial categorizations used subtle dis- tinctions between possible responses. In our analyses below, however, we restrict our attention to the simplest response—“Yes”—though all of our results are robust to using “No” instead, as well as to ignoring nonresponses or to using broader defi- nitions of “Yes.” We collected all data using scrapers we built for this purpose. We sent inquiries to Airbnb hosts using web browser automation tools we built for this purpose. III. Results Table 2 presents the main effect. We find that inquiries from guests with white-sounding names are accepted roughly 50 percent of the time. In contrast, guests with African American-sounding names are accepted roughly 42 percent of the time. Columns 2 and 3 introduce additional control variables related to the host or the property. The effect stays constant at a roughly 8 percentage point gap across these specifications, controlling for the host’s gender, race, an indicator for whether the host has multiple listings, an indicator for whether the property is shared, host experience (whether the host has more than ten reviews), and the log of the listing price. As noted, we break down hosts’ responses into 11 categories. Figure 2 shows the frequency of each response by race. One might worry that results are driven by differences in host responses that are hard to classify, such as conditional “Yes” responses. Similarly, we would be concerned if our findings were driven by differ- ences in response rate. African American accounts might be more likely to be catego- rized as spam, or hosts may believe that African American accounts are more likely to be fake, in which case one might expect higher nonresponse rates for African 9 Our initial goal was to collect roughly 10,000 responses. This was based on a power analysis, which in turn used an effect size calculated from Edelman and Luca (2014). To find a similar effect size, we would need a sample size of roughly 3,000 hosts. But, to calculate an effect among a subgroup of hosts, like African American hosts, which represent roughly 7 percent of the Airbnb population, we would need a sample size closer to 10,000. We fell short of this goal for an exogenous reason: Airbnb shut down the experimental accounts after we collected roughly 6,400 responses. 8 American Economic Journal: applied economics april 2017 American accounts. But as Figure 2 shows, the discrimination results occur because of differences in simple “Yes” or “No” responses, not because of nonresponses or intermediate responses (like a conditional “Yes”). In the rest of this section, we use the wealth of data available on Airbnb about the host and location for each listing to look for factors that influence the gap between Table 2— The Impact of Race on Likelihood of Acceptance Dependent variable: 1(host accepts) Guest is African American −0.08 (0.02) −0.08 (0.02) −0.09 (0.02) Host is African American 0.07 (0.02) 0.09 (0.02) Host is male −0.05 (0.01) −0.05 (0.01) Host has multiple listings 0.09 (0.02) Shared property −0.07 (0.02) Host has 10+ reviews 0.12 (0.01) ln(price) −0.06 (0.01) Constant 0.49 (0.01) 0.50 (0.01) 0.76 (0.07) Observations 6,235 6,235 6,168 Adjusted R2 0.006 0.009 0.040 Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race and various host and location characteristics. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Figure 2. Host Responses by Race 1,200 900 600 300 0 Yes Conditional yes No response Conditional no No Guest is African American Guest is white Vol. 9 No. 2 9 Edelman et al.: Racial Discrimination in the Sharing Economy white and African American names. Does the identity of the host matter? Does the location of the property matter? Generally, we find that the discrimination is remark- ably robust. A. Effects by Host Characteristics We first check whether our finding changes based on the identity of the host. If discrimination is driven by homophily (in-group bias), then the host’s race should matter. According to this theory, hosts might simply prefer guests of the same race. If homophily were the primary factor driving differential guest acceptance rates, then African American guests would face higher acceptance rates from African American hosts. Table 3 presents regressions that include guest race, host race, and an interaction term. Across the entire sample of hosts, the interaction between the race and guest of the host is not significantly different from zero, but the point esti- mate is noisy. This result masks heterogeneity across genders. Columns 2 and 3 of Table 3 report the same regression limited to male hosts and female hosts, respec- tively. Among male hosts, the interaction between the host’s race and guest’s race shows a widening of the race gap by 11 percentage points, whereas among females, the race gap narrows by 11 percentage points. Both estimates are noisy; we cannot reject coefficients of zero.10 10 Table 4 explores the effect of the host’s race with more nuance. It shows the proportion of “Yes” responses from each gender/race cell among hosts in response to each gender/race cell among guests. African American male hosts discriminate against African American male and female guests. White hosts of both genders are more likely to accept white guests of either gender. African American female hosts are the only exception: they accept African American female guests more than any other group. Thus, with the exception of African American females, the data Table 3—Race Gap by Race of the Host Dependent variable: 1(host accepts) All hosts Male hosts Female hosts Other hosts Guest is African American −0.08 (0.02) −0.09 (0.02) −0.09 (0.02) −0.07 (0.03) Host is African American 0.06 (0.03) 0.19 (0.05) −0.00 (0.04) 0.03 (0.09) Host is African American × guest is African American 0.01 (0.05) −0.11 (0.08) 0.11 (0.06) −0.06 (0.14) Constant 0.48 (0.01) 0.44 (0.02) 0.50 (0.02) 0.50 (0.02) Observations 6,235 1,854 2,336 2,045 Adjusted R2 0.007 0.015 0.007 0.003 Implied coefficient on guest is African American + host is African American × guest is African American −0.07 (0.05) −0.19 (0.08) 0.02 (0.06) −0.12 (0.14) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, the host’s race, and the interaction between the two. Other hosts are hosts we could not classify as male or female. Of the 2,045 host pic- tures we could not classify for gender, 972 had a picture of a mixed-gender couple, 259 had a same-gender couple, 603 had a picture without a human in it, and the rest could not be classified. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. 10 American Economic Journal: applied economics april 2017 Discrimination may also be influenced by a host’s proximity to the guest. For example, Becker (1957) formalizes racial discrimination as distaste for interactions with individuals of a certain race. On Airbnb, a host must classify each listing as offer- ing an entire unit, a room within a unit, or a shared room. We classify anything other than an entire unit as a “shared property.” Column 1 of Table 5 shows that the race gap is roughly the same whether or not a property is shared. (In unreported results, we find that the race gap stays roughly the same in shared properties with only one bathroom.) One might expect a distinction between casual Airbnb hosts who occasion- ally rent out their homes, versus professional hosts who offer multiple properties. Roughly a sixth of Airbnb hosts manage multiple properties, and roughly 40 percent of hosts have at least ten reviews from past guests. Columns 2 and 3 explore the extent of discrimination among hosts with multiple locations, and those with more than ten reviews. Across these specifications, the race gap persists with roughly the same magnitude.11 To the extent that discrimination rates are changing over time, one might expect discrimination to be less common among younger hosts. To assess this possibility, we employed Mechanical Turk workers to categorize hosts as young, middle-aged, or old. Column 4 shows that discrimination also persists across the age categories with roughly the same magnitude. B. Effects by Listing Characteristics Just as discrimination was robust across host characteristics, we find that dis- crimination does not vary based on the cost or location of the property. Column 1 of Table 6 shows that, overall, listings above the median price are more likely to reject is inconsistent with homophily. Table 4 focuses on race/gender subgroups, but we present a more systematic break- down of the raw results in Appendix Table 2. We ultimately focused on race/gender cells for ease of presentation. 11 Hosts with at least ten reviews still have a race gap, but the acceptance rates for both races are higher among these hosts. Instead of the 50 percent to 42 percent gap we see among all hosts, the race gap among hosts with at least 10 reviews, or hosts with multiple properties, is closer to 60 percent to 52 percent. Hence, the racial gap is the same in terms of percentage points, but not in terms of percent. The same is true in a later specification, where we look at the race gap among hosts with at least one review from an African American guest. In all these specifica- tions, the change in the odds ratio is not economically significant. We have insufficient statistical power to reject the possibility that the odds ratios remain constant while the gap changes slightly. Table 4—Proportion of Positive Responses by Race and Gender Guest race/gender Host race/gender White male African American male White female African American female White male 0.42 0.35 0.49 0.32 African American male 0.64 0.40 0.59 0.43 White female 0.46 0.35 0.49 0.44 African American female 0.43 0.38 0.53 0.59 Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to guests of a certain race/gender. Vol. 9 No. 2 11 Edelman et al.: Racial Discrimination in the Sharing Economy inquiries. However, discrimination remains both among more expensive and less expensive listings. We can also check whether the listing was eventually filled (for the nights in question) to create a proxy for the desirability of the listing. First, we fit a Probit model to predict the likelihood that the listing was filled, controlling for a fixed city effect and a host of covariates.12 Then we assign each listing a probability of being filled. This lets us test whether discrimination changes based on the listing’s desir- ability.13 It does not. We also hypothesized that the extent of discrimination might vary with the diver- sity of a neighborhood. More generally, one might expect that geography matters and that discrimination is worse in some areas than others, due to market structure 12 The covariates are as follows: the host’s race and gender, the price, number of bedrooms, whether the property is shared, whether the bathroom is shared, the number of reviews, the age of the host, whether the host operates mul- tiple listings, the proportion of white people in the census tract, and the number of Airbnb listings in the census tract. 13 We thank an anonymous reviewer for suggesting this approach. Table 5—Are Effects Driven by Host Characteristics? Dependent variable: 1(host accepts) Guest is African American −0.07 (0.02) −0.08 (0.02) −0.09 (0.02) −0.11 (0.02) −0.09 (0.02) Shared property 0.00 (0.01) Shared property × guest is African American −0.02 (0.03) Host has multiple listings 0.14 (0.02) Host has multiple listings × guest is African American −0.01 (0.03) Host has ten+ reviews 0.14 (0.02) Host has ten+ reviews × guest is African American 0.01 (0.02) Host looks young −0.03 (0.02) Host looks young × guest is African American −0.01 (0.02) Host has 1+ reviews from an African American guest 0.10 (0.01) Host has 1+ reviews from an African American guest × guest is African American 0.06 (0.02) Constant 0.49 (0.01) 0.46 (0.01) 0.42 (0.01) 0.50 (0.01) 0.46 (0.01) Observations 6,235 6,235 6,235 6,235 6,235 Adjusted R2 0.006 0.014 0.027 0.011 0.019 Implied coefficient on guest is African American + host trait × guest is African American −0.09 (0.02) −0.09 (0.03) −0.08 (0.02) −0.08 (0.03) −0.04 (0.03) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various host char- acteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. 12 American Economic Journal: applied economics april 2017 or underlying rates of discrimination among a population. Merging data on neigh- borhoods by census tract, column 2 shows that the extent of discrimination does not vary with the proportion of nearby residents who are African American. Column 3 shows that discrimination is ubiquitous: it does not vary with the number of Airbnb listings within the census tract. We also find discrimination in all cities in our sam- ple, as shown in Appendix Table 3. C. Robustness—Effects by Name Table 7 shows the proportion of positive responses broken down by name. The effect is robust across choice of names. For example, the African American female name with the most positive responses (Tamika) received fewer positive responses than the white female name with the fewest positive responses (Kristen), though this difference is not statistically significant. Similarly, the African American males with the most positive responses (Darnell and Rasheed) received fewer acceptances than the white male with the fewest positive responses (Brad). D. Comparing Experimental Results with Observational Patterns Each listing page includes reviews from previous guests, along with profile pic- tures for these guests. This allows us to see which hosts previously accepted African Table 6— Are Effects Driven by Location Characteristics? Dependent variable = 1(host accepts) Guest is African American −0.09 (0.02) −0.08 (0.02) −0.09 (0.02) −0.12 (0.06) Price > median −0.07 (0.02) Guest is African American × (price > median) 0.01 (0.03) Share of African American population in census tract 0.05 (0.05) Guest is African American × (share of African American population in census tract) 0.02 (0.08) Airbnb listings per census tract −0.0007 (0.0009) Guest is African American × (Airbnb listings per census tract) 0.0008 (0.001) Probability listing is filled 8 weeks later 0.56 (0.08) Guest is African American × (probability listing is filled eight weeks later) 0.09 (0.12) Constant 0.52 (0.02) 0.48 (0.01) 0.49 (0.02) 0.24 (0.03) Observations 6,235 6,223 6,235 6,101 Adjusted R2 0.01 0.006 0.006 0.030 Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various location characteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Vol. 9 No. 2 13 Edelman et al.: Racial Discrimination in the Sharing Economy American guests (although not all guests leave reviews and not all guests have pho- tos that reveal their race). We use this data to assess the external validity of our results. We collected profile pictures from the ten most recent reviews on each listing page. We categorized these past guests by race and gender, finding that 29 percent of hosts in our sample had at least one review from an African American guest. We then regressed the likelihood of a host responding positively to our inquiry on the race of the guest, whether the host has at least one recent review from an African American guest, and an interaction between these variables. Column 5 of Table 5 reports the results. We find that the race gap drops sharply among hosts with at least one recent review from an African American guest. We cannot reject zero difference for requests from our African American test accounts versus requests from our white test accounts, though this result is only significant at the 10 percent level.14 This finding reinforces our interpretation of our main effects, including the role of race and the interpretation that observed differences reflect racial discrimina- tion by Airbnb hosts. Put another way, if our findings are driven by a quirk of our 14 These findings are robust to alternative specifications of a host’s past guests. The same substantive results hold if we look at the raw number of reviews from African Americans, rather than whether there is at least one such review. The same is true if we use the proportion of reviews from African American guests. Table 7— Proportion of Positive Responses, by Name Entire sample 0.43 (6,390) White female African American female Allison Sullivan 0.49 (306) Lakisha Jones 0.42 (324) Anne Murphy 0.56 (344) Latonya Robinson 0.35 (331) Kristen Sullivan 0.48 (325) Latoya Williams 0.43 (327) Laurie Ryan 0.50 (327) Tamika Williams 0.47 (339) Meredith O’Brien 0.49 (303) Tanisha Jackson 0.40 (309) White male African American male Brad Walsh 0.41 (317) Darnell Jackson 0.38 (285) Brent Baker 0.48 (332) Jamal Jones 0.33 (328) Brett Walsh 0.44 (279) Jermaine Jones 0.36 (300) Greg O’Brien 0.45 (312) Rasheed Jackson 0.38 (313) Todd McCarthy 0.43 (314) Tyrone Robinson 0.36 (254) Notes: The table reports the proportion of “Yes” responses by name. The number of messages sent by each guest name is shown in parentheses. 14 American Economic Journal: applied economics april 2017 experimental design, rather than race, then it is difficult to explain why the race gap disappears precisely among hosts with a history of accepting African American guests. E. Importance of Profile Pictures and More Complete Profiles A related concern is that we used guest profiles that were relatively bare. A host may hesitate to accept a guest without a profile picture or past reviews. Of course, this alone cannot explain the race gap, since both white and African American guests had bare profiles. But it does raise the question of whether more complete profiles could mitigate discrimination.15 Internal data from Airbnb and observational data on Airbnb users both suggest that profile pictures alone are unlikely to make much difference. With access to internal Airbnb data, Fradkin (2015) looks at roughly 17,000 requests sent to hosts and finds that guests are rejected 49 percent of the time. Notably, these requests from ordinary Airbnb users, with typical Airbnb profiles, were rejected at a rate similar to that of our guests. In our experiment, as detailed in Appendix Table 4, 44 percent of guests were rejected or received no response. Another 11 percent received a message from a host requesting more information. The remaining 46 percent were accepted. The similarity in rejection rates suggests that incompleteness of our guests’ profiles is not likely to be causing a change in the rejection rate, and reinforces the ecological validity of our experimental design. Other methods indicate that profile pictures seem to have little impact on accep- tance decisions. In a logistic regression estimating the probability of receiving a rejection from a host, again using internal Airbnb data, Fradkin (2015) finds that including a profile picture has no significant effect. This matches the observational data we collect: in a random selection of Airbnb users, we found that only 44 per- cent have a profile picture. The proportion of guests with a profile picture is higher among users who have left a review, but nonetheless both analyses indicate that the existence of profile pictures plays a small role in host decision-making. Further, even if profile pictures impact rejection rates, it is not clear that the impact should be differential by race. For example, one might expect that pictures would make a guest’s race more salient. If our results are driven by race, then our findings would be a lower bound on the true effect. One limitation of our experiment is that we do not observe the effect of past reviews on discrimination. If our findings are driven by statistical discrimination, positive reviews from previous hosts may reduce the extent of discrimination. However, three factors suggest that reviews are an incomplete response to a discrim- ination problem. First, our acceptance rates are similar to overall acceptance rates 15 Similarly, our experiment does not assess whether discrimination occurs because of race or social class. Hanson and Hawley (2011) find, in a field experiment on Craigslist’s housing market using similar methodology, that renters with African American names face a penalty, but that the penalty decreases if the e-mail sent to a landlord signals higher social class. Under some specifications, African Americans face a statistically significant penalty based on race and an additional penalty for signaling low class, also statistically significant. Under other specifications, the racial gap is not statistically significant when comparing white and African American guests who both signal high social class. On the whole, the paper indicates that social class and race both play a role. Vol. 9 No. 2 15 Edelman et al.: Racial Discrimination in the Sharing Economy on Airbnb (Fradkin 2015), which indicates that hosts are not treating our test guest accounts differently for lack of reviews, meaning that reviews would be unlikely to eliminate discrimination. Indeed, for reviews to eliminate discrimination, they would need to provide a 16 percent differential increase in acceptance rates for African Americans, relative to white guests. Second, all Airbnb users necessarily start without past reviews, so a review system would not address any initial barri- ers to entry that guests face. Third, a subjective review system can itself allow or facilitate discrimination. (See, e.g., Goldin and Rouse 2000, finding that visually confirming a musician’s gender may influence an expert’s judgment of her work.) Whatever mechanism is causing a lower acceptance rate for the African American guests may also cause a worse rating. F. How Much Does Discrimination Cost Hosts? A host incurs a cost for discriminating when rejecting a guest causes a unit to remain empty. The expected cost depends on the likelihood of the property remain- ing vacant, which in turn depends on the thickness of the market. If a host can easily find a replacement guest, then discrimination is nearly costless for the host. But if a property remains vacant after the host rejects a guest, then discrimination imposes a more significant cost. In other words, the impact on net revenue from discriminating depends on the likelihood of filling a unit with someone of the host’s preferred race after rejecting a guest of a disfavored race. Because we collect data about each property’s availability after a host declines a guest, we can estimate the cost in net revenue from discrimination. Suppose a host charges price p for a listing and pays listing fees f to Airbnb. Let π replace be the prob- ability of filling the property after rejecting a guest in our study. Then the cost in net revenue of discrimination is as follows: ΔNet Revenue = ( p − f ) − π replace · ( p − f ) = (1 − π replace ) · ( p − f ). That is, the cost of discrimination, in terms of net revenue, is the revenue that the host forgoes if the listing remains empty multiplied by the probability that the listing remains empty. In our data, hosts who rejected or never responded to our inquiries had properties with a median price of $163 and a mean price of $295.16 The numbers are similar and slightly higher if we restrict the sample further to those hosts who rejected African American guests, or if we expand the sample to hosts who responded “Yes” to our accounts.17 Airbnb charges each host a fee equal to 3 percent of the listing price. 16 In calculating price, we sum the listing price and any cleaning fee. 17 An anonymous reviewer correctly points out that the host we are interested in is the host on the margin of discriminating. But there are hosts far from this margin both within the group of hosts who said yes and within the group of hosts who said no. Nonetheless, our calculations in this section are not sensitive to which group of hosts we include. When including hosts who said yes, the median price drops from $163 to 150,andtheprobabilityoffindingareplacementguestrisesto64percentinsteadof59.4percent(excludingdisappearinghosts)or45percentinsteadof37.9percent(includingdisappearinghosts).Thus,thecostofdiscriminationdropsbyabout10 or $20 16 American Economic Journal: applied economics april 2017 After our inquiries, roughly 25.9 percent of the listings in our study remained vacant on the dates we requested after rejecting or not responding to one of our guests. Another 37.9 percent remained listed but were no longer available on those dates, suggesting that the host either found another guest or decided to no longer make the property available on the specified dates. The remaining 36.1 percent of properties were no longer listed on Airbnb. Because it is unclear whether the hosts who exit should be excluded from the sample or treated as not having found a replacement, we develop two estimates. If we exclude these disappearing hosts from our calculation, 59.4 percent of hosts found a replacement guest. Setting p equal to the median price ($163) and fees at 3 percent of the median price: ΔNet Revenue = (1 − 0.594) · ($163 − 0.03 · $163) ≈ $64.19. If we treat disappearing listings as vacancies, in effect assuming that the host of a dropped listing was not able to find a replacement guest, then only 37.9 percent of hosts found a replacement guest. The cost of discrimination rises as a result: ΔNet Revenue = (1 − 0.379) · ($163 − 0.03 · $163) ≈ $98.19. In this analysis, we focus on the net revenue, which does not incorporate the marginal cost of each night the listing is rented, since we do not directly observe costs. The cost of hosting includes various types of host effort or wear-and-tear to the property. In principle, hosting also entails a risk of damage by a guest, though throughout the relevant period Airbnb automatically provided all hosts with prop- erty insurance, which reduces the risk. Our calculation also excludes unobserved benefits of hosting, such as the possibility that a positive review draws more guests in the future and improves the listing position on Airbnb. A full estimate of profit would also need to consider the time cost of looking for new guests after rejecting someone on the basis of race.18 While these estimates are clearly noisy, they suggest that hosts incur a real cost by discriminating. The median host who rejects a guest because of race is turning down between 65and100 of revenue. IV. Discussion Online platforms such as Airbnb create new markets by eliminating search fric- tions, building trust, and facilitating transactions (Lewis 2011, Luca 2016). With the rise of the sharing economy, however, comes a level of discrimination that among hosts who say yes, and therefore either did not discriminate against the African American accounts or did not get a chance to do so. 18 Our calculation also ignores other factors that cut in both directions. Responding with a “Yes” to a guest does not provide 100 percent certainty of a paid booking; the guest may choose another option or may not make the trip. In that case, our estimates overstate the revenue loss. Similarly, we have imperfect information about whether a host found a replacement guest. Among other complexities, our guests requested two-night stays; we treat a host as having filled a listing if the host found a replacement guest for at least one of the nights, though a host who filled only one of the nights has nonetheless lost one night of revenue. Vol. 9 No. 2 17 Edelman et al.: Racial Discrimination in the Sharing Economy is impossible in the online hotel reservations process. Clearly, the manager of a Holiday Inn cannot examine names of potential guests and reject them based on race or socioeconomic status, or some combination of the two. Yet, this is commonplace on Airbnb, which now accounts for a growing share of the short-term rental market. Our results contribute to a small but growing body of literature suggesting that discrimination persists—and we argue may even be exacerbated—in online plat- forms. Edelman and Luca (2014) show that African American hosts on Airbnb seek and receive lower prices than white hosts, controlling for the observable attributes of each listing. Pope and Sydnor (2011) find that loan listings with pictures of African Americans on Prosper.com are less likely to be funded than similar listings with pic- tures of white borrowers. Doleac and Stein (2013) show that buyers are less likely to respond to Craigslist listings showing an iPod held by a Black hand compared to an identical ad with a white hand. In contrast, Morton, Zettelmeyer, and Silva-Risso (2003) find no difference by race in price paid for cars in online purchases—a sharp contrast to traditional channels (see, e.g., List 2004; Zhao, Ondrich, and Yinger 2005). One important limitation of our experiment is that we cannot identify the mecha- nism causing worse outcomes for guests with distinctively African American names. Prior research shows that distinctively African American names are correlated with lower socioeconomic status (Fryer and Levitt 2004). Our findings cannot identify whether the discrimination is based on race, socioeconomic status, or a combination of these two. That said, we note that discrimination disappears among hosts who have previously accepted African American guests. One might worry that discrimi- nation against our test guest accounts results from our choice of names and, hence, does not represent patterns that affect genuine Airbnb guests. However, we find that discrimination is limited to hosts who have never had an African American guest, which suggests that our results are consistent with any broader underlying patterns of discrimination. Similarly, our experiment does not provide a sharp test of alternative models of discrimination. The theoretical literature on discrimination often distinguishes between statistical and taste-based discrimination. While our experimental design cannot reject either mechanism, our findings suggest a more nuanced story than either of the classic models. For one, we find homophily among African American females, but not among other race/gender combinations. Furthermore, we find that discrimination is not sensitive to a measure of proximity between the host and guest. Both findings are in tension with pure taste-based discrimination. But we also find some evidence against pure statistical discrimination. As noted above, we find that hosts who have had an African American guest in the past exhibit less discrimination than other hosts. This suggests that, at the very least, hosts are using different statis- tical models as they evaluate potential guests. A. Designing a Discrimination-Free Marketplace Because online platforms choose which information is available to parties during a transaction, they can prevent the transmission of information that is irrelevant or potentially pernicious. Our results highlight a platform’s role in preventing 18 American Economic Journal: applied economics april 2017 discrimination or facilitating discrimination, as the case may be. If a platform aspires to provide a discrimination-free environment, its rules must be designed accordingly. Airbnb has several options to reduce discrimination. For example, it could con- ceal guest names, just as it already prevents transmission of e-mail addresses and phone numbers, so that guests and hosts cannot circumvent Airbnb’s platform and its fees. Communications on eBay’s platform have long used pseudonyms and auto- matic salutations, so Airbnb could easily implement that approach. Alternatively, Airbnb might further expand its “Instant Book” option, in which hosts accept guests without screening them first. Closer to traditional hotels and bed and breakfasts, this system would eliminate the opportunity for discrimination. This change also offers convenience benefits for guests, who can count on their booking being confirmed more quickly and with fewer steps. However, in our sample, only a small subset of hosts currently allow instant booking. Airbnb could push to expand the use of this feature, which would also serve the company’s broader goal of reduc- ing search frictions. More generally, our results suggest an important tradeoff for market designers, who set the rules of online platforms, including the pricing mechanisms (Einav et al. 2013) and the information that is available and actionable at the time of transaction (Luca 2016). Market design principles have generally focused on increasing the information flow within a platform (Bolton et al. 2013, Che and HÖrner 2014, Dai et al. 2014, Fradkin et al. 2014), but we highlight a situation in which platforms may be providing too much information. B. Policy Implications Because the legal system grants considerable protection to online marketplaces, Airbnb is unlikely to be held liable for allowing discrimination on its platform. Within the United States, the Civil Rights Act of 1964 prohibits discrimination in hotels (and other public accommodations) based on race, color, religion, or national origin. But these laws appear to be a poor fit for the informal sharing economy, where private citizens rent out a room in their home (Belzer and Leong forthcoming; Todisco 2015). As discussed in Edelman and Luca (2014), any changes by Airbnb would likely be driven by ethical considerations or public pressure rather than law. In contrast, offline rental markets and hotels have been subject to significant regula- tion (as well as audit studies to test for discrimination) for decades. This contributes to worry among policymakers that online short-term rental markets like Airbnb may be displacing offline markets, which are more heavily regulated (Schatz, Feinstein, and Warren 2016). One clear policy implication is that regulators may want to audit Airbnb hosts using an approach based on our paper—much like longstanding efforts to reduce discrimination in offline rental markets. One might have hoped that online markets would cure discrimination, and it seems a different design might indeed do so. Regrettably, our analysis indicates that at Airbnb, this is not yet the case. Vol. 9 No. 2 19 Edelman et al.: Racial Discrimination in the Sharing Economy Invited Postscript: Airbnb Implements Market Design Changes Prior to this paper, Airbnb repeatedly ignored allegations of discrimination on the platform (Finley 2016; Larson and Harris 2016). In response to our study and growing user complaints, the company put together a task force including former attorney general Eric Holder to propose a set of market design changes to reduce discrimination on the platform (Benner 2016). On the same day this paper was accepted for publication in this journal, Airbnb announced the company’s planned changes. Changes include a goal of increasing the proportion of hosts who offer Instant Book (letting guests book instantly, without the host first seeing the guest’s picture or name), a reminder to all users of the company’s anti-discrimination pol- icy, increased training for Airbnb staff to assist users who report discrim- ination, and testing reduced prominence of guests’ photos. However, as of the time of publication, Airbnb continued to reject suggestions to conceal guest photos and names before booking. Appendix Table A1—Results of Survey Testing Races Associated with Names White female African American female Meredith O’Brien 0.93 Tanisha Jackson 0.03 Anne Murphy 0.95 Lakisha Jones 0.05 Laurie Ryan 0.97 Latoya Williams 0.05 Allison Sullivan 0.98 Latonya Robinson 0.07 Kristen Sullivan 1.00 Tamika Williams 0.07 White male African American male Greg O‘Brien 0.88 Tyrone Robinson 0.00 Brent Baker 0.90 Rasheed Jackson 0.06 Brad Walsh 0.91 Jamal Jones 0.07 Brett Walsh 0.93 Darnell Jackson 0.10 Todd McCarthy 0.98 Jermaine Jones 0.26 Notes: “White” is coded as 1. “African American” is coded as 0. Sample size = 62. Table A2—Raw Discrimination across All Race and Gender Groups Guest race/gender Host race/gender White male (1) African American male (2) White female (3) African American female (4) Male (5) Female (6) p-value (7) White (8) African American (9) White male 0.42 0.35 0.49 0.32 0.39 0.4 0.72 0.45 0.34 African American male 0.64 0.40 0.59 0.43 0.52 0.51 0.99 0.62 0.42 White female 0.46 0.35 0.49 0.44 0.41 0.46 0.06 0.48 0.39 African American female 0.43 0.38 0.53 0.59 0.41 0.56 0.02 0.48 0.50 White 0.45 0.36 0.50 0.40 0.41 0.45 0.02 0.47 0.38 African American 0.49 0.40 0.58 0.52 0.45 0.55 0.02 0.53 0.46 Other or uncertain 0.45 0.38 0.51 0.43 0.41 0.47 0.03 0.48 0.40 Male 0.43 0.36 0.47 0.35 0.40 0.41 0.80 0.45 0.35 Female 0.47 0.34 0.51 0.45 0.41 0.48 0.004 0.49 0.40 Other or uncertain 0.45 0.41 0.54 0.45 0.43 0.50 0.003 0.50 0.43 Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to guests of a certain race/gender. 20 American Economic Journal: applied economics april 2017 References Ayres, Ian, and Peter Siegelman. 1995. “Race and Gender Discrimination in Bargaining for a New Car.” American Economic Review 85 (3): 304–21. Ayres, Ian, Fredrick E. Vars, and Nasser Zakariya. 2005. “To Insure Prejudice: Racial Disparities in Taxicab Tipping.” Yale Law Journal 114 (7): 1613–74. Becker, Gary S. 1957. The Economics of Discrimination. Chicago: University of Chicago Press. Belzer, Aaron, and Nancy Leong. Forthcoming. “The New Public Accommodations.” Georgetown Law Journal. Benner, Katie. 2016. “Airbnb Adopts Rules to Fight Discrimination by Its Hosts.” New York Times, September 8, A1. Bertrand, Marianne, and Sendhil Mullainathan. 2004. “Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination.” American Economic Review 94 (4): 991–1013. Table A3—Discrimination by City Dependent variable: 1(host accepts) All cities Baltimore (N = 347) Dallas (N = 415) Los Angeles (N = 3,913) St. Louis (N = 151) Washington, DC (N = 1,559) Guest is African American −0.08 −0.07 (0.02) −0.08 (0.02) −0.10 (0.02) −0.08 (0.03) −0.08 (0.02) City — 0.07 (0.03) 0.04 (0.03) −0.00 (0.03) 0.02 (0.05) −0.03 (0.04) City × guest is African American — −0.12 (0.05) −0.01 (0.04) 0.03 (0.04) 0.02 (0.07) −0.01 (0.05) Constant 0.49 0.48 (0.01) 0.49 (0.01) 0.49 (0.02) 0.49 (0.01) 0.50 (0.01) Observations 6,235 6,235 6,235 6,235 6,235 6,235 Adjusted R2 0.006 0.007 0.006 0.006 0.006 0.007 Implied coefficient on guest is African American + city × guest is African American — −0.19 (0.04) −0.09 (0.04) −0.07 (0.02) −0.06 (0.06) −0.09 (0.05) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, a city, and the inter- action of city and guest race. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Table A4—Host Responses to Guest Inquiries, by Race of the Guest White guests African American guests Yes 1,152 940 Yes, but request for more information 375 308 Yes, with lower price if booked now 11 10 Yes, if guest extends stay 10 15 Yes, but in a different property 18 8 Yes, at a higher price 4 0 Request for more information 339 323 Not sure or check back later 154 175 No response 429 423 No unless more information is provided 12 15 No 663 873 Notes: The table reports the frequency of each type of host response to a guest inquiry, by race of the guest. Likelihood-ratio chi-squared = 68.61 ( p < 0.01). Null hypothesis is that the columns will have equal proportions for each type of response. Vol. 9 No. 2 21 Edelman et al.: Racial Discrimination in the Sharing Economy Bolton, Gary, Ben Greiner, and Axel Ockenfels. 2013. “Engineering Trust: Reciprocity in the Produc- tion of Reputation Information.” Management Science 59 (2): 265–85. Carlsson, Magnus, and Dan-Olof Rooth. 2007. “Evidence of ethnic discrimination in the Swedish labor market using experimental data.” Labour Economics 14 (4): 716–29. Che, Yeon-Koo, and Johannes Hörner. 2014. “Optimal Design for Social Learning.” http://liberalarts. utexas.edu/_files/ms37643/Che-Horner03-04-14.pdf. Dai, Weijia, Ginger Z. Jin, Jungmin Lee, and Michael Luca. 2014. “Optimal Aggregation of Consumer Ratings: An Application to Yelp.com.” National Bureau of Economic Research (NBER) Working Paper 18567. Deming, David J., Noam Yuchtman, Amira Abulafi, Claudia Golding, and Lawrence F. Katz. 2016. “The Value of Postsecondary Credentials in the Labour Market: An Experimental Study.” American Economic Review 106 (3): 778–806. Doleac, Jennifer L., and Luke C. D. Stein. 2013. “The Visible Hand: Race and Online Market Out- comes.” Economic Journal 123 (572): F469–92. Edelman, Benjamin G., and Michael Luca. 2014. “Digital Discrimination: The Case of Airbnb.com.” Harvard Business School Working Paper 14-054. Edelman, Benjamin, Michael Luca, and Dan Svirsky. 2017. “Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment: Dataset.” American Economic Journal: Applied Eco- nomics. https://doi.org/10.1257/app.20160213. Einav, Liran, Chiara Farronato, Jonathan D. Levin, and Neel Sundaresan. 2013. “Sales Mechanisms in Online Markets: What Happened to Internet Auctions?” National Bureau of Economic Research (NBER) Working Paper 19021. Finley, Taryn. 2016. “These Airbnb Alternatives Want To Make Travel More Welcoming For Black People.” Huffington Post, August 18. http://www.huffingtonpost.com/entry/innclusive-noirbnb- airbnb-alternatives_us_5768462ae4b0853f8bf1c675. Fradkin, Audrey. 2015. “Search Frictions and the Design of Online Marketplaces.” http://andreyfradkin. com/assets/SearchFrictions.pdf. Fradkin, Audrey, Elena Grewal, Dave Holtz, and Matthew Pearson. 2014. “Bias and Reciprocity in Online Reviews: Evidence from Field Experiments on Airbnb.” Unpublished. Fryer, Roland G., Jr., and Steven D. Levitt. 2004. “The Causes and Consequences of Distinctively Black Names.” Quarterly Journal of Economics 119 (3): 767–805. Ghayad, Rand. 2014. “The Jobless Trap.” http://www.lexissecuritiesmosaic.com/gateway/FEDRES/ SPEECHES/ugd_576e9a_f6cf3b6661e44621ad26547112f66691.pdf. Goldin, Claudia, and Cecilia Rouse. 2000. “Orchestrating Impartiality: The Impact of ‘Blind’ Audi- tions on Female Musicians.” American Economic Review 90 (4): 715–41. Hanson, Andrew, and Zackary Hawley. 2011. “Do landlords discriminate in the rental housing mar- ket? Evidence from an internet field experiment in U.S. cities.” Journal of Urban Economics 70 (2–3): 99–114. Lahey, Joanna N. 2008. “Age, Women, and Hiring: An Experimental Study.” Journal of Human Resources 43 (1): 30–56. Larson, Erik, and Andrew M. Harris. 2016. “Airbnb Sued, Accused of Ignoring Hosts’ Race Discrim- ination.” Bloomberg, May 18. http://www.bloomberg.com/news/articles/2016-05-18/airbnb-sued- over-host-s-alleged-discrimination-against-black-man. Lewis, Gregory. 2011. “Asymmetric Information, Adverse Selection and Online Disclosure: The Case of eBay Motors.” American Economic Review 101 (4): 1535–46. List, John A. 2004. “The Nature and Extent of Discrimination in the Marketplace: Evidence from the Field.” Quarterly Journal of Economics 119 (1): 49–89. Luca, Michael. 2016. “User-Generated Content and Social Media.” In Handbook of Media Economics, Vol. 1B, edited by Simon Anderson, Joel Waldfogel, and David Strömberg, 563–92. Amsterdam: North-Holland. Morton, Fiona Scott, Florian Zettelmeyer, and Jorge Silva-Risso. 2003. “Consumer Information and Discrimination: Does the Internet Affect the Pricing of New Cars to Women and Minorities?” Quantitative Marketing and Economics 1 (1): 65–92. Ondrich, Jan, Alex Stricker, and John Yinger. 1999. “Do Landlords Discriminate? The Incidence and Causes of Racial Discrimination in Rental Housing Markets.” Journal of Housing Economics 8 (3): 185–204. Oreopoulos, Philip. 2011. “Why Do Skilled Immigrants Struggle in the Labor Market? A Field Exper- iment with Thirteen Thousand Resumes.” American Economic Journal: Economic Policy 3 (4): 148–71. 22 American Economic Journal: applied economics april 2017 Pager, Devah. 2003. “The Mark of a Criminal Record.” American Journal of Sociology 108 (5): 937–75. Pope, Devon G., and Justin R. Sydnor. 2011. “What’s in a Picture?: Evidence of Discrimination from Prosper.com.” Journal of Human Resources 46 (1): 53–92. Schatz, Brian, Dianne Feinstein, and Elizabeth Warren. 2016. “Letter to Edith Ramirez, Chairwoman of the Federal Trade Commission.” http://www.warren.senate.gov/files/documents/2016-7-13- letter-to-FTC.pdf. Todisco, Michael. 2015. “Share and Share Alike? Considering Racial Discrimination in the Nascent Room-Sharing Economy.” Stanford Law Review Online 67: 121–29. U.S. Department of Housing and Urban Development. 2013. Housing Discrimination against Racial and Ethnic Minorities 2012. Office of Policy Development and Research. Washington, DC, June. Yinger, John. 1998. “Evidence on Discrimination in Consumer Markets.” Journal of Economic Per- spectives 12 (2): 23–40. Zhao, Bo, Jon Ondrich, and John Yinger. 2005. “Why Do Real Estate Brokers Continue to Discrimi- nate? Evidence from the 2000 Housing Discrimination Study.” Syracuse University Center for Pol- icy Research Paper 96.
Original LaTeX notation
American Economic Journal: Applied Economics 2017, 9(2): 1–22 https://doi.org/10.1257/app.20160213 1 Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment† By Benjamin Edelman, Michael Luca, and Dan Svirsky* In an experiment on Airbnb, we find that applications from guests with distinctively African American names are 16 percent less likely to be accepted relative to identical guests with distinctively white names. Discrimination occurs among landlords of all sizes, includ- ing small landlords sharing the property and larger landlords with multiple properties. It is most pronounced among hosts who have never had an African American guest, suggesting only a subset of hosts discriminate. While rental markets have achieved significant reductions in discrimination in recent decades, our results sug- gest that Airbnb’s current design choices facilitate discrimination and raise the possibility of erasing some of these civil rights gains. (JEL C93, J15, L83) O ver the past 50 years, there have been considerable societal efforts to reduce the level of discrimination against African Americans in the United States. In the context of housing and rental accommodations, antidiscrimination laws have sought to eliminate discrimination through regulation. While racial discrimination continues to exist in rental markets, it has improved in the last two decades (Yinger 1998, US Department of Housing and Urban Development 2013; compare Zhao, Ondrich, and Yinger 2005 to Ondrich, Stricker, and Yinger 1999). Yet in recent years, markets have changed dramatically, with a growing share of transactions moving online. In the context of housing, Airbnb has created a new market for short-term rentals that did not previously exist, allowing small landlords to increasingly enter the market. Whereas antidiscrimination laws ban the landlord of a large apartment building from discriminating based on race, the prevailing view among legal scholars is that such laws likely do not reach many of the smaller land- lords using Airbnb (Belzer and Leong forthcoming; Todisco 2015). In this paper, we investigate the existence and extent of racial discrimination on Airbnb, the canonical example of the sharing economy. Airbnb allows hosts * Edelman: Harvard Business School, Morgan 462, 25 Harvard Way, Boston, MA 02163 (e-mail: bedelman@ hbs.edu); Luca: Harvard Business School, Baker Library 457, 10 Harvard Way, Boston, MA 02163 (e-mail: mluca@ hbs.edu); Svirsky: Harvard Business School and Harvard University Department of Economics, Baker Library 420A, 25 Harvard Way, Boston MA 02163 (e-mail: dsvirsky@hbs.edu). We thank Ian Ayres, Larry Katz, Kevin Lang, Sendhil Mullainathan, Devah Pager, and seminar participants at eBay, Harvard Law School, Hong Kong University of Science and Technology, Indiana University, New York University, Northwestern University, Stanford University, and University at Albany for valuable feedback. We thank Haruka Uchida for tireless research assistance. Our Institutional Review Board approved our methods before we began collecting data. IRB# 15-2226. † Go to https://doi.org/10.1257/app.20160213 to visit the article page for additional materials and author disclosure statement(s) or to comment in the online discussion forum. 2 American Economic Journal: applied economics april 2017 to rent out houses, apartments, or rooms within an apartment. To facilitate these transactions, Airbnb promotes properties to prospective guests, facilitates commu- nication, and handles payment and some aspects of customer service. Airbnb allows hosts to decide whether to accept or reject a guest after seeing his or her name and often a picture—a market design choice that may further enable discrimination. To test for discrimination, we conduct a field experiment in which we inquire about the availability of roughly 6,400 listings on Airbnb across five cities. Specifically, we create guest accounts that differ by name but are otherwise identical. Drawing on the methodology of a labor market experiment by Bertrand and Mullainathan (2004), we select two sets of names—one distinctively African American and the other distinctively white.1 We find widespread discrimination against guests with distinctively African American names. African American guests received a positive response roughly 42 percent of the time, compared to roughly 50 percent for white guests.2 This 8 percentage point (roughly 16 percent) penalty for African American guests is par- ticularly noteworthy when compared to the discrimination-free setting of competing short-term accommodation platforms such as Expedia. The penalty is consistent with the racial gap found in contexts ranging from labor markets to online lending to classified ads to taxicabs.3 Combining our experimental results with observational data from Airbnb’s site, we investigate whether different types of hosts discriminate more, and whether dis- crimination is more common at certain types of properties based on price or local demographics. Our results are remarkably persistent. Both African American and white hosts discriminate against African American guests; both male and female hosts discriminate; both male and female African American guests are discrimi- nated against. Effects persist both for hosts that offer an entire property and for hosts who share the property with guests. Discrimination persists among experi- enced hosts, including those with multiple properties and those with many reviews. Discrimination persists and is of similar magnitude in high- and low-priced units, in diverse and homogeneous neighborhoods. Because hosts’ profile pages contain reviews (and pictures) from recent guests, we can cross-validate our experimental findings using observational data on whether the host has recently had an African American guest. We find that discrimination is concentrated among hosts with no African American guests in their review history. When we restrict our analysis to hosts who have had an African American guest in 1 We build on the large literature using audit studies to test for discrimination. Past research considers African Americans and applicants with prison records in the labor market (Pager 2003), immigrants in the labor market (Oreopoulos 2011), Arabic job seekers (Carlsson and Rooth 2007), gender (Lahey 2008), long-term unemployment (Ghayad 2014), and going to a for-profit college (Deming et al. 2016), among many others. 2 Some caution is warranted here. We only observe a gap between distinctively white and distinctively African American names, which differ not only by suggested ethnicity but also potentially by socioeconomic status (Fryer and Levitt 2004). For ease of exposition, we describe our results in terms of differences among the “African American guests” or the “white guests,” or use the term “race gap,” without also specifying that our results may better be described as a “race and socioeconomic status gap.” Section V discusses this issue in more detail. 3 Doleac and Stein (2013) find a 62 percent to 56 percent gap in offer rates for online classified postings. Bertrand and Mullainathan (2004) find a 10 percent to 6 percent gap in callback rates for jobs. Pope and Sydnor (2011) find a 9 percent to 6 percent gap in lending rates in an online lending market. Ayres, Vars, and Zakariya (2005) find a 20 percent to 13 percent gap in how often taxi drivers receive a tip. Vol. 9 No. 2 3 Edelman et al.: Racial Discrimination in the Sharing Economy the recent past, discrimination disappears—reinforcing the external validity of our main results, and suggesting that discrimination is concentrated among a subset of hosts. To explore the cost to a host of discriminating, we check whether each listing is ultimately rented for the weekend we inquired about. Combining that informa- tion with the price of each listing, we estimate that a host incurs a cost of roughly $65–$100 in foregone revenue by rejecting an African American guest. Overall, our results suggest a cause for concern. While discrimination has shrunk in more regulated offline markets, it arises and persists in online markets. Government agencies at both the federal and state level have routinely conducted audit studies to test for racial discrimination since 1955 in offline markets. One might imagine implementing regular audits in online markets as well; indeed, online audits might be easier to run at scale due to improved data access and reduced implementation cost. Our results also reflect the design choices that Airbnb and other online market- places use. It is not clear a priori how online markets will affect discrimination. To the extent that online markets can be more anonymous than in-person trans- actions, there may actually be less room for discrimination. For example, Ayres and Siegelman (1995) find that African American car buyers pay a higher price than white car buyers at dealerships, whereas Morton, Zettelmeyer, and Silva-Risso (2003) find no such racial difference in online purchases. Similarly, platforms such as Amazon, eBay, and Expedia offer little scope for discrimination, as sellers effec- tively pre-commit to accept all buyers regardless of race or ethnicity. However, these advantages are by no means guaranteed, and in fact they depend on design choices made by each online platform. In this situation, Airbnb’s design choices enable widespread discrimination. I. About Airbnb Airbnb is a popular online marketplace for short-term rentals. Founded in 2008, the site gained traction quickly and, as of November 2015, it offers 2,000,000 listings worldwide.4 This is more than 3 times as many as Marriott’s 535,000 rooms world- wide. Airbnb reports serving over 40 million guests in more than 190 countries. While the traditional hotel industry is dominated by hotels and inns that each offer many rooms, Airbnb enables anyone to post even a single room that is vacant only occasionally. Hosts provide a wealth of information about each listing, includ- ing the type of property (house, apartment, boat, or even castle, of which there are over 1,400 listed), the number of bedrooms and bathrooms, the price, and location. Each host also posts information about herself. An interested guest can see a host’s profile picture as well as reviews from past guests. Airbnb encourages prospective guests to confirm availability by clicking a listing’s “Contact” button to write to the host.5 In our field experiments (described in the next section), we use that method to evaluate a host’s receptiveness to a booking from a given guest. 4 https://www.airbnb.com/about/about-us. 5 See “How do I know if a listing is available,” https://www.airbnb.com/help/question/137. 4 American Economic Journal: applied economics april 2017 II. Experimental Design A. Sample and Data Collection We collected data on all properties offered on Airbnb in Baltimore, Dallas, Los Angeles, St. Louis, and Washington, DC as of July 2015. Our goal was to collect data from the top 20 metropolitan areas from the 2010 census. We started with these five cities because they had varying levels of Airbnb usage and came from diverse geographic regions. Baltimore, Dallas, and St. Louis offer several hundred listings each, while Los Angeles and Washington, DC have several thousand. We stopped data collection after these five cities because Airbnb became increasingly rapid in blocking our automated tools which logged into guest accounts and communicated with hosts. (We considered taking steps to conceal our methods from Airbnb, but ultimately declined to do so.) Because some hosts offer multiple listings, we selected only one listing per host using a random number generator. This helped to reduce the burden on any given host, and it also prevented a single host from receiving multiple identical e-mails. Each host was contacted for no more than one transaction in our experiment. We also collected data from each host’s profile page. This allowed us to analyze host characteristics in exceptional detail. First, we saved the host’s profile image. We then employed Mechanical Turk workers to assess each host image for race (white, African American, Asian, Hispanic, multiracial, unknown), gender (male, female, two people of the same gender, two people of different genders, unknown), and age (young, middle-aged, old). We hired two Mechanical Turk workers to assess each image, and if the workers disagreed on race or gender, we hired a third to settle the dispute. If all three workers disagreed (as happened, for example, for a host whose profile picture was an image of a sea turtle), we manually coded the picture. We coded race as “unknown” when the picture did not show a person. Through this procedure, we roughly categorized hosts by race, gender, and age. Profile pages also revealed other variables of interest. We noted the number of properties each host offers on Airbnb, anticipating that professional hosts with mul- tiple properties might discriminate less often than others. We retrieved the number of reviews the host has received, a rough measure of whether the host is an avid Airbnb user or a casual one. We further checked the guests who had previously reviewed each host. Airbnb posts the photo of each such guest, so we used Face++, a face-detection API, to categorize past guests by race, gender, and age.6 This allows us to examine relationships between a host’s prior experience with African American guests and the host’s rejection of new African American requests. We also collected information about each listing. We recorded the price of the listing, the number of bedrooms and bathrooms, the cancellation policy, any clean- ing fee, and the listing’s ratings from past guests. We also measured whether the 6 In addition to detecting race, gender, and age, Face++ estimates its confidence for each trait. When Face++ was unable to make a match or its confidence was below 95 out of 100, we used Mechanical Turk to categorize the past guest via the method described above. Vol. 9 No. 2 5 Edelman et al.: Racial Discrimination in the Sharing Economy listing offered an entire unit versus a room in a larger unit, yielding a proxy for how much the host interacts with the guest. Each listing included a longitude and latitude, which allowed us to link to census demographic data to assess the relationship between neighborhood demographics and discrimination. After linking the latitude and longitude to a census tract, we used census data on the number of African American, Hispanic, Asian, and white individuals. Table 1 presents summary statistics about the hosts and listings as well as balanced treatment tests. We later checked each listing to see whether hosts were ultimately able to fill open- ings. Our guests inquired about reservations eight weeks in advance. Thus, if a guest sent a message on August 1 about the weekend of September 25, we checked on Friday, September 24 to see whether the specified listing was still listed as available. B. Treatment Groups Our analysis used four main treatment groups based on the perceived race and gender of the test guest accounts. Hosts were contacted by guests with names that signaled African American males, African American females, white males, and white females, drawn from Bertrand and Mullainathan (2004). The list was based on the frequency of names from birth certificates of babies born between 1974 and 1979 in Massachusetts. Distinctively white names are those that are most likely to be white, conditional on the name, and similarly for distinctively African American names. To validate the list, we conducted a survey in which we asked participants to quickly categorize each name as white or African American. With just three sec- onds permitted for a response, survey takers had little time to think beyond a gut response. The survey results, presented in Appendix Table 1, confirm that the names continue to signal race.7 7 On a scale of 0 to 1, where 0 is African American, the white female names each had an average survey response of 0.90 or above, and the African American female names all had an average score of 0.10 or below. The male Table 1— Summary Statistics Variables Mean SD 25th percentile 75th percentile Observations Mean, white accounts Mean, African American accounts p-value Host is white 0.63 0.48 0 1 6,392 0.64 0.63 0.15 Host is African American 0.08 0.27 0 0 6,392 0.08 0.08 0.97 Host is female 0.38 0.48 0 1 6,392 0.38 0.37 0.44 Host is male 0.30 0.46 0 1 6,392 0.3 0.3 0.90 Price ($) 181.11 1,280.23 75 175 6,302 166.43 195.81 0.36 Number of bedrooms 3.18 2.26 2 4 6,242 3.18 3.18 0.96 Number of bathrooms 3.17 2.26 2 4 6,285 3.17 3.17 0.93 Number of reviews 30.87 72.51 2 29 6,390 30.71 31.03 0.86 Host has multiple listings 0.16 0.36 0 0 6,392 0.32 0.33 0.45 Host has 1+ reviews from African American guests 0.29 0.45 0 1 6,390 0.29 0.28 0.38 Airbnb listings per census tract 9.51 9.28 2 14 6,392 9.49 9.54 0.85 Percent population African American (census tract) 0.14 0.2 0.03 0.14 6,378 0.14 0.14 0.92 6 American Economic Journal: applied economics april 2017 We then created 20 Airbnb accounts, identical in all respects except for guest names. Our names included ten that are distinctively African American and ten dis- tinctively white names, divided into five male and five female names within each group. To avoid the confounds that would result from pictures, we use only names; our Airbnb profiles include no picture of the putative guest. From these 20 guest accounts, we sent messages to prospective hosts. Each host was randomly assigned one of our 20 guest accounts. Figure 1 presents a representative e-mail from one of our guests to an Airbnb host. The name and dates changed depending on the mes- sage sender and when the message was sent.8 In choosing the dates, we asked hosts about a weekend that was approximately eight weeks distant from when the mes- sage was sent. We limited our search to those properties that were listed as available during the weekend in question. names showed slightly more variation but tell the same story: all the white male names scored 0.88 or above, and all the African American male names except for Jermaine Jones scored 0.10 or below. The Appendix presents the full results of the survey. 8 No more than 48 hours elapsed between our first contact to a host in a given city, and the completion of our contacting hosts in that city. Furthermore, no hosts in our sample had listings in more than one of the five cities we tested. Hence, it is unlikely that a host contacted later on in the study would have learned about the experiment. Figure 1. Sample Treatment Vol. 9 No. 2 7 Edelman et al.: Racial Discrimination in the Sharing Economy C. Experimental Procedure We sent roughly 6,400 messages to hosts between July 7, 2015 and July 30, 2015.9 Each message inquired about availability during a specific weekend in September. When a host replied to a guest, we replied to the host with a personal message clar- ifying that we (as the guest) were still not sure if we would visit the city or if we would need a place to stay. We sent this reply in order to reduce the likelihood of a host holding inventory for one of our hypothetical guests. We tracked host responses over the 30 days that followed each request. A research assistant then coded each response into categories. The majority of responses were in 1 of 6 groups: “No response” (if the host did not respond within 30 days); “No or listing is unavailable;” “Yes;” “Request for more information” (if the host responded with questions for the guest); “Yes, with questions” (if the host approved the stay but also asked questions); “Check back later for definitive answer;” and “I will get back to you.” As these categories show, our initial categorizations used subtle dis- tinctions between possible responses. In our analyses below, however, we restrict our attention to the simplest response—“Yes”—though all of our results are robust to using “No” instead, as well as to ignoring nonresponses or to using broader defi- nitions of “Yes.” We collected all data using scrapers we built for this purpose. We sent inquiries to Airbnb hosts using web browser automation tools we built for this purpose. III. Results Table 2 presents the main effect. We find that inquiries from guests with white-sounding names are accepted roughly 50 percent of the time. In contrast, guests with African American-sounding names are accepted roughly 42 percent of the time. Columns 2 and 3 introduce additional control variables related to the host or the property. The effect stays constant at a roughly 8 percentage point gap across these specifications, controlling for the host’s gender, race, an indicator for whether the host has multiple listings, an indicator for whether the property is shared, host experience (whether the host has more than ten reviews), and the log of the listing price. As noted, we break down hosts’ responses into 11 categories. Figure 2 shows the frequency of each response by race. One might worry that results are driven by differences in host responses that are hard to classify, such as conditional “Yes” responses. Similarly, we would be concerned if our findings were driven by differ- ences in response rate. African American accounts might be more likely to be catego- rized as spam, or hosts may believe that African American accounts are more likely to be fake, in which case one might expect higher nonresponse rates for African 9 Our initial goal was to collect roughly 10,000 responses. This was based on a power analysis, which in turn used an effect size calculated from Edelman and Luca (2014). To find a similar effect size, we would need a sample size of roughly 3,000 hosts. But, to calculate an effect among a subgroup of hosts, like African American hosts, which represent roughly 7 percent of the Airbnb population, we would need a sample size closer to 10,000. We fell short of this goal for an exogenous reason: Airbnb shut down the experimental accounts after we collected roughly 6,400 responses. 8 American Economic Journal: applied economics april 2017 American accounts. But as Figure 2 shows, the discrimination results occur because of differences in simple “Yes” or “No” responses, not because of nonresponses or intermediate responses (like a conditional “Yes”). In the rest of this section, we use the wealth of data available on Airbnb about the host and location for each listing to look for factors that influence the gap between Table 2— The Impact of Race on Likelihood of Acceptance Dependent variable: 1(host accepts) Guest is African American −0.08 (0.02) −0.08 (0.02) −0.09 (0.02) Host is African American 0.07 (0.02) 0.09 (0.02) Host is male −0.05 (0.01) −0.05 (0.01) Host has multiple listings 0.09 (0.02) Shared property −0.07 (0.02) Host has 10+ reviews 0.12 (0.01) ln(price) −0.06 (0.01) Constant 0.49 (0.01) 0.50 (0.01) 0.76 (0.07) Observations 6,235 6,235 6,168 Adjusted R2 0.006 0.009 0.040 Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race and various host and location characteristics. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Figure 2. Host Responses by Race 1,200 900 600 300 0 Yes Conditional yes No response Conditional no No Guest is African American Guest is white Vol. 9 No. 2 9 Edelman et al.: Racial Discrimination in the Sharing Economy white and African American names. Does the identity of the host matter? Does the location of the property matter? Generally, we find that the discrimination is remark- ably robust. A. Effects by Host Characteristics We first check whether our finding changes based on the identity of the host. If discrimination is driven by homophily (in-group bias), then the host’s race should matter. According to this theory, hosts might simply prefer guests of the same race. If homophily were the primary factor driving differential guest acceptance rates, then African American guests would face higher acceptance rates from African American hosts. Table 3 presents regressions that include guest race, host race, and an interaction term. Across the entire sample of hosts, the interaction between the race and guest of the host is not significantly different from zero, but the point esti- mate is noisy. This result masks heterogeneity across genders. Columns 2 and 3 of Table 3 report the same regression limited to male hosts and female hosts, respec- tively. Among male hosts, the interaction between the host’s race and guest’s race shows a widening of the race gap by 11 percentage points, whereas among females, the race gap narrows by 11 percentage points. Both estimates are noisy; we cannot reject coefficients of zero.10 10 Table 4 explores the effect of the host’s race with more nuance. It shows the proportion of “Yes” responses from each gender/race cell among hosts in response to each gender/race cell among guests. African American male hosts discriminate against African American male and female guests. White hosts of both genders are more likely to accept white guests of either gender. African American female hosts are the only exception: they accept African American female guests more than any other group. Thus, with the exception of African American females, the data Table 3—Race Gap by Race of the Host Dependent variable: 1(host accepts) All hosts Male hosts Female hosts Other hosts Guest is African American −0.08 (0.02) −0.09 (0.02) −0.09 (0.02) −0.07 (0.03) Host is African American 0.06 (0.03) 0.19 (0.05) −0.00 (0.04) 0.03 (0.09) Host is African American × guest is African American 0.01 (0.05) −0.11 (0.08) 0.11 (0.06) −0.06 (0.14) Constant 0.48 (0.01) 0.44 (0.02) 0.50 (0.02) 0.50 (0.02) Observations 6,235 1,854 2,336 2,045 Adjusted R2 0.007 0.015 0.007 0.003 Implied coefficient on guest is African American + host is African American × guest is African American −0.07 (0.05) −0.19 (0.08) 0.02 (0.06) −0.12 (0.14) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, the host’s race, and the interaction between the two. Other hosts are hosts we could not classify as male or female. Of the 2,045 host pic- tures we could not classify for gender, 972 had a picture of a mixed-gender couple, 259 had a same-gender couple, 603 had a picture without a human in it, and the rest could not be classified. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. 10 American Economic Journal: applied economics april 2017 Discrimination may also be influenced by a host’s proximity to the guest. For example, Becker (1957) formalizes racial discrimination as distaste for interactions with individuals of a certain race. On Airbnb, a host must classify each listing as offer- ing an entire unit, a room within a unit, or a shared room. We classify anything other than an entire unit as a “shared property.” Column 1 of Table 5 shows that the race gap is roughly the same whether or not a property is shared. (In unreported results, we find that the race gap stays roughly the same in shared properties with only one bathroom.) One might expect a distinction between casual Airbnb hosts who occasion- ally rent out their homes, versus professional hosts who offer multiple properties. Roughly a sixth of Airbnb hosts manage multiple properties, and roughly 40 percent of hosts have at least ten reviews from past guests. Columns 2 and 3 explore the extent of discrimination among hosts with multiple locations, and those with more than ten reviews. Across these specifications, the race gap persists with roughly the same magnitude.11 To the extent that discrimination rates are changing over time, one might expect discrimination to be less common among younger hosts. To assess this possibility, we employed Mechanical Turk workers to categorize hosts as young, middle-aged, or old. Column 4 shows that discrimination also persists across the age categories with roughly the same magnitude. B. Effects by Listing Characteristics Just as discrimination was robust across host characteristics, we find that dis- crimination does not vary based on the cost or location of the property. Column 1 of Table 6 shows that, overall, listings above the median price are more likely to reject is inconsistent with homophily. Table 4 focuses on race/gender subgroups, but we present a more systematic break- down of the raw results in Appendix Table 2. We ultimately focused on race/gender cells for ease of presentation. 11 Hosts with at least ten reviews still have a race gap, but the acceptance rates for both races are higher among these hosts. Instead of the 50 percent to 42 percent gap we see among all hosts, the race gap among hosts with at least 10 reviews, or hosts with multiple properties, is closer to 60 percent to 52 percent. Hence, the racial gap is the same in terms of percentage points, but not in terms of percent. The same is true in a later specification, where we look at the race gap among hosts with at least one review from an African American guest. In all these specifica- tions, the change in the odds ratio is not economically significant. We have insufficient statistical power to reject the possibility that the odds ratios remain constant while the gap changes slightly. Table 4—Proportion of Positive Responses by Race and Gender Guest race/gender Host race/gender White male African American male White female African American female White male 0.42 0.35 0.49 0.32 African American male 0.64 0.40 0.59 0.43 White female 0.46 0.35 0.49 0.44 African American female 0.43 0.38 0.53 0.59 Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to guests of a certain race/gender. Vol. 9 No. 2 11 Edelman et al.: Racial Discrimination in the Sharing Economy inquiries. However, discrimination remains both among more expensive and less expensive listings. We can also check whether the listing was eventually filled (for the nights in question) to create a proxy for the desirability of the listing. First, we fit a Probit model to predict the likelihood that the listing was filled, controlling for a fixed city effect and a host of covariates.12 Then we assign each listing a probability of being filled. This lets us test whether discrimination changes based on the listing’s desir- ability.13 It does not. We also hypothesized that the extent of discrimination might vary with the diver- sity of a neighborhood. More generally, one might expect that geography matters and that discrimination is worse in some areas than others, due to market structure 12 The covariates are as follows: the host’s race and gender, the price, number of bedrooms, whether the property is shared, whether the bathroom is shared, the number of reviews, the age of the host, whether the host operates mul- tiple listings, the proportion of white people in the census tract, and the number of Airbnb listings in the census tract. 13 We thank an anonymous reviewer for suggesting this approach. Table 5—Are Effects Driven by Host Characteristics? Dependent variable: 1(host accepts) Guest is African American −0.07 (0.02) −0.08 (0.02) −0.09 (0.02) −0.11 (0.02) −0.09 (0.02) Shared property 0.00 (0.01) Shared property × guest is African American −0.02 (0.03) Host has multiple listings 0.14 (0.02) Host has multiple listings × guest is African American −0.01 (0.03) Host has ten+ reviews 0.14 (0.02) Host has ten+ reviews × guest is African American 0.01 (0.02) Host looks young −0.03 (0.02) Host looks young × guest is African American −0.01 (0.02) Host has 1+ reviews from an African American guest 0.10 (0.01) Host has 1+ reviews from an African American guest × guest is African American 0.06 (0.02) Constant 0.49 (0.01) 0.46 (0.01) 0.42 (0.01) 0.50 (0.01) 0.46 (0.01) Observations 6,235 6,235 6,235 6,235 6,235 Adjusted R2 0.006 0.014 0.027 0.011 0.019 Implied coefficient on guest is African American + host trait × guest is African American −0.09 (0.02) −0.09 (0.03) −0.08 (0.02) −0.08 (0.03) −0.04 (0.03) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various host char- acteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. 12 American Economic Journal: applied economics april 2017 or underlying rates of discrimination among a population. Merging data on neigh- borhoods by census tract, column 2 shows that the extent of discrimination does not vary with the proportion of nearby residents who are African American. Column 3 shows that discrimination is ubiquitous: it does not vary with the number of Airbnb listings within the census tract. We also find discrimination in all cities in our sam- ple, as shown in Appendix Table 3. C. Robustness—Effects by Name Table 7 shows the proportion of positive responses broken down by name. The effect is robust across choice of names. For example, the African American female name with the most positive responses (Tamika) received fewer positive responses than the white female name with the fewest positive responses (Kristen), though this difference is not statistically significant. Similarly, the African American males with the most positive responses (Darnell and Rasheed) received fewer acceptances than the white male with the fewest positive responses (Brad). D. Comparing Experimental Results with Observational Patterns Each listing page includes reviews from previous guests, along with profile pic- tures for these guests. This allows us to see which hosts previously accepted African Table 6— Are Effects Driven by Location Characteristics? Dependent variable = 1(host accepts) Guest is African American −0.09 (0.02) −0.08 (0.02) −0.09 (0.02) −0.12 (0.06) Price > median −0.07 (0.02) Guest is African American × (price > median) 0.01 (0.03) Share of African American population in census tract 0.05 (0.05) Guest is African American × (share of African American population in census tract) 0.02 (0.08) Airbnb listings per census tract −0.0007 (0.0009) Guest is African American × (Airbnb listings per census tract) 0.0008 (0.001) Probability listing is filled 8 weeks later 0.56 (0.08) Guest is African American × (probability listing is filled eight weeks later) 0.09 (0.12) Constant 0.52 (0.02) 0.48 (0.01) 0.49 (0.02) 0.24 (0.03) Observations 6,235 6,223 6,235 6,101 Adjusted R2 0.01 0.006 0.006 0.030 Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, various location characteristics, and the interaction between the two. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Vol. 9 No. 2 13 Edelman et al.: Racial Discrimination in the Sharing Economy American guests (although not all guests leave reviews and not all guests have pho- tos that reveal their race). We use this data to assess the external validity of our results. We collected profile pictures from the ten most recent reviews on each listing page. We categorized these past guests by race and gender, finding that 29 percent of hosts in our sample had at least one review from an African American guest. We then regressed the likelihood of a host responding positively to our inquiry on the race of the guest, whether the host has at least one recent review from an African American guest, and an interaction between these variables. Column 5 of Table 5 reports the results. We find that the race gap drops sharply among hosts with at least one recent review from an African American guest. We cannot reject zero difference for requests from our African American test accounts versus requests from our white test accounts, though this result is only significant at the 10 percent level.14 This finding reinforces our interpretation of our main effects, including the role of race and the interpretation that observed differences reflect racial discrimina- tion by Airbnb hosts. Put another way, if our findings are driven by a quirk of our 14 These findings are robust to alternative specifications of a host’s past guests. The same substantive results hold if we look at the raw number of reviews from African Americans, rather than whether there is at least one such review. The same is true if we use the proportion of reviews from African American guests. Table 7— Proportion of Positive Responses, by Name Entire sample 0.43 (6,390) White female African American female Allison Sullivan 0.49 (306) Lakisha Jones 0.42 (324) Anne Murphy 0.56 (344) Latonya Robinson 0.35 (331) Kristen Sullivan 0.48 (325) Latoya Williams 0.43 (327) Laurie Ryan 0.50 (327) Tamika Williams 0.47 (339) Meredith O’Brien 0.49 (303) Tanisha Jackson 0.40 (309) White male African American male Brad Walsh 0.41 (317) Darnell Jackson 0.38 (285) Brent Baker 0.48 (332) Jamal Jones 0.33 (328) Brett Walsh 0.44 (279) Jermaine Jones 0.36 (300) Greg O’Brien 0.45 (312) Rasheed Jackson 0.38 (313) Todd McCarthy 0.43 (314) Tyrone Robinson 0.36 (254) Notes: The table reports the proportion of “Yes” responses by name. The number of messages sent by each guest name is shown in parentheses. 14 American Economic Journal: applied economics april 2017 experimental design, rather than race, then it is difficult to explain why the race gap disappears precisely among hosts with a history of accepting African American guests. E. Importance of Profile Pictures and More Complete Profiles A related concern is that we used guest profiles that were relatively bare. A host may hesitate to accept a guest without a profile picture or past reviews. Of course, this alone cannot explain the race gap, since both white and African American guests had bare profiles. But it does raise the question of whether more complete profiles could mitigate discrimination.15 Internal data from Airbnb and observational data on Airbnb users both suggest that profile pictures alone are unlikely to make much difference. With access to internal Airbnb data, Fradkin (2015) looks at roughly 17,000 requests sent to hosts and finds that guests are rejected 49 percent of the time. Notably, these requests from ordinary Airbnb users, with typical Airbnb profiles, were rejected at a rate similar to that of our guests. In our experiment, as detailed in Appendix Table 4, 44 percent of guests were rejected or received no response. Another 11 percent received a message from a host requesting more information. The remaining 46 percent were accepted. The similarity in rejection rates suggests that incompleteness of our guests’ profiles is not likely to be causing a change in the rejection rate, and reinforces the ecological validity of our experimental design. Other methods indicate that profile pictures seem to have little impact on accep- tance decisions. In a logistic regression estimating the probability of receiving a rejection from a host, again using internal Airbnb data, Fradkin (2015) finds that including a profile picture has no significant effect. This matches the observational data we collect: in a random selection of Airbnb users, we found that only 44 per- cent have a profile picture. The proportion of guests with a profile picture is higher among users who have left a review, but nonetheless both analyses indicate that the existence of profile pictures plays a small role in host decision-making. Further, even if profile pictures impact rejection rates, it is not clear that the impact should be differential by race. For example, one might expect that pictures would make a guest’s race more salient. If our results are driven by race, then our findings would be a lower bound on the true effect. One limitation of our experiment is that we do not observe the effect of past reviews on discrimination. If our findings are driven by statistical discrimination, positive reviews from previous hosts may reduce the extent of discrimination. However, three factors suggest that reviews are an incomplete response to a discrim- ination problem. First, our acceptance rates are similar to overall acceptance rates 15 Similarly, our experiment does not assess whether discrimination occurs because of race or social class. Hanson and Hawley (2011) find, in a field experiment on Craigslist’s housing market using similar methodology, that renters with African American names face a penalty, but that the penalty decreases if the e-mail sent to a landlord signals higher social class. Under some specifications, African Americans face a statistically significant penalty based on race and an additional penalty for signaling low class, also statistically significant. Under other specifications, the racial gap is not statistically significant when comparing white and African American guests who both signal high social class. On the whole, the paper indicates that social class and race both play a role. Vol. 9 No. 2 15 Edelman et al.: Racial Discrimination in the Sharing Economy on Airbnb (Fradkin 2015), which indicates that hosts are not treating our test guest accounts differently for lack of reviews, meaning that reviews would be unlikely to eliminate discrimination. Indeed, for reviews to eliminate discrimination, they would need to provide a 16 percent differential increase in acceptance rates for African Americans, relative to white guests. Second, all Airbnb users necessarily start without past reviews, so a review system would not address any initial barri- ers to entry that guests face. Third, a subjective review system can itself allow or facilitate discrimination. (See, e.g., Goldin and Rouse 2000, finding that visually confirming a musician’s gender may influence an expert’s judgment of her work.) Whatever mechanism is causing a lower acceptance rate for the African American guests may also cause a worse rating. F. How Much Does Discrimination Cost Hosts? A host incurs a cost for discriminating when rejecting a guest causes a unit to remain empty. The expected cost depends on the likelihood of the property remain- ing vacant, which in turn depends on the thickness of the market. If a host can easily find a replacement guest, then discrimination is nearly costless for the host. But if a property remains vacant after the host rejects a guest, then discrimination imposes a more significant cost. In other words, the impact on net revenue from discriminating depends on the likelihood of filling a unit with someone of the host’s preferred race after rejecting a guest of a disfavored race. Because we collect data about each property’s availability after a host declines a guest, we can estimate the cost in net revenue from discrimination. Suppose a host charges price p for a listing and pays listing fees f to Airbnb. Let π replace be the prob- ability of filling the property after rejecting a guest in our study. Then the cost in net revenue of discrimination is as follows: ΔNet Revenue = ( p − f ) − π replace · ( p − f ) = (1 − π replace ) · ( p − f ). That is, the cost of discrimination, in terms of net revenue, is the revenue that the host forgoes if the listing remains empty multiplied by the probability that the listing remains empty. In our data, hosts who rejected or never responded to our inquiries had properties with a median price of $163 and a mean price of $295.16 The numbers are similar and slightly higher if we restrict the sample further to those hosts who rejected African American guests, or if we expand the sample to hosts who responded “Yes” to our accounts.17 Airbnb charges each host a fee equal to 3 percent of the listing price. 16 In calculating price, we sum the listing price and any cleaning fee. 17 An anonymous reviewer correctly points out that the host we are interested in is the host on the margin of discriminating. But there are hosts far from this margin both within the group of hosts who said yes and within the group of hosts who said no. Nonetheless, our calculations in this section are not sensitive to which group of hosts we include. When including hosts who said yes, the median price drops from $163 to $150, and the probability of finding a replacement guest rises to 64 percent instead of 59.4 percent (excluding disappearing hosts) or 45 percent instead of 37.9 percent (including disappearing hosts). Thus, the cost of discrimination drops by about $10 or $20 16 American Economic Journal: applied economics april 2017 After our inquiries, roughly 25.9 percent of the listings in our study remained vacant on the dates we requested after rejecting or not responding to one of our guests. Another 37.9 percent remained listed but were no longer available on those dates, suggesting that the host either found another guest or decided to no longer make the property available on the specified dates. The remaining 36.1 percent of properties were no longer listed on Airbnb. Because it is unclear whether the hosts who exit should be excluded from the sample or treated as not having found a replacement, we develop two estimates. If we exclude these disappearing hosts from our calculation, 59.4 percent of hosts found a replacement guest. Setting p equal to the median price ($163) and fees at 3 percent of the median price: ΔNet Revenue = (1 − 0.594) · ($163 − 0.03 · $163) ≈ $64.19. If we treat disappearing listings as vacancies, in effect assuming that the host of a dropped listing was not able to find a replacement guest, then only 37.9 percent of hosts found a replacement guest. The cost of discrimination rises as a result: ΔNet Revenue = (1 − 0.379) · ($163 − 0.03 · $163) ≈ $98.19. In this analysis, we focus on the net revenue, which does not incorporate the marginal cost of each night the listing is rented, since we do not directly observe costs. The cost of hosting includes various types of host effort or wear-and-tear to the property. In principle, hosting also entails a risk of damage by a guest, though throughout the relevant period Airbnb automatically provided all hosts with prop- erty insurance, which reduces the risk. Our calculation also excludes unobserved benefits of hosting, such as the possibility that a positive review draws more guests in the future and improves the listing position on Airbnb. A full estimate of profit would also need to consider the time cost of looking for new guests after rejecting someone on the basis of race.18 While these estimates are clearly noisy, they suggest that hosts incur a real cost by discriminating. The median host who rejects a guest because of race is turning down between $65 and $100 of revenue. IV. Discussion Online platforms such as Airbnb create new markets by eliminating search fric- tions, building trust, and facilitating transactions (Lewis 2011, Luca 2016). With the rise of the sharing economy, however, comes a level of discrimination that among hosts who say yes, and therefore either did not discriminate against the African American accounts or did not get a chance to do so. 18 Our calculation also ignores other factors that cut in both directions. Responding with a “Yes” to a guest does not provide 100 percent certainty of a paid booking; the guest may choose another option or may not make the trip. In that case, our estimates overstate the revenue loss. Similarly, we have imperfect information about whether a host found a replacement guest. Among other complexities, our guests requested two-night stays; we treat a host as having filled a listing if the host found a replacement guest for at least one of the nights, though a host who filled only one of the nights has nonetheless lost one night of revenue. Vol. 9 No. 2 17 Edelman et al.: Racial Discrimination in the Sharing Economy is impossible in the online hotel reservations process. Clearly, the manager of a Holiday Inn cannot examine names of potential guests and reject them based on race or socioeconomic status, or some combination of the two. Yet, this is commonplace on Airbnb, which now accounts for a growing share of the short-term rental market. Our results contribute to a small but growing body of literature suggesting that discrimination persists—and we argue may even be exacerbated—in online plat- forms. Edelman and Luca (2014) show that African American hosts on Airbnb seek and receive lower prices than white hosts, controlling for the observable attributes of each listing. Pope and Sydnor (2011) find that loan listings with pictures of African Americans on Prosper.com are less likely to be funded than similar listings with pic- tures of white borrowers. Doleac and Stein (2013) show that buyers are less likely to respond to Craigslist listings showing an iPod held by a Black hand compared to an identical ad with a white hand. In contrast, Morton, Zettelmeyer, and Silva-Risso (2003) find no difference by race in price paid for cars in online purchases—a sharp contrast to traditional channels (see, e.g., List 2004; Zhao, Ondrich, and Yinger 2005). One important limitation of our experiment is that we cannot identify the mecha- nism causing worse outcomes for guests with distinctively African American names. Prior research shows that distinctively African American names are correlated with lower socioeconomic status (Fryer and Levitt 2004). Our findings cannot identify whether the discrimination is based on race, socioeconomic status, or a combination of these two. That said, we note that discrimination disappears among hosts who have previously accepted African American guests. One might worry that discrimi- nation against our test guest accounts results from our choice of names and, hence, does not represent patterns that affect genuine Airbnb guests. However, we find that discrimination is limited to hosts who have never had an African American guest, which suggests that our results are consistent with any broader underlying patterns of discrimination. Similarly, our experiment does not provide a sharp test of alternative models of discrimination. The theoretical literature on discrimination often distinguishes between statistical and taste-based discrimination. While our experimental design cannot reject either mechanism, our findings suggest a more nuanced story than either of the classic models. For one, we find homophily among African American females, but not among other race/gender combinations. Furthermore, we find that discrimination is not sensitive to a measure of proximity between the host and guest. Both findings are in tension with pure taste-based discrimination. But we also find some evidence against pure statistical discrimination. As noted above, we find that hosts who have had an African American guest in the past exhibit less discrimination than other hosts. This suggests that, at the very least, hosts are using different statis- tical models as they evaluate potential guests. A. Designing a Discrimination-Free Marketplace Because online platforms choose which information is available to parties during a transaction, they can prevent the transmission of information that is irrelevant or potentially pernicious. Our results highlight a platform’s role in preventing 18 American Economic Journal: applied economics april 2017 discrimination or facilitating discrimination, as the case may be. If a platform aspires to provide a discrimination-free environment, its rules must be designed accordingly. Airbnb has several options to reduce discrimination. For example, it could con- ceal guest names, just as it already prevents transmission of e-mail addresses and phone numbers, so that guests and hosts cannot circumvent Airbnb’s platform and its fees. Communications on eBay’s platform have long used pseudonyms and auto- matic salutations, so Airbnb could easily implement that approach. Alternatively, Airbnb might further expand its “Instant Book” option, in which hosts accept guests without screening them first. Closer to traditional hotels and bed and breakfasts, this system would eliminate the opportunity for discrimination. This change also offers convenience benefits for guests, who can count on their booking being confirmed more quickly and with fewer steps. However, in our sample, only a small subset of hosts currently allow instant booking. Airbnb could push to expand the use of this feature, which would also serve the company’s broader goal of reduc- ing search frictions. More generally, our results suggest an important tradeoff for market designers, who set the rules of online platforms, including the pricing mechanisms (Einav et al. 2013) and the information that is available and actionable at the time of transaction (Luca 2016). Market design principles have generally focused on increasing the information flow within a platform (Bolton et al. 2013, Che and HÖrner 2014, Dai et al. 2014, Fradkin et al. 2014), but we highlight a situation in which platforms may be providing too much information. B. Policy Implications Because the legal system grants considerable protection to online marketplaces, Airbnb is unlikely to be held liable for allowing discrimination on its platform. Within the United States, the Civil Rights Act of 1964 prohibits discrimination in hotels (and other public accommodations) based on race, color, religion, or national origin. But these laws appear to be a poor fit for the informal sharing economy, where private citizens rent out a room in their home (Belzer and Leong forthcoming; Todisco 2015). As discussed in Edelman and Luca (2014), any changes by Airbnb would likely be driven by ethical considerations or public pressure rather than law. In contrast, offline rental markets and hotels have been subject to significant regula- tion (as well as audit studies to test for discrimination) for decades. This contributes to worry among policymakers that online short-term rental markets like Airbnb may be displacing offline markets, which are more heavily regulated (Schatz, Feinstein, and Warren 2016). One clear policy implication is that regulators may want to audit Airbnb hosts using an approach based on our paper—much like longstanding efforts to reduce discrimination in offline rental markets. One might have hoped that online markets would cure discrimination, and it seems a different design might indeed do so. Regrettably, our analysis indicates that at Airbnb, this is not yet the case. Vol. 9 No. 2 19 Edelman et al.: Racial Discrimination in the Sharing Economy Invited Postscript: Airbnb Implements Market Design Changes Prior to this paper, Airbnb repeatedly ignored allegations of discrimination on the platform (Finley 2016; Larson and Harris 2016). In response to our study and growing user complaints, the company put together a task force including former attorney general Eric Holder to propose a set of market design changes to reduce discrimination on the platform (Benner 2016). On the same day this paper was accepted for publication in this journal, Airbnb announced the company’s planned changes. Changes include a goal of increasing the proportion of hosts who offer Instant Book (letting guests book instantly, without the host first seeing the guest’s picture or name), a reminder to all users of the company’s anti-discrimination pol- icy, increased training for Airbnb staff to assist users who report discrim- ination, and testing reduced prominence of guests’ photos. However, as of the time of publication, Airbnb continued to reject suggestions to conceal guest photos and names before booking. Appendix Table A1—Results of Survey Testing Races Associated with Names White female African American female Meredith O’Brien 0.93 Tanisha Jackson 0.03 Anne Murphy 0.95 Lakisha Jones 0.05 Laurie Ryan 0.97 Latoya Williams 0.05 Allison Sullivan 0.98 Latonya Robinson 0.07 Kristen Sullivan 1.00 Tamika Williams 0.07 White male African American male Greg O‘Brien 0.88 Tyrone Robinson 0.00 Brent Baker 0.90 Rasheed Jackson 0.06 Brad Walsh 0.91 Jamal Jones 0.07 Brett Walsh 0.93 Darnell Jackson 0.10 Todd McCarthy 0.98 Jermaine Jones 0.26 Notes: “White” is coded as 1. “African American” is coded as 0. Sample size = 62. Table A2—Raw Discrimination across All Race and Gender Groups Guest race/gender Host race/gender White male (1) African American male (2) White female (3) African American female (4) Male (5) Female (6) p-value (7) White (8) African American (9) White male 0.42 0.35 0.49 0.32 0.39 0.4 0.72 0.45 0.34 African American male 0.64 0.40 0.59 0.43 0.52 0.51 0.99 0.62 0.42 White female 0.46 0.35 0.49 0.44 0.41 0.46 0.06 0.48 0.39 African American female 0.43 0.38 0.53 0.59 0.41 0.56 0.02 0.48 0.50 White 0.45 0.36 0.50 0.40 0.41 0.45 0.02 0.47 0.38 African American 0.49 0.40 0.58 0.52 0.45 0.55 0.02 0.53 0.46 Other or uncertain 0.45 0.38 0.51 0.43 0.41 0.47 0.03 0.48 0.40 Male 0.43 0.36 0.47 0.35 0.40 0.41 0.80 0.45 0.35 Female 0.47 0.34 0.51 0.45 0.41 0.48 0.004 0.49 0.40 Other or uncertain 0.45 0.41 0.54 0.45 0.43 0.50 0.003 0.50 0.43 Note: This table shows the proportion of “Yes” responses by hosts of a certain race/gender to guests of a certain race/gender. 20 American Economic Journal: applied economics april 2017 References Ayres, Ian, and Peter Siegelman. 1995. “Race and Gender Discrimination in Bargaining for a New Car.” American Economic Review 85 (3): 304–21. Ayres, Ian, Fredrick E. Vars, and Nasser Zakariya. 2005. “To Insure Prejudice: Racial Disparities in Taxicab Tipping.” Yale Law Journal 114 (7): 1613–74. Becker, Gary S. 1957. The Economics of Discrimination. Chicago: University of Chicago Press. Belzer, Aaron, and Nancy Leong. Forthcoming. “The New Public Accommodations.” Georgetown Law Journal. Benner, Katie. 2016. “Airbnb Adopts Rules to Fight Discrimination by Its Hosts.” New York Times, September 8, A1. Bertrand, Marianne, and Sendhil Mullainathan. 2004. “Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination.” American Economic Review 94 (4): 991–1013. Table A3—Discrimination by City Dependent variable: 1(host accepts) All cities Baltimore (N = 347) Dallas (N = 415) Los Angeles (N = 3,913) St. Louis (N = 151) Washington, DC (N = 1,559) Guest is African American −0.08 −0.07 (0.02) −0.08 (0.02) −0.10 (0.02) −0.08 (0.03) −0.08 (0.02) City — 0.07 (0.03) 0.04 (0.03) −0.00 (0.03) 0.02 (0.05) −0.03 (0.04) City × guest is African American — −0.12 (0.05) −0.01 (0.04) 0.03 (0.04) 0.02 (0.07) −0.01 (0.05) Constant 0.49 0.48 (0.01) 0.49 (0.01) 0.49 (0.02) 0.49 (0.01) 0.50 (0.01) Observations 6,235 6,235 6,235 6,235 6,235 6,235 Adjusted R2 0.006 0.007 0.006 0.006 0.006 0.007 Implied coefficient on guest is African American + city × guest is African American — −0.19 (0.04) −0.09 (0.04) −0.07 (0.02) −0.06 (0.06) −0.09 (0.05) Notes: This table reports coefficients from a regression of a “Yes” response on the guest’s race, a city, and the inter- action of city and guest race. Standard errors are clustered by (guest name) × (city) and are reported in parentheses. Table A4—Host Responses to Guest Inquiries, by Race of the Guest White guests African American guests Yes 1,152 940 Yes, but request for more information 375 308 Yes, with lower price if booked now 11 10 Yes, if guest extends stay 10 15 Yes, but in a different property 18 8 Yes, at a higher price 4 0 Request for more information 339 323 Not sure or check back later 154 175 No response 429 423 No unless more information is provided 12 15 No 663 873 Notes: The table reports the frequency of each type of host response to a guest inquiry, by race of the guest. Likelihood-ratio chi-squared = 68.61 ( p < 0.01). Null hypothesis is that the columns will have equal proportions for each type of response. Vol. 9 No. 2 21 Edelman et al.: Racial Discrimination in the Sharing Economy Bolton, Gary, Ben Greiner, and Axel Ockenfels. 2013. “Engineering Trust: Reciprocity in the Produc- tion of Reputation Information.” Management Science 59 (2): 265–85. Carlsson, Magnus, and Dan-Olof Rooth. 2007. “Evidence of ethnic discrimination in the Swedish labor market using experimental data.” Labour Economics 14 (4): 716–29. Che, Yeon-Koo, and Johannes Hörner. 2014. “Optimal Design for Social Learning.” http://liberalarts. utexas.edu/_files/ms37643/Che-Horner03-04-14.pdf. Dai, Weijia, Ginger Z. Jin, Jungmin Lee, and Michael Luca. 2014. “Optimal Aggregation of Consumer Ratings: An Application to Yelp.com.” National Bureau of Economic Research (NBER) Working Paper 18567. Deming, David J., Noam Yuchtman, Amira Abulafi, Claudia Golding, and Lawrence F. Katz. 2016. “The Value of Postsecondary Credentials in the Labour Market: An Experimental Study.” American Economic Review 106 (3): 778–806. Doleac, Jennifer L., and Luke C. D. Stein. 2013. “The Visible Hand: Race and Online Market Out- comes.” Economic Journal 123 (572): F469–92. Edelman, Benjamin G., and Michael Luca. 2014. “Digital Discrimination: The Case of Airbnb.com.” Harvard Business School Working Paper 14-054. Edelman, Benjamin, Michael Luca, and Dan Svirsky. 2017. “Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment: Dataset.” American Economic Journal: Applied Eco- nomics. https://doi.org/10.1257/app.20160213. Einav, Liran, Chiara Farronato, Jonathan D. Levin, and Neel Sundaresan. 2013. “Sales Mechanisms in Online Markets: What Happened to Internet Auctions?” National Bureau of Economic Research (NBER) Working Paper 19021. Finley, Taryn. 2016. “These Airbnb Alternatives Want To Make Travel More Welcoming For Black People.” Huffington Post, August 18. http://www.huffingtonpost.com/entry/innclusive-noirbnb- airbnb-alternatives_us_5768462ae4b0853f8bf1c675. Fradkin, Audrey. 2015. “Search Frictions and the Design of Online Marketplaces.” http://andreyfradkin. com/assets/SearchFrictions.pdf. Fradkin, Audrey, Elena Grewal, Dave Holtz, and Matthew Pearson. 2014. “Bias and Reciprocity in Online Reviews: Evidence from Field Experiments on Airbnb.” Unpublished. Fryer, Roland G., Jr., and Steven D. Levitt. 2004. “The Causes and Consequences of Distinctively Black Names.” Quarterly Journal of Economics 119 (3): 767–805. Ghayad, Rand. 2014. “The Jobless Trap.” http://www.lexissecuritiesmosaic.com/gateway/FEDRES/ SPEECHES/ugd_576e9a_f6cf3b6661e44621ad26547112f66691.pdf. Goldin, Claudia, and Cecilia Rouse. 2000. “Orchestrating Impartiality: The Impact of ‘Blind’ Audi- tions on Female Musicians.” American Economic Review 90 (4): 715–41. Hanson, Andrew, and Zackary Hawley. 2011. “Do landlords discriminate in the rental housing mar- ket? Evidence from an internet field experiment in U.S. cities.” Journal of Urban Economics 70 (2–3): 99–114. Lahey, Joanna N. 2008. “Age, Women, and Hiring: An Experimental Study.” Journal of Human Resources 43 (1): 30–56. Larson, Erik, and Andrew M. Harris. 2016. “Airbnb Sued, Accused of Ignoring Hosts’ Race Discrim- ination.” Bloomberg, May 18. http://www.bloomberg.com/news/articles/2016-05-18/airbnb-sued- over-host-s-alleged-discrimination-against-black-man. Lewis, Gregory. 2011. “Asymmetric Information, Adverse Selection and Online Disclosure: The Case of eBay Motors.” American Economic Review 101 (4): 1535–46. List, John A. 2004. “The Nature and Extent of Discrimination in the Marketplace: Evidence from the Field.” Quarterly Journal of Economics 119 (1): 49–89. Luca, Michael. 2016. “User-Generated Content and Social Media.” In Handbook of Media Economics, Vol. 1B, edited by Simon Anderson, Joel Waldfogel, and David Strömberg, 563–92. Amsterdam: North-Holland. Morton, Fiona Scott, Florian Zettelmeyer, and Jorge Silva-Risso. 2003. “Consumer Information and Discrimination: Does the Internet Affect the Pricing of New Cars to Women and Minorities?” Quantitative Marketing and Economics 1 (1): 65–92. Ondrich, Jan, Alex Stricker, and John Yinger. 1999. “Do Landlords Discriminate? The Incidence and Causes of Racial Discrimination in Rental Housing Markets.” Journal of Housing Economics 8 (3): 185–204. Oreopoulos, Philip. 2011. “Why Do Skilled Immigrants Struggle in the Labor Market? A Field Exper- iment with Thirteen Thousand Resumes.” American Economic Journal: Economic Policy 3 (4): 148–71. 22 American Economic Journal: applied economics april 2017 Pager, Devah. 2003. “The Mark of a Criminal Record.” American Journal of Sociology 108 (5): 937–75. Pope, Devon G., and Justin R. Sydnor. 2011. “What’s in a Picture?: Evidence of Discrimination from Prosper.com.” Journal of Human Resources 46 (1): 53–92. Schatz, Brian, Dianne Feinstein, and Elizabeth Warren. 2016. “Letter to Edith Ramirez, Chairwoman of the Federal Trade Commission.” http://www.warren.senate.gov/files/documents/2016-7-13- letter-to-FTC.pdf. Todisco, Michael. 2015. “Share and Share Alike? Considering Racial Discrimination in the Nascent Room-Sharing Economy.” Stanford Law Review Online 67: 121–29. U.S. Department of Housing and Urban Development. 2013. Housing Discrimination against Racial and Ethnic Minorities 2012. Office of Policy Development and Research. Washington, DC, June. Yinger, John. 1998. “Evidence on Discrimination in Consumer Markets.” Journal of Economic Per- spectives 12 (2): 23–40. Zhao, Bo, Jon Ondrich, and John Yinger. 2005. “Why Do Real Estate Brokers Continue to Discrimi- nate? Evidence from the 2000 Housing Discrimination Study.” Syracuse University Center for Pol- icy Research Paper 96.
choice A
For the homeowners of these houses, the author only used machine learning methods to analyze their account profile pictures and determine characteristics such as race, gender, and age.
choice B
This article employs a randomized trial method, selecting 10 experimental areas and creating 20 Airbnb test accounts to randomly book houses listed as "available" on the website eight weeks in advance.
choice C
The author categorized homeowners into six major groups based on their different responses, focusing primarily on those landlords who requested more information from tenants.
choice D
The author collected past guest reviews from homeowners' web pages to ensure the validity of the experiment.
difficulty
hard
domain
Single-Document QA
length
short
sub domain
Academic
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
initial import