The Effect of School Choice on Student Outcomes in the United States

The Effect of School Choice on Student Outcomes in the United States

Summary of the Randomized Evaluation

Country

United States (Chicago)

Researchers

Julie Berry Cullen, Brian Jacob, Steven Levitt

Methods

Researchers conducted a randomized controlled trial (RCT) in partnership with Chicago Public Schools (CPS) to evaluate the impact of school choice on student outcomes. The study involved 14,434 eighth-grade students who participated in randomized lotteries for admission to 19 different high schools. By comparing students who won the lottery (and thus attended their chosen schools) with those who did not, researchers aimed to identify any systematic benefits provided by attending these schools.
Context:

Chicago Public Schools operates one of the most extensive school choice programs in the United States. In this system, students can apply to attend schools outside their assigned neighbourhood schools. When the number of applications exceeds available spots, lotteries are used to allocate admissions, ensuring a randomized and fair selection process.

Improving Security through Concentrated Policing in Bogotá, Colombia

Improving Security through Concentrated Policing in Bogotá, Colombia

Summary of the Randomized Evaluation

Country

Colombia (Bogotá)

Researchers

Chris Blattman, Donald Green, Daniel Mejia, Daniel Ortega, Santiago Tobón

Methods

Researchers conducted a randomized controlled trial (RCT) to evaluate the impact of concentrated policing and municipal clean-ups on crime reduction and displacement in Bogotá, Colombia. The study targeted 1,919 high-crime street segments, randomly assigning them to one of four groups: concentrated policing, municipal clean-ups, both interventions, or a control group with no special interventions.
Context:

Crime in Bogotá is spatially concentrated, with a small percentage of street segments accounting for a significant portion of homicides and other crimes. The intervention aimed to address these high-crime areas through increased police presence and municipal maintenance, such as street light repairs, graffiti removal, and garbage collection. The study also aimed to measure potential crime displacement to neighbouring areas.

Reducing Inequality through a Summer Youth Employment Program in Boston

Reducing Inequality through a Summer Youth Employment Program in Boston

Summary of the Randomized Evaluation

Country

United States (Boston, MA).

Methods

Researchers conducted a randomized controlled trial (RCT) to evaluate the impact of the Boston Summer Youth Employment Program (SYEP) on participants' social behaviours, academic aspirations, and job readiness skills. The study involved 4,083 youth, who were selected through a lottery system.

Evaluating the Impact of a Growth Mindset Intervention in Argentina

Evaluating the Impact of a Growth Mindset Intervention in Argentina

Summary of the Randomized Evaluation 

Country

Argentina (Salta Province)

Researchers

Alejandro Ganimian

Methods

Researchers conducted a randomized controlled trial to evaluate the impact of a growth mindset intervention on educational attainment among secondary school students. The study involved 202 public secondary schools in the Province of Salta, with Grade 12 students participating in the intervention. Schools were randomly assigned to either the treatment group, where students received information about the potential to develop intelligence through practice, or the control group, which received no such intervention.

Changing Beliefs, Changing Bribes in India

Changing Beliefs, Changing Bribes in India

Summary of the Randomized Evaluation

Country

India (Rajasthan)

Researchers

Abhijit Banerjee, Esther Duflo, John Firth, Daniel Keniston, Ben Olken, Jeffrey Weaver

Methods

Researchers conducted a randomized controlled trial (RCT) to evaluate the impact of informing citizens about the true legal penalty for helmet violations on corruption and lawbreaking. The study included 17,369 motorcyclists across 112 towns in Rajasthan. Randomly selected motorcyclists were informed of the actual fine for not wearing a helmet through private information campaigns via phone calls and SMS messages. The comparison group received general safe driving messages without the fine details.

Randomized Evaluations in Education To Tackle Social Inequality

What are Randomized Evaluations in Education?

Randomized evaluations, also known as randomized controlled trials (RCTs), are a rigorous method used to assess the impact of educational interventions by randomly assigning participants to either a treatment or control group. This method ensures that any observed differences in outcomes can be attributed to the intervention itself, providing robust and unbiased evidence of its effectiveness. 

Why are They Important for Public Policy?

Such evaluations are crucial for public policy as they offer concrete data on what works and what does not, allowing policymakers to make informed decisions that can improve educational outcomes, enhance resource allocation, and ultimately drive systemic improvements in education systems.

In What Other Areas Can They be Implemented? 

RCTs are versatile and can be applied to a wide range of areas to assess the impact of various interventions. Here are some key areas where they can be particularly proven to be useful:

Healthcare

• Public Health Interventions: Evaluating the effectiveness of vaccination campaigns, sanitation improvements, or nutritional programs.
• Medical Treatments: Comparing the efficacy of new medications, treatments, or surgical procedures against standard practices.
• Health Education: Assessing the impact of health education programs on behaviours such as smoking cessation, diet, and exercise.

Education

• Curriculum Changes: Testing new teaching methods, educational technologies, or curriculum changes to improve student learning outcomes.
• Teacher Training: Evaluating the effectiveness of professional development programs for teachers.
• Student Support Services: Assessing the impact of counselling, tutoring, or mentorship programs on student performance and well-being.

Social Welfare

• Poverty Alleviation Programs: Evaluating the impact of cash transfers, microfinance, or job training programs on economic outcomes for low-income families.
• Housing Interventions:  Assessing the effectiveness of housing vouchers, rent subsidies, or homelessness prevention programs.
• Child Welfare: Testing the impact of parenting programs, child care services, or early childhood education on child development outcomes.

Labor Markets

• Employment Programs: Evaluating job placement services, skills training programs, or employment subsidies to improve job market outcomes.
• Wage Policies: Assessing the impact of minimum wage increases or wage subsidy programs on employment and income levels.
• Workplace Interventions: Testing the effectiveness of workplace wellness programs, flexible work arrangements, or diversity training.

Environmental Policy

• Conservation Programs: Evaluating the impact of initiatives such as protected areas, reforestation projects, or sustainable farming practices on environmental outcomes.
• Pollution Control: Testing the effectiveness of policies aimed at reducing air, water, or soil pollution.
• Energy Efficiency: Assessing the impact of energy-saving technologies or behavioural interventions on energy consumption.

Criminal Justice

• Policing Strategies: Evaluating the effectiveness of different policing strategies, such as community policing or hotspot policing, on crime rates.
• Rehabilitation Programs: Assessing the impact of rehabilitation programs, education, or job training for prisoners on recidivism rates.
• Legal Aid: Testing the effectiveness of providing legal aid or public defenders on justice outcomes for low-income individuals.

Public Policy

• Tax Policies: Evaluating the impact of tax incentives or subsidies on economic behaviour and public revenue.
• Regulatory Changes: Assessing the impact of regulatory changes on business practices, consumer protection, or market competition.
• Government Services: Testing the effectiveness of e-governance initiatives, public service delivery improvements, or anti-corruption measures.

Technology and Innovation

• Digital Inclusion Programs: Evaluating the impact of providing internet access, digital literacy training, or technological devices to underserved communities.
• Innovation Policies: Assessing the effectiveness of policies promoting research and development, start-up incubators, or technology transfer programs.
• AI and Automation: Testing the impact of AI-driven tools or automation technologies on productivity, employment, and social inequality.

By applying randomized evaluations across these diverse areas, policymakers and practitioners can obtain rigorous evidence on what works, enabling them to design and implement more effective and equitable interventions.