Controlled Experiments: Scholarly Readings
For a little more information on the value, applicability, generalizability, and difficulties in the design of controlled experiment, see the following:
- What is evidence-based education?, from Philip Davies of the University of Oxford
- Random Versus Nonrandom Assignment in Controlled Experiments: Do You Get the Same Answer, from William Shadish and Kevin Ragsdale of the University of Memphis
- Practical guide to controlled experiments on the web: listen to your customers not to the hippo, from Ron Kohavi, Randal Henne, and Dan Sommerfield of Microsoft
- Controlled experiments on the web: survey and practical guide, from Ron Kohavi, Roger Longbotham, Dan Sommerfield, and Randal Henne of Microsoft
- Trustworthy Online Controlled Experiments: Five Puzzling Outcomes Explained, from Ron Kohavi, Alex Deng, Brian Frasca, Roger Longbotham, Toby Walker, and Ya Xu of Microsoft
- Seven Pitfalls to Avoid when Running, Controlled Experiments on the Web, from Thomas Crook, Brian Frasca, Ron Kohavi, and Roger Longbotham of Microsoft
- Lab experiments are a major source of knowledge in
the social sciences, from Armin Falk and James Jeckman of the University of Munich
For more comprehensive information, see:
For demonstrations of good experimental design, we recommend using Google Scholar to search for controlled experiments in your chosen area. You'll generally find several useful examples. Similarly, we'd recommend also searching similarly for quasi-experiments if you're leaning in that direction. Or, see our own list of exemplary controlled experiments in education.
Interested in adding to this page? Please complete and submit our contribution form and we'll process your additions soon!