psiTurk: An open-source framework for conducting replicable behavioral experiments online

Gureckis, T. M., Martin, J. B., McDonnell, J., Rich, A. S., Markant, D. B., Coenen, A., Halpern, D., Hamrick, J. B., & Chan, P. (2015). psiTurk: An open-source framework for conducting replicable behavioral experiments online. Behavioral Research Methods.

PDFgithub282 citations

Abstract

Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps researchers develop experiment designs which can be conducted over the Internet. The tool primarily interfaces with Amazon's Mechanical Turk, a popular crowd-sourcing labor market. This paper describes the basic architecture of the system and introduces new users to the overall goals of the system. psiTurk aims to reduce the technical hurdles for researchers developing online experiments while improving the transparency and collaborative nature of the behavioral sciences. [ final version available at <a href="http://link.springer.com/article/10.3758/s13428-015-0642-8 ">http://link.springer.com/article/10.3758/s13428-015-0642-8 </a>]

Highlighted Figures

Keywords

Bibtex entry:

@article{gureckis2015psiturk,
	abstract = {Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps researchers develop experiment designs which can be conducted over the Internet. The tool primarily interfaces with Amazon's Mechanical Turk, a popular crowd-sourcing labor market. This paper describes the basic architecture of the system and introduces new users to the overall goals of the system. psiTurk aims to reduce the technical hurdles for researchers developing online experiments while improving the transparency and collaborative nature of the behavioral sciences. [ final version available at <a href="http://link.springer.com/article/10.3758/s13428-015-0642-8 ">http://link.springer.com/article/10.3758/s13428-015-0642-8 </a>]},
	author = {Gureckis, T.M. and Martin, J.B. and McDonnell, J. and Rich, A.S. and Markant, D.B. and Coenen, A. and Halpern, D. and Hamrick, J.B. and Chan, P.},
	journal = {Behavioral Research Methods},
	title = {psiTurk: An open-source framework for conducting replicable behavioral experiments online},
	year = {2015}}

QR Code:


Download SVG