A Tale of Two Anachronisms
Counterfactual Meta-Experimentation and the Limits of Science: 100 Years of Parapsychology as a Control Group
How to produce credible research on anything
Embracing Variation and Accepting Uncertainty: Implications for Science and Metascience
Statistical methods as social technologies versus analytic tools: Implications for metascience and research reform
Checking Robustness in 4 Steps
Biological variation is more than random noise
Fomenting (Rigorous) Technological Revolutions: Replication and DARPA’s Mission
Is replication research the study of research or of researchers?
Jevin West is an Assistant Professor in the Information School at the University of Washington and co-founder of the DataLab. He is an Adjunct Faculty member in the Paul G. Allen School of Computer Science & Engineering, Data Science Fellow at the eScience Institute and Affiliate Faculty in the Center for Statistics & Social Sciences at UW. He develops knowledge discovery tools to study and facilitate science. His methods aim to detect the origins of scientific disciplines, the social and economic biases that drive these disciplines, and the impact the current publication system has on the health of science. This work led to a new course on Calling BS that he and his colleague, Carl Bergstrom, developed to combat misinformation that comes wrapped in data, figures, visualizations and statistics. The course is now being taught at universities around the globe.
Paula Stephan is professor of economics, Georgia State University and a research associate, National Bureau of Economic Research. Her research focuses on the economics of science and the careers of scientists and engineers. Recent work examines how bibliometric measures discourage risk taking in science, the relationship between international mobility and scientific productivity, how gender pairing between student and advisor relates to the productivity of PhD recipients and the economics of the postdoctoral position. She is a Fellow of the American Association for the Advancement of Science and member of the Board of Reviewing Editors, Science. She was named ScienceCareers’ first Person of the Year in 2012. Stephan is a Phi Beta Kappa Visiting Scholar for the 2018-2019 academic year.
Fiona Fidler is Associate Professor at the University of Melbourne, with a joint appointment in the Schools of BioSciences and History and Philosophy of Science. She is broadly interested in how experts, including scientists, make decisions and change their minds. Her past research has examined how methodological change occurs in different disciplines, including psychology, medicine and ecology, and developed methods for eliciting reliable expert judgements to improve decision making. She originally trained as a psychologist, and maintains a strong interest in psychological methods. She also has an abiding interest is statistical controversies, for example, the ongoing debate over Null Hypothesis Significance Testing. She is a current Australian Research Council Future Fellow, and leads the University of Melbourne’s Interdisciplinary MetaResearch Group (IMeRG).
I am a Research Assistant Professor at the Kellogg School of Management, Northwestern University. My principal research interest lies in the area of data mining/machine learning, computational social science and science of science. I study the link between the social network and leadership attainment and how social network can help women to achieve placement in leadership. Based on organizational theory, I develop a model for estimating a terror group’s future lethality by inferring from latent variables its hidden capabilities and resources. This model has an unique early warning signals. I also test the ability of artificial intelligence to address the replication problem in science. The goal is to demonstrate how AI can address replication problems at scale in ways that current methods cannot and can advance research by combining human and machine intelligence.