0000-0001-6797-5476
Charting the Space of Science Reform_PhD Dissertation
clearexciting
The Affleck-Murphy effect: Group membership has a larger effect on automatic than on deliberate judgment of known people
excitingrobustclear
Psychology's Theory Crisis, and Why Formal Modelling Cannot Solve It
robustclearexciting
Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis
Open Science Practices are on the Rise: The State of Social Science (3S) Survey
Proposal to NSF 19-565 to Create a STEM Education Research Hub
Assessing the effects of a precommitment policy applied during peer review
Merits and Limits of Preregistration for Visualization Research
Assessing the Effects of a Precommitment Policy Applied During Peer Review
Transform to Open Science Mission November 2023 Community Panel Summary Report
Registered Report vs. Traditional Reports: Text Mining
15 November 2023 - NASA Transform to Open Science (TOPS) Community Panel Transcript (Day 2)
14 November 2023 - NASA Transform to Open Science (TOPS) Community Panel Transcript (Day 1)
Responsible data sharing: Identifying and remedying possible re-identification of human participants
Effects of data availability statements on likelihood of preprint downloads.
Experience with the Registered Report Process
Placeholder for Research Materials (Public)
RCT of Registered Reports: Global Flourishing Study
Registered Revisions Pathfinder Pilot
Resources for Collaborators
Resources for Journals and Editors
Transform to Open Science October Community Panel Summary Report
Center for Open Science Impact Reports
Transcripts from 2022 October TOPS Community Panel
Age IAT 2002-2017
Analysis
Analysis Plan
Analysis Plan (Study 1)
Analysis Scripts
Arab IAT 2004-2017
Asian American IAT 2004-2017
Assessing Reliability of Coders
Attractiveness Bias and Decision Making 3.3
Attractiveness Bias in Decision Making
Attractiveness Bias in Decision Making 3.2
Attractiveness Bias in Decision-Making 3
Attractiveness Bias in Decision-Making II
Brian Nosek Article Coding Component
Bypassing in Good and Bad Behaviors (UCSB Wave 1 Study)
Changing Political Perceptions (Nosek Lab, Stanford Wave 1 Study)
Comparing Interventions to Reduce Social Bias in Decision-Making
Comparison Article Selection and Coding
Conception Risk and Racial Prejudice
Confirmation Study
Conflict of Interest Signal Study
Contributing Labs
Data
Data & Analysis
Dataset
Datasets & Codebooks
Datasets & Codebooks (Touch Screen)
Datasets & Codebooks (Touch screen)
Design
Differences from Original Study (Kawakami et al., 2011, Study 1)
Disability IAT 2004-2017
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Experiment Materials
Expert Materials
Explicit system justifying motives and racial BIATs
Final analysis plan for 'Manipulating awareness within bias reduction strategies'
Gender-Science IAT 2003-2017
Geographic Information and Census Data Extension
Global Awareness and Reducing Multiple Biases in Social Judgment
How Awareness Impacts Multiple Forms of Social Bias in Behavior
How Awareness Impacts Multiple Forms of Social Bias in Behavior (Analysis Plan)
How Awareness Impacts Multiple Forms of Social Bias in Behavior (Final Data Collection and Analysis Plan)
How Awareness Impacts Multiple Forms of Social Bias in Behavior II
How Awareness Impacts Multiple Forms of Social Bias in Behavior III
How Awareness Impacts Multiple Forms of Social Bias in Behavior IV
How Awareness Impacts Multiple Forms of Social Bias in Behavior V
IAT Changes Over Time
Implicit Sexuality Preferences during the 2014 Ebola Outbreak
In-group Favoritism when Changing Groups
In-house Materials
Ingroup Bias in Decision-Making
Ingroup Bias in Decision-Making 2
Intuitions About 'Choking' vs. 'Being Clutch' Pilot
Investigating Mechanisms For Impact of Awareness on Biased Behavior (Data Analysis Plan)
Investigating Mechanisms For Impact of Awareness on Biased Behavior (Measures and Methods)
Investigating variation in replicability: A “Many Labs” Replication Project
Investigating variation in replicability: The “Many Labs” Replication Project
Journal policies related to research transparency and reproducibility in psychology: A cross-sectional assessment of influential journals and randomly-selected journals
Looking back on identities past: Implicit and explicit evaluations of former groups
ML2: The Effects
ML4 registration draft
ML5 Dataset & Analysis LoBue & DeLoache
ML5 LoBue & DeLoache Results Blind Manuscript, raw data, materials and code
ML5 LoBue & DeLoache Results Included
ML5 Protocols: LoBue & DeLoache (2008)
ML5: Overarching Analyses
ML5: Replication of Crosby, Monin & Richardson (2008)
ML5: Replications of LoBue & DeLoache (2008)
ML5: Replications of Payne, Burkley, & Stokes (2008)
Manipulating Fairness and Awareness for Reducing Biased Behavior
Manipulating awareness within bias reduction strategies
Many Labs 2: Investigating Variation in Replicability Across Sample and Setting
Many Labs 3: Evaluating participant pool quality across the academic semester via replication
Many Labs 3: Participant Pool Edition
Materials
Materials and Measures
Materials and Methods
Measuring Attractiveness and Ingroup Biases Simultaneously in a JBT
Meeting Minutes
Method and Procedure (Study 1)
Methods and Measures
Methods and Study Materials
Mock Session Videos
Native American IAT 2004-2017
Own-Race Bias in Romantic Decisions
Perception of Greedy Behavior (Berkeley Wave 1)
Perception of Moral Behavior (UCSB Wave 1)
Perceptions of Sexual Orientation (Decline Effect Confirmation Study)
Political Bias in Decision Making II
Pre-Registered Analysis Plan for Conservatism and BIATs
Pre-Registration Files
Pre-registration
Preregistering Qualitative Research - Delphi study
Preregistration and Updating Beliefs: Direct Replication
Preregistration and Updating Beliefs: Study 2
Preregistration and Updating Beliefs: Study 3
Preregistration and Updating Beliefs: Study 4
Preregistration and Updating Beliefs: Study 5
Preregistration of Preregistration evaluation 2016
President IAT 2003-2017
Project Implicit Demo Website Datasets
Race IAT 2002-2017
Randomization
Real Groups Study
Reducing Attractiveness Bias in Decision-Making By Making Judgments in Pairs
Reducing Implicit Racial Preferences: II. Intervention Effectiveness Across Time
Referral Judgments (Berkeley Wave 2)
Registered Report vs. Traditional Reports Coding Task
Rejecting or Accepting Choices in the False Consensus Effect
Religion IAT 2004-2017
Replication Reports
Replication of Ackerman et al (2010)
Replication of Gervais and Norenzayan (2012)
Replication of Karpicke and Blunt (2011)
Replication of Lee and Schwarz (2010)
Replication of Morrison & Miller (2008, JPSP, Study 3)
Replication of Ramirez and Beilock (2011)
Research Quality of Registered Reports Compared to the Traditional Publishing Model
Results: Data
Results: Figures
Results: Scripts
Role of Awareness on Shooter Bias
Self-Control Failure (UCSB Wave 2)
Self-Replication
Self-Replication (Decline Effect)
Sexuality IAT 2004-2017
Shooter Task Pilot Study
Site and Sample Characteristics
Skin Tone IAT 2004-2017
Slate 1: Alter, Oppenheimer, Epley & Eyre (2007) Study 4
Slate 1: Graham, Haidt, & Nosek (2009) Study 1
Slate 1: Hauser et al. (2007) Scenarios 1+2
Slate 1: Inbar, Pizarro, Knobe & Bloom (2009) Study 1
Slate 2: Hauser et al. (2007) Scenarios 3+4
Slate 2: Knobe (2003) Study 1
Slate 2: Risen & Gilovich (2008) Study 1
Special Issue of Social Psychology
Spontaneous Awareness and Bias
Study 1
Study 2
Study 8 - Manipulating Identifiability of Bias
Study Demonstration / Materials (Study 1)
Study Materials
Study Surveys (pre-post and mid)
Testing Impact of Encoding Phase on JBT
Using prediction markets to predict the outcomes in DARPA’s Next Generation Social Science program
Weapons IAT 2004-2017
Weight IAT 2004-2017
When do Counterstereotypical Exemplars Reduce Implicit Bias?
iREDS
misinformationVSSystemJustification
#MTRP: MTurk Replication Project
Attitudes, Identities, & Individual Differences (AIID) - exploratory data subset
Center for Open Science: Response to ASAPbio RFA for a Preprint Service
Code
Coding the Articles
Credibility of Preprints Survey
Data Error Correction
Deciphering the Decline Effect
Gender Differences in Implicit Measures of Personality Traits
Gender-Career IAT 2005-2017
Many analysts, one dataset: Making transparent how variations in analytical choices affect results
Operations Manuals
Overarching Paper
Pre-Analysis Plan
Preregistration and Updating Beliefs: Study 6
Project Notes, Organization, & IRB Protocol
Religion IAT 2004-2009
Religion IAT 2017
Religion MC-IAT 2009-2014
Reproducibility Project: Cancer Biology
Reproducibility Project: Psychology
Study 6 - Minimum Wage
Study 6a - Minimum Wage (Online)
Study 6a - Minimum Wage (online)
Study 6b - Minimum Wage (Lab)
Summary Results
Supplemental Files
Supplementary Information
The Attitudes, Identities, and Individual Differences (AIID) Study and Dataset
The Effect of Badges on Availability of Data and Materials
The Influence of Past Religious Group Membership on Current Preferences
The Open Scholarship Survey (OSS)
Who watches the Watchmen / Reviewing Reviewers
Transform to Open Science May Community Panel Summary Report
Presentations Given by COS
Transform to Open Science Community Panel Transcripts
Challenges for assessing replicability in preclinical cancer biology
Initial evidence of research quality of registered reports compared with the standard publishing model
Replicability, Robustness, and Reproducibility in Psychological Science
We are in it together
Open Letter: Scientists stand up to protect academic whistleblowers and post-publication peer review.
Initial Evidence of Research Quality of Registered Reports Compared to the Traditional Publishing Model
Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability
Credibility of preprints: an interdisciplinary survey of researchers
High Replicability of Newly-Discovered Social-behavioral Findings is Achievable
What is replication?
Credibility of Preprints: An interdisciplinary Survey of Researchers
Chan Zuckerberg Initiative (CZI) Essential Open Source Software for Science, Cycle 2 Center for Open Science (COS) Proposal - Advancing Sustainability and Innovation of Open Manuscript Services
NSF 19-501 AccelNet Proposal: Community of Open Scholarship Grassroots Networks (COSGN)
A randomized trial of a lab-embedded discourse intervention to improve research ethics
Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement
Preregistration Is Hard, And Worthwhile
Center for Open Science: Proposal for NSF 19-537 Mid-Scale Research Infrastructure
Predicting replication outcomes in the Many Labs 2 study
Reply to Ledgerwood: Predictions without analysis plans are inert
Reply to Ledgerwood: Predictions without Analysis Plans are Inert
Ensuring the quality and specificity of preregistrations
Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015
Scientific Utopia: III. Crowdsourcing Science
Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education
Earth and Space Sciences Data Are a World Heritage – Community Partnership to Develop Best Practices Across the Data Lifecycle to Advance Open and FAIR Data
Dimensions of Subjective Age Identity Across the Lifespan
Scale Invariant Contrasts of Response Latency Distributions
The preregistration revolution
Easy preregistration will benefit any research
Reducing social judgment biases may require identifying the potential source of bias
Testimony Before the Federal Spending Oversight Subcommittee, October 18, 2017
Reducing Implicit Prejudice
Response latency in social psychological research
Response to DARPA-SN-17-57 RFI: Path to Iterative Confidence Level Evaluation
Redefine statistical significance
How Ideological Migration Geographically Segregates Groups
An Open, FAIRified Data Commons: Proposal for NIH Data Commons Pilot
The Preregistration Revolution
(Part of) The Case for a Pragmatic Approach to Validity: Comment on De Houwer, Teige-Mocigemba, Spruyt, and Moors (2009)
A Proposal to Advance Theory and Promote Collaboration in Tropical Biology by Supporting Replications
Mischaracterizing replication studies leads to erroneous conclusions
National differences in gender–science stereotypes predict national sex differences in science and math achievement
Center for Open Science: Strategic Plan
A Comparison of the Sensitivity of Four Indirect Evaluation Measures to Evaluative Information
A multitrait-multimethod validation of the Implicit Association Test
Faulty assumptions: A comment on Blanton, Jaccard, Gonzales, and Christie (2006)
Consequential Validity of the Implicit Association Test: Comment on Blanton and Jaccard (2006)
Moderators of the Relationship between Implicit and Explicit Evaluation
Uncomfortable Truths
Why So Little Faith? A Reply to Blanton and Jaccard’s (2006) Skeptical View of Testing Pure Multiplicative Theories
Contextual Variations in Implicit Evaluation
Validity of the Salience Asymmetry Interpretation of the IAT: Comment on Rothermund and Wentura (2004)
(At least) two factors moderate the relationship between implicit and explicit attitudes
A Unified Theory of Implicit Attitudes, Stereotypes, Self-Esteem, and Self-Concept
Harvesting implicit group attitudes and beliefs from a demonstration website
Health of the Implicit Association Test at Age 3
Math = Male, Me = Female, therefore Math ≠ Me
Understanding and Using the Brief Implicit Association Test: Recommended Scoring Procedures
Understanding and Using the Implicit Association Test: 1. An Improved Scoring Algorithm
eResearch: Ethics, Security, Design, and Control in Psychological Research on the Internet
Moral Elevation Reduces Prejudice Against Gay Men
The Go/No-Go Association Task
A comparative investigation of seven indirect attitude measures
Estimating the Reproducibility of Psychological Science
Transparency and Openness Promotion (TOP) Guidelines
Moderators of the relationship between implicit and explicit attitudes
Scientific Utopia: II. Restructuring incentives and practices to promote truth over publishability
Implicit preferences for straight people over lesbian women and gay men weakened from 2006 to 2013
Policy Implications of Implicit Social Cognition
A Meta-Analysis of Procedures to Change Implicit Measures
Age-Based Hiring Discrimination as a Function of Equity Norms and Self-Perceived Objectivity
An unintentional, robust, and replicable pro-Black bias in social judgment
Go/No-go Association Task
Maximizing the Reproducibility of Your Research
Misattribution of Claims: Comment on Payne et al., 2013
Reducing stigma toward individuals with mental illnesses: A brief, online manipulation
Registered Reports: A Method to Increase the Credibility of Published Reports
Statistically Small Effects of the Implicit Association Test can Have Societally Large Effects
The Assimilative Effect of Co-occurrence on Evaluation Above and Beyond the Effect of Relational Qualifiers
The Effect of the Validity of Co-occurrence on Automatic and Deliberate Evaluation
The Judgment Bias Task: A flexible method for assessing individual differences in social judgment biases
An unintentional, robust, and replicable pro-black bias in social judgment
Liberating field science samples and data: Promote reproducibility by moving beyond "available upon request"
Reducing Implicit Gender Leadership Bias in Academic Medicine With an Educational Intervention
Response to Comment on Estimating the reproducibility of psychological science
archival-project: v0.1.0
Attitudes and stereotypes in lung cancer versus breast cancer
Estimating the reproducibility of psychological science
Health care providers' implicit and explicit attitudes toward lesbian women and gay men
In Search of an Association Between Conception Risk and Prejudice
On the gender-science stereotypes held by Scientists: Explicit accord with gender-ratios, implicit accord with scientific identity
Processing goals moderate the effect of co-occurrence on automatic evaluation
Promoting an open research culture
Statistically small effects of the Implicit Association Test can have societally large effects
Using prediction markets to estimate the reproducibility of scientific research
Do physicians' implicit views of African Americans affect clinical decision making?
How ideological migration geographically segregates groups
Investigating variation in replicability: A "many labs" replication project
Moral elevation reduces prejudice against gay men
Promoting transparency in social science research
Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention
Reducing implicit racial preferences: I. A comparative investigation of 17 interventions
Registered reports: A method to increase the credibility of published results
Replication attempt: "Effect of BMAP-28 antimicrobial peptides on Leishmania major promastigote and amastigote growth: Role of leishmanolysin in parasite survival"
The Rules of Implicit Evaluation by Race, Religion, and Age
Theory building through replication response to commentaries on the "many labs"replication project
Understanding and using the brief implicit association test: Recommended scoring procedures
Overweight People Have Low Levels of Implicit Weight Bias, but Overweight Nations Have High Levels of Implicit Weight Bias
Belief in a Just God (and a Just Society): A System Justification Perspective on Religious Ideology.
Childless lesbian and gay adults’ self-efficacy about achieving parenthood.
Confidence and precision increase with high statistical power
Consider the Source: Persuasion of Implicit Evaluations Is Moderated by Source Credibility
Empirical evidence for low reproducibility indicates low pre-study odds
Gender differences in implicit and explicit personality traits
Power failure: why small sample size undermines the reliability of neuroscience
Recommendations for Increasing Replicability in Psychology
Replication Actually: Comment on Crawford and Pilanski (2013)
Special Issue of <i>Social Psychology</i> on “Replications of Important Results in Social Psychology”
When Fatigue Turns Deadly: The Association Between Fatigue and Racial Bias in the Decision to Shoot
An open, large-scale, collaborative effort to estimate the reproducibility of psychological science
Attitudinal dissociation: What does it mean?
Do Implicit Attitudes Predict Actual Voting Behavior Particularly for Undecided Voters?
Does One Bad Apple(Juice) Spoil the Bunch? Implicit Attitudes Toward One Product Transfer to Other Products by the Same Brand
Implicit and Explicit Anti-Fat Bias among a Large Sample of Medical Doctors by BMI, Race/Ethnicity and Gender
Links Between Psychosocial Variables and Body Dissatisfaction in Homosexual Men: Differential Relations with the Drive for Muscularity and the Drive for Thinness
Motivated Independence? Implicit Party Identity Predicts Political Judgments Among Self-Proclaimed Independents
My Culture Made Me Do It
Presenting Survey Items One at a Time Compared to All at Once Decreases Missing Data without Sacrificing Validity in Research with Internet Volunteers
Rapid Assimilation: Automatically Integrating New Information with Existing Beliefs
Reporting Intentional Rating of the Primes Predicts Priming Effects in the Affective Misattribution Procedure
Reproducibility concerns
Scientific Communication Is Changing and Scientists Should Lead the Way
Scientific Utopia: I. Opening Scientific Communication
Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability
The Moral Stereotypes of Liberals and Conservatives: Exaggeration of Differences across the Political Spectrum
When Ingroups Aren’t “In”: Perceived Political Belief Similarity Moderates Religious Ingroup Favoritism
Affective Focus Increases the Concordance Between Implicit and Explicit Attitudes
Implicit social cognition: from measures to mechanisms
Implicit social cognitions predict sex differences in math engagement and achievement
Mapping the moral domain.
Negativity and outgroup biases in attitude formation and transfer
System Justification: A Motivational Process with Implications for Social Conflict
System Justification: How do we know it’s motivated
Correlational biases in mean response latency differences
Creating distinct implicit and explicit attitudes with an illusory correlation paradigm
Cumulative and career-stage citation impact of social-personality psychology programs and their members
Evaluative conditioning and conscious knowledge of contingencies: A correlational investigation with large samples
Group-Based Dominance and Opposition to Equality Correspond to Different Psychological Motives
Implicit (and explicit) racial attitudes barely changed during Barack Obama’s presidential campaign and early presidency
Implicit Association Test
Implicit Social Cognition
Seeing the forest through the trees: A comparison of different IAT variants measuring implicit alcohol associations
The Surprisingly Limited Malleability of Implicit Racial Evaluations
“Do Unto Others”: Effects of Priming the Golden Rule on Buddhists’ and Christians’ Attitudes Toward Gay People
(Part of) the case for a pragmatic approach to validity: Comment on De Houwer, Teige-Mocigemba, Spruyt, and Moors (2009).
Alienable Speech: Ideological Variations in the Application of Free-Speech Principles
Implicit Race Attitudes Predicted Vote in the 2008 U.S. Presidential Election
Liberals and conservatives rely on different sets of moral foundations.
National differences in gender-science stereotypes predict national sex differences in science and math achievement
Physicians’ Implicit and Explicit Attitudes About Race by MD Race, Ethnicity, and Gender
The Sorting Paired Features Task
Distinguishing automatic and controlled components of attitudes from direct and indirect measurement methods
Ideology: Its Resurgence in Social, Personality, and Political Psychology
Implicit Attitude Generalization Occurs Immediately; Explicit Attitude Generalization Takes Time
Implicit and Explicit Stigma of Mental Illness
Implicit and explicit stigma of mental illness: Links to clinical care
Personalizing the Implicit Association Test Increases Explicit Evaluation of Target Concepts
The associations in our heads belong to us: Searching for attitudes and knowledge in implicit evaluation
A Multitrait-Multimethod Validation of the Implicit Association Test
Explicit and implicit cognition: A preliminary test of a dual-process theory of cognitive vulnerability to depression
Implicit?Explicit Relations
Pervasiveness and correlates of implicit attitudes and stereotypes
Understanding the individual implicitly and explicitly
Why so little faith? A reply to Blanton and Jaccard's (2006) skeptical view of testing pure multiplicative theories: Postcript.
Consequential validity of the Implicit Association Test: Comment on Blanton and Jaccard (2006).
Consequential validity of the implicit association Test: Comment on Blanton and Jaccard (2006)
The Influence of One’s Own Body Weight on Implicit and Explicit Anti-fat Bias*
Why so little faith? A reply to Blanton and Jaccard's (2006) skeptical view of testing pure multiplicative theories
Why so little faith? A reply to Blanton and Jaccard's (2006) skeptical view of testing pure multiplicative theories.
Moderators of the relationship between implicit and explicit evaluation
The War of the Words: How Linguistic Differences in Reporting Shape Perceptions of Terrorism
Understanding and using the implicit association test: II. Method variables and construct validity
Validity of the salience asymmetry interpretation of the implicit association test: Comment on Rothermund and Wentura (2004)
What moderates implicit—explicit consistency?
A Decade of System Justification Theory: Accumulated Evidence of Conscious and Unconscious Bolstering of the Status Quo
No place for Nostalgia in science: A response to Arkes and Tetlock
"Understanding and using the Implicit Association Test: I. An improved scoring algorithm": Correction to Greenwald et al. (2003).
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept
A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept.
E-Research: Ethics, Security, Design, and Control in Psychological Research on the Internet
Harvesting implicit group attitudes and beliefs from a demonstration web site.
Math = male, me = female, therefore math ≠ me.
A Comparative Investigation of 18 Interventions to Reduce Implicit Racial Preferences
A Comparative Investigation of Seven Implicit Measures of Social Cognition
Ambivalence and Implicit-Explicit Discrepancy Are Not the Same Construct
Automatic Associations: Personal Attitudes or Cultural Knowledge?
Childless Lesbian and Gay Adults’ Self-Efficacy About Achieving Parenthood
Consider the Source: Persuasion of Implicit Evaluations is Moderated by Source Credibility
Gender Differences in Implicit and Explicit Personality Traits
How Moral Migration Geographically Segregates and Polarizes Groups
Implicit Attitudes
Implicit Social Cognition: From Measures to Mechanisms
Moral Elevation Reduces Prejudice against Gay Men
The Moral Stereotypes of Liberals and Conservatives: Exaggeration of Differences Across the Political Divide
The Politics of Intergroup Attitudes
Understanding and Using the Brief Implicit Association Test: I. Recommended Scoring Procedures
Warning Bell: Liberals Implicitly Respond to Group Morality Before Rejecting it Explicitly
When Fatigue Turns Deadly: The Effects of Cognitive Depletion and Sleep Deprivation on the Decision to Shoot
When Ingroups Aren’t 'In': Perceived Political Belief Similarity Moderates Religious Ingroup Favoritism
0000-0001-6797-5476
All endorsersAll endorsers