Registered Replication Report: Dijksterhuis and van Knippenberg (1998)

Michael O'Donnell; Leif D Nelson; Evi Ackermann; Balazs Aczel; Athfah Akhtar; Silvio Aldrovandi; Nasseem Alshaif; Ronald Andringa; Mark Aveyard; Peter Babincak; Nursena Balatekin; Scott A Baldwin; Gabriel Banik; Ernest Baskin; Raoul Bell; Olga Białobrzeska; Angie R Birt; Walter R Boot; Scott R Braithwaite; Jessie C Briggs; Axel Buchner; Desiree Budd; Kathryn Budzik; Lottie Bullens; Richard L Bulley; Peter R Cannon; Katarzyna Cantarero; Joseph Cesario; Stephanie Chambers; Christopher R Chartier; Peggy Chekroun; Clara Chong; Axel Cleeremans; Sean P Coary; Jacob Coulthard; Florien M Cramwinckel; Thomas F Denson; Marcos Díaz-Lago; Theresa E DiDonato; Aaron Drummond; Julia Eberlen; Titus Ebersbach; John E Edlund; Katherine M Finnigan; Justin Fisher; Natalia Frankowska; Efraín García-Sánchez; Frank D Golom; Andrew J Graves; Kevin Greenberg; Mando Hanioti; Heather A Hansen; Jenna A Harder; Erin R Harrell; Andree Hartanto; Michael Inzlicht; David J Johnson; Andrew Karpinski; Victor N Keller; Olivier Klein; Lina Koppel; Emiel Krahmer; Anthony Lantian; Michael J Larson; Jean-Baptiste Légal; Richard E Lucas; Dermot Lynott; Corey M Magaldino; Karlijn Massar; Matthew T McBee; Neil McLatchie; Nadhilla Melia; Michael C Mensink; Laura Mieth; Samantha Moore-Berg; Geraldine Neeser; Ben R Newell; Marret K Noordewier; Asil Ali Özdogğru; Myrto Pantazi; Michał Parzuchowski; Kim Peters; Michael C Philipp; Monique M H Pollmann; Panagiotis Rentzelas; Rosa Rodríguez-Bailón; Jan Philipp Röer; Ivan Ropovik; Nelson A Roque; Carolina Rueda; Bastiaan T Rutjens; Katey Sackett; Janos Salamon; Ángel Sánchez-Rodríguez; Blair Saunders; Juliette Schaafsma; Michael Schulte-Mecklenbeck; David R Shanks; Martin F Sherman; Kenneth M Steele; Niklas K Steffens; Jessie Sun; Kyle J Susa; Barnabas Szaszi; Aba Szollosi; Ricardo M Tamayo; Gustav Tinghög; Yuk-Yue Tong; Carol Tweten; Miguel A Vadillo; Deisy Valcarcel; Nicolas Van der Linden; Michiel van Elk; Frenk van Harreveld; Daniel Västfjäll; Simine Vazire; Philippe Verduyn; Matt N Williams; Guillermo B Willis; Sarah E Wood; Chunliang Yang; Oulmann Zerhouni; Robert Zheng; Mark Zrubka

doi:10.1177/1745691618755704

Registered Replication Report: Dijksterhuis and van Knippenberg (1998)

Michael O'Donnell^*, Leif D Nelson, Evi Ackermann, Balazs Aczel, Athfah Akhtar, Silvio Aldrovandi, Nasseem Alshaif, Ronald Andringa, Mark Aveyard, Peter Babincak, Nursena Balatekin, Scott A Baldwin, Gabriel Banik, Ernest Baskin, Raoul Bell, Olga Białobrzeska, Angie R Birt, Walter R Boot, Scott R Braithwaite, Jessie C BriggsAxel Buchner, Desiree Budd, Kathryn Budzik, Lottie Bullens, Richard L Bulley, Peter R Cannon, Katarzyna Cantarero, Joseph Cesario, Stephanie Chambers, Christopher R Chartier, Peggy Chekroun, Clara Chong, Axel Cleeremans, Sean P Coary, Jacob Coulthard, Florien M Cramwinckel, Thomas F Denson, Marcos Díaz-Lago, Theresa E DiDonato, Aaron Drummond, Julia Eberlen, Titus Ebersbach, John E Edlund, Katherine M Finnigan, Justin Fisher, Natalia Frankowska, Efraín García-Sánchez, Frank D Golom, Andrew J Graves, Kevin Greenberg, Mando Hanioti, Heather A Hansen, Jenna A Harder, Erin R Harrell, Andree Hartanto, Michael Inzlicht, David J Johnson, Andrew Karpinski, Victor N Keller, Olivier Klein, Lina Koppel, Emiel Krahmer, Anthony Lantian, Michael J Larson, Jean-Baptiste Légal, Richard E Lucas, Dermot Lynott, Corey M Magaldino, Karlijn Massar, Matthew T McBee, Neil McLatchie, Nadhilla Melia, Michael C Mensink, Laura Mieth, Samantha Moore-Berg, Geraldine Neeser, Ben R Newell, Marret K Noordewier, Asil Ali Özdogğru, Myrto Pantazi, Michał Parzuchowski, Kim Peters, Michael C Philipp, Monique M H Pollmann, Panagiotis Rentzelas, Rosa Rodríguez-Bailón, Jan Philipp Röer, Ivan Ropovik, Nelson A Roque, Carolina Rueda, Bastiaan T Rutjens, Katey Sackett, Janos Salamon, Ángel Sánchez-Rodríguez, Blair Saunders, Juliette Schaafsma, Michael Schulte-Mecklenbeck, David R Shanks, Martin F Sherman, Kenneth M Steele, Niklas K Steffens, Jessie Sun, Kyle J Susa, Barnabas Szaszi, Aba Szollosi, Ricardo M Tamayo, Gustav Tinghög, Yuk-Yue Tong, Carol Tweten, Miguel A Vadillo, Deisy Valcarcel, Nicolas Van der Linden, Michiel van Elk, Frenk van Harreveld, Daniel Västfjäll, Simine Vazire, Philippe Verduyn, Matt N Williams, Guillermo B Willis, Sarah E Wood, Chunliang Yang, Oulmann Zerhouni, Robert Zheng, Mark Zrubka

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

41 Citations (Web of Science)

137 Downloads (Pure)

Abstract

Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ("professor") subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ("soccer hooligans"). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the "professor" category and those primed with the "hooligan" category (0.14%) and no moderation by gender.

Original language	English
Pages (from-to)	268-294
Number of pages	27
Journal	Perspectives on Psychological Science
Volume	13
Issue number	2
DOIs	https://doi.org/10.1177/1745691618755704
Publication status	Published - 1 Mar 2018

Keywords

priming
replication
intelligence
CATEGORY ACCESSIBILITY
BEHAVIOR
ACTIVATION
PRIMES
Intelligence
Humans
Male
Prejudice
Social Perception
Female

Access to Document

10.1177/1745691618755704

Full TextFinal published version, 718 KBLicence: Taverne

Cite this

O'Donnell, M., Nelson, L. D., Ackermann, E., Aczel, B., Akhtar, A., Aldrovandi, S., Alshaif, N., Andringa, R., Aveyard, M., Babincak, P., Balatekin, N., Baldwin, S. A., Banik, G., Baskin, E., Bell, R., Białobrzeska, O., Birt, A. R., Boot, W. R., Braithwaite, S. R., ... Zrubka, M. (2018). Registered Replication Report: Dijksterhuis and van Knippenberg (1998). Perspectives on Psychological Science, 13(2), 268-294. https://doi.org/10.1177/1745691618755704

@article{8c7f4698f4544532b61572ca9759ec42,

title = "Registered Replication Report: Dijksterhuis and van Knippenberg (1998)",

abstract = "Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ({"}professor{"}) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ({"}soccer hooligans{"}). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the {"}professor{"} category and those primed with the {"}hooligan{"} category (0.14%) and no moderation by gender.",

keywords = "priming, replication, intelligence, CATEGORY ACCESSIBILITY, BEHAVIOR, ACTIVATION, PRIMES, Intelligence, Humans, Male, Prejudice, Social Perception, Female",

author = "Michael O'Donnell and Nelson, {Leif D} and Evi Ackermann and Balazs Aczel and Athfah Akhtar and Silvio Aldrovandi and Nasseem Alshaif and Ronald Andringa and Mark Aveyard and Peter Babincak and Nursena Balatekin and Baldwin, {Scott A} and Gabriel Banik and Ernest Baskin and Raoul Bell and Olga Bia{\l}obrzeska and Birt, {Angie R} and Boot, {Walter R} and Braithwaite, {Scott R} and Briggs, {Jessie C} and Axel Buchner and Desiree Budd and Kathryn Budzik and Lottie Bullens and Bulley, {Richard L} and Cannon, {Peter R} and Katarzyna Cantarero and Joseph Cesario and Stephanie Chambers and Chartier, {Christopher R} and Peggy Chekroun and Clara Chong and Axel Cleeremans and Coary, {Sean P} and Jacob Coulthard and Cramwinckel, {Florien M} and Denson, {Thomas F} and Marcos D{\'i}az-Lago and DiDonato, {Theresa E} and Aaron Drummond and Julia Eberlen and Titus Ebersbach and Edlund, {John E} and Finnigan, {Katherine M} and Justin Fisher and Natalia Frankowska and Efra{\'i}n Garc{\'i}a-S{\'a}nchez and Golom, {Frank D} and Graves, {Andrew J} and Kevin Greenberg and Mando Hanioti and Hansen, {Heather A} and Harder, {Jenna A} and Harrell, {Erin R} and Andree Hartanto and Michael Inzlicht and Johnson, {David J} and Andrew Karpinski and Keller, {Victor N} and Olivier Klein and Lina Koppel and Emiel Krahmer and Anthony Lantian and Larson, {Michael J} and Jean-Baptiste L{\'e}gal and Lucas, {Richard E} and Dermot Lynott and Magaldino, {Corey M} and Karlijn Massar and McBee, {Matthew T} and Neil McLatchie and Nadhilla Melia and Mensink, {Michael C} and Laura Mieth and Samantha Moore-Berg and Geraldine Neeser and Newell, {Ben R} and Noordewier, {Marret K} and {\"O}zdogğru, {Asil Ali} and Myrto Pantazi and Micha{\l} Parzuchowski and Kim Peters and Philipp, {Michael C} and Pollmann, {Monique M H} and Panagiotis Rentzelas and Rosa Rodr{\'i}guez-Bail{\'o}n and R{\"o}er, {Jan Philipp} and Ivan Ropovik and Roque, {Nelson A} and Carolina Rueda and Rutjens, {Bastiaan T} and Katey Sackett and Janos Salamon and {\'A}ngel S{\'a}nchez-Rodr{\'i}guez and Blair Saunders and Juliette Schaafsma and Michael Schulte-Mecklenbeck and Shanks, {David R} and Sherman, {Martin F} and Steele, {Kenneth M} and Steffens, {Niklas K} and Jessie Sun and Susa, {Kyle J} and Barnabas Szaszi and Aba Szollosi and Tamayo, {Ricardo M} and Gustav Tingh{\"o}g and Yuk-Yue Tong and Carol Tweten and Vadillo, {Miguel A} and Deisy Valcarcel and {Van der Linden}, Nicolas and {van Elk}, Michiel and {van Harreveld}, Frenk and Daniel V{\"a}stfj{\"a}ll and Simine Vazire and Philippe Verduyn and Williams, {Matt N} and Willis, {Guillermo B} and Wood, {Sarah E} and Chunliang Yang and Oulmann Zerhouni and Robert Zheng and Mark Zrubka",

year = "2018",

month = mar,

day = "1",

doi = "10.1177/1745691618755704",

language = "English",

volume = "13",

pages = "268--294",

journal = "Perspectives on Psychological Science",

issn = "1745-6916",

publisher = "SAGE Publications Ltd",

number = "2",

}

O'Donnell, M, Nelson, LD, Ackermann, E, Aczel, B, Akhtar, A, Aldrovandi, S, Alshaif, N, Andringa, R, Aveyard, M, Babincak, P, Balatekin, N, Baldwin, SA, Banik, G, Baskin, E, Bell, R, Białobrzeska, O, Birt, AR, Boot, WR, Braithwaite, SR, Briggs, JC, Buchner, A, Budd, D, Budzik, K, Bullens, L, Bulley, RL, Cannon, PR, Cantarero, K, Cesario, J, Chambers, S, Chartier, CR, Chekroun, P, Chong, C, Cleeremans, A, Coary, SP, Coulthard, J, Cramwinckel, FM, Denson, TF, Díaz-Lago, M, DiDonato, TE, Drummond, A, Eberlen, J, Ebersbach, T, Edlund, JE, Finnigan, KM, Fisher, J, Frankowska, N, García-Sánchez, E, Golom, FD, Graves, AJ, Greenberg, K, Hanioti, M, Hansen, HA, Harder, JA, Harrell, ER, Hartanto, A, Inzlicht, M, Johnson, DJ, Karpinski, A, Keller, VN, Klein, O, Koppel, L, Krahmer, E, Lantian, A, Larson, MJ, Légal, J-B, Lucas, RE, Lynott, D, Magaldino, CM, Massar, K, McBee, MT, McLatchie, N, Melia, N, Mensink, MC, Mieth, L, Moore-Berg, S, Neeser, G, Newell, BR, Noordewier, MK, Özdogğru, AA, Pantazi, M, Parzuchowski, M, Peters, K, Philipp, MC, Pollmann, MMH, Rentzelas, P, Rodríguez-Bailón, R, Röer, JP, Ropovik, I, Roque, NA, Rueda, C, Rutjens, BT, Sackett, K, Salamon, J, Sánchez-Rodríguez, Á, Saunders, B, Schaafsma, J, Schulte-Mecklenbeck, M, Shanks, DR, Sherman, MF, Steele, KM, Steffens, NK, Sun, J, Susa, KJ, Szaszi, B, Szollosi, A, Tamayo, RM, Tinghög, G, Tong, Y-Y, Tweten, C, Vadillo, MA, Valcarcel, D, Van der Linden, N, van Elk, M, van Harreveld, F, Västfjäll, D, Vazire, S, Verduyn, P, Williams, MN, Willis, GB, Wood, SE, Yang, C, Zerhouni, O, Zheng, R & Zrubka, M 2018, 'Registered Replication Report: Dijksterhuis and van Knippenberg (1998)', Perspectives on Psychological Science, vol. 13, no. 2, pp. 268-294. https://doi.org/10.1177/1745691618755704

TY - JOUR

T1 - Registered Replication Report

T2 - Dijksterhuis and van Knippenberg (1998)

AU - O'Donnell, Michael

AU - Nelson, Leif D

AU - Ackermann, Evi

AU - Aczel, Balazs

AU - Akhtar, Athfah

AU - Aldrovandi, Silvio

AU - Alshaif, Nasseem

AU - Andringa, Ronald

AU - Aveyard, Mark

AU - Babincak, Peter

AU - Balatekin, Nursena

AU - Baldwin, Scott A

AU - Banik, Gabriel

AU - Baskin, Ernest

AU - Bell, Raoul

AU - Białobrzeska, Olga

AU - Birt, Angie R

AU - Boot, Walter R

AU - Braithwaite, Scott R

AU - Briggs, Jessie C

AU - Buchner, Axel

AU - Budd, Desiree

AU - Budzik, Kathryn

AU - Bullens, Lottie

AU - Bulley, Richard L

AU - Cannon, Peter R

AU - Cantarero, Katarzyna

AU - Cesario, Joseph

AU - Chambers, Stephanie

AU - Chartier, Christopher R

AU - Chekroun, Peggy

AU - Chong, Clara

AU - Cleeremans, Axel

AU - Coary, Sean P

AU - Coulthard, Jacob

AU - Cramwinckel, Florien M

AU - Denson, Thomas F

AU - Díaz-Lago, Marcos

AU - DiDonato, Theresa E

AU - Drummond, Aaron

AU - Eberlen, Julia

AU - Ebersbach, Titus

AU - Edlund, John E

AU - Finnigan, Katherine M

AU - Fisher, Justin

AU - Frankowska, Natalia

AU - García-Sánchez, Efraín

AU - Golom, Frank D

AU - Graves, Andrew J

AU - Greenberg, Kevin

AU - Hanioti, Mando

AU - Hansen, Heather A

AU - Harder, Jenna A

AU - Harrell, Erin R

AU - Hartanto, Andree

AU - Inzlicht, Michael

AU - Johnson, David J

AU - Karpinski, Andrew

AU - Keller, Victor N

AU - Klein, Olivier

AU - Koppel, Lina

AU - Krahmer, Emiel

AU - Lantian, Anthony

AU - Larson, Michael J

AU - Légal, Jean-Baptiste

AU - Lucas, Richard E

AU - Lynott, Dermot

AU - Magaldino, Corey M

AU - Massar, Karlijn

AU - McBee, Matthew T

AU - McLatchie, Neil

AU - Melia, Nadhilla

AU - Mensink, Michael C

AU - Mieth, Laura

AU - Moore-Berg, Samantha

AU - Neeser, Geraldine

AU - Newell, Ben R

AU - Noordewier, Marret K

AU - Özdogğru, Asil Ali

AU - Pantazi, Myrto

AU - Parzuchowski, Michał

AU - Peters, Kim

AU - Philipp, Michael C

AU - Pollmann, Monique M H

AU - Rentzelas, Panagiotis

AU - Rodríguez-Bailón, Rosa

AU - Röer, Jan Philipp

AU - Ropovik, Ivan

AU - Roque, Nelson A

AU - Rueda, Carolina

AU - Rutjens, Bastiaan T

AU - Sackett, Katey

AU - Salamon, Janos

AU - Sánchez-Rodríguez, Ángel

AU - Saunders, Blair

AU - Schaafsma, Juliette

AU - Schulte-Mecklenbeck, Michael

AU - Shanks, David R

AU - Sherman, Martin F

AU - Steele, Kenneth M

AU - Steffens, Niklas K

AU - Sun, Jessie

AU - Susa, Kyle J

AU - Szaszi, Barnabas

AU - Szollosi, Aba

AU - Tamayo, Ricardo M

AU - Tinghög, Gustav

AU - Tong, Yuk-Yue

AU - Tweten, Carol

AU - Vadillo, Miguel A

AU - Valcarcel, Deisy

AU - Van der Linden, Nicolas

AU - van Elk, Michiel

AU - van Harreveld, Frenk

AU - Västfjäll, Daniel

AU - Vazire, Simine

AU - Verduyn, Philippe

AU - Williams, Matt N

AU - Willis, Guillermo B

AU - Wood, Sarah E

AU - Yang, Chunliang

AU - Zerhouni, Oulmann

AU - Zheng, Robert

AU - Zrubka, Mark

PY - 2018/3/1

Y1 - 2018/3/1

N2 - Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ("professor") subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ("soccer hooligans"). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the "professor" category and those primed with the "hooligan" category (0.14%) and no moderation by gender.

AB - Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ("professor") subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ("soccer hooligans"). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the "professor" category and those primed with the "hooligan" category (0.14%) and no moderation by gender.

KW - priming

KW - replication

KW - intelligence

KW - CATEGORY ACCESSIBILITY

KW - BEHAVIOR

KW - ACTIVATION

KW - PRIMES

KW - Intelligence

KW - Humans

KW - Male

KW - Prejudice

KW - Social Perception

KW - Female

U2 - 10.1177/1745691618755704

DO - 10.1177/1745691618755704

M3 - Article

C2 - 29463182

SN - 1745-6916

VL - 13

SP - 268

EP - 294

JO - Perspectives on Psychological Science

JF - Perspectives on Psychological Science

IS - 2

ER -