Anna van 't Veer
Assistant professor
- Name
- Dr. A.E. van 't Veer
- Telephone
- +31 71 527 1822
- a.e.van.t.veer@fsw.leidenuniv.nl
- ORCID iD
- 0000-0002-2733-1841
Dr. Anna van ’t Veer is an assistant professor at the Methodology and Statistics unit focusing on responsible research methods.
Profile
I'm an assistant professor at the Methodology and Statistics unit of Psychology, with a focus on advancing responsible scholarship through values, methods, and practices that enhance research(er) integrity and an open equitable culture in science. As a teacher, researcher, and Open Science Community manager I am actively involved in initiatives surrounding open science and scientific integrity, conduct meta-scientific studies in this area, and represent bottom-up experiences in strategy/policy-making.
I've recently developed an educational model to foster a culture of responsible scholarship amongst academic teams (see news item; interview on making mistakes in science). I have acted as an editor at Collabra: Psychology, contributed to the Ethics Committee of the Psychological Science Accelerator (a global lab network), and as member of the Code of Conduct Committee of the Society for Improvement of Psychological Science (SIPS) and national events like the Open Science festival.
Research
In my research, I work on theory and implementation of methodologies and practices that shape responsible scholarship and self-correcting processes within science, such as replication, preregistration, open publising, and collective efforts that are value-driven, collaborative, equitable, and transparent.
A current line of work is focussed on how replication can most efficiently help towards correcting and updating the scientific record. We propose a method to decide which of many original claims in the literature are most valuable to put our replication efforts towards (see theoretical foundation paper, Exploratory Report on feasibility of our proposed method, a checklist for transparent reporting of replication target selection, preprint with a quantitative operationalisation of our selection method and our call to invite open critical discussion on our work in commentaries to be published alongside our paper).
Teaching
I teach courses in the bachelor's programmes of Psychology (Good Research Practices), in the (research) master's programmes of Psychology (e.g., Responsible Research in Practice, fMRI Data and Statistics), and in the Graduate School for Social Sciences (Scientific Conduct for PhD's and Postdocs). Furthermore, I serve on the Research Master Educational Committee of my institute, and as part of the Research Committee I review Training and Supervision plans for our institute's PhD candidates.
Co-supervision of PhD candidates
Community management
As a community manager for the Open Science Community Leiden, I am commited to reaching and engaging researchers and research supporters to learn more, to inspire and enable them to adopt new practices, and to empower and support them to shape the future together, at our university and on a broader scale (see interview). On the national level, I serve as a board member and chair of the board of the Dutch network of Open Science Communities (OSC-NL).
In this role, I also serve on advisory boards, gather and provide input to policy (e.g., to the national open science ambitions), and write grants to accelorate the open science communities through funding dedicated to community management, knowledge exchange, open scholarly publishing (e.g,. modular publishing), and open science events (e.g., the Open Science Retreat).
Grants
- Impulse Open Science Communities-NL (2024), 400k, under review.
- Impulse Open Science Community Leiden (2023), 100k.
- Open Science fund (2023), 50k: Fostering a national Community-led network to accelerate Open Science practices: Foster OSC-NL. https://www.researchequals.com/modules/q5k9-bsxw
- Center for Open Science Replication Grant (2013): “Reproducibility grant proposal: Prescribed optimism, Is it right to be wrong about the future?” (with Bethany Lassetter & Mark J. Brandt). See for the completed replication report: https://osf.io/8u5v2/
Selected Publications
On replication:
- Isager, P. M., van Aert, R. C. M., Bahník, Š., Brandt, M. J., DeSoto, K. A., Giner-Sorolla, R., Krueger, J. I., Perugini, M., Ropovik, I., van 't Veer, A. E., Vranka, M., & Lakens, D. (2021). Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000438
- Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & van 't Veer, A. E. (2013). The replication recipe: What makes for a convincing replication? Journal of Experimental Social Psychology, 50, 217-224 see: https://www.sciencedirect.com/science/article/pii/S0022103113001819
- Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, 6251, 943. aac4716. https://doi.org/10.1126/science.aac4716 see: https://osf.io/447b3
On preregistration:
- Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., van 't Veer, A. E., & Vazire, S. (2019). Preregistation is hard, and worthwhile. Trends in Cognitive Sciences. https://doi.org/10.1016/j.tics.2019.07.009
- van ‘t Veer, A. E., Giner-Sorolla, R. (2016). Pre-registration in Social Psychology—A discussion and suggested template. Journal of Experimental Social Psychology. doi: 10.1016/j.jesp.2016.03.004 see: https://osf.io/sn6by/
About open science / open data:
- Bakk, Z., Boy, J., Mons, B., & van 't Veer, A. E. (2022, October 11). Young Academy Leiden - Summer of Data Diversity podcast. Zenodo. https://doi.org/10.5281/zenodo.7220703
- Armeni, K., Brinkman, L., Carlsson, R., Eerland, A., Fijten, R., Fondberg, R., Heininga, V. E., Heunis, S., Koh, W. Q., Masselink, M., Moran, N., O Baoill, A., Sarafoglou, A., Schettino, A., Schwamm, H., Sjoerds, Z., Teperek, M., van den. Akker, O. R., van ‘t Veer, A. E. & Zurita-Milla, R. (2021). Towards wide-scale adoption of open science practices: The role of open science communities. Science and Public Policy, 48(5), 605-611. https://doi.org/10.1093/scipol/scab039
- van ’t Veer, A. E., Sleegers, W. W. A. (2019). Psychology data from an exploration of the effect of anticipatory stress on disgust vs. non-disgust related moral judgments. Journal of Psychology Data , 7(1), 1. https://doi.org/10.5334/jopd.43
Supporting bottom-up work for culture change, using modular publishing:
- Edited collection of artefacts/outputs from the 2nd edition of the Open Science Retreat, https://www.researchequals.com/collections/mrhg-9r
- Selection of summaries of some of the collaborative work during Open Science Retreat 2024, the Netherlands (#OSR24NL) & list of contributors, https://www.researchequals.com/modules/g6hr-cn36
Assistant professor
- Faculteit der Sociale Wetenschappen
- Instituut Psychologie
- Methodologie & Statistiek
- Isager P. M., Veer A. E. van 't, Freeman Z., Martinovici A., Breemer L., Ravenzwaaij D. van, Liem C.S., Hoekstra R. & Rasti S. (2024), Hackathon proceedings for: Perspectives on Scientific Error–Coordinating Quality Control in Practice. [other].
- Ravenzwaaij D. van, Bakker M., Heesen R., Romero F., Dongen N. van, Cruwell S., Field S.M., Held L., Munafo M.R., Pittelkow M.M., Tiokhin L., Traag V.A., Akker O.R. van den, Veer A.E. van't & Wagenmakers E.J. (2023), Perspectives on scientific error, Royal Society Open Science 10(7): .
- Isager Peder Mortvedt van Aert Robbie C. M. Bahnik Stepan Brandt Mark J. DeSoto K. Andrew Giner-Sorolla Roger Krueger Joachim I Perugini Marco Ropovik Ivan van 't Veer Anna E. Vranka Marek Lakens Daniel (2023), Deciding What to Replicate: A Decision Model for Replication Study Selection Under Resource and Knowledge Constraints, Psychological Methods 28(2): 438-451.
- Isager P.M., Lakens D., Leeuwen T. van & Veer A.E. van 't (2023), Exploring a formal approach to selecting studies for replication: a feasibility study in social neuroscience, Cortex 171: 330-346.
- Isager P.M., Aert R.C.M. van, Bahnik S., Brandt M.J., DeSoto K.A., Giner-Sorolla R., Krueger J.I., Perugini M., Ropovik I., Veer A.E. van 't, Vranka M. & Lakens D. (2023), Deciding what to replicate: a decision model for replication study selection under resource and knowledge constraints, Psychological Methods 28(2): 438-451.
- Pittelkow M.-M., Field S.M., Isager P.M., Veer A.E. van 't, Anderson T., Cole S.N., Dominik T., Giner-Sorolla R., Gok S., Heyman T.D.P., Jekel M., Luke T.J., Mitchell D.B., Peels R., Pendrous R., Sarrazin S., Schauer J.M., Specker E., Tran U.S., Vranka M.A., Wicherts J.M., Yoshimura N., Zwaan R.A. & Ravenzwaaij D. van (2023), The process of replication target selection in psychology: what to consider?, Royal Society Open Science 10(2): .
- Armeni K., Brinkman L., Carlsson R., Eerland A., Fijten R., Fondberg R., Heininga V.E., Heunis S., Koh W.Q., Masselink M., Moran N., Baoill A.Ó, Sarafoglou A., Schettino A., Schwamm H., Sjoerds Z., Teperek M., Akker O.R. van den, Veer A.E. van 't & Zurita-Milla R. (2021), Towards wide-scale adoption of open science practices: the role of open science communities, Science and Public Policy 48(5): 605-611.
- Van den Akker O.R., Weston S., Campbell L., Chopik B., Damian R., Davis-Kean P., Hall A., Kosie J., Kruse E., Olsen J., Ritchie S., Valentine K.D., Van 't Veer A. & Bakker M. (2021), Preregistration of secondary data analysis: a template and tutorial, Meta-Psychology 5: .
- Huijser D.C., Achterberg M., Wierenga L.M., Van 't Veer A.E., Klapwijk E.T., Van Erkel R. & Hettne K. (2020), MRI data sharing guide. Zenodo: Zenodo.
- Botvinik-Nezer R., Holzmeister F., Camerer C.F., Dreber A., Huber J., Johannesson M., Kirchler M., Iwanir R., Mumford J.A., Adcock R.A., Avesani P., Baczkowski B.M., Bajracharya A., Bakst L., Ball S., Barilari M., Bault N., Beaton D., Beitner J., Benoit R.G., Berkers R.M.W.J., Bhanji J.P., Biswal B.B., Bobadilla-Suarez S., Bortolini T., Bottenhorn K.L., Bowring A., Braem S., Brooks H.R., Brudner E.G., Calderon C.B., Camilleri J.A., Castrellon J.J., Cecchetti L., Cieslik E.C., Cole Z.J., Collignon O., Cox R.W., Cunningham W.A., Czoschke S., Dadi K., Davis C.P., Luca A.D., Delgado M.R., Demetriou L., Dennison J.B., X di, Dickie E.W., Dobryakova E., Donnat C.L., Dukart J., Duncan N.W., Durnez J., Eed A., Eickhoff S.B., Erhart A., Fontanesi L., Fricke G.M., Fu S.G., Galvan A., Gau R., Genon S., Glatard T., Glerean E., Goeman J.J., Golowin S.A.E., Gonzalez-Garcia C., Gorgolewski K.J., Grady C.L., Green M.A., Moreira J.F.G., Guest O., Hakimi S., Hamilton J.P., Hancock R., Handjaras G., Harry B.B., Hawco C., Herholz P., Herman G., Heunis S., Hoffstaedter F., Hogeveen J., Holmes S., Hu C.P., Huettel S.A., Hughes M.E., Iacovella V., Iordan A.D., Isager P.M., Isik A.I., Jahn A., Johnson M.R., Johnstone T., Joseph M.J.E., Juliano A.C., Kable J.W., Kassinopoulos M., Koba C., Kong X.Z., Koscik T.R., Kucukboyaci N.E., Kuhl B.A., Kupek S., Laird A.R., Lamm C., Langner R., Lauharatanahirun N., Lee H.M., Lee S.G., Leemans A., Leo A., Lesage E., Li F.R., Li M.Y.C., Lim P.C., Lintz E.N., Liphardt S.W., Vermeer A.L.B., Love B.C., Mack M.L., Malpica N., Marins T., Maumet C., McDonald K., McGuire J.T., Melero H., Leal A.M.S., Meyer B., Meyer K.N., Mihai G., Mitsis G.D., Moll J., Nielson D.M., Nilsonne G., Notter M.P., Olivetti E., Onicas A.I., Papale P., Patil K.R., Peelle J.E., Perez A., Pischedda D., Poline J.B., Prystauka Y., Ray S., Reuter-Lorenz P.A., Reynolds R.C., Ricciardi E., Rieck J.R., Rodriguez-Thompson A.M., Romyn A., Salo T., Samanez-Larkin G.R., Sanz-Morales E., Schlichting M.L., Schultz D.H., Shen Q., Sheridan M.A., Silvers J.A., Skagerlund K., Smith A., Smith D.V., Sokol-Hessner P., Steinkamp S.R., Tashjian S.M., Thirion B., Thorp J.N., Tinghog G., Tisdall L., Tompson S.H., Toro-Serey C., Tresols J.J.T., Tozzi L., Truong V., Turella L., Veer A.E. van 't, Verguts T., Vettel J.M., Vijayarajah S., Vo K., Wall M.B., Weeda W.D., Weis S., White D.J., Wisniewski D., Xifra-Porxas A., Yearling E.A., Yoon S., Yuan R., Yuen K.S.L., Zhang L., Zhang X., Zosky J.E., Nichols T.E., Poldrack R.A. & Schonberg T. (2020), Variability in the analysis of a single neuroimaging dataset by many teams, Nature 582: 84-88.
- Isager P.M., Van Aert R.C.M., Bahník S., Brandt M.J., DeSoto K.A., Giner-Sorolla R. Krueger J., Perugini M., Ropovik I., Veer A.E. van 't, Vranka M.A. & Lakens D. (2020), Deciding what to replicate: a formal definition of “replication value” and a decision model for replication study selection. Center for Open Science (MetaArXiv preprints). [other].
- Botvinik-Nezer R., Holzmeister F., Camerer C.F., Dreber A., Huber J., Johannesson M., Kirchler M., Iwanir R., Mumford J.A., Adcock R.A., Avesani P., Baczkowski B.M., Bajracharya A., Bakst L., Ball S., Barilari M., Bault N., Beaton D., Beitner J., Benoit R.G., Berkers R.M.W.J., Bhanji J.P., Biswal B.B., Bobadilla-Suarez S., Bortolini T., Bottenhorn K.L., Bowring A., Braem S., Brooks H.R., Brudner E.G., Calderon C.B., Camilleri J.A., Castrellon J.J., Cecchetti L., Cieslik E.C., Cole Z.J., Collignon O., Cox R.W., Cunningham W.A., Czoschke S., Dadi K., Davis C.P., Luca A.D., Delgado M.R., Demetriou L., Dennison J.B., Di X., Dickie E.W., Dobryakova E., Donnat C.L., Dukart J., Duncan N.W., Durnez J., Eed A., Eickhoff S.B., Erhart A., Fontanesi L., Fricke G.M., Fu S.G., Galvan A., Gau R., Genon S., Glatard T., Glerean E., Goeman J.J., Golowin S.A.E., Gonzalez-Garcia C., Gorgolewski K.J., Grady C.L., Green M.A., Moreira J.F.G., Guest O., Hakimi S., Hamilton J.P., Hancock R., Handjaras G., Harry B.B., Hawco C., Herholz P., Herman G., Heunis S., Hoffstaedter F., Hogeveen J., Holmes S., Hu C.P., Huettel S.A., Hughes M.E., Iacovella V., Iordan A.D., Isager P.M., Isik A.I., Jahn A., Johnson M.R., Johnstone T., Joseph M.J.E., Juliano A.C., Kable J.W., Kassinopoulos M., Koba C., Kong X.Z., Koscik T.R., Kucukboyaci N.E., Kuhl B.A., Kupek S., Laird A.R., Lamm C., Langner R., Lauharatanahirun N., Lee H.M., Lee S.G., Leemans A., Leo A., Lesage E., Li F.R., Li M.Y.C., Lim P.C., Lintz E.N., Liphardt S.W., Vermeer A.L.B., Love B.C., Mack M.L., Malpica N., Marins T., Maumet C., McDonald K., McGuire J.T., Melero H., Leal A.M.S., Meyer B., Meyer K.N., Mihai G., Mitsis G.D., Moll J., Nielson D.M., Nilsonne G., Notter M.P., Olivetti E., Onicas A.I., Papale P., Patil K.R., Peelle J.E., Perez A., Pischedda D., Poline J.B., Prystauka Y., Ray S., Reuter-Lorenz P.A., Reynolds R.C., Ricciardi E., Rieck J.R., Rodriguez-Thompson A.M., Romyn A., Salo T., Samanez-Larkin G.R., Sanz-Morales E., Schlichting M.L., Schultz D.H., Shen Q., Sheridan M.A., Silvers J.A., Skagerlund K., Smith A., Smith D.V., Sokol-Hessner P., Steinkamp S.R., Tashjian S.M., Thirion B., Thorp J.N., Tinghog G., Tisdall L., Tompson S.H., Toro-Serey C., Tresols J.J.T., Tozzi L., Truong V., Turella L., Veer A.E. van 't, Verguts T., Vettel J.M., Vijayarajah S., Vo K., Wall M.B., Weeda W.D., Weis S., White D.J., Wisniewski D., Xifra-Porxas A., Yearling E.A., Yoon S., Yuan R., Yuen K.S.L., Zhang L., Zhang X., Zosky J.E., Nichols T.E., Poldrack R.A. & Schonberg T. (2020), Variability in the analysis of a single neuroimaging dataset by many teams, Nature 582(7810): 84-88.
- Nosek B.A., Beck E.D., Campbell L., Flake J.K., Hardwicke T.E., Mellor D.T., Veer A. van 't & Vazire A. (2019), Preregistration is hard, and worthwhile, PsyArXiv : .
- Veer A.E. van 't & Sleegers W.W.A. (2019), Psychology Data from an Exploration of the Effect of Anticipatory Stress on Disgust vs. Non-Disgust Related Moral Judgments, Journal of Open Psychology Data 7(1): e1.
- Veer A.E. van 't, Thijssen S., Witteman J., IJzendoorn M.H. van & Bakermans-Kranenburg M.J. (2019), Exploring the neural basis for paternal protection: an investigation of the neural response to infants in danger, Social Cognitive and Affective Neuroscience 14(4): 447-457.
- Alyousefi-Van Dijk K., Veer A.E. van 't, Meijer W.M., Lotz A.M., Rijlaarsdam J., Witteman J. & Bakermans-Kranenburg M.J. (2019), Vasopressin Differentially Affects Handgrip Force of Expectant Fathers in Reaction to Own and Unknown Infant Faces, Frontiers in Behavioral Neuroscience 13: e105.
- Nosek B.A., Beck E.D., Campbell L., Flake J.K., Hardwicke T.E., Mellor D.T., Veer A.E. van 't & Vazire S. (2019), Preregistration is hard, and worthwhile, Trends in Cognitive Sciences 23(10): 815-818.
- Thijssen S., Van 't Veer A.E., Witteman J., Meijer W.M., Van IJzendoorn M.H. & Bakermans-Kranenburg M.J. (2018), Effects of vasopressin on neural processing of infant crying in expectant fathers, Hormones and Behavior 103: 19-27.
- Klein R.A., Vianello M., Hasselman F., Adams B.G., Adams R.B., Alper S., Aveyard M., Axt J.R., BabalolaM.T., Bahník S., Batra R., Berkics M., Bernstein M.J., Berry D.R., Bialobrzeska O., Binan E.D., Bocian K., Brandt M.J., Busching R., Rédei A.C., Cai H., Cambier F., Cantarero K., Carmichael C.L., Ceric F., Chandler J., Chang J.H., Chatard A., Chen E.E., Cheong W., Cicero D.C., Coen S., Coleman J.A., Collisson B., Conway M.A., Corker K.S., Curran P.G., Cushman F., Dagona Z.K., Dalgar L., Rosa A.D., Davis W.E., De Bruijn M., De Schutter L., Devos T., De Vries M., Dog˘ulu C., Dozo N., Dukes K.N., Dunham Y., Durrhe K., Ebersole C.R., Edlund J.E., Eller A., English A.S., Finck C., Frankowska N., Freyre M.A., Friedman M., Galliani E.M., Gandi J.C., Ghoshal T., Giessner S.R., Gill T., Gnambs T., Gómez A., González R., Graham J., Grahe J.E., Grahek I., Green E.G.T., Hai K., Haigh M., Haines E.L., Hall M.P., Heffernan M.E., Hicks J.A., Houdek P., Huntsinger J.R., Huynh Ho Phi, IJzerman H., Inbar Y., Innes-Ker A.H., Jiménez-Leal W., Melissa-Sue John, Joy-Gaba J., Kamilog˘lu R., Kappes H., Karabati S., Karick H., Keller V., Kende A., Kervyn N., Kneževic G., Kovacs C., Krueger L.E., Kurapov G., Kurtz J., Lakens D., Lazarevic L.B., Levitan C.A., Lewis Jr. N.A.L., Samuel Lins, Nikolette Lipse, Losee J., Esther Maassen, Maitner A.T., Winfrida Malingumu, Mallett R.K., Marotta S.A., Međedović J., Mena Pacheco F., Milfont T.L., Morris W.L., Murphy S., Andriy Myachykov, Nick Neave & Neijenhuijs K. (2018), Many Labs 2: Investigating Variation in Replicability Across Samples and Settings, Advances in Methods and Practices in Psychological Science 1(4): 443-490.
- Bouwmeester S., Verkoeijen P.P.J.L., Aczel B., Barbosa F., Bègue L., Brañas-Garza P., Chmura T.G.H., Cornelissen G., Døssing F.S., Espín A.M., Evans A.M., Ferreira-Santos F., Fiedler S., Flegr J., Ghaffari M., Glöckner A., Goeschl T., Guo L., Hauser O.P., Hernan-Gonzalez R., Herrero A., Horne Z., Houdek P., Johannesson M., Koppe L.I., Kujal P., Laine T., Lohse J., Martins E.C., Mauro C., Mischkowski D., Mukherjee S., Myrseth K.O.R., Navarro-Martínez D., Neal T.M.S., Novakova J., Pagà R., Paiva T.O., Palfi B., Piovesan M., Rahal R.M., Salomon E., Srinivasan N., Srivastava A., Szaszi B., Szollosi A., Thor K.O., Tinghög G., Trueblood J.S., Bavel J.S. van, Veer A.E. van ‘t, Västfjäll D., Warner M., Wengström E., Wills J. & Wollbrant C.E. (2017), Registered Replication Report: Rand, Greene & Nowak (2012), Psychological Science 12(3): 527-542.
- Van 't Veer A.E. & Giner-Sorolla R. (2016), Pre-registration in social psychology-A discussion and suggested template, Journal of Experimental Social Psychology 67: 2-12.
- Veer A.E. van 't & Open Science Collaboration (2015), Estimating the reproducibility of psychological science, Science 349(6251): .
- Brandt M.J., IJzerman H., Dijksterhuis A., Farach F.J., Geller J., Giner-Sorolla R., Grange J.A., Perugini M., Spies J.R. & Van 't Veer A.E. (2014), The Replication Recipe: What makes for a convincing replication?, Journal of Experimental Social Psychology : .
- Bestuurslid