The MZES Open Social Science Conference 2019 is over. 80 participants from all world continents (except Oceania) have participated, discussing and practicing „New Standards in Research Transparency and Reproducibility“.
The entire conference was live-streamed, sparking vivid debates on twitter with several hundred tweets using the #ossc19 hashtag. If you have missed the conference, you can all watch all keynote speeches, presentations and discussions on YouTube.
After the conference, I gave two interviews to German Public radio on asseing and improving the credibility on social science research:
When you talk to your spouse or friends, what do you talk about? Talk has political ramifications. According to moral psychologist Jonathan Haidt, human beings tend to disregard most information that contradict our pre-existing attitudes but social cues are the single influence with the potential to elicit a lasting change of mind.
However, although communication with friends and neighbours has the potential of transmitting new information and changing our minds, this potential will not materialize if we only converse with like-minded people. Considering ongoing debates about filter-bubbles and echo-chambers, this seems to be what is happening.
The Campaign Panel of the German Longitudinal Election Study allows shedding some light on the personal communication of ordinary citizens. In nine survey waves, respondents were repeatedly asked about the political conversations they have had in the past week: Whether they had any and with whom. Naturally, these measures are self-reported and therefore imperfect. Having these caveats in mind, here are some basic findings of research in collaboration with Lea Gärtner.
First, individuals differ strongly in whether and how often they talk about politics. Figure 1 shows the distribution of self-reported frequency of political conversations over the past week. Some people never touched upon this issue while a handful of people talked about politics every day.
We also investigated whether citizens only talk with like-minded people. In this case, „like-minded“ is operationalized as talking to a person who the respondent perceives as having the same vote intention. Specifically, we calculated the relative homogeneity of a person’s discussion network where „1“ denotes a respondent’s discussion network is not biased towards her own party. If the respondent intends to vote for CDU and the CDU polls at 30% then the discussion network is unbiased if it consists of 30% CDU voters. However, if 60% of the respondent’s conversation partners intend to vote CDU, then the respondent apparently prefers like-minded conversation partners and the coefficient would be „2“.
Figure 2 provides three fundamental insights. First, citizens do prefer like-minded conversation partners. Regardless of party preference, the average citizen has twice as many conversation partners with identical vote preferences in her discussion network than we would have expected if discussion networks were unbiased. Second, the homogeneity of discussion networks does not increase when the election draws closer. Third, voters of AfD and (surprisingly?) voters of the Green Party have the strongest inclination to talk to like-minded people.
Finally, we should note that while we observe a bias towards congeniality, most of the respondents do not live in filter-bubbles. Although people prefer talking with like-minded others, other analyses show that most people also do talk to citizens with other points of view.
For several months or years now I have been learning and thinking about the credibility of social scientific research. In the wake of this progress, I thoroughly revised my beliefs about the evidential value of published research findings. When I was conducting my master’s studies and was reading a scientific study published in a scientific journal by full-grown scientists, I believed and never questioned that was I was reading must be true. I knew that some studies were better than others and that scientists occasionally err. Still, when I heard that one of those full-grown scientists claimed that „most published research findings are false“ I was puzzled.
Years later I am being involved in organizing the MZES Open Social Science Conference 2019, which brings together scholars from around the globe to discuss research credibility and what we can do improve it. Now, I have penned a commentary on Open Science with a particular focus on political science. Rather than being fatalistic, the commentary hopes to be analytic and constructive. The article is a review of the existing meta-scientific literature on the credibility of quantitative findings in political science. At best, the paper will serve as a primer for those who are not yet versed in these discussions and it will contribute to the ongoing debates about research credibility.
The article is now published online at Springer PVS and will be published in print in the Issue 1/2019 of the German Political Science Quarterly.
The IKMZ (Institut für Kommunikationswissenschaft und Medienforschung) invited me for a talk on the credibility of social scientific research. The presentation sparked an engaged debate about the incentive structures in academia and about what we can do to better align individual researcher rationality with the collective good of reliable research.
For which party have citizens voted back in 2013 who cast their ballot for the AfD in 2017? Were these voters AfD-adherents all along or did they abstain at the previous election or were they even voters of leftist parties at the previous elections?
In survey research, there are two ways of finding out: First, you can ask citizens after the federal elections 2017 about their vote choice at the recent election and then you also ask them to remember their vote choice at the previous election. The problem is that human beings are bad at remembering things. Just as we forget where we put our keys (only 5 minutes ago!) we also forget who we voted for four years ago. We are very bad at remembering. Research by Ruth Dassonneville shows that only half of those voters who have actually switched party choices between elections do remember that they had switched.
Therefore, the better option is having asked those voters already in 2013 about their vote choices and then to ask them again right after the elections in 2017. This requires tracing respondents for a long period of time which means a lot of survey administration (and comes with other caveats, such as panel attrition). However, in addition to the accurate recall, such longitudinal survey data provide so many other benefits. For each individual, you can trace how his or his opinions about Merkel and immigrants (and how the personality or individual sense of efficacy changed) over all these years.
Such a longitudinal dataset is now available for the German Federal Elections 2013 and 2017.
Respondents surveyed 18 times
before/after German federal elections 2013 & 2017
about 5,000 substantive variables
free, open and well documented (German only at the moment)
With my amazing colleagues Nate Breznau and Eike Mark Rinke, I have the pleasure to organize a conference on a topic that is of personal importance for me. It concerns the practices and politics of doing research and is about establishing new standards of reproducibility and transparency in social science research.
Here is our call for papers. Please forward it to friends and colleagues and consider participating. Feel free to contact me with any questions you might have.
CfP — MZES Open Social Science Conference 2019: Practicing New Standards in Transparency and Reproducibility
This conference is a forum for practicing and discussing credibility, transparency and replicability in the social sciences.
About a decade ago, John Ioannidis claimed that “most published research findings are false”. While seeming outrageous at the time, a growing body of meta-scientific research in the behavioral and social sciences substantiated this claim, causing uncertainty about the trustworthiness of published scientific findings. We believe that threats to the validity of published findings in the social sciences are widespread and systemic. Therefore, this conference promotes introspection about the current state of social science research and exchange on the opportunities for institutional and methodological improvement in the future.
The conference is supported by the Berkeley Initiative for Transparency in the Social Sciences (BITSS) and will take place from 25-27 January 2019 in Mannheim, Germany.
Keynote speakersJeremy Freese (Stanford University)Thomas König (APSR, University of Mannheim)Arthur Lupia (OSF, University of Michigan)Julia Rohrer (100% CI, Leipzig University)
Participate in the conference
Give a talk: We call for researchers to advance discussion, debate, literature synthesis, or methods in open social science. We welcome methodological advances, e.g., p-curve analysis, systematic reviews, pre-analysis planning, and replication. We welcome general research findings that apply best practices of open science while conducting the research – Abstract submission DL: 22 August 2018 Read more
MZES-GESIS Pre-Registration Challenge: We call for researchers to participate in a competition to win funding or survey time for the most innovative and rigorous pre-registration plan for a social science study. – Abstract submission DL: 22 August 2018 Read more
OSSC19 Crowdsourced Replication Initiative: We call for researchers to replicate and expand a previously published cross-national macro-comparative study. The goal is to explore and develop crowdsourcing methods and generate research surpassing what a single researcher could achieve. The replication comes from the field of immigration and social policy, but we encourage social science researchers of all disciplines and levels to participate. All full participants will be co-authors on the final paper. – Registration DL: 27 July 2018 Read more
Participate as a guest in Mannheim during the conference or during the subsequent Open Science Workshop, offered in collaboration with the Berkeley Initiative for Transparency in the Social Sciences (BITSS). Or use the live stream online.
LSE Business Review has published an article of ours (Jungherr, Mader, Schoen, Wuttke) summarizing the paper „Context-driven attitude formation: the difference between supporting free trade in the abstract and supporting specific trade agreements“, published in Review of International Political Economy.
Considering current discussions about the eminent trade war between the US and Europe and related discussions about „TTIP light“, we hope this piece has some value for explaining public support and opposition towards free trade and specific free trade agreements:
Why some people value political engagement and even find pleasure in engaging with politics while others hardly bother about the political domain, is a crucial question for the functioning of democratic societies. In my dissertation, I investigate what we can learn from motivation studies (largely neglected by political scientists) to understand the roots of political engagement. My contribution is to investigate the nonpolitical origins of political engagement in early childhood experiences, more specifically, the level of need satisfaction provided in the parental home during socialization’s formative phase.
I had the opportunity to write about these thoughts and the findings from two analyses of longitudinal cohort data at the ISSP blog. Please feel free to provide any comments and criticism.
Open Science refers to a broad, transdisciplinary movement aiming to open up research processes to promote the integrity, reproducibility and value of scholarly work, in part as a response to pressing problems facing science. This movement thoroughly changed the field of psychology, and clearly a similar fundamental rearrangement is coming in all social sciences, for example political science, sociology, and communication.
With Nate Breznau and Eike Rinke, I have the pleasure of organizing a meta-scientific conference, which discusses, advances and pushes for Open Science in research on politics and society.
Stream 1: Advancing Open Science: Problems in and solutions for research on politics and society
Stream 2: Doing Open Science: Applications in research on politics on society
Stream 3: Debating Open Science: Perspectives on the State of Social Science
Crowdsourced replication effort
BITSS Workshop on reproducible research
Key note speakers
Jeremy Freese (Stanford University)
Thomas König (APSR, University of Mannheim)
Arthur Lupia (OSF, University of Michigan)
Julia Rohrer (100% CI, Uni Leipzig)
How to participate
In June, we will distribute the CfP and information on the crowdsourced replication effort and the pre-registration challenge.
The state election in Lower Saxony in October 2017 walked in the shadows of the preceding election on the federal level. In light of both campaigns’ temporal proximity, this study investigates the development of political attitudes towards the federal and the state level and their relative influence on voter behavior in Lower Saxony. We make use of a multi-wave panel survey of 1,346 eligible voters in Lower Saxony, which was carried out in the framework of the German Longitudinal Election Study (GLES). Cross-sectional and longitudinal analyses show that a significant minority of respondents based their voting decision in the state election on state-specific considerations. State-specific attitudes varied strongly and to a large extent independently of attitudes towards parties and politicians at the federal level and went hand in hand with changes in voting intentions. The Lower Saxony SPD, in particular, was able to promote the popularity of its leading candidate, thereby leaving behind the CDU at the ballot boxes. [ZParl, vol. 49 (2018), no. 1, pp. 22 – 39]
Ein Umschwung in den letzten Wochen des Landtagswahlkampfes: Befunde einer mehrwelligen Wiederholungsbefragung zur niedersächsischen Landtagswahl 2017
Die niedersächsische Landtagswahl im Oktober 2017 fand im Schatten der vorhergehenden Bundestagswahl statt. Vor dem Hintergrund der zeitlichen Nähe beider Wahlgänge untersucht dieser Aufsatz die Entwicklung bundes- und landesbezogener Einstellungen im Wahlkampfverlauf sowie deren Einfluss auf das Wählerverhalten in Niedersachsen. Eine mehrwellige Wiederholungsbefragung von 1.346 niedersächsischen Wahlberechtigten, die im Rahmen der German Longitudinal Election Study (GLES) durchgeführt wurde, dient als Grundlage der Untersuchung. In quer- und längsschnittlichen Analysen wird gezeigt, dass eine bedeutende Minderheit der Befragten den Wahlentscheidungen auf der Landesebene ebenenspezifische Erwägungen zu Grunde legt. Landesbezogene Einstellungen waren einer von der Bundesebene weitgehend unabhängigen Wahlkampfdynamik unterworfen, die die Wahlabsichten des Elektorats beeinflusst zu haben scheinen. So konnte gerade die niedersächsische SPD die Popularität ihres Spitzenkandidaten in den letzten Wahlkampfwochen steigern und dadurch die CDU in einem Schlussspurt als stärkste Kraft ablösen. [ZParl, 49. Jg. (2018), H. 1, S. 22 – 39]