{"id":211,"date":"2025-07-21T12:45:00","date_gmt":"2025-07-21T10:45:00","guid":{"rendered":"http:\/\/ilonalipp.at\/?p=211"},"modified":"2025-09-14T12:47:45","modified_gmt":"2025-09-14T10:47:45","slug":"thoughts-on-research-excellence-part-2-from-ideal-to-practice-supporting-excellent-research","status":"publish","type":"post","link":"https:\/\/ilonalipp.de\/de\/2025\/07\/21\/thoughts-on-research-excellence-part-2-from-ideal-to-practice-supporting-excellent-research\/","title":{"rendered":"Thoughts on Research Excellence &#8211; Part 2: From Ideal to Practice: Supporting Excellent Research"},"content":{"rendered":"<p>In the\u00a0<a href=\"https:\/\/ilonalipp.de\/de\/blog\/thoughts-on-research-excellence-part-1\/\">previous post<\/a>, I discussed how research \u201cexcellence\u201d is often defined by proxies such as publication count and grant income. These measures have emerged historically, but are not based on a shared understanding of what excellent research actually is. I reviewed how the current operationalisation of research excellence can inadvertently lead to bad research practices. In this post, I want to offer a working definition of excellent research \u2014 and address what it takes to facilitate it.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Defining Excellent Research<\/strong><\/h3>\n\n\n\n<p>When I think about the characteristics of excellent research, the following aspects come to mind:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>It has impact on the field, by providing reliable and helpful insights or methods.<\/li>\n\n\n\n<li>It adds to humanity\u2019s knowledge base and understanding of the world.<\/li>\n\n\n\n<li>It has long-term impact on society by contributing to practical solutions.<\/li>\n\n\n\n<li>It uses established, validated methods that consider previous work.<\/li>\n\n\n\n<li>It is innovative by bringing in new ideas, while also replicating and strengthening established findings.<\/li>\n\n\n\n<li>It is thoroughly conducted and transparently reported to allow replication.<\/li>\n\n\n\n<li>It applies interdisciplinary approaches, combining perspectives and methods to get a more holistic understanding of the problem at hand.<\/li>\n\n\n\n<li>It is conducted in well-functioning teams.<\/li>\n<\/ul>\n\n\n\n<p>Some of these criteria are assessed by funders and journals, others are largely ignored. This list may not be exhaustive, but it is a useful starting point for thinking about how to support excellent research. It is my list though. So who decides what criteria matter? Can each researcher or institution define excellence for themselves, or do we need some shared foundation? Is it part of \u201cacademic freedom\u201d to come up with your own criteria of good research? These are difficult philosophical questions.\u00a0<\/p>\n\n\n\n<p>To approach this conundrum pragmatically, let us return to the roots of science and ask what it is the motivation and purpose of science. One attempt to define a framework for thinking about this was made by sociologist\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Robert_K._Merton\">Robert K. Merton<\/a>. He proposed four core norms of science, distinguishing \u201creal\u201d science from what he called \u201canti-science\u201d, which includes \u201cscience\u201d done by authoritarian regimes like during the NS period in Germany.<\/p>\n\n\n\n<p>According to Merton, real science is based on the strive towards (see&nbsp;<a href=\"https:\/\/revistas.ufpr.br\/novation\/article\/view\/95874\">von Schomberg, 2024<\/a>):<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Communism<\/strong>: Scientific knowledge should be created and shared collectively (#OpenScience).<\/li>\n\n\n\n<li><strong>Universalism<\/strong>: Quality assessment should be independent of the researcher\u2019s identity or status.<\/li>\n\n\n\n<li><strong>Disinterestedness<\/strong>: The primary motivation should be advancing knowledge, not personal gain.<\/li>\n\n\n\n<li><strong>Organised scepticism<\/strong>: Claims must be critically scrutinised and supported by evidence before being accepted.<\/li>\n<\/ul>\n\n\n\n<p>I speculate that if you showed this list to the science-affine general public, most would agree that science should be done this way \u2014 and likely assume that it is done this way. But if you have experience with the current academic system, neither is knowledge created nor shared collectively, and a researcher\u2019s affiliation is strongly relevant for their credibility. The idea of \u201cdisinterestedness\u201d may also seem completely at odds with how academic careers are structured. To be able to advance knowledge in the long run, you first need to advance your career. And once you are in a permanent academic position, you spend much more time on administration, management and securing funds than doing research yourself. As a result, the motivation to publish papers is often not to share meaningful insights with the community, but simply to add another item to your CV. In my career, I have rarely heard,\u00a0<em>\u201cI found something very useful \u2014 I want to write a paper\u201d<\/em>, but I have often heard,\u00a0<em>\u201cI need to write a paper \u2014 so I have to come up with something.\u201d<\/em>\u00a0So is Merton too idealistic or outdated, or has something gone seriously wrong in how we have come to organise science? I suppose, if you have read my last blog post, you already know where I stand on that. So what can we do?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What Does It Take to Do Excellent Research?<\/strong><\/h3>\n\n\n\n<p>The crucial question is: under what conditions can people actually uphold the scientific values and do excellent work? Let us assume for now that excellent research fulfils the criteria I listed above and Merton\u2019s standards. Then it becomes clear that doing excellent research is difficult. It requires more than just funding. It relies on infrastructure, skilled and motivated people, and an environment that fosters collaboration (especially across disciplines) and openness. A constructive\u00a0<a href=\"https:\/\/osf.io\/kruhn_v1\">error culture<\/a>\u00a0is also important, since identifying and correcting mistakes is a central part of the scientific progress. That includes protecting junior researchers from retaliation when raising concerns, and ensuring that PIs are not overloaded with administrative duties that undermine time for critical reflection and team management.<\/p>\n\n\n\n<p>In the following, I provide some thoughts what individuals, teams, institutions and technology can do to contribute to more excellence in academic research.<br><br><strong>Individuals: Staying Grounded in Your Ideals<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Doing excellent research starts with\u00a0<strong>knowing what drives you<\/strong>. Take time to reflect on why you entered academia in the first place \u2014 maybe it was curiosity, a desire to solve interesting problems, or the ambition to make the world a better place. Your true motivations can easily get lost under the constant pressure to perform. Reconnecting with them can help you stay motivated and set your own agenda instead of being steered entirely by external incentives.<br><\/li>\n\n\n\n<li>To stay true to your own agenda, it is important to\u00a0<strong>define your own boundaries<\/strong>. Not all common practices in academia are acceptable just because they are widespread. Reflecting on your values allows you to decide what you are \u2014 and are not \u2014 willing to participate in. Although good scientific practice is codified in guidelines, disciplinary norms and \u201cacademic freedom\u201d often normalise bad practices or create grey zones. The system is meant to be self-corrective, and as you are part of the system, that means\u00a0<strong>you also carry responsibility<\/strong>: through your research practices, your peer reviews, and reporting mechanisms.<br><\/li>\n\n\n\n<li>Taking responsibility for sustained research quality is not easy. In practical terms, taking responsibility means reporting and correcting your own mistakes and addressing questionable behaviours that you observe in others. Often, these are not a result of bad intentions. Therefore, you can try to do that in a\u00a0<strong>constructive and non-accusative way<\/strong>, by framing it in an open-minded manner, distinguishing your observations from your interpretations. An example of such wording is: \u201cI noticed that when you showed your results in a lab meeting, you had looked at five different outcome measures, but in the manuscript draft only the one outcome measure, for which you found a statistically significant effect, is mentioned. This gives me the impression you are prioritising a clean story over transparency. I understand that you want to keep the paper as simple as possible, at the same time, I do not feel comfortable intentionally leaving out such important information and results, as this may mislead the research community. Shall we brainstorm together how we can include the other measures without overcomplicating the paper?\u201d<br><\/li>\n\n\n\n<li>Even when done carefully, speaking up or pushing back against problematic norms can isolate you or even put your career at risk. But it can also prompt others to rethink their own behaviour.\u00a0<strong>Confidence\u00a0<\/strong>in doing this often comes from clarity about your values and boundaries. That is where imposter beliefs can get in the way \u2014 the idea that others are more competent and know better. Identifying imposter beliefs, understanding where these come from, and actively doing reality checks \u2013 for example by talking to peers and mentors &#8211; can help staying confident and firm. The wider scientific community has great people, so go look for like-minded colleagues also outside your own institution. Especially sub-communities focused on open science can be a valuable place to find peers and mutual support.<br><\/li>\n\n\n\n<li><strong>Choosing teams and supervisors who share your values<\/strong>\u00a0is a more subtle but effective way to create alignment. During job interviews, ask questions to evaluate whether the employer can provide the conditions that you need in order to do your research in the best possible manner. Look for PIs and groups that are transparent, collaborative, and committed to quality. A good way to find out about the atmosphere in a research group is to reach out to people who work or previously have worked in the group for an informal chat.<br><\/li>\n\n\n\n<li>Finally, you can become a role model. Creating useful resources for your community can help building a\u00a0<strong>profile as a high quality researcher<\/strong>. Sharing methods, workflows, and data builds trust and shows rigour. Rigorously conducted research that challenges mainstream ideas is highly valuable and can give you broad visibility as an innovative researcher. But even without news headline worthy outcomes, producing resources that are informative and helpful for the research field is appreciated, feels good and can be strongly sold in your next application.<\/li>\n<\/ul>\n\n\n\n<p><br><strong>Teams: Building Culture and Collaboration<br><br><\/strong>Even though the stereotype of the ingenious and antisocial scientist is widespread, excellent science is really a\u00a0<strong>team sport<\/strong>. The combination of interdisciplinarity and high quality standards across domains cannot be fulfilled by a single person. In reality, however, many research groups function as loosely connected individuals. The competitive academic system with its focus on individual accomplishments and a seemingly endless \u201cresearcher in training\u201d phase does simply not support the establishment of well functioning, efficient, long term research teams.\u00a0<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>To counteract, research groups can proactively try to\u00a0<strong>incorporate collaborative practices<\/strong>\u00a0in their daily work. Creating structured formats \u2014 like brainstorming sessions, code review or hackathons \u2014 can help to use the potential of collective intelligence, find errors more quickly, and use resources more effectively by reducing uncoordinated parallel work. These formats also help to stay motivated, especially those who do enjoy working in teams.<br><\/li>\n\n\n\n<li>A constructive research culture requires space for disagreement without hostility. The principle \u201c<strong>be hard on the problem, soft on the person<\/strong>\u201d is a helpful guide (see\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Getting_to_Yes\">Harvard principles for negotiation<\/a>). In academia, we need space for critical, even intense debates about methods and interpretation \u2014 but this must go hand-in-hand with respect and psychological safety. As a researcher, you should actually be pleased being challenged and contradicted, as this may bring new perspectives and opportunities to refine your theories or the communication strategies of your ideas. However, when valid intellectual challenges are framed as personal attacks \u2014 or come with them \u2014 it can be difficult to accept the critique or engage with it constructively. There are some principles for communication, such as the concept of\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Nonviolent_Communication\">nonviolent communication<\/a>\u00a0by Marshall Rosenberg, that are a good framework for understanding and fostering a constructive research culture.\u00a0<br><\/li>\n\n\n\n<li>Blocking time in your calendar to\u00a0<strong>reflect on how you work<\/strong>\u00a0(not just what you are working on) is not only helpful for individuals, but also for research groups. In my experience, work meetings in academia are largely technical and rarely focus on other topics. With constant deadlines and pressure, it can be challenging to make time for it. A good opportunity, however, are retreat-like events that are often organised by research groups. Use this valuable time together not only to discuss research progress, but also to reflect on shared goals, challenges, organisation, and communication structures. There are many interactive formats that facilitate such discussions and can provide invaluable insights at the same time as being fun and contributing to team spirit. If you do not have time to think or are unsure how to organise retreats effectively, you can get external help from people like me.<\/li>\n<\/ul>\n\n\n\n<p><strong>Institutions: Aligning Structures with Scientific Integrity<\/strong><\/p>\n\n\n\n<p>Institutions help shape the environment in which researchers operate. If an institution wants to foster truly excellent research, they need to emphasise their commitment to quality and create conditions that support it \u2014 structurally and operationally.\u00a0<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>This starts with\u00a0<strong>rethinking hiring and evaluation<\/strong>: create procedures for selecting candidates not just for their publication record, but for how the underlying research was done, and for their leadership and project management skills as well as their ability to support collaborative science. This also includes recognising practices like contributing valuable data and tools to the research community.<br><\/li>\n\n\n\n<li>PIs, such as professors and group leaders, have management positions. Institutions should require their managers to continuously develop their\u00a0<strong>leadership skills<\/strong>. Nobody is born with the skills for how to run an effective team, develop lab-specific codes of conduct, and deal with challenging situations. And institutions should not be fooled by the argument of \u201cacademic freedom\u201d (Wissenschaftsfreiheit). This freedom refers to choosing the scientific topic to study and how to do the research, it does not justify disregarding standards for scientific integrity and responsible management.<br><\/li>\n\n\n\n<li>Thorough research takes time and often comes with extra effort. What institutions can do to enable that right now is twofold. On one hand to optimise processes to reduce administrative burden on individuals. On the other hand, provide tools, infrastructure and support to implement the excellent research practices. Additionally, working towards an\u00a0<strong>institutional structure with different roles<\/strong>\u00a0would allow research work to be organised more effectively and career pressures to be relieved. Creating staff scientist positions and positions such as data stewards can crucially contribute to a research system that has embedded quality management structures in place.<\/li>\n<\/ul>\n\n\n\n<p><strong>Tools and Technology: Lowering Barriers, Raising Standards<\/strong><\/p>\n\n\n\n<p>Tools and technology can make high-quality science easier \u2014 if they are accessible and straightforward to integrate into daily workflows. Such tools include\u00a0<strong>open-source community software, data repositories, and tools like Git for version control<\/strong>.\u00a0<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>As an individual researcher, it is a worthwhile investment to learn how to code, structure your data properly, and implement\u00a0<strong>reproducible workflows<\/strong>. Although it may require time upfront, it will increase confidence in your work and save time later \u2014 especially if you want to reuse parts of your pipeline across multiple projects. Well implemented research processes also ensure that research groups can function sustainably, even as members come and go. In addition to better documented research processes, technology can therefore prevent wasting resources as well.<br><\/li>\n\n\n\n<li>Since excellent research builds on previous work, previous work needs to be available to use. Information from paper publications is generally not detailed enough to reproduce other researcher\u2019s methods.\u00a0<strong>Open science practices<\/strong>\u00a0have been developed to allow transparent communication of the entire research process. Technological infrastructure, such as\u00a0<a href=\"https:\/\/www.softwareheritage.org\/\">Software Heritage<\/a>,\u00a0<a href=\"https:\/\/www.protocols.io\/\">protocols.io<\/a>\u00a0and the\u00a0<a href=\"https:\/\/ilonalipp.de\/de\/blog\/thoughts-on-research-excellence-part-2\/osf.io\/\">osf<\/a>, has been set up to make it as easy as possible to implement these practices.\u00a0<br><\/li>\n\n\n\n<li><strong>Responsible development and use of AI<\/strong>\u00a0can enhance research quality by accelerating time-consuming manual processes, identifying bugs or overlooked limitations, and generating new ideas and methods. However, doing so must be guided by thoughtful, community-led verification of AI-based tools and workflows. Institutions should provide training and usage guidelines that help researchers stay within ethical and legal boundaries while making the most of technological advances. At the same time, as a research ecosystem we also need long-term technical developments that are grounded in research ethics \u2014 to avoid reliance on proprietary tools or those designed for other purposes or interests.<br><\/li>\n\n\n\n<li>With regard to research methodology,\u00a0<strong>replication efforts<\/strong>\u00a0are essential for building a reliable scientific foundation that others can build on. For example, the large-scale\u00a0<a href=\"https:\/\/osf.io\/ezcuj\/wiki\/home\/\"><em>ManyLabs<\/em><\/a>\u00a0replication initiative in psychology \u2014 often mentioned in the context of low reproducibility of previously published findings \u2014 also highlights which findings do meet strict replication criteria. When building on previous work, be strategic. Reach out to the original authors to gather insights that may not be included in the published papers. Conferences are a good opportunity for these informal exchanges. And when taking a new direction in your research, conducting a\u00a0<strong>meta-analysis or structured literature review<\/strong>\u00a0can help reduce the risk of basing your project on weak or inconsistent findings.<\/li>\n<\/ul>\n\n\n\n<p><br><strong>To conclude<\/strong><br><br>Excellent research does not just happen through individual \u201cbrilliance\u201d \u2014 it happens in environments where researchers can thrive and follow scientific values. It happens in collaborative teams with constructive communication habits. It happens when supportive structures are in place. It happens where technology facilitates the implementation of reliable workflows. Creating such conditions is not simple \u2014 but it is not unrealistic either. Many tools, approaches, and good examples already exist. So even though the academic system sometimes seems to be in a pretty bad state, it does not have to stay that way. We can start improving how we work within it. Every small effort counts.<\/p>\n\n\n\n<p>And yes, in case you are wondering \u2014 the way I design my workshops and consultations is very much shaped by the principles described in this post. Do not hesitate to reach out if you are looking for support.<\/p>","protected":false},"excerpt":{"rendered":"<p>In the\u00a0previous post, I discussed how research \u201cexcellence\u201d is often defined by proxies such as publication count and grant income. These measures have emerged historically, but are not based on a shared understanding of what excellent research actually is. I reviewed how the current operationalisation of research excellence can inadvertently lead to bad research practices. [&hellip;]<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-211","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/posts\/211","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/comments?post=211"}],"version-history":[{"count":1,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/posts\/211\/revisions"}],"predecessor-version":[{"id":212,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/posts\/211\/revisions\/212"}],"wp:attachment":[{"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/media?parent=211"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/categories?post=211"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ilonalipp.de\/de\/wp-json\/wp\/v2\/tags?post=211"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}