keepcalculator

06 Numbers and Powers

Questionable research practices why junior researchers need better support?

Card No. 06·79738 · Updated · Standard formula, shown below

Questionable research practices (QRPs) are research behaviors that are not outright fraudulent but still compromise the integrity of the scientific process, and junior researchers are particularly vulnerable to them because they often lack the experience, power, and institutional support to resist pressures to produce positive, publishable results. This article explains what QRPs are, why they are so common among early-career scientists, and what concrete forms of support can help reduce them.

What Exactly Are Questionable Research Practices?

QRPs sit in a gray zone between responsible conduct and outright misconduct. They include p-hacking (collecting or analyzing data until a result becomes statistically significant), selectively reporting only favorable outcomes, failing to report all dependent variables, stopping data collection early when results look good, and “HARKing” (hypothesizing after results are known). Unlike fabrication or falsification, QRPs are often not explicitly forbidden, and many researchers engage in them without thinking they are doing anything wrong. A 2012 survey of over 2,000 psychologists found that up to 90% admitted to at least one QRP, though the exact figures vary by field and definition.

Why Are Junior Researchers Especially Vulnerable?

Junior researchers—graduate students, postdocs, and early-career faculty—face a unique combination of pressures and knowledge gaps that make QRPs more likely. They are evaluated on publication count and impact, often by supervisors who themselves feel pressure to “publish or perish.” They may not have received formal training in research ethics beyond a one-hour online course. They are also less likely to challenge a senior author’s suggestion to “try a different analysis” or “drop that outlier” because they fear career repercussions. A junior researcher who questions a powerful lab head’s methods can be excluded from future projects, denied authorship, or receive a poor recommendation.

How QRPs Spread Through a Research Culture

QRPs are not just individual failings; they are cultural. When a lab or field rewards positive results and punishes null findings, researchers learn that certain behaviors are necessary for survival. Junior researchers observe their mentors and peers, and they quickly internalize the message that “that’s just how science is done.” This is reinforced by the publication system, which favors novel, positive, and clean results. A junior researcher who sees a senior colleague p-hack a paper that then gets published in a top journal receives a powerful lesson: this is the path to success. Over time, these practices become normalized, and the next generation of researchers carries them forward.

What Kind of Support Do Junior Researchers Actually Need?

Better support must address both the structural pressures and the knowledge gaps. Here are the key elements:

  • Formal training in research integrity that goes beyond generic online modules—covering real-world scenarios, how to recognize QRPs, and how to respond when a supervisor suggests one.
  • Mentorship that models good practices—senior researchers who openly discuss their own struggles with null results, share pre-registration templates, and reward transparency.
  • Institutional policies that protect early-career researchers—such as anonymous reporting channels, clear authorship guidelines, and a zero-tolerance stance on coercive leadership.
  • Access to statistical consulting so that junior researchers do not feel forced to choose between a “significant” result and a methodologically sound one.
  • Funding and time for replication or null-result projects—so that not every project must be novel and positive to count as a career win.

Common Misconceptions About QRPs and Junior Researchers

One common misconception is that QRPs are committed by “bad apples” who lack ethics. In reality, most QRPs are committed by well-intentioned researchers who are responding to incentives. Another misconception is that only the social sciences have a QRP problem. In fact, QRPs have been documented in medicine, biology, economics, and even physics—though the specific practices may differ. A third misconception is that simply telling junior researchers “don’t do that” is enough. Given the strong situational pressures, education alone is insufficient; the environment must change.

How to Build a Supportive Research Environment

Creating a supportive environment requires action at multiple levels. At the lab level, principal investigators can establish a “pre-registration culture” where hypotheses and analysis plans are registered before data collection. They can also hold regular “fail fests” where null results are celebrated. At the department level, promotion criteria can be revised to value replication studies and open science contributions. At the publisher level, journals can offer “registered reports” where the introduction and methods are peer-reviewed before results are known. At the funder level, grants can include specific budgets for data management and open access. Each of these changes reduces the cost of honest research and makes QRPs less necessary.

Frequently Asked Questions

Are QRPs the same as scientific fraud?

No. Fraud involves deliberate deception, such as fabricating data. QRPs are more ambiguous—they are often rationalized as “just being thorough” or “not wanting to waste data.” However, QRPs can still distort the literature and erode trust, and repeated QRPs can escalate to outright fraud.

What is the most common QRP among junior researchers?

Selective reporting of results is probably the most common. It includes not reporting all dependent variables, not reporting all conditions, and only reporting analyses that yield significant results. This is often done because the researcher believes that “non-significant” results are uninteresting or will be criticized by reviewers.

How can a junior researcher refuse to engage in a QRP without damaging their career?

It helps to frame the refusal in terms of good science rather than personal objection. For example, “I’m concerned that this analysis isn’t pre-registered, and I’d like to keep our methods transparent.” If the pressure comes from a supervisor, it may be useful to consult a trusted ombudsperson or the university’s research integrity office. In many institutions, there are confidential channels for this.

Does pre-registration really reduce QRPs?

Pre-registration makes it harder to p-hack or HARK because the planned analyses are time-stamped and public. It does not prevent all QRPs—for example, a researcher could still selectively report results after pre-registration—but it is one of the most effective tools we have. It also shifts the reward from “significant results” to “good methods.”

What can senior researchers do to support juniors?

Senior researchers can lead by example: share your own null results, pre-register your studies, and publicly acknowledge when a hypothesis was wrong. They can also ensure that junior researchers get credit for their work, and they can create a lab culture where asking for help with statistics or design is encouraged, not seen as a weakness.

Conclusion

Junior researchers are not the root cause of QRPs; they are the most visible victims of a system that rewards quantity over quality. By providing better training, mentorship, and institutional safeguards, we can help them conduct research that is both successful and honest. The future of science depends on it.

Related

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.

More cards in this drawer

The whole Numbers and Powers drawer →