Risks of Bias in Research#

Prerequisites#

Prerequisite

Importance

Notes

Data Hazards

Helpful

Data Hazard labels can be used to highlight specific ethical risks to shareholders.

Summary#

Risks of bias are opportunities for the results of research to become distorted by limitations within the study design, conduct, and analysis. This can cause the findings and interpretation of research to be misleading or incorrect. Many risks can be mitigated, though this requires researchers to be aware both of the risks and the mitigation techniques. This chapter introduces methods for the assessment of risks of bias, identification of confounders, and some methods to improve validation.

In this chapter, the word bias predominantely refers to statistical distortion rather than to the unfair treatment of societal groups (discrimination), which is an important topic in its own right.

Motivation and Background#

Researchers are trusted by a wide array of stakeholders. Governmental and advisory bodies may look to research to influence policies, effected parties to influence their personal lives, and other researchers to influence future research. However, despite the best intentions, it can be easy to produce misleading research, leading to potential harms and the loss of trust.

Many risks can be mitigated with careful planning of data collection and analysis, leading to more accurate research outputs. Where risks are inevitable, these can be made clear to stakeholders to reduce the risk of inaccuracies causing harm.

This chapter aims to help researchers to identify and mitigate risks of bias in order to conduct research as accurately and ethically as possible, making for trustworthy, high-impact studies that can have a positive real-world impact.