Risk of bias assessment (sometimes called "quality assessment" or "critical appraisal") helps to establish transparency of evidence synthesis results and findings. A risk of bias assessment is often performed for each included study in your review. Evidence syntheses strive to eliminate bias in their findings. Individual studies that are included in a synthesis may include biases in their results or conclusions, for example design flaws that raise questions about validity of findings or an overestimate of intervention effect. Risk of bias assessment generally is not required with evidence synthesis methods outside of systematic reviews. However, this may depend on the evidence synthesis method that you are utilizing.
This Cochrane Training presentation helps to navigate the steps of Risk of Bias Assessment, but some things might not apply to other disciplines. For disciplines outside of human medicine, the Critical Appraisal Skills Programme provides checklists that can be applied to a diverse array of study types.
“A key difference between scoping reviews and systematic reviews is that the former are generally conducted to provide an overview of the existing evidence regardless of methodological quality or risk of bias (4, 5). Therefore, the included sources of evidence are typically not critically appraised for scoping reviews.”
Risk of bias assessments can be represented in table format in an evidence synthesis, showing each included study and how strong it is across several quality criteria for that particular study type for example*:
If a high proportion of studies are assessed with a high risk of bias, caution should be used when interpreting results for your evidence synthesis. More information can be found in Chapter 8 of the Cochrane Handbook.