Skip to content
Back to glossary
Concepts & theories

AMSTAR 2

AMSTAR 2 is a checklist for judging how well a systematic review was conducted. The name stands for A MeaSurement Tool to Assess systematic Reviews, in its second version, published in 2017. It has 16 items covering the protocol, the literature search, study selection and data extraction in duplicate, assessment of risk of bias in the included studies, the methods used for pooling, and the handling of funding and conflicts of interest. Seven of the 16 are marked critical: registration of a protocol before the review began, adequacy of the search, justification of excluded studies, appropriate risk of bias assessment, suitable statistical methods, consideration of risk of bias when interpreting results, and assessment of publication bias. The instrument does not produce a score. It produces one of four overall confidence ratings: high, moderate, low, or critically low. One critical flaw drops a review to low, more than one to critically low. Reporting an AMSTAR score out of 16 is a common misuse, because the items are not equally weighted and the tool was never designed to be summed. The difference from GRADE matters: this tool appraises the conduct of the review, while GRADE appraises the certainty of the underlying evidence. A flawless review of weak trials still yields low certainty. The two are used together.

Last reviewed:

This definition is educational and is not medical advice, a diagnosis, or treatment. Talk to a doctor about any health decisions. Read our full medical disclaimer

Sources

  1. Shea BJ, Reeves BC, Wells G, et al.. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. *BMJ*doi:10.1136/bmj.j4008
  2. Shea BJ, Grimshaw JM, Wells GA, et al.. (2007). Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. *BMC Medical Research Methodology*doi:10.1186/1471-2288-7-10
  3. Lorenz RC, Matthias K, Pieper D, et al.. (2019). A psychometric study found AMSTAR 2 to be a valid and moderately reliable appraisal tool. *Journal of Clinical Epidemiology*doi:10.1016/j.jclinepi.2019.05.028