U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • My Bibliography
  • Collections
  • Citation manager

Save citation to file

Email citation, add to collections.

  • Create a new collection
  • Add to an existing collection

Add to My Bibliography

Your saved search, create a file for external citation management software, your rss feed.

  • Search in PubMed
  • Search in NLM Catalog
  • Add to Search

How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses

Affiliations.

  • 1 Behavioural Science Centre, Stirling Management School, University of Stirling, Stirling FK9 4LA, United Kingdom; email: [email protected].
  • 2 Department of Psychological and Behavioural Science, London School of Economics and Political Science, London WC2A 2AE, United Kingdom.
  • 3 Department of Statistics, Northwestern University, Evanston, Illinois 60208, USA; email: [email protected].
  • PMID: 30089228
  • DOI: 10.1146/annurev-psych-010418-102803

Systematic reviews are characterized by a methodical and replicable methodology and presentation. They involve a comprehensive search to locate all relevant published and unpublished work on a subject; a systematic integration of search results; and a critique of the extent, nature, and quality of evidence in relation to a particular research question. The best reviews synthesize studies to draw broad theoretical conclusions about what a literature means, linking theory to evidence and evidence to theory. This guide describes how to plan, conduct, organize, and present a systematic review of quantitative (meta-analysis) or qualitative (narrative review, meta-synthesis) information. We outline core standards and principles and describe commonly encountered problems. Although this guide targets psychological scientists, its high level of abstraction makes it potentially relevant to any subject area or discipline. We argue that systematic reviews are a key methodology for clarifying whether and how research findings replicate and for explaining possible inconsistencies, and we call for researchers to conduct systematic reviews to help elucidate whether there is a replication crisis.

Keywords: evidence; guide; meta-analysis; meta-synthesis; narrative; systematic review; theory.

PubMed Disclaimer

Similar articles

  • The future of Cochrane Neonatal. Soll RF, Ovelman C, McGuire W. Soll RF, et al. Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
  • Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Aromataris E, et al. Int J Evid Based Healthc. 2015 Sep;13(3):132-40. doi: 10.1097/XEB.0000000000000055. Int J Evid Based Healthc. 2015. PMID: 26360830
  • RAMESES publication standards: meta-narrative reviews. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. Wong G, et al. BMC Med. 2013 Jan 29;11:20. doi: 10.1186/1741-7015-11-20. BMC Med. 2013. PMID: 23360661 Free PMC article.
  • A Primer on Systematic Reviews and Meta-Analyses. Nguyen NH, Singh S. Nguyen NH, et al. Semin Liver Dis. 2018 May;38(2):103-111. doi: 10.1055/s-0038-1655776. Epub 2018 Jun 5. Semin Liver Dis. 2018. PMID: 29871017 Review.
  • Publication Bias and Nonreporting Found in Majority of Systematic Reviews and Meta-analyses in Anesthesiology Journals. Hedin RJ, Umberham BA, Detweiler BN, Kollmorgen L, Vassar M. Hedin RJ, et al. Anesth Analg. 2016 Oct;123(4):1018-25. doi: 10.1213/ANE.0000000000001452. Anesth Analg. 2016. PMID: 27537925 Review.
  • Strength of evidence for five happiness strategies. Puterman E, Zieff G, Stoner L. Puterman E, et al. Nat Hum Behav. 2024 Aug 12. doi: 10.1038/s41562-024-01954-0. Online ahead of print. Nat Hum Behav. 2024. PMID: 39134738 No abstract available.
  • Nursing Education During the SARS-COVID-19 Pandemic: The Implementation of Information and Communication Technologies (ICT). Soto-Luffi O, Villegas C, Viscardi S, Ulloa-Inostroza EM. Soto-Luffi O, et al. Med Sci Educ. 2024 May 9;34(4):949-959. doi: 10.1007/s40670-024-02056-2. eCollection 2024 Aug. Med Sci Educ. 2024. PMID: 39099870 Review.
  • Surveillance of Occupational Exposure to Volatile Organic Compounds at Gas Stations: A Scoping Review Protocol. Mendes TMC, Soares JP, Salvador PTCO, Castro JL. Mendes TMC, et al. Int J Environ Res Public Health. 2024 Apr 23;21(5):518. doi: 10.3390/ijerph21050518. Int J Environ Res Public Health. 2024. PMID: 38791733 Free PMC article. Review.
  • Association between poor sleep and mental health issues in Indigenous communities across the globe: a systematic review. Fernandez DR, Lee R, Tran N, Jabran DS, King S, McDaid L. Fernandez DR, et al. Sleep Adv. 2024 May 2;5(1):zpae028. doi: 10.1093/sleepadvances/zpae028. eCollection 2024. Sleep Adv. 2024. PMID: 38721053 Free PMC article.
  • Barriers to ethical treatment of patients in clinical environments: A systematic narrative review. Dehkordi FG, Torabizadeh C, Rakhshan M, Vizeshfar F. Dehkordi FG, et al. Health Sci Rep. 2024 May 1;7(5):e2008. doi: 10.1002/hsr2.2008. eCollection 2024 May. Health Sci Rep. 2024. PMID: 38698790 Free PMC article.
  • Search in MeSH

LinkOut - more resources

Full text sources.

  • Ingenta plc
  • Ovid Technologies, Inc.

Other Literature Sources

  • scite Smart Citations

Miscellaneous

  • NCI CPTAC Assay Portal
  • Citation Manager

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

  • A-Z Publications

Annual Review of Psychology

Volume 70, 2019, review article, how to do a systematic review: a best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses.

  • Andy P. Siddaway 1 , Alex M. Wood 2 , and Larry V. Hedges 3
  • View Affiliations Hide Affiliations Affiliations: 1 Behavioural Science Centre, Stirling Management School, University of Stirling, Stirling FK9 4LA, United Kingdom; email: [email protected] 2 Department of Psychological and Behavioural Science, London School of Economics and Political Science, London WC2A 2AE, United Kingdom 3 Department of Statistics, Northwestern University, Evanston, Illinois 60208, USA; email: [email protected]
  • Vol. 70:747-770 (Volume publication date January 2019) https://doi.org/10.1146/annurev-psych-010418-102803
  • First published as a Review in Advance on August 08, 2018
  • Copyright © 2019 by Annual Reviews. All rights reserved

Systematic reviews are characterized by a methodical and replicable methodology and presentation. They involve a comprehensive search to locate all relevant published and unpublished work on a subject; a systematic integration of search results; and a critique of the extent, nature, and quality of evidence in relation to a particular research question. The best reviews synthesize studies to draw broad theoretical conclusions about what a literature means, linking theory to evidence and evidence to theory. This guide describes how to plan, conduct, organize, and present a systematic review of quantitative (meta-analysis) or qualitative (narrative review, meta-synthesis) information. We outline core standards and principles and describe commonly encountered problems. Although this guide targets psychological scientists, its high level of abstraction makes it potentially relevant to any subject area or discipline. We argue that systematic reviews are a key methodology for clarifying whether and how research findings replicate and for explaining possible inconsistencies, and we call for researchers to conduct systematic reviews to help elucidate whether there is a replication crisis.

Article metrics loading...

Full text loading...

Literature Cited

  • APA Publ. Commun. Board Work. Group J. Artic. Rep. Stand. 2008 . Reporting standards for research in psychology: Why do we need them? What might they be?. Am. Psychol . 63 : 848– 49 [Google Scholar]
  • Baumeister RF 2013 . Writing a literature review. The Portable Mentor: Expert Guide to a Successful Career in Psychology MJ Prinstein, MD Patterson 119– 32 New York: Springer, 2nd ed.. [Google Scholar]
  • Baumeister RF , Leary MR 1995 . The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychol. Bull. 117 : 497– 529 [Google Scholar]
  • Baumeister RF , Leary MR 1997 . Writing narrative literature reviews. Rev. Gen. Psychol. 3 : 311– 20 Presents a thorough and thoughtful guide to conducting narrative reviews. [Google Scholar]
  • Bem DJ 1995 . Writing a review article for Psychological Bulletin. Psychol . Bull 118 : 172– 77 [Google Scholar]
  • Borenstein M , Hedges LV , Higgins JPT , Rothstein HR 2009 . Introduction to Meta-Analysis New York: Wiley Presents a comprehensive introduction to meta-analysis. [Google Scholar]
  • Borenstein M , Higgins JPT , Hedges LV , Rothstein HR 2017 . Basics of meta-analysis: I 2 is not an absolute measure of heterogeneity. Res. Synth. Methods 8 : 5– 18 [Google Scholar]
  • Braver SL , Thoemmes FJ , Rosenthal R 2014 . Continuously cumulating meta-analysis and replicability. Perspect. Psychol. Sci. 9 : 333– 42 [Google Scholar]
  • Bushman BJ 1994 . Vote-counting procedures. The Handbook of Research Synthesis H Cooper, LV Hedges 193– 214 New York: Russell Sage Found. [Google Scholar]
  • Cesario J 2014 . Priming, replication, and the hardest science. Perspect. Psychol. Sci. 9 : 40– 48 [Google Scholar]
  • Chalmers I 2007 . The lethal consequences of failing to make use of all relevant evidence about the effects of medical treatments: the importance of systematic reviews. Treating Individuals: From Randomised Trials to Personalised Medicine PM Rothwell 37– 58 London: Lancet [Google Scholar]
  • Cochrane Collab. 2003 . Glossary Rep., Cochrane Collab. London: http://community.cochrane.org/glossary Presents a comprehensive glossary of terms relevant to systematic reviews. [Google Scholar]
  • Cohn LD , Becker BJ 2003 . How meta-analysis increases statistical power. Psychol. Methods 8 : 243– 53 [Google Scholar]
  • Cooper HM 2003 . Editorial. Psychol. Bull. 129 : 3– 9 [Google Scholar]
  • Cooper HM 2016 . Research Synthesis and Meta-Analysis: A Step-by-Step Approach Thousand Oaks, CA: Sage, 5th ed.. Presents a comprehensive introduction to research synthesis and meta-analysis. [Google Scholar]
  • Cooper HM , Hedges LV , Valentine JC 2009 . The Handbook of Research Synthesis and Meta-Analysis New York: Russell Sage Found, 2nd ed.. [Google Scholar]
  • Cumming G 2014 . The new statistics: why and how. Psychol. Sci. 25 : 7– 29 Discusses the limitations of null hypothesis significance testing and viable alternative approaches. [Google Scholar]
  • Earp BD , Trafimow D 2015 . Replication, falsification, and the crisis of confidence in social psychology. Front. Psychol. 6 : 621 [Google Scholar]
  • Etz A , Vandekerckhove J 2016 . A Bayesian perspective on the reproducibility project: psychology. PLOS ONE 11 : e0149794 [Google Scholar]
  • Ferguson CJ , Brannick MT 2012 . Publication bias in psychological science: prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychol. Methods 17 : 120– 28 [Google Scholar]
  • Fleiss JL , Berlin JA 2009 . Effect sizes for dichotomous data. The Handbook of Research Synthesis and Meta-Analysis H Cooper, LV Hedges, JC Valentine 237– 53 New York: Russell Sage Found, 2nd ed.. [Google Scholar]
  • Garside R 2014 . Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how. Innovation 27 : 67– 79 [Google Scholar]
  • Hedges LV , Olkin I 1980 . Vote count methods in research synthesis. Psychol. Bull. 88 : 359– 69 [Google Scholar]
  • Hedges LV , Pigott TD 2001 . The power of statistical tests in meta-analysis. Psychol. Methods 6 : 203– 17 [Google Scholar]
  • Higgins JPT , Green S 2011 . Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 London: Cochrane Collab. Presents comprehensive and regularly updated guidelines on systematic reviews. [Google Scholar]
  • John LK , Loewenstein G , Prelec D 2012 . Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol. Sci. 23 : 524– 32 [Google Scholar]
  • Juni P , Witschi A , Bloch R , Egger M 1999 . The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 282 : 1054– 60 [Google Scholar]
  • Klein O , Doyen S , Leys C , Magalhães de Saldanha da Gama PA , Miller S et al. 2012 . Low hopes, high expectations: expectancy effects and the replicability of behavioral experiments. Perspect. Psychol. Sci. 7 : 6 572– 84 [Google Scholar]
  • Lau J , Antman EM , Jimenez-Silva J , Kupelnick B , Mosteller F , Chalmers TC 1992 . Cumulative meta-analysis of therapeutic trials for myocardial infarction. N. Engl. J. Med. 327 : 248– 54 [Google Scholar]
  • Light RJ , Smith PV 1971 . Accumulating evidence: procedures for resolving contradictions among different research studies. Harvard Educ. Rev. 41 : 429– 71 [Google Scholar]
  • Lipsey MW , Wilson D 2001 . Practical Meta-Analysis London: Sage Comprehensive and clear explanation of meta-analysis. [Google Scholar]
  • Matt GE , Cook TD 1994 . Threats to the validity of research synthesis. The Handbook of Research Synthesis H Cooper, LV Hedges 503– 20 New York: Russell Sage Found. [Google Scholar]
  • Maxwell SE , Lau MY , Howard GS 2015 . Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?. Am. Psychol. 70 : 487– 98 [Google Scholar]
  • Moher D , Hopewell S , Schulz KF , Montori V , Gøtzsche PC et al. 2010 . CONSORT explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340 : c869 [Google Scholar]
  • Moher D , Liberati A , Tetzlaff J , Altman DG PRISMA Group. 2009 . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339 : 332– 36 Comprehensive reporting guidelines for systematic reviews. [Google Scholar]
  • Morrison A , Polisena J , Husereau D , Moulton K , Clark M et al. 2012 . The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int. J. Technol. Assess. Health Care 28 : 138– 44 [Google Scholar]
  • Nelson LD , Simmons J , Simonsohn U 2018 . Psychology's renaissance. Annu. Rev. Psychol. 69 : 511– 34 [Google Scholar]
  • Noblit GW , Hare RD 1988 . Meta-Ethnography: Synthesizing Qualitative Studies Newbury Park, CA: Sage [Google Scholar]
  • Olivo SA , Macedo LG , Gadotti IC , Fuentes J , Stanton T , Magee DJ 2008 . Scales to assess the quality of randomized controlled trials: a systematic review. Phys. Ther. 88 : 156– 75 [Google Scholar]
  • Open Sci. Collab. 2015 . Estimating the reproducibility of psychological science. Science 349 : 943 [Google Scholar]
  • Paterson BL , Thorne SE , Canam C , Jillings C 2001 . Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Synthesis Thousand Oaks, CA: Sage [Google Scholar]
  • Patil P , Peng RD , Leek JT 2016 . What should researchers expect when they replicate studies? A statistical view of replicability in psychological science. Perspect. Psychol. Sci. 11 : 539– 44 [Google Scholar]
  • Rosenthal R 1979 . The “file drawer problem” and tolerance for null results. Psychol. Bull. 86 : 638– 41 [Google Scholar]
  • Rosnow RL , Rosenthal R 1989 . Statistical procedures and the justification of knowledge in psychological science. Am. Psychol. 44 : 1276– 84 [Google Scholar]
  • Sanderson S , Tatt ID , Higgins JP 2007 . Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int. J. Epidemiol. 36 : 666– 76 [Google Scholar]
  • Schreiber R , Crooks D , Stern PN 1997 . Qualitative meta-analysis. Completing a Qualitative Project: Details and Dialogue JM Morse 311– 26 Thousand Oaks, CA: Sage [Google Scholar]
  • Shrout PE , Rodgers JL 2018 . Psychology, science, and knowledge construction: broadening perspectives from the replication crisis. Annu. Rev. Psychol. 69 : 487– 510 [Google Scholar]
  • Stroebe W , Strack F 2014 . The alleged crisis and the illusion of exact replication. Perspect. Psychol. Sci. 9 : 59– 71 [Google Scholar]
  • Stroup DF , Berlin JA , Morton SC , Olkin I , Williamson GD et al. 2000 . Meta-analysis of observational studies in epidemiology (MOOSE): a proposal for reporting. JAMA 283 : 2008– 12 [Google Scholar]
  • Thorne S , Jensen L , Kearney MH , Noblit G , Sandelowski M 2004 . Qualitative meta-synthesis: reflections on methodological orientation and ideological agenda. Qual. Health Res. 14 : 1342– 65 [Google Scholar]
  • Tong A , Flemming K , McInnes E , Oliver S , Craig J 2012 . Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med. Res. Methodol. 12 : 181– 88 [Google Scholar]
  • Trickey D , Siddaway AP , Meiser-Stedman R , Serpell L , Field AP 2012 . A meta-analysis of risk factors for post-traumatic stress disorder in children and adolescents. Clin. Psychol. Rev. 32 : 122– 38 [Google Scholar]
  • Valentine JC , Biglan A , Boruch RF , Castro FG , Collins LM et al. 2011 . Replication in prevention science. Prev. Sci. 12 : 103– 17 [Google Scholar]
  • Article Type: Review Article

Most Read This Month

Most cited most cited rss feed, job burnout, executive functions, social cognitive theory: an agentic perspective, on happiness and human potentials: a review of research on hedonic and eudaimonic well-being, sources of method bias in social science research and recommendations on how to control it, mediation analysis, missing data analysis: making it work in the real world, grounded cognition, personality structure: emergence of the five-factor model, motivational beliefs, values, and goals.

  • Open access
  • Published: 15 December 2015

Qualitative and mixed methods in systematic reviews

  • David Gough 1  

Systematic Reviews volume  4 , Article number:  181 ( 2015 ) Cite this article

23k Accesses

42 Citations

23 Altmetric

Metrics details

Expanding the range of methods of systematic review

The logic of systematic reviews is very simple. We use transparent rigorous approaches to undertake primary research, and so we should do the same in bringing together studies to describe what has been studied (a research map) or to integrate the findings of the different studies to answer a research question (a research synthesis). We should not really need to use the term ‘systematic’ as it should be assumed that researchers are using and reporting systematic methods in all of their research, whether primary or secondary. Despite the universality of this logic, systematic reviews (maps and syntheses) are much better known in health research and for answering questions of the effectiveness of interventions (what works). Systematic reviews addressing other sorts of questions have been around for many years, as in, for example, meta ethnography [ 1 ] and other forms of conceptual synthesis [ 2 ], but only recently has there been a major increase in the use of systematic review approaches to answer other sorts of research questions.

There are probably several reasons for this broadening of approach. One may be that the increased awareness of systematic reviews has made people consider the possibilities for all areas of research. A second related factor may be that more training and funding resources have become available and increased the capacity to undertake such varied review work.

A third reason could be that some of the initial anxieties about systematic reviews have subsided. Initially, there were concerns that their use was being promoted by a new managerialism where reviews, particularly effectiveness reviews, were being used to promote particular ideological and theoretical assumptions and to indirectly control research agendas. However, others like me believe that explicit methods should be used to enable transparency of perspectives driving research and to open up access to and participation in research agendas and priority setting [ 3 ] as illustrated, for example, by the James Lind Alliance (see http://www.jla.nihr.ac.uk/ ).

A fourth possible reason for the development of new approaches is that effectiveness reviews have themselves broadened. Some ‘what works’ reviews can be open to criticism for only testing a ‘black box’ hypothesis of what works with little theorizing or any logic model about why any such hypothesis should be true and the mechanisms involved in such processes. There is now more concern to develop theory and to test how variables combine and interact. In primary research, qualitative strategies are advised prior to undertaking experimental trials [ 4 , 5 ] and similar approaches are being advocated to address complexity in reviews [ 6 ], in order to ask questions and use methods that address theories and processes that enable an understanding of both impact and context.

This Special Issue of Systematic Reviews Journal is providing a focus for these new methods of review whether these use qualitative review methods on their own or mixed together with more quantitative approaches. We are linking together with the sister journal Trials for this Special Issue as there is a similar interest in what qualitative approaches can and should contribute to primary research using experimentally controlled trials (see Trials Special Issue editorial by Claire Snowdon).

Dimensions of difference in reviews

Developing the range of methods to address different questions for review creates a challenge in describing and understanding such methods. There are many names and brands for the new methods which may or may not withstand the changes of historical time, but another way to comprehend the changes and new developments is to consider the dimensions on which the approaches to review differ [ 7 , 8 ].

One important distinction is the research question being asked and the associated paradigm underlying the method used to address this question. Research assumes a particular theoretical position and then gathers data within this conceptual lens. In some cases, this is a very specific hypothesis that is then tested empirically, and sometimes, the research is more exploratory and iterative with concepts being emergent and constructed during the research process. This distinction is often labelled as quantitative or positivist versus qualitative or constructionist. However, this can be confusing as much research taking a ‘quantitative’ perspective does not have the necessary numeric data to analyse. Even if it does have such data, this might be explored for emergent properties. Similarly, research taking a ‘qualitative’ perspective may include implicit quantitative themes in terms of the extent of different qualitative findings reported by a study.

Sandelowski and colleagues’ solution is to consider the analytic activity and whether this aggregates (adds up) or configures (arranges) the data [ 9 ]. In a randomized controlled trial and an effectiveness review of such studies, the main analysis is the aggregation of data using a priori non-emergent strategies with little iteration. However, there may also be post hoc analysis that is more exploratory in arranging (configuring) data to identify patterns as in, for example, meta regression or qualitative comparative analysis aiming to identify the active ingredients of effective interventions [ 10 ]. Similarly, qualitative primary research or reviews of such research are predominantly exploring emergent patterns and developing concepts iteratively, yet there may be some aggregation of data to make statements of generalizations of extent.

Even where the analysis is predominantly configuration, there can be a wide variation in the dimensions of difference of iteration of theories and concepts. In thematic synthesis [ 11 ], there may be few presumptions about the concepts that will be configured. In meta ethnography which can be richer in theory, there may be theoretical assumptions underlying the review question framing the analysis. In framework synthesis, there is an explicit conceptual framework that is iteratively developed and changed through the review process [ 12 , 13 ].

In addition to the variation in question, degree of configuration, complexity of theory, and iteration are many other dimensions of difference between reviews. Some of these differences follow on from the research questions being asked and the research paradigm being used such as in the approach to searching (exhaustive or based on exploration or saturation) and the appraisal of the quality and relevance of included studies (based more on risk of bias or more on meaning). Others include the extent that reviews have a broad question, depth of analysis, and the extent of resultant ‘work done’ in terms of progressing a field of inquiry [ 7 , 8 ].

Mixed methods reviews

As one reason for the growth in qualitative synthesis is what they can add to quantitative reviews, it is not surprising that there is also growing interest in mixed methods reviews. This reflects similar developments in primary research in mixing methods to examine the relationship between theory and empirical data which is of course the cornerstone of much research. But, both primary and secondary mixed methods research also face similar challenges in examining complex questions at different levels of analysis and of combining research findings investigated in different ways and may be based on very different epistemological assumptions [ 14 , 15 ].

Some mixed methods approaches are convergent in that they integrate different data and methods of analysis together at the same time [ 16 , 17 ]. Convergent systematic reviews could be described as having broad inclusion criteria (or two or more different sets of criteria) for methods of primary studies and have special methods for the synthesis of the resultant variation in data. Other reviews (and also primary mixed methods studies) are sequences of sub-reviews in that one sub-study using one research paradigm is followed by another sub-study with a different research paradigm. In other words, a qualitative synthesis might be used to explore the findings of a prior quantitative synthesis or vice versa [ 16 , 17 ].

An example of a predominantly aggregative sub-review followed by a configuring sub-review is the EPPI-Centre’s mixed methods review of barriers to healthy eating [ 18 ]. A sub-review on the effectiveness of public health interventions showed a modest effect size. A configuring review of studies of children and young people’s understanding and views about eating provided evidence that the public health interventions did not take good account of such user views research, and that the interventions most closely aligned to the user views were the most effective. The already mentioned qualitative comparative analysis to identify the active ingredients within interventions leading to impact could also be considered a qualitative configuring investigation of an existing quantitative aggregative review [ 10 ].

An example of a predominantly configurative review followed by an aggregative review is realist synthesis. Realist reviews examine the evidence in support of mid-range theories [ 19 ] with a first stage of a configuring review of what is proposed by the theory or proposal (what would need to be in place and what casual pathways would have to be effective for the outcomes proposed by the theory to be supported?) and a second stage searching for empirical evidence to test for those necessary conditions and effectiveness of the pathways. The empirical testing does not however use a standard ‘what works’ a priori methods approach but rather a more iterative seeking out of evidence that confirms or undermines the theory being evaluated [ 20 ].

Although sequential mixed methods approaches are considered to be sub-parts of one larger study, they could be separate studies as part of a long-term strategic approach to studying an issue. We tend to see both primary studies and reviews as one-off events, yet reviews are a way of examining what we know and what more we want to know as a strategic approach to studying an issue over time. If we are in favour of mixing paradigms of research to enable multiple levels and perspectives and mixing of theory development and empirical evaluation, then we are really seeking mixed methods research strategies rather than simply mixed methods studies and reviews.

Noblit G. Hare RD: meta-ethnography: synthesizing qualitative studies. Newbury Park NY: Sage Publications; 1988.

Google Scholar  

Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9:59.

Article   PubMed   PubMed Central   Google Scholar  

Gough D, Elbourne D. Systematic research synthesis to inform policy, practice and democratic debate. Soc Pol Soc. 2002;2002:1.

Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance 2015. BMJ. 2015;350:h1258

Candy B, Jone L, King M, Oliver S. Using qualitative evidence to help understand complex palliative care interventions: a novel evidence synthesis approach. BMJ Support Palliat Care. 2014;4:Supp A41–A42.

Article   Google Scholar  

Noyes J, Gough D, Lewin S, Mayhew A, Michie S, Pantoja T, et al. A research and development agenda for systematic reviews that ask complex questions about complex interventions. J Clin Epidemiol. 2013;66:11.

Gough D, Oliver S, Thomas J. Introduction to systematic reviews. London: Sage; 2012.

Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1:28.

Sandelowski M, Voils CJ, Leeman J, Crandlee JL. Mapping the mixed methods-mixed research synthesis terrain. J Mix Methods Res. 2012;6:4.

Thomas J, O’Mara-Eves A, Brunton G. Using qualitative comparative analysis (QCA) in systematic reviews of complex interventions: a worked example. Syst Rev. 2014;3:67.

Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.

Oliver S, Rees R, Clarke-Jones L, Milne R, Oakley AR, Gabbay J, et al. A multidimensional conceptual framework for analysing public involvement in health services research. Health Exp. 2008;11:72–84.

Booth A, Carroll C. How to build up the actionable knowledge base: the role of ‘best fit’ framework synthesis for studies of improvement in healthcare. BMJ Qual Saf. 2015. 2014-003642.

Brannen J. Mixed methods research: a discussion paper. NCRM Methods Review Papers, 2006. NCRM/005.

Creswell J. Mapping the developing landscape of mixed methods research. In: Teddlie C, Tashakkori A, editors. SAGE handbook of mixed methods in social & behavioral research. New York: Sage; 2011.

Morse JM. Principles of mixed method and multi-method research design. In: Teddlie C, Tashakkori A, editors. Handbook of mixed methods in social and behavioural research. London: Sage; 2003.

Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health. 2014;35:29–45.

Harden A, Thomas J. Mixed methods and systematic reviews: examples and emerging issues. In: Tashakkori A, Teddlie C, editors. Handbook of mixed methods in the social and behavioral sciences. 2nd ed. London: Sage; 2010. p. 749–74.

Chapter   Google Scholar  

Pawson R. Evidenced-based policy: a realist perspective. London: Sage; 2006.

Book   Google Scholar  

Gough D. Meta-narrative and realist reviews: guidance, rules, publication standards and quality appraisal. BMC Med. 2013;11:22.

Download references

Author information

Authors and affiliations.

EPPI-Centre, Social Science Research Unit, University College London, London, WC1H 0NR, UK

David Gough

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to David Gough .

Additional information

Competing interests.

The author is a writer and researcher in this area. The author declares that he has no other competing interests.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article.

Gough, D. Qualitative and mixed methods in systematic reviews. Syst Rev 4 , 181 (2015). https://doi.org/10.1186/s13643-015-0151-y

Download citation

Received : 13 October 2015

Accepted : 29 October 2015

Published : 15 December 2015

DOI : https://doi.org/10.1186/s13643-015-0151-y

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Systematic Reviews

ISSN: 2046-4053

  • Submission enquiries: Access here and click Contact Us
  • General enquiries: [email protected]

a systematic qualitative literature review

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

  • Knowledge Base

Methodology

  • Systematic Review | Definition, Example, & Guide

Systematic Review | Definition, Example & Guide

Published on June 15, 2022 by Shaun Turney . Revised on November 20, 2023.

A systematic review is a type of review that uses repeatable methods to find, select, and synthesize all available evidence. It answers a clearly formulated research question and explicitly states the methods used to arrive at the answer.

They answered the question “What is the effectiveness of probiotics in reducing eczema symptoms and improving quality of life in patients with eczema?”

In this context, a probiotic is a health product that contains live microorganisms and is taken by mouth. Eczema is a common skin condition that causes red, itchy skin.

Table of contents

What is a systematic review, systematic review vs. meta-analysis, systematic review vs. literature review, systematic review vs. scoping review, when to conduct a systematic review, pros and cons of systematic reviews, step-by-step example of a systematic review, other interesting articles, frequently asked questions about systematic reviews.

A review is an overview of the research that’s already been completed on a topic.

What makes a systematic review different from other types of reviews is that the research methods are designed to reduce bias . The methods are repeatable, and the approach is formal and systematic:

  • Formulate a research question
  • Develop a protocol
  • Search for all relevant studies
  • Apply the selection criteria
  • Extract the data
  • Synthesize the data
  • Write and publish a report

Although multiple sets of guidelines exist, the Cochrane Handbook for Systematic Reviews is among the most widely used. It provides detailed guidelines on how to complete each step of the systematic review process.

Systematic reviews are most commonly used in medical and public health research, but they can also be found in other disciplines.

Systematic reviews typically answer their research question by synthesizing all available evidence and evaluating the quality of the evidence. Synthesizing means bringing together different information to tell a single, cohesive story. The synthesis can be narrative ( qualitative ), quantitative , or both.

Prevent plagiarism. Run a free check.

Systematic reviews often quantitatively synthesize the evidence using a meta-analysis . A meta-analysis is a statistical analysis, not a type of review.

A meta-analysis is a technique to synthesize results from multiple studies. It’s a statistical analysis that combines the results of two or more studies, usually to estimate an effect size .

A literature review is a type of review that uses a less systematic and formal approach than a systematic review. Typically, an expert in a topic will qualitatively summarize and evaluate previous work, without using a formal, explicit method.

Although literature reviews are often less time-consuming and can be insightful or helpful, they have a higher risk of bias and are less transparent than systematic reviews.

Similar to a systematic review, a scoping review is a type of review that tries to minimize bias by using transparent and repeatable methods.

However, a scoping review isn’t a type of systematic review. The most important difference is the goal: rather than answering a specific question, a scoping review explores a topic. The researcher tries to identify the main concepts, theories, and evidence, as well as gaps in the current research.

Sometimes scoping reviews are an exploratory preparation step for a systematic review, and sometimes they are a standalone project.

A systematic review is a good choice of review if you want to answer a question about the effectiveness of an intervention , such as a medical treatment.

To conduct a systematic review, you’ll need the following:

  • A precise question , usually about the effectiveness of an intervention. The question needs to be about a topic that’s previously been studied by multiple researchers. If there’s no previous research, there’s nothing to review.
  • If you’re doing a systematic review on your own (e.g., for a research paper or thesis ), you should take appropriate measures to ensure the validity and reliability of your research.
  • Access to databases and journal archives. Often, your educational institution provides you with access.
  • Time. A professional systematic review is a time-consuming process: it will take the lead author about six months of full-time work. If you’re a student, you should narrow the scope of your systematic review and stick to a tight schedule.
  • Bibliographic, word-processing, spreadsheet, and statistical software . For example, you could use EndNote, Microsoft Word, Excel, and SPSS.

A systematic review has many pros .

  • They minimize research bias by considering all available evidence and evaluating each study for bias.
  • Their methods are transparent , so they can be scrutinized by others.
  • They’re thorough : they summarize all available evidence.
  • They can be replicated and updated by others.

Systematic reviews also have a few cons .

  • They’re time-consuming .
  • They’re narrow in scope : they only answer the precise research question.

The 7 steps for conducting a systematic review are explained with an example.

Step 1: Formulate a research question

Formulating the research question is probably the most important step of a systematic review. A clear research question will:

  • Allow you to more effectively communicate your research to other researchers and practitioners
  • Guide your decisions as you plan and conduct your systematic review

A good research question for a systematic review has four components, which you can remember with the acronym PICO :

  • Population(s) or problem(s)
  • Intervention(s)
  • Comparison(s)

You can rearrange these four components to write your research question:

  • What is the effectiveness of I versus C for O in P ?

Sometimes, you may want to include a fifth component, the type of study design . In this case, the acronym is PICOT .

  • Type of study design(s)
  • The population of patients with eczema
  • The intervention of probiotics
  • In comparison to no treatment, placebo , or non-probiotic treatment
  • The outcome of changes in participant-, parent-, and doctor-rated symptoms of eczema and quality of life
  • Randomized control trials, a type of study design

Their research question was:

  • What is the effectiveness of probiotics versus no treatment, a placebo, or a non-probiotic treatment for reducing eczema symptoms and improving quality of life in patients with eczema?

Step 2: Develop a protocol

A protocol is a document that contains your research plan for the systematic review. This is an important step because having a plan allows you to work more efficiently and reduces bias.

Your protocol should include the following components:

  • Background information : Provide the context of the research question, including why it’s important.
  • Research objective (s) : Rephrase your research question as an objective.
  • Selection criteria: State how you’ll decide which studies to include or exclude from your review.
  • Search strategy: Discuss your plan for finding studies.
  • Analysis: Explain what information you’ll collect from the studies and how you’ll synthesize the data.

If you’re a professional seeking to publish your review, it’s a good idea to bring together an advisory committee . This is a group of about six people who have experience in the topic you’re researching. They can help you make decisions about your protocol.

It’s highly recommended to register your protocol. Registering your protocol means submitting it to a database such as PROSPERO or ClinicalTrials.gov .

Step 3: Search for all relevant studies

Searching for relevant studies is the most time-consuming step of a systematic review.

To reduce bias, it’s important to search for relevant studies very thoroughly. Your strategy will depend on your field and your research question, but sources generally fall into these four categories:

  • Databases: Search multiple databases of peer-reviewed literature, such as PubMed or Scopus . Think carefully about how to phrase your search terms and include multiple synonyms of each word. Use Boolean operators if relevant.
  • Handsearching: In addition to searching the primary sources using databases, you’ll also need to search manually. One strategy is to scan relevant journals or conference proceedings. Another strategy is to scan the reference lists of relevant studies.
  • Gray literature: Gray literature includes documents produced by governments, universities, and other institutions that aren’t published by traditional publishers. Graduate student theses are an important type of gray literature, which you can search using the Networked Digital Library of Theses and Dissertations (NDLTD) . In medicine, clinical trial registries are another important type of gray literature.
  • Experts: Contact experts in the field to ask if they have unpublished studies that should be included in your review.

At this stage of your review, you won’t read the articles yet. Simply save any potentially relevant citations using bibliographic software, such as Scribbr’s APA or MLA Generator .

  • Databases: EMBASE, PsycINFO, AMED, LILACS, and ISI Web of Science
  • Handsearch: Conference proceedings and reference lists of articles
  • Gray literature: The Cochrane Library, the metaRegister of Controlled Trials, and the Ongoing Skin Trials Register
  • Experts: Authors of unpublished registered trials, pharmaceutical companies, and manufacturers of probiotics

Step 4: Apply the selection criteria

Applying the selection criteria is a three-person job. Two of you will independently read the studies and decide which to include in your review based on the selection criteria you established in your protocol . The third person’s job is to break any ties.

To increase inter-rater reliability , ensure that everyone thoroughly understands the selection criteria before you begin.

If you’re writing a systematic review as a student for an assignment, you might not have a team. In this case, you’ll have to apply the selection criteria on your own; you can mention this as a limitation in your paper’s discussion.

You should apply the selection criteria in two phases:

  • Based on the titles and abstracts : Decide whether each article potentially meets the selection criteria based on the information provided in the abstracts.
  • Based on the full texts: Download the articles that weren’t excluded during the first phase. If an article isn’t available online or through your library, you may need to contact the authors to ask for a copy. Read the articles and decide which articles meet the selection criteria.

It’s very important to keep a meticulous record of why you included or excluded each article. When the selection process is complete, you can summarize what you did using a PRISMA flow diagram .

Next, Boyle and colleagues found the full texts for each of the remaining studies. Boyle and Tang read through the articles to decide if any more studies needed to be excluded based on the selection criteria.

When Boyle and Tang disagreed about whether a study should be excluded, they discussed it with Varigos until the three researchers came to an agreement.

Step 5: Extract the data

Extracting the data means collecting information from the selected studies in a systematic way. There are two types of information you need to collect from each study:

  • Information about the study’s methods and results . The exact information will depend on your research question, but it might include the year, study design , sample size, context, research findings , and conclusions. If any data are missing, you’ll need to contact the study’s authors.
  • Your judgment of the quality of the evidence, including risk of bias .

You should collect this information using forms. You can find sample forms in The Registry of Methods and Tools for Evidence-Informed Decision Making and the Grading of Recommendations, Assessment, Development and Evaluations Working Group .

Extracting the data is also a three-person job. Two people should do this step independently, and the third person will resolve any disagreements.

They also collected data about possible sources of bias, such as how the study participants were randomized into the control and treatment groups.

Step 6: Synthesize the data

Synthesizing the data means bringing together the information you collected into a single, cohesive story. There are two main approaches to synthesizing the data:

  • Narrative ( qualitative ): Summarize the information in words. You’ll need to discuss the studies and assess their overall quality.
  • Quantitative : Use statistical methods to summarize and compare data from different studies. The most common quantitative approach is a meta-analysis , which allows you to combine results from multiple studies into a summary result.

Generally, you should use both approaches together whenever possible. If you don’t have enough data, or the data from different studies aren’t comparable, then you can take just a narrative approach. However, you should justify why a quantitative approach wasn’t possible.

Boyle and colleagues also divided the studies into subgroups, such as studies about babies, children, and adults, and analyzed the effect sizes within each group.

Step 7: Write and publish a report

The purpose of writing a systematic review article is to share the answer to your research question and explain how you arrived at this answer.

Your article should include the following sections:

  • Abstract : A summary of the review
  • Introduction : Including the rationale and objectives
  • Methods : Including the selection criteria, search method, data extraction method, and synthesis method
  • Results : Including results of the search and selection process, study characteristics, risk of bias in the studies, and synthesis results
  • Discussion : Including interpretation of the results and limitations of the review
  • Conclusion : The answer to your research question and implications for practice, policy, or research

To verify that your report includes everything it needs, you can use the PRISMA checklist .

Once your report is written, you can publish it in a systematic review database, such as the Cochrane Database of Systematic Reviews , and/or in a peer-reviewed journal.

In their report, Boyle and colleagues concluded that probiotics cannot be recommended for reducing eczema symptoms or improving quality of life in patients with eczema. Note Generative AI tools like ChatGPT can be useful at various stages of the writing and research process and can help you to write your systematic review. However, we strongly advise against trying to pass AI-generated text off as your own work.

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

  • Student’s  t -distribution
  • Normal distribution
  • Null and Alternative Hypotheses
  • Chi square tests
  • Confidence interval
  • Quartiles & Quantiles
  • Cluster sampling
  • Stratified sampling
  • Data cleansing
  • Reproducibility vs Replicability
  • Peer review
  • Prospective cohort study

Research bias

  • Implicit bias
  • Cognitive bias
  • Placebo effect
  • Hawthorne effect
  • Hindsight bias
  • Affect heuristic
  • Social desirability bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

A systematic review is secondary research because it uses existing research. You don’t collect new data yourself.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Turney, S. (2023, November 20). Systematic Review | Definition, Example & Guide. Scribbr. Retrieved August 21, 2024, from https://www.scribbr.com/methodology/systematic-review/

Is this article helpful?

Shaun Turney

Shaun Turney

Other students also liked, how to write a literature review | guide, examples, & templates, how to write a research proposal | examples & templates, what is critical thinking | definition & examples, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

DistillerSR Logo

About Systematic Reviews

Are Systematic Reviews Qualitative or Quantitative?

a systematic qualitative literature review

Automate every stage of your literature review to produce evidence-based research faster and more accurately.

A systematic review is designed to be transparent and replicable. Therefore, systematic reviews are considered reliable tools in scientific research and clinical practice. They synthesize the results using multiple primary studies by using strategies that minimize bias and random errors. Depending on the research question and the objectives of the research, the reviews can either be qualitative or quantitative. Qualitative reviews deal with understanding concepts, thoughts, or experiences. Quantitative reviews are employed when researchers want to test or confirm a hypothesis or theory. Let’s look at some of the differences between these two types of reviews.

To learn more about how long it takes to do a systematic review , you can check out the link to our full article on the topic.

Differences between Qualitative and Quantitative Reviews

The differences lie in the scope of the research, the methodology followed, and the type of questions they attempt to answer. Some of these differences include:

Research Questions

As mentioned earlier qualitative reviews attempt to answer open-ended research questions to understand or formulate hypotheses. This type of research is used to gather in-depth insights into new topics. Quantitative reviews, on the other hand, test or confirm existing hypotheses. This type of research is used to establish generalizable facts about a topic.

Type of Sample Data

The data collected for both types of research differ significantly. For qualitative research, data is collected as words using observations, interviews, and interactions with study subjects or from literature reviews. Quantitative studies collect data as numbers, usually from a larger sample size.

Data Collection Methods

To collect data as words for a qualitative study, researchers can employ tools such as interviews, recorded observations, focused groups, videos, or by collecting literature reviews on the same subject. For quantitative studies, data from primary sources is collected as numbers using rating scales and counting frequencies. The data for these studies can also be collected as measurements of variables from a well-designed experiment carried out under pre-defined, monitored conditions.

Data Analysis Methods

Data by itself cannot prove or demonstrate anything unless it is analyzed. Qualitative data is more challenging to analyze than quantitative data. A few different approaches to analyzing qualitative data include content analysis, thematic analysis, and discourse analysis. The goal of all of these approaches is to carefully analyze textual data to identify patterns, themes, and the meaning of words or phrases.

Quantitative data, since it is in the form of numbers, is analyzed using simple math or statistical methods. There are several software programs that can be used for mathematical and statistical analysis of numerical data.

Presentation of Results

Learn more about distillersr.

(Article continues below)

a systematic qualitative literature review

Final Takeaway – Qualitative or Quantitative?

3 reasons to connect.

a systematic qualitative literature review

  • Locations and Hours
  • UCLA Library
  • Research Guides
  • Biomedical Library Guides

Systematic Reviews

  • Types of Literature Reviews

What Makes a Systematic Review Different from Other Types of Reviews?

  • Planning Your Systematic Review
  • Database Searching
  • Creating the Search
  • Search Filters and Hedges
  • Grey Literature
  • Managing and Appraising Results
  • Further Resources

Reproduced from Grant, M. J. and Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26: 91–108. doi:10.1111/j.1471-1842.2009.00848.x

Aims to demonstrate writer has extensively researched literature and critically evaluated its quality. Goes beyond mere description to include degree of analysis and conceptual innovation. Typically results in hypothesis or mode Seeks to identify most significant items in the field No formal quality assessment. Attempts to evaluate according to contribution Typically narrative, perhaps conceptual or chronological Significant component: seeks to identify conceptual contribution to embody existing or derive new theory
Generic term: published materials that provide examination of recent or current literature. Can cover wide range of subjects at various levels of completeness and comprehensiveness. May include research findings May or may not include comprehensive searching May or may not include quality assessment Typically narrative Analysis may be chronological, conceptual, thematic, etc.
Mapping review/ systematic map Map out and categorize existing literature from which to commission further reviews and/or primary research by identifying gaps in research literature Completeness of searching determined by time/scope constraints No formal quality assessment May be graphical and tabular Characterizes quantity and quality of literature, perhaps by study design and other key features. May identify need for primary or secondary research
Technique that statistically combines the results of quantitative studies to provide a more precise effect of the results Aims for exhaustive, comprehensive searching. May use funnel plot to assess completeness Quality assessment may determine inclusion/ exclusion and/or sensitivity analyses Graphical and tabular with narrative commentary Numerical analysis of measures of effect assuming absence of heterogeneity
Refers to any combination of methods where one significant component is a literature review (usually systematic). Within a review context it refers to a combination of review approaches for example combining quantitative with qualitative research or outcome with process studies Requires either very sensitive search to retrieve all studies or separately conceived quantitative and qualitative strategies Requires either a generic appraisal instrument or separate appraisal processes with corresponding checklists Typically both components will be presented as narrative and in tables. May also employ graphical means of integrating quantitative and qualitative studies Analysis may characterise both literatures and look for correlations between characteristics or use gap analysis to identify aspects absent in one literature but missing in the other
Generic term: summary of the [medical] literature that attempts to survey the literature and describe its characteristics May or may not include comprehensive searching (depends whether systematic overview or not) May or may not include quality assessment (depends whether systematic overview or not) Synthesis depends on whether systematic or not. Typically narrative but may include tabular features Analysis may be chronological, conceptual, thematic, etc.
Method for integrating or comparing the findings from qualitative studies. It looks for ‘themes’ or ‘constructs’ that lie in or across individual qualitative studies May employ selective or purposive sampling Quality assessment typically used to mediate messages not for inclusion/exclusion Qualitative, narrative synthesis Thematic analysis, may include conceptual models
Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research Completeness of searching determined by time constraints Time-limited formal quality assessment Typically narrative and tabular Quantities of literature and overall quality/direction of effect of literature
Preliminary assessment of potential size and scope of available research literature. Aims to identify nature and extent of research evidence (usually including ongoing research) Completeness of searching determined by time/scope constraints. May include research in progress No formal quality assessment Typically tabular with some narrative commentary Characterizes quantity and quality of literature, perhaps by study design and other key features. Attempts to specify a viable review
Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives Aims for comprehensive searching of current literature No formal quality assessment Typically narrative, may have tabular accompaniment Current state of knowledge and priorities for future investigation and research
Seeks to systematically search for, appraise and synthesis research evidence, often adhering to guidelines on the conduct of a review Aims for exhaustive, comprehensive searching Quality assessment may determine inclusion/exclusion Typically narrative with tabular accompaniment What is known; recommendations for practice. What remains unknown; uncertainty around findings, recommendations for future research
Combines strengths of critical review with a comprehensive search process. Typically addresses broad questions to produce ‘best evidence synthesis’ Aims for exhaustive, comprehensive searching May or may not include quality assessment Minimal narrative, tabular summary of studies What is known; recommendations for practice. Limitations
Attempt to include elements of systematic review process while stopping short of systematic review. Typically conducted as postgraduate student assignment May or may not include comprehensive searching May or may not include quality assessment Typically narrative with tabular accompaniment What is known; uncertainty around findings; limitations of methodology
Specifically refers to review compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results Identification of component reviews, but no search for primary studies Quality assessment of studies within component reviews and/or of reviews themselves Graphical and tabular with narrative commentary What is known; recommendations for practice. What remains unknown; recommendations for future research
  • << Previous: Home
  • Next: Planning Your Systematic Review >>
  • Last Updated: Jul 23, 2024 3:40 PM
  • URL: https://guides.library.ucla.edu/systematicreviews

Banner

Systematic Review: Home

  • Systematic Reviews using PubMed
  • Systematic Reviews using Covidence
  • Literature search
  • Referencing tools
  • Recommended books on Systematic Review

Systematic Reviews

What is a systematic review.

A systematic literature review is a method of synthesising scientific evidence and ensuring the quality of this evidence to answer a particular research question transparently and reproducibly. An accurate Systematic review includes all available published outputs on the topic (Guillaume, 2019).

Types systematic review

1. Scoping review A scoping review is a preliminary assessment of the potential size and scope of available research literature. It aims to identify the nature and extent of research evidence (usually including ongoing research).

2. Rapid review Rapid reviews assess what is already known about a policy or practice issue. They use systematic review methods to search for and critically appraise existing research.

3. Narrative review Also called a literature review. It synthesises primary studies and explores this through description rather than statistics. Library support for literature review can be found in this guide.

4. Meta-analysis A meta-analysis statistically combines the results of quantitative studies to provide a more precise effect on the results. This type of study examines data from multiple studies on the same subject to determine trends.

5. Mixed methods/mixed studies Refers to any combination of methods where one significant component is a literature review (usually systematic review).

  • Next: Systematic Reviews using PubMed >>
  • Last Updated: Jul 31, 2024 3:00 PM
  • URL: https://libguides.nwu.ac.za/systematic-review
  • Systematic Review
  • Open access
  • Published: 14 August 2024

Experiences of informal caregivers supporting individuals with upper gastrointestinal cancers: a systematic review

  • Melinda Furtado   ORCID: orcid.org/0000-0001-5472-4707 1 ,
  • Dawn Davis 1 ,
  • Jenny M. Groarke 1 , 2 &
  • Lisa Graham-Wisener 1  

BMC Health Services Research volume  24 , Article number:  932 ( 2024 ) Cite this article

143 Accesses

Metrics details

Upper gastrointestinal cancers (UGICs) are increasingly prevalent. With a poor prognosis and significant longer-term effects, UGICs present significant adjustment challenges for individuals with cancer and their informal caregivers. However, the supportive care needs of these informal caregivers are largely unknown. This systematic review of qualitative studies synthesises and critically evaluates the current evidence base on the experience of informal caregivers of individuals with UGIC.

A Joanna Briggs Institute systematic review was conducted. Searches were performed in four databases (MEDLINE, PsycINFO, Embase, CINAHL) from database inception to February 2021. Included studies explored experiences of informal caregivers of individuals diagnosed with primary cancer of the oesophagus, stomach, pancreas, bile duct, gallbladder, or liver. Studies were independently screened for eligibility and included studies were appraised for quality by two reviewers. Data were extracted and synthesised using meta-aggregation.

19 papers were included in this review, and 328 findings were extracted. These were aggregated into 16 categories across three findings: (1) UGIC caregiver burden; UGIC caregivers undertake extensive responsibilities, especially around patient diet as digestion is severely impacted by UGICs. (2) Mediators of caregiver burden; The nature of UGICs, characterised by disruptive life changes for caregivers, was identified as a mediator for caregiver burden. (3) Consequences of caregiver burden: UGIC caregivers’ experiences were shaped by unmet needs, a lack of information and a general decline in social interaction.

Conclusions

The findings of this review suggest the need for a cultural shift within health services. Caregiving for UGIC patients is suggested to adversely affect caregivers’ quality of life, similarly to other cancer caregiving populations and therefore they should be better incorporated as co-clients in care-planning and execution by including them in discussions about the patient’s diagnosis, treatment options, and potential side effects.

Peer Review reports

The National Institute for Clinical Excellence (NICE) [ 1 ] define upper gastrointestinal cancers (UGICs) as cancers of the oesophagus, stomach, pancreas, bile duct/gallbladder, or liver. Of all new cancer diagnoses in 2020 globally, 16.6% were UGICs [ 2 ]. Incidence of UGICs is increasing in countries under economic transition, and in Western countries due to heightened exposure to certain risk factors [ 3 ]. Overall prevalence of UGICs is also expected to rise annually with growing life expectancy and improved diagnostics [ 4 ]. Despite this, UGICs still have a uniquely poor prognosis in comparison to other cancer populations [ 5 ]. UGICs do not typically benefit from screening programmes and individuals are more likely to present at diagnosis with advanced disease [ 6 ]. This is compounded by a high rate of recurrence for individuals able to receive curative treatment [ 7 , 8 , 9 ]. As a result, UGICs persistently account for a significant proportion of global cancer deaths; 27.1% in 2020 [ 2 ]. Poor prognosis contributes significantly to the heightened disease burden of UGIC, alongside increased utilisation of health services due to the complexity of the treatment trajectory and symptom management [ 10 , 11 ]. In comparison to other cancer populations, having UGIC is associated with late consultation with palliative care services [ 12 ] meaning patients and their families have delayed access, if any, to supportive interventions such as counselling, psycho-education, financial advice and structured family meetings [ 13 ].

The supportive care needs of the sizeable population of individuals with UGIC are considerable, with sustained late and longer-term effects. In addition to the common sequalae from cancer diagnosis and treatment, disruption to the digestive system presents problems with swallowing, nausea and keeping food down, a modified diet, extreme changes in weight, chronic pain and living with a stoma [ 14 , 15 ]. The poor prognosis and longer-term effects present a challenge in adjustment both for the individual with UGIC and their informal caregiver, defined as “close persons” who may be related to the diagnosed individual (siblings, relatives, or spouses) or not (friends, neighbours). A caregiver is anyone identified as such by the patient to provide unpaid ongoing care and support [ 16 ]. Examples of challenges for caregivers include learning new practical skills such as managing negative responses to foods, providing a new diet, monitoring weight changes, chronic pain management and stoma management [ 17 , 18 ]. With biomedical advances leading to a reduction in hospital stay length [ 19 ], there is increasing emphasis placed on the role of the UGIC caregiver to provide support to the individual with cancer in the community.

This unique caregiver population face distinct challenges which contribute to caregiver burden which reflects the need for further research into their experiences. For example, due to changes in the diet of the individual with UGIC, the social aspect of dining for both is compromised and can lead to feelings of loneliness, anxiety, and shame [ 20 , 21 ]. Evidence of caregiver burden is suggested by high levels of anxiety and depression. In caregivers of post-treatment oesophageal cancer patients, 30% of caregivers reported moderate-high levels of anxiety and 10% reported moderate-high levels of depression, alongside a significant fear of recurrence [ 22 ]. Research suggests that UGIC caregivers may experience higher levels of psychological distress than the individual with UGIC, and that clinical levels of anxiety and depression may be sustained in the longer-term [ 22 , 23 ]. However it is worth noting that a lot of the effects of UGIC caregiving acknowledged in the literature are consistent with the general experience of informally providing care and as such there is scope to apply the beneficial practices from other settings (both extra-GI cancer and non-cancer).

It is crucial that we recognise the role of caregivers as co-clients and understand the experiences of this significant caregiver population. Caregivers’ personal experiences are inherently subjective, and due to this subjective nature, a qualitative research approach is optimal [ 24 ]. A synthesis of existing qualitative studies will help to establish a knowledge base on the experience of informal caregivers of individuals with UGIC and will help to inform the provision for supportive care. An initial search of PROSPERO, MEDLINE, the Cochrane Database of Systematic Reviews and the Joanna Briggs Institute (JBI) Database of Systematic Reviews and Implementation Reports was conducted and no current or underway systematic reviews on the topic were identified.

This qualitative systematic review aims to synthesise the best available evidence on the experiences of informal caregivers supporting individuals diagnosed with UGIC.

This systematic review was conducted following the JBI approach to qualitative systematic reviews [ 25 ]. A protocol was pre-registered in PROSPERO (registration number CRD42021235354). The systematic review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement [ 26 ].

Search strategy

An initial limited search of MEDLINE (Ovid) and PsycINFO (Ovid) was undertaken using the following keywords: Oesophageal cancer OR Stomach cancer OR Gastrointestinal cancer OR pancreas cancer OR gallbladder cancer OR liver cancer AND caregiver AND Qualitative. The text words contained in the titles and abstracts of relevant articles, and the index terms used to describe the articles were used to develop a full search strategy for MEDLINE and adapted for the other databases.

The final search strategy (Additional information 1 ) was then employed against four databases: MEDLINE (Ovid), PsycINFO (Ovid), Embase (Elsevier) and CINAHL (EBSCOhost). Each database was searched on 12th February 2021.

Study selection

Following the formal searches, all identified citations were collated and uploaded into Endnote [ 27 ] to identify and remove duplicates. Rayyan reference management software [ 28 ] was then used by independent two reviewers (DD, MF) to screen titles and abstracts against the eligibility criteria. Potentially relevant articles were retrieved in full and screened against the eligibility criteria by two independent reviewers (DD, MF). Reasons for exclusion of papers at full text review were recorded. Any disagreements that arose between the reviewers at each stage of the selection process was resolved through discussion (DD, MF), or with an additional reviewer (LGW). The reference list and citation list of all eligible articles was searched for additional studies.

Inclusion and exclusion criteria

This review included studies exploring experiences of adults (≥ 18 years of age) who are informal caregivers of individuals diagnosed with UGIC at any stage within the disease process. This included those diagnosed with cancer of the oesophagus, stomach, pancreas, bile duct, gallbladder, or liver [ 1 ]. This diagnosis must be the primary cancer site. Studies involving informal caregivers of individuals who had secondary gastrointestinal system metastases were not included.

A caregiver is anyone identified as such by the patient to provide unpaid ongoing care and support [ 16 ]. Paid professional caregivers were not included. The caregivers included provided various services, such as practical (providing transport, overseeing meals) or emotional support roles in caring for the patient. Caregivers with any gender or ethnicity were considered for inclusion. Both active and bereaved caregivers were eligible, if discussing their pre-bereavement experience.

Studies which reviewed experiences of multiple groups (e.g., patients, caregivers, healthcare professionals) or multiple cancers beyond the remit of UGIC were included, provided the data pertaining to informal caregivers and UGICs was clearly delineated and could be extracted separately. Where data was hard to distinguish regarding participant-type or cancer-type, the study was only included if at least 50% of the sample size was drawn from the target population.

Phenomena of interest

The review included qualitative studies that looked at caregivers’ experiences of caring for an individual with UGIC.

Studies for inclusion were based in any geographic location or setting. All care contexts were considered relevant (e.g., primary care, secondary, tertiary, community, or home settings).

Types of studies

Research studies considered for inclusion were focused on qualitative data including, but not limited to; designs such as phenomenology, grounded theory, ethnography, action research and feminist research. Mixed method studies were considered relevant if data from the qualitative component could be clearly extracted. Only English language studies were included.

Only empirical studies published in peer-reviewed journals were included. There was no restriction on publication year. Systematic reviews were not included, however relevant studies were harvested from them, when relevant. Editorials, opinion papers, case studies and any articles without relevant, original data were excluded, alongside grey literature.

Quality Appraisal

Subsequently, two independent reviewers (DD, MF) critically appraised the included studies to evaluate the strength of the evidence for methodological quality using the JBI Critical Appraisal Checklist for Qualitative Research [ 29 ]. All studies, regardless of the results of their methodological quality, underwent data extraction and synthesis. One of the included studies employed use of free-test questionnaires [ 30 ], the robustness of which has been called into question by qualitative researchers as the data generated from these responses is rarely rich enough to provide the necessary strong insights [ 31 ]. However, the reviewers felt the robustness of this study was upheld by the fact that the researchers conducted a comprehensive search on existing literature prior to data collection, thus allowing questionnaire findings to be scaffolded onto existing conceptual frameworks.

Data extraction

Data were extracted using standardized JBI data extraction tool [ 32 ] by two independent reviewers (DD, MF). Each undertook data extraction for half of the articles and then checked the other reviewer’s data extraction. The extracted data included specific details about the population, context, study methods and the phenomena of interest relevant to the review objective. Disagreements between the reviewers were resolved through discussion. Four authors of papers were contacted to request missing or additional data for clarification mainly regarding breakdown of participant populations by cancer type of which no new information arose.

A finding is defined by the JBI as “a verbatim extract of the author’s analytic interpretation accompanied by either a participant voice, or fieldwork observations or other data.” [ 33 , p40]. Findings were identified through repeated reading of the text, and extraction of findings included any distinct analytic observation reported by authors with an accompanying illustration (Additional information 2 ).

Data synthesis

Each finding was identified by an alphanumeric code (e.g., A1, A2, B1, etc.). Each letter corresponded to a study and each number to a unique finding. The progressive numbers indicate the order of the findings within the original article. Each finding was rated with one of three levels of credibility as per the ConQual system [ 34 ]:

Unequivocal - findings accompanied by an illustration that is beyond reasonable doubt and therefore not open to challenge.

Credible - findings accompanied by an illustration lacking clear association with it and therefore open to challenge.

Not Supported - findings are not supported by the data.

Qualitative research findings were pooled with the meta-aggregation approach and captured in a Microsoft Excel spreadsheet [ 33 ]. Findings were aggregated by assembling the findings and categorizing these findings based on similarity in meaning, then labelling the categories accordingly. Categories were then synthesised to produce a comprehensive set of synthesized findings. Two reviewers (DD, MF) repeatedly read the findings and developed a set of categories. To assess the quality and confidence of each qualitative finding synthesised within this review, authors utilised the ConQual system (Additional information 3 ), a tool used to assign ratings of confidence in synthesised qualitative research findings [ 34 ]. Only unequivocal and credible findings were included in the synthesis.

The combined database searches yielded 5465 records. After removing duplicates and screening studies against eligibility criteria (Fig.  1 ), the review included 19 studies [ 18 , 30 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 ]. Additional information 4 displays the characteristics of the 19 included studies.

figure 1

PRISMA flowchart of study selection process

Description of included studies

All included studies were published between 2004 and 2021. Most commonly, studies focused on caregivers of individuals with oesophageal cancer ( N  = 7), or pancreatic ( N  = 7), including one study of pancreatic and bile duct cancer. Other studies included caregivers of individuals with liver cancer ( N  = 2), gastric cancer ( N  = 1) and the gastrointestinal tract generally ( N  = 2). Geographically, studies were conducted in eight regions. The largest group ( N  = 6) were conducted in the US [ 35 , 37 , 38 , 39 , 40 , 41 ], followed by Denmark ( N  = 3) [ 42 , 43 , 44 ]. Most samples included a variety of within-family caregivers ( N  = 13), generally spouses/partners, children, and siblings. Others ( N  = 3) looked specifically at spouses and three did not specify the caregiver-patient relationship. Most studies included a semi-structured interview format ( N  = 12), others used focus groups ( N  = 4), secondary analysis of existing data ( N  = 2) or questionnaires ( N  = 1).

Quality of included studies

The JBI Critical Appraisal Checklist [ 25 ] was used to establish the quality of the research. The included studies were generally of good quality, with all 19 papers achieving at least 60% across the ten JBI quality assessment criteria (Additional information 5 ). Within the JBI checklist there are five questions assessing study dependability, where the studies performed at a lower satisfactory level. Of the included papers, two achieved a 5/5 score on dependability questions, seven achieved 4/5, nine scored 3/5 and one scored 2/5. Only 26% of studies could adequately locate the researcher(s) culturally or theoretically and only 37% of papers addressed the influence of the researcher on the research and vice-versa. Conversely, nearly all papers adequately addressed the research methodology’s congruity on objectives, data collection, data representation and analysis.

Meta-aggregation findings

Across the 19 studies, 328 supported findings were extracted, of which 239 were unequivocal and 89 were credible. Findings could be aligned into 23 categories with unique core meanings, which were then synthesised into three findings: (1) UGIC caregiver burden; (2) Mediators of caregiver burden; (3) Consequences of caregiver burden (Additional information 6 ). Figure  2 outlines how the categories relate to the overarching synthesised findings. To remain grounded in the data, the actual participants’ words are used throughout the narrative and double quotation marks illustrate a direct caregiver quote. References given after a quotation links the quote to the study as outlined in Additional information 2 .

figure 2

Structural arrangement of categories and synthesised findings

Synthesised finding 1: UGIC caregiver burden

As caregivers began supporting those with UGIC, they faced numerous challenges to adjustment. This largely stemmed from efforts to integrate a broad and complex caregiving role within their existing routine. Difficulties such as disruption to daily routines and meals impacted caregivers’ psychological wellbeing. Caregivers were often unprepared for this life disruption, leading them to seek out information from which to learn and distribute to others.

1. Breadth of the caregiver role

The extent of responsibilities on UGIC caregivers was perceived as broad and complex, with an ‘all encompassing’ focus on patient outcomes. UGIC caregivers ‘assume different roles’ [ 42 ].

“The food thing is omnipresent. We have been told that he is not allowed to have further weight loss (K23).

Specific responsibilities included working around reduced appetite and oral intake; monitoring physical signs e.g., patient weight; perioperative management such as care of surgical wounds and organising medical appointments and treatments.

“We’d have to keep. . .going with all the medical appointments and surgery and treatment” (B11).

2. Challenges around patients’ meals

Treatment for and progression of UGIC severely impacts the patient’s relationship with food; with diet quantity and content at times significantly altered. Adaption for the caregiver involved learning about dietary modifications and management of digestive symptoms such as dysphagia. Several studies found that the new dietary restrictions were a source of worry for caregivers regarding the patients’ weight [ 44 , 45 , 46 , 47 ]. The social importance of food was a common theme throughout the included studies, with interruption to established social norms perceived as distressing. Mealtimes are considered a ‘unifying family ritual’ [ 49 ], but when mealtimes constantly serve to remind caregivers of their responsibility of monitoring, they became a potential source of distress.

“I can’t get Bernard out of the small meals. . I have to ring him every day from work to tell him to eat” (A7).

3. Life disruption

UGIC was experienced as coming unexpectedly into caregivers’ lives, intruding on their existing routines, for instance, as working professionals or parents. Caregivers described their responsibilities as time and energy-consuming. This conflict caused caregivers to feel a loss of control [ 44 ]. Caregiving responsibilities for UGICs demanded commitment over a long-time frame, impacting caregivers’ employability and their ‘own social life’ [ 35 ]:

“It’s changed my daily routine. It totally disrupted my life. I have to rearrange a lot of things such as my kids , my work , and getting help for my house cleaning” (J4).

4. Unpreparedness

Caregivers expressed being ill-equipped and unqualified to manage the needs of the UGIC patient. Caregivers reported feeling out of their depth, partially attributed to the lack of available support, relating to patients’ medical requirements:

“I went , ‘You’re not supposed to call 911? What am I supposed to do? What if he just dies right here?’ I mean , it seems they should have somebody say , ’OK , if he’s with you , then here’s the procedure…[The nurse] gave me really no support about what to do” (R21).

Caregivers sometimes felt misled about the extent of their new responsibilities, as while the patient was cared for in hospital by medical staff, they could not gauge what caregiving at home would involve.

“I wish they would have talked to me about it as well… it was a bit of a shock. …but the next morning it all dawned on me that I had just replaced a whole team” (E10).

5. Information manager

Caregivers perceived a key responsibility was to make executive decisions in the dissemination of information, for instance symptomatology, treatment plans and prognosis. Caregivers felt they were the ‘conduit’ [ 18 ] through which medical details were communicated to members of the extended social circle, a time-consuming role where they spent “hours on the phone telling everyone what is happening” (I32).

The caregivers also viewed their role as giving healthcare providers (HCPs) valuable insight into how the patient was coping outside of the medical setting:

“[describing a discussion during a clinical consultation , contradicting the patient] It is not correct that you almost eat as usual. You are eating food of more liquid substance than you usually do and your drinks are high-protein” (C1).

Synthesised finding 2: mediators of caregiver burden

While supporting patients with UGIC, caregivers are exposed to mediators which could increase or reduce caregiver burden, including their use of coping strategies, financial and social resources, and their caregiving context. For instance, higher levels of social support helped alleviate some caregiver burden. Similarly, how excluded a caregiver felt in the medical setting influenced the burden experienced.

1. Degree of inclusion in medical settings

Many studies reported that caregivers perceived they are often kept at a distance in medical settings, increasing caregiver burden. Although some caregivers felt this was fitting and chose to take a ‘subordinate position’ [ 44 ], others struggled with a sense of exclusion, which commonly left unresolved questions:

“…my husband could ask questions , but I didn’t have the space to ask questions , not unless my husband allowed it” (K39).

In such cases, caregivers relied on HCPs’ judgement. Caregivers described only being ‘seen’ if they actively called attention to themselves [ 41 ]. Caregivers experienced being left out of important decisions.

Caregivers expressed wanting to ask questions without the patient present but felt they had no opportunity to directly communicate with HCPs. This pervasive, default invisibility was perceived as disempowering:

“No health professionals involved me in this decision” (K38).

2. Social resources

The degree and quality of support received by caregivers varied and shaped their overall caring experience. The support network is especially beneficial for normalisation of caregivers’ experiences, providing hope and reducing feelings of isolation.

“it was only when I came here that I started talking to people … it was just like a breath of fresh air. . this dumping syndrome , he [the patient] wasn’t the only one” (A10).

Support could be from spiritual groups ( “I have a lot of people that stand behind me…” (B19), empathetic HCPs ( “It’s easier to talk with a nurse when it concerns important questions. You may receive quite good and reassuring answers” (H22) or peers who have undergone a similar caregiving experience, and therefore could reliably address and empathise with caregivers’ challenges.

3. Financial resources

Caregivers reported financial pressure as they had to consider the dyad’s financial situation while one or both members may not be able to work. Providing full-time care was a drain on caregivers’ resources, time, and money. Caregivers struggled with financial planning for the future in the face of prognostic ambiguity.

“We talked about if we should stay on at the house or sell it” (K6).

There were additional pressures on dyads living in countries where utilisation of private health services is the norm.

“Now my grandmother is sick and I can understand how high is the cost of the disease” (D5).

4. Patient-caregiver relationship

The caregiving experience was shaped by the inter-dyad relationship. Some caregivers reported having an emotionally distant relationship with the patient before the diagnosis which led to poor attachment during the cancer trajectory. Others reported a decline in the relationship quality due to cancer-related pressures.

“When I got upset , I would say to my husband , ‘You got cancer because you didn’t listen to me! You deserve it!” (F35).

Others noted a shift within the relationship, transitioning from ‘caregiver’ to ‘curer’ or from a spousal role to a parental one [ 45 ] especially where the caregiver was actively involved in delivering treatment:

“Sometimes I felt like a mother talking to a child: ‘Remember to do this and that’ ” (K29).

Caregivers experienced reciprocal suffering when seeing the patient suffer, especially if an established close relationship existed:

“up when the patient is up and down when the patient is down” (I21).

5. Emotion-focused coping

The cancer experience was perceived to result in significant distress for caregivers. To address this challenge, caregivers engaged in positive emotion-focused coping strategies to directly regulate distress. Many caregivers reported trying to maintain positive thinking. One participant recalled using humour:

“Sometimes you can’t believe what happens and the only thing you can do is laugh” (I41).

Maintaining a positive outlook was perceived to involve “looking for the good in every situation” and by being selective about what news caregivers received through ‘denial’ and “choosing what to hear” (I44). Conversely, another study described positivity as an open-minded reflection on the conflict between current suffering and spiritual beliefs [ 38 ]. Caregivers described how formally addressing their feelings through therapy was also helpful.

Individuals were limited in their opportunity for emotional expression. Caregivers described hiding their own negative thoughts from the patient and took practical measures to divert the patient’s attention by doing “normal things like [going] for a drive and [having] visits from our children and grandchildren” (C15).

6. Information seeking

Caregivers perceived challenges around a lack of information from HCPs regarding UGIC’s pathology and related management options. The experiences of caregivers included difficulties in accessing information.

“We have little information in these areas. When we go to the physician’s office for treatment , the doctor is too busy to give us information in this regard and he merely visits the patients. When we see that nobody could survive from such diseases , we get worried more” (D9).

Caregivers addressed the information challenge by persistently seeking information relating to the disease itself, namely cancer-related symptomatology, prognosis, and treatment options (including alternative therapies). Caregivers referred to sources like medically knowledgeable peers, the internet and print (e.g., encyclopaedias). HCPs were trusted for honest information, with their word choices and body language carefully analysed:

“When my husband and I visit the doctor together , you see when he opens the door that there is no good news today” (H6).

Caregivers were especially empowered when they could differentiate between symptoms due to disease progression and treatment-related adverse effects.

Synthesised finding 3: consequences of caregiver burden

There were consequences of caregiver burden such as feelings of helplessness, distress, anger, guilt and a strong fear of losing the patient. Conversely, there was potential for positive outcomes as caregivers experienced growth and feelings of hope.

1. Distress and helplessness

When recounting the most involved phase of providing care, active treatment, many caregivers reported experiencing heightened distress. One caregiver perceived gastric cancer a ‘death sentence’ [ 49 ], and seeing the patient struggle with the effects of disease and treatments an unbearably ‘ challenging experience’ [ 40 ]. This distress also affected children with one spouse noting their child’s “grades dropped disastrously during his first term” (H14).

Helplessness originates from a lack of control over the disease progression. A particular source of distress were the delays along the cancer trajectory, especially at diagnosis due to the ambiguous presentation of UGICs and lack of control over symptom management.

“It is distressing seeing him in pain all the time” (E6).

2. Anger and guilt

Caregivers experienced a sense of guilt and anger because they perceived stigma from society towards certain cancers. Others may assume that the diagnosis was caused by the patient’s behaviours and therefore indirectly the caregiver may also have been involved. A few studies described this judgement from society towards the patient, with caregivers fearing that others would see the diagnosis as a justified fate:

“You know , when you say cirrhosis of the liver , they think , ‘Oh , you drank yourself’” (R7).

Caregivers also harboured anger at being forced to take on caregiving responsibilities, describing they had “been dealt a bad hand” (I39); however, they felt guilty for feeling this way.

3. Fear of cancer progression and recurrence

Due to the unpredictability of UGICs, caregivers described living in constant dread of the patient’s health declining, and the potential for disease progression or recurrence:

“I am not sure I am going to like the answers I get. Maybe it is better not to know so very much but to do like the ostrich , to bury your head in the sand and hope for the best and keep your fingers crossed” (H41).

Caregivers were fearful of any new physical or psychological symptoms in patients, especially weight-loss, as caregivers saw this as a marker of recurrence. Further, caregivers feared the cancer would progress to a terminal stage which meant they were afraid of the means through which the bereavement would occur and their own subsequent reaction.

“the fear of not being sure of how it’s going to happen and how I’m going to react…I’m afraid of losing him” (L1).

The high mortality associated with most UGICs caused several caregivers to experience acceptance, with the realisation of the long-term impact of their loved one’s cancer and possibility of bereavement.

“The possibility is there for one of us dying quickly” (K5).

4. Isolation and loneliness

Caregivers commonly reported experiencing isolation within their unique role, feeling unable to share their anxieties. As patients were burdened already, caregivers did not want to unload their own worries on to the patient.

“And I had nobody to talk to…There was just nobody. I couldn’t let myself down , my guard down and I found the isolation terrible” (A3).

Loneliness was not only an ongoing concern, but a future threat as spousal caregivers relayed their fear of life post-bereavement.

5. Personal growth

Caregivers reflected that they saw the experience of caregiving as a catalyst for personal change, resulting in positive outcomes such as personal growth and appreciation for life, individually and within the relationship. Caregivers recounted that this unexpected, immense challenge had given them ‘ new perspectives about life’ [ 35 ]. Couples got to spend time together that they would not have had otherwise which led to an improved quality of relationship.

“We’ll talk three or four times a month. Where 10 years ago it might be 6 months or 10 months you know between phone calls” (B14).

The current study presents the first comprehensive synthesis of qualitative research on the experiences of caregivers of individuals with UGICs. This review is the first to systematically identify and synthesise the current evidence base on the experiences of informal caregivers of individuals with UGIC. Given the emergence of this prominent caregiver population, this review contributes to advancing cancer caregiver literature as a whole, an important area of study recognised by individuals with cancer, their family and healthcare professionals [ 52 ]. The review included 19 studies, presented synthesised findings, and identified aspects of caregiving experiences that UGIC caregivers have in common with other cancer caregivers, and aspects more distinct to UGICs. UGIC caregivers experience significant challenges contributing to high levels of burden which are mediated by social, psychological, and practical resources, as well as aspects of health service delivery. The consequences of caregiver burden are primarily negative, including distress, anger, fear, and loneliness.

Caregivers of UGIC patients experienced burden due to the breath and complexity of their role for which they felt unprepared. Caring involved incorporating novel skills into existing responsibilities, causing significant life disruption. Caregivers perceive burden in providing multifaceted care with demands that shift along the illness trajectory. For example, in the beginning caregivers felt it necessary to partake in provision of care, and due to UGIC treatment and disease progression, many responsibilities evolved to monitor and maximise physical health, such as diligent weight monitoring and meal preparation [ 45 , 46 , 47 ]. These findings align to the general cancer caregiver literature [ 53 ], with caregivers recognised in having steep initial learning curves to rapidly acquire skills to provide care. Only one of the 19 studies evaluated data over an extended period [ 45 ]. An extended review is needed to map supportive care resources available across the disease path and longitudinal studies tracking UGIC caregiver support needs across the illness trajectory is warranted.

One of the most reported findings in this review was informal caregivers’ continuous search for information related to their role. Many struggle to satisfy their informational needs at different stages of the disease trajectory contributing to caregiver burden. This corresponds with systematic review findings of Wang et al. [ 54 ] that informational needs were the most common unmet need of informal caregivers. To begin addressing this need, caregivers could be signposted to existing sources of general caregiver support information and interventions, such as Cancer Caring Coping [ 55 , 56 ]. These supports could be used to develop informational resources tailored for UGIC caregivers. A core information set has been developed to aid HCPs at consultation with UGIC patients, to ensure key information is being delivered [ 57 , 58 ] and now the focus of improving patient-carer education should be raising awareness of this key information toolkit to HCPs who commonly interact with this population. A similar approach could be utilised by identifying informational needs of UGIC caregivers at consultations and developing standardised information points delivered by HCPs to caregivers within those consultations. There is also potential to expand the pool of reliable sources of information to individuals outside of the HCP cohort, such as peer networks or psychologists in providing longitudinal support without necessarily adding to the cost burden required for the development of additional personnel and resources.

This review found caregivers experienced exclusion in the medical setting, suggesting enhanced communication between HCPs and caregivers could improve caregivers’ experience. Indeed, a qualitative study by Reblin et al. [ 59 ] identified communication within health services as a key driver for improving cancer caregiver support. One potential avenue to bridge the gap between HCPs and patient-caregiver dyad is incorporating better the clinical nurse specialist (CNS) [ 60 ] as these professionals can be a key contact for bi-directional communication between HCPs and caregivers. That is, caregivers support and help the clinical team to understand the patient’s progress and through this process HCPs acknowledge and include caregivers in the patient’s care. However, the current issue of under resourcing in cancer nursing would need to be addressed as it presently limits the amount of CNS time available to support caregivers [ 61 ].

One review finding specific to UGIC caregiver burden was the challenge around preparing meals. Taleghani and colleagues [ 62 ] mirror this, highlighting gastric caregivers experienced inadequate education in managing patient’s dietary requirements appropriately, resulting in feeling inefficient, uncomfortable, and fearful. Dietician-led interventions are typically patient focused [ 63 , 64 , 65 ]. However, this review highlights an opportunity for HCPs to include caregivers in dietician-led interventions as many caregivers assume responsibility over meal preparation and grocery shopping. The challenge around meals also has social consequences as meals are important social settings. Changes in eating behaviours can lead to both dyad members feeling isolated and lonely [ 18 , 66 ]. Loneliness is prevalent among people living with cancer and is influenced by cancer-specific and non-cancer specific risk factors, such as lack of social support [ 67 ]. There is less of an understanding of loneliness among UGIC caregivers compared to general cancer caregivers [ 68 ]. This is of concern as negative physical and mental health impacts of loneliness are well-established [ 69 , 70 ]. Peer support is the most used intervention to reduce caregivers’ loneliness, with strategies of psychoeducation and emotional support featuring prominently [ 71 ]. Research is needed to identify risk and protective factors for loneliness among UGIC caregivers.

In addition to loneliness, distress and negative affect were identified as consequences of UGIC caregiver burden. There is evidence of heightened distress and reduced physical and mental health among UGIC caregivers relative to UGIC patients [ 72 , 73 ]. This review also found that caregivers engage in emotion-focused strategies to cope with their caregiving role. A review by Teixeira et al. [ 74 ] found that among cancer caregivers, emotion-focused coping was related to higher distress, whereas problem-focused coping was related to better adjustment and reduced burden. There is a need to develop targeted theory-based psychosocial interventions for this caregiver group. The Transactional Theory of Stress and Coping (TTSC) framework could be utilised to understand how mediating processes specific to coping strategies influence distress and negative affect among UGIC caregivers [ 75 , 76 , 77 ], similar to how Bowan et al. [ 78 ] used a Baltes and Baltes [ 79 ] coping framework to develop interventions for cancer patients’ families. Candidate interventions could involve problem-solving and coping skills training [ 80 , 81 ], which could in turn ameliorate the negative consequences of caregiver burden. If effective with UGIC caregivers, such interventions could be extended to all caregivers as part of a standard care pathway. This review recommends further research to develop an understanding of adjustment in UGIC caregivers.

In contrast to the many negative consequences described by informal caregivers, there were a small group of findings which indicated some positive outcomes. These findings align with a review of the positive aspects of caregiving, which reported improved relationship quality, reward, fulfilment, and personal growth [ 82 ]. The review concluded that positive aspects of caregiving are interconnected and suggested, in addition to interventions reducing negative burden, that interventions could be developed to enhance positive outcomes, such as personal growth. Tedeschi and Calhoun’s Transformational Model (TM) [ 83 ] proposes that potentially traumatic stressors, such as caring for an individual diagnosed with cancer, cause a disruption in one’s worldview triggering attempts to make meaning in response to the stressor. Cognitive disruptions also lead to distress, which in turn can act as a catalyst for post-traumatic growth (PTG). Studies have found that caregivers of people with advanced cancer and early-stage breast cancer experience PTG in relation to their caregiving role [ 84 , 85 ], and that PTG was positively associated with greater social support and perceived hope [ 86 ]. Additional research is needed to understand how the challenging UGIC caregiver role may facilitate growth and help the caregiver adjust to their role.

Study limitations

The current systematic review has several strengths. Firstly, it followed an internationally recognised methodology (JBI) for the conduct of qualitative systematic reviews. This helped ensure methodological approach rigour and subsequently, confidence in findings should they be used to inform policy and practice. There are however several limitations. Although studies in the review are generally of good quality, only 19 studies were identified. Indeed, the UK Less Survivable Cancers Taskforce [ 87 ] advocates for more research focused on cancers with low life expectancy, two-thirds of which are UGICs. This lack of research into UGICs extends to the evidence on caregivers. Synthesised findings are therefore based on a small number of studies, largely conducted in the US and Denmark. Within the studies, caregivers of individuals with oesophageal and pancreatic cancer were well represented. However, there were a dearth of studies focused on caregivers’ experiences with gallbladder, or stomach cancer, alongside multiple studies exploring caregivers’ experiences related to dysphagia and malabsorption but fewer exploring jaundice. Therefore, more primary qualitative research is necessary to understand experiences of all UGIC caregiver populations.

Clinical implications

Of relevance for clinical practice was the finding that caregivers often felt excluded in medical settings, increasing caregiver burden. Caregivers should be seen as co-clients along with patients in the medical setting. This is very much in line with the priorities of care within palliative healthcare settings. Since the palliative care approach seeks to addresses the physical, psychological, cultural, social, and spiritual needs [ 88 ] of both individuals with life-limiting and chronic illnesses like cancer and their support networks, early referral to palliative care services could be particularly beneficial for caregivers as their needs are formally and expertly acknowledged and thus help alleviate the burden identified for informal caregivers in this study.

HCPs have an opportunity to give caregivers reliable, specific, and up-to-date information, pitched at the right level to reassure but not overwhelm. Morris and Thomas [ 89 ] mirror this suggestion and highlight its importance, as there is potential for tension in information exchange due to HCP’s lack of formal acknowledgement of caregivers. Clinical guidance and policy could be updated to include recognition of caregivers as co-clients, and with caregiver training, could formally be part of the patient support team. This could help meet the caregivers’ needs, especially post-diagnosis. On an institutional level, caregivers may be more recognised within their role if acknowledged formally, for example in NICE [ 1 ] guidelines for UGICs. In understanding the considerable role caregivers undertake supporting the care of UGIC patients outside of the healthcare system, policymakers and HCPs need to improve support for caregivers which will in turn reduce the burden on health services.

The aim of this qualitative systematic review was to synthesize evidence about the experiences of UGIC caregivers and has found that caregivers face significant challenges leading to caregiver burden which negatively impacts adjustment. Due to the nature of UGICs, caregivers experienced unique challenges such as how best to manage disruptions to mealtimes and how to monitor surrogate markers of patient health, such as weight. UGICs are a medically complex and evolving chronic condition and caregivers struggle to gain information. This review found that caregiver burden was impacted by feeling excluded in medical settings which could be improved with better communication between HCPs, patients, and their caregivers. There is a lack of data relating to the experiences of certain UGIC caregivers (e.g., gallbladder, stomach) in comparison to others (e.g., oesophageal), as well as a lack of understanding on how to manage the impact of caregiving for these types of cancer, thus providing directions for future research.

Data availability

No datasets were generated or analysed during the current study.

Gastrointestinal tract (upper). cancers - recognition and referral | Health topics A to Z | CKS |NICE. https://cks.nice.org.uk/topics/gastrointestinal-tract-upper-cancers-recognition-referral/2022 . Accessed 25 Aug 2022.

Ferlay J, Ervik M, Lam F, Colombet M, Mery L, Piñeros M, Znaor A, Soerjomataram I, Bray F. Global cancer observatory: cancer today. Lyon, France: International Agency for Research on Cancer (2020). https://gco.iarc.fr/today . Accessed 1 Sep 2021.

Xie Y, Shi L, He X, Luo Y. Gastrointestinal cancers in China, the USA, and Europe. Gastroenterol Rep. 2021;9(2):91–104.

Article   Google Scholar  

Gastrointestinal Cancers Global Burden Expected to Rise. National Cancer Institute. 2020. https://dceg.cancer.gov/news-events/news/2020/global-burden-gastro . Accessed 25 Aug 2022.

Veitch AM, Uedo N, Yao K, East JE. Optimizing early upper gastrointestinal cancer detection at endoscopy. Nat Reviews Gastroenterol Hepatol. 2015;12(11):660–7.

Vedeld HM, Goel A, Lind GE. Epigenetic biomarkers in gastrointestinal cancers: the current state and clinical perspectives. InSeminars in cancer biology 2018 Aug 1 (Vol. 51, pp. 36–49). Academic.

Hong L, Huang YX, Zhuang QY, Zhang XQ, Tang LR, Du KX, Lin XY, Zheng BH, Cai SL, Wu JX, Li JL. Survival benefit of re-irradiation in esophageal cancer patients with locoregional recurrence: a propensity score-matched analysis. Radiat Oncol. 2018;13(1):1–9.

Article   CAS   Google Scholar  

Lee S, Kang TW, Song KD, Lee MW, Rhim H, Lim HK, Kim SY, Sinn DH, Kim JM, Kim K, Ha SY. Effect of microvascular invasion risk on early recurrence of hepatocellular carcinoma after surgery and radiofrequency ablation. Ann Surg. 2021;273(3):564–71.

Article   PubMed   Google Scholar  

Sakamoto H, Attiyeh MA, Gerold JM, Makohon-Moore AP, Hayashi A, Hong J, Kappagantula R, Zhang L, Melchor JP, Reiter JG, Heyde A. The evolutionary origins of recurrent pancreatic CancerOrigins of recurrent pancreatic cancer. Cancer Discov. 2020;10(6):792–805.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Peery AF, Crockett SD, Murphy CC, Lund JL, Dellon ES, Williams JL… Sandler, R. S. Burden and cost of gastrointestinal, liver, and pancreatic diseases in the United States: update 2018. Gastroenterology. 2019;156(1):254–72. Study 2.

Peery AF, Crockett SD, Murphy CC, Lund JL, Dellon ES, Williams JL, Jensen ET, Shaheen NJ, Barritt AS, Lieber SR, Kochar B. Burden and cost of gastrointestinal, liver, and pancreatic diseases in the United States: update 2018. Gastroenterology. 2019;156(1):254–72.

Valentino T, Paiva B, Oliveira M, Hui D, Paiva C. Factors associated with palliative care referral among patients with advanced cancers: a retrospective analysis of a large Brazilian cohort. Support Care Cancer. 2018;26:1933–41.

Hudson P, Remedios C, Thomas K. A systematic review of psychosocial interventions for family carers of palliative care patients. BMC Palliat Care. 2010;9:17–17.

Article   PubMed   PubMed Central   Google Scholar  

Khan NN, Maharaj A, Evans S, Pilgrim C, Zalcberg J, Brown W, Cashin P, Croagh D, Michael N, Shapiro J, White K. A qualitative investigation of the supportive care experiences of people living with pancreatic and oesophagogastric cancer. BMC Health Serv Res. 2022;22(1):1–1.

Cencioni C, Trestini I, Piro G, Bria E, Tortora G, Carbone C, Spallotta F. Gastrointestinal cancer patient nutritional management: from specific needs to novel epigenetic dietary approaches. Nutrients. 2022;14(8):1542.

Given BA, Given CW, Sherwood PR. Family and caregiver needs over the course of the cancer trajectory. J Support Oncol. 2012;10:57–64. https://doi.org/10.1016/j.suponc.2011.10.003

Kim Y, Baek W. Caring experiences of family caregivers of patients with pancreatic cancer: an integrative literature review. Support Care Cancer. 2022;7:1–0.

McCorry NK, Dempster M, Clarke C, Doyle R. Adjusting to life after esophagectomy: the experience of survivors and carers. Qual Health Res. 2009;19:1485–94. https://doi.org/10.1177/1049732309348366

Bozzetti F, Braga M, Gianotti L, Gavazzi C, Mariani L. Postoperative enteral versus parenteral nutrition in malnourished patients with gastrointestinal cancer: a randomised multicentre trial. Lancet. 2001;358(9292):1487–92.

Article   CAS   PubMed   Google Scholar  

Laursen L, Schønau MN, Bergenholtz HM, Siemsen M, Christensen M, Missel M. Table in the corner: a qualitative study of life situation and perspectives of the everyday lives of oesophageal cancer patients in palliative care. BMC Palliat care. 2019;18(1):1–0.

Cooper C, Burden ST, Molassiotis A. An explorative study of the views and experiences of food and weight loss in patients with operable pancreatic cancer perioperatively and following surgical intervention. Support Care Cancer. 2015;23(4):1025–33.

Dempster M, McCorry NK, Brennan E, Donnelly M, Murray LJ, Johnston BT. Psychological distress among family carers of oesophageal cancer survivors: the role of illness cognitions and coping. Psycho-oncology. 2011;20(7):698–705.

Graham L, Dempster M, McCorry NK, Donnelly M, Johnston BT. Change in psychological distress in longer-term oesophageal cancer carers: are clusters of illness perception change a useful determinant? Psycho‐Oncology. 2016;25(6):663–9.

Penner JL, McClement SE. Using phenomenology to examine the experiences of family caregivers of patients with advanced head and neck cancer: reflections of a novice researcher. Int J Qualitative Methods. 2008;7:92–101. https://doi.org/10.1177/160940690800700206

Munn Z, Moola S, Riitano D, Lisy K. The development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence. Int J Health Policy Manage. 2014;3(3):123.

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. https://doi.org/10.1136/bmj.n71

Clarivate analytics. endnote (version 7.7.1). Philadelphia, USA. https://endnote.com Accessed 25 Aug 2022.

Mourad Ouzzani H, Hammady Z, Fedorowicz, Ahmed Elmagarmid. Rayyan — a web and mobile app for systematic reviews. Syst Reviews. 2016;5:210. https://doi.org/10.1186/s13643-016-0384-4

Joanna Briggs Institute. Joanna Briggs Institute critical appraisal checklist for studies reporting prevalence data. Adelaide: Joanna Briggs Institute; 2011.

Google Scholar  

Hodgson T. Oesophageal cancer: experiences of patients and their partners. Br J Nurs. 2006;15(21):1157–60.

LaDonna K, Taylor T, Lingard L. Why open-ended survey questions are unlikely to support rigorous qualitative insights. Acad Medicine: J Association Am Med Colleges. 2017;93(3):347–9.

Joanna Briggs Institute. Joanna Briggs Institute reviewers’ manual: 2014 edition. Australia: The Joanna Briggs Institute. 2014:88–91.

Lockwood C, Munn Z, Porritt K. Qualitative research synthesis: methodological guidance for systematic reviewers utilizing meta-aggregation. JBI Evid Implement. 2015;13(3):179–87.

Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. Establishing confidence in the output of qualitative research synthesis: the ConQual approach. BMC Med Res Methodol. 2014;14(1):1–7.

Sherman DW, McGuire DB, Free D, Cheon JY. A pilot study of the experience of family caregivers of patients with advanced pancreatic cancer using a mixed methods approach. J Pain Symptom Manag. 2014;48(3):385–99.

Winterling J, Wasteson E, Glimelius B, Sjödén PO, Nordin K. Substantial changes in life: perceptions in patients with newly diagnosed advanced cancer and their spouses. Cancer Nurs. 2004;27:381–8.

Hansen L, Rosenkranz SJ, Wherity K, Sasaki A. Living with hepatocellular carcinoma near the end of life: family caregivers’ perspectives. In Oncology nursing forum 2017 Sep 1 (Vol. 44, No. 5).

Nolan MT, Hodgin MB, Olsen SJ, Coleman J. Spiritual issues of family members in a pancreatic cancer chat room. In Oncology Nursing Forum 2006 Mar 1 (Vol. 33, No. 2, p. 239). Oncology Nursing Society.

Padron A. Dyadic relationships among sense of mastery, cancer-related distress, and cortisol in patients and caregivers impacted by abdominal and pelvic malignancies. In University of Florida. 2018.

Petrin K, Bowen DJ, Alfano CM, Bennett R. Adjusting to pancreatic cancer: perspectives from first-degree relatives. Palliat Support Care. 2009;7(3):281–8.

Wong SS, George TJ, Godfrey M, Le J, Pereira DB. Using photography to explore psychological distress in patients with pancreatic cancer and their caregivers: a qualitative study. Support Care Cancer. 2019;27(1):321–8.

Larsen LS, Blix BH, Hamran T. Family caregivers’ involvement in decision-making processes regarding admission of persons with dementia to nursing homes. Dementia. 2020;19(6):2038–55.

Gerhardt S, Dengsø KE, Herling S, Thomsen T. From bystander to enlisted carer–a qualitative study of the experiences of caregivers of patients attending follow-up after curative treatment for cancers in the pancreas, duodenum and bile duct. Eur J Oncol Nurs. 2020;44:101717.

Larsen MK, Birkelund R, Mortensen MB, Schultz H. Being a relative on the sideline to the patient with oesophageal cancer: a qualitative study across the treatment course. Scand J Caring Sci. 2021;35(1):277–86.

Shaw J, Harrison J, Young J, Butow P, Sandroussi C, Martin D, Solomon M. Coping with newly diagnosed upper gastrointestinal cancer: a longitudinal qualitative study of family caregivers’ role perception and supportive care needs. Support Care Cancer. 2013;21(3):749–56.

Gooden HM, White KJ. Pancreatic cancer and supportive care—pancreatic exocrine insufficiency negatively impacts on quality of life. Support Care Cancer. 2013;21(7):1835–41.

Andreassen S, Randers I, Näslund E, Stockeld D, Mattiasson AC. Family members’ experiences, information needs and information seeking in relation to living with a patient with oesophageal cancer. Eur J Cancer Care. 2005;14(5):426–34.

Morowatisharifabad MA, Gerayllo S, Jouybari L, Amirbeigy MK, Fallahzadeh H. Concerns and fear of esophageal cancer in relatives of patients with cancer: a qualitative study. J Gastrointest cancer. 2020;51(3):957–64.

Yi M, Kahn D. Experience of gastric cancer survivors and their spouses in Korea: secondary analysis. J Korean Acad Nurs. 2004;34(4):625–35.

Morowatisharifabad MA, Gerayllo S, Jouybari L, Amirbeigy MK, Fallahzadeh H. Perceived threats toward esophageal cancer among immediate relatives of sufferers: a qualitative study. J Gastrointest Cancer. 2021;52:643–50. https://doi.org/10.1007/s12029-020-00422-y

Shih WM, Hsiao PJ, Chen ML, Lin MH. Experiences of family of patient with newly diagnosed advanced terminal stage hepatocellular cancer. Asian Pac J Cancer Prev. 2013;14(8):4655–60.

James Lind, Alliance. 2021. https://www.jla.nihr.ac.uk . Accessed 1 Sep 2021.

Girgis A, Lambert S. Caregivers of cancer survivors: the state of the field. In Cancer Forum 2009 Nov (Vol. 33, No. 3, pp. 168–171).

Wang T, Molassiotis A, Chung BP, Tan JY. Unmet care needs of advanced cancer patients and their informal caregivers: a systematic review. BMC Palliat care. 2018;17(1):1–29.

Cancer Caring Coping. 2021. https://www.qub.ac.uk/sites/CancerCaringCoping . Accessed 1 Sep 2021.

Santin O, McShane T, Hudson P, Prue G. Using a six-step co‐design model to develop and test a peer‐led web‐based resource (PLWR) to support informal carers of cancer patients. Psycho‐oncology. 2019;28(3):518–24.

Blazeby JM, Macefield R, Blencowe NS, Jacobs M, McNair AG, Sprangers M, Brookes ST, Avery KN, Blazeby JM, Blencowe NS, Brookes ST. Core information set for oesophageal cancer surgery. J Br Surg. 2015;102(8):936–43.

Jacobs M, Henselmans I, Macefield RC, Blencowe NS, Smets EM, de Haes JC, Sprangers MA, Blazeby JM, van Berge Henegouwen MI. Delphi survey to identify topics to be addressed at the initial follow-up consultation after oesophageal cancer surgery. J Br Surg. 2014;101(13):1692–701.

Reblin M, Ketcher D, Vadaparampil ST. Care for the cancer caregiver: a qualitative study of facilitators and barriers to caregiver integration and support. J Cancer Educ. 2021;30:1–7.

Pape E, Decoene E, Debrauwere M, Van Nieuwenhove Y, Pattyn P, Feryn T, Pattyn PR, Verhaeghe S, Van Hecke A, Vandecandelaere P, Desnouck S. Experiences and needs of partners as informal caregivers of patients with major low anterior resection syndrome: a qualitative study. Eur J Oncol Nurs. 2022;58:102143.

Dacre J, Francis R, Appleby J, Charlesworth A, Peckham S, Ahmed S, Brown J, Dickson J, Morris N, Patel M. Expert panel: evaluation of the Government’s commitments in the area of cancer services in England.

Taleghani F, Ehsani M, Farzi S, Farzi S, Adibi P, Moladoost A, Shahriari M, Tabakhan M. Nutritional challenges of gastric cancer patients from the perspectives of patients, family caregivers, and health professionals: a qualitative study. Support Care Cancer. 2021;29(7):3943–50.

Reece L, Hogan S, Allman-Farinelli M, Carey S. Oral nutrition interventions in patients undergoing gastrointestinal surgery for cancer: a systematic literature review. Support Care Cancer. 2020;28(12):5673–91.

Hanna L, Huggins CE, Furness K, Silvers MA, Savva J, Frawley H, Croagh D, Cashin P, Low L, Bauer J, Truby H. Effect of early and intensive nutrition care, delivered via telephone or mobile application, on quality of life in people with upper gastrointestinal cancer: study protocol of a randomised controlled trial. BMC Cancer. 2018;18(1):1–3.

Missel M, Hansen M, Jackson R, Siemsen M, Schønau MN. Re-embodying eating after surgery for oesophageal cancer: patients’ lived experiences of participating in an education and counselling nutritional intervention. J Clin Nurs. 2018;27(7–8):1420–30.

Dempster M, McCorry NK, Brennan E, Donnelly M, Murray LJ, Johnston BT. Illness perceptions among carer–survivor dyads are related to psychological distress among oesophageal cancer survivors. J Psychosom Res. 2011;70(5):432–9.

Deckx L, van den Akker M, Buntinx F. Risk factors for loneliness in patients with cancer: a systematic literature review and meta-analysis. Eur J Oncol Nurs. 2014;18(5):466–77.

Gray TF, Azizoddin DR, Nersesian PV. Loneliness among cancer caregivers: a narrative review. Palliat Support Care. 2020;18(3):359–67.

Beutel ME, Klein EM, Brähler E, Reiner I, Jünger C, Michal M, et al. Loneliness in the general population: prevalence, determinants and relations to mental health. BMC Psychiatry. 2017;17(1):97. pmid:28320380.

Holt-Lunstad J, Smith TB, Baker M, Harris T, Stephenson D. Loneliness and social isolation as risk factors for mortality: a meta-analytic review. Perspect Psychol Sci. 2015;10(2):227–37. pmid:25910392.

Velloze IG, Jester DJ, Jeste DV, Mausbach BT. Interventions to reduce loneliness in caregivers: an integrative review of the literature. Psychiatry Res. 2022;12:114508.

Haj Mohammad N, Walter AW, van Oijen MGH, et al. Burden of spousal caregivers of stage II and III esophageal cancer survivors 3 years after treatment with curative intent. Support Care Cancer. 2015;23:3589–98. https://doi.org/10.1007/s00520-015-2727-4

Langenberg SM, Reyners AK, Wymenga AN, Sieling GC, Veldhoven CM, van Herpen CM, Prins JB, van der Graaf WT. Caregivers of patients receiving long-term treatment with a tyrosine kinase inhibitor (TKI) for gastrointestinal stromal tumour (GIST): a cross-sectional assessment of their distress and burden. Acta Oncol. 2019;58(2):191–9.

Teixeira RJ, Applebaum AJ, Bhatia S, Brandão T. The impact of coping strategies of cancer caregivers on psychophysiological outcomes: an integrative review. Psychol Res Behav Manage. 2018;11:207.

Folkman S, Lazarus RS. Stress, appraisal, and coping. New York: Springer Publishing Company; 1984. p. 460.

Han Y, Hu D, Liu Y, Lu C, Luo Z, Zhao J, Lopez V, Mao J. Coping styles and social support among depressed Chinese family caregivers of patients with esophageal cancer. Eur J Oncol Nurs. 2014;18(6):571–7.

Rankin SR. Influence of coping styles on social support seeking among cancer patient family caregivers (Doctoral dissertation, Walden University).

Bowman KF, Rose JH, Radziewicz RM, O’Toole EE, Berila RA. Family caregiver engagement in a coping and communication support intervention tailored to advanced cancer patients and families. Cancer Nurs. 2009;32(1):73–81.

Baltes PB, Baltes MM, editors. Successful aging: perspectives from the behavioral sciences. Cambridge University Press; 1993 May. p. 28.

Toseland RW, Blanchard CG, McCallion P. A problem solving intervention for caregivers of cancer patients. Soc Sci Med. 1995;40(4):517–28.

McMillan SC, Small BJ, Weitzner M, Schonwetter R, Tittle M, Moody L, Haley WE. Impact of coping skills intervention with family caregivers of hospice patients with cancer: a randomized clinical trial. Cancer. 2006;106(1):214–22.

Li Q, Loke AY. The positive aspects of caregiving for cancer patients: a critical review of the literature and directions for future research. Psycho-oncology. 2013;22(11):2399–407.

Tedeschi RG, Calhoun LG. Trauma and transformation. Sage; 1995 Jun. p. 20.

Liu Y, Li Y, Chen L, Li Y, Qi W, Yu L. Relationships between family resilience and posttraumatic growth in breast cancer survivors and caregiver burden. Psycho-oncology. 2018;27(4):1284–90.

Moore AM, Gamblin TC, Geller DA, Youssef MN, Hoffman KE, Gemmell L, Likumahuwa SM, Bovbjerg DH, Marsland A, Steel JL. A prospective study of posttraumatic growth as assessed by self-report and family caregiver in the context of advanced cancer. Psycho‐oncology. 2011;20(5):479–87.

Nouzari R, Najafi SS, Momennasab M. Post-traumatic growth among family caregivers of cancer patients and its association with social support and hope. Int J Community Based Nurs Midwifery. 2019;7(4):319.

PubMed   Google Scholar  

Less Survivable Cancers Taskforce.org.uk. London: Principle Consulting. https://lesssurvivablecancers.org.uk . Accessed 30 December 2021.

Dy S, Isenberg S, Hamayel N. Palliative care for cancer survivors. Med Clin N Am. 2017;101(6):1181–96.

Morris SM, Thomas C. The need to know: informal carers and information 1. Eur J Cancer Care. 2002;11(3):183–7.

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

School of Psychology, Queen’s University Belfast, University Road, Belfast, BT7 1NN, UK

Melinda Furtado, Dawn Davis, Jenny M. Groarke & Lisa Graham-Wisener

School of Psychology, University of Galway, University Road, Galway, Ireland

Jenny M. Groarke

You can also search for this author in PubMed   Google Scholar

Contributions

M.F., D.D. wrote the main manuscript text with supervision/assistance from J.M.G and L G-W . All authors reviewed the manuscript.

Corresponding author

Correspondence to Melinda Furtado .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1: Additional file 1

Search Strategy

Supplementary Material 2: Additional file 2

Findings illustrations table

Supplementary Material 3: Additional file 3

ConQual table

Supplementary Material 4: Additional file 4

Characteristics of studies

Supplementary Material 5: Additional file 5

Methodological assessment

Supplementary Material 6: Additional file 6

Meta-synthesis

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Furtado, M., Davis, D., Groarke, J.M. et al. Experiences of informal caregivers supporting individuals with upper gastrointestinal cancers: a systematic review. BMC Health Serv Res 24 , 932 (2024). https://doi.org/10.1186/s12913-024-11306-3

Download citation

Received : 20 June 2024

Accepted : 10 July 2024

Published : 14 August 2024

DOI : https://doi.org/10.1186/s12913-024-11306-3

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Caregiver burden
  • Esophageal neoplasms
  • Gastrointestinal neoplasms
  • Gallbladder
  • Quality of life
  • Delivery of health care

BMC Health Services Research

ISSN: 1472-6963

a systematic qualitative literature review

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • J Otolaryngol Head Neck Surg

Logo of jooheadnecksurg

Systematic and other reviews: criteria and complexities

Robert t. sataloff.

1 Editor-in-Chief, Journal of Voice, Philadephia, USA

2 Editor Emeritus, Ear, Nose and Throat Journal, Philadephia, USA

Matthew L. Bush

3 Assistant Editor, Otology & Neurotology, Lexington, USA

Rakesh Chandra

4 Editor-in-Chief, Ear, Ear, Nose and Throat Journal, Nashville, USA

Douglas Chepeha

5 Editor-in-Chief, Journal of Otolaryngology – Head & Neck Surgery, Toronto, Canada

Brian Rotenberg

6 Editor-in-Chief, Journal of Otolaryngology – Head & Neck Surgery, London, Canada

Edward W. Fisher

7 Senior Editor, Journal of Laryngology and Otology, Birmingham, UK

David Goldenberg

8 Editor-in-Chief, Operative Techniques in Otolaryngology – Head and Neck Surgery, Hershey, USA

Ehab Y. Hanna

9 Editor-in-Chief, Head & Neck, Houston, USA

Joseph E. Kerschner

10 Editor-in-Chief, International Journal of Pediatric Otorhinolaryngology, Milwaukee, USA

Dennis H. Kraus

11 Co-Editor-in-Chief, Journal of Neurological Surgery Part B: Skull Base, New York, USA

John H. Krouse

12 Editor-in-Chief, Otolaryngology – Head and Neck Surgery, Philadelphia, USA

13 Editor-in-Chief, OTO-Open, Philadelphia, USA

14 Editor-in-Chief, Journal for Oto-Rhino-Laryngology, Head and Neck Surgery, Philadelphia, USA

15 Editor-in-Chief, World Journal of Otorhinolaryngology – Head and Neck Surgery, Philadelphia, USA

Michael Link

16 Co-Editor-in-Chief, Journal of Neurological Surgery Part B: Skull Base, Rochester, USA

Lawrence R. Lustig

17 Editor-in-Chief, Otology & Neurotology, New York, USA

Samuel H. Selesnick

18 Editor-in-Chief, The Laryngoscope, New York, USA

Raj Sindwani

19 Editor-in-Chief, American Journal of Rhinology & Allergy, Cleveland, USA

Richard J. Smith

20 Editor-in-Chief, Annals of Otology, Rhinology & Laryngology, Iowa City, USA

James Tysome

21 Editor-in-Chief, Clinical Otolaryngology, Cambridge, UK

Peter C. Weber

22 Editor-in-Chief, American Journal of Otolaryngology, Boston, USA

D. Bradley Welling

23 Editor-in-Chief, Laryngoscope Investigative Otolaryngology, Boston, USA

Review articles can be extremely valuable. They synthesize information for readers, often provide clarity and valuable insights into a topic; and good review articles tend to be cited frequently. Review articles do not require Institutional Review Board (IRB) approval if the data reviewed are public (including private and government databases) and if the articles reviewed have received IRB approval previously. However, some institutions require IRB review and exemption for review articles. So, authors should be familiar with their institution’s policy. In assessing and interpreting review articles, it is important to understand the article’s methodology, scholarly purpose and credibility. Many readers, and some journal reviewers, are not aware that there are different kinds of review articles with different definitions, criteria and academic impact [ 1 ]. In order to understand the importance and potential application of a review article, it is valuable for readers and reviewers to be able to classify review articles correctly.

Systematic reviews

Authors often submit articles that include the term “systematic” in the title without realizing that that term requires strict adherence to specific criteria. A systematic review follows explicit methodology to answer a well-defined research question by searching the literature comprehensively, evaluating the quantity and quality of research evidence rigorously, and analyzing the evidence to synthesize an answer to the research question. The evidence gathered in systematic reviews can be qualitative or quantitative. However, if adequate and comparable quantitative data are available then a meta-analysis can be performed to assess the weighted and summarized effect size of the studies included. Depending on the research question and the data collected, systematic reviews may or may not include quantitative meta-analyses; however, meta-analyses should be performed in the setting of a systematic review to ensure that all of the appropriate data were accessed. The components of a systematic review can be found in an important article by Moher et al. published in 2009 that defined requirements for systematic reviews and meta-analyses [ 2 ].

In order to optimize reporting of meta-analyses, an international group developed the Quality of Reporting of Meta-Analyses (QUOROM) statement at a meeting in 1996 that led to publication of the QUOROM statement in 1999 [ 3 ]. Moher et al. revised that document and re-named the guidelines the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The PRISMA statement included both meta-analyses and systematic reviews, and the authors incorporated definitions established by the Cochrane Collaboration [ 4 ]. The PRISMA statement established the current standard for systematic reviews. To qualify as a systematic review, the methods section should acknowledge use of the PRISMA guidelines, and all PRISMA components should be incorporated strictly in all facets of the paper from the research question to the discussion. The PRISMA statement includes a checklist of 27 items that must be included when reporting a systematic review or meta-analysis [ 2 ]. A downloadable version of this checklist can be used by authors, reviewers, and journal editorial staff to ensure compliance with recommended components [ 5 ]. All 27 will not be listed in this brief editorial (although authors and reviewers are encouraged to consult the article by Moher et al. and familiarize themselves with all items), but a few will be highlighted.

The research question, as reflected in the title, should be a hypothesis-based specific research inquiry. The introduction must describe the rationale for the review and provide a specific goal or set of goals to be addressed. The type of systematic review, according to the Cochrane Collaboration, is based on the research question being asked and may assess diagnostic test accuracy, review prognostic studies evidence, evaluate intervention effect, scrutinize research methodology, or summarize qualitative evidence [ 6 ].

In the methods section, the participants, interventions, comparisons, outcomes and study design (PICOS) must be put forward. In addition to mentioning compliance with PRISMA, the methods section should state whether a review protocol exists and, if so, where it can be accessed (including a registration number). Systematic reviews are eligible for registration in the International Prospective Register of Systematic Reviews (PROSPERO) as established at the University of York (York, UK). When PROSPERO is used (it is available but not required for systematic reviews), registration should occur at the initial protocol stage of the review, and the final paper should direct to the information in the register. The methods section also must include specific study characteristics including databases used, years considered, languages of articles included, specific inclusion and exclusion criteria for studies; and rationale for each criterion must be included. Which individuals specifically performed searches should be noted. Electronic search strategy (with a full description of at least one electronic search strategy sufficient to allow replication of the search), process for article selection, data variables sought, assumptions and simplifications, methods for assessing bias risk of each individual study (such as selective reporting in individual studies) and utilization of this information in data synthesis, principal summary measures (risk ratio, hazard ratio, difference in means, etc.), methods of data management and combining study results, outcome level assessment, and other information should be reported.

The results section should include the number of studies identified, screened, evaluated for eligibility (including rationale for exclusion), and those included in the final synthesis. A PRISMA flow diagram should be included to provide this information succinctly [ 7 ]. The results also should include the study characteristics, study results, risk of bias within and across studies, and a qualitative or quantitative synthesis of the results of the included studies. This level of rigor in acquiring and evaluating the evidence of each individual study is one of the criteria that distinguishes systematic reviews from other categories. If the systematic review involves studies with paired samples and quantitative data, a summary of data should be provided for each intervention group along with effect estimates and confidence intervals for all outcomes of each study. If a meta-analysis is performed, then synthesized effect size should be reported with confidence intervals and measures of consistency (i.e. – data heterogeneity such as I 2 ) for each meta-analysis, and assessment of bias risk across studies. A forest plot, which provides a graphical presentation of the meta-analysis results, should be included.

The discussion section should summarize the main findings commenting on the strength of evidence for each outcome, as well as relevance to healthcare providers, policymakers and other key stake-holders; limitations of the study and outcomes; and conclusions highlighting the interpretation of results in the context of other research, and implications for future research.

Without adhering to of all of these criteria and the others listed in the PRISMA statement and checklist, the review does not qualify to be classified as “systematic”.

Meta-analyses

Meta-analyses, when feasible based on available and comparable quantitative data, supplement a systematic review evaluation, by adding a secondary statistical analysis of the pooled weighted outcomes of similar studies. This adds a level of objectivity in the synthesis of the review’s findings. Meta-analyses are appropriate when at least 2 individual studies contain paired samples (experimental group and control group) and provide quantitative outcome data and sample size. Studies that lack a control group may over-estimate the effect size of the experimental intervention or condition being studied and are not ideal for meta-analyses [ 8 ]. It also should be remembered that the conclusions of a meta-analysis are only as valid as the data on which the analysis is based. If the articles included are flawed, then the conclusions of the meta-analysis also may be flawed. Systematic reviews and meta-analyses are the most rigorous categories of review.

Other types of reviews

Mixed methods reviews.

Systematic reviews typically contain a single type of data, either qualitative or quantitative; however, mixed methods reviews bring together a combination of data types or study types. This approach may be utilized when quantitative data, in the setting of an intervention study, only provide a narrow perspective of the efficacy or effectiveness of the intervention. The addition of qualitative data or qualitative studies may provide a more complete picture of the knowledge, attitudes, and behaviors of clinicians, patients or researchers regarding that intervention. This type of review could involve collecting either the quantitative or the qualitative data using systematic review methodology, but often the qualitative data are gathered using a convenience sampling. Many qualitative studies provide useful insights into clinical management and/or implementation of research interventions; and incorporating them into a mixed methods review may provide valuable perspective on a wide range of literature. Mixed methods reviews are not necessarily systematic in nature; however, authors conducting mixed methods reviews should follow systematic review methodology, when possible.

Literature and narrative reviews

Literature reviews include peer-reviewed original research, systematic reviews, and meta-analyses, but also may include conference abstracts, books, graduate degree theses, and other non-peer reviewed publications. The methods used to identify and evaluate studies should be specified, but they are less rigorous and comprehensive than those required for systematic reviews. Literature reviews can evaluate a broad topic but do not specifically articulate a specific question, nor do they synthesize the results of included studies rigorously. Like mixed method reviews, they provide an overview of published information on the topic, although they may be less comprehensive than integrative reviews; and, unlike systematic reviews, they do not need to support evidence-based clinical or research practices, or highlight high-quality evidence for the reader. Narrative reviews are similar to literature reviews and evaluate the same scope of literature. The terms sometimes are used interchangeably, and author bias in article selection and data interpretation is a potential concern in literature and narrative reviews.

Umbrella reviews

An umbrella review integrates previously published, high-quality reviews such as systematic reviews and meta-analyses. Its purpose is to synthesize information in previously published systematic reviews and meta-analyses into one convenient paper.

Rapid review

A rapid review uses systematic review methodology to evaluate existing research. It provides a quick synthesis of evidence and is used most commonly to assist in emergent decision-making such as that required to determine whether COVID-19 vaccines should receive emergent approval.

Scoping, mapping, and systematized reviews

If literature has not been reviewed comprehensively in a specific subject that is varied and complex, a mapping review (also called scoping review) may be useful to organize initial understanding of the topic and its available literature. While mapping reviews may be helpful in crystallizing research findings and may be published, they are particularly useful in helping to determine whether a topic is amenable to systematic review, and to help organize and direct the approach of the systematic review or other reviews of the subject. Systematized reviews are used most commonly by students. The systematized review provides initial assessment of a topic that is potentially appropriate for a systematic review, but a systematized review does not meet the rigorous criteria of a systematic review and has substantially more limited value. Additional types of reviews exist including critical review, state-of-the-art review, and others.

Reviews can be invaluable; but they also can be misleading. Systematic reviews and meta-analyses provide readers with the greatest confidence that rigorous efforts have attempted to eliminate bias and ensure validity, but even they have limitations based upon the strengths and weaknesses of the literature that they have assessed (and the skill and objectivity with which the authors have executed the review). Risks of bias, incomplete information and misinformation increase as the rigor of review methodology decreases. While review articles may summarize research related to a topic for readers, non-systematic reviews lack the rigor to answer adequately hypothesis-driven research questions that can influence evidence-based practice. Journal authors, reviewers, editorial staff, and should be cognizant of the strengths and weaknesses of review methodology and should consider them carefully as they assess the value of published review articles, particularly as they determine whether the information presented should alter their patient care.

Authors’ contributions

The author(s) read and approved the final manuscript.

Declarations

The authors declare no competing interests.

This article is co-published in the following journals: Journal of Voice, Otology & Neurotology, Ear, Nose and Throat Journal, Journal of Laryngology and Otology, Operative Techniques in Otolaryngology – Head and Neck Surgery, Head & Neck, International Journal of Pediatric Otorhinolaryngology, Journal of Neurological Surgery Part B: Skull Base, Otolaryngology – Head and Neck Surgery, World Journal of Otorhinolaryngology – Head and Neck Surgery, The Laryngoscope, American Journal of Rhinology & Allergy, Annals of Otology, Rhinology & Laryngology, Clinical Otolaryngology, American Journal of Otolaryngology, Laryngoscope Investigative Otolaryngology.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

Department of Psychiatry

  • Accessibility
  • Knowledge Base
  • Publications

The Acceptability, Engagement, and Feasibility of Mental Health Apps for Marginalized and Underserved Young People: Systematic Review and Qualitative Study

Bear ha., ayala nunes l., ramos g., manchanda t., fernandes b., chabursky s., walper s., watkins e., fazel m..

Background Smartphone apps may provide an opportunity to deliver mental health resources and interventions in a scalable and cost-effective manner. However, young people from marginalized and underserved groups face numerous and unique challenges to accessing, engaging with, and benefiting from these apps. Objective This study aims to better understand the acceptability (ie, perceived usefulness and satisfaction with an app) and feasibility (ie, the extent to which an app was successfully used) of mental health apps for underserved young people. A secondary aim was to establish whether adaptations can be made to increase the accessibility and inclusivity of apps for these groups. Methods We conducted 2 sequential studies, consisting of a systematic literature review of mental health apps for underserved populations followed by a qualitative study with underserved young male participants (n=20; age: mean 19). Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, an electronic search of 5 databases was conducted in 2021. The search yielded 18,687 results, of which 14 articles met the eligibility criteria. Results The included studies comprised a range of groups, including those affected by homelessness, having physical health conditions, living in low- and middle-income countries, and those with sexual and gender minority identities. Establishing and maintaining user engagement was a pervasive challenge across mental health apps and populations, and dropout was a reported problem among nearly all the included studies. Positive subjective reports of usability, satisfaction, and acceptability were insufficient to determine users’ objective engagement. Conclusions Despite the significant amount of funding directed to the development of mental health apps, juxtaposed with only limited empirical evidence to support their effectiveness, few apps have been deliberately developed or adapted to meet the heterogeneous needs of marginalized and underserved young people. Before mental health apps are scaled up, a greater understanding is needed of the types of services that more at-risk young people and those in limited-resource settings prefer (eg, standard vs digital) followed by more rigorous and consistent demonstrations of acceptability, effectiveness, and cost-effectiveness. Adopting an iterative participatory approach by involving young people in the development and evaluation process is an essential step in enhancing the adoption of any intervention, including apps, in “real-world” settings and will support future implementation and sustainability efforts to ensure that marginalized and underserved groups are reached. Trial Registration PROSPERO CRD42021254241; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=254241

Original publication

10.2196/48964

Journal article

Journal of Medical Internet Research

JMIR Publications Inc.

Publication Date

e48964 - e48964

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

muscles-logo

Article Menu

a systematic qualitative literature review

  • Subscribe SciFeed
  • Recommended Articles
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

Hormonal influences on skeletal muscle function in women across life stages: a systematic review.

a systematic qualitative literature review

1. Introduction

Research significance, 2.1. search strategy.

  • Hormonal influence;
  • Skeletal muscle function;
  • Progesterone;
  • Adolescence;
  • Reproductive years;
  • Muscle metabolism;
  • Muscle strength;
  • Muscle recovery.

2.1.1. Inclusion Criteria

2.1.2. exclusion criteria, 2.2. selection process, 2.2.1. initial screening, 2.2.2. eligibility assessment, 2.2.3. data extraction.

  • Study characteristics (authors, publication year, study design);
  • Participant demographics (age, health status, hormonal status);
  • Details of hormonal measurements (types of hormones measured, measurement methods);
  • Outcomes related to skeletal muscle function (muscle strength, muscle mass, muscle metabolism, recovery metrics);
  • Intervention details, if applicable (type, duration, and outcome measures of hormonal or non-hormonal interventions);
  • Results and conclusions of the studies.

2.2.4. Quality Assessment

2.2.5. data synthesis.

  • Qualitative Synthesis: A narrative synthesis was conducted to provide a comprehensive summary of the findings from each study, highlighting common themes, differences, and gaps in the research.
  • Descriptive Synthesis: Where appropriate, descriptive statistics such as ranges, medians, and frequencies were used to summarize the outcomes related to hormonal influences on muscle function across different life stages.
  • A PRISMA checklist was used to ensure the transparency and completeness of this review process.

3.1. Study Characteristics

  • The selected studies comprised 20 randomized controlled trials, 15 cohort studies, and 10 cross-sectional studies. This mix of study designs provided a comprehensive view of the hormonal influences on skeletal muscle function.
  • The total number of participants across all included studies was approximately 2400, with ages ranging from 12 to 75 years.
  • The studies included both healthy individuals and those with specific health conditions that could impact muscle function, such as polycystic ovary syndrome (PCOS), menopause, and chronic diseases.
  • The participants were categorized into three main life stages: adolescence (12–18 years), reproductive years (19–45 years), and menopause (46 years and above).
  • Hormonal assessments varied among the studies, with most measuring the levels of estrogen and progesterone. Some studies also included measurements of other hormones such as testosterone, cortisol, and insulin-like growth factor 1 (IGF-1).
  • The methods of hormonal assessment included blood serum levels (used in 35 studies), urinary excretion (used in 7 studies), and salivary measurements (used in 3 studies).
  • Muscle strength was commonly assessed using grip strength tests (used in 25 studies), leg press exercises (used in 10 studies), and isokinetic dynamometry (used in 10 studies).
  • Muscle mass was evaluated through imaging techniques such as magnetic resonance imaging (MRI) (used in 15 studies), dual-energy X-ray absorptiometry (DEXA) (used in 20 studies), and bioelectrical impedance analysis (BIA) (used in 10 studies).
  • Muscle metabolism outcomes included glucose uptake rates (measured in 12 studies), fatty acid oxidation (measured in 8 studies), and metabolic enzyme activity (measured in 10 studies), often assessed through biopsy samples or metabolic testing.
  • Muscle recovery was assessed by examining the recovery time post-exercise and markers of muscle damage, such as creatine kinase levels (used in 12 studies).
  • Among the studies that included interventions, the types of interventions varied widely. Hormone replacement therapy (HRT) was used in 15 studies, exercise programs in 20 studies, and dietary supplements in 10 studies.
  • The duration of the interventions ranged from 8 weeks to 24 months, with outcome measures taken at multiple time points to assess the changes in muscle function.

3.2. Hormonal Influences in Adolescence

3.3. hormonal influences during reproductive years, 3.4. hormonal influences in menopause, 3.5. intervention efficacy, 4. discussion, 4.1. implications for health management.

  • Health Education and Monitoring: Educating adolescent girls about the importance of hormonal health and its impact on muscle function is crucial. Regular monitoring of hormonal levels and muscle health can help to identify any imbalances early on, allowing for timely interventions.
  • Tailored Physical Activity Programs: Implementing physical activity programs that are sensitive to hormonal changes during adolescence can optimize muscle development. Encouraging participation in resistance training and other strength-building exercises during periods of peak estrogen levels can maximize muscle gains.
  • Menstrual-Cycle-Based Training: Health practitioners and fitness trainers should consider the menstrual cycle when designing exercise programs for women in their reproductive years. Tailoring exercise intensity and type to different phases of the menstrual cycle can enhance muscle performance and recovery.
  • Pregnancy and Postpartum Care: Personalized exercise and nutritional plans during pregnancy and the postpartum period are essential. Ensuring that pregnant women receive adequate support to maintain muscle health through appropriate physical activities and dietary supplements can mitigate the adverse effects of pregnancy on muscle function.
  • Contraceptive Counseling: When prescribing hormonal contraceptives, healthcare providers should consider their potential impact on muscle function. Discussing the benefits and drawbacks of different contraceptive methods can help women to make informed choices that align with their muscle health goals.
  • Hormone Replacement Therapy (HRT): HRT can be a valuable tool for maintaining muscle health in postmenopausal women. Healthcare providers should evaluate the risks and benefits of HRT for each patient, considering factors such as family history, cardiovascular health, and bone density.
  • Resistance Training Programs: Developing specialized resistance training programs for postmenopausal women can help to counteract muscle atrophy and improve strength. These programs should focus on progressive resistance exercises to stimulate muscle protein synthesis and enhance metabolic function.
  • Nutritional Support: Adequate intake of protein, vitamin D, calcium, and omega-3 fatty acids is crucial for postmenopausal women. Healthcare providers should recommend dietary adjustments and supplements to support muscle health and overall well-being.
  • Personalized Medicine: The integration of hormonal assessments into routine health evaluations can help to personalize interventions for muscle health. Understanding each woman’s hormonal profile can guide the development of targeted exercise, nutritional, and therapeutic strategies.
  • Interdisciplinary Approach: Collaboration between endocrinologists, dietitians, physiotherapists, and fitness trainers is essential to create comprehensive health management plans. This interdisciplinary approach ensures that all aspects of hormonal health and muscle function are addressed.
  • Public Health Initiatives: Public health campaigns focused on the importance of hormonal health and its impact on muscle function can raise awareness and promote proactive health management. These initiatives can encourage women to seek regular hormonal assessments and adopt healthy lifestyle practices.

4.2. Clinical and Practical Relevance

  • Personalized Health Management: Understanding the hormonal influences on muscle function allows for the development of personalized health management plans that are tailored to the hormonal profiles and life stages of women. This approach can optimize muscle health and performance, prevent muscle-related diseases, and enhance overall well-being.
  • Targeted Interventions: Health practitioners can implement targeted interventions, such as phase-specific exercise programs and nutritional adjustments, to support muscle function in women during critical periods of hormonal change.
  • Hormonal Assessments: Regular hormonal assessments should be integrated into routine health evaluations for women, enabling the early identification of imbalances and timely interventions.
  • Interdisciplinary Collaboration: A collaborative approach involving endocrinologists, dietitians, physiotherapists, and fitness trainers is essential to create comprehensive health management plans that address all aspects of hormonal health and muscle function.
  • Public Health Initiatives: Public health campaigns focused on the importance of hormonal health and its impact on muscle function can raise awareness and promote proactive health management practices among women.

4.3. Limitations of This Study

  • Heterogeneity of Studies: The included studies varied widely in terms of participant demographics, study design, hormonal measurements, and outcome assessments. This heterogeneity may affect the generalizability of the findings.
  • Quality of Evidence: Although most studies were of high quality, some had limitations, such as small sample sizes, lack of blinding, or short follow-up periods. These factors could introduce bias and affect the reliability of the results.
  • Publication Bias: The potential for publication bias exists, as studies with significant findings are more likely to be published. This bias could skew the overall conclusions of this study.
  • Variability in Hormonal Measurements: Differences in methods of hormonal assessment (e.g., blood serum vs. urinary measurements) and timing of measurements relative to menstrual cycles or menopausal status could introduce variability in the findings.
  • Intervention Differences: The type, duration, and intensity of the interventions varied across the studies, making it challenging to directly compare the results. Standardizing intervention protocols in future research could improve comparability.

4.4. Recommendations for Future Research

  • Longitudinal Studies: Conducting long-term longitudinal studies can provide a more comprehensive view of how hormonal changes impact muscle function over time.
  • Standardized Protocols: Developing standardized protocols for hormonal measurements and intervention strategies can improve the consistency and comparability of study results.
  • Diverse Populations: Including diverse populations in terms of age, ethnicity, and health status can help to generalize findings and identify unique hormonal influences in different groups.
  • Mechanistic Studies: Investigating the underlying mechanisms of hormonal effects on muscle function at the molecular and cellular levels can provide deeper insights and inform targeted therapies.
  • Combined Interventions: Exploring the synergistic effects of combined interventions (e.g., HRT and resistance training) in large-scale, randomized controlled trials can help to identify the most effective strategies for maintaining muscle health.

5. Conclusions

Author contributions, institutional review board statement, informed consent statement, data availability statement, conflicts of interest.

  • Frontera, W.R.; Ochala, J. Skeletal Muscle: A Brief Review of Structure and Function. Calcif. Tissue Int. 2015 , 96 , 183–195. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • MacIntosh, B.R.; Gardiner, P.F.; McComas, A.J. Skeletal Muscle: Form and Function ; Human Kinetics: Champaign, IL, USA, 2006. [ Google Scholar ]
  • Mukund, K.; Subramaniam, S. Skeletal muscle: A review of molecular structure and function, in health and disease. Wiley Interdiscip. Rev. Syst. Biol. Med. 2020 , 12 , e1462. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Argilés, J.M.; Campos, N.; Lopez-Pedrosa, J.M.; Rueda, R.; Rodriguez-Mañas, L. Skeletal muscle regulates metabolism via interorgan crosstalk: Roles in health and disease. J. Am. Med. Dir. Assoc. 2016 , 17 , 789–796. [ Google Scholar ] [ CrossRef ]
  • Zatsiorsky, V.M.; Prilutsky, B.I. Biomechanics of Skeletal Muscles ; Human Kinetics: Champaign, IL, USA, 2012. [ Google Scholar ]
  • Kart, C.S.; Metress, S.P. Human Aging and Chronic Disease ; Jones & Bartlett Learning: Burlington, MA, USA, 1992. [ Google Scholar ]
  • Welch, A.A. Nutritional influences on age-related skeletal muscle loss. Proc. Nutr. Soc. 2014 , 73 , 16–33. [ Google Scholar ] [ CrossRef ]
  • Buchner, D.M.; de Lateur, B.J. The importance of skeletal muscle strength to physical function in older adults. Ann. Behav. Med. 1991 , 13 , 91–98. [ Google Scholar ] [ CrossRef ]
  • Tieland, M.; Trouwborst, I.; Clark, B.C. Skeletal muscle performance and ageing. J. Cachex-Sarcopenia Muscle 2018 , 9 , 3–19. [ Google Scholar ] [ CrossRef ]
  • Vandervoort, A.A.; Hayes, K.C.; Blanger, A. Strength and endurance of skeletal muscle in the elderly. Physiother. Can. 1986 , 38 , 167–173. [ Google Scholar ] [ CrossRef ]
  • Ikeda, K.; Horie-Inoue, K.; Inoue, S. Functions of estrogen and estrogen receptor signaling on skeletal muscle. J. Steroid Biochem. Mol. Biol. 2019 , 191 , 105375. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Adamo, S.; Pigna, E.; Lugarà, R.; Moresi, V.; Coletti, D.; Bouché, M. Skeletal muscle: A significant novel neurohypophyseal hormone-secreting organ. Front. Physiol. 2019 , 9 , 1885. [ Google Scholar ] [ CrossRef ]
  • Sipilä, S.; Narici, M.; Kjaer, M.; Pöllänen, E.; Atkinson, R.A.; Hansen, M.; Kovanen, V. Sex hormones and skeletal muscle weakness. Biogerontology 2013 , 14 , 231–245. [ Google Scholar ] [ CrossRef ]
  • Alexander, S.E.; Pollock, A.C.; Lamon, S. The effect of sex hormones on skeletal muscle adaptation in females. Eur. J. Sport Sci. 2022 , 22 , 1035–1045. [ Google Scholar ] [ CrossRef ]
  • Kitajima, Y.; Ono, Y. Estrogens maintain skeletal muscle and satellite cell functions. J. Endocrinol. 2016 , 229 , 267–275. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Velloso, C.P. Regulation of muscle mass by growth hormone and IGF-I. Br. J. Pharmacol. 2008 , 154 , 557–568. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Pierce, J.R.; Clark, B.C.; Ploutz-Snyder, L.L.; Kanaley, J.A. Growth hormone and muscle function responses to skeletal muscle ischemia. J. Appl. Physiol. 2006 , 101 , 1588–1595. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Robinson, D.P.; Klein, S.L. Pregnancy and pregnancy-associated hormones alter immune responses and disease pathogenesis. Horm. Behav. 2012 , 62 , 263–271. [ Google Scholar ] [ CrossRef ]
  • Burger, H.G.; Dudley, E.C.; Robertson, D.M.; Dennerstein, L. Hormonal changes in the menopause transition. Recent Prog. Horm. Res. 2002 , 57 , 257–276. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Buckler, H. The menopause transition: Endocrine changes and clinical symptoms. Br. Menopause Soc. J. 2005 , 11 , 61–65. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Takkouche, B.; Norman, G. PRISMA statement. Epidemiology 2011 , 22 , 128. [ Google Scholar ] [ CrossRef ]
  • Wells, G.A.; Shea, B.; O’Connell, D.; Peterson, J.; Welch, V.; Losos, M.; Tugwell, P. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses ; University of Ottawa: Ottawa, ON, Canada, 2000. [ Google Scholar ]
  • Armijo-Olivo, S.; Stiles, C.R.; Hagen, N.A.; Biondo, P.D.; Cummings, G.G. Assessment of study quality for systematic reviews: A comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: Methodological research. J. Eval. Clin. Pract. 2012 , 18 , 12–18. [ Google Scholar ] [ CrossRef ]
  • Ramos, E.; Frontera, W.R.; Llopart, A.; Feliciano, D. Muscle Strength and Hormonal Levels in Adolescents: Gender Related Differences. Int. J. Sports Med. 1998 , 19 , 526–531. [ Google Scholar ] [ CrossRef ]
  • Round, J.M.; Jones, D.A.; Honour, J.W.; Nevill, A.M. Hormonal factors in the development of differences in strength between boys and girls during adolescence: A longitudinal study. Ann. Hum. Biol. 1999 , 26 , 49–62. [ Google Scholar ] [ CrossRef ]
  • Laddu, D.R.; Farr, J.N.; Lee, V.R.; Blew, R.M.; Stump, C.; Houtkooper, L.; Lohman, T.G.; Going, S.B. Muscle density predicts changes in bone density and strength: A prospective study in girls. J. Musculoskelet. Neuronal Interact. 2014 , 14 , 195–204. [ Google Scholar ] [ PubMed ]
  • Tiidus, P.M.; Lowe, D.A.; Brown, M. Estrogen replacement and skeletal muscle: Mechanisms and population health. J. Appl. Physiol. 2013 , 115 , 569–578. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Collins, B.C.; Laakkonen, E.K.; Lowe, D.A. Aging of the musculoskeletal system: How the loss of estrogen impacts muscle strength. Bone 2019 , 123 , 137–144. [ Google Scholar ] [ CrossRef ]
  • Boisseau, N.; Delamarche, P. Metabolic and Hormonal Responses to Exercise in Children and Adolescents. Sports Med. 2000 , 30 , 405–422. [ Google Scholar ] [ CrossRef ]
  • Varlamov, O.; Bethea, C.L.; Roberts, C.T., Jr. Sex-specific differences in lipid and glucose metabolism. Front. Endocrinol. 2015 , 5 , 241. [ Google Scholar ] [ CrossRef ]
  • Campbell, K.L.; Westerlind, K.C.; Harber, V.J.; Bell, G.J.; Mackey, J.R.; Courneya, K.S. Effects of Aerobic Exercise Training on Estrogen Metabolism in Premenopausal Women: A Randomized Controlled Trial. Cancer Epidemiol. Biomark. Prev. 2007 , 16 , 731–739. [ Google Scholar ] [ CrossRef ]
  • Hausswirth, C.; Le Meur, Y. Physiological and nutritional aspects of post-exercise recovery: Specific recommendations for female athletes. Sports Med. 2011 , 41 , 861–882. [ Google Scholar ] [ CrossRef ]
  • Williams, T.; Walz, E.; Lane, A.; Pebole, M.; Hackney, A. The effect of estrogen on muscle damage biomarkers following prolonged aerobic exercise in eumenorrheic women. Biol. Sport 2015 , 32 , 193–198. [ Google Scholar ] [ CrossRef ]
  • Baird, M.F.; Graham, S.M.; Baker, J.S.; Bickerstaff, G.F. Creatine-Kinase- and Exercise-Related Muscle Damage Implications for Muscle Performance and Recovery. J. Nutr. Metab. 2012 , 2012 , 960363. [ Google Scholar ] [ CrossRef ]
  • Ackerman, K.E.; Singhal, V.; Baskaran, C.; Slattery, M.; Reyes, K.J.C.; Toth, A.; Eddy, K.T.; Bouxsein, M.L.; Lee, H.; Klibanski, A.; et al. Oestrogen replacement improves bone mineral density in oligo-amenorrhoeic athletes: A randomised clinical trial. Br. J. Sports Med. 2019 , 53 , 229–236. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Prior, J.C. Adolescents’ Use of Combined Hormonal Contraceptives for Menstrual Cycle–Related Problem Treatment and Contraception: Evidence of Potential Lifelong Negative Reproductive and Bone Effects. Women’s Reprod. Health 2016 , 3 , 73–92. [ Google Scholar ] [ CrossRef ]
  • Küüsmaa-Schildt, M. Combined Strength and Endurance Training: Effect of Training Order and Time-of-Day on Adaptations in Neuromuscular and Cardiorespiratory Performance, Muscle Hypertrophy, Serum Hormone Concentrations and Wellbeing. Doctoral Dissertations, University of Jyväskylä, Jyväskylä, Finland, 2019. [ Google Scholar ]
  • Stathopoulou, G.; Powers, M.B.; Berry, A.C.; Smits, J.A.J.; Otto, M.W. Exercise Interventions for Mental Health: A Quantitative and Qualitative Review. Clin. Psychol. Sci. Pract. 2006 , 13 , 179–193. [ Google Scholar ] [ CrossRef ]
  • Pallavi, L.C.; SoUza, U.J.D.; Shivaprakash, G. Assessment of musculoskeletal strength and levels of fatigue during different phases of menstrual cycle in young adults. J. Clin. Diagn. Res. JCDR 2017 , 11 , CC11. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Romero-Moraleda, B.; Del Coso, J.; Gutiérrez-Hellín, J.; Ruiz-Moreno, C.; Grgic, J.; Lara, B. The Influence of the Menstrual Cycle on Muscle Strength and Power Performance. J. Hum. Kinet. 2019 , 68 , 123–133. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Beetham, K.S.; Giles, C.; Noetel, M.; Clifton, V.; Jones, J.C.; Naughton, G. The effects of vigorous intensity exercise in the third trimester of pregnancy: A systematic review and meta-analysis. BMC Pregnancy Childbirth 2019 , 19 , 281. [ Google Scholar ] [ CrossRef ]
  • Harvey, N.C.; Moon, R.J.; Sayer, A.A.; Ntani, G.; Davies, J.H.; Javaid, M.K.; Southampton Women’s Survey Study Group. Maternal antenatal vitamin D status and offspring muscle development: Findings from the Southampton Women’s Survey. J. Clin. Endocrinol. Metab. 2014 , 99 , 330–337. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Myllyaho, M.M.; Ihalainen, J.K.; Hackney, A.C.; Valtonen, M.; Nummela, A.; Vaara, E.; Häkkinen, K.; Kyröläinen, H.; Taipale, R.S. Hormonal Contraceptive Use Does Not Affect Strength, Endurance, or Body Composition Adaptations to Combined Strength and Endurance Training in Women. J. Strength Cond. Res. 2021 , 35 , 449–457. [ Google Scholar ] [ CrossRef ]
  • Nolan, D.; McNulty, K.L.; Manninen, M.; Egan, B. The Effect of Hormonal Contraceptive Use on Skeletal Muscle Hypertrophy, Power and Strength Adaptations to Resistance Exercise Training: A Systematic Review and Multilevel Meta-analysis. Sports Med. 2024 , 54 , 105–125. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Sabatini, R.; Cagiano, R.; Rabe, T. Adverse effects of hormonal contraception. J. Reprod. Med. Endocrinol. 2011 , 8 , 130–156. [ Google Scholar ]
  • SantaBarbara, K. Effects of the Menstrual Cycle and Mitigating its Impact in Resistance-Trained Women. Ph.D. Thesis, Auckland University of Technology, Auckland, New Zealand, 2023. [ Google Scholar ]
  • Sung, E.; Han, A.; Hinrichs, T.; Vorgerd, M.; Manchado, C.; Platen, P. Effects of follicular versus luteal phase-based strength training in young women. SpringerPlus 2014 , 3 , 668. [ Google Scholar ] [ CrossRef ]
  • Kissow, J.; Jacobsen, K.J.; Gunnarsson, T.P.; Jessen, S.; Hostrup, M. Effects of Follicular and Luteal Phase-Based Menstrual Cycle Resistance Training on Muscle Strength and Mass. Sports Med. 2022 , 52 , 2813–2819. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Kochi, M.N.; Marques, N.R.; da Costa, G.D.C.; Reis, J.G.; de Paula, F.J.A.; Ferreiral, C.H.J.; de Abreu, D.C.C. Impact of first 10 years of post menopause on muscle function, muscle mass and bone mineral density in adult women. J. Osteopor. Phys. Act. 2015 , 3 , 2. [ Google Scholar ]
  • Greeves, J.P.; Cable, N.T.; Reilly, T.; Kingsland, C. Changes in muscle strength in women following the menopause: A longitudinal assessment of the efficacy of hormone replacement therapy. Clin. Sci. 1999 , 97 , 79–84. [ Google Scholar ] [ CrossRef ]
  • Colombel, A.; Charbonnel, B. Weight gain and cardiovascular risk factors in the post-menopausal woman. Hum. Reprod. 1997 , 12 (Suppl. 1), 134–145. [ Google Scholar ] [ CrossRef ]
  • Pöllänen, E.; Ronkainen, P.H.A.; Suominen, H.; Takala, T.; Koskinen, S.; Puolakka, J.; Sipilä, S.; Kovanen, V. Muscular transcriptome in postmenopausal women with or without hormone replacement. Rejuvenation Res. 2007 , 10 , 485–500E. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Kemmler, W.; Wildt, L.; Engelke, K.; Pintag, R.; Pavel, M.; Bracher, B.; Weineck, J.; Kalender, W. Acute hormonal responses of a high impact physical exercise session in early postmenopausal women. Eur. J. Appl. Physiol. 2003 , 90 , 199–209. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Holtzman, B.; Ackerman, K.E. Recommendations and nutritional considerations for female athletes: Health and performance. Sports Med. 2021 , 51 (Suppl. 1), 43–57. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Chien, M.Y.; Wu, Y.T.; Hsu, A.T.; Yang, R.S.; Lai, J.S. Efficacy of a 24-week aerobic exercise program for osteopenic postmenopausal women. Calcif. Tissue Int. 2000 , 67 , 443–448. [ Google Scholar ] [ CrossRef ]
  • Bea, J.W.; Cussler, E.C.; Going, S.B.; Blew, R.M.; Metcalfe, L.L.; Lohman, T.G. Resistance training predicts six-year body composition change in postmenopausal women. Med. Sci. Sports Exerc. 2010 , 42 , 1286. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Isenmann, E.; Kaluza, D.; Havers, T.; Elbeshausen, A.; Geisler, S.; Hofmann, K.; Flenker, U.; Diel, P.; Gavanda, S. Resistance training alters body composition in middle-aged women depending on menopause-A 20-week control trial. BMC Women’s Health 2023 , 23 , 526. [ Google Scholar ] [ CrossRef ]
  • Marín-Cascales, E.; Rubio-Arias, J.A.; Romero-Arenas, S.; Alcaraz, P.E. Effect of 12 weeks of whole-body vibration versus multi-component training in post-menopausal women. Rejuvenation Res. 2015 , 18 , 508–516. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Lee, H.; Caguicla, J.M.C.; Park, S.; Kwak, D.J.; Won, D.Y.; Park, Y.; Kim, J.; Kim, M. Effects of 8-week Pilates exercise program on menopausal symptoms and lumbar strength and flexibility in postmenopausal women. J. Exerc. Rehabil. 2016 , 12 , 247. [ Google Scholar ] [ CrossRef ]
  • Verlaan, S.; Maier, A.B.; Bauer, J.M.; Bautmans, I.; Brandt, K.; Donini, L.M.; Maggio, M.; McMurdo, M.E.; Mets, T.; Seal, C.; et al. Sufficient levels of 25-hydroxyvitamin D and protein intake required to increase muscle mass in sarcopenic older adults—The PROVIDE study. Clin. Nutr. 2018 , 37 , 551–557. [ Google Scholar ] [ CrossRef ]
  • Dewansingh, P.; Melse-Boonstra, A.; Krijnen, W.P.; van der Schans, C.P.; Jager-Wittenaar, H.; van den Heuvel, E.G. Supplemental protein from dairy products increases body weight and vitamin D improves physical performance in older adults: A systematic review and meta-analysis. Nutr. Res. 2018 , 49 , 1–22. [ Google Scholar ] [ CrossRef ]
  • Armstrong, A.L.; Oborne, J.; Coupland, C.A.; MacPherson, M.B.; Bassey, E.J.; Wallace, W.A. Effects of hormone replacement therapy on muscle performance and balance in post-menopausal women. Clin. Sci. 1996 , 91 , 685–690. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Carville, S.F.; Rutherford, O.M.; Newham, D.J. Power output, isometric strength and steadiness in the leg muscles of pre-and postmenopausal women; the effects of hormone replacement therapy. Eur. J. Appl. Physiol. 2006 , 96 , 292–298. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Ribom, E.L.; Piehl-Aulin, K.; Ljunghall, S.; Ljunggren, Ö.; Naessén, T. Six months of hormone replacement therapy does not influence muscle strength in postmenopausal women. Maturitas 2002 , 42 , 225–231. [ Google Scholar ] [ CrossRef ]
  • Jacobsen, D.E.; Samson, M.M.; Kezic, S.; Verhaar, H.J.J. Postmenopausal HRT and tibolone in relation to muscle strength and body composition. Maturitas 2007 , 58 , 7–18. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Elliott, K.J.; Sale, C.; Cable, N.T. Effects of resistance training and detraining on muscle strength and blood lipid profiles in postmenopausal women. Br. J. Sports Med. 2002 , 36 , 340–344. [ Google Scholar ] [ CrossRef ]
  • Nunes, P.R.P.; Barcelos, L.C.; Oliveira, A.A.; Furlanetto Junior, R.; Martins, F.M.; Orsatti, C.L.; Resende, E.A.M.R.; Orsatti, F.L. Effect of resistance training on muscular strength and indicators of abdominal adiposity, metabolic risk, and inflammation in postmenopausal women: Controlled and randomized clinical trial of efficacy of training volume. Age 2016 , 38 , 1–13. [ Google Scholar ] [ CrossRef ]
  • Young, V.R.; Pellett, P.L. Protein intake and requirements with reference to diet and health. Am. J. Clin. Nutr. 1987 , 45 , 1323–1343. [ Google Scholar ] [ CrossRef ]
  • Volek, J.S. Influence of nutrition on responses to resistance training. Med. Sci. Sports Exerc. 2004 , 36 , 689–696. [ Google Scholar ] [ CrossRef ]
  • Desbrow, B.; McCormack, J.; Burke, L.M.; Cox, G.R.; Fallon, K.; Hislop, M.; Logan, R.; Marino, N.; Sawyer, S.M.; Shaw, G.; et al. Sports Dietitians Australia position statement: Sports nutrition for the adolescent athlete. Int. J. Sport Nutr. Exerc. Metab. 2014 , 24 , 570–584. [ Google Scholar ] [ CrossRef ]
  • Damanti, S.; Azzolino, D.; Roncaglione, C.; Arosio, B.; Rossi, P.; Cesari, M. Efficacy of nutritional interventions as stand-alone or synergistic treatments with exercise for the management of sarcopenia. Nutrients 2019 , 11 , 1991. [ Google Scholar ] [ CrossRef ]
  • Dedeyne, L.; Dupont, J.; Koppo, K.; Verschueren, S.; Tournoy, J.; Gielen, E. Exercise and Nutrition for Healthy AgeiNg (ENHANce) project–effects and mechanisms of action of combined anabolic interventions to improve physical functioning in sarcopenic older adults: Study protocol of a triple blinded, randomized controlled trial. BMC Geriatr. 2020 , 20 , 532. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Singh, M.A.F. Combined exercise and dietary intervention to optimize body composition in aging. Ann. N. Y. Acad. Sci. 1998 , 854 , 378–393. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Davitt, P.M.; Pellegrino, J.K.; Schanzer, J.R.; Tjionas, H.; Arent, S.M. The effects of a combined resistance training and endurance exercise program in inactive college female subjects: Does order matter? J. Strength Cond. Res. 2014 , 28 , 1937–1945. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Brellenthin, A.G.; Lanningham-Foster, L.M.; Kohut, M.L.; Li, Y.; Church, T.S.; Blair, S.N.; Lee, D.C. Comparison of the cardiovascular benefits of resistance, aerobic, and combined exercise (CardioRACE): Rationale, design, and methods. Am. Heart J. 2019 , 217 , 101–111. [ Google Scholar ] [ CrossRef ]

Click here to enlarge figure

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Kodete, C.S.; Thuraka, B.; Pasupuleti, V.; Malisetty, S. Hormonal Influences on Skeletal Muscle Function in Women across Life Stages: A Systematic Review. Muscles 2024 , 3 , 271-286. https://doi.org/10.3390/muscles3030024

Kodete CS, Thuraka B, Pasupuleti V, Malisetty S. Hormonal Influences on Skeletal Muscle Function in Women across Life Stages: A Systematic Review. Muscles . 2024; 3(3):271-286. https://doi.org/10.3390/muscles3030024

Kodete, Chandra Shikhi, Bharadwaj Thuraka, Vikram Pasupuleti, and Saiteja Malisetty. 2024. "Hormonal Influences on Skeletal Muscle Function in Women across Life Stages: A Systematic Review" Muscles 3, no. 3: 271-286. https://doi.org/10.3390/muscles3030024

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

IMAGES

  1. Integrating qualitative research with trials in systematic reviews

    a systematic qualitative literature review

  2. Systematic literature review phases.

    a systematic qualitative literature review

  3. Systematic Literature Review Methodology

    a systematic qualitative literature review

  4. systematic literature review steps

    a systematic qualitative literature review

  5. Process of the systematic literature review

    a systematic qualitative literature review

  6. How to Conduct a Systematic Review

    a systematic qualitative literature review

COMMENTS

  1. A Guide to Writing a Qualitative Systematic Review Protocol to Enhance

    Methodology: The key elements required in a systematic review protocol are discussed, with a focus on application to qualitative reviews: Development of a research question; formulation of key search terms and strategies; designing a multistage review process; critical appraisal of qualitative literature; development of data extraction ...

  2. Guidance on Conducting a Systematic Literature Review

    Literature reviews establish the foundation of academic inquires. However, in the planning field, we lack rigorous systematic reviews. In this article, through a systematic search on the methodology of literature review, we categorize a typology of literature reviews, discuss steps in conducting a systematic literature review, and provide suggestions on how to enhance rigor in literature ...

  3. Qualitative systematic reviews: their importance for our understanding

    A qualitative systematic review brings together research on a topic, systematically searching for research evidence from primary qualitative studies and drawing the findings together. There is a debate over whether the search needs to be exhaustive. 1 , 2 Methods for systematic reviews of quantitative research are well established and explicit ...

  4. Guidance to best tools and practices for systematic reviews

    The gray literature and a search of trials may also reveal important details about topics that would otherwise be missed ... Qualitative systematic review: Qualitative synthesis: Synthesis of qualitative data a: Qualitative synthesis: Synthesis without meta-analysis: Narrative synthesis b, narrative summary.

  5. Literature review as a research methodology: An overview and guidelines

    Provides guidelines for conducting a systematic literature review in management research. Torraco (2005) ... This is often referred to as a qualitative systematic review, which can be described as a method of comparing findings from qualitative studies (Grant & Booth, 2009). That is, a strict systematic review process is used to collect ...

  6. How to Do a Systematic Review: A Best Practice Guide for Conducting and

    The best reviews synthesize studies to draw broad theoretical conclusions about what a literature means, linking theory to evidence and evidence to theory. This guide describes how to plan, conduct, organize, and present a systematic review of quantitative (meta-analysis) or qualitative (narrative review, meta-synthesis) information.

  7. Guidelines for writing a systematic review

    A preliminary review, which can often result in a full systematic review, to understand the available research literature, is usually time or scope limited. Complies evidence from multiple reviews and does not search for primary studies. 3. Identifying a topic and developing inclusion/exclusion criteria.

  8. How-to conduct a systematic literature review: A quick guide for

    Method details Overview. A Systematic Literature Review (SLR) is a research methodology to collect, identify, and critically analyze the available research studies (e.g., articles, conference proceedings, books, dissertations) through a systematic procedure [12].An SLR updates the reader with current literature about a subject [6].The goal is to review critical points of current knowledge on a ...

  9. Why Qualitative Research Needs More and Better Systematic Review

    Those doing qualitative research cannot "opt out" of knowing their relevant scholarly conversations. Undertaking a qualitative systematic review provides a vital means to know and tune into the past conversation in your topic area that allows the researcher to position themselves and their work substantively, ontologically, theoretically, and methodologically in this landscape.

  10. A Guide to Writing a Qualitative Systematic Review Protocol to Enhance

    The qualitative systematic review is a rapidly developing area of nursing research. In order to present trustworthy, high-quality recommendations, such reviews should be based on a review protocol to minimize bias and enhance transparency and reproducibility. ... critical appraisal of qualitative literature; development of data extraction ...

  11. How to Do a Systematic Review: A Best Practice Guide for Conducting and

    The best reviews synthesize studies to draw broad theoretical conclusions about what a literature means, linking theory to evidence and evidence to theory. This guide describes how to plan, conduct, organize, and present a systematic review of quantitative (meta-analysis) or qualitative (narrative review, meta-synthesis) information.

  12. Qualitative and mixed methods in systematic reviews

    This Special Issue of Systematic Reviews Journal is providing a focus for these new methods of review whether these use qualitative review methods on their own or mixed together with more quantitative approaches. ... Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.

  13. Systematic Review

    Systematic review vs. literature review. A literature review is a type of review that uses a less systematic and formal approach than a systematic review. Typically, an expert in a topic will qualitatively summarize and evaluate previous work, without using a formal, explicit method. ... Narrative (qualitative): Summarize the information in ...

  14. An overview of methodological approaches in systematic reviews

    1. INTRODUCTION. Evidence synthesis is a prerequisite for knowledge translation. 1 A well conducted systematic review (SR), often in conjunction with meta‐analyses (MA) when appropriate, is considered the "gold standard" of methods for synthesizing evidence related to a topic of interest. 2 The central strength of an SR is the transparency of the methods used to systematically search ...

  15. Are Systematic Reviews Qualitative or Quantitative

    A systematic review can be qualitative, quantitative, or a combination of the two. The approach that is chosen is determined by the research question and the scope of the research. When qualitative and quantitative techniques are used together in a given study, it is called a mixed method. In a mixed-method study, synthesis for the quantitative ...

  16. Systematic reviews: Brief overview of methods, limitations, and

    CONCLUSION. Siddaway 16 noted that, "The best reviews synthesize studies to draw broad theoretical conclusions about what the literature means, linking theory to evidence and evidence to theory" (p. 747). To that end, high quality systematic reviews are explicit, rigorous, and reproducible. It is these three criteria that should guide authors seeking to write a systematic review or editors ...

  17. Qualitative Evidence Synthesis: Where Are We at?

    Through a QES, evidence is synthesized from primary qualitative studies with the aim of developing new cumulative knowledge. This differs to a more traditional literature review of qualitative research which seeks to combine studies in a summary format (Flemming & Jones, 2020).Depending on the QES method selected, the process can enable researchers to "go beyond" the individual findings of ...

  18. Research Guides: Systematic Reviews: Types of Literature Reviews

    Qualitative, narrative synthesis. Thematic analysis, may include conceptual models. Rapid review. Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research. Completeness of searching determined by time constraints.

  19. Home

    What is a Systematic Review? A systematic review is a literature review that gathers all of the available evidence matching pre-specified eligibility criteria to answer a specific research question. It uses explicit, systematic methods, documented in a protocol, to minimize bias, provide reliable findings, and inform decision-making.

  20. Home

    A systematic literature review is a method of synthesising scientific evidence and ensuring the quality of this evidence to answer a particular research question transparently and reproducibly. An accurate Systematic review includes all available published outputs on the topic (Guillaume, 2019). Types systematic review. 1. Scoping review

  21. Research Guides: Research at NJAES : Literature Reviews

    There are many different types of literature reviews from traditional literature reviews to rigorous systematic reviews. Each has its own methodology. Please review resources on this page and familiarize yourself with the task, commitment, and purpose of each before trying to decide on the type of review best fitting your research question.

  22. Mental health professionals' perceived barriers and enablers to shared

    Background: Risk assessment and risk management are fundamental processes in the delivery of safe and effective mental health care, yet studies have shown that service users are often not directly involved or are unaware that an assessment has taken place. Shared decision-making in mental health systems is supported by research and advocated in policy. This systematic review (PROSPERO ...

  23. Barriers and Solutions to the Gap between Theory and Practice in

    The guidelines for Preferred Reporting Items for Systematic Reviews and Meta-Analyses and the Joanna Briggs Institute methodology for Qualitative Systematic Reviews were used to perform and record a systematic search of the literature . In PROSPERO, an a priori protocol has been published (Registration No. CRD42023388954). 2.1.

  24. Qualitative systematic reviews: their importance for our understanding

    In addition to evidence of effectiveness, understanding how people with pain experience both their pain and their care can help us when we are working with them to provide care that meets their needs. A rigorous qualitative systematic review can also uncover new understandings, often helping illuminate 'why' and can help build theory.

  25. Experiences of informal caregivers supporting individuals with upper

    Background Upper gastrointestinal cancers (UGICs) are increasingly prevalent. With a poor prognosis and significant longer-term effects, UGICs present significant adjustment challenges for individuals with cancer and their informal caregivers. However, the supportive care needs of these informal caregivers are largely unknown. This systematic review of qualitative studies synthesises and ...

  26. Systematic and other reviews: criteria and complexities

    A systematic review follows explicit methodology to answer a well-defined research question by searching the literature comprehensively, evaluating the quantity and quality of research evidence rigorously, and analyzing the evidence to synthesize an answer to the research question. The evidence gathered in systematic reviews can be qualitative ...

  27. The Acceptability, Engagement, and Feasibility of Mental Health Apps

    Methods We conducted 2 sequential studies, consisting of a systematic literature review of mental health apps for underserved populations followed by a qualitative study with underserved young male participants (n=20; age: mean 19).

  28. Rationale and Standards for the Systematic Review of Qualitative

    Despite growing recognition of the need for qualitative methods in health services research, there have been few attempts to define quality standards for assessing the results. This article acknowl...

  29. Muscles

    Skeletal muscle function is vital for locomotion, posture, and metabolism, significantly impacting overall health and preventing falls, morbidity, and mortality, especially in elderly populations. This systematic review investigates the influence of hormonal fluctuations on skeletal muscle function across different life stages in women, including adolescence, the reproductive years, and menopause.

  30. Advancing circular economy approaches in plastic waste ...

    The Systematic Literature Review (SLR) is using ROSES (Reporting Standards for Systematic Evidence Syntheses), a set of guidelines developed by Haddaway et al. (2018). Compared to other protocols, ROSES is the most appropriate review methodology to use, given that the topic of this study is approaches for managing plastic waste.