Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

  • Knowledge Base

Methodology

  • How to Write a Literature Review | Guide, Examples, & Templates

How to Write a Literature Review | Guide, Examples, & Templates

Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .

There are five key steps to writing a literature review:

  • Search for relevant literature
  • Evaluate sources
  • Identify themes, debates, and gaps
  • Outline the structure
  • Write your literature review

A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

upload-your-document-ai-proofreader

Table of contents

What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.

  • Quick Run-through
  • Step 1 & 2

When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

  • Demonstrate your familiarity with the topic and its scholarly context
  • Develop a theoretical framework and methodology for your research
  • Position your work in relation to other researchers and theorists
  • Show how your research addresses a gap or contributes to a debate
  • Evaluate the current state of research and demonstrate your knowledge of the scholarly debates around your topic.

Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.

Literature review guide

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

uses of literature review in research methodology

Try for free

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

  • Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
  • Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
  • Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
  • Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .

Make a list of keywords

Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.

  • Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
  • Body image, self-perception, self-esteem, mental health
  • Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:

  • Your university’s library catalogue
  • Google Scholar
  • Project Muse (humanities and social sciences)
  • Medline (life sciences and biomedicine)
  • EconLit (economics)
  • Inspec (physics, engineering and computer science)

You can also use boolean operators to help narrow down your search.

Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.

For each publication, ask yourself:

  • What question or problem is the author addressing?
  • What are the key concepts and how are they defined?
  • What are the key theories, models, and methods?
  • Does the research use established frameworks or take an innovative approach?
  • What are the results and conclusions of the study?
  • How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
  • What are the strengths and weaknesses of the research?

Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.

You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

Receive feedback on language, structure, and formatting

Professional editors proofread and edit your paper by focusing on:

  • Academic style
  • Vague sentences
  • Style consistency

See an example

uses of literature review in research methodology

To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

  • Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
  • Themes: what questions or concepts recur across the literature?
  • Debates, conflicts and contradictions: where do sources disagree?
  • Pivotal publications: are there any influential theories or studies that changed the direction of the field?
  • Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

  • Most research has focused on young women.
  • There is an increasing interest in the visual aspects of social media.
  • But there is still a lack of robust research on highly visual platforms like Instagram and Snapchat—this is a gap that you could address in your own research.

There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.

Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

  • Look at what results have emerged in qualitative versus quantitative research
  • Discuss how the topic has been approached by empirical versus theoretical scholarship
  • Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, you can follow these tips:

  • Summarize and synthesize: give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: don’t just paraphrase other researchers — add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically evaluate: mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: use transition words and topic sentences to draw connections, comparisons and contrasts

In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.

When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !

This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.

Scribbr slides are free to use, customize, and distribute for educational purposes.

Open Google Slides Download PowerPoint

If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.

  • Sampling methods
  • Simple random sampling
  • Stratified sampling
  • Cluster sampling
  • Likert scales
  • Reproducibility

 Statistics

  • Null hypothesis
  • Statistical power
  • Probability distribution
  • Effect size
  • Poisson distribution

Research bias

  • Optimism bias
  • Cognitive bias
  • Implicit bias
  • Hawthorne effect
  • Anchoring bias
  • Explicit bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

There are several reasons to conduct a literature review at the beginning of a research project:

  • To familiarize yourself with the current state of knowledge on your topic
  • To ensure that you’re not just repeating what others have already done
  • To identify gaps in knowledge and unresolved problems that your research can address
  • To develop your theoretical framework and methodology
  • To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved February 12, 2024, from https://www.scribbr.com/dissertation/literature-review/

Is this article helpful?

Shona McCombes

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, what is your plagiarism score.

Research Methods

  • Getting Started
  • Literature Review Research
  • Research Design
  • Research Design By Discipline
  • SAGE Research Methods
  • Teaching with SAGE Research Methods

Literature Review

  • What is a Literature Review?
  • What is NOT a Literature Review?
  • Purposes of a Literature Review
  • Types of Literature Reviews
  • Literature Reviews vs. Systematic Reviews
  • Systematic vs. Meta-Analysis

Literature Review  is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.

Also, we can define a literature review as the collected body of scholarly works related to a topic:

  • Summarizes and analyzes previous research relevant to a topic
  • Includes scholarly books and articles published in academic journals
  • Can be an specific scholarly paper or a section in a research paper

The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic

  • Help gather ideas or information
  • Keep up to date in current trends and findings
  • Help develop new questions

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Helps focus your own research questions or problems
  • Discovers relationships between research studies/ideas.
  • Suggests unexplored ideas or populations
  • Identifies major themes, concepts, and researchers on a topic.
  • Tests assumptions; may help counter preconceived ideas and remove unconscious bias.
  • Identifies critical gaps, points of disagreement, or potentially flawed methodology or theoretical approaches.
  • Indicates potential directions for future research.

All content in this section is from Literature Review Research from Old Dominion University 

Keep in mind the following, a literature review is NOT:

Not an essay 

Not an annotated bibliography  in which you summarize each article that you have reviewed.  A literature review goes beyond basic summarizing to focus on the critical analysis of the reviewed works and their relationship to your research question.

Not a research paper   where you select resources to support one side of an issue versus another.  A lit review should explain and consider all sides of an argument in order to avoid bias, and areas of agreement and disagreement should be highlighted.

A literature review serves several purposes. For example, it

  • provides thorough knowledge of previous studies; introduces seminal works.
  • helps focus one’s own research topic.
  • identifies a conceptual framework for one’s own research questions or problems; indicates potential directions for future research.
  • suggests previously unused or underused methodologies, designs, quantitative and qualitative strategies.
  • identifies gaps in previous studies; identifies flawed methodologies and/or theoretical approaches; avoids replication of mistakes.
  • helps the researcher avoid repetition of earlier research.
  • suggests unexplored populations.
  • determines whether past studies agree or disagree; identifies controversy in the literature.
  • tests assumptions; may help counter preconceived ideas and remove unconscious bias.

As Kennedy (2007) notes*, it is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the original studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally that become part of the lore of field. In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews.

Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are several approaches to how they can be done, depending upon the type of analysis underpinning your study. Listed below are definitions of types of literature reviews:

Argumentative Review      This form examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to to make summary claims of the sort found in systematic reviews.

Integrative Review      Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication.

Historical Review      Few things rest in isolation from historical precedent. Historical reviews are focused on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review      A review does not always focus on what someone said [content], but how they said it [method of analysis]. This approach provides a framework of understanding at different levels (i.e. those of theory, substantive fields, research approaches and data collection and analysis techniques), enables researchers to draw on a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection and data analysis, and helps highlight many ethical issues which we should be aware of and consider as we go through our study.

Systematic Review      This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyse data from the studies that are included in the review. Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?"

Theoretical Review      The purpose of this form is to concretely examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review help establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

* Kennedy, Mary M. "Defining a Literature."  Educational Researcher  36 (April 2007): 139-147.

All content in this section is from The Literature Review created by Dr. Robert Larabee USC

Robinson, P. and Lowe, J. (2015),  Literature reviews vs systematic reviews.  Australian and New Zealand Journal of Public Health, 39: 103-103. doi: 10.1111/1753-6405.12393

uses of literature review in research methodology

What's in the name? The difference between a Systematic Review and a Literature Review, and why it matters . By Lynn Kysh from University of Southern California

uses of literature review in research methodology

Systematic review or meta-analysis?

A  systematic review  answers a defined research question by collecting and summarizing all empirical evidence that fits pre-specified eligibility criteria.

A  meta-analysis  is the use of statistical methods to summarize the results of these studies.

Systematic reviews, just like other research articles, can be of varying quality. They are a significant piece of work (the Centre for Reviews and Dissemination at York estimates that a team will take 9-24 months), and to be useful to other researchers and practitioners they should have:

  • clearly stated objectives with pre-defined eligibility criteria for studies
  • explicit, reproducible methodology
  • a systematic search that attempts to identify all studies
  • assessment of the validity of the findings of the included studies (e.g. risk of bias)
  • systematic presentation, and synthesis, of the characteristics and findings of the included studies

Not all systematic reviews contain meta-analysis. 

Meta-analysis is the use of statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review.  More information on meta-analyses can be found in  Cochrane Handbook, Chapter 9 .

A meta-analysis goes beyond critique and integration and conducts secondary statistical analysis on the outcomes of similar studies.  It is a systematic review that uses quantitative methods to synthesize and summarize the results.

An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings.  Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted.  In that case, an integrative review is an appropriate strategy. 

Some of the content in this section is from Systematic reviews and meta-analyses: step by step guide created by Kate McAllister.

  • << Previous: Getting Started
  • Next: Research Design >>
  • Last Updated: Aug 21, 2023 4:07 PM
  • URL: https://guides.lib.udel.edu/researchmethods

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

OWL logo

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

  • An introductory paragraph that explains what your working topic and thesis is
  • A forecast of key topics or texts that will appear in the review
  • Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
  • Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically Evaluate: Mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

  • Summarize the key findings you have taken from the literature and emphasize their significance
  • Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

  • Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
  • Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
  • Qualitative versus quantitative research
  • Empirical versus theoretical scholarship
  • Divide the research by sociological, historical, or cultural sources
  • Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

  • It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
  • Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
  • Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
  • Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

  • USC Libraries
  • Research Guides

Organizing Your Social Sciences Research Paper

  • 5. The Literature Review
  • Purpose of Guide
  • Design Flaws to Avoid
  • Independent and Dependent Variables
  • Glossary of Research Terms
  • Reading Research Effectively
  • Narrowing a Topic Idea
  • Broadening a Topic Idea
  • Extending the Timeliness of a Topic Idea
  • Academic Writing Style
  • Choosing a Title
  • Making an Outline
  • Paragraph Development
  • Research Process Video Series
  • Executive Summary
  • The C.A.R.S. Model
  • Background Information
  • The Research Problem/Question
  • Theoretical Framework
  • Citation Tracking
  • Content Alert Services
  • Evaluating Sources
  • Primary Sources
  • Secondary Sources
  • Tiertiary Sources
  • Scholarly vs. Popular Publications
  • Qualitative Methods
  • Quantitative Methods
  • Insiderness
  • Using Non-Textual Elements
  • Limitations of the Study
  • Common Grammar Mistakes
  • Writing Concisely
  • Avoiding Plagiarism
  • Footnotes or Endnotes?
  • Further Readings
  • Generative AI and Writing
  • USC Libraries Tutorials and Other Guides
  • Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

  • Give a new interpretation of old material or combine new with old interpretations,
  • Trace the intellectual progression of the field, including major debates,
  • Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
  • Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

  • Place each work in the context of its contribution to understanding the research problem being studied.
  • Describe the relationship of each work to the others under consideration.
  • Identify new ways to interpret prior research.
  • Reveal any gaps that exist in the literature.
  • Resolve conflicts amongst seemingly contradictory previous studies.
  • Identify areas of prior scholarship to prevent duplication of effort.
  • Point the way in fulfilling a need for additional research.
  • Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE : Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

  • An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
  • Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
  • An explanation of how each work is similar to and how it varies from the others,
  • Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

  • Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
  • Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
  • Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
  • Persuasiveness -- which of the author's theses are most convincing or least convincing?
  • Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

  • Current Situation : Information necessary to understand the current topic or focus of the literature review.
  • Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
  • History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
  • Standards : Description of the way in which you present your information.
  • Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

  • Sources in your literature review do not clearly relate to the research problem;
  • You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
  • Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
  • Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
  • Does not describe the search procedures that were used in identifying the literature to review;
  • Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
  • Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

  • How are they organizing their ideas?
  • What methods have they used to study the problem?
  • What theories have been used to explain, predict, or understand their research problem?
  • What sources have they cited to support their conclusions?
  • How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

  • Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
  • Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
  • Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

  • << Previous: Theoretical Framework
  • Next: Citation Tracking >>
  • Last Updated: Feb 8, 2024 1:57 PM
  • URL: https://libguides.usc.edu/writingguide
  • Methodology
  • Open access
  • Published: 11 October 2016

Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research

  • Stephen J. Gentles 1 , 4 ,
  • Cathy Charles 1 ,
  • David B. Nicholas 2 ,
  • Jenny Ploeg 3 &
  • K. Ann McKibbon 1  

Systematic Reviews volume  5 , Article number:  172 ( 2016 ) Cite this article

49k Accesses

26 Citations

13 Altmetric

Metrics details

Overviews of methods are potentially useful means to increase clarity and enhance collective understanding of specific methods topics that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness. This type of review represents a distinct literature synthesis method, although to date, its methodology remains relatively undeveloped despite several aspects that demand unique review procedures. The purpose of this paper is to initiate discussion about what a rigorous systematic approach to reviews of methods, referred to here as systematic methods overviews , might look like by providing tentative suggestions for approaching specific challenges likely to be encountered. The guidance offered here was derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research.

The guidance is organized into several principles that highlight specific objectives for this type of review given the common challenges that must be overcome to achieve them. Optional strategies for achieving each principle are also proposed, along with discussion of how they were successfully implemented in the overview on sampling. We describe seven paired principles and strategies that address the following aspects: delimiting the initial set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology used to describe specific methods topics, and generating rigorous verifiable analytic interpretations. Since a broad aim in systematic methods overviews is to describe and interpret the relevant literature in qualitative terms, we suggest that iterative decision making at various stages of the review process, and a rigorous qualitative approach to analysis are necessary features of this review type.

Conclusions

We believe that the principles and strategies provided here will be useful to anyone choosing to undertake a systematic methods overview. This paper represents an initial effort to promote high quality critical evaluations of the literature regarding problematic methods topics, which have the potential to promote clearer, shared understandings, and accelerate advances in research methods. Further work is warranted to develop more definitive guidance.

Peer Review reports

While reviews of methods are not new, they represent a distinct review type whose methodology remains relatively under-addressed in the literature despite the clear implications for unique review procedures. One of few examples to describe it is a chapter containing reflections of two contributing authors in a book of 21 reviews on methodological topics compiled for the British National Health Service, Health Technology Assessment Program [ 1 ]. Notable is their observation of how the differences between the methods reviews and conventional quantitative systematic reviews, specifically attributable to their varying content and purpose, have implications for defining what qualifies as systematic. While the authors describe general aspects of “systematicity” (including rigorous application of a methodical search, abstraction, and analysis), they also describe a high degree of variation within the category of methods reviews itself and so offer little in the way of concrete guidance. In this paper, we present tentative concrete guidance, in the form of a preliminary set of proposed principles and optional strategies, for a rigorous systematic approach to reviewing and evaluating the literature on quantitative or qualitative methods topics. For purposes of this article, we have used the term systematic methods overview to emphasize the notion of a systematic approach to such reviews.

The conventional focus of rigorous literature reviews (i.e., review types for which systematic methods have been codified, including the various approaches to quantitative systematic reviews [ 2 – 4 ], and the numerous forms of qualitative and mixed methods literature synthesis [ 5 – 10 ]) is to synthesize empirical research findings from multiple studies. By contrast, the focus of overviews of methods, including the systematic approach we advocate, is to synthesize guidance on methods topics. The literature consulted for such reviews may include the methods literature, methods-relevant sections of empirical research reports, or both. Thus, this paper adds to previous work published in this journal—namely, recent preliminary guidance for conducting reviews of theory [ 11 ]—that has extended the application of systematic review methods to novel review types that are concerned with subject matter other than empirical research findings.

Published examples of methods overviews illustrate the varying objectives they can have. One objective is to establish methodological standards for appraisal purposes. For example, reviews of existing quality appraisal standards have been used to propose universal standards for appraising the quality of primary qualitative research [ 12 ] or evaluating qualitative research reports [ 13 ]. A second objective is to survey the methods-relevant sections of empirical research reports to establish current practices on methods use and reporting practices, which Moher and colleagues [ 14 ] recommend as a means for establishing the needs to be addressed in reporting guidelines (see, for example [ 15 , 16 ]). A third objective for a methods review is to offer clarity and enhance collective understanding regarding a specific methods topic that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness within the available methods literature. An example of this is a overview whose objective was to review the inconsistent definitions of intention-to-treat analysis (the methodologically preferred approach to analyze randomized controlled trial data) that have been offered in the methods literature and propose a solution for improving conceptual clarity [ 17 ]. Such reviews are warranted because students and researchers who must learn or apply research methods typically lack the time to systematically search, retrieve, review, and compare the available literature to develop a thorough and critical sense of the varied approaches regarding certain controversial or ambiguous methods topics.

While systematic methods overviews , as a review type, include both reviews of the methods literature and reviews of methods-relevant sections from empirical study reports, the guidance provided here is primarily applicable to reviews of the methods literature since it was derived from the experience of conducting such a review [ 18 ], described below. To our knowledge, there are no well-developed proposals on how to rigorously conduct such reviews. Such guidance would have the potential to improve the thoroughness and credibility of critical evaluations of the methods literature, which could increase their utility as a tool for generating understandings that advance research methods, both qualitative and quantitative. Our aim in this paper is thus to initiate discussion about what might constitute a rigorous approach to systematic methods overviews. While we hope to promote rigor in the conduct of systematic methods overviews wherever possible, we do not wish to suggest that all methods overviews need be conducted to the same standard. Rather, we believe that the level of rigor may need to be tailored pragmatically to the specific review objectives, which may not always justify the resource requirements of an intensive review process.

The example systematic methods overview on sampling in qualitative research

The principles and strategies we propose in this paper are derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research [ 18 ]. The main objective of that methods overview was to bring clarity and deeper understanding of the prominent concepts related to sampling in qualitative research (purposeful sampling strategies, saturation, etc.). Specifically, we interpreted the available guidance, commenting on areas lacking clarity, consistency, or comprehensiveness (without proposing any recommendations on how to do sampling). This was achieved by a comparative and critical analysis of publications representing the most influential (i.e., highly cited) guidance across several methodological traditions in qualitative research.

The specific methods and procedures for the overview on sampling [ 18 ] from which our proposals are derived were developed both after soliciting initial input from local experts in qualitative research and an expert health librarian (KAM) and through ongoing careful deliberation throughout the review process. To summarize, in that review, we employed a transparent and rigorous approach to search the methods literature, selected publications for inclusion according to a purposeful and iterative process, abstracted textual data using structured abstraction forms, and analyzed (synthesized) the data using a systematic multi-step approach featuring abstraction of text, summary of information in matrices, and analytic comparisons.

For this article, we reflected on both the problems and challenges encountered at different stages of the review and our means for selecting justifiable procedures to deal with them. Several principles were then derived by considering the generic nature of these problems, while the generalizable aspects of the procedures used to address them formed the basis of optional strategies. Further details of the specific methods and procedures used in the overview on qualitative sampling are provided below to illustrate both the types of objectives and challenges that reviewers will likely need to consider and our approach to implementing each of the principles and strategies.

Organization of the guidance into principles and strategies

For the purposes of this article, principles are general statements outlining what we propose are important aims or considerations within a particular review process, given the unique objectives or challenges to be overcome with this type of review. These statements follow the general format, “considering the objective or challenge of X, we propose Y to be an important aim or consideration.” Strategies are optional and flexible approaches for implementing the previous principle outlined. Thus, generic challenges give rise to principles, which in turn give rise to strategies.

We organize the principles and strategies below into three sections corresponding to processes characteristic of most systematic literature synthesis approaches: literature identification and selection ; data abstraction from the publications selected for inclusion; and analysis , including critical appraisal and synthesis of the abstracted data. Within each section, we also describe the specific methodological decisions and procedures used in the overview on sampling in qualitative research [ 18 ] to illustrate how the principles and strategies for each review process were applied and implemented in a specific case. We expect this guidance and accompanying illustrations will be useful for anyone considering engaging in a methods overview, particularly those who may be familiar with conventional systematic review methods but may not yet appreciate some of the challenges specific to reviewing the methods literature.

Results and discussion

Literature identification and selection.

The identification and selection process includes search and retrieval of publications and the development and application of inclusion and exclusion criteria to select the publications that will be abstracted and analyzed in the final review. Literature identification and selection for overviews of the methods literature is challenging and potentially more resource-intensive than for most reviews of empirical research. This is true for several reasons that we describe below, alongside discussion of the potential solutions. Additionally, we suggest in this section how the selection procedures can be chosen to match the specific analytic approach used in methods overviews.

Delimiting a manageable set of publications

One aspect of methods overviews that can make identification and selection challenging is the fact that the universe of literature containing potentially relevant information regarding most methods-related topics is expansive and often unmanageably so. Reviewers are faced with two large categories of literature: the methods literature , where the possible publication types include journal articles, books, and book chapters; and the methods-relevant sections of empirical study reports , where the possible publication types include journal articles, monographs, books, theses, and conference proceedings. In our systematic overview of sampling in qualitative research, exhaustively searching (including retrieval and first-pass screening) all publication types across both categories of literature for information on a single methods-related topic was too burdensome to be feasible. The following proposed principle follows from the need to delimit a manageable set of literature for the review.

Principle #1:

Considering the broad universe of potentially relevant literature, we propose that an important objective early in the identification and selection stage is to delimit a manageable set of methods-relevant publications in accordance with the objectives of the methods overview.

Strategy #1:

To limit the set of methods-relevant publications that must be managed in the selection process, reviewers have the option to initially review only the methods literature, and exclude the methods-relevant sections of empirical study reports, provided this aligns with the review’s particular objectives.

We propose that reviewers are justified in choosing to select only the methods literature when the objective is to map out the range of recognized concepts relevant to a methods topic, to summarize the most authoritative or influential definitions or meanings for methods-related concepts, or to demonstrate a problematic lack of clarity regarding a widely established methods-related concept and potentially make recommendations for a preferred approach to the methods topic in question. For example, in the case of the methods overview on sampling [ 18 ], the primary aim was to define areas lacking in clarity for multiple widely established sampling-related topics. In the review on intention-to-treat in the context of missing outcome data [ 17 ], the authors identified a lack of clarity based on multiple inconsistent definitions in the literature and went on to recommend separating the issue of how to handle missing outcome data from the issue of whether an intention-to-treat analysis can be claimed.

In contrast to strategy #1, it may be appropriate to select the methods-relevant sections of empirical study reports when the objective is to illustrate how a methods concept is operationalized in research practice or reported by authors. For example, one could review all the publications in 2 years’ worth of issues of five high-impact field-related journals to answer questions about how researchers describe implementing a particular method or approach, or to quantify how consistently they define or report using it. Such reviews are often used to highlight gaps in the reporting practices regarding specific methods, which may be used to justify items to address in reporting guidelines (for example, [ 14 – 16 ]).

It is worth recognizing that other authors have advocated broader positions regarding the scope of literature to be considered in a review, expanding on our perspective. Suri [ 10 ] (who, like us, emphasizes how different sampling strategies are suitable for different literature synthesis objectives) has, for example, described a two-stage literature sampling procedure (pp. 96–97). First, reviewers use an initial approach to conduct a broad overview of the field—for reviews of methods topics, this would entail an initial review of the research methods literature. This is followed by a second more focused stage in which practical examples are purposefully selected—for methods reviews, this would involve sampling the empirical literature to illustrate key themes and variations. While this approach is seductive in its capacity to generate more in depth and interpretive analytic findings, some reviewers may consider it too resource-intensive to include the second step no matter how selective the purposeful sampling. In the overview on sampling where we stopped after the first stage [ 18 ], we discussed our selective focus on the methods literature as a limitation that left opportunities for further analysis of the literature. We explicitly recommended, for example, that theoretical sampling was a topic for which a future review of the methods sections of empirical reports was justified to answer specific questions identified in the primary review.

Ultimately, reviewers must make pragmatic decisions that balance resource considerations, combined with informed predictions about the depth and complexity of literature available on their topic, with the stated objectives of their review. The remaining principles and strategies apply primarily to overviews that include the methods literature, although some aspects may be relevant to reviews that include empirical study reports.

Searching beyond standard bibliographic databases

An important reality affecting identification and selection in overviews of the methods literature is the increased likelihood for relevant publications to be located in sources other than journal articles (which is usually not the case for overviews of empirical research, where journal articles generally represent the primary publication type). In the overview on sampling [ 18 ], out of 41 full-text publications retrieved and reviewed, only 4 were journal articles, while 37 were books or book chapters. Since many books and book chapters did not exist electronically, their full text had to be physically retrieved in hardcopy, while 11 publications were retrievable only through interlibrary loan or purchase request. The tasks associated with such retrieval are substantially more time-consuming than electronic retrieval. Since a substantial proportion of methods-related guidance may be located in publication types that are less comprehensively indexed in standard bibliographic databases, identification and retrieval thus become complicated processes.

Principle #2:

Considering that important sources of methods guidance can be located in non-journal publication types (e.g., books, book chapters) that tend to be poorly indexed in standard bibliographic databases, it is important to consider alternative search methods for identifying relevant publications to be further screened for inclusion.

Strategy #2:

To identify books, book chapters, and other non-journal publication types not thoroughly indexed in standard bibliographic databases, reviewers may choose to consult one or more of the following less standard sources: Google Scholar, publisher web sites, or expert opinion.

In the case of the overview on sampling in qualitative research [ 18 ], Google Scholar had two advantages over other standard bibliographic databases: it indexes and returns records of books and book chapters likely to contain guidance on qualitative research methods topics; and it has been validated as providing higher citation counts than ISI Web of Science (a producer of numerous bibliographic databases accessible through institutional subscription) for several non-biomedical disciplines including the social sciences where qualitative research methods are prominently used [ 19 – 21 ]. While we identified numerous useful publications by consulting experts, the author publication lists generated through Google Scholar searches were uniquely useful to identify more recent editions of methods books identified by experts.

Searching without relevant metadata

Determining what publications to select for inclusion in the overview on sampling [ 18 ] could only rarely be accomplished by reviewing the publication’s metadata. This was because for the many books and other non-journal type publications we identified as possibly relevant, the potential content of interest would be located in only a subsection of the publication. In this common scenario for reviews of the methods literature (as opposed to methods overviews that include empirical study reports), reviewers will often be unable to employ standard title, abstract, and keyword database searching or screening as a means for selecting publications.

Principle #3:

Considering that the presence of information about the topic of interest may not be indicated in the metadata for books and similar publication types, it is important to consider other means of identifying potentially useful publications for further screening.

Strategy #3:

One approach to identifying potentially useful books and similar publication types is to consider what classes of such publications (e.g., all methods manuals for a certain research approach) are likely to contain relevant content, then identify, retrieve, and review the full text of corresponding publications to determine whether they contain information on the topic of interest.

In the example of the overview on sampling in qualitative research [ 18 ], the topic of interest (sampling) was one of numerous topics covered in the general qualitative research methods manuals. Consequently, examples from this class of publications first had to be identified for retrieval according to non-keyword-dependent criteria. Thus, all methods manuals within the three research traditions reviewed (grounded theory, phenomenology, and case study) that might contain discussion of sampling were sought through Google Scholar and expert opinion, their full text obtained, and hand-searched for relevant content to determine eligibility. We used tables of contents and index sections of books to aid this hand searching.

Purposefully selecting literature on conceptual grounds

A final consideration in methods overviews relates to the type of analysis used to generate the review findings. Unlike quantitative systematic reviews where reviewers aim for accurate or unbiased quantitative estimates—something that requires identifying and selecting the literature exhaustively to obtain all relevant data available (i.e., a complete sample)—in methods overviews, reviewers must describe and interpret the relevant literature in qualitative terms to achieve review objectives. In other words, the aim in methods overviews is to seek coverage of the qualitative concepts relevant to the methods topic at hand. For example, in the overview of sampling in qualitative research [ 18 ], achieving review objectives entailed providing conceptual coverage of eight sampling-related topics that emerged as key domains. The following principle recognizes that literature sampling should therefore support generating qualitative conceptual data as the input to analysis.

Principle #4:

Since the analytic findings of a systematic methods overview are generated through qualitative description and interpretation of the literature on a specified topic, selection of the literature should be guided by a purposeful strategy designed to achieve adequate conceptual coverage (i.e., representing an appropriate degree of variation in relevant ideas) of the topic according to objectives of the review.

Strategy #4:

One strategy for choosing the purposeful approach to use in selecting the literature according to the review objectives is to consider whether those objectives imply exploring concepts either at a broad overview level, in which case combining maximum variation selection with a strategy that limits yield (e.g., critical case, politically important, or sampling for influence—described below) may be appropriate; or in depth, in which case purposeful approaches aimed at revealing innovative cases will likely be necessary.

In the methods overview on sampling, the implied scope was broad since we set out to review publications on sampling across three divergent qualitative research traditions—grounded theory, phenomenology, and case study—to facilitate making informative conceptual comparisons. Such an approach would be analogous to maximum variation sampling.

At the same time, the purpose of that review was to critically interrogate the clarity, consistency, and comprehensiveness of literature from these traditions that was “most likely to have widely influenced students’ and researchers’ ideas about sampling” (p. 1774) [ 18 ]. In other words, we explicitly set out to review and critique the most established and influential (and therefore dominant) literature, since this represents a common basis of knowledge among students and researchers seeking understanding or practical guidance on sampling in qualitative research. To achieve this objective, we purposefully sampled publications according to the criterion of influence , which we operationalized as how often an author or publication has been referenced in print or informal discourse. This second sampling approach also limited the literature we needed to consider within our broad scope review to a manageable amount.

To operationalize this strategy of sampling for influence , we sought to identify both the most influential authors within a qualitative research tradition (all of whose citations were subsequently screened) and the most influential publications on the topic of interest by non-influential authors. This involved a flexible approach that combined multiple indicators of influence to avoid the dilemma that any single indicator might provide inadequate coverage. These indicators included bibliometric data (h-index for author influence [ 22 ]; number of cites for publication influence), expert opinion, and cross-references in the literature (i.e., snowball sampling). As a final selection criterion, a publication was included only if it made an original contribution in terms of novel guidance regarding sampling or a related concept; thus, purely secondary sources were excluded. Publish or Perish software (Anne-Wil Harzing; available at http://www.harzing.com/resources/publish-or-perish ) was used to generate bibliometric data via the Google Scholar database. Figure  1 illustrates how identification and selection in the methods overview on sampling was a multi-faceted and iterative process. The authors selected as influential, and the publications selected for inclusion or exclusion are listed in Additional file 1 (Matrices 1, 2a, 2b).

Literature identification and selection process used in the methods overview on sampling [ 18 ]

In summary, the strategies of seeking maximum variation and sampling for influence were employed in the sampling overview to meet the specific review objectives described. Reviewers will need to consider the full range of purposeful literature sampling approaches at their disposal in deciding what best matches the specific aims of their own reviews. Suri [ 10 ] has recently retooled Patton’s well-known typology of purposeful sampling strategies (originally intended for primary research) for application to literature synthesis, providing a useful resource in this respect.

Data abstraction

The purpose of data abstraction in rigorous literature reviews is to locate and record all data relevant to the topic of interest from the full text of included publications, making them available for subsequent analysis. Conventionally, a data abstraction form—consisting of numerous distinct conceptually defined fields to which corresponding information from the source publication is recorded—is developed and employed. There are several challenges, however, to the processes of developing the abstraction form and abstracting the data itself when conducting methods overviews, which we address here. Some of these problems and their solutions may be familiar to those who have conducted qualitative literature syntheses, which are similarly conceptual.

Iteratively defining conceptual information to abstract

In the overview on sampling [ 18 ], while we surveyed multiple sources beforehand to develop a list of concepts relevant for abstraction (e.g., purposeful sampling strategies, saturation, sample size), there was no way for us to anticipate some concepts prior to encountering them in the review process. Indeed, in many cases, reviewers are unable to determine the complete set of methods-related concepts that will be the focus of the final review a priori without having systematically reviewed the publications to be included. Thus, defining what information to abstract beforehand may not be feasible.

Principle #5:

Considering the potential impracticality of defining a complete set of relevant methods-related concepts from a body of literature one has not yet systematically read, selecting and defining fields for data abstraction must often be undertaken iteratively. Thus, concepts to be abstracted can be expected to grow and change as data abstraction proceeds.

Strategy #5:

Reviewers can develop an initial form or set of concepts for abstraction purposes according to standard methods (e.g., incorporating expert feedback, pilot testing) and remain attentive to the need to iteratively revise it as concepts are added or modified during the review. Reviewers should document revisions and return to re-abstract data from previously abstracted publications as the new data requirements are determined.

In the sampling overview [ 18 ], we developed and maintained the abstraction form in Microsoft Word. We derived the initial set of abstraction fields from our own knowledge of relevant sampling-related concepts, consultation with local experts, and reviewing a pilot sample of publications. Since the publications in this review included a large proportion of books, the abstraction process often began by flagging the broad sections within a publication containing topic-relevant information for detailed review to identify text to abstract. When reviewing flagged text, the reviewer occasionally encountered an unanticipated concept significant enough to warrant being added as a new field to the abstraction form. For example, a field was added to capture how authors described the timing of sampling decisions, whether before (a priori) or after (ongoing) starting data collection, or whether this was unclear. In these cases, we systematically documented the modification to the form and returned to previously abstracted publications to abstract any information that might be relevant to the new field.

The logic of this strategy is analogous to the logic used in a form of research synthesis called best fit framework synthesis (BFFS) [ 23 – 25 ]. In that method, reviewers initially code evidence using an a priori framework they have selected. When evidence cannot be accommodated by the selected framework, reviewers then develop new themes or concepts from which they construct a new expanded framework. Both the strategy proposed and the BFFS approach to research synthesis are notable for their rigorous and transparent means to adapt a final set of concepts to the content under review.

Accounting for inconsistent terminology

An important complication affecting the abstraction process in methods overviews is that the language used by authors to describe methods-related concepts can easily vary across publications. For example, authors from different qualitative research traditions often use different terms for similar methods-related concepts. Furthermore, as we found in the sampling overview [ 18 ], there may be cases where no identifiable term, phrase, or label for a methods-related concept is used at all, and a description of it is given instead. This can make searching the text for relevant concepts based on keywords unreliable.

Principle #6:

Since accepted terms may not be used consistently to refer to methods concepts, it is necessary to rely on the definitions for concepts, rather than keywords, to identify relevant information in the publication to abstract.

Strategy #6:

An effective means to systematically identify relevant information is to develop and iteratively adjust written definitions for key concepts (corresponding to abstraction fields) that are consistent with and as inclusive of as much of the literature reviewed as possible. Reviewers then seek information that matches these definitions (rather than keywords) when scanning a publication for relevant data to abstract.

In the abstraction process for the sampling overview [ 18 ], we noted the several concepts of interest to the review for which abstraction by keyword was particularly problematic due to inconsistent terminology across publications: sampling , purposeful sampling , sampling strategy , and saturation (for examples, see Additional file 1 , Matrices 3a, 3b, 4). We iteratively developed definitions for these concepts by abstracting text from publications that either provided an explicit definition or from which an implicit definition could be derived, which was recorded in fields dedicated to the concept’s definition. Using a method of constant comparison, we used text from definition fields to inform and modify a centrally maintained definition of the corresponding concept to optimize its fit and inclusiveness with the literature reviewed. Table  1 shows, as an example, the final definition constructed in this way for one of the central concepts of the review, qualitative sampling .

We applied iteratively developed definitions when making decisions about what specific text to abstract for an existing field, which allowed us to abstract concept-relevant data even if no recognized keyword was used. For example, this was the case for the sampling-related concept, saturation , where the relevant text available for abstraction in one publication [ 26 ]—“to continue to collect data until nothing new was being observed or recorded, no matter how long that takes”—was not accompanied by any term or label whatsoever.

This comparative analytic strategy (and our approach to analysis more broadly as described in strategy #7, below) is analogous to the process of reciprocal translation —a technique first introduced for meta-ethnography by Noblit and Hare [ 27 ] that has since been recognized as a common element in a variety of qualitative metasynthesis approaches [ 28 ]. Reciprocal translation, taken broadly, involves making sense of a study’s findings in terms of the findings of the other studies included in the review. In practice, it has been operationalized in different ways. Melendez-Torres and colleagues developed a typology from their review of the metasynthesis literature, describing four overlapping categories of specific operations undertaken in reciprocal translation: visual representation, key paper integration, data reduction and thematic extraction, and line-by-line coding [ 28 ]. The approaches suggested in both strategies #6 and #7, with their emphasis on constant comparison, appear to fall within the line-by-line coding category.

Generating credible and verifiable analytic interpretations

The analysis in a systematic methods overview must support its more general objective, which we suggested above is often to offer clarity and enhance collective understanding regarding a chosen methods topic. In our experience, this involves describing and interpreting the relevant literature in qualitative terms. Furthermore, any interpretative analysis required may entail reaching different levels of abstraction, depending on the more specific objectives of the review. For example, in the overview on sampling [ 18 ], we aimed to produce a comparative analysis of how multiple sampling-related topics were treated differently within and among different qualitative research traditions. To promote credibility of the review, however, not only should one seek a qualitative analytic approach that facilitates reaching varying levels of abstraction but that approach must also ensure that abstract interpretations are supported and justified by the source data and not solely the product of the analyst’s speculative thinking.

Principle #7:

Considering the qualitative nature of the analysis required in systematic methods overviews, it is important to select an analytic method whose interpretations can be verified as being consistent with the literature selected, regardless of the level of abstraction reached.

Strategy #7:

We suggest employing the constant comparative method of analysis [ 29 ] because it supports developing and verifying analytic links to the source data throughout progressively interpretive or abstract levels. In applying this approach, we advise a rigorous approach, documenting how supportive quotes or references to the original texts are carried forward in the successive steps of analysis to allow for easy verification.

The analytic approach used in the methods overview on sampling [ 18 ] comprised four explicit steps, progressing in level of abstraction—data abstraction, matrices, narrative summaries, and final analytic conclusions (Fig.  2 ). While we have positioned data abstraction as the second stage of the generic review process (prior to Analysis), above, we also considered it as an initial step of analysis in the sampling overview for several reasons. First, it involved a process of constant comparisons and iterative decision-making about the fields to add or define during development and modification of the abstraction form, through which we established the range of concepts to be addressed in the review. At the same time, abstraction involved continuous analytic decisions about what textual quotes (ranging in size from short phrases to numerous paragraphs) to record in the fields thus created. This constant comparative process was analogous to open coding in which textual data from publications was compared to conceptual fields (equivalent to codes) or to other instances of data previously abstracted when constructing definitions to optimize their fit with the overall literature as described in strategy #6. Finally, in the data abstraction step, we also recorded our first interpretive thoughts in dedicated fields, providing initial material for the more abstract analytic steps.

Summary of progressive steps of analysis used in the methods overview on sampling [ 18 ]

In the second step of the analysis, we constructed topic-specific matrices , or tables, by copying relevant quotes from abstraction forms into the appropriate cells of matrices (for the complete set of analytic matrices developed in the sampling review, see Additional file 1 (matrices 3 to 10)). Each matrix ranged from one to five pages; row headings, nested three-deep, identified the methodological tradition, author, and publication, respectively; and column headings identified the concepts, which corresponded to abstraction fields. Matrices thus allowed us to make further comparisons across methodological traditions, and between authors within a tradition. In the third step of analysis, we recorded our comparative observations as narrative summaries , in which we used illustrative quotes more sparingly. In the final step, we developed analytic conclusions based on the narrative summaries about the sampling-related concepts within each methodological tradition for which clarity, consistency, or comprehensiveness of the available guidance appeared to be lacking. Higher levels of analysis thus built logically from the lower levels, enabling us to easily verify analytic conclusions by tracing the support for claims by comparing the original text of publications reviewed.

Integrative versus interpretive methods overviews

The analytic product of systematic methods overviews is comparable to qualitative evidence syntheses, since both involve describing and interpreting the relevant literature in qualitative terms. Most qualitative synthesis approaches strive to produce new conceptual understandings that vary in level of interpretation. Dixon-Woods and colleagues [ 30 ] elaborate on a useful distinction, originating from Noblit and Hare [ 27 ], between integrative and interpretive reviews. Integrative reviews focus on summarizing available primary data and involve using largely secure and well defined concepts to do so; definitions are used from an early stage to specify categories for abstraction (or coding) of data, which in turn supports their aggregation; they do not seek as their primary focus to develop or specify new concepts, although they may achieve some theoretical or interpretive functions. For interpretive reviews, meanwhile, the main focus is to develop new concepts and theories that integrate them, with the implication that the concepts developed become fully defined towards the end of the analysis. These two forms are not completely distinct, and “every integrative synthesis will include elements of interpretation, and every interpretive synthesis will include elements of aggregation of data” [ 30 ].

The example methods overview on sampling [ 18 ] could be classified as predominantly integrative because its primary goal was to aggregate influential authors’ ideas on sampling-related concepts; there were also, however, elements of interpretive synthesis since it aimed to develop new ideas about where clarity in guidance on certain sampling-related topics is lacking, and definitions for some concepts were flexible and not fixed until late in the review. We suggest that most systematic methods overviews will be classifiable as predominantly integrative (aggregative). Nevertheless, more highly interpretive methods overviews are also quite possible—for example, when the review objective is to provide a highly critical analysis for the purpose of generating new methodological guidance. In such cases, reviewers may need to sample more deeply (see strategy #4), specifically by selecting empirical research reports (i.e., to go beyond dominant or influential ideas in the methods literature) that are likely to feature innovations or instructive lessons in employing a given method.

In this paper, we have outlined tentative guidance in the form of seven principles and strategies on how to conduct systematic methods overviews, a review type in which methods-relevant literature is systematically analyzed with the aim of offering clarity and enhancing collective understanding regarding a specific methods topic. Our proposals include strategies for delimiting the set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology, and generating credible and verifiable analytic interpretations. We hope the suggestions proposed will be useful to others undertaking reviews on methods topics in future.

As far as we are aware, this is the first published source of concrete guidance for conducting this type of review. It is important to note that our primary objective was to initiate methodological discussion by stimulating reflection on what rigorous methods for this type of review should look like, leaving the development of more complete guidance to future work. While derived from the experience of reviewing a single qualitative methods topic, we believe the principles and strategies provided are generalizable to overviews of both qualitative and quantitative methods topics alike. However, it is expected that additional challenges and insights for conducting such reviews have yet to be defined. Thus, we propose that next steps for developing more definitive guidance should involve an attempt to collect and integrate other reviewers’ perspectives and experiences in conducting systematic methods overviews on a broad range of qualitative and quantitative methods topics. Formalized guidance and standards would improve the quality of future methods overviews, something we believe has important implications for advancing qualitative and quantitative methodology. When undertaken to a high standard, rigorous critical evaluations of the available methods guidance have significant potential to make implicit controversies explicit, and improve the clarity and precision of our understandings of problematic qualitative or quantitative methods issues.

A review process central to most types of rigorous reviews of empirical studies, which we did not explicitly address in a separate review step above, is quality appraisal . The reason we have not treated this as a separate step stems from the different objectives of the primary publications included in overviews of the methods literature (i.e., providing methodological guidance) compared to the primary publications included in the other established review types (i.e., reporting findings from single empirical studies). This is not to say that appraising quality of the methods literature is not an important concern for systematic methods overviews. Rather, appraisal is much more integral to (and difficult to separate from) the analysis step, in which we advocate appraising clarity, consistency, and comprehensiveness—the quality appraisal criteria that we suggest are appropriate for the methods literature. As a second important difference regarding appraisal, we currently advocate appraising the aforementioned aspects at the level of the literature in aggregate rather than at the level of individual publications. One reason for this is that methods guidance from individual publications generally builds on previous literature, and thus we feel that ahistorical judgments about comprehensiveness of single publications lack relevance and utility. Additionally, while different methods authors may express themselves less clearly than others, their guidance can nonetheless be highly influential and useful, and should therefore not be downgraded or ignored based on considerations of clarity—which raises questions about the alternative uses that quality appraisals of individual publications might have. Finally, legitimate variability in the perspectives that methods authors wish to emphasize, and the levels of generality at which they write about methods, makes critiquing individual publications based on the criterion of clarity a complex and potentially problematic endeavor that is beyond the scope of this paper to address. By appraising the current state of the literature at a holistic level, reviewers stand to identify important gaps in understanding that represent valuable opportunities for further methodological development.

To summarize, the principles and strategies provided here may be useful to those seeking to undertake their own systematic methods overview. Additional work is needed, however, to establish guidance that is comprehensive by comparing the experiences from conducting a variety of methods overviews on a range of methods topics. Efforts that further advance standards for systematic methods overviews have the potential to promote high-quality critical evaluations that produce conceptually clear and unified understandings of problematic methods topics, thereby accelerating the advance of research methodology.

Hutton JL, Ashcroft R. What does “systematic” mean for reviews of methods? In: Black N, Brazier J, Fitzpatrick R, Reeves B, editors. Health services research methods: a guide to best practice. London: BMJ Publishing Group; 1998. p. 249–54.

Google Scholar  

Cochrane handbook for systematic reviews of interventions. In. Edited by Higgins JPT, Green S, Version 5.1.0 edn: The Cochrane Collaboration; 2011.

Centre for Reviews and Dissemination: Systematic reviews: CRD’s guidance for undertaking reviews in health care . York: Centre for Reviews and Dissemination; 2009.

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700–0.

Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9(1):59.

Article   PubMed   PubMed Central   Google Scholar  

Kastner M, Tricco AC, Soobiah C, Lillie E, Perrier L, Horsley T, Welch V, Cogo E, Antony J, Straus SE. What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Med Res Methodol. 2012;12(1):1–1.

Article   Google Scholar  

Booth A, Noyes J, Flemming K, Gerhardus A. Guidance on choosing qualitative evidence synthesis methods for use in health technology assessments of complex interventions. In: Integrate-HTA. 2016.

Booth A, Sutton A, Papaioannou D. Systematic approaches to successful literature review. 2nd ed. London: Sage; 2016.

Hannes K, Lockwood C. Synthesizing qualitative research: choosing the right approach. Chichester: Wiley-Blackwell; 2012.

Suri H. Towards methodologically inclusive research syntheses: expanding possibilities. New York: Routledge; 2014.

Campbell M, Egan M, Lorenc T, Bond L, Popham F, Fenton C, Benzeval M. Considering methodological options for reviews of theory: illustrated by a review of theories linking income and health. Syst Rev. 2014;3(1):1–11.

Cohen DJ, Crabtree BF. Evaluative criteria for qualitative research in health care: controversies and recommendations. Ann Fam Med. 2008;6(4):331–9.

Tong A, Sainsbury P, Craig J. Consolidated criteria for reportingqualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.

Article   PubMed   Google Scholar  

Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217.

Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007;4(3):e78.

Chan AW, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005;365(9465):1159–62.

Alshurafa M, Briel M, Akl EA, Haines T, Moayyedi P, Gentles SJ, Rios L, Tran C, Bhatnagar N, Lamontagne F, et al. Inconsistent definitions for intention-to-treat in relation to missing outcome data: systematic review of the methods literature. PLoS One. 2012;7(11):e49163.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Gentles SJ, Charles C, Ploeg J, McKibbon KA. Sampling in qualitative research: insights from an overview of the methods literature. Qual Rep. 2015;20(11):1772–89.

Harzing A-W, Alakangas S. Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison. Scientometrics. 2016;106(2):787–804.

Harzing A-WK, van der Wal R. Google Scholar as a new source for citation analysis. Ethics Sci Environ Polit. 2008;8(1):61–73.

Kousha K, Thelwall M. Google Scholar citations and Google Web/URL citations: a multi‐discipline exploratory analysis. J Assoc Inf Sci Technol. 2007;58(7):1055–65.

Hirsch JE. An index to quantify an individual’s scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569–72.

Booth A, Carroll C. How to build up the actionable knowledge base: the role of ‘best fit’ framework synthesis for studies of improvement in healthcare. BMJ Quality Safety. 2015;24(11):700–8.

Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13(1):37.

Carroll C, Booth A, Cooper K. A worked example of “best fit” framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents. BMC Med Res Methodol. 2011;11(1):29.

Cohen MZ, Kahn DL, Steeves DL. Hermeneutic phenomenological research: a practical guide for nurse researchers. Thousand Oaks: Sage; 2000.

Noblit GW, Hare RD. Meta-ethnography: synthesizing qualitative studies. Newbury Park: Sage; 1988.

Book   Google Scholar  

Melendez-Torres GJ, Grant S, Bonell C. A systematic review and critical appraisal of qualitative metasynthetic practice in public health to develop a taxonomy of operations of reciprocal translation. Res Synthesis Methods. 2015;6(4):357–71.

Article   CAS   Google Scholar  

Glaser BG, Strauss A. The discovery of grounded theory. Chicago: Aldine; 1967.

Dixon-Woods M, Agarwal S, Young B, Jones D, Sutton A. Integrative approaches to qualitative and quantitative evidence. In: UK National Health Service. 2004. p. 1–44.

Download references

Acknowledgements

Not applicable.

There was no funding for this work.

Availability of data and materials

The systematic methods overview used as a worked example in this article (Gentles SJ, Charles C, Ploeg J, McKibbon KA: Sampling in qualitative research: insights from an overview of the methods literature. The Qual Rep 2015, 20(11):1772-1789) is available from http://nsuworks.nova.edu/tqr/vol20/iss11/5 .

Authors’ contributions

SJG wrote the first draft of this article, with CC contributing to drafting. All authors contributed to revising the manuscript. All authors except CC (deceased) approved the final draft. SJG, CC, KAB, and JP were involved in developing methods for the systematic methods overview on sampling.

Authors’ information

Competing interests.

The authors declare that they have no competing interests.

Consent for publication

Ethics approval and consent to participate, author information, authors and affiliations.

Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada

Stephen J. Gentles, Cathy Charles & K. Ann McKibbon

Faculty of Social Work, University of Calgary, Alberta, Canada

David B. Nicholas

School of Nursing, McMaster University, Hamilton, Ontario, Canada

Jenny Ploeg

CanChild Centre for Childhood Disability Research, McMaster University, 1400 Main Street West, IAHS 408, Hamilton, ON, L8S 1C7, Canada

Stephen J. Gentles

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Stephen J. Gentles .

Additional information

Cathy Charles is deceased

Additional file

Additional file 1:.

Submitted: Analysis_matrices. (DOC 330 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article.

Gentles, S.J., Charles, C., Nicholas, D.B. et al. Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research. Syst Rev 5 , 172 (2016). https://doi.org/10.1186/s13643-016-0343-0

Download citation

Received : 06 June 2016

Accepted : 14 September 2016

Published : 11 October 2016

DOI : https://doi.org/10.1186/s13643-016-0343-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Systematic review
  • Literature selection
  • Research methods
  • Research methodology
  • Overview of methods
  • Systematic methods overview
  • Review methods

Systematic Reviews

ISSN: 2046-4053

  • Submission enquiries: Access here and click Contact Us
  • General enquiries: [email protected]

uses of literature review in research methodology

RMIT University

Teaching and Research guides

Literature reviews.

  • Introduction
  • Plan your search
  • Where to search
  • Refine and update your search
  • Finding grey literature
  • Writing the review
  • Referencing

Research methods overview

Finding literature on research methodologies, sage research methods online.

  • Get material not at RMIT
  • Further help

What are research methods?

Research methodology is the specific strategies, processes, or techniques utilised in the collection of information that is created and analysed.

The methodology section of a research paper, or thesis, enables the reader to critically evaluate the study’s validity and reliability by addressing how the data was collected or generated, and how it was analysed.

Types of research methods

There are three main types of research methods which use different designs for data collection.  

(1) Qualitative research

Qualitative research gathers data about lived experiences, emotions or behaviours, and the meanings individuals attach to them. It assists in enabling researchers to gain a better understanding of complex concepts, social interactions or cultural phenomena. This type of research is useful in the exploration of how or why things have occurred, interpreting events and describing actions.

Examples of qualitative research designs include:

  • focus groups
  • observations
  • document analysis
  • oral history or life stories  

(2) Quantitative research

Quantitative research gathers numerical data which can be ranked, measured or categorised through statistical analysis. It assists with uncovering patterns or relationships, and for making generalisations. This type of research is useful for finding out how many, how much, how often, or to what extent.

Examples of quantitative research designs include:

  • surveys or questionnaires
  • observation
  • document screening
  • experiments  

(3) Mixed method research

Mixed Methods research integrates both Qualitative research and Quantitative research. It provides a holistic approach combining and analysing the statistical data with deeper contextualised insights. Using Mixed Methods also enables triangulation, or verification, of the data from two or more sources.

Sometimes in your literature review, you might need to discuss and evaluate relevant research methodologies in order to justify your own choice of research methodology.

When searching for literature on research methodologies it is important to search across a range of sources. No single information source will supply all that you need. Selecting appropriate sources will depend upon your research topic.

Developing a robust search strategy will help reduce irrelevant results. It is good practice to plan a strategy before you start to search.

Search tips

(1) free text keywords.

Free text searching is the use of natural language words to conduct your search. Use selective free text keywords such as: phenomenological, "lived experience", "grounded theory", "life experiences", "focus groups", interview, quantitative, survey, validity, variance, correlation and statistical.

To locate books on your desired methodology, try LibrarySearch . Remember to use  refine  options such as books, ebooks, subject, and publication date.  

(2) Subject headings in Databases

Databases categorise their records using subject terms, or a controlled vocabulary (thesaurus). These subject headings may be useful to use, in addition to utilising free text keywords in a database search.

Subject headings will differ across databases, for example, the PubMed database uses 'Qualitative Research' whilst the CINHAL database uses 'Qualitative Studies.'  

(3) Limiting search results

Databases enable sets of results to be limited or filtered by specific fields, look for options such as Publication Type, Article Type, etc. and apply them to your search.  

(4) Browse the Library shelves

To find books on  research methods  browse the Library shelves at call number  001.42

  • SAGE Research Methods Online SAGE Research Methods Online (SRMO) is a research tool supported by a newly devised taxonomy that links content and methods terms. It provides the most comprehensive picture available today of research methods (quantitative, qualitative and mixed methods) across the social and behavioural sciences.

SAGE Research Methods Overview  (2:07 min) by SAGE Publishing  ( YouTube ) 

  • << Previous: Referencing
  • Next: Get material not at RMIT >>

Creative Commons license: CC-BY-NC.

  • Last Updated: Feb 13, 2024 3:55 PM
  • URL: https://rmit.libguides.com/literature-review

Library Homepage

Research Methods and Design

  • Action Research
  • Case Study Design

Literature Review

  • Quantitative Research Methods
  • Qualitative Research Methods
  • Mixed Methods Study
  • Indigenous Research and Ethics This link opens in a new window
  • Identifying Empirical Research Articles This link opens in a new window
  • Research Ethics and Quality
  • Data Literacy
  • Get Help with Writing Assignments

A literature review is a discussion of the literature (aka. the "research" or "scholarship") surrounding a certain topic. A good literature review doesn't simply summarize the existing material, but provides thoughtful synthesis and analysis. The purpose of a literature review is to orient your own work within an existing body of knowledge. A literature review may be written as a standalone piece or be included in a larger body of work.

You can read more about literature reviews, what they entail, and how to write one, using the resources below. 

Am I the only one struggling to write a literature review?

Dr. Zina O'Leary explains the misconceptions and struggles students often have with writing a literature review. She also provides step-by-step guidance on writing a persuasive literature review.

An Introduction to Literature Reviews

Dr. Eric Jensen, Professor of Sociology at the University of Warwick, and Dr. Charles Laurie, Director of Research at Verisk Maplecroft, explain how to write a literature review, and why researchers need to do so. Literature reviews can be stand-alone research or part of a larger project. They communicate the state of academic knowledge on a given topic, specifically detailing what is still unknown.

This is the first video in a whole series about literature reviews. You can find the rest of the series in our SAGE database, Research Methods:

Videos

Videos covering research methods and statistics

Identify Themes and Gaps in Literature (with real examples) | Scribbr

Finding connections between sources is key to organizing the arguments and structure of a good literature review. In this video, you'll learn how to identify themes, debates, and gaps between sources, using examples from real papers.

4 Tips for Writing a Literature Review's Intro, Body, and Conclusion | Scribbr

While each review will be unique in its structure--based on both the existing body of both literature and the overall goals of your own paper, dissertation, or research--this video from Scribbr does a good job simplifying the goals of writing a literature review for those who are new to the process. In this video, you’ll learn what to include in each section, as well as 4 tips for the main body illustrated with an example.

Cover Art

  • Literature Review This chapter in SAGE's Encyclopedia of Research Design describes the types of literature reviews and scientific standards for conducting literature reviews.
  • UNC Writing Center: Literature Reviews This handout from the Writing Center at UNC will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.
  • Purdue OWL: Writing a Literature Review The overview of literature reviews comes from Purdue's Online Writing Lab. It explains the basic why, what, and how of writing a literature review.

Organizational Tools for Literature Reviews

One of the most daunting aspects of writing a literature review is organizing your research. There are a variety of strategies that you can use to help you in this task. We've highlighted just a few ways writers keep track of all that information! You can use a combination of these tools or come up with your own organizational process. The key is choosing something that works with your own learning style.

Citation Managers

Citation managers are great tools, in general, for organizing research, but can be especially helpful when writing a literature review. You can keep all of your research in one place, take notes, and organize your materials into different folders or categories. Read more about citations managers here:

  • Manage Citations & Sources

Concept Mapping

Some writers use concept mapping (sometimes called flow or bubble charts or "mind maps") to help them visualize the ways in which the research they found connects.

uses of literature review in research methodology

There is no right or wrong way to make a concept map. There are a variety of online tools that can help you create a concept map or you can simply put pen to paper. To read more about concept mapping, take a look at the following help guides:

  • Using Concept Maps From Williams College's guide, Literature Review: A Self-guided Tutorial

Synthesis Matrix

A synthesis matrix is is a chart you can use to help you organize your research into thematic categories. By organizing your research into a matrix, like the examples below, can help you visualize the ways in which your sources connect. 

  • Walden University Writing Center: Literature Review Matrix Find a variety of literature review matrix examples and templates from Walden University.
  • Writing A Literature Review and Using a Synthesis Matrix An example synthesis matrix created by NC State University Writing and Speaking Tutorial Service Tutors. If you would like a copy of this synthesis matrix in a different format, like a Word document, please ask a librarian. CC-BY-SA 3.0
  • << Previous: Case Study Design
  • Next: Quantitative Research Methods >>
  • Last Updated: Feb 6, 2024 9:20 AM

CityU Home - CityU Catalog

Creative Commons License

Duke University Libraries

Literature Reviews

  • Getting started

What is a literature review?

Why conduct a literature review, stages of a literature review, lit reviews: an overview (video), check out these books.

  • Types of reviews
  • 1. Define your research question
  • 2. Plan your search
  • 3. Search the literature
  • 4. Organize your results
  • 5. Synthesize your findings
  • 6. Write the review
  • Thompson Writing Studio This link opens in a new window
  • Need to write a systematic review? This link opens in a new window

uses of literature review in research methodology

Contact a Librarian

Ask a Librarian

uses of literature review in research methodology

Definition: A literature review is a systematic examination and synthesis of existing scholarly research on a specific topic or subject.

Purpose: It serves to provide a comprehensive overview of the current state of knowledge within a particular field.

Analysis: Involves critically evaluating and summarizing key findings, methodologies, and debates found in academic literature.

Identifying Gaps: Aims to pinpoint areas where there is a lack of research or unresolved questions, highlighting opportunities for further investigation.

Contextualization: Enables researchers to understand how their work fits into the broader academic conversation and contributes to the existing body of knowledge.

uses of literature review in research methodology

tl;dr  A literature review critically examines and synthesizes existing scholarly research and publications on a specific topic to provide a comprehensive understanding of the current state of knowledge in the field.

What is a literature review NOT?

❌ An annotated bibliography

❌ Original research

❌ A summary

❌ Something to be conducted at the end of your research

❌ An opinion piece

❌ A chronological compilation of studies

The reason for conducting a literature review is to:

uses of literature review in research methodology

Literature Reviews: An Overview for Graduate Students

While this 9-minute video from NCSU is geared toward graduate students, it is useful for anyone conducting a literature review.

uses of literature review in research methodology

Writing the literature review: A practical guide

Available 3rd floor of Perkins

uses of literature review in research methodology

Writing literature reviews: A guide for students of the social and behavioral sciences

Available online!

uses of literature review in research methodology

So, you have to write a literature review: A guided workbook for engineers

uses of literature review in research methodology

Telling a research story: Writing a literature review

uses of literature review in research methodology

The literature review: Six steps to success

uses of literature review in research methodology

Systematic approaches to a successful literature review

Request from Duke Medical Center Library

uses of literature review in research methodology

Doing a systematic review: A student's guide

  • Next: Types of reviews >>
  • Last Updated: Feb 15, 2024 1:45 PM
  • URL: https://guides.library.duke.edu/lit-reviews

Duke University Libraries

Services for...

  • Faculty & Instructors
  • Graduate Students
  • Undergraduate Students
  • International Students
  • Patrons with Disabilities

Twitter

  • Harmful Language Statement
  • Re-use & Attribution / Privacy
  • Support the Libraries

Creative Commons License

  • Privacy Policy
  • SignUp/Login

Research Method

Home » Literature Review – Types Writing Guide and Examples

Literature Review – Types Writing Guide and Examples

Table of Contents

Literature Review

Literature Review

Definition:

A literature review is a comprehensive and critical analysis of the existing literature on a particular topic or research question. It involves identifying, evaluating, and synthesizing relevant literature, including scholarly articles, books, and other sources, to provide a summary and critical assessment of what is known about the topic.

Types of Literature Review

Types of Literature Review are as follows:

  • Narrative literature review : This type of review involves a comprehensive summary and critical analysis of the available literature on a particular topic or research question. It is often used as an introductory section of a research paper.
  • Systematic literature review: This is a rigorous and structured review that follows a pre-defined protocol to identify, evaluate, and synthesize all relevant studies on a specific research question. It is often used in evidence-based practice and systematic reviews.
  • Meta-analysis: This is a quantitative review that uses statistical methods to combine data from multiple studies to derive a summary effect size. It provides a more precise estimate of the overall effect than any individual study.
  • Scoping review: This is a preliminary review that aims to map the existing literature on a broad topic area to identify research gaps and areas for further investigation.
  • Critical literature review : This type of review evaluates the strengths and weaknesses of the existing literature on a particular topic or research question. It aims to provide a critical analysis of the literature and identify areas where further research is needed.
  • Conceptual literature review: This review synthesizes and integrates theories and concepts from multiple sources to provide a new perspective on a particular topic. It aims to provide a theoretical framework for understanding a particular research question.
  • Rapid literature review: This is a quick review that provides a snapshot of the current state of knowledge on a specific research question or topic. It is often used when time and resources are limited.
  • Thematic literature review : This review identifies and analyzes common themes and patterns across a body of literature on a particular topic. It aims to provide a comprehensive overview of the literature and identify key themes and concepts.
  • Realist literature review: This review is often used in social science research and aims to identify how and why certain interventions work in certain contexts. It takes into account the context and complexities of real-world situations.
  • State-of-the-art literature review : This type of review provides an overview of the current state of knowledge in a particular field, highlighting the most recent and relevant research. It is often used in fields where knowledge is rapidly evolving, such as technology or medicine.
  • Integrative literature review: This type of review synthesizes and integrates findings from multiple studies on a particular topic to identify patterns, themes, and gaps in the literature. It aims to provide a comprehensive understanding of the current state of knowledge on a particular topic.
  • Umbrella literature review : This review is used to provide a broad overview of a large and diverse body of literature on a particular topic. It aims to identify common themes and patterns across different areas of research.
  • Historical literature review: This type of review examines the historical development of research on a particular topic or research question. It aims to provide a historical context for understanding the current state of knowledge on a particular topic.
  • Problem-oriented literature review : This review focuses on a specific problem or issue and examines the literature to identify potential solutions or interventions. It aims to provide practical recommendations for addressing a particular problem or issue.
  • Mixed-methods literature review : This type of review combines quantitative and qualitative methods to synthesize and analyze the available literature on a particular topic. It aims to provide a more comprehensive understanding of the research question by combining different types of evidence.

Parts of Literature Review

Parts of a literature review are as follows:

Introduction

The introduction of a literature review typically provides background information on the research topic and why it is important. It outlines the objectives of the review, the research question or hypothesis, and the scope of the review.

Literature Search

This section outlines the search strategy and databases used to identify relevant literature. The search terms used, inclusion and exclusion criteria, and any limitations of the search are described.

Literature Analysis

The literature analysis is the main body of the literature review. This section summarizes and synthesizes the literature that is relevant to the research question or hypothesis. The review should be organized thematically, chronologically, or by methodology, depending on the research objectives.

Critical Evaluation

Critical evaluation involves assessing the quality and validity of the literature. This includes evaluating the reliability and validity of the studies reviewed, the methodology used, and the strength of the evidence.

The conclusion of the literature review should summarize the main findings, identify any gaps in the literature, and suggest areas for future research. It should also reiterate the importance of the research question or hypothesis and the contribution of the literature review to the overall research project.

The references list includes all the sources cited in the literature review, and follows a specific referencing style (e.g., APA, MLA, Harvard).

How to write Literature Review

Here are some steps to follow when writing a literature review:

  • Define your research question or topic : Before starting your literature review, it is essential to define your research question or topic. This will help you identify relevant literature and determine the scope of your review.
  • Conduct a comprehensive search: Use databases and search engines to find relevant literature. Look for peer-reviewed articles, books, and other academic sources that are relevant to your research question or topic.
  • Evaluate the sources: Once you have found potential sources, evaluate them critically to determine their relevance, credibility, and quality. Look for recent publications, reputable authors, and reliable sources of data and evidence.
  • Organize your sources: Group the sources by theme, method, or research question. This will help you identify similarities and differences among the literature, and provide a structure for your literature review.
  • Analyze and synthesize the literature : Analyze each source in depth, identifying the key findings, methodologies, and conclusions. Then, synthesize the information from the sources, identifying patterns and themes in the literature.
  • Write the literature review : Start with an introduction that provides an overview of the topic and the purpose of the literature review. Then, organize the literature according to your chosen structure, and analyze and synthesize the sources. Finally, provide a conclusion that summarizes the key findings of the literature review, identifies gaps in knowledge, and suggests areas for future research.
  • Edit and proofread: Once you have written your literature review, edit and proofread it carefully to ensure that it is well-organized, clear, and concise.

Examples of Literature Review

Here’s an example of how a literature review can be conducted for a thesis on the topic of “ The Impact of Social Media on Teenagers’ Mental Health”:

  • Start by identifying the key terms related to your research topic. In this case, the key terms are “social media,” “teenagers,” and “mental health.”
  • Use academic databases like Google Scholar, JSTOR, or PubMed to search for relevant articles, books, and other publications. Use these keywords in your search to narrow down your results.
  • Evaluate the sources you find to determine if they are relevant to your research question. You may want to consider the publication date, author’s credentials, and the journal or book publisher.
  • Begin reading and taking notes on each source, paying attention to key findings, methodologies used, and any gaps in the research.
  • Organize your findings into themes or categories. For example, you might categorize your sources into those that examine the impact of social media on self-esteem, those that explore the effects of cyberbullying, and those that investigate the relationship between social media use and depression.
  • Synthesize your findings by summarizing the key themes and highlighting any gaps or inconsistencies in the research. Identify areas where further research is needed.
  • Use your literature review to inform your research questions and hypotheses for your thesis.

For example, after conducting a literature review on the impact of social media on teenagers’ mental health, a thesis might look like this:

“Using a mixed-methods approach, this study aims to investigate the relationship between social media use and mental health outcomes in teenagers. Specifically, the study will examine the effects of cyberbullying, social comparison, and excessive social media use on self-esteem, anxiety, and depression. Through an analysis of survey data and qualitative interviews with teenagers, the study will provide insight into the complex relationship between social media use and mental health outcomes, and identify strategies for promoting positive mental health outcomes in young people.”

Reference: Smith, J., Jones, M., & Lee, S. (2019). The effects of social media use on adolescent mental health: A systematic review. Journal of Adolescent Health, 65(2), 154-165. doi:10.1016/j.jadohealth.2019.03.024

Reference Example: Author, A. A., Author, B. B., & Author, C. C. (Year). Title of article. Title of Journal, volume number(issue number), page range. doi:0000000/000000000000 or URL

Applications of Literature Review

some applications of literature review in different fields:

  • Social Sciences: In social sciences, literature reviews are used to identify gaps in existing research, to develop research questions, and to provide a theoretical framework for research. Literature reviews are commonly used in fields such as sociology, psychology, anthropology, and political science.
  • Natural Sciences: In natural sciences, literature reviews are used to summarize and evaluate the current state of knowledge in a particular field or subfield. Literature reviews can help researchers identify areas where more research is needed and provide insights into the latest developments in a particular field. Fields such as biology, chemistry, and physics commonly use literature reviews.
  • Health Sciences: In health sciences, literature reviews are used to evaluate the effectiveness of treatments, identify best practices, and determine areas where more research is needed. Literature reviews are commonly used in fields such as medicine, nursing, and public health.
  • Humanities: In humanities, literature reviews are used to identify gaps in existing knowledge, develop new interpretations of texts or cultural artifacts, and provide a theoretical framework for research. Literature reviews are commonly used in fields such as history, literary studies, and philosophy.

Role of Literature Review in Research

Here are some applications of literature review in research:

  • Identifying Research Gaps : Literature review helps researchers identify gaps in existing research and literature related to their research question. This allows them to develop new research questions and hypotheses to fill those gaps.
  • Developing Theoretical Framework: Literature review helps researchers develop a theoretical framework for their research. By analyzing and synthesizing existing literature, researchers can identify the key concepts, theories, and models that are relevant to their research.
  • Selecting Research Methods : Literature review helps researchers select appropriate research methods and techniques based on previous research. It also helps researchers to identify potential biases or limitations of certain methods and techniques.
  • Data Collection and Analysis: Literature review helps researchers in data collection and analysis by providing a foundation for the development of data collection instruments and methods. It also helps researchers to identify relevant data sources and identify potential data analysis techniques.
  • Communicating Results: Literature review helps researchers to communicate their results effectively by providing a context for their research. It also helps to justify the significance of their findings in relation to existing research and literature.

Purpose of Literature Review

Some of the specific purposes of a literature review are as follows:

  • To provide context: A literature review helps to provide context for your research by situating it within the broader body of literature on the topic.
  • To identify gaps and inconsistencies: A literature review helps to identify areas where further research is needed or where there are inconsistencies in the existing literature.
  • To synthesize information: A literature review helps to synthesize the information from multiple sources and present a coherent and comprehensive picture of the current state of knowledge on the topic.
  • To identify key concepts and theories : A literature review helps to identify key concepts and theories that are relevant to your research question and provide a theoretical framework for your study.
  • To inform research design: A literature review can inform the design of your research study by identifying appropriate research methods, data sources, and research questions.

Characteristics of Literature Review

Some Characteristics of Literature Review are as follows:

  • Identifying gaps in knowledge: A literature review helps to identify gaps in the existing knowledge and research on a specific topic or research question. By analyzing and synthesizing the literature, you can identify areas where further research is needed and where new insights can be gained.
  • Establishing the significance of your research: A literature review helps to establish the significance of your own research by placing it in the context of existing research. By demonstrating the relevance of your research to the existing literature, you can establish its importance and value.
  • Informing research design and methodology : A literature review helps to inform research design and methodology by identifying the most appropriate research methods, techniques, and instruments. By reviewing the literature, you can identify the strengths and limitations of different research methods and techniques, and select the most appropriate ones for your own research.
  • Supporting arguments and claims: A literature review provides evidence to support arguments and claims made in academic writing. By citing and analyzing the literature, you can provide a solid foundation for your own arguments and claims.
  • I dentifying potential collaborators and mentors: A literature review can help identify potential collaborators and mentors by identifying researchers and practitioners who are working on related topics or using similar methods. By building relationships with these individuals, you can gain valuable insights and support for your own research and practice.
  • Keeping up-to-date with the latest research : A literature review helps to keep you up-to-date with the latest research on a specific topic or research question. By regularly reviewing the literature, you can stay informed about the latest findings and developments in your field.

Advantages of Literature Review

There are several advantages to conducting a literature review as part of a research project, including:

  • Establishing the significance of the research : A literature review helps to establish the significance of the research by demonstrating the gap or problem in the existing literature that the study aims to address.
  • Identifying key concepts and theories: A literature review can help to identify key concepts and theories that are relevant to the research question, and provide a theoretical framework for the study.
  • Supporting the research methodology : A literature review can inform the research methodology by identifying appropriate research methods, data sources, and research questions.
  • Providing a comprehensive overview of the literature : A literature review provides a comprehensive overview of the current state of knowledge on a topic, allowing the researcher to identify key themes, debates, and areas of agreement or disagreement.
  • Identifying potential research questions: A literature review can help to identify potential research questions and areas for further investigation.
  • Avoiding duplication of research: A literature review can help to avoid duplication of research by identifying what has already been done on a topic, and what remains to be done.
  • Enhancing the credibility of the research : A literature review helps to enhance the credibility of the research by demonstrating the researcher’s knowledge of the existing literature and their ability to situate their research within a broader context.

Limitations of Literature Review

Limitations of Literature Review are as follows:

  • Limited scope : Literature reviews can only cover the existing literature on a particular topic, which may be limited in scope or depth.
  • Publication bias : Literature reviews may be influenced by publication bias, which occurs when researchers are more likely to publish positive results than negative ones. This can lead to an incomplete or biased picture of the literature.
  • Quality of sources : The quality of the literature reviewed can vary widely, and not all sources may be reliable or valid.
  • Time-limited: Literature reviews can become quickly outdated as new research is published, making it difficult to keep up with the latest developments in a field.
  • Subjective interpretation : Literature reviews can be subjective, and the interpretation of the findings can vary depending on the researcher’s perspective or bias.
  • Lack of original data : Literature reviews do not generate new data, but rather rely on the analysis of existing studies.
  • Risk of plagiarism: It is important to ensure that literature reviews do not inadvertently contain plagiarism, which can occur when researchers use the work of others without proper attribution.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Paper Conclusion

Research Paper Conclusion – Writing Guide and...

Appendices

Appendices – Writing Guide, Types and Examples

Research Report

Research Report – Example, Writing Guide and...

Delimitations

Delimitations in Research – Types, Examples and...

Scope of the Research

Scope of the Research – Writing Guide and...

Research Contribution

Research Contribution – Thesis Guide

Harvey Cushing/John Hay Whitney Medical Library

  • Collections
  • Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

  • Biomedical Databases
  • Global (Public Health) Databases
  • Soc. Sci., History, and Law Databases
  • Grey Literature
  • Trials Registers
  • Data and Statistics
  • Public Policy
  • Google Tips
  • Recommended Books
  • Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Discovers relationships between research studies/ideas.
  • Identifies major themes, concepts, and researchers on a topic.
  • Identifies critical gaps and points of disagreement.
  • Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

Cover Art

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

  • Make sure your research question is not too broad or too narrow.  Is it manageable?
  • Begin writing down terms that are related to your question. These will be useful for searches later.
  • If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

  • This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

  • use the tabs on this guide
  • Find other databases in the Nursing Information Resources web page
  • More on the Medical Library web page
  • ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

  • Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
  • Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
  • Review the abstracts of research studies carefully. This will save you time.
  • Use the bibliographies and references of research studies you find to locate others.
  • Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
  • Ask your librarian for help at any time.
  • Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

  • What was the research question of the study you are reviewing? What were the authors trying to discover?
  • Was the research funded by a source that could influence the findings?
  • What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
  • Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
  • If there are conflicting studies, why do you think that is?
  • How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

  • Review the abstracts carefully.  
  • Keep careful notes so that you may track your thought processes during the research process.
  • Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
  • << Previous: Recommended Books
  • Last Updated: Jan 4, 2024 10:52 AM
  • URL: https://guides.library.yale.edu/YSNDoctoral

Auraria Library red logo

Research Methods: Literature Reviews

  • Annotated Bibliographies
  • Literature Reviews
  • Scoping Reviews
  • Systematic Reviews
  • Scholarship of Teaching and Learning
  • Persuasive Arguments
  • Subject Specific Methodology

A literature review involves researching, reading, analyzing, evaluating, and summarizing scholarly literature (typically journals and articles) about a specific topic. The results of a literature review may be an entire report or article OR may be part of a article, thesis, dissertation, or grant proposal. A literature review helps the author learn about the history and nature of their topic, and identify research gaps and problems.

Steps & Elements

Problem formulation

  • Determine your topic and its components by asking a question
  • Research: locate literature related to your topic to identify the gap(s) that can be addressed
  • Read: read the articles or other sources of information
  • Analyze: assess the findings for relevancy
  • Evaluating: determine how the article are relevant to your research and what are the key findings
  • Synthesis: write about the key findings and how it is relevant to your research

Elements of a Literature Review

  • Summarize subject, issue or theory under consideration, along with objectives of the review
  • Divide works under review into categories (e.g. those in support of a particular position, those against, those offering alternative theories entirely)
  • Explain how each work is similar to and how it varies from the others
  • Conclude which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of an area of research

Writing a Literature Review Resources

  • How to Write a Literature Review From the Wesleyan University Library
  • Write a Literature Review From the University of California Santa Cruz Library. A Brief overview of a literature review, includes a list of stages for writing a lit review.
  • Literature Reviews From the University of North Carolina Writing Center. Detailed information about writing a literature review.
  • Undertaking a literature review: a step-by-step approach Cronin, P., Ryan, F., & Coughan, M. (2008). Undertaking a literature review: A step-by-step approach. British Journal of Nursing, 17(1), p.38-43

uses of literature review in research methodology

Literature Review Tutorial

  • << Previous: Annotated Bibliographies
  • Next: Scoping Reviews >>
  • Last Updated: Jan 26, 2024 2:37 PM
  • URL: https://guides.auraria.edu/researchmethods

1100 Lawrence Street Denver, CO 80204 303-315-7700 Ask Us Directions

Research-Methodology

Types of Literature Review

There are many types of literature review. The choice of a specific type depends on your research approach and design. The following types of literature review are the most popular in business studies:

Narrative literature review , also referred to as traditional literature review, critiques literature and summarizes the body of a literature. Narrative review also draws conclusions about the topic and identifies gaps or inconsistencies in a body of knowledge. You need to have a sufficiently focused research question to conduct a narrative literature review

Systematic literature review requires more rigorous and well-defined approach compared to most other types of literature review. Systematic literature review is comprehensive and details the timeframe within which the literature was selected. Systematic literature review can be divided into two categories: meta-analysis and meta-synthesis.

When you conduct meta-analysis you take findings from several studies on the same subject and analyze these using standardized statistical procedures. In meta-analysis patterns and relationships are detected and conclusions are drawn. Meta-analysis is associated with deductive research approach.

Meta-synthesis, on the other hand, is based on non-statistical techniques. This technique integrates, evaluates and interprets findings of multiple qualitative research studies. Meta-synthesis literature review is conducted usually when following inductive research approach.

Scoping literature review , as implied by its name is used to identify the scope or coverage of a body of literature on a given topic. It has been noted that “scoping reviews are useful for examining emerging evidence when it is still unclear what other, more specific questions can be posed and valuably addressed by a more precise systematic review.” [1] The main difference between systematic and scoping types of literature review is that, systematic literature review is conducted to find answer to more specific research questions, whereas scoping literature review is conducted to explore more general research question.

Argumentative literature review , as the name implies, examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. It should be noted that a potential for bias is a major shortcoming associated with argumentative literature review.

Integrative literature review reviews , critiques, and synthesizes secondary data about research topic in an integrated way such that new frameworks and perspectives on the topic are generated. If your research does not involve primary data collection and data analysis, then using integrative literature review will be your only option.

Theoretical literature review focuses on a pool of theory that has accumulated in regard to an issue, concept, theory, phenomena. Theoretical literature reviews play an instrumental role in establishing what theories already exist, the relationships between them, to what degree existing theories have been investigated, and to develop new hypotheses to be tested.

At the earlier parts of the literature review chapter, you need to specify the type of your literature review your chose and justify your choice. Your choice of a specific type of literature review should be based upon your research area, research problem and research methods.  Also, you can briefly discuss other most popular types of literature review mentioned above, to illustrate your awareness of them.

[1] Munn, A. et. al. (2018) “Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach” BMC Medical Research Methodology

Types of Literature Review

  John Dudovskiy

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • Advanced Search
  • Journal List
  • Clinics (Sao Paulo)

Approaching literature review for academic purposes: The Literature Review Checklist

Debora f.b. leite.

I Departamento de Ginecologia e Obstetricia, Faculdade de Ciencias Medicas, Universidade Estadual de Campinas, Campinas, SP, BR

II Universidade Federal de Pernambuco, Pernambuco, PE, BR

III Hospital das Clinicas, Universidade Federal de Pernambuco, Pernambuco, PE, BR

Maria Auxiliadora Soares Padilha

Jose g. cecatti.

A sophisticated literature review (LR) can result in a robust dissertation/thesis by scrutinizing the main problem examined by the academic study; anticipating research hypotheses, methods and results; and maintaining the interest of the audience in how the dissertation/thesis will provide solutions for the current gaps in a particular field. Unfortunately, little guidance is available on elaborating LRs, and writing an LR chapter is not a linear process. An LR translates students’ abilities in information literacy, the language domain, and critical writing. Students in postgraduate programs should be systematically trained in these skills. Therefore, this paper discusses the purposes of LRs in dissertations and theses. Second, the paper considers five steps for developing a review: defining the main topic, searching the literature, analyzing the results, writing the review and reflecting on the writing. Ultimately, this study proposes a twelve-item LR checklist. By clearly stating the desired achievements, this checklist allows Masters and Ph.D. students to continuously assess their own progress in elaborating an LR. Institutions aiming to strengthen students’ necessary skills in critical academic writing should also use this tool.

INTRODUCTION

Writing the literature review (LR) is often viewed as a difficult task that can be a point of writer’s block and procrastination ( 1 ) in postgraduate life. Disagreements on the definitions or classifications of LRs ( 2 ) may confuse students about their purpose and scope, as well as how to perform an LR. Interestingly, at many universities, the LR is still an important element in any academic work, despite the more recent trend of producing scientific articles rather than classical theses.

The LR is not an isolated section of the thesis/dissertation or a copy of the background section of a research proposal. It identifies the state-of-the-art knowledge in a particular field, clarifies information that is already known, elucidates implications of the problem being analyzed, links theory and practice ( 3 - 5 ), highlights gaps in the current literature, and places the dissertation/thesis within the research agenda of that field. Additionally, by writing the LR, postgraduate students will comprehend the structure of the subject and elaborate on their cognitive connections ( 3 ) while analyzing and synthesizing data with increasing maturity.

At the same time, the LR transforms the student and hints at the contents of other chapters for the reader. First, the LR explains the research question; second, it supports the hypothesis, objectives, and methods of the research project; and finally, it facilitates a description of the student’s interpretation of the results and his/her conclusions. For scholars, the LR is an introductory chapter ( 6 ). If it is well written, it demonstrates the student’s understanding of and maturity in a particular topic. A sound and sophisticated LR can indicate a robust dissertation/thesis.

A consensus on the best method to elaborate a dissertation/thesis has not been achieved. The LR can be a distinct chapter or included in different sections; it can be part of the introduction chapter, part of each research topic, or part of each published paper ( 7 ). However, scholars view the LR as an integral part of the main body of an academic work because it is intrinsically connected to other sections ( Figure 1 ) and is frequently present. The structure of the LR depends on the conventions of a particular discipline, the rules of the department, and the student’s and supervisor’s areas of expertise, needs and interests.

An external file that holds a picture, illustration, etc.
Object name is cln-74-e1403-g001.jpg

Interestingly, many postgraduate students choose to submit their LR to peer-reviewed journals. As LRs are critical evaluations of current knowledge, they are indeed publishable material, even in the form of narrative or systematic reviews. However, systematic reviews have specific patterns 1 ( 8 ) that may not entirely fit with the questions posed in the dissertation/thesis. Additionally, the scope of a systematic review may be too narrow, and the strict criteria for study inclusion may omit important information from the dissertation/thesis. Therefore, this essay discusses the definition of an LR is and methods to develop an LR in the context of an academic dissertation/thesis. Finally, we suggest a checklist to evaluate an LR.

WHAT IS A LITERATURE REVIEW IN A THESIS?

Conducting research and writing a dissertation/thesis translates rational thinking and enthusiasm ( 9 ). While a strong body of literature that instructs students on research methodology, data analysis and writing scientific papers exists, little guidance on performing LRs is available. The LR is a unique opportunity to assess and contrast various arguments and theories, not just summarize them. The research results should not be discussed within the LR, but the postgraduate student tends to write a comprehensive LR while reflecting on his or her own findings ( 10 ).

Many people believe that writing an LR is a lonely and linear process. Supervisors or the institutions assume that the Ph.D. student has mastered the relevant techniques and vocabulary associated with his/her subject and conducts a self-reflection about previously published findings. Indeed, while elaborating the LR, the student should aggregate diverse skills, which mainly rely on his/her own commitment to mastering them. Thus, less supervision should be required ( 11 ). However, the parameters described above might not currently be the case for many students ( 11 , 12 ), and the lack of formal and systematic training on writing LRs is an important concern ( 11 ).

An institutional environment devoted to active learning will provide students the opportunity to continuously reflect on LRs, which will form a dialogue between the postgraduate student and the current literature in a particular field ( 13 ). Postgraduate students will be interpreting studies by other researchers, and, according to Hart (1998) ( 3 ), the outcomes of the LR in a dissertation/thesis include the following:

  • To identify what research has been performed and what topics require further investigation in a particular field of knowledge;
  • To determine the context of the problem;
  • To recognize the main methodologies and techniques that have been used in the past;
  • To place the current research project within the historical, methodological and theoretical context of a particular field;
  • To identify significant aspects of the topic;
  • To elucidate the implications of the topic;
  • To offer an alternative perspective;
  • To discern how the studied subject is structured;
  • To improve the student’s subject vocabulary in a particular field; and
  • To characterize the links between theory and practice.

A sound LR translates the postgraduate student’s expertise in academic and scientific writing: it expresses his/her level of comfort with synthesizing ideas ( 11 ). The LR reveals how well the postgraduate student has proceeded in three domains: an effective literature search, the language domain, and critical writing.

Effective literature search

All students should be trained in gathering appropriate data for specific purposes, and information literacy skills are a cornerstone. These skills are defined as “an individual’s ability to know when they need information, to identify information that can help them address the issue or problem at hand, and to locate, evaluate, and use that information effectively” ( 14 ). Librarian support is of vital importance in coaching the appropriate use of Boolean logic (AND, OR, NOT) and other tools for highly efficient literature searches (e.g., quotation marks and truncation), as is the appropriate management of electronic databases.

Language domain

Academic writing must be concise and precise: unnecessary words distract the reader from the essential content ( 15 ). In this context, reading about issues distant from the research topic ( 16 ) may increase students’ general vocabulary and familiarity with grammar. Ultimately, reading diverse materials facilitates and encourages the writing process itself.

Critical writing

Critical judgment includes critical reading, thinking and writing. It supposes a student’s analytical reflection about what he/she has read. The student should delineate the basic elements of the topic, characterize the most relevant claims, identify relationships, and finally contrast those relationships ( 17 ). Each scientific document highlights the perspective of the author, and students will become more confident in judging the supporting evidence and underlying premises of a study and constructing their own counterargument as they read more articles. A paucity of integration or contradictory perspectives indicates lower levels of cognitive complexity ( 12 ).

Thus, while elaborating an LR, the postgraduate student should achieve the highest category of Bloom’s cognitive skills: evaluation ( 12 ). The writer should not only summarize data and understand each topic but also be able to make judgments based on objective criteria, compare resources and findings, identify discrepancies due to methodology, and construct his/her own argument ( 12 ). As a result, the student will be sufficiently confident to show his/her own voice .

Writing a consistent LR is an intense and complex activity that reveals the training and long-lasting academic skills of a writer. It is not a lonely or linear process. However, students are unlikely to be prepared to write an LR if they have not mastered the aforementioned domains ( 10 ). An institutional environment that supports student learning is crucial.

Different institutions employ distinct methods to promote students’ learning processes. First, many universities propose modules to develop behind the scenes activities that enhance self-reflection about general skills (e.g., the skills we have mastered and the skills we need to develop further), behaviors that should be incorporated (e.g., self-criticism about one’s own thoughts), and each student’s role in the advancement of his/her field. Lectures or workshops about LRs themselves are useful because they describe the purposes of the LR and how it fits into the whole picture of a student’s work. These activities may explain what type of discussion an LR must involve, the importance of defining the correct scope, the reasons to include a particular resource, and the main role of critical reading.

Some pedagogic services that promote a continuous improvement in study and academic skills are equally important. Examples include workshops about time management, the accomplishment of personal objectives, active learning, and foreign languages for nonnative speakers. Additionally, opportunities to converse with other students promotes an awareness of others’ experiences and difficulties. Ultimately, the supervisor’s role in providing feedback and setting deadlines is crucial in developing students’ abilities and in strengthening students’ writing quality ( 12 ).

HOW SHOULD A LITERATURE REVIEW BE DEVELOPED?

A consensus on the appropriate method for elaborating an LR is not available, but four main steps are generally accepted: defining the main topic, searching the literature, analyzing the results, and writing ( 6 ). We suggest a fifth step: reflecting on the information that has been written in previous publications ( Figure 2 ).

An external file that holds a picture, illustration, etc.
Object name is cln-74-e1403-g002.jpg

First step: Defining the main topic

Planning an LR is directly linked to the research main question of the thesis and occurs in parallel to students’ training in the three domains discussed above. The planning stage helps organize ideas, delimit the scope of the LR ( 11 ), and avoid the wasting of time in the process. Planning includes the following steps:

  • Reflecting on the scope of the LR: postgraduate students will have assumptions about what material must be addressed and what information is not essential to an LR ( 13 , 18 ). Cooper’s Taxonomy of Literature Reviews 2 systematizes the writing process through six characteristics and nonmutually exclusive categories. The focus refers to the reviewer’s most important points of interest, while the goals concern what students want to achieve with the LR. The perspective assumes answers to the student’s own view of the LR and how he/she presents a particular issue. The coverage defines how comprehensive the student is in presenting the literature, and the organization determines the sequence of arguments. The audience is defined as the group for whom the LR is written.
  • Designating sections and subsections: Headings and subheadings should be specific, explanatory and have a coherent sequence throughout the text ( 4 ). They simulate an inverted pyramid, with an increasing level of reflection and depth of argument.
  • Identifying keywords: The relevant keywords for each LR section should be listed to guide the literature search. This list should mirror what Hart (1998) ( 3 ) advocates as subject vocabulary . The keywords will also be useful when the student is writing the LR since they guide the reader through the text.
  • Delineating the time interval and language of documents to be retrieved in the second step. The most recently published documents should be considered, but relevant texts published before a predefined cutoff year can be included if they are classic documents in that field. Extra care should be employed when translating documents.

Second step: Searching the literature

The ability to gather adequate information from the literature must be addressed in postgraduate programs. Librarian support is important, particularly for accessing difficult texts. This step comprises the following components:

  • Searching the literature itself: This process consists of defining which databases (electronic or dissertation/thesis repositories), official documents, and books will be searched and then actively conducting the search. Information literacy skills have a central role in this stage. While searching electronic databases, controlled vocabulary (e.g., Medical Subject Headings, or MeSH, for the PubMed database) or specific standardized syntax rules may need to be applied.

In addition, two other approaches are suggested. First, a review of the reference list of each document might be useful for identifying relevant publications to be included and important opinions to be assessed. This step is also relevant for referencing the original studies and leading authors in that field. Moreover, students can directly contact the experts on a particular topic to consult with them regarding their experience or use them as a source of additional unpublished documents.

Before submitting a dissertation/thesis, the electronic search strategy should be repeated. This process will ensure that the most recently published papers will be considered in the LR.

  • Selecting documents for inclusion: Generally, the most recent literature will be included in the form of published peer-reviewed papers. Assess books and unpublished material, such as conference abstracts, academic texts and government reports, are also important to assess since the gray literature also offers valuable information. However, since these materials are not peer-reviewed, we recommend that they are carefully added to the LR.

This task is an important exercise in time management. First, students should read the title and abstract to understand whether that document suits their purposes, addresses the research question, and helps develop the topic of interest. Then, they should scan the full text, determine how it is structured, group it with similar documents, and verify whether other arguments might be considered ( 5 ).

Third step: Analyzing the results

Critical reading and thinking skills are important in this step. This step consists of the following components:

  • Reading documents: The student may read various texts in depth according to LR sections and subsections ( defining the main topic ), which is not a passive activity ( 1 ). Some questions should be asked to practice critical analysis skills, as listed below. Is the research question evident and articulated with previous knowledge? What are the authors’ research goals and theoretical orientations, and how do they interact? Are the authors’ claims related to other scholars’ research? Do the authors consider different perspectives? Was the research project designed and conducted properly? Are the results and discussion plausible, and are they consistent with the research objectives and methodology? What are the strengths and limitations of this work? How do the authors support their findings? How does this work contribute to the current research topic? ( 1 , 19 )
  • Taking notes: Students who systematically take notes on each document are more readily able to establish similarities or differences with other documents and to highlight personal observations. This approach reinforces the student’s ideas about the next step and helps develop his/her own academic voice ( 1 , 13 ). Voice recognition software ( 16 ), mind maps ( 5 ), flowcharts, tables, spreadsheets, personal comments on the referenced texts, and note-taking apps are all available tools for managing these observations, and the student him/herself should use the tool that best improves his/her learning. Additionally, when a student is considering submitting an LR to a peer-reviewed journal, notes should be taken on the activities performed in all five steps to ensure that they are able to be replicated.

Fourth step: Writing

The recognition of when a student is able and ready to write after a sufficient period of reading and thinking is likely a difficult task. Some students can produce a review in a single long work session. However, as discussed above, writing is not a linear process, and students do not need to write LRs according to a specific sequence of sections. Writing an LR is a time-consuming task, and some scholars believe that a period of at least six months is sufficient ( 6 ). An LR, and academic writing in general, expresses the writer’s proper thoughts, conclusions about others’ work ( 6 , 10 , 13 , 16 ), and decisions about methods to progress in the chosen field of knowledge. Thus, each student is expected to present a different learning and writing trajectory.

In this step, writing methods should be considered; then, editing, citing and correct referencing should complete this stage, at least temporarily. Freewriting techniques may be a good starting point for brainstorming ideas and improving the understanding of the information that has been read ( 1 ). Students should consider the following parameters when creating an agenda for writing the LR: two-hour writing blocks (at minimum), with prespecified tasks that are possible to complete in one section; short (minutes) and long breaks (days or weeks) to allow sufficient time for mental rest and reflection; and short- and long-term goals to motivate the writing itself ( 20 ). With increasing experience, this scheme can vary widely, and it is not a straightforward rule. Importantly, each discipline has a different way of writing ( 1 ), and each department has its own preferred styles for citations and references.

Fifth step: Reflecting on the writing

In this step, the postgraduate student should ask him/herself the same questions as in the analyzing the results step, which can take more time than anticipated. Ambiguities, repeated ideas, and a lack of coherence may not be noted when the student is immersed in the writing task for long periods. The whole effort will likely be a work in progress, and continuous refinements in the written material will occur once the writing process has begun.

LITERATURE REVIEW CHECKLIST

In contrast to review papers, the LR of a dissertation/thesis should not be a standalone piece or work. Instead, it should present the student as a scholar and should maintain the interest of the audience in how that dissertation/thesis will provide solutions for the current gaps in a particular field.

A checklist for evaluating an LR is convenient for students’ continuous academic development and research transparency: it clearly states the desired achievements for the LR of a dissertation/thesis. Here, we present an LR checklist developed from an LR scoring rubric ( 11 ). For a critical analysis of an LR, we maintain the five categories but offer twelve criteria that are not scaled ( Figure 3 ). The criteria all have the same importance and are not mutually exclusive.

An external file that holds a picture, illustration, etc.
Object name is cln-74-e1403-g003.jpg

First category: Coverage

1. justified criteria exist for the inclusion and exclusion of literature in the review.

This criterion builds on the main topic and areas covered by the LR ( 18 ). While experts may be confident in retrieving and selecting literature, postgraduate students must convince their audience about the adequacy of their search strategy and their reasons for intentionally selecting what material to cover ( 11 ). References from different fields of knowledge provide distinct perspective, but narrowing the scope of coverage may be important in areas with a large body of existing knowledge.

Second category: Synthesis

2. a critical examination of the state of the field exists.

A critical examination is an assessment of distinct aspects in the field ( 1 ) along with a constructive argument. It is not a negative critique but an expression of the student’s understanding of how other scholars have added to the topic ( 1 ), and the student should analyze and contextualize contradictory statements. A writer’s personal bias (beliefs or political involvement) have been shown to influence the structure and writing of a document; therefore, the cultural and paradigmatic background guide how the theories are revised and presented ( 13 ). However, an honest judgment is important when considering different perspectives.

3. The topic or problem is clearly placed in the context of the broader scholarly literature

The broader scholarly literature should be related to the chosen main topic for the LR ( how to develop the literature review section). The LR can cover the literature from one or more disciplines, depending on its scope, but it should always offer a new perspective. In addition, students should be careful in citing and referencing previous publications. As a rule, original studies and primary references should generally be included. Systematic and narrative reviews present summarized data, and it may be important to cite them, particularly for issues that should be understood but do not require a detailed description. Similarly, quotations highlight the exact statement from another publication. However, excessive referencing may disclose lower levels of analysis and synthesis by the student.

4. The LR is critically placed in the historical context of the field

Situating the LR in its historical context shows the level of comfort of the student in addressing a particular topic. Instead of only presenting statements and theories in a temporal approach, which occasionally follows a linear timeline, the LR should authentically characterize the student’s academic work in the state-of-art techniques in their particular field of knowledge. Thus, the LR should reinforce why the dissertation/thesis represents original work in the chosen research field.

5. Ambiguities in definitions are considered and resolved

Distinct theories on the same topic may exist in different disciplines, and one discipline may consider multiple concepts to explain one topic. These misunderstandings should be addressed and contemplated. The LR should not synthesize all theories or concepts at the same time. Although this approach might demonstrate in-depth reading on a particular topic, it can reveal a student’s inability to comprehend and synthesize his/her research problem.

6. Important variables and phenomena relevant to the topic are articulated

The LR is a unique opportunity to articulate ideas and arguments and to purpose new relationships between them ( 10 , 11 ). More importantly, a sound LR will outline to the audience how these important variables and phenomena will be addressed in the current academic work. Indeed, the LR should build a bidirectional link with the remaining sections and ground the connections between all of the sections ( Figure 1 ).

7. A synthesized new perspective on the literature has been established

The LR is a ‘creative inquiry’ ( 13 ) in which the student elaborates his/her own discourse, builds on previous knowledge in the field, and describes his/her own perspective while interpreting others’ work ( 13 , 17 ). Thus, students should articulate the current knowledge, not accept the results at face value ( 11 , 13 , 17 ), and improve their own cognitive abilities ( 12 ).

Third category: Methodology

8. the main methodologies and research techniques that have been used in the field are identified and their advantages and disadvantages are discussed.

The LR is expected to distinguish the research that has been completed from investigations that remain to be performed, address the benefits and limitations of the main methods applied to date, and consider the strategies for addressing the expected limitations described above. While placing his/her research within the methodological context of a particular topic, the LR will justify the methodology of the study and substantiate the student’s interpretations.

9. Ideas and theories in the field are related to research methodologies

The audience expects the writer to analyze and synthesize methodological approaches in the field. The findings should be explained according to the strengths and limitations of previous research methods, and students must avoid interpretations that are not supported by the analyzed literature. This criterion translates to the student’s comprehension of the applicability and types of answers provided by different research methodologies, even those using a quantitative or qualitative research approach.

Fourth category: Significance

10. the scholarly significance of the research problem is rationalized.

The LR is an introductory section of a dissertation/thesis and will present the postgraduate student as a scholar in a particular field ( 11 ). Therefore, the LR should discuss how the research problem is currently addressed in the discipline being investigated or in different disciplines, depending on the scope of the LR. The LR explains the academic paradigms in the topic of interest ( 13 ) and methods to advance the field from these starting points. However, an excess number of personal citations—whether referencing the student’s research or studies by his/her research team—may reflect a narrow literature search and a lack of comprehensive synthesis of ideas and arguments.

11. The practical significance of the research problem is rationalized

The practical significance indicates a student’s comprehensive understanding of research terminology (e.g., risk versus associated factor), methodology (e.g., efficacy versus effectiveness) and plausible interpretations in the context of the field. Notably, the academic argument about a topic may not always reflect the debate in real life terms. For example, using a quantitative approach in epidemiology, statistically significant differences between groups do not explain all of the factors involved in a particular problem ( 21 ). Therefore, excessive faith in p -values may reflect lower levels of critical evaluation of the context and implications of a research problem by the student.

Fifth category: Rhetoric

12. the lr was written with a coherent, clear structure that supported the review.

This category strictly relates to the language domain: the text should be coherent and presented in a logical sequence, regardless of which organizational ( 18 ) approach is chosen. The beginning of each section/subsection should state what themes will be addressed, paragraphs should be carefully linked to each other ( 10 ), and the first sentence of each paragraph should generally summarize the content. Additionally, the student’s statements are clear, sound, and linked to other scholars’ works, and precise and concise language that follows standardized writing conventions (e.g., in terms of active/passive voice and verb tenses) is used. Attention to grammar, such as orthography and punctuation, indicates prudence and supports a robust dissertation/thesis. Ultimately, all of these strategies provide fluency and consistency for the text.

Although the scoring rubric was initially proposed for postgraduate programs in education research, we are convinced that this checklist is a valuable tool for all academic areas. It enables the monitoring of students’ learning curves and a concentrated effort on any criteria that are not yet achieved. For institutions, the checklist is a guide to support supervisors’ feedback, improve students’ writing skills, and highlight the learning goals of each program. These criteria do not form a linear sequence, but ideally, all twelve achievements should be perceived in the LR.

CONCLUSIONS

A single correct method to classify, evaluate and guide the elaboration of an LR has not been established. In this essay, we have suggested directions for planning, structuring and critically evaluating an LR. The planning of the scope of an LR and approaches to complete it is a valuable effort, and the five steps represent a rational starting point. An institutional environment devoted to active learning will support students in continuously reflecting on LRs, which will form a dialogue between the writer and the current literature in a particular field ( 13 ).

The completion of an LR is a challenging and necessary process for understanding one’s own field of expertise. Knowledge is always transitory, but our responsibility as scholars is to provide a critical contribution to our field, allowing others to think through our work. Good researchers are grounded in sophisticated LRs, which reveal a writer’s training and long-lasting academic skills. We recommend using the LR checklist as a tool for strengthening the skills necessary for critical academic writing.

AUTHOR CONTRIBUTIONS

Leite DFB has initially conceived the idea and has written the first draft of this review. Padilha MAS and Cecatti JG have supervised data interpretation and critically reviewed the manuscript. All authors have read the draft and agreed with this submission. Authors are responsible for all aspects of this academic piece.

ACKNOWLEDGMENTS

We are grateful to all of the professors of the ‘Getting Started with Graduate Research and Generic Skills’ module at University College Cork, Cork, Ireland, for suggesting and supporting this article. Funding: DFBL has granted scholarship from Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES) to take part of her Ph.D. studies in Ireland (process number 88881.134512/2016-01). There is no participation from sponsors on authors’ decision to write or to submit this manuscript.

No potential conflict of interest was reported.

1 The questions posed in systematic reviews usually follow the ‘PICOS’ acronym: Population, Intervention, Comparison, Outcomes, Study design.

2 In 1988, Cooper proposed a taxonomy that aims to facilitate students’ and institutions’ understanding of literature reviews. Six characteristics with specific categories are briefly described: Focus: research outcomes, research methodologies, theories, or practices and applications; Goals: integration (generalization, conflict resolution, and linguistic bridge-building), criticism, or identification of central issues; Perspective: neutral representation or espousal of a position; Coverage: exhaustive, exhaustive with selective citations, representative, central or pivotal; Organization: historical, conceptual, or methodological; and Audience: specialized scholars, general scholars, practitioners or policymakers, or the general public.

Logo for British Columbia/Yukon Open Authoring Platform

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

The Literature Review

28 The Literature Review

A literature review is a survey of everything that has been written about a particular topic, theory, or research question. The word “literature” means “sources of information”. The literature will inform you about the research that has already been conducted on your chosen subject. This is important because we do not want to repeat research that has already been done unless there is a good reason for doing so (i.e. there has been a new development in this area or testing a theory with a new population, or even just to see if the research can be reproduced).  Literature reviews usually serve as a background for a larger work (e.g. as part of a research proposal), or it may stand on its own. Much more than a simple list of sources, an effective literature review analyzes and synthesizes information about key themes or issues.

Purpose of a literature review

The literature review involves an extensive study of research publications, books and other documents related to the defined problem.  The study is important because it advises you, as a researcher, whether the problem you identified has already been solved by other researchers.  It also advises you as to the status of the problem, techniques that have been used by other researchers to investigate the problem, and other related details.

A literature review goes beyond the search for information and includes the identification and articulation of relationships between existing literature and your field of research. The literature review enables the researcher to discover what has been already been written about a topic and to understand the relationship between the various contributions. This will enable the researcher to determine the contributions of each sources (books, article, etc.) to the topic. Literature reviews also enable the researcher to identify and (if possible) resolve contradictions, and also determine research gaps and/or unanswered questions.

Even though the nature of the literature review may vary with different types of studies, the basic purposes remain constant and could be summarized as follows:

  • Provide a context for your research;
  • Justify the research you are proposing;
  • Ensure that your proposed research has not been carried out by another person (and if you find it has, then your literature review should specify why replication is necessary);
  • Show where your proposed research fits into the existing body of knowledge;
  • Enable the researcher to learn from previous theory on the subject;
  • Illustrate how the subject has been studied previously;
  • Highlight flaws in previous research;
  • Outline gaps in previous research;
  • Show how your proposed research can add to the understanding and knowledge of the field;
  • Help refine, refocus, or even move the topic in a new direction

What is involved in writing a literature review?

  • Research – to discover what has been written about the topic;
  • Critical Appraisal – to evaluate the literature, determine the relationship between the sources and ascertain what has been done already and what still needs to be done;
  • Writing – to explain what you have found

Generally speaking, it is helpful to think of the literature review as a funnel.  One starts with a broad examination of the research related to the issue, working down to look at more specific aspects of the issue, which leads to the gap or the specific issue that your research will address.

How to undertake a literature review

The first step in undertaking a literature review is to conduct a library search of academic research that has been done on your topic.  This can be done electronically, or if you are within close vicinity to a library, you can go in and use their computers to find electronic and print holdings. You can also use Google Scholar for your search.  In some cases, research conducted outside academia can serve as an important research source for your literature review. Indeed, such research can have important practical implications, as opposed to academic research which usually (although not always) tends toward theoretical applications.

However, it is important to understand who funded the research you review, in addition to the perspective and the purpose of the research.  This is becoming an issue in Canada as universities and colleges increasingly turn to industry for research funding grants (see How TransAlta used a university-sanctioned research project to lobby for the coal industry ).

As part of this first step there are a few more some things to be thinking about as you review the literature, as follows:

  • Who are the various researchers who have studied this topic?  Who are the most prolific researchers/writers on this topic? Has a specific researcher or teams of researchers been identified as pioneers or leaders in this field of study?
  • How have the various researchers defined key terms that are relevant to your topic? Have the definitions of any of the key terms evolved over time?
  • What are the different theories that have been examined and applied to this topic? How, if at all, have the various theories applied to this topic over time evolved?
  • What methodologies have been used to study this topic?  Have the methodologies evolved over time?

In addition to thinking about these questions, you should be taking notes during this process. It can be helpful to keep these notes in an Excel file.  For example, your notes should include the following information:

  • If the article is empirical, write down the results of the research study in one or two sentences of your own words. e.g. “people who are between ages 18 – 35 are more likely to own a smart phone than those above or below.”  It is also a good idea to make note of the methods, the research design, the number of participants and details on the sample used in the study. Sometimes, you may even want to write down the names of the statistical procedures used to analyze the data or even some of the statistics, depending on your assignment.
  • If the article is a review of previous research, look for the main points. It may be helpful to read or skim the whole article, look away, and ask yourself what you felt was the main idea.
  • Write down any limitations or gaps you notice, anything that seems to contradict something you read elsewhere, or just anything that you think is important or interesting (Adjei, n.d.)

When reading through your sources, remember that you are looking for the “big picture,” not a collection of random, separate articles (an annotated bibliography).  You are also not trying to prove a point (an essay). You are looking for common themes and patterns in the research as a whole. You are also looking to see how the various pieces of research are linked, if at all.  As part of this process, you also want to identify research gaps or areas that require further research related your topic (Adjei, n.d.). In this regard, you cannot be expected to be an expert on your topic. A suggestion for finding gaps is to read the conclusion section of the academic journal articles and conference proceedings your search has uncovered.  Researchers often identify gaps in the research in their conclusion. They may even suggest areas for future research. However, remember, if a researcher suggested a gap 10 years ago, it is likely that the gap has now been addressed. To find a gap, look at the most recent research your literature review has uncovered (within 2-3 years of the current date). At this point in your search of the literature, you may realize that your research question needs to change or adapt.  This is a fairly common occurrence, as when you first develop a research question, you cannot be sure what the status of the research area is, until you undertake your review of the literature related to this topic. Finally, it is worth mentioning that it is very likely you will not include all of the resources you have read in your literature review. If you are asked to include 20 resources in your literature review, for example, expect to read approximately 30.

How to write a literature review

There are three parts to the literature review: the introduction, the body, and the conclusion.  In the following paragraphs we outline what to include in each of these sections. This section concludes with a variety of resources for you to check out.

Introduction

  • The introduction must identify the topic by briefly discussing the significance of the topic including a statement that outlines the conclusion to be drawn from the literature review.
  • If your literature review is part of a larger work, explain the importance of the review to your research question.
  • Defend the importance of the topic by giving a broad overview of the scope of the work you are reviewing. For example, if you are interested in post traumatic stress disorder (PTSD) in paramedics, you might provide some stats to prove how much work time is lost by those suffering from PTSD.
  • Clarify whether you are looking at the entire history of the field, or just a particular period of time.
  • Discuss and assess the research according to specific organizational principles (see examples below), rather than addressing each source separately. Most, if not all, paragraphs should discuss more than one source. Avoid addressing your sources alphabetically as this does not assist in developing the themes or key issues central to your review.
  • Compare, contrast, and connect the various pieces of research. Much of the research you are reading should be connected.  Or you may notice various themes within the research (i.e. effects of PTSD on sick time, effects of PTSD on families of paramedics, effects of PTSD on overall paramedic wellness, etc.).  If you have undertaken a thorough review of the literature, you should start to see the bigger picture of how the research on this topic has evolved over time, who the main researchers are on this topic, how the methods and theories related to this topic have changed (if at all), over time.
  • Summarize the works you are reviewing. Just as in any written assignment, use logical organization and clear transitions. Spend more time on the researchers and bodies of research that are considered most important in the field and/or that are most relevant.

Based upon your research, suggest where the research in the field will or should go next. If you are proposing your own research study, show how you will contribute to the field and fill in any gaps. The conclusion would also be a good place to defend the importance of the topic, now that you have demonstrated the current state of thinking in the field.

Other resources to help you write a literature review

In conclusion, there is a plethora of resources, both here and online, that provide information on how to write a literature review. For example, check out these three, very helpful YouTube videos prepared by a professor at the University of Maryland, in the U.S.A:

  • The Literature Review, Part 1
  • The Literature Review, Part 2
  • The Literature Review, Part 3

Table 5.1 also provides some suggested organizational techniques, as well as instances when you might use these various techniques.  The table also provides a writing sample to demonstrate the writing technique.

And remember, most university and college libraries also have valuable information on literature reviews.  Here is the link to one such website: JIBC Literature Review information [PDF]

Acceptable sources for literature reviews

There are a few acceptable sources for literature reviews, and I will list these in order from what will be considered most acceptable to less acceptable sources for your literature review assignments, as follows:

  • Peer reviewed journal articles;
  • Edited academic books;
  • Articles in professional journals;
  • Statistical data from government websites;
  • Website material from professional associations (use sparingly and carefully);

The following sections will explain and provide examples of these various sources.

Peer reviewed journal articles (papers)

A peer reviewed journal article is a paper that has been submitted to a scholarly journal, accepted, and published.  Peer review journal papers go through a rigorous, blind review process of peer review. What this means is that two to three experts in the area of research featured in the paper have reviewed and accepted the paper for publication. The names of the author(s) who are seeking to publish the research have been removed (blind review), so as to minimize any bias towards the authors of the research. Albeit, sometimes a savvy reviewer can discern who has done the research based upon previous publications, etc.  This blind review process can be long (often 12 to 18 months) that may involve many back and forth edits on the behalf of the researchers, as they work to address the edits and concerns of the peers who reviewed their paper. Often, reviewers will reject the paper for a variety of reasons, such as unclear or questionable methods, lack of contribution to the field, etc. Because peer reviewed journal articles have gone through a rigorous process of review, they are considered to be the premier source for research. Peer reviewed journal articles should serve as the foundation for your literature review.

The following website will provide more information on peer-reviewed journal articles: Evaluating Information Sources: What Is A Peer-Reviewed Article? Make sure you watch the little video on the upper left-hand side of your screen, in addition to reading the material.

Edited academic books

An edited academic book is a collection of scholarly scientific papers written by different authors. The works are original papers, not published elsewhere (Wikipedia, 2018).  The papers within the text also go through a process of review; however, the review is often not a blind review because the authors have been invited to contribute to the book. Consequently, edited academic books are fine to use for your literature review, but you also want to ensure that your literature review contains mostly peer reviewed journal papers.

Articles in professional journals.

Articles from professional journals should be used with caution, as far as it relates to a source for your literature review.  This is because articles in trade journals are not usually peer reviewed, even though they may appear as such. A good way to find out is to read the “About us” section of the professional journal.  They should state there if the papers are peer reviewed. You can also google the name of the journal and add peer reviewed to the search and you should be able to find out that way.

Statistical data from governmental websites.

Governmental websites can be excellent sources for statistical data.  For examples, Statistics Canada collects and publishes data related to the economy, society, and the environment.

Website material from professional associations

Material from other websites can also serve as a source for statistics that you may need for your literature review.  As you want to justify the value of the research you are interested in, you might make use of a professional association´s website to learn how many members they have, for example.  As a hypothetical example, you might want to demonstrate, as part of the introduction to your literature review, why more research on the topic of PTSD in police officers is important.  You could use peer reviewed journal articles to determine the prevalence of PTSD in police officers in Canada in the last ten years and then use the Ontario Police Officers´ Association website to determine the approximate number of police officers employed in the Province of Ontario over the last ten years. This might help you create an approximation of how many police officers could be suffering with PTSD in Ontario.  That number could potentially help to justify a research grand down the road. But again, this type of website-based material should be used with caution and sparingly.

Text Attributions

  • This chapter has been adapted from Unit 2: Literature Review in  Research Methods by Joseph K. Adjei. © Creative Commons Attribution-ShareAlike 3.0 License .

The Literature Review by Valerie A. Sheppard is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

Literature Reviews

  • Getting Started
  • Choosing a Type of Review
  • Developing a Research Question
  • Searching the Literature
  • Searching Tips
  • ChatGPT [beta]
  • Documenting your Search
  • Using Citation Managers
  • Concept Mapping
  • Concept Map Definition

MindMeister

  • Writing the Review
  • Further Resources

Additional Tools

Google slides.

GSlides can create concept maps using their Diagram feature. Insert > Diagram > Hierarchy will give you some editable templates to use.

Tutorial on diagrams in GSlides .

MICROSOFT WORD

MS Word can create concept maps using Insert > SmartArt Graphic. Select Process, Cycle, Hierarchy, or Relationship to see templates.

NVivo  is software for qualitative analysis that has a concept map feature. Zotero libraries can be uploaded using ris files. NVivo Concept Map information.

A concept map or mind map is a visual representation of knowledge that illustrates relationships between concepts or ideas. It is a tool for organizing and representing information in a hierarchical and interconnected manner. At its core, a concept map consists of nodes, which represent individual concepts or ideas, and links, which depict the relationships between these concepts .

Below is a non-exhaustive list of tools that can facilitate the creation of concept maps.

uses of literature review in research methodology

www.canva.com

Canva is a user-friendly graphic design platform that enables individuals to create visual content quickly and easily. It offers a diverse array of customizable templates, design elements, and tools, making it accessible to users with varying levels of design experience. 

Pros: comes with many pre-made concept map templates to get you started

Cons : not all features are available in the free version

Explore Canva concept map templates here .

Note: Although Canva advertises an "education" option, this is for K-12 only and does not apply to university users.

uses of literature review in research methodology

www.lucidchart.com

Lucid has two tools that can create mind maps (what they're called inside Lucid): Lucidchart is the place to build, document, and diagram, and Lucidspark is the place to ideate, connect, and plan.

Lucidchart is a collaborative online diagramming and visualization tool that allows users to create a wide range of diagrams, including flowcharts, org charts, wireframes, and mind maps. Its mind-mapping feature provides a structured framework for brainstorming ideas, organizing thoughts, and visualizing relationships between concepts. 

Lucidspark , works as a virtual whiteboard. Here, you can add sticky notes, develop ideas through freehand drawing, and collaborate with your teammates. Has only one template for mind mapping.

Explore Lucid mind map creation here .

How to create mind maps using LucidSpark: 

Note: U-M students have access to Lucid through ITS. [ info here ] Choose the "Login w Google" option, use your @umich.edu account, and access should happen automatically.

uses of literature review in research methodology

www.figma.com

Figma is a cloud-based design tool that enables collaborative interface design and prototyping. It's widely used by UI/UX designers to create, prototype, and iterate on digital designs. Figma is the main design tool, and FigJam is their virtual whiteboard:

Figma  is a comprehensive design tool that enables designers to create and prototype high-fidelity designs

FigJam focuses on collaboration and brainstorming, providing a virtual whiteboard-like experience, best for concept maps

Explore FigJam concept maps here .

uses of literature review in research methodology

Note: There is a " Figma for Education " version for students that will provide access. Choose the "Login w Google" option, use your @umich.edu account, and access should happen automatically.

uses of literature review in research methodology

www.mindmeister.com

MindMeister  is an online mind mapping tool that allows users to visually organize their thoughts, ideas, and information in a structured and hierarchical format. It provides a digital canvas where users can create and manipulate nodes representing concepts or topics, and connect them with lines to show relationships and associations.

Features : collaborative, permits multiple co-authors, and multiple export formats. The free version allows up to 3 mind maps.

Explore  MindMeister templates here .

  • << Previous: Using Citation Managers
  • Next: Writing the Review >>
  • Last Updated: Feb 15, 2024 1:47 PM
  • URL: https://guides.lib.umich.edu/litreview

Grad Coach (R)

What’s Included: Research Paper Template

If you’re preparing to write an academic research paper, our free research paper template is the perfect starting point. In the template, we cover every section step by step, with clear, straightforward explanations and examples .

The template’s structure is based on the tried and trusted best-practice format for formal academic research papers. The template structure reflects the overall research process, ensuring your paper will have a smooth, logical flow from chapter to chapter.

The research paper template covers the following core sections:

  • The title page/cover page
  • Abstract (sometimes also called the executive summary)
  • Section 1: Introduction 
  • Section 2: Literature review 
  • Section 3: Methodology
  • Section 4: Findings /results
  • Section 5: Discussion
  • Section 6: Conclusion
  • Reference list

Each section is explained in plain, straightforward language , followed by an overview of the key elements that you need to cover within each section. We’ve also included links to free resources to help you understand how to write each section.

The cleanly formatted Google Doc can be downloaded as a fully editable MS Word Document (DOCX format), so you can use it as-is or convert it to LaTeX.

FAQs: Research Paper Template

What format is the template (doc, pdf, ppt, etc.).

The research paper template is provided as a Google Doc. You can download it in MS Word format or make a copy to your Google Drive. You’re also welcome to convert it to whatever format works best for you, such as LaTeX or PDF.

What types of research papers can this template be used for?

The template follows the standard best-practice structure for formal academic research papers, so it is suitable for the vast majority of degrees, particularly those within the sciences.

Some universities may have some additional requirements, but these are typically minor, with the core structure remaining the same. Therefore, it’s always a good idea to double-check your university’s requirements before you finalise your structure.

Is this template for an undergrad, Masters or PhD-level research paper?

This template can be used for a research paper at any level of study. It may be slight overkill for an undergraduate-level study, but it certainly won’t be missing anything.

How long should my research paper be?

This depends entirely on your university’s specific requirements, so it’s best to check with them. We include generic word count ranges for each section within the template, but these are purely indicative. 

What about the research proposal?

If you’re still working on your research proposal, we’ve got a template for that here .

We’ve also got loads of proposal-related guides and videos over on the Grad Coach blog .

How do I write a literature review?

We have a wealth of free resources on the Grad Coach Blog that unpack how to write a literature review from scratch. You can check out the literature review section of the blog here.

How do I create a research methodology?

We have a wealth of free resources on the Grad Coach Blog that unpack research methodology, both qualitative and quantitative. You can check out the methodology section of the blog here.

Can I share this research paper template with my friends/colleagues?

Yes, you’re welcome to share this template. If you want to post about it on your blog or social media, all we ask is that you reference this page as your source.

Can Grad Coach help me with my research paper?

Within the template, you’ll find plain-language explanations of each section, which should give you a fair amount of guidance. However, you’re also welcome to consider our private coaching services .

Free Webinar: Literature Review 101

Log in using your username and password

  • Search More Search for this keyword Advanced search
  • Latest content
  • Current issue
  • BMJ Journals More You are viewing from: Google Indexer

You are here

  • Online First
  • Rapid reviews methods series: guidance on rapid qualitative evidence synthesis
  • Article Text
  • Article info
  • Citation Tools
  • Rapid Responses
  • Article metrics

Download PDF

  • http://orcid.org/0000-0003-4808-3880 Andrew Booth 1 , 2 ,
  • Isolde Sommer 3 , 4 ,
  • Jane Noyes 2 , 5 ,
  • Catherine Houghton 2 , 6 ,
  • Fiona Campbell 1 , 7
  • The Cochrane Rapid Reviews Methods Group and Cochrane Qualitative and Implementation Methods Group (CQIMG)
  • 1 EnSyGN Sheffield Evidence Synthesis Group , University of Sheffield , Sheffield , UK
  • 2 Cochrane Qualitative and Implementation Methods Group (CQIMG) , London , UK
  • 3 Department for Evidence-based Medicine and Evaluation , University for Continuing Education Krems , Krems , Austria
  • 4 Cochrane Rapid Reviews Group & Cochrane Austria , Krems , Austria
  • 5 Bangor University , Bangor , UK
  • 6 University of Galway , Galway , Ireland
  • 7 University of Newcastle upon Tyne , Newcastle upon Tyne , UK
  • Correspondence to Professor Andrew Booth, Univ Sheffield, Sheffield, UK; a.booth{at}sheffield.ac.uk

This paper forms part of a series of methodological guidance from the Cochrane Rapid Reviews Methods Group and addresses rapid qualitative evidence syntheses (QESs), which use modified systematic, transparent and reproducible methodsu to accelerate the synthesis of qualitative evidence when faced with resource constraints. This guidance covers the review process as it relates to synthesis of qualitative research. ‘Rapid’ or ‘resource-constrained’ QES require use of templates and targeted knowledge user involvement. Clear definition of perspectives and decisions on indirect evidence, sampling and use of existing QES help in targeting eligibility criteria. Involvement of an information specialist, especially in prioritising databases, targeting grey literature and planning supplemental searches, can prove invaluable. Use of templates and frameworks in study selection and data extraction can be accompanied by quality assurance procedures targeting areas of likely weakness. Current Cochrane guidance informs selection of tools for quality assessment and of synthesis method. Thematic and framework synthesis facilitate efficient synthesis of large numbers of studies or plentiful data. Finally, judicious use of Grading of Recommendations Assessment, Development and Evaluation approach for assessing the Confidence of Evidence from Reviews of Qualitative research assessments and of software as appropriate help to achieve a timely and useful review product.

  • Systematic Reviews as Topic
  • Patient Care

Data availability statement

No data are available. Not applicable. All data is from published articles.

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See:  http://creativecommons.org/licenses/by-nc/4.0/ .

https://doi.org/10.1136/bmjebm-2023-112620

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

WHAT IS ALREADY KNOWN ON THIS TOPIC

Rapid Qualitative Evidence Synthesis (QES) is a relatively recent innovation in evidence synthesis and few published examples currently exists.

Guidance for authoring a rapid QES is scattered and requires compilation and summary.

WHAT THIS STUDY ADDS

This paper represents the first attempt to compile current guidance, illustrated by the experience of several international review teams.

We identify features of rapid QES methods that could be accelerated or abbreviated and where methods resemble those for conventional QESs.

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

This paper offers guidance for researchers when conducting a rapid QES and informs commissioners of research and policy-makers what to expect when commissioning such a review.

Introduction

This paper forms part of a series from the Cochrane Rapid Reviews Methods Group providing methodological guidance for rapid reviews. While other papers in the series 1–4 focus on generic considerations, we aim to provide in-depth recommendations specific to a resource-constrained (or rapid) qualitative evidence synthesis (rQES). 5 This paper is accompanied by recommended resources ( online supplemental appendix A ) and an elaboration with practical considerations ( online supplemental appendix B ).

Supplemental material

The role of qualitative evidence in decision-making is increasingly recognised. 6 This, in turn, has led to appreciation of the value of qualitative evidence syntheses (QESs) that summarise findings across multiple contexts. 7 Recognition of the need for such syntheses to be available at the time most useful to decision-making has, in turn, driven demand for rapid qualitative evidence syntheses. 8 The breadth of potential rQES mirrors the versatility of QES in general (from focused questions to broad overviews) and outputs range from descriptive thematic maps through to theory-informed syntheses (see table 1 ).

  • View inline

Glossary of important terms (alphabetically)

As with other resource-constrained reviews, no one size fits all. A team should start by specifying the phenomenon of interest, the review question, 9 the perspectives to be included 9 and the sample to be determined and selected. 10 Subsequently, the team must finalise the appropriate choice of synthesis. 11 Above all, the review team should consider the intended knowledge users, 3 including requirements of the funder.

An rQES team, in particular, cannot afford any extra time or resource requirements that might arise from either a misunderstanding of the review question, an unclear picture of user requirements or an inappropriate choice of methods. The team seeks to align the review question and the requirements of the knowledge user with available time and resources. They also need to ensure that the choice of data and choice of synthesis are appropriate to the intended ‘knowledge claims’ (epistemology) made by the rQES. 11 This involves the team asking ‘what types of data are meaningful for this review question?’, ‘what types of data are trustworthy?’ and ‘is the favoured synthesis method appropriate for this type of data?’. 12 This paper aims to help rQES teams to choose methods that best fit their project while understanding the limitations of those choices. Our recommendations derive from current QES guidance, 5 evidence on modified QES methods, 8 13 and practical experience. 14 15

This paper presents an overview of considerations and recommendations as described in table 2 . Supplemental materials including additional resources details of our recommendations and practical examples are provided in online supplemental appendices A and B .

Recommendations for resource-constrained qualitative evidence synthesis (rQES)

Setting the review question and topic refinement

Rapid reviews summarise information from multiple research studies to produce evidence for ‘the public, researchers, policymakers and funders in a systematic, resource-efficient manner’. 16 Involvement of knowledge users is critical. 3 Given time constraints, individual knowledge users could be asked only to feedback on very specific decisions and tasks or on selective sections of the protocol. Specifically, whenever a QES is abbreviated or accelerated, a team should ensure that the review question is agreed by a minimum number of knowledge users with expertise or experience that reflects all the important review perspectives and with authority to approve the final version 2 5 11 ( table 2 , item R1).

Involvement of topic experts can ensure that the rQES is responsive to need. 14 17 One Cochrane rQES saved considerable time by agreeing the review topic within a single meeting and one-phase iteration. 9 Decisions on topics to be omitted are also informed by a knowledge of existing QESs. 17

An information specialist can help to manage the quantity and quality of available evidence by setting conceptual boundaries and logistic limits. A structured question format, such as Setting-Perspective-Interest, phenomenon of-Comparison-Evaluation or Population-Interest, phenomenon of-Context helps in communicating the scope and, subsequently, in operationalising study selection. 9 18

Scoping (of review parameters) and mapping (of key types of evidence and likely richness of data) helps when planning the review. 5 19 The option to choose purposive sampling over comprehensive sampling approaches, as offered by standard QES, may be particularly helpful in the context of a rapid QES. 8 Once a team knows the approximate number and distribution of studies, perhaps mapping them against country, age, ethnicity, etc), they can decide whether or not to use purposive sampling. 12 An rQES for the WHO combined purposive with variation sampling. Sampling in two stages started by reducing the initial number of studies to a more manageable sampling frame and then sampling approximately a third of the remaining studies from within the sampling frame. 20

Sampling may target richer studies and/or privilege diversity. 8 21 A rich qualitative study typically illustrates findings with verbatim extracts from transcripts from interviews or textual responses from questionnaires. Rich studies are often found in specialist qualitative research or social science journals. In contrast, less rich studies may itemise themes with an occasional indicative text extract and tend to summarise findings. In clinical or biomedical journals less rich findings may be placed within a single table or box.

No rule exists on an optimal number of studies; too many studies makes it challenging to ‘maintain insight’, 22 too few does not sustain rigorous analysis. 23 Guidance on sampling is available from the forthcoming Cochrane-Campbell QES Handbook.

A review team can use templates to fast-track writing of a protocol. The protocol should always be publicly available ( table 2 , item R2). 24 25 Formal registration may require that the team has not commenced data extraction but should be considered if it does not compromise the rQES timeframe. Time pressures may require that methods are left suitably flexible to allow well-justified changes to be made as a detailed picture of the studies and data emerge. 26 The first Cochrane rQES drew heavily on text from a joint protocol/review template previously produced within Cochrane. 24

Setting eligibility criteria

An rQES team may need to limit the number of perspectives, focusing on those most important for decision-making 5 9 27 ( table 2 , item R3). Beyond the patients/clients each additional perspective (eg, family members, health professionals, other professionals, etc) multiplies the additional effort involved.

A rapid QES may require strict date and setting restrictions 17 and language restrictions that accommodate the specific requirements of the review. Specifically, the team should consider whether changes in context over time or substantive differences between geographical regions could be used to justify a narrower date range or a limited coverage of countries and/or languages. The team should also decide if ‘indirect evidence’ is to substitute for the absence of direct evidence. An rQES typically focuses on direct evidence, except when only indirect evidence is available 28 ( table 2 , item R4). Decisions on relevance are challenging—precautions for swine influenza may inform precautions for bird influenza. 28 A smoking ban may operate similarly to seat belt legislation, etc. A review team should identify where such shared mechanisms might operate. 28 An rQES team must also decide whether to use frameworks or models to focus the review. Theories may be unearthed within the topic search or be already known to team members, fro example, Theory of Planned Behaviour. 29

Options for managing the quantity and quality of studies and data emerge during the scoping (see above). In summary, the review team should consider privileging rich qualitative studies 2 ; consider a stepwise approach to inclusion of qualitative data and explore the possibility of sampling ( table 2 , item R5). For example, where data is plentiful an rQES may be limited to qualitative research and/or to mixed methods studies. Where data is less plentiful then surveys or other qualitative data sources may need to be included. Where plentiful reviews already exist, a team may decide to conduct a review of reviews 5 by including multiple QES within a mega-synthesis 28 29 ( table 2 , item R6).

Searching for QES merits its own guidance, 21–23 30 this section reinforces important considerations from guidance specific to qualitative research. Generic guidance for rapid reviews in this series broadly applies to rapid QESs. 1

In addition to journal articles, by far the most plentiful source, qualitative research is found in book chapters, theses and in published and unpublished reports. 21 Searches to support an rQES can (a) limit the number of databases searched, deliberately selecting databases from diverse disciplines, (b) use abbreviated study filters to retrieve qualitative designs and (c) employ high yield complementary methods (eg, reference checking, citation searching and Related Articles features). An information specialist (eg, librarian) should be involved in prioritising sources and search methods ( table 2 , item R7). 11 14

According to empirical evidence optimal database combinations include Scopus plus CINAHL or Scopus plus ProQuest Dissertations and Theses Global (two-database combinations) and Scopus plus CINAHL plus ProQuest Dissertations and Theses Global (three-database combination) with both choices retrieving between 89% and 92% of relevant studies. 30

If resources allow, searches should include one or two specialised databases ( table 2 , item R8) from different disciplines or contexts 21 (eg, social science databases, specialist discipline databases or regional or institutional repositories). Even when resources are limited, the information specialist should factor in time for peer review of at least one search strategy ( table 2 , item R9). 31 Searches for ‘grey literature’ should selectively target appropriate types of grey literature (such as theses or process evaluations) and supplemental searches, including citation chaining or Related Articles features ( table 2 , item R10). 32 The first Cochrane rQES reported that searching reference lists of key papers yielded an extra 30 candidate papers for review. However, the team documented exclusion of grey literature as a limitation of their review. 15

Study selection

Consistency in study selection is achieved by using templates, by gaining a shared team understanding of the audience and purpose, and by ongoing communication within, and beyond, the team. 2 33 Individuals may work in parallel on the same task, as in the first Cochrane rQES, or follow a ‘segmented’ approach where each reviewer is allocated a different task. 14 The use of machine learning in the specific context of rQES remains experimental. However, the possibility of developing qualitative study classifiers comparable to those for randomised controlled trials offers an achievable aspiration. 34

Title and abstract screening

The entire screening team should use pre-prepared, pretested title and abstract templates to limit the scale of piloting, calibration and testing ( table 2 , item R11). 1 14 The first Cochrane rQES team double-screened titles and abstracts within Covidence review software. 14 Disagreements were resolved with reference to a third reviewer achieving a shared understanding of the eligibility criteria and enhancing familiarity with target studies and insight from data. 14 The team should target and prioritise identified risks of either over-zealous inclusion or over-exclusion specific to each rQES ( table 2 , item R12). 14 The team should maximise opportunities to capture divergent views and perspectives within study findings. 35

Full-text screening

Full-text screening similarly benefits from using a pre-prepared pretested standardised template where possible 1 14 ( table 2 , item R11). If a single reviewer undertakes full-text screening, 8 the team should identify likely risks to trustworthiness of findings and focus quality control procedures (eg, use of additional reviewers and percentages for double screening) on specific threats 14 ( table 2 , item R13). The Cochrane rQES team opted for double screening to assist their immersion within the topic. 14

Data extraction

Data extraction of descriptive/contextual data may be facilitated by review management software (eg, EPPI-Reviewer) or home-made approaches using Google Forms, or other survey software. 36 Where extraction of qualitative findings requires line-by-line coding with multiple iterations of the data then a qualitative data management analysis package, such as QSR NVivo, reaps dividends. 36 The team must decide if, collectively, they favour extracting data to a template or coding direct within an electronic version of an article.

Quality control must be fit for purpose but not excessive. Published examples typically use a single reviewer for data extraction 8 with use of two independent reviewers being the exception. The team could limit data extraction to minimal essential items. They may also consider re-using descriptive details and findings previously extracted within previous well-conducted QES ( table 2 , item R14). A pre-existing framework, where readily identified, may help to structure the data extraction template. 15 37 The same framework may be used to present the findings. Some organisations may specify a preferred framework, such as an evidence-to-decision-making framework. 38

Assessment of methodological limitations

The QES community assess ‘methodological limitations’ rather than use ‘risk of bias’ terminology. An rQES team should pick an approach appropriate to their specific review. For example, a thematic map may not require assessment of individual studies—a brief statement of the generic limitations of the set of studies may be sufficient. However, for any synthesis that underpins practice recommendations 39 assessment of included studies is integral to the credibility of findings. In any decision-making context that involves recommendations or guidelines, an assessment of methodological limitations is mandatory. 40 41

Each review team should work with knowledge users to determine a review-specific approach to quality assessment. 27 While ‘traffic lights’, similar to the outputs from the Cochrane Risk of Bias tool, may facilitate rapid interpretation, accompanying textual notes are invaluable in highlighting specific areas for concern. In particular, the rQES team should demonstrate that they are aware (a) that research designs for qualitative research seek to elicit divergent views, rather than control for variation; (b) that, for qualitative research, the selection of the sample is far more informative than the size of the sample; and (c) that researchers from primary research, and equally reviewers for the qualitative synthesis, need to be thoughtful and reflexive about their possible influences on interpretation of either the primary data or the synthesised findings.

Selection of checklist

Numerous scales and checklists exist for assessing the quality of qualitative studies. In the absence of validated risk of bias tools for qualitative studies, the team should choose a tool according to Cochrane Qualitative and Implementation Methods Group (CQIMG) guidance together with expediency (according to ease of use, prior familiarity, etc) ( table 2 , item R15). 41 In comparison to the Critical Appraisal Skills Programme checklist which was never designed for use in synthesis, 42 the Cochrane qualitative tool is similarly easy to use and was designed for QES use. Work is underway to identify an assessment process that is compatible with QESs that support decision-making. 41 For now the choice of a checklist remains determined by interim Cochrane guidance and, beyond this, by personal preference and experience. For an rQES a team could use a single reviewer to assess methodological limitations, with verification of judgements (and support statements) by a second reviewer ( table 2 , item R16).

The CQIMG endorses three types of synthesis; thematic synthesis, framework synthesis and meta-ethnography ( box 1 ). 43 44 Rapid QES favour descriptive thematic synthesis 45 or framework synthesis, 46 47 except when theory generation (meta-ethnography 48 49 or analytical thematic synthesis) is a priority ( table 2 , item R17).

Choosing a method for rapid qualitative synthesis

Thematic synthesis: first choice method for rQES. 45 For example, in their rapid QES Crooks and colleagues 44 used a thematic synthesis to understand the experiences of both academic and lived experience coresearchers within palliative and end of life research. 45

Framework synthesis: alternative where a suitable framework can be speedily identified. 46 For example, Bright and colleagues 46 considered ‘best-fit framework synthesis’ as appropriate for mapping study findings to an ‘a priori framework of dimensions measured by prenatal maternal anxiety tools’ within their ‘streamlined and time-limited evidence review’. 47

Less commonly, an adapted meta-ethnographical approach was used for an implementation model of social distancing where supportive data (29 studies) was plentiful. 48 However, this QES demonstrates several features that subsequently challenge its original identification as ‘rapid’. 49

Abbrevations: QES, qualitative evidence synthesis; rQES, resource-constrained qualitative evidence synthesis.

The team should consider whether a conceptual model, theory or framework offers a rapid way for organising, coding, interpreting and presenting findings ( table 2 , item R18). If the extracted data appears rich enough to sustain further interpretation, data from a thematic or framework synthesis can subsequently be explored within a subsequent meta-ethnography. 43 However, this requires a team with substantial interpretative expertise. 11

Assessments of confidence in the evidence 4 are central to any rQES that seeks to support decision-making and the QES-specific Grading of Recommendations Assessment, Development and Evaluation approach for assessing the Confidence of Evidence from Reviews of Qualitative research (GRADE-CERQual) approach is designed to assess confidence in qualitative evidence. 50 This can be performed by a single reviewer, confirmed by a second reviewer. 26 Additional reviewers could verify all, or a sample of, assessments. For a rapid assessment a team must prioritise findings, using objective criteria; a WHO rQES focused only on the three ‘highly synthesised findings’. 20 The team could consider reusing GRADE-CERQual assessments from published QESs if findings are relevant and of demonstrable high quality ( table 2 , item R19). 50 No rapid approach to full application of GRADE-CERQual currently exists.

Reporting and record management

Little is written on optimal use of technology. 8 A rapid review is not a good time to learn review management software or qualitative analysis management software. Using such software for all general QES processes ( table 2 , item R20), and then harnessing these skills and tools when specifically under resource pressures, is a sounder strategy. Good file labelling and folder management and a ‘develop once, re-use multi-times’ approach facilitates resource savings.

Reporting requirements include the meta-ethnography reporting guidance (eMERGe) 51 and the Enhancing transparency in reporting the synthesis of qualitative research (ENTREQ) statement. 52 An rQES should describe limitations and their implications for confidence in the evidence even more thoroughly than a regular QES; detailing the consequences of fast-tracking, streamlining or of omitting processes all together. 8 Time spent documenting reflexivity is similarly important. 27 If QES methodology is to remain credible rapid approaches must be applied with insight and documented with circumspection. 53 54 (56)

Ethics statements

Patient consent for publication.

Not applicable.

Ethics approval

  • Klerings I ,
  • Robalino S ,
  • Booth A , et al
  • Nussbaumer-Streit B ,
  • Hamel C , et al
  • Garritty C ,
  • Tricco AC ,
  • Smith M , et al
  • Gartlehner G ,
  • Devane D , et al
  • NHS Scotland
  • Campbell F ,
  • Flemming K , et al
  • Glenton C ,
  • Lubarsky S ,
  • Varpio L , et al
  • Meskell P ,
  • Glenton C , et al
  • Houghton C ,
  • Delaney H , et al
  • Beecher C ,
  • Maeso B , et al
  • McKenzie JE , et al
  • Harris JL ,
  • Cargo M , et al
  • Varley-Campbell J , et al
  • Downe S , et al
  • Shamseer L ,
  • Clarke M , et al
  • Nussbaumer-Streit B , et al
  • Finlayson KW ,
  • Lawrie TA , et al
  • Lewin S , et al
  • Frandsen TF ,
  • Gildberg FA ,
  • Tingleff EB
  • Mshelia S ,
  • Analo CV , et al
  • Husk K , et al
  • Carmona C ,
  • Carroll C ,
  • Ilott I , et al
  • Meehan B , et al
  • Munthe-Kaas H ,
  • Bohren MA ,
  • Munthe-Kaas HM ,
  • French DP ,
  • Flemming K ,
  • Garside R , et al
  • Shulman C , et al
  • Dixon-Woods M
  • Bright KS ,
  • Norris JM ,
  • Letourneau NL , et al
  • Sadjadi M ,
  • Mörschel KS ,
  • Petticrew M
  • France EF ,
  • Cunningham M ,
  • Ring N , et al
  • McInnes E , et al
  • Britten N ,
  • Garside R ,
  • Pope C , et al

Supplementary materials

Supplementary data.

This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

  • Data supplement 1

Contributors All authors (AB, IS, JN, CH, FC) have made substantial contributions to the conception and design of the guidance document. AB led on drafting the work and revising it critically for important intellectual content. All other authors (IS, JN, CH, FC) contributed to revisions of the document. All authors (AB, IS, JN, CH, FC) have given final approval of the version to be published. As members of the Cochrane Qualitative and Implementation Methods Group and/or the Cochrane Rapid Reviews Methods Group all authors (AB, IS, JN, CH, FC) agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests AB is co-convenor of the Cochrane Qualitative and Implementation Methods Group. In the last 36 months, he received royalties from Systematic Approaches To a Successful Literature Review (Sage 3rd edition), honoraria from the Agency for Healthcare Research and Quality, and travel support from the WHO. JN is lead convenor of the Cochrane Qualitative and Implementation Methods Group. In the last 36 months, she has received honoraria from the Agency for Healthcare Research and Quality and travel support from the WHO. CH is co-convenor of the Cochrane Qualitative and Implementation Methods Group.

Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review Not commissioned; internally peer reviewed.

Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Read the full text or download the PDF:

Academic Entrepreneurship Ecosystems: Systematic Literature Review and Future Research Directions

  • Open access
  • Published: 16 February 2024

Cite this article

You have full access to this open access article

  • Maria Patrocínia Correia 1 , 2 ,
  • Carla Susana Marques   ORCID: orcid.org/0000-0003-1557-1319 2 ,
  • Rui Silva 2 &
  • Veland Ramadani 3  

Research on the entrepreneurship ecosystem, based on different data and scales, limits the acceptance of a single definition. This conceptual limitation and the still recent research and higher education institutions have come to be seen as ecosystems associated with entrepreneurship. The aim of this study is to contribute to the field of knowledge, identify current and emerging thematic areas and trends and reveal the scientific roots of research on entrepreneurial ecosystems and their relationship with higher education institutions. A bibliometric analysis was developed to analyse a final sample of 110 articles published between 2011 and 2022. In order to develop the analysis, Bibliometrix R-Tool was used and the metadata of two databases (Web of Science and Scopus) was retrieved and merged. The software creates a reference co-citation’s map, which allowed emphasize the state of the art and indicate three thematic clusters: (i) the importance of the higher education context for the entrepreneurial ecosystem, (ii) the evolution and challenges of entrepreneurship education and (iii) academic entrepreneurship ecosystems. The paper concludes by suggesting future research focused on the importance of building an integrated approach to entrepreneurial ecosystems and higher education institutions on a context regional scale.

Avoid common mistakes on your manuscript.

Introduction

The new research on the “entrepreneurship ecosystem” (EE) limits the acceptance of a single definition. According to this conceptual limitation and the still recent research, higher education institutions (HEIs) have come to be seen as ecosystems associated with entrepreneurship. While several bibliometric and systematic literature reviews have advanced for a research agenda for academic entrepreneurial ecosystems (AEEs), a holistic approach that integrates theories, attributes and methods is still necessary.

The concept of EE in HEIs has emerged in the literature (Fetters et al., 2010 ). Consequently, initial studies have addressed the components of these ecosystems (Fetters et al., 2010 ; Graham, 2014 ; Meyer et al., 2020 ), and internal and external actors have been identified (e.g. Hayter, 2016 ; Hayter et al., 2018 ; Meyer et al., 2020 ). Hayter ( 2016 ) and Hayter et al. ( 2018 ) further elaborated on the research by relating the effectiveness of academic EEs to the levels of the interconnectedness of the constituent elements and their collective capacity.

Higher education institutions (HEIs) and their surroundings play a “fundamental role for contemporary societies in the field of education and knowledge generation” (Kobylinska & Lavios, 2020 : 118). For the authors, during the last decade, the university and its surroundings have become a special ecosystem. Specifically, favourable conditions are created for cooperation between various entities, namely, HEI, business incubators, technology transfer centres and funding institutions, which contribute to developing academic entrepreneurship ecosystem (AEE) (Meyer et al., 2020 ; Kobylinska & Lavios, 2020 ). The combination of EE and HEI requires further research.

The systematic literature review (SLR) developed in this article found five studies that allow us to assess what is known about this subject. Malecki ( 2018 ) reviews the literature, concepts and operationalizations of the concept of EE with a bibliometric analysis. Kansheba and Wald ( 2020 ) present a systematic review of the existing literature, develop a research agenda and analysing, only, articles that focused on EEs (conceptual, theoretical or empirical). They concluded that the concept of EEs is poorly theorised and dominated by conceptual studies, revealing existing theoretical and empirical gaps on EEs. In the third SLR found, Kobylinska and Lavios ( 2020 ) aimed to analyse the state of research on University EE and to identify research trends related to the topic. They concluded that the study of University EE is little recognized in the literature, lacking a solid methodological basis and revealed that the topic may constitute a research area of interest. In the fourth review, Guindalini et al. ( 2021 ) present an SLR with bibliometric and network analysis, with the aim of mapping AEE. In this SLR, as in the two previously mentioned, the authors conclude that this topic is at an “embryonic stage of academic research” (Guindalini et al., 2021 : 6). They also find a gap in research regarding evaluation studies that support the targeting of potential scientific discoveries in the market. With bibliometric and SLR, the study develops a holistic framework that integrates sustainability factors into the EE literature. They confirm that EE research has mostly focused on academic entrepreneurship, innovation and regional development, among others.

The originality of this research is directly linked to the chosen emerging theme. In this context, this study aims to complement and stand out from the five reviews found and understand the characteristics of an AEE and their successful development as a potential research area relevant in the future. To this end, a bibliometric analysis is proposed to answer the following research questions: (a) RQ1: Is it possible establish common attributes for AEE?; (b) RQ2: What are the opportunities and challenges that HEIs must recognize to achieve an successful EE?; (c) RQ3: What key areas require further research with regards to AEE?

In order to complement the proposed research questions, this study also responds to the subsequent objectives: to provide a comprehensive overview of the origins of the EE concept, to explore the research conducted so far in this field of study, to reveal the scientific roots of research on EEs and their relationship with the HEIs and to create knowledge for future research on AEEs.

To achieve them, the SLR followed in this article included a rigorous protocol and definition of research steps and a literature review based on scientific articles published in Web of Science (WoS) and Scopus. In addition, the 110 articles related to EEs were submitted to a bibliometric analysis with the Bibliometrix-R tool . In this quantitative bibliometric, we used the analysis of co-citations, which allowed obtaining a citation network composed of clusters.

The article is structured in seven parts. After this introductory section, the theoretical framework on the concept is presented in the second section of the paper and is organized as follows: entrepreneurial ecosystems and academic entrepreneurial ecosystems. In the third section, the methodological characteristics of the research used in the SLR, the sample and the bibliometric analysis method are presented. The results are explained in the fourth section. The thematic analysis exposing the resulting visual maps and discussing the results of the articles classified by clusters is the fifth section. In the sixth and final section, the future lines of research and conclusions are addressed presenting limitations that resulted from the review and future of research.

Theoretical Framework

Defining entrepreneurial ecosystems and academic entrepreneurship ecosystem.

The concept of entrepreneurial ecosystem is an ambiguous term, but, in fact, this concept has been increasingly explored by researchers over the years (Bischoff et al., 2018 ; Clarysse et al., 2014 ; Cohen, 2006 ; Isenberg, 2010 , 2011 ; Kansheba & Wald, 2020 ; Stam & Spigel, 2017 ; Van de Ven, 1993 ). The term entrepreneurial ecosystem (EE) is a composite of two terms.

The component of the term—entrepreneur—according to Mason and Brown ( 2014 ) is often associated with “high growth start-ups” or “economies of scale” as being a source of innovation and growth in productivity and employment. The other component of the term—ecosystem—is associated with biology and is defined as the physical environment and all possible interactions in the complex of living and non-living components (Stam, 2015 ). As in ecology, the biological perspective focuses on the rise and fall of many organizations and institutions that are mutually related and play different but complementary roles that enable their birth, growth and survival (Astley & Van de Ven, 1983 ; Freeman & Audia, 2006 ).

Cohen ( 2006 ) was the first to use the concept of EE building on the study of Neck et al. ( 2004 ). Neck et al. ( 2004 ) used qualitative analysis to identify the components present in the EE in Boulder, USA. This concept became more prominent through Daniel Isenberg, in 2010. For this author, an EE is a set of individual elements combined in a complex way. In isolation, each can generate entrepreneurship but cannot sustain it (Isenberg, 2010 , 2011 ). Mason and Brown ( 2014 : 5) more broadly defined an EE as a “set of interrelated entrepreneurial actors, entrepreneurial organizations, institutions and entrepreneurial processes that formally or informally cooperate in relating and mediate performance within the local entrepreneurial environment.” Audretsh and Belitski ( 2017 : 1031) define EE as “institutional and organisational systems as well as other systemic factors that interact and influence the identification and commercialisation of entrepreneurial opportunities.” Acs et al. ( 2014 ) defined entrepreneurial ecosystems as a dynamic, institutionally embedded interaction between entrepreneurial attitudes, capabilities and aspirations of individuals that drives the allocation of resources through the creation and operation of new projects. Stam and Spigel ( 2017 ) point out that it is the coordination that occurs between actors and interdependent factors that enables productive entrepreneurship in each territory.

As this term has captured the attention of researchers, experts and policymakers significant knowledge gaps have also emerged in terms of its conceptual meaning, theoretical foundation and application (Audretsh et al., 2019 ; Kansheba & Wald, 2020 ). According to Audretsh et al. ( 2019 ), the question remains as to what exactly an EE is and what it comprises. It also mentions that the definition of EE does not add value to academic discourses that rely on “networks”, “cluster initiatives”, “triple helix initiatives” or “public–private partnerships”. For the authors, thinking in terms of EEs may only reflect the importance of a particular topic, such as “business ecosystems”, “digital ecosystems”, “financial ecosystems” and “university ecosystems”, among others.

Combining EEs and HEIs: An Overview of Academic Entrepreneurship Ecosystems

In recent decades, some universities have oriented themselves towards a more entrepreneurial direction through the realization of the third mission as a key player in promoting national and regional economic and social development (Etzkowitz & Leydesdorff, 2000 ; Yi & Uyarra, 2018 ) resulting from the interaction of three actors belonging to different helixes—university-industry-government: triple helix model (Etzkowitz & Leydesdorff, 2000 ). Etzkowitz and Zhou ( 2017 ) point out that the thesis of the model is that the university starts to abandon a social, yet important, role of providing higher education and research and starts to assume an essential role equivalent to that of industry and government as a generator of new industries and enterprises. As a result, the entrepreneurial university has become an increasingly significant academic configuration and is considered a vital element (Etzkowitz & Zhou, 2017 ; Wang et al., 2021 ). Pita et al. ( 2021 ) agree, pointing out that universities actively contribute to the development of EEs by providing a skilled workforce and stimulating new enterprises, such as start-ups or spin-offs.

In the entrepreneurial university, knowledge-sharing processes are outlined, which requires the university to reconfigure its traditional educational programmes and approaches to create a favourable context for university entrepreneurship by supporting students in a process that moves from idea generation to idea development, business model and commercialisation (Secundo et al., 2021 ). Another challenge facing HEIs is to shift their focus from education about entrepreneurship to educating for entrepreneurship. This encompasses any programme or pedagogical process of education aimed at achieving entrepreneurial skills and attitudes (Bischoff et al., 2018 ).

Against entrepreneurial HEIs and their pedagogical competencies of entrepreneurship education, researchers highlight that the entrepreneurial university itself can form an EE (Miller & Acs, 2017 ; Wang et al., 2021 ). The EE developed with an academic campus as a context is referred to as “University-based Entrepreneurship Ecosystem” (UBEE) or “University Entrepreneurship Ecosystem” (UEE) or “Academic Entrepreneurship Ecosystem” (AEE). All these terms refer to the ecosystem developed on the university campus, which are part of a wider ecosystem. For Wang et al., ( 2021 : 2), the creation of UEEs, currently, is a “hot topic.”

Naturally, many definitions were put forward, leading to the decision to present, chronologically, a selection of definitions (Table  1 ).

An effective AEE is critical for entrepreneurial academic activities as they not only act as a catalyst for the acceleration of knowledge commercialisation but also as a platform and dynamic in maintaining the sustainable development of academic entrepreneurship (Yi & Uyarra, 2018 ). However, little literature exists on the AEE’s structure and function and particularly how the transition from the academic entrepreneurial system to an AEE occurs (Hayter, 2016 ; Yi & Uyarra, 2018 ).

Similarly, to research on EE, academics attach greater importance to the conceptualisation and elements of the UEE. Several authors identify the factors contributing to the evolution of EEUs (Fetters et al., 2010 ; Graham, 2014 ; Meyer et al., 2020 ). Fetters et al. ( 2010 ) cite seven factors contributing to the evolution of UBEEs: senior leadership, strong teaching and programmatic capacity, long-term commitment, the commitment of financial resources, the commitment to continuous innovation in programmes and curricula, adequate organizational infrastructure and the commitment to increasing critical mass and creating enterprises. Graham ( 2014 ) also identifies seven factors that underpin UEEs: institutions, culture, university leadership, university research capacity, regional or governmental support, effective institutional strategies and strong demand for entrepreneurial students.

Brush ( 2014 ) believed that entrepreneurship education is the core of the UEE. The researcher divided the internal entrepreneurial education ecosystem into three broad areas (introductory/curricular courses, extracurricular activities and research) and four dimensions (stakeholders, resources, infrastructure and culture). Sherwood ( 2018 ), in addition to the elements, identified curricular, extra-curricular components, Technology Transfer Offices (TTO), resources and informal and community engagement. For Wang et al. ( 2021 ), diversified extracurricular activities have played an important role in stimulating students’ interest in entrepreneurship by providing them with a large number of resources. For the authors, student entrepreneurs also tend to get the guidance and resources they need through these activities.

For Bischoff et al. ( 2018 ), although the concrete strengths and conceptualization of UBEEs generally vary between universities, a number of common characteristics can be identified. Secundo et al. ( 2021 ) mention that UBEE facilitates innovation and entrepreneurial opportunities thanks to the knowledge-sharing processes between the various actors. Within a UBEE, for the author, each actor needs to be connected to the other members through a constant flow of knowledge from information that enables the overflow of entrepreneurial knowledge. The author points out that universities may assume different roles according to the size and composition of the entrepreneurial ecosystem, interacting through different channels.

In accordance with the review carried out, the other authors initiate the development of methods to evaluate an AEE. Table 2 shows three of the conceptual models highlighted in the literature review and published chronologically in the last 5 years.

Within this context, further research work on evaluations of AEE is needed. The findings draw attention to considerations as “unique entrepreneurial architecture” (Prokop & Thompson, 2022 : 17). The Prokop and Thompson ( 2022 : 181) study include 81 UEE and, according to the author, “it is in no way reflective of all types of sub-ecosystems, or broader ecosystems.” The study of university and broader EEs is a critical feature to recognize and involve in future studies. This study aims to contribute to this challenge.

Methodology

To produce a comprehensive review article, Hulland ( 2020 ) refers that authors should carry out their studies in a systematic way. A systematic review needs the definition of clear questions, criteria and conclusions that provide new information based on the examined content. According to Aria and Cuccurullo ( 2017 ), this means that the phases adopted in the review can be replicated in all procedures and there should be clarity in all of them. The authors state that the working model of an SLR is based on five stages: study design, data collection, data analysis, data visualization and interpretation.

Ferreira et al. ( 2019 ) mention that one of the most suitable methods for analysing past research works is bibliometric analysis. According to Aria and Cuccurullo ( 2017 ) and Thelwall ( 2008 ), there are relevant points when using bibliometric. For Aria and Cuccurullo ( 2017 ), there are three types of research questions that can be answered using bibliometrics: identify the knowledge base of a topic or field of research, examine the conceptual structure of a topic or field of research and produce a network structure based on a particular scientific community. The relevance for Thelwall ( 2008 ) concerns the types of procedures in bibliometric analysis. The author identified two types of procedures, evaluation bibliometric and relational bibliometric. The first evaluates the productivity and impact of researchers, research centres and countries. The second type examines the similarity and relationship between publications, authors and keywords using co-word, co-authorship and co-citation analyses.

The article will use the suggestions of both authors in bibliometric analysis. It will respond to the three types of questions posed by Aria and Cuccurullo ( 2017 ) and uses both types of procedures, evaluation bibliometric and relational bibliometric. In evaluation bibliometric, mappings, qualitative analyses and baseline indicators are carried out. In relational bibliometrics will analyse co-citations and the respective clusters.

Data Collection and Eligibility Criteria

In additional search, the research papers were determined through the comprehensive advanced search in two databases including Scopus and Web of Science. These choices were justified for two reasons: they are two multidisciplinary databases that include all indexed journals with the highest number of citations in their respective areas of scientific specialization (Huang et al., 2020 ; Pranckuté, 2021 ). They also provide a citation index, generating information about each publication in documents that cite them as well as cited.

Table 3 elucidates the stages that followed in this study.

The keywords come from the research question and was defined the following search query: “entrepreneur* ecosystem*” (in title) AND “universit*” OR “polytechnic*” OR “higher education institution*” (in topic). All the articles from the current year were excluded because at the time of this research the year had not finished. The document type was limited to “article” and “review.” After applying these criteria, it was obtained 183 papers from the research process (104 obtained in SCOPUS and 79 results in Web of Science) (stages 1 and 2 from Table  3 and Fig.  1 ).

figure 1

Process of data collection and analysis

In the third stage, wherein some records were excluded, the data was filtered. To this end, other restrictions were applied:

Eliminating the repeats by cross-referencing the databases (62 documents)

The exclusion of 11 documents, after analysing the content of each, because the global subject of the articles was different from the scope of the study

Although language was not a filter, it should be noted that the search was developed utilizing English, which could be understood as “quasi-filter.”

The procedures followed in the data collection and the application of the eligibility criteria complete Fig.  1 which demonstrates the careful way in which the final database was obtained ( n  = 110).

Mapping and Qualitative Analysis

R-Bibliometrix summarized the mapping of the documents included in the final database with the information considered relevant, as shown in Table  4 . Table 4 reveals that the dataset contains 110 documents published between 2011 and 2022, representing the work of 276 authors from 32 different countries. The average years from publication is 3.31 and the average number of citations per documents 13.4. The number of authors and co-authors per document is 2.5 and 2.7.

The first study in the final database addressed the entrepreneurship ecosystems, and the global innovation networks were written by Malecki in 2011. For the author, the existing knowledge is dispersed as it results from entrepreneurial activity originating from small and medium enterprises, research institutes and universities. Malecki ( 2011 ) suggested the simultaneous integration of local and global knowledge as well as internal and external.

A reading of Tables  4 and  5 reveals that various articles have been published recently (during 2011–2022). Moreover, an increase of publications (except 2012 and 2013) shows an increasing trend, suggesting that the subject has been progressively gaining popularity in the academic community. The results reveal and confirm the increase prevalence of research on EEs over the past 11 years.

In 2022, the number reached 24 articles in the last year of the period. After 2014, there was a considerable increase in the number of published articles. The data shows a turning point in 2018 (14) and 2019 (23). This latter year and 2022 standing out with the highest number of published articles. It is important to mention that more than half of the articles (62) were published in the last 3 years. The production growth rate is 33.5%.

According to the average number of citations, per year, the articles written in 2022 were those with a higher number (9.79) followed by articles from the years 2011, 2018 and 2019. This increment in the interest of EE results from the fact that this concept has assumed a global and multidisciplinary dimension recognized and associated with innovation by the various economic and social actors.

Table 6 presents the five authors and journals that have contributed for research’s development. The most cited papers by author were those of Malecki, with 185, followed by Audretsh, with 111, and Carayannis, with 110. The three authors who have published the most with the highest local impact (TC index) are Cunningham (4 publications, TC 156), Audretsh (3 publications, TC 184) and Menter (3 publications, TC 154).

R-Bibliometrix software was used to identify the keywords mentioned in the 110 documents of the final sample. As can be seen in the Fig.  2 , the most frequently terms mentioned are “entrepreneurial ecosystem”, “entrepreneurial university”, “entrepreneurial education”, “university”, innovation” and “higher education”. This also shows that of the studies analysed word association results as “academic entrepreneurship”.

figure 2

Most mentioned keywords

Table 7 summarizes the applied methodologies. As an emerging theoretical stream, EEs have been studied through qualitative methods. Thus, several articles use a case study technique. There is an increase on quantitative methods using factor analysis and structural equation modelling to understand variations in entrepreneurship and develop metrics. Researchers have used mixed methods, both qualitative and quantitative data collection techniques to address the complexity of the phenomenon.

Concerning methodologies, of a total 110 articles, 59 documents (54%) use a qualitative approach, through the technique of data collection via interviews (in-depth and semi-structured), samples, observation and documentary analysis. The case study technique, inserted in this approach, focuses on 25 articles, meaning that its weighting is 42% in relation to the total number of articles that use qualitative methodologies. The 28 articles (around 25%) use a quantitative approach through data collection techniques involving the application of questionnaires and secondary data (statistics) and eight articles (7%) use mixed methods, namely, they use both qualitative and quantitative data collection techniques. Eight conceptual articles (7%) and seven literature review articles (6%) were identified. Of this literature review, five are based on systematic literature reviews. From the numbers, we deduce that there is no balance of methods in EE and HEI studies and literature reviews are the least frequent type of publication.

Thematic Analysis

In this part of the article, the thematic analysis results will be examined. It will start with the strategic and evolutionary analysis and, subsequently, the networks created by the co-citation analysis. The subsequent figures will be presented all results.

Strategic and Evolutionary Thematic Analysis

The strategic diagram for the studied subject is presented in Fig.  3 . The size of the circles represents the number of occurrences of these words. The upper right quadrant represents the main themes, and the upper left quadrant depicts the more specific themes, considered niche themes. The lower right quadrant represents the basic themes, and the lower left means that the theme may be emerging or disappearing.

figure 3

Strategic diagram

The themes in the upper right quadrant are “academic entrepreneurship” and “entrepreneurial”. All these sets of themes are crucial to the research in this paper.

The theme in the upper left quadrant is “start-ups”, “case study” and “networks.

The lower right quadrant represents the basic themes necessary for understanding the present study: “entrepreneurial ecosystem”, “entrepreneurial education”, “entrepreneurial university”. Also “university” and “technology transfer” are essential for the understanding on the topic. The lower left quadrant given the inexistence of declining themes but also gives the emerging themes, “entrepreneurial education” and “entrepreneur”. All this fact enhances the importance of the sets of themes in the article.

Thus, “networks”, “case study” and “academic entrepreneurship” reveal themselves as major themes. The transversal themes are “entrepreneurial ecosystems” and “university incubators”. This last phase, 2022, was the growth stage of an approach integrating Entrepreneurial Ecosystems and the Entrepreneurial University. Therefore, 2023 could be a high growth phase for an integrated approach to AEEs.

Figure  4 presents the evolution of research topics in entrepreneurial ecosystems and the relationship with the university. The data were analysed using the author’s keywords and cut-off points in the years 2014, 2018 and 2020. The results reveal a thematic evolution of the conceptual frameworks from 2011 to 2022. From the general concept of “Entrepreneurial Ecosystem” (2011–2014), “innovation” emerges in the thematic evolution (2015–2017). Therefore, the cut-off points were two periods when the first publications on the topic of the paper appeared (three publications in 2011–2014 and nine publications in 2015–2017).

figure 4

Thematic evolution, with cut-off points

In 2018, results of the emergence of thematic areas such as “education” and “higher education” are revealed. From 2019, “entrepreneurial ecosystem” gives way to “entrepreneurial education”, “entrepreneurial university” and its “ecosystem”. Likewise, the area of “innovation” gives way to a unique “entrepreneurial ecosystem” based on “entrepreneurial education”, “university”, “higher education” and “academic entrepreneurship”. The thematic evolution of the conceptual framework between 2018 and 2022 revealed that these periods are the most productive and creative with the highest number of base themes and driving themes evolving in these periods.

Cluster Analysis

A bibliometric analysis was carried out to understand how this field of study is divided into research clusters, and the co-citations were analysed. No cut-off point for the number of citations per document has been defined. All linked documents were selected, leaving us with a final analysis with 50 documents distributed by clusters. Each of the clusters, identified with different colours, can be observed in Fig.  5 . The colours indicate the clusters and the articles belonging to them. In addition, each article’s weight is assigned based on the links’ total strength, and the number of citations the publication has received. The top nodes are the publications with the highest link strength.

figure 5

Clusters networks through the co-citation analysis technique

Based on the visualization of Fig.  5 and after analysing the resulting network and the content of the articles, it is concluded that the research is divided into three thematic clusters (Table  8 ).

Cluster 1 (Blue)—Conceptualization and Attributes of Entrepreneurship Ecosystems

The first cluster is focused on the definition and attributes present in EEs. No consensus has been reached in the academic community on the theoretical characterization of the concept and the elements that characterize it.

While there is none accepted definition of an EE, as Spigel ( 2018 ) points out, the most active area of interest has been around the types of domains (Isenberg, 2010 , 2011 ), components (Cohen, 2006 ) or attributes (Spigel, 2017 ).

Diverse literature provides tools that show several factors considered important for a successful EE. Cohen ( 2006 ) refers to formal and informal networks, government, university, skilled human resources, support services, funding and talent. The works of Isenberg ( 2010 , 2011 ) list six domains present in the ecosystem: policy, funding, culture, support, human capital and markets.

Spigel ( 2017 ) efforts to rank the categories of an EE in terms of (i) cultural attributes (entrepreneurship stories, supportive culture), (ii) social attributes (talent, mentors, networks, investment capital) and (iii) material attributes (infrastructure, universities, support services, public policies, open markets). Spigel and Harrison ( 2018 ) give attention to several factors such as governance, knowledge, industry, actors, resources and benefits.

Table 9 summarizes the attributes by applying them to the EEs.

Although the topic on the attributes of EEs is innovative, it has not been without trials. Several articles highlight criticisms of previous work (Alvedalen & Boschma, 2017 ; Brown & Mason, 2017 ; Malecki, 2018 ; Nicotra et al., 2018 ; Stam & Spigel, 2017 ). Alvedalen and Boschma ( 2017 ), Nicotra et al. ( 2018 ) and Stam and Spigel ( 2017 ) highlighted the lack of a clear analytical framework to empirically explain the cause-effect relationship of EEs’ attributes and their effects on productive entrepreneurship. The static approach of EE studies was another criticism highlighted as its evolution over time was not considered. Finally, Malecki ( 2018 ) noted the lack of an issue related to spatial scale.

Cluster 2 (Red)—Spatial Context and Knowledge Ecosystems

Beyond definitional debates, the lead author of this cluster, Stam ( 2015 ), expresses himself critically concerning studies of EEs. He underlines that it is not only generating entrepreneurship that makes it a good EE. He also mentions that the approaches only offer a long list of elements without a cause-effect relationship and concludes that it is unclear what level of geographical analysis the approaches have taken into consideration. The author refers that a new emerging approach to EE occurs, conveying a new view on people, networks and institutions. From this emerging approach, differentiations have emerged at two levels: spatial context and dynamics of knowledge ecosystems.

The first sub-division of this cluster refers to the importance of context in EEs (Acs et al., 2014 ; Cohen, 2006 ; Spigel, 2017 ; Stam, 2015 ). For Stam ( 2015 ), the common denominator in this sub-cluster seems to be that entrepreneurs create value in a specific institutional context. The author approach emphasizes the interdependencies within the context and provides a bottom-up analysis of the performance of regional economies. Stam ( 2015 ) argues that EEs open the door to a shared responsibility among actors that foster, encourage and support entrepreneurs, asking about the systemic services that a region tries to achieve.

The second sub-cluster analyses the dynamics of knowledge ecosystems, namely, the role of HEIs for value creation in a given context. Kuratko ( 2005 ), in his study, notes that younger people have become the most entrepreneurial generation since the Industrial Revolution. The growth and development in programmes and curricula dedicated to entrepreneurship and the creation of new projects have been remarkable. The number of colleges and universities offering entrepreneurship-related courses has increased. However, among this enormous expansion, for Kuratko ( 2005 ) there remains the challenge of the academic legitimacy of entrepreneurship. Although there has been this significant growth, the author points out two specific challenges to academia: (i) development of academic programmes and specialized human resources to improve the quality of courses and (ii) commitment by institutions to create formal academic programmes.

Clarysse et al. ( 2014 ) analysed the tension between knowledge and business ecosystems. In relation to the success factors, they seem similar: diversity of organizations and key actors. However, regarding the factors, anchor organizations in knowledge are universities and public research organizations that do not directly compete with the ecosystem. In contrast, key actors in EEs are based on companies that are competitors in the ecosystem. Another difference lies in value creation. In knowledge ecosystems, to Clarysse et al. ( 2014 ), the value creation flows from upstream to downstream, while in EEs, the value creation process is non-linear . The author’s note that some studies already include universities as part of the knowledge system but that further research could focus on analysing the circumstances under which a university could be considered an ecosystem and how the interaction between knowledge and business ecosystems would occur. Miller and Acs ( 2017 ) explore the EE of higher education by choosing a university campus because the “entrepreneurial opportunities had been identified and/or the process of firm-formation had begun by multiple founders…” (p. 82).

Cluster 3 (Green)—Inter-institutional Relationships in University’s Ecosystem

This third cluster leads us to the wider set of relationships in the university’s ecosystem, strategies and their specificities of regional/local factors. Audretsch et al. ( 2019 ) refers that EE is a vehicle for carrying entrepreneurs, policymakers and managers of linked companies and all their relationships organizing the EE. For the author, an EE is defined by frontiers, and the necessary resources are produced and absorbed within and beyond those boundaries.

Audretsch and Belitski ( 2017 ) set out to develop a model that captured both regional and local systemic factors to better understand and explain variations in entrepreneurial activity. In their study, they found four domains under EEs in European cities: norms and culture, infrastructure and equipment, formal institutions and Internet access and connections. To Audretsch and Link ( 2017 : 431), conceptually a university represents a “reservoir of knowledge, knowledge embodied in faculty…”. Universities are one part of the complexity of the research. They have evolved towards taking an active role in regional development and the dynamics of local networks. This evolution in the model involves inter-institutional relationships between the three actors, leading to an increasing overlap of their roles. The work of Schaeffer and Matt ( 2016 ) showed that universities cannot replicate the mechanisms that lead to the success of an EE but rather adapt their strategies to the specificities of each regional context.

Can academia encompass a third mission, beyond research and teaching? This question was formulated by Etzkowitz and Leydesdorff ( 2000 : 110). Three spaces emerge from the triple helix model: the consensus space, a knowledge space (R&D activities) and innovation space.

Schaeffer and Matt ( 2016 ) state these are coordinated and managed by a regional innovation officer. The authors refer that this responsibility can be assigned to the university to contribute to developing the regional networks. They analysed the university of Strasbourg’s Technology Transfer Offices (TTO) and supported entrepreneurial academic activities over 15 years. The study reveals a strong growth in the structure of the TTO and its role as a boundary, changing objectives and developing collaborations with other regional actors. As pointed by Fini et al. ( 2011 ) and Vohora et al. ( 2004 ), since university faculty have limited entrepreneurial experience, networks with outside contacts are crucial to motivate the creation of entrepreneurial activities as well as their success.

In addition to TTOs, entrepreneurship education, either as part of the academic programme or as an extra-curricular offering, can provide students and faculty with important knowledge to stimulate and support entrepreneurial efforts (relationship to Cluster 2). While most of the study streams have focused on the role of faculty as academic entrepreneurs, Boh et al. ( 2016 ) focused on the role of students. The typology created by the authors provides insight into the various responsibilities of students and faculty in technology commercialisation. It is the different relationships between students, faculty and entrepreneurs and the analysis of the strengths and weaknesses of each that can lead to the creation of a successful spinoff. The authors, Boh et al. ( 2016 ), group into six the university practices, independent of the TTOs: project disciplines for technology commercialisation, mentoring programmes, incubator programmes, entrepreneurial business plans and entrepreneurial education for students and university professionals.

Other authors analyse the relation between social networks and academic entrepreneurship (Clarysse et al., 2011 ; Fini et al., 2011 ; Vohora et al., 2004 ), Spinoffs (Lockett & Wright, 2005 ; Fini et al, 2011 , 2017 ; Vohora et al., 2004 ; Clarysse et al., 2011 ; Hayter, 2016 ) and the entrepreneurial environment and academic programmes supporting entrepreneurship (Fini et al., 2011 ). As pointed by Fini et al. ( 2011 ) and Vohora et al. ( 2004 ), since university faculty have limited entrepreneurial experience, networks with outside contacts are crucial to motivate the creation of entrepreneurial activities as well as their success. Vohora et al. ( 2004 ) argues that networks are pathways through which access to opportunities will be achieved, for example, gaining knowledge of the market that motivates the creation of the spinoff. Hayter ( 2016 ) uses Vohora et al. ( 2004 ) qualitative model of entrepreneurial development and that includes four stages of development: opportunity recognition, commitment, credibility and sustainability, as well as the resources and network elements associated with each stage. Entrepreneurial development and its success are reflected in the progression of the university spinoff , overcoming the obstacles of each stage, with the aim of achieving entrepreneurial sustainability.

Hayter ( 2016 ), using mixed methods, compares the composition and contribution of social networks among entrepreneurial academics and analyses how these networks relate to the development trajectory of university spinoffs . The traditional definition of spinoff , according to Hayter et al. ( 2017 ) focuses on the role of faculty establishing a company based on a technology licensing agreement, with their home university. University spinoffs , for Hayter ( 2016 ), are an important vehicle for generating productivity, job creation and prosperity for regional economies. The author also mentions that spinoffs are a window through which the contributions of universities can be examined. He compares the composition and contribution of social networks among entrepreneurial academics and analyses how these networks relate to the development trajectory of university spinoffs.

Cluster Relations

The three clusters are related. The cluster 2 indicates the importance of higher education for EE and cluster 3 leads us to the triple helix model with the focus on university entrepreneurial experience. Cluster 1 introduces definitions and attributes necessaries to understand the EE and their relationship with or within the HEIs. This cluster creates a theoretical background with relevant publications in entrepreneurship research.

Clusters 2 and 3 have a robust relation. Notably, the position of Stam ( 2015 ) and Spigel ( 2017 ) influences 2 clusters, indicating higher link strength and confirming its centrality in the EE literature. Various articles from cluster 2 criticize the analytical framework that produces long lists of factors that enhance entrepreneurship. Their perspective enables researchers to measure an EE within a country or territory by considering their specificities. This understanding highlights the configuration, structure and evolution of ecosystems influenced by ecosystem process and territorial boundaries.

In cluster 3 it is evident that the challenge of the third mission that academia encompass emphasizes entrepreneurship and the corresponding emergence of the entrepreneurial university. The relationships between students, faculty and entrepreneurs and the analysis of the strengths and weaknesses of each can lead to the creation of a successful spinoff.

To understand the substance of AEE and how the broad research was advanced, the group of these three clusters creates a fundamental and theoretical base to: the terminology of EE, the higher education context and the emergence of an AEE (Fig.  6 ).

figure 6

Academic entrepreneurship ecosystem model

Contributions and Future Research Directions

The scientific literature about entrepreneurial ecosystems has been growing, and within it, one area that has been gaining impulse has been the academic ecosystem. This paper contributes by attempting to consolidate the most important of this growing literature and to try to confirm it.

This study brings important theoretical contributions to the existing literature. Firstly, this study led to a survey and mapping of the main investigations on EE and their relationship with the HEI. Secondly, this study strengthens the credibility of the AEE theoretical frameworks in lending support to the importance of analysing the specific contributions of HEIs to the development of an EE. Thirdly, the developed co-citation analysis allowed obtaining an understanding about the existing field of knowledge on EEs and AEE, identifying their scientific origins and revealing research roots.

Most contributions are conceptual providing an understanding of the different elements that form conducive AEE. Therefore, as a fourth contribution, this study emphasizes the need for more empirical research, especially regarding potential causal relations between elements, context factors, outputs and outcomes of entrepreneurial ecosystems. The few empirical studies on entrepreneurial ecosystems have majorly applied case studies including qualitative methods (Kansheba & Wald, 2020 ; Malecki, 2018 ; Nicotra et al., 2018 ). There is a need of deploying other methodological approaches for more rigor and generalizability purposes.

The above leads us to propose as possible future research directions. As mentioned, most research studies on EEs and AEEs have adopted the qualitative methodological approach (particularly case studies), which is understandable since the research topic is emergent. However, considering the systematic research conducted here, it is believed that this topic would benefit from implementing mixed methodologies (as has already been carried out by some of the authors included here). Thus, with the adoption of qualitative and quantitative methodologies, it will be attempted, in a future line of research, to build an assessment tool for an AEE.

The composition of clusters groups generated research points. Studying an AEE based on a regional scale will imply, firstly, building a theoretical framework, based on multiple dimensions, which allows the development of the EE model. HEIs are a complex process which involves an extensive research approach to accurately represent the levels and components of the entire entrepreneurial ecosystem (cluster 1). It will be necessary to study whether the HEI develops strategies adapted to the specificities of its EE. Likewise, to explore the pillars of the model from the point of view of young university students who show varying degrees of entrepreneurial intention (cluster 2). Several studies have found that entrepreneurship education has a positive impact on students’ entrepreneurial intention (Peterman & Kennedy, 2003 ; Souitaris et al., 2007 ; Pruett et al., 2009 ; Engle et al., 2010 ; Lanero et al., 2011 ; Sanchez, 2013 ; Bae et al., 2014 ; Sansone et al., 2021 ). Vanevenhoven ( 2013 ) and Fiore et al. ( 2019 ) have warned of the need for more research into the impact of entrepreneurship education on students in different contexts. Although there has been a growing number of publications on the role of intentions in the entrepreneurial process (Liñán & Fayolle, 2015 ; Ferreira-Neto et al, 2023 ), there is still a gap in research on how to improve the presence of higher education students in entrepreneurial activities so that they can face the problems of the labour market. A broader study could be undertaken, from a mixed approach, to establish mechanisms to collect appropriate data and to establish the different levels of success of EE outcomes, by the HEI (cluster 3).

Finally, the relevance of knowledge of skilled people has brought to the policy agenda of governments worldwide the need to modernize science and higher education systems and institutions (Santos et al., 2016 ; Scott, 2000 ). Portugal is characterized as a developed country but with a poorly qualified workforce in European average terms, facing structural barriers to economic growth (Carneiro et al., 2014 ). It was also a country that has seen one of the fastest developments in its scientific system at the beginning of the twenty-first century (Heitor et al., 2014 ). The emergence of the COVID-19 pandemic has brought new challenges to the country: the establishment of telework and the intense decline in economic activity were some of the most evident cross-cutting changes, with direct consequences for the emergence of new forms and policies to support the employment (Sousa & Paiva, 2023 ).

All these reasons have been supporting the need to make a RSL focused on how young graduates capture new forms and conditions of the exercise of work. This knowledge is crucial to investigate wow the entrepreneurial skills or the academic entrepreneurship path is in the future.

Conclusions and Limitations

The quest to identify and define EEs has become an issue of great importance as countries, regions and cities handle with an entrepreneurial economy. The range of these topics is wide and ambiguous. Researchers and practitioners have assessed various contributions, most of which identify HEIs as important development institutions. Marques et al., ( 2021 : 133) highlight their importance, stating that HEIs “… are seen as organizations responsible for human resource training, knowledge transfer, and regional development”.

This work used data from the Scopus and WoS databases. Based on 110 academic articles obtained through a rigorous data collection process, the study went beyond describing elementary information, standing out in relation to the review studies found and filling a gap in the field of EEs taking into consideration higher education institutions. It also revealed the embryonic state of research (2011–2022) and reinforced the scientific importance of the topic since about 56% of the articles were published in the last 3 years. The results were published in a variety of indexed journals. However, this study shows the limitations in other literature reviews.

Despite considering that this study constitutes a work that will be the object of the development in the coming years, the study is not without limitations. The first limitation concerns to the search strategy. This study is based on the regular updating of databases with the consequent increase or decrease in the number of indexed journals, so a bibliometric analysis of an emerging topic can be subject to substantial variations in just a very few years. The other limitation of this study is that it used two different databases to analyse a particular topic. Despite being two of the most influential databases, the overview could be improved by including other databases. Another limitation is the subjectivity present in the scientific articles analysis. Although bibliometric methods help to reduce subjectivity, it is not possible to completely exclude some interpretative biases.

Data Availability

Available upon reasonable request from the corresponding author.

Acs, Z. J., Autio, E., & Szerb, L. (2014). National systems of entrepreneurship: Measurement issues and policy implications. Research Policy, 43 (3), 449–476.

Article   Google Scholar  

Allahar, H., & Sookram, R. (2019). A university business school as an entrepreneurial ecosystem hub. Technology Innovation Management Review, 9 (11), 15–25.

Alvedalen, J., & Boschma, R. (2017). A critical review of entrepreneurial ecosystems research: Towards a future research agenda. European Planning Studies, 25 (6), 887–903.

Aria, M., & Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Infometrics, 11 (4), 959–975. RSL.

Astley, W. G., & Van de Ven, A. H. (1983). Central perspectives and debates in organization theory. Administrative Science Quarterly, 28 (2), 245–273. https://doi.org/10.2307/2392620

Audretsch, D., & Belitski, M. (2017). Entrepreneurial ecosystems in cities: Establishing the framework conditions. The Journal of Technology Transfer, 42 (5), 1030–1051.

Audretsch, D., Cunningham, J., Kuratko, D., Lehman, E., & Menter, M. (2019). Entrepreneurial ecosystems: Economic, technological, and societal impacts. The Journal of Technology Transfer, 44 , 313–325.

Article   PubMed   Google Scholar  

Audretsch, B., & Link, N. (2017). Universities and the entrepreneurial ecosystem (pp. 13–50). Edward Elgar.

Bae, T., Qian, S., Miao, C., & Fiet, J. (2014). The relationship between entrepreneurship education and entrepreneurial intentions: A meta-analytic review. Entrepreneurship Theory & Practice, 38 (2), 217–254.

Bischoff, K., Volkmann, C., & Audretsch, D. (2018). Stakeholder collaboration in entrepreneurship education: An analysis of the entrepreneurial ecosystems of European higher educational institutions. Journal of Technology Transfer, 43 , 20–46.

Boh, W., De-Haan, U., & Strom, R. (2016). University technology transfer through entrepreneurship: Faculty and students in spinoffs. The Journal of Technology Transfer, 41 (4), 661–669.

Breznitz, S., & Zhang, Q. (2019). Fostering the growth of student start-ups from university accelerators: An entrepreneurial ecosystem perspective. Industrial and Corporate Change, 28 (4), 855–873.

Brown, R., & Mason, C. (2017). Looking inside the spiky bits: A critical review and conceptualisation of entrepreneurial ecosystems. Small Business Economics, 49 , 11–30.

Brush, C. G. (2014). Exploring the concept of an entrepreneurship education ecosystem. In  Innovative pathways for university entrepreneurship in the 21st century  (vol. 24, pp. 25–39). Emerald Group Publishing Limited.

Carayannis, E., Grigoroudis, E., Campbell, D., Meissner, D., & Stamati, D. (2017). The ecosystem as helix: An exploratory theory-building study of regional co-opetitive entrepreneurial ecosystems as Quadruple/Quintuple Helix Innovation Models. R & D Management , 148–162.

Carneiro, A., Portugal, P., & Varejão, J. (2014). Catastrophic job destruction during the Portuguese economic crisis. Journal of Macroeconomics, 39 , 444–457.

Clarysse, B., Wright, M., & Van de Velde, E. (2011). Entrepreneurial origin, technological knowledge, and the growth of spin-off companies. Journal of Management Studies, 48 (6), 1420–1442.

Clarysse, B., Wright, M., Bruneel, J., & Mahajan, A. (2014). Creating value in ecosystems: Crossing the chasm between knowledge and business ecosystems. Research Policy, 43 (7), 1164–1176.

Cohen, B. (2006). Sustainable valley entrepreneurial ecosystems. Business Strategy Environment, 15 (1), 1–14.

Article   MathSciNet   Google Scholar  

Colombo, M. G., Dagnino, G. B., Lehmann, E. E., & Salmador, M. (2019). The governance of entrepreneurial ecosystems. Small Business Economics, 52 , 419–428.

Engle, R., Dimitriadi, N., Gavidia, J., Schlaegel, C., Delanoë-Gueguen, S., Alvarado, I., He, X., Baume, S., & Wolff, B. (2010). Entrepreneurial intent: A twelve country evaluation of Ajzen’s model on planned behavior. International Journal of Entrepreneurial Behaviour and Research., 16 , 35–57.

Etzkowitz, H., & Leydesdorff, L. (2000). The dynamics of innovation: From national systems and “mode 2” to a triple helix of university–industry–government relations. Research Policy, 29 (2), 109–123.

Etzkowitz, H., & Zhou, C. (2017). Hélice Tríplice: Inovação e Empreendedorismo Universidade-Indústria-Governo. Estudos Avançados, 31 (90), 23–48.

Feldman, M., Siegel, D. S., & Wright, M. (2019). New developments in innovation and entrepreneurial ecosystems. Industrial and Corporate Change, 28 (4), 817–826.

Ferreira, J., Fernandes, C., & Kraus, S. (2019). Entrepreneurship research: Mapping intellectual structures and research trends. Review of Managerial Science, 13 , 181–205.

Ferreira-Neto, M., de Carvalho-Castro, J., de Sousa-Filho, J., & Souza-Lessa, B. (2023). The role of self-efficacy, entrepreneurial passion, and creativity in developing entrepreneurial intentions. Frontiers in. Psychology, 14 , 1–14.

Fetters, L., Patricia, G., Mark, P., & Butler, J. (2010). The development of university-based entrepreneurship ecosystems: Global practices . Edward Elgar.

Book   Google Scholar  

Fini, R., Grimaldi, R., Santoni, S., & Sobrero, M. (2011). Complements or substitutes? The role of universities and local context in supporting the creation of academic spin-offs. Research Policy, 40 , 1113–1127.

Fini, R., Fu, K., Mathisen, M. T., Rasmussen, E., & Wright, M. (2017). Institutional determinants of university spin-off quantity and quality: A longitudinal, multilevel, cross-country study. Small Business Economics, 48 , 361–391.

Fiore, E., Sansone, G., & Paolucci, E. (2019). Entrepreneurship education in a multidisciplinary environment: Evidence from an entrepreneurship programme held in Turin. Administration Science, 9 (1), 28.

Google Scholar  

Freeman, J. H., & Audia, P. G. (2006). Community ecology and the sociology of organizations. Annual Review of Sociology, 32 , 145–169.

Graham, R. (2014). Creating university-based entrepreneurial ecosystems evidence from emerging world leaders . MIT Skoltech Initiative.

Guindalini, C., Verreyenne, M.-L., & Kastelle, T. (2021). Taking scientific inventions to market: Mapping the academic entrepreneurship ecosystem. Technological Forecasting & Social Change, 173 , 1–12.

Hallam, C., Novick, D., Gilbert, D., Frankwick, G., Wenker, O., & Zanella, G. (2017). Academic entrepreneurship and the entrepreneurial ecosystem: The UT transform project. Academy of Entrepreneurship Journal, 23 (1), 77–90.

Hayter, C. (2016). A trajectory of early-stage spinoff success: The role of knowledge intermediaries within an entrepreneurial university ecosystem. Small Business Economics, 47 , 633–656.

Hayter, C., Lubynsky, R., & Maroulis, S. (2017). Who is the academic entrepreneur? The role of graduate students in the development of university spinoffs. The Journal of Technology Transfer, 42 , 1237–1254.

Hayter, C., Nelson, A., Zayed, S., & O’Connor, A. (2018). Conceptualizing academic entrepreneurship ecosystems: A review, analysis and extension of the literature. The Journal of Technology Transfer, 43 , 1039–1082.

Heitor, M., Horta, H., & Mendonça, J. (2014). Developing human capital and research capacity: Science policies promoting brain gain. Technological Forecasting and Social Change, 82 , 6–22.

Huang, C.-K., Neylon, C., Brookes-Kenworthy, C., Hosking, R., Montgomery, L., Wilson, K., & Ozaygen, A. (2020). Comparison of bibliographic data sources: Implications for the robustness of university rankings. Quantitative Science Studies, 1 , 445–478.

Hulland, J. (2020). Conceptual review papers: Revisiting existing research to develop and refine theory. AMS Review, 10 (1–2), 27–35.

Isenberg, D. (2010). How to start an entrepreneurial revolution. Harvard Business Review, 88 (6), 40–50.

Isenberg, D. (2011). The entrepreneurship ecosystem strategy as a new paradigm for economic policy: Principles for cultivating entrepreneurship . Institute of International European Affairs.

Johnson, D., Bock, A., & George, G. (2019). Entrepreneurial dynamism and the built environment in the evolution of university entrepreneurial ecosystems. Industrial and Corporate Change, 28 (4), 941–959.

Kansheba, J., & Wald, A. (2020). Entrepreneurial ecosystems: A systematic literature review and research agenda. Journal of Small Business and Enterprise Development, 27 (6), 943–964.

Kobylinska, U., & Lavios, J. (2020). Development of research on the university entrepreneurship ecosystem: Trends and areas of interest of researchers based on a systematic review of literature. Oeconomia Copernicana, 11 (1), 117–133.

Kuratko, D. (2005). The emergence of entrepreneurship education: Development, trends, and challenges. Entrepreneurship Theory and Practice, 29 (5), 577–597.

Lanero, A., Burguete, J., Rodriguez, P., & Miguélez, M. (2011). The Impact of entrepreneurship education in European universities: An Intention-based approach analyzed in the spanish area. International Review on Public and Nonprofit Marketing, 8 (2), 111–130.

Liguori, E., Bendickson, J., Solomon, S., & McDowell, W. (2019). Development of a multi-dimensional measure for assessing entrepreneurial ecosystems. Entrepreneurship & Regional Development, 31 (1–2), 7–21.

Liñan, F., & Fayolle, A. (2015). A systematic literature review on entrepreneurial intentions: Citation, thematic analyses, and research agenda. International Entrepreneurship Management Journal, 11 , 907–933.

Lockett, A., & Wright, M. (2005). Resources, capabilities, risk capital and the creation of university spin-out companies. Research Policy, 34 , 1043–1057.

Malecki, E. (2011). Connecting local entrepreneurial ecosystems to global innovation networks: Open innovation, double networks and knowledge integration. International of Journal Entrepreneurship and Innovation Management, 14 (1), 36–59.

Malecki, E. (2018). Entrepreneurship and entrepreneurial ecosystems. Geography Compass, 12 , 1–21.

Marques, C., Marques, A., Braga, V., & Ratten, V. (2021). Technological transfer and spillovers within the RIS3 entrepreneurial ecosystems: A quadruple helix approach. Knowledge Management Research & Practice, 19 (1), 127–136.

Mason, C., & Brown, R. (2014). Entrepreneurial ecosystems and growth oriented entrepreneurship . OECD LEED Programme. Dutch Ministry of Economic Affairs.

Meyer, M. H., Lee, C., Kelley, D., & Collier, G. (2020). An assessment and planning methodology for university-based: Entrepreneurship ecosystems. The Journal of Entrepreneurship, 29 (2), 259–292.

Miller, J. D., & Acs, J. Z. (2017). The campus as entrepreneurial ecosystem: The university of chicago. Small Business Economic, 49 , 75–95.

Neck, H., Meyer, G., Cohen, B., & Corbett, A. (2004). An entrepreneurial system view of new venture creation. Journal of Small Business Management, 42 , 190–208.

Nicotra, M., Romano, M., Giudice, M., & Scillaci, C. (2018). The causal relation between entrepreneurial ecosystem and productive entrepreneurship: A measurement framework. Journal of Technology Transfer, 43 , 640–673.

O’Brien, E., Cooney, T. M., & Blenker, P. (2019). Expanding university entrepreneurial ecosystems to under-represented communities. Journal of Entrepreneurship and Public Policy, 8 (3), 384–407.

Pita, M., Costa, J., & Moreira, A. C. (2021). The effect of university missions on entrepreneurial initiative across multiple entrepreneurial ecosystems: Evidence from Europe. Education Sciences, 11 (12), 762.

Peterman, N. E., & Kennedy, J. (2003). Enterprise education: Influencing students’ perceptions of entrepreneurship. Entrepreneurship theory and practice, 28 (2), 129–144.

Pranckuté, R. (2021). Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications, 9 , 12. https://doi.org/10.3390/publications9010012

Prokop, D., & Thompson, P. (2023). Defining networks in entrepreneurial ecosystems: The openness of ecosystems. Small Business Economics, 61 , 517–538.

Pruett, M., Shinnar, R., Toney, B., Llopis, F., & Fox, J. (2009). Explaining entrepreneurial intentions of university students: A cross-cultural study. International Journal of Entrepreneurial Behaviour & Research, 15 (6), 571–594.

Sanchez, J. C. (2013). The impact of an entrepreneurship education program on entrepreneurial competencies and intention. Journal of Small Business Management, 51 (3), 447–465.

Sansone, G., Ughetto, E., & Landoni, P. (2021). Entrepreneurial intention: An analysis of the role of student-led entrepreneurial organizations. Journal of International Entrepreneurship, 19 (3), 399–433.

Santos, S., Costa, S., Neumeyer, X., & Caetano, A. (2016). Bridging entrepreneurial cognition research and entrepreneurship education: What and how. Annals of Entrepreneurship Education and Pedagogy , 83–108.

Scott, P. (2000). Globalisation and higher education: challenges for the 21st century. Journal of Studies in International Education, 4 , 3–10.

Schaeffer, V., & Matt, M. (2016). Development of academic entrepreneurship in a non-mature context: The role of the university as a hub-organisation. Entrepreneurship & Regional Development, 28 (9–10), 724–745.

Secundo, G., Mele, G., Del Vecchio, P., & Degennaro, G. (2021). Knowledge spillover creation in university-based entrepreneurial ecosystem: The role of the Italian “contamination labs.” Knowledge Management Research & Practice, 19 (1), 137–151.

Sherwood, A. (2018). Universities and the entrepreneurship ecosystem. In S. Globerman, & J. Clemens (Eds),  Demographics and entrepreneurship. Mitigating the effects of an aging population (239–282). Fraser Institute.

Sousa, L., & Paiva, T. (2023). Work risks in pandemic times. EDULEARN23 Proceedings , 526–535.

Souitaris, V., Zerbinati, S., & Al-Laham, A. (2007). Do entrepreneurship programmes raise entrepreneurial intention of science and engineering students? the effect of learning, inspiration and resources. Journal of Business Venturing, 22 , 566–591.

Spigel, B. (2017). The relational organization of entrepreneurial ecosystems. Entrepreneurship Theory and Practice, 41 (1), 49–72. https://doi.org/10.1111/etap.12167

Spigel, B., & Harrison, R. (2018). Toward a process theory of entrepreneurial ecosystems. Strategic Entrepreneurship Journal, 12 (1), 151–168. https://doi.org/10.1002/sej.1268

Spigel. (2018). Envisioning a new research agenda for entrepreneurial ecosystems: Top-down and bottom-up approaches. In J. A. Katz, & A. C. Corbett (Eds.), Reflections and extensions on key papers of the first twenty-five years of advances (advances in entrepreneurship, firm emergence and growth) (Vol. 20, pp. 127–147), Emerald Publishing Limited. https://doi.org/10.1108/S1074-754020180000020004

Stam, E. (2015). Entrepreneurial ecosystems and regional policy: A sympathetic critique. European Planning Studies, 23 (9), 1759–1769.

Stam, E., & Spigel, B. (2017). Entrepreneurial ecosystems. In R. Blackburn, D. De Clercq, J. Heinonen (Eds.), The Handbook for entrepreneurship and small business and entrepreneurship . SAGE.

Thelwall, M. (2008). Bibliometrics to webometrics. Journal of Information Science, 34 , 605–621.

Theodoraki, C., Messeghem, K., & Rice, M. (2018). A social capital approach to the development of sustainable entrepreneurial ecosystems: An explorative study. Small Business Economics, 51 , 153–170.

Van de Ven, A. H. (1993). The development of an infrastructure for entrepreneurship. Journal of Business Venturing, 8 , 211–230.

Vanevenhoven, J. (2013). Advances and challenges in entrepreneurship education. Journal of Small Business Management, 51 (3), 466–470.

Vohora, A., Wright, M., & Lockett, A. (2004). Critical junctures in the development of university high-tech spinout companies. Research Policy, 33 , 147–175.

Wang, X., Sun, X., Liu, S., & Mu, C. (2021). A preliminary exploration of factors affecting a university entrepreneurship ecosystem. Frontiers in Psycology, 12 , 1–12.

Yi, G. & Uyarra, E. (2018). Process mechanisms for academic entrepreneurial ecosystems: Insights from a case study in China. Science, Technology & Society, 23 (1), 85–106. RSL.

Download references

Open access funding provided by FCT|FCCN (b-on). This research is supported by national funds, through the FCT–Portuguese Foundation for Science and Technology under the project UIDB/04011/2020 ( https://doi.org/10.54499/UIDB/0401 1/2020), and by NECE-UBI, Research Centre for Business Sciences, Research Centre under the project UIDB/04630/2022 and by CEECINST/00127/2018/CP1501/CT0010.

Author information

Authors and affiliations.

Instituto Politécnico de Bragança – ESACT, Mirandela, Portugal

Maria Patrocínia Correia

CETRAD Rearch Unit and University of Trás-os-Montes e Alto Douro and NECE Research Center for Business Sciences, Vila Real, Portugal

Maria Patrocínia Correia, Carla Susana Marques & Rui Silva

Faculty of Business and Economics, South East European University, Tetovo, North Macedonia

Veland Ramadani

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Carla Susana Marques .

Ethics declarations

Conflict of interest.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Correia, M.P., Marques, C.S., Silva, R. et al. Academic Entrepreneurship Ecosystems: Systematic Literature Review and Future Research Directions. J Knowl Econ (2024). https://doi.org/10.1007/s13132-024-01819-x

Download citation

Received : 20 June 2023

Accepted : 02 February 2024

Published : 16 February 2024

DOI : https://doi.org/10.1007/s13132-024-01819-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Academic entrepreneurship
  • Entrepreneurial ecosystems
  • Higher education institutions
  • Universities
  • Bibliometric analysis
  • Systematic literature review

Advertisement

  • Find a journal
  • Publish with us
  • Track your research

Log in using your username and password

  • Search More Search for this keyword Advanced search
  • Latest content
  • For authors
  • Browse by collection
  • BMJ Journals More You are viewing from: Google Indexer

You are here

  • Volume 14, Issue 2
  • Protocol for a scoping review to identify research reporting on eating disorders in minority ethnic populations in the UK, Canada, Australia and New Zealand
  • Article Text
  • Article info
  • Citation Tools
  • Rapid Responses
  • Article metrics

Download PDF

  • http://orcid.org/0000-0003-1636-8187 Helena Tuomainen 1 ,
  • Rose McGowan 1 ,
  • Aliyah Williams-Ridgway 1 ,
  • Katie Guy 2 ,
  • Sheryllin McNeil 2
  • 1 University of Warwick , Coventry , UK
  • 2 Birmingham Women’s and Children’s Hospitals NHS Foundation Trust , Birmingham , UK
  • Correspondence to Dr Helena Tuomainen; helena.tuomainen{at}warwick.ac.uk

Introduction Eating disorders (EDs) are common, severe and often life-threatening psychiatric conditions. Notwithstanding stereotypes, EDs affect individuals from all racial and ethnic backgrounds. However, despite similar and in some cases increased prevalence of disordered eating and EDs among minority ethnic groups, there appear to be disparities when it comes to ED diagnosis and treatment. To date, most of the existing literature exploring disordered eating and EDs among minority ethnic groups has been conducted in the USA. The present scoping review aims to examine the extent, range and nature of research activity into disordered eating and EDs in the UK, Canada, Australia and New Zealand providing a comprehensive overview of the existing literature. A special focus will be placed on studies exploring prevalence, access to care and treatment experiences.

Methods and analysis The scoping review framework first outlined by Arksey and O’Malley and improved on by Levac et al was used to guide the development of this scoping review protocol. A detailed systematic search of relevant databases (Medline, EMBASE, PsycINFO, CINAHL and Web of Science) will be conducted. Relevant literature will also be identified from the reference lists of included studies. Two reviewers will independently screen titles and abstracts and full-texts against specified inclusion and exclusion criteria. A third reviewer will resolve disagreements if necessary. Relevant data will be extracted using a data charting form. Quantitative and qualitative summaries of extracted data will be provided.

Ethics and dissemination No ethical approval is required for this study. Findings will be of benefit to researchers, clinicians and policy-makers by highlighting areas for future research and identifying ways to making ED treatment more accessible for individuals from all backgrounds. Findings will be disseminated via conferences, presentations and peer-reviewed journals.

  • Eating disorders
  • Health Services Accessibility
  • Systematic Review

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See:  https://creativecommons.org/licenses/by/4.0/ .

https://doi.org/10.1136/bmjopen-2023-075034

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

This protocol will ensure transparency in methodology to reduce the likelihood of reviewing bias.

Studies conducted in non-Western, low-income or middle-income countries will not be included in this review.

There will be no quality assessment of the included studies.

Only studies published in English will be included.

Introduction

Eating disorders (EDs) are complex psychiatric conditions characterised by disordered eating and/or weight-control behaviours, 1 which typically have their onset during adolescence. 2 A recent systematic review reported a pooled global lifetime and 12-month prevalence of EDs of 0.91% and 0.43%, respectively. 3 EDs have profound physical and psychological impacts on the affected individual and those around them. EDs have high comorbidity with other psychiatric conditions and are associated with suicidal thoughts and attempts. 4 5 The medical complications that often accompany EDs involve almost all organ systems and can be life-threatening, 6 leading to significantly increased mortality rates. 7 Given the negative consequences of EDs, it is imperative that we understand their prevalence and treatment within and across ethnic groups.

Despite the prevailing stereotype that EDs only affect ‘skinny, White, affluent girls’ (the SWAG stereotype), 8 it is widely reported that EDs affect individuals from all racial and ethnic backgrounds. 9 However, findings regarding the prevalence of disordered eating and EDs across ethnic groups are mixed. Some studies report no difference in disordered eating and ED prevalence across different ethnic groups. 10–12 Others, however, have reported higher prevalence of disordered eating among minority ethnic men and women relative to White individuals. 13 In contrast, some studies have found higher prevalence of EDs in White adults when compared with other racial and ethnic groups. 8 14 15 Reported prevalence seems to vary based on the racial or ethnic group and type of disordered eating or ED being studied. 9 Differences in study design and diagnostic criteria used may also contribute to differences in reported prevalence. 11

Despite similar and in some cases increased rates of disordered eating and EDs among minority ethnic groups there appear to be disparities when it comes to ED diagnosis and treatment. In their systematic review, Sinha and Warfa 16 found minority ethnic individuals in the UK and the USA were less likely to seek and receive ED treatment as well as less frequently diagnosed and referred to specialist ED services. Since publication of this review, further studies have replicated these findings. 8 17 18 Such disparities in diagnosis and treatment have been attributed to a lack of perceived need for treatment among these populations, 8 differences in symptom presentation 18 and culturally insensitive diagnostic criteria. 19

To date, most of the existing literature exploring disordered eating and EDs among minority ethnic groups has been conducted in the USA. This is apparent in recent narrative and systematic reviews which have explored the identification, prevalence, presentation, risk factors and treatment of disordered eating and EDs among minority racial and ethnic populations. 9 16 20–23 The overwhelming majority of studies included in these reviews have been conducted in the USA.

Researchers have called for more research exploring ethnic and racial diversity in EDs to be conducted outside of the USA. 24 The generalisability of findings from studies conducted in the USA to countries with different healthcare systems and sociocultural and environmental contexts has been questioned. 11 25 Franko and Rodgers 26 also argue research outside of the USA is necessary to fully understand the extent of similarities and differences within and across ethnic groups.

The present scoping review aims to identify and describe studies reporting on disordered eating and EDs in minority ethnic groups in the UK, Canada, Australia and New Zealand; to our knowledge, this will be the first review to do so. These countries have large established minority ethnic populations due to high levels of immigration and/or the forced displacement of Indigenous peoples, as well as broadly comparable healthcare systems. By providing a broad overview of the extent, range and nature of existing research conducted in these countries we hope to elucidate any knowledge gaps to inform future research. This is crucial considering the identified need for more research exploring racial and ethnic differences in EDs outside of the USA. 24

Given the well-documented racial and ethnic health disparities in the diagnosis and treatment of EDs 16 and mental health conditions more broadly, 27 a special focus will be placed on studies which have reported on the prevalence of disordered eating and EDs, access to care and treatment experiences among minority ethnic groups. Such studies will be particularly relevant in identifying any health disparities in the countries of focus and highlighting possible ways to overcome these. This is of particular importance given prompt diagnosis and intervention can improve ED treatment outcomes and recovery prospects. 28

In this scoping review, we aim to examine the extent, range and nature of research activity into disordered eating and EDs among minority ethnic populations in the UK, Canada, Australia and New Zealand. The specific objectives are to:

Map the literature according to the main themes/topics addressed, target populations and methodologies used.

Report on findings regarding ED prevalence, access to care and treatment experiences.

Identify gaps and/or limitations in the literature and suggest areas for future research.

Methods and analysis

Protocol design.

A scoping review was chosen as the most appropriate methodology. Scoping reviews are suited to answering broad research questions and are designed to identify the types of evidence available in a field, examine how this research has been conducted and highlight any knowledge gaps. 29 The present scoping review will follow the five-stage framework first outlined by Arksey and O’Malley 30 and subsequently improved by Levac et al . 31 The stages are as follows: (1) identifying the research questions; (2) identifying the relevant literature; (3) selecting studies; (4) charting the data and (5) collating, summarising and reporting the results. To ensure the quality of the scoping review, the development and reporting of this protocol followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines. 32 The protocol for this scoping review is also registered on OSF ( https://osf.io/w3d6g ). Any changes made as part of the iterative nature of the scoping review will be documented here.

Stage 1: identifying the research questions

The first stage of a scoping review is to develop research questions which are informed by the purpose and objectives of the scoping review. 31 Based on the aforementioned objectives of this scoping review, we have formulated six research questions. These are described in further detail below. Given the iterative nature of scoping reviews, a reflexive approach will be adopted. If necessary, as we become more familiar with the existing literature our research questions will be refined and modified accordingly.

Question 1: what topics are being addressed by the current literature?

Within the USA, studies have explored the identification, prevalence, presentation, risk factors and treatment of EDs among minority racial and ethnic groups. For each study included in this scoping review, we will report on the primary focus of the study. By doing so, we hope to provide a summary of the themes/topics that have been addressed by the current literature on disordered eating and EDs among minority ethnic populations in the UK, Canada, Australia and New Zealand.

Question 2: how has this research been conducted?

This research question aims to explore how the included studies have been designed and conducted. For each study, we will report the research design and methodology used to answer research questions.

Question 3: which populations have been targeted for this research?

By answering this question, we hope to provide an overview of which groups and populations have been studied. We will report on key participant characteristics (e.g., age, gender, socioeconomic status, comorbidities) and examine which ethnic groups and types of disordered eating or EDs have been studied. We also aim to explore how and where participants were recruited (e.g., sampling technique, clinical or non-clinical sample, sample size).

Question 4: are there differences in reported ED prevalence across ethnicity?

This question aims to assess whether reported prevalence rates of disordered eating and EDs differ across ethnic groups.

Question 5: are there differences in access to ED treatment across ethnic groups?

To answer this question, we will extract and analyse data from studies which have reported findings regarding any of the following: referrals to ED services, service utilisation, barriers to care or help-seeking (or treatment seeking).

Question 6: do ED treatment experiences differ across ethnic groups?

The purpose of this question is to assess what is currently known regarding the treatment experiences of minority ethnic patients. We will aim to explore how minority ethnic individuals and/or stakeholders involved in the delivery or receipt of their treatment (e.g., clinicians, family members) describe their experiences of treatment. We will also aim to identify the types of treatment that have been used in minority ethnic populations.

Stage 2: identifying the relevant literature

Information sources.

The second stage of a scoping review is to identify relevant studies for selection and data extraction. This will involve a systematic search of the following electronic databases: (1) Medline, (2) PsycINFO, (3) EMBASE, (4) CINAHL and (5) Web of Science. To ensure the search is as comprehensive as possible, backwards citation chaining of included studies will be used to identify any additional studies of relevance. For the sake of completeness, a web search using Google Scholar will also be completed. Both published and grey literature (e.g., theses) will be considered for inclusion.

Search strategy

The search strategy was developed by members of the research team (HT, SM and RM) in collaboration with a speciality academic support librarian. Search terms include keywords and terms related to (1) EDs and (2) ethnicity. See online supplemental appendix 1 for the search strategy for each of the databases. No date limits will be applied to the search results, but the database search query will be set to produce articles in English only due to resource constraints.

Supplemental material

The search results for each database will be documented and references will be imported into the citation management system EndNote, where duplicates will be removed before studies are screened for inclusion.

Stage 3: selecting studies

The process of selecting studies will consist of two stages: (1) title and abstract screening and (2) full-text screening. Each stage will involve two reviewers independently screening the identified studies against the inclusion and exclusion criteria. All screening will be conducted using the online screening tool Rayyan.

In the first round of screening, two reviewers (RM and HT) will review paper titles and abstracts. Papers will be categorised as either ‘include’, ‘exclude’ or ‘maybe’. Decisions as to whether papers are eligible for full-text review will be made as follows: (1) if both reviewers agree to ‘include’, the study will move on to the second screening; (2) if both reviewers agree to ‘exclude’, the study will not be read in full and will be excluded from the review and (3) if the reviewers are not unanimous in their decisions, the study will move onto the second screening to be read in full before a final decision is made. Where a paper abstract is unavailable, papers will be assigned to the ‘maybe’ category and automatically move on to the second stage of screening to be read in full. Eligibility criteria will be further refined and finalised following the first round of screening if necessary.

In the second round of screening, two reviewers (AW-R and HT) will read the remaining articles in full to determine whether they meet the inclusion criteria. If the decision to include or exclude is not unanimous, both reviewers will assess the study together and discuss disagreements. A third reviewer (SM) may be consulted for arbitration of any conflicting decisions. A flow chart outlining decisions made regarding study inclusion will be produced using the PRIMSA template. 33

Eligibility criteria

Eligibility criteria were developed using the Population, Concept, Context framework 34 (see table 1 ). Inclusion and exclusion criteria are further detailed below (see table 2 ).

  • View inline

Core elements of the scoping review based on Population Concept, Context framework

Inclusion and exclusion criteria

Stage 4: charting the data/data extraction

Once studies have been identified for final inclusion, data from these studies will be extracted and charted. A comprehensive data charting form will be developed in Excel and used to extract relevant information from studies. Two reviewers (AW-R and HT) will pilot the data charting form on a sample of randomly selected papers (10% of included papers). Any discrepancies or uncertainties highlighted by this exercise will be discussed and the charting form will be adjusted accordingly. One reviewer (AW-R) will extract the data from the remaining papers. The research team will meet regularly throughout the data extraction process to discuss progress and further changes to the data extraction form will be made as needed in an iterative process. For example, additional categories of interest may emerge. Any changes made and the rationale for doing so will be reported in final scoping review findings.

Data to be extracted will include some standard information about the paper. For example, study title, author(s), year of publication and country of publication. Additional information specific to our research questions will also be extracted. This will include the study aims/objectives, research focus/topic, study design and methodology, sample characteristics and demographics (e.g., age, gender, ED diagnosis, ethnicity, sample size), setting in which the study was conducted (e.g., clinical or non-clinical setting), summary of relevant findings and recommendations of the author(s) if applicable. In line with guidance on conducting scoping reviews, there will be no critical appraisal of the included studies. 32

Stage 5: collating, summarising and reporting the results

Rather than meta-synthesis or critical appraisal of studies, the purpose of a scoping review is to provide an overview of the existing literature, summarising what is already known and identifying any knowledge gaps. 29 The extracted data will be summarised in a way that maps the extent, range and nature of research into disordered eating and EDs among minority ethnic populations in the UK, Canada, Australia and New Zealand, while placing particular focus on ethnic differences in prevalence, access to care and treatment experiences.

We will provide a descriptive numerical summary of the characteristics of included studies. Studies will be classified and grouped according to their characteristics. Extracted data will be presented in tables, charts and visual maps. To accompany tabular and visual summaries, we will also provide a qualitative narrative summary of the data and how it relates to our research questions. If data and resources permit, qualitative findings relating to treatment experiences of minority ethnic individuals will be synthesised following Thomas and Harden’s 35 thematic synthesis approach. Thematic synthesis adapts the key principles of thematic analysis 36 for use in reviews. The aim of the analysis is to identify and interpret themes/patterns across papers. This is done across three stages (1) line-by-line coding of the results section; (2) organising codes into descriptive themes and (3) generation of analytical themes. 35 If conducted, further details on this analysis procedure will be provided in the final review. Finally, informed by any significant gaps and/or limitations of the literature, we will recommend avenues for future research. The scoping review findings will also be discussed in relation to clinical practice and policy. Reporting of the results will follow PRISMA ScR guidelines. 32

Ethics and dissemination

As scoping reviews involve the methodological examination and integration of existing literature and resources, ethical approval is not required. Once all stages of the scoping review are complete, findings will be disseminated via conferences, presentations and the submission of the final review for peer-reviewed publication.

Patient and public involvement

Patients or the public have not been involved in the design, conduct, reporting or dissemination plans of this scoping review.

Ethics statements

Patient consent for publication.

Not applicable.

Acknowledgments

The authors thank Samantha Johnson, Academic Support Librarian, for assisting in the search strategy.

  • American Psychiatric Association
  • Tortorella A ,
  • Manchia M , et al
  • Liu F , et al
  • Chamay-Weber C ,
  • Narring F ,
  • Lewinsohn PM ,
  • Striegel-Moore RH ,
  • Voderholzer U ,
  • Correll CU , et al
  • van Hoeken D ,
  • Sonneville KR ,
  • Rodgers RF ,
  • Fuller-Marashi L , et al
  • Hatch SL , et al
  • Marques L ,
  • Alegria M ,
  • Becker AE , et al
  • Anderson LM , et al
  • Kraemer HC , et al
  • Coffino JA ,
  • Hotopf M , et al
  • Lee-Winn A ,
  • Mendelson T ,
  • Cowell MM ,
  • Mazzeo SE , et al
  • Siegfried N , et al
  • Deitsch T , et al
  • Shekriladze I ,
  • Javakhishvili N , et al
  • Egbert AH ,
  • Williams KL , et al
  • Mikhail ME ,
  • Franko DL ,
  • McGuire TG ,
  • Linardon J ,
  • Rodgers RF , et al
  • Peters MDJ ,
  • Stern C , et al
  • Colquhoun H ,
  • Tricco AC ,
  • Zarin W , et al
  • Liberati A ,
  • Tetzlaff J , et al
  • Aromataris E ,
  • United Nations
  • Krentz EM ,
  • Warschburger P

Supplementary materials

Supplementary data.

This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

  • Data supplement 1

Contributors HT and SM were involved in the initial conception of the review. HT is responsible for the design of the review. RM aided with the design of the review and drafted the first manuscript. AW-R revised the manuscript making critical edits. KG contributed meaningfully to the drafting and editing of the manuscript. All authors read and approved the final manuscript.

Funding This research is funded by the National Institute for Health and Care Research (NIHR) Applied Research Collaboration (ARC) West Midlands (grant number NIHR200165).

Disclaimer The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

Competing interests None declared.

Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review Not commissioned; externally peer reviewed.

Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Read the full text or download the PDF:

IMAGES

  1. How to Write a Literature Review Complete Guide

    uses of literature review in research methodology

  2. The Importance of Literature Review in Scientific Research Writing

    uses of literature review in research methodology

  3. what are the different types of literature reviews used in research

    uses of literature review in research methodology

  4. research literature review example

    uses of literature review in research methodology

  5. review of related literature in research process

    uses of literature review in research methodology

  6. What is Literature Review in Research Methodology?

    uses of literature review in research methodology

VIDEO

  1. Systematic literature review

  2. Write Your Literature Review FAST

  3. Research Methods: Writing a Literature Review

  4. What is Literature Review?

  5. Literature Review Research Methodology

  6. Literature Review In ONE Day

COMMENTS

  1. Literature review as a research methodology: An overview and guidelines

    In addition, a literature review is an excellent way of synthesizing research findings to show evidence on a meta-level and to uncover areas in which more research is needed, which is a critical component of creating theoretical frameworks and building conceptual models.

  2. How to Write a Literature Review

    Example literature review #2: "Literature review as a research methodology: An overview and guidelines" (Methodological literature review about interdisciplinary knowledge acquisition and production.) Example literature review #3: "The Use of Technology in English Language Learning: ...

  3. Literature Review Research

    Literature Review is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.

  4. Methodological Approaches to Literature Review

    A literature review is defined as "a critical analysis of a segment of a published body of knowledge through summary, classification, and comparison of prior research studies, reviews of literature, and theoretical articles." (The Writing Center University of Winconsin-Madison 2022) A literature review is an integrated analysis, not just a summa...

  5. Writing a Literature Review

    A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research ...

  6. PDF METHODOLOGY OF THE LITERATURE REVIEW

    The literature review represents a method because the literature reviewer chooses from an array of strategies and procedures for identifying, recording, understanding, meaning-making, and transmitting information pertinent to a topic of interest.

  7. Chapter 9 Methods for Literature Reviews

    Among other methods, literature reviews are essential for: (a) identifying what has been written on a subject or topic; (b) determining the extent to which a specific research area reveals any interpretable trends or patterns; (c) aggregating empirical findings related to a narrow research question to support evidence-based practice; (d) generat...

  8. 5. The Literature Review

    Definition A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated.

  9. Reviewing the research methods literature: principles and strategies

    The conventional focus of rigorous literature reviews (i.e., review types for which systematic methods have been codified, including the various approaches to quantitative systematic reviews [ 2 - 4 ], and the numerous forms of qualitative and mixed methods literature synthesis [ 5 - 10 ]) is to synthesize empirical research findings from multip...

  10. Reviewing literature for research: Doing it the right way

    Review of research literature can be summarized into a seven step process: (i) Selecting research questions/purpose of the literature review (ii) Selecting your sources (iii) Choosing search terms (iv) Running your search (v) Applying practical screening criteria (vi) Applying methodological screening criteria/quality appraisal (vii) Synthesizin...

  11. Guidance on Conducting a Systematic Literature Review

    Literature review is an essential feature of academic research. Fundamentally, knowledge advancement must be built on prior existing work. To push the knowledge frontier, we must know where the frontier is. By reviewing relevant literature, we understand the breadth and depth of the existing body of work and identify gaps to explore.

  12. Reviewing research methodologies

    Research methodology is the specific strategies, processes, or techniques utilised in the collection of information that is created and analysed. The methodology section of a research paper, or thesis, enables the reader to critically evaluate the study's validity and reliability by addressing how the data was collected or generated, and how ...

  13. Literature Review

    Definition Literature Review A literature review is a discussion of the literature (aka. the "research" or "scholarship") surrounding a certain topic. A good literature review doesn't simply summarize the existing material, but provides thoughtful synthesis and analysis.

  14. Getting started

    What is a literature review? Definition: A literature review is a systematic examination and synthesis of existing scholarly research on a specific topic or subject. Purpose: It serves to provide a comprehensive overview of the current state of knowledge within a particular field. Analysis: Involves critically evaluating and summarizing key findings, methodologies, and debates found in ...

  15. (PDF) Literature review as a research methodology: An overview and

    This paper discusses literature review as a methodology for conducting research and offers an overview of different types of reviews, as well as some guidelines to how to both conduct and...

  16. (PDF) Literature Review as a Research Methodology: An overview and

    This paper draws input from a study that employed a systematic literature review as its main source of data. A systematic review can be explained as a research method and process for identifying ...

  17. Literature Review

    January 4, 2024 by Muhammad Hassan Table of Contents Literature Review Definition: A literature review is a comprehensive and critical analysis of the existing literature on a particular topic or research question.

  18. Steps in Conducting a Literature Review

    A literature review is an integrated analysis-- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

  19. Research Methods: Literature Reviews

    Scoping Reviews Systematic Reviews Scholarship of Teaching and Learning Persuasive Arguments Subject Specific Methodology Definition A literature review involves researching, reading, analyzing, evaluating, and summarizing scholarly literature (typically journals and articles) about a specific topic.

  20. PDF Literature Reviews: Methods and Applications

    This type of review requires attention to non-biased analysis of the literature by use of a defined scientific method, such as described within the PRISMA Statement.1 Systematic reviews require minimization of error both in conduct of the review and within the literature included within the review.

  21. Types of Literature Review

    Theoretical literature reviews play an instrumental role in establishing what theories already exist, the relationships between them, to what degree existing theories have been investigated, and to develop new hypotheses to be tested.

  22. Approaching literature review for academic purposes: The Literature

    A sophisticated literature review (LR) can result in a robust dissertation/thesis by scrutinizing the main problem examined by the academic study; anticipating research hypotheses, methods and results; and maintaining the interest of the audience in how the dissertation/thesis will provide solutions for the current gaps in a particular field.

  23. The Literature Review

    A literature review is a survey of everything that has been written about a particular topic, theory, or research question. The word "literature" means "sources of information". The literature will inform you about the research that has already been conducted on your chosen subject. This is important because we do not want to repeat ...

  24. A practical guide to data analysis in general literature reviews

    A general literature review starts with formulating a research question, defining the population, and conducting a systematic search in scientific databases, steps that are well-described elsewhere. 1, 2, 3 Once students feel confident that they have thoroughly combed through relevant databases and found the most relevant research on the topic, ...

  25. Research Guides: Literature Reviews: Concept Mapping

    A concept map or mind map is a visual representation of knowledge that illustrates relationships between concepts or ideas. It is a tool for organizing and representing information in a hierarchical and interconnected manner. At its core, a concept map consists of nodes, which represent individual concepts or ideas, and links, which depict the relationships between these concepts.

  26. Free Research Paper Template (Word Doc & PDF)

    If you're preparing to write an academic research paper, our free research paper template is the perfect starting point. In the template, we cover every section step by step, with clear, straightforward explanations and examples.. The template's structure is based on the tried and trusted best-practice format for formal academic research papers. The template structure reflects the overall ...

  27. Rapid reviews methods series: guidance on rapid qualitative evidence

    This paper forms part of a series of methodological guidance from the Cochrane Rapid Reviews Methods Group and addresses rapid qualitative evidence syntheses (QESs), which use modified systematic, transparent and reproducible methodsu to accelerate the synthesis of qualitative evidence when faced with resource constraints. This guidance covers the review process as it relates to synthesis of ...

  28. Academic Entrepreneurship Ecosystems: Systematic Literature Review and

    Research on the entrepreneurship ecosystem, based on different data and scales, limits the acceptance of a single definition. This conceptual limitation and the still recent research and higher education institutions have come to be seen as ecosystems associated with entrepreneurship. The aim of this study is to contribute to the field of knowledge, identify current and emerging thematic areas ...

  29. Protocol for a scoping review to identify research reporting on eating

    Methods and analysis The scoping review framework first outlined by Arksey and O'Malley and improved on by Levac et al was used to guide the development of this scoping review protocol. ... of scoping reviews, a reflexive approach will be adopted. If necessary, as we become more familiar with the existing literature our research questions ...