Tag Archives: Systematic Review

Systematic Reviews: five frequently asked questions

Posted on by
Reply

When the Academic Support Librarians provide help for students and researchers who are conducting large-scale reviews, such as systematic and scoping reviews, we find that often the same questions will come up. This blog post aims to answer five of your frequently asked questions about systematic reviews and provide some useful resources for you to explore further.

For even more advice about systematic review guidance, see the library’s subject guide on systematic reviews and LibSmart II: Literature Searching for Systematic Reviews.

Now let’s dive in to five Frequently Asked Questions…

1. What is a systematic review, and how does it differ from other types of literature review?

A funnel.

Image by Mugé from Pixabay

According to the Cochrane Collaboration, a leading group in the production of evidence synthesis and systematic reviews;

systematic reviews are large syntheses of evidence, which use rigorous and reproducible methods, with a view to minimise bias, to identify all known data on a specific research question.1

This is done by a large, complex literature search in databases and other sources, using multiple search terms and search techniques.

Traditional literature reviews, such as the literature review chapter in a dissertation, don’t usually apply the same rigour in their methods because, unlike systematic reviews, synthesise all known data on a topic. Literature reviews can provide context or background information for a new piece of research, or can stand alone as a general guide to what is already known about a particular topic2.

What about scoping reviews?

There are other review types in the systematic review “family”3. You may have also heard of scoping reviews. These are similar to systematic reviews, in that they employ transparent reporting of reproducible methods and synthesise evidence, but they do so in order to identify knowledge gaps, scope a body of literature, clarify concepts or to investigate research conduct4. Literature searching for scoping reviews will be similarly comprehensive, but may be more iterative than in systematic reviews.

Useful resources:

 

2. Which databases should I use?

Choosing appropriate databases in which to search is important, as it determines the comprehensiveness of your review. Using multiple databases means you are searching across a wider breadth of literature, as different databases will index different journals.

The list of Databases by Subject and the library subject guides can guide you to key databases for your topic.

To get an idea which databases are best suited to yield the data you need, you can also look at published systematic reviews on similar topics to yours, to see which databases those authors used.

The number of databases you use to search will vary depending on the research query, but it is important to use multiple databases to mitigate database bias and publication bias. More important than the number of databases is using the appropriate databases for the subject to find all the relevant data.

Useful resources:

 

3. What is grey literature and how do I find it?

You may have read that you should include grey literature in your sources of data for your review.

The term ‘grey literature’ refers to a wide range of information which is not formally or commercially published, and which is often not well represented in library research databases.

Using grey literature will help you to find current and emerging research, to broaden your research, and to mitigate against publication bias.

Sources and types of grey literature will vary between research topics. Some examples include:

  • Clinical trials
  • Conference papers and proceedings
  • Datasets
  • Dissertations and theses
  • Government documents and reports

 
  • NGOs documents and reports
  • Patents
  • Policy statements
  • Pre-prints
  • Statistical reports
  • White papers, working papers

Key sources of grey literature

Finding grey literature can be tricky because it can vary a lot in type and where it’s published. To help you, the Library’s subject guide has some key sources of grey literature to explore. The Library also has several databases which include records of dissertations and theses, which can be a source of relevant data for your review.

Another useful approach is using a domain search in Google to search within the websites of key organisations or professional bodies in your subject. For example, searching site: followed by a domain in Google:

site:who.int will search within the WHO website.

site:gov.uk will search only websites with a url that ends .gov.uk

 

4. How do I translate searches between databases?

Illustration of two screens.

Image by 200 Degrees from Pixabay

You may have heard that you need to ‘translate’ your search. This simply means taking the search you have developed in the database and optimising it to work best in a different database.

The way you tell a database to search for a term in the title of the record, or the command for searching for terms in close proximity to each other, will be different between databases and platforms.

For example, in the medical literature database Ovid Medline, the search for a subject heading on gestational diabetes is Diabetes, Gestational/ whereas the nursing database EbscoHost CINAHL uses MH “Diabetes Mellitus, Gestational”. Both the syntax that refers to a subject heading needs to be translated (/ to MH) and the subject heading itself is different (Diabetes, Gestational to Diabetes Mellitus, Gestational).

You can practice translating a search in the Learn course LibSmart II in the module on Literature Searching for Systematic Reviews. We also have a Library Bitesize session on translating literature search strategies across databases coming up in April.

Useful resources:

 

5. Do you have any training for systematic review?

Cartoon laptop.

Image by José Miguel from Pixabay

We do! The Learn course LibSmart II: Advance Your Library Research has a whole module on Literature Searching for Systematic Reviews.  LibSmart II can be found in Essentials in Learn. If you don’t see it there, contact your Academic Support Librarian and we’ll get you enrolled.

We also have several recorded presentations on systematic reviews on our Media Hopper channel, including ‘What is a systematic review dissertation like?’ and ‘How to test your systematic review searches for quality and relevance’.

For self-paced training on the whole process of conducting a systematic review, Cochrane Interactive Learning has modules created by methods experts so you build your knowledge one step at a time. Perfect for what can be an overwhelming research method.

If you are a student conducting a systematic review, we can highly recommend the book Doing a Systematic Review (2023). With a friendly, accessible style, the book covers every step of the systematic review process, from planning to dissemination.

—–

The FAQs in this post are taken from the library subject guide on Systematic Review Guidance where you can find even more information and advice about conducting large-scale literature reviews.

You can contact your Academic Support Librarian for advice on literature searching, using databases, and managing the literature you find.

—–

References

  1. Higgins, J., et al., Cochrane Handbook for Systematic Reviews of Interventions version 6.4 (updated August 2023). 2023, Cochrane.
  2. Mellor, L. The difference between a systematic review and a literature review, Covidence. 2021. Available at: https://www.covidence.org/blog/the-difference-between-a-systematic-review-and-a-literature-review/. (Accessed: 20 March 2024).
  3. Sutton, A., et al., Meeting the review family: exploring review types and associated information retrieval requirements. Health Information & Libraries Journal, 2019. 36(3): p. 202-222.
  4. Munn, Z., et al., Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol, 2018. 18(1): p. 143.

Mixed Methods Reviews

Posted on by
Reply

Most researchers have heard of and understand the needs of a systematic review (SR), however the concept of a mixed methods review (MMR) can be confusing. The types of questions students and researchers ask can include:

  • Can I do this type of research?
  • How do I combine the data?
  • My quantitative and qualitative data are different – how do I make sense of this?

MMRs differ from the traditional model of SR as they aim to answer complex interventions and social policy type questions. They go beyond what works and look to highlight the complexity of what is happening, to explain why things make an impact and what may influence how an intervention works, offering context to interventions.

To answer such questions MMRs need to draw from both quantitative and qualitative material (Pearson et al, 2015), but this does not mean they cannot be systematic!

To be systematic they should demonstrate the same transparent and explicit approach that established SR methods require – so have a protocol, as well as detailed reporting of methods. There would need to be appraisal and analysis of the included literature. They would need to show a rigorous research process (Gough et al, 2017).

There are different review approaches included in this type of research, but it is important that the research question uses both qualitative and quantative data. If the research question does not then it may be better to use another type of review method. An overview of review types can be found in an article by Sutton et al (2019).

How the types of data are combined depends on the research objectives of the review.

The resource SAGE Research Methods (which is available to all staff and students at the University via our Library Databases pages) has lots of information and advice on the ways that the differing data can be analysed and combined, as well as an overview of this family of research methodology.

https://www.ed.ac.uk/information-services/library-museum-gallery/finding-resources/library-databases/databases-a-z/databases-s

Book cover for SAGE handbook of Mixed Methods in Social & Behavioural ResearchBook cover for Mixed Methods Research: A guide to the fieldBook cover for An Introduction To Fully Integrated Mixed Methods Research

Donna Watson
Academic Support Librarian 

Dissertation Festival Blog: So… what is a systematic review?

Posted on by
Reply

Introduction

Welcome to the first of three blogs, where I document my Dissertation Festival Experience. For those who don’t know, the Library’s Dissertation Festival is a collaborative effort from the Library, Digital Skills department and Institute of Academic Development (IAD). They have come together to host a series of virtual sessions spanning over two weeks, providing students with the knowledge and resources to make the most out of their dissertations. Think Tomorrowland, Glastonbury and Coachella but online, free and hosted by the University of Edinburgh. So not quite the same. However, the Dissertation Festival is a fantastic opportunity to learn tips and tricks to help you write, reference and uncover what support is available to you at the University.  

The Session

The first Dissertation Festival session I participated in was titled “What is a Systematic Review dissertation like?”. I decided to attend because I was interested in finding out how systematic reviews (SR) differed from other dissertation types. Luckily, this was thoroughly covered within the presentation. After the first 5 minutes of the event, I was able to explain that the goal of a systematic review;  to answer a specific question in a topic area using reproducible review principles.    

Slide from Dissertation Festival used to help illustrate where different review approaches

Slide from Dissertation Festival used to help illustrate where different review approaches sit

Other key points of the session include “The supporting principles of a SR” which highlighted the need for a pre-defined and detailed methodology. This was an important topic for me as I am typically more of a ‘go-with-the-flow type person when writing pieces of work. However, now knowing the aims of an SR, I am confident that is not the best strategy. Instead, you should develop a clear plan (in advance), have an inclusion criterion for studies you are considering, find ways to avoid bias and document all your SR  activities. 

Thoughts and Conclusion

I would recommend this session for those who are just about to carry out a dissertation or thesis and don’t know where to start. The presentation is designed to help you gain a basic level of understanding a SR and what it entails. For all, you indecisive people out there or those who don’t know what research method to use, the pros and cons list shown in the presentation can help you evaluate if this is the right research method for you! Throughout the session, there were lots of valuable pieces of advice and information given. There were also signposts for further knowledge items to help you further your understanding in your own time.  

If you are interested in the session and want to check it out, you can find it HERE! Thanks for checking out the blog.