Systematic Reviews: five frequently asked questions

When the Academic Support Librarians provide help for students and researchers who are conducting large-scale reviews, such as systematic and scoping reviews, we find that often the same questions will come up. This blog post aims to answer five of your frequently asked questions about systematic reviews and provide some useful resources for you to explore further.

For even more advice about systematic review guidance, see the library’s subject guide on systematic reviews and LibSmart II: Literature Searching for Systematic Reviews.

Now let’s dive in to five Frequently Asked Questions…

1. What is a systematic review, and how does it differ from other types of literature review?

A funnel.

Image by Mugé from Pixabay

According to the Cochrane Collaboration, a leading group in the production of evidence synthesis and systematic reviews;

systematic reviews are large syntheses of evidence, which use rigorous and reproducible methods, with a view to minimise bias, to identify all known data on a specific research question.1

This is done by a large, complex literature search in databases and other sources, using multiple search terms and search techniques.

Traditional literature reviews, such as the literature review chapter in a dissertation, don’t usually apply the same rigour in their methods because, unlike systematic reviews, synthesise all known data on a topic. Literature reviews can provide context or background information for a new piece of research, or can stand alone as a general guide to what is already known about a particular topic2.

What about scoping reviews?

There are other review types in the systematic review “family”3. You may have also heard of scoping reviews. These are similar to systematic reviews, in that they employ transparent reporting of reproducible methods and synthesise evidence, but they do so in order to identify knowledge gaps, scope a body of literature, clarify concepts or to investigate research conduct4. Literature searching for scoping reviews will be similarly comprehensive, but may be more iterative than in systematic reviews.

Useful resources:

 

2. Which databases should I use?

Choosing appropriate databases in which to search is important, as it determines the comprehensiveness of your review. Using multiple databases means you are searching across a wider breadth of literature, as different databases will index different journals.

The list of Databases by Subject and the library subject guides can guide you to key databases for your topic.

To get an idea which databases are best suited to yield the data you need, you can also look at published systematic reviews on similar topics to yours, to see which databases those authors used.

The number of databases you use to search will vary depending on the research query, but it is important to use multiple databases to mitigate database bias and publication bias. More important than the number of databases is using the appropriate databases for the subject to find all the relevant data.

Useful resources:

 

3. What is grey literature and how do I find it?

You may have read that you should include grey literature in your sources of data for your review.

The term ‘grey literature’ refers to a wide range of information which is not formally or commercially published, and which is often not well represented in library research databases.

Using grey literature will help you to find current and emerging research, to broaden your research, and to mitigate against publication bias.

Sources and types of grey literature will vary between research topics. Some examples include:

  • Clinical trials
  • Conference papers and proceedings
  • Datasets
  • Dissertations and theses
  • Government documents and reports

 

  • NGOs documents and reports
  • Patents
  • Policy statements
  • Pre-prints
  • Statistical reports
  • White papers, working papers

Key sources of grey literature

Finding grey literature can be tricky because it can vary a lot in type and where it’s published. To help you, the Library’s subject guide has some key sources of grey literature to explore. The Library also has several databases which include records of dissertations and theses, which can be a source of relevant data for your review.

Another useful approach is using a domain search in Google to search within the websites of key organisations or professional bodies in your subject. For example, searching site: followed by a domain in Google:

site:who.int will search within the WHO website.

site:gov.uk will search only websites with a url that ends .gov.uk

 

4. How do I translate searches between databases?

Illustration of two screens.

Image by 200 Degrees from Pixabay

You may have heard that you need to ‘translate’ your search. This simply means taking the search you have developed in the database and optimising it to work best in a different database.

The way you tell a database to search for a term in the title of the record, or the command for searching for terms in close proximity to each other, will be different between databases and platforms.

For example, in the medical literature database Ovid Medline, the search for a subject heading on gestational diabetes is Diabetes, Gestational/ whereas the nursing database EbscoHost CINAHL uses MH “Diabetes Mellitus, Gestational”. Both the syntax that refers to a subject heading needs to be translated (/ to MH) and the subject heading itself is different (Diabetes, Gestational to Diabetes Mellitus, Gestational).

You can practice translating a search in the Learn course LibSmart II in the module on Literature Searching for Systematic Reviews. We also have a Library Bitesize session on translating literature search strategies across databases coming up in April.

Useful resources:

 

5. Do you have any training for systematic review?

Cartoon laptop.

Image by José Miguel from Pixabay

We do! The Learn course LibSmart II: Advance Your Library Research has a whole module on Literature Searching for Systematic Reviews.  LibSmart II can be found in Essentials in Learn. If you don’t see it there, contact your Academic Support Librarian and we’ll get you enrolled.

We also have several recorded presentations on systematic reviews on our Media Hopper channel, including ‘What is a systematic review dissertation like?’ and ‘How to test your systematic review searches for quality and relevance’.

For self-paced training on the whole process of conducting a systematic review, Cochrane Interactive Learning has modules created by methods experts so you build your knowledge one step at a time. Perfect for what can be an overwhelming research method.

If you are a student conducting a systematic review, we can highly recommend the book Doing a Systematic Review (2023). With a friendly, accessible style, the book covers every step of the systematic review process, from planning to dissemination.

—–

The FAQs in this post are taken from the library subject guide on Systematic Review Guidance where you can find even more information and advice about conducting large-scale literature reviews.

You can contact your Academic Support Librarian for advice on literature searching, using databases, and managing the literature you find.

—–

References

  1. Higgins, J., et al., Cochrane Handbook for Systematic Reviews of Interventions version 6.4 (updated August 2023). 2023, Cochrane.
  2. Mellor, L. The difference between a systematic review and a literature review, Covidence. 2021. Available at: https://www.covidence.org/blog/the-difference-between-a-systematic-review-and-a-literature-review/. (Accessed: 20 March 2024).
  3. Sutton, A., et al., Meeting the review family: exploring review types and associated information retrieval requirements. Health Information & Libraries Journal, 2019. 36(3): p. 202-222.
  4. Munn, Z., et al., Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol, 2018. 18(1): p. 143.

Academic writing help: Royal Literary Fund Fellow

Are you a student who is struggling with academic writing? Are you a staff member who knows of a student who isn’t quite getting the hang of writing at University level?

Perhaps you need to book an appointment with our Royal Literary Fund Fellow. Mary Paulson-Ellis is a well-respected expert in the field of writing, and has been a writing mentor, workshop leader, tutor and writer-in-residence for many organisations including the National Centre for Writing, the National Galleries of Scotland and the Edinburgh International Festival. She is also a committee member for the Society of Authors in Scotland, and student feedback from her first semester working at Edinburgh has been enthusiastically positive. She specialises in helping students in any discipline hone their writing skills and she does this by arranging one-to-one appointments with students in the Main Library.

The service is free, confidential and individual to each student’s needs. To find out more about the service you can visit our RLFF page, or to book an appointment please email Mary directly. 

Five reasons you should use LibSmart to prep for your assignments

Here we are midway through the first semester, and you may start to feel like you should be looking ahead to your end of semester assessments. Often students feel a bit overwhelmed before their first hand in, but here at the library we’re keen to help you feel confident from the start. Read on to find out why LibSmart is one of the best ways to prepare for your research and writing….

1. LibSmart shows you the basics of finding information in easy-to-follow lessons

Split into five simple sections, LibSmart I takes you through everything you need to find good material to base your assignments on. You’ll learn about how to search the library catalogue, how to double check your course reading, and suggestions of where to go for follow up resources.

2. You can dip in and out of it any time that suits you

One of the great things about LibSmart is all new students are already enrolled! You just need to log in to learn and click on the ‘Essentials’ tab on the left to find it. It’s there whenever you need it all year long, so if you’re feeling like you need to be productive at 11pm one evening then log on and complete a module. We’re sure you’ll either learn something new or you’ll feel more confident that you’re on the right track.

3. The whole of LibSmart I can take less than one afternoon to work through

We designed LibSmart I so that it’s not a huge effort for you to complete. We know your time is precious and that you may have classes to get to, work shifts to make or social activities that are a huge and important part of your student experience. We wanted to make the information in LibSmart as accessible as possible, and while you can take it at whatever pace you like, we know that some students like to rattle through it in just one day. Whichever route you chose, we appreciate the time you spend there.

4. You’ll learn valuable skills on how to get started with referencing

Referencing is one of the top enquiries we Academic Support Librarians receive – people are confused by it or don’t understand what, where and how to do it properly. LibSmart I has a really useful introductory module that can help you get to grips with the foundations of referencing, and offers top advice on how to find the right style and systems for you. If you’re feeling stuck with where to start then this is the place to go.

5. It’s so much more than just library stuff! 

We know it’s a lot to ask students to spend a few hours on looking specifically at library catalogues and databases especially when this isn’t prescribed reading on any particular course. However, students who’ve spent time on LibSmart believe it’s really made a difference to their experience as a student.

When I signed up, I assumed the course was just an introduction to the library but it has really been a guide to how academic research works. I wonder if more people would have signed up for this if they had realised it was not just a tour of the library to see where the books were kept. Along with the one hour “Study Skills” course I did, which was also surprisingly useful in its content, I feel I got as much learning from these free courses as the main one I paid for.

 


If you’re interested in giving LibSmart a go, you can find out more on our website.

Alternatively if you’re keen to get started straight away, just visit Learn and click on the Essentials tab on the left hand navigation. It’s all there ready for whenever you need it!

Screenshot of Learn Ultra platform, displaying the Essentials tab where LibSmart can be found

LibSmart: All students now automatically enrolled!

LibSmart banner, which contains the university crest in white on a black background to the left of the image. The word 'Library' is written beneath the crest. In the centre of the image is a photo of students sitting outside the Main Library on central campus on stone benches, and the Library sign is visible. To the right of the banner is the library branding which looks like geometric shapes in white and electric blue on a back background.

We’re very excited to let you know that from this year onwards all students at Undergraduate and Postgraduate level will automatically be enrolled in our LibSmart online information literacy course! If you’ve not encountered LibSmart before, it’s a great way to get to grips with finding and using information available to you via the Library. It’s asychronous which means you can dip in and out whenever suits you across the year, and we tend to find people use it either at the start of term when they need to start looking reading material up, or right before they start research for their assignments.

LibSmart I is our foundation level course, helping students get a good baseline in using our library catalogue, searching for reading materials for courses, and understanding the best places to go for help. We also talk about referencing and plagiarism, something students will need to understand at every level of university life.

LibSmart II is a bit more specialised – it takes a subject-specific look at different topics that people find tricky to work with, such as systematic reviews, data mindfulness and digital news sources. We walk you through different types of resource and processes for working with this information, and hopefully leave you feeling confident of where to start with your assignment or research project. We recommend you complete LibSmart I first, but if you’re feeling confident and ready to dive in to LibSmart II then you’re welcome to start wherever you like!

And if the achievement of completing a module alone doesn’t bring you joy, we also award you some lovely digital badges for each module you complete. You can save them and use them as evidence of the self-directed learning you’ve completed via LibSmart – something that could look very attractive to future employers!

Picture of LibSmart digital badges in a wooden picture frame leaning against a wall

Earn digital badges for every module you complete in LibSmart I and II.

To access LibSmart, simply follow these steps:

  1. Visit www.learn.ed.ac.uk
  2. Log in using your UUN (normal university username and password)
  3. On the left hand navigation, select ‘Organisations’
  4. Locate LibSmart I: Your Library Research Starts Here (2023/24) from the list, or LibSmart II: Advance your Library Research (2023/24). 
  5. Click into the course and start working your way through!

If you would like some further information on LibSmart you can find out more on our LibSmart webpage which includes information about the modules available and a look at what previous students have found most useful about the course. Of course if you have any questions please leave us a comment or email us.