Mixed Methods Reviews

Most researchers have heard of and understand the needs of a systematic review (SR), however the concept of a mixed methods review (MMR) can be confusing. The types of questions students and researchers ask can include:

  • Can I do this type of research?
  • How do I combine the data?
  • My quantitative and qualitative data are different – how do I make sense of this?

MMRs differ from the traditional model of SR as they aim to answer complex interventions and social policy type questions. They go beyond what works and look to highlight the complexity of what is happening, to explain why things make an impact and what may influence how an intervention works, offering context to interventions.

To answer such questions MMRs need to draw from both quantitative and qualitative material (Pearson et al, 2015), but this does not mean they cannot be systematic!

To be systematic they should demonstrate the same transparent and explicit approach that established SR methods require – so have a protocol, as well as detailed reporting of methods. There would need to be appraisal and analysis of the included literature. They would need to show a rigorous research process (Gough et al, 2017).

There are different review approaches included in this type of research, but it is important that the research question uses both qualitative and quantative data. If the research question does not then it may be better to use another type of review method. An overview of review types can be found in an article by Sutton et al (2019).

How the types of data are combined depends on the research objectives of the review.

The resource SAGE Research Methods (which is available to all staff and students at the University via our Library Databases pages) has lots of information and advice on the ways that the differing data can be analysed and combined, as well as an overview of this family of research methodology.

https://www.ed.ac.uk/information-services/library-museum-gallery/finding-resources/library-databases/databases-a-z/databases-s

Book cover for SAGE handbook of Mixed Methods in Social & Behavioural ResearchBook cover for Mixed Methods Research: A guide to the fieldBook cover for An Introduction To Fully Integrated Mixed Methods Research

Donna Watson
Academic Support Librarian 

Dissertation Festival Blog: So… what is a systematic review?

Introduction

Welcome to the first of three blogs, where I document my Dissertation Festival Experience. For those who don’t know, the Library’s Dissertation Festival is a collaborative effort from the Library, Digital Skills department and Institute of Academic Development (IAD). They have come together to host a series of virtual sessions spanning over two weeks, providing students with the knowledge and resources to make the most out of their dissertations. Think Tomorrowland, Glastonbury and Coachella but online, free and hosted by the University of Edinburgh. So not quite the same. However, the Dissertation Festival is a fantastic opportunity to learn tips and tricks to help you write, reference and uncover what support is available to you at the University.  

The Session

The first Dissertation Festival session participated in was titled “What is a Systematic Review dissertation like?”. I decided to attend because was interested in finding out how systematic reviews (SR) differed from other dissertation types. Luckily, this was thoroughly covered within the presentation. After the first 5 minutes of the event, I was able to explain that the goal of a systematic review;  to answer a specific question in a topic area using reproducible review principles.    

Slide from Dissertation Festival used to help illustrate where different review approaches

Slide from Dissertation Festival used to help illustrate where different review approaches sit

Other key points of the session include “The supporting principles of a SR” which highlighted the need for a pre-defined and detailed methodology. This was an important topic for me as I am typically more of a ‘go-with-the-flow type person when writing pieces of work. However, now knowing the aims of an SR, I am confident that is not the best strategy. Instead, you should develop a clear plan (in advance), have an inclusion criterion for studies you are considering, find ways to avoid bias and document all your SR  activities. 

Thoughts and Conclusion

I would recommend this session for those who are just about to carry out a dissertation or thesis and don’t know where to start. The presentation is designed to help you gain a basic level of understanding a SR and what it entails. For all, you indecisive people out there or those who don’t know what research method to use, the pros and cons list shown in the presentation can help you evaluate if this is the right research method for you! Throughout the session, there were lots of valuable pieces of advice and information given. There were also signposts for further knowledge items to help you further your understanding in your own time.  

If you are interested in the session and want to check it out, you can find it HERE! Thanks for checking out the blog.