2020 Nov 18;17(22):8566. doi: 10.3390/ijerph17228566. Background: Realist evaluation is increasingly used in health services and other fields of research and evaluation. Health Res Policy Syst. Gill was a member of the Rameses research teams which developed the international publication standards and quality standards for realist evaluation and realist literature review. Its overall place in the toolkit of evaluation approaches is not yet fully established. RAMESES I - (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) developed quality and publication standards and training materials for realist reviews and the related approach of meta-narrative reviews. No previous standards exist for reporting realist evaluations. We also drew on our collective experience as realist evaluators, in training and supporting realist evaluations, and on the RAMESES email list to help us develop the briefing materials. RAMESES : Hide Latest Messages. Content available from CC BY 2.0: RAMESES publication standards: Realist syntheses.pdf. Introduction: Realist evaluation is an increasingly popular methodology in health services research. 2020 Nov 1;35(Supplement_2):ii9-ii21. This standard was developed as part of the RAMESES (Realist And MEtaânarrative Evidence Syntheses: Evolving Standards) project. This project developed quality and reporting standards and resources and training materials for realist evaluation. We hope that these standards will lead to greater consistency and rigour of reporting and make realist evaluation reports more accessible, usable and helpful to different stakeholders. Our background searching has shown that some realist evaluations are not flagged as such in the title and may also be inconsistently indexed, and hence are more difficult to locate. 2015;350:h1258. USA.gov. Process evaluation of complex interventions: Medical Research Council guidance. There are different forms of reasoning in research and evaluation. As with all primary research approaches, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. Wong G, Greenhalgh T, Westhorp G, Pawson R. Southampton (UK): NIHR Journals Library; 2014 Sep. BMC Med. Conclusions. Wong G, Westhorp G, Greenhalgh J, Manzano A, Jagosh J, Greenhalgh T. Southampton (UK): NIHR Journals Library; 2017 Oct. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. BMC Med. These reporting standards for realist evaluations have been developed by drawing on a range of sources. Language: English: PubMed ID: 27342217: Relevant URLs (full-text if available) | The project's aim is to produce preliminary publication standards for realist systematic reviews. -. Musa MK, Akdur G, Hanratty B, Kelly S, Gordon A, Peryer G, Spilsbury K, Killett A, Burton J, Meyer J, Fortescue S, Towers AM, Irvine L, Goodman C. BMJ Open. We recruited 35 panel members from 27 organisations across six countries from nine different disciplines. This approach offers the potential to expand the knowledge base in policy-relevant areas -for example, by explaining the success, failure or mixed fortunes of complex interventions. Realist evaluation reports need to be developed in line with the realist nature of the evaluation. doi: 10.1136/bmjopen-2020-040397. Uptake and use of a minimum data set (MDS) for older people living and dying in care homes in England: a realist review protocol. | realist evaluation covering the same kind of project or programme. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Through discussion within the project team, we developed a list of issues related to quality that needed to be addressed when carrying out realist evaluations. RAMESES II. We used a realist evaluation approach, guided by RAMESES II reporting standards for realist evaluation . Retroduction in realist evaluation The RAMESES II Project What is retroduction? doi: 10.1136/bmjopen-2020-037224. Realist evaluation for programs and services in the health area: an integrative review of the theoretical and methodological literature. The realist evaluation approach is a relatively new approach to evaluation, especially in some fields (such as health services research). about Realist Evaluation The RAMESES II Project 1. BMC Med. Data is collected from primary sources. 2016;14(1):96. For this purpose, RAMESES II for realist evaluation were followed . RAMESES II - developed quality and reporting standards and resources and training materials for realist evaluation. These approaches offer the potential to expand the knowledge base in policy-relevant areas - for example by explaining the success, failure or mixed fortunes of complex interventions. doi: 10.1177/1356389010389913. | Responsibilities. These were then shared with the panel members and their feedback was sought. doi: 10.1590/1518-8345.3933.3255. doi: 10.1136/bmj.h1258. Get the latest public health information from CDC: https://www.coronavirus.gov. The project's aim is to produce initial reporting standards for realist evaluations. 1 RAMESES II provides guidance on quality assurance and uniform reporting for improving quality and consistency of realist evaluation studies (Wong et al., 2017). Realist evaluation is increasingly used in health services and other fields of research and evaluation. There are hundreds of members and they are very good about providing advice and support. Background: I heartily endorse Alice's suggestion of joining the Rameses discussion list. collated and summarised existing literature on the principles of good practice in realist and meta-narrative systematic review; considered the extent to which these principles have been followed by published and in-progress reviews, thereby identifying how rigour may be lost and how existing methods could be improved; used an online Delphi method with an interdisciplinary panel of experts from academia and policy, produce a draft set of methodological steps and publication standards; produced training materials with learning outcomes linked to these steps; piloted these standards and training materials prospectively on real reviews-in-progress, capturing methodological and other challenges as they arise; synthesised expert input, evidence review and real-time problem analysis into more definitive guidance and standards. Harnessing the health systems strengthening potential of quality improvement using realist evaluation: an example from southern Tanzania. BMC Med. No previous standards exist for reporting realist evaluations. Panel members were asked to rank each potential item twice on a 7-point Likert scale, once for relevance and once for validity. 2014;12:29. doi: 10.1186/1478-4505-12-29. Realist evaluation is an increasingly popular methodology in health services research. Once the panel members had provided their feedback on our briefing materials, we constructed a set of items for potential inclusion in the reporting standards and circulated these online to panel members. 2 Acronym of âCommunity Orientated and Opportunity Learning Musicâ project. No previous standards exist for reporting realist evaluations. National Center for Biotechnology Information, Unable to load your collection due to an error, Unable to load your delegates due to an error. No previous publication standards exist for reporting realist syntheses. We also drew on our collective experience as realist evaluators, in training and supporting realist evaluations, and on the RAMESES email list to help us develop the briefing materials. Inductive logic derives The RAMESES II reporting guidelines for realist evaluations is an important initiative to ensure these evaluations are reported in sufficient detail, in the context of existing evidence, and with a rating of strength of evidence for main findings that will greatly assist users of the evaluations. The RAMESES II reporting guidelines for realist evaluations is an important initiative to ensure these evaluations are reported in sufficient detail, in the context of existing evidence, and with a rating of strength of evidence for main findings that will greatly assist users of the evaluations. The RAMESES (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) project has produced: for those seeking to use the realist and/or meta-narrative approach to systematic review. 2013 Jan 29;11:20. doi: 10.1186/1741-7015-11-20. Thus, its focus is on not just whether or not a programme such as an NZ regional DHB grouping âworksâ but how, for whom and in what contexts it âworksâ. This can include field research, interviews, focus groups NIH The projects' goals are to produce quality and publication standards and training materials for realist research approaches. We purposively recruited a maximum variety sample of an international group of experts in realist evaluation to our online Delphi panel. Realist evaluation is increasingly used in health services and other fields of research and evaluation. Evaluation. Methods: This approach was used because a simple binary of success and failure is sometimes unhelpful when evaluating the complexities of changing services and systems [ 14 ]. Quintans JR, Yonekura T, Trapé CA, Soares CB. Delphi approach; Realist evaluation; Reporting guidelines.