Skip to main

Impact case study database

The impact case study database allows you to browse and search for impact case studies submitted to the REF 2021. Use the search and filters below to find the impact case studies you are looking for.

Search and filter

Filter by

  • University of Bristol
   None selected
  • 2 - Public Health, Health Services and Primary Care
   None selected
   None selected
   None selected
   None selected
   None selected
   None selected
Waiting for server
Download currently selected sections for currently selected case studies (spreadsheet) (generating)
Download currently selected case study PDFs (zip) (generating)
Download tags for the currently selected case studies (spreadsheet) (generating)
Currently displaying text from case study section
Showing impact case studies 1 to 9 of 9
Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

University of Bristol (UoB) research was critical to the Department of Health deciding, in 2015, to introduce the Bexsero vaccine against group B meningococcal (MenB) disease for babies. UoB led research to develop new models predicting which vaccine strategy could avert the most cases and the maximum vaccine cost for the NHS. The Joint Committee on Vaccination and Immunisation, who advise Government, recommended introducing the vaccine at a cost-effective price based on UoB’s findings and MenB cases reduced by 75% by the third year of the programme. The research has also informed vaccination policy in Belgium and Germany.

2. Underpinning research

Mathematical models are now a critical tool for informing decisions on vaccine policy in the UK. This is because the Joint Committee on Vaccination and Immunisation (JCVI), who advise the Government on vaccine policy in the UK, can only recommend vaccine introduction if it is deemed cost-effective. When new vaccines are developed new mathematical models are required to assess potential effectiveness and cost-effectiveness when implemented in populations – UoB led research developed such models for novel vaccines against meningococcal B disease.

This body of research began in 2007 and has been undertaken by Hannah Christensen, in collaboration with Dr CL Trotter (Bristol, now at Cambridge), Prof M Hickman (Bristol) and Prof WJ Edmunds (Health Protection Agency (now Public Health England) and the London School of Hygiene & Tropical Medicine). Two types of mathematical model (cohort and transmission dynamic) were developed, incorporating epidemiological and economic data, to predict the potential impact of introducing a new meningococcal vaccine with the capacity to protect against capsular group B meningococcal (MenB) disease, in terms of case reduction and cost-effectiveness. The models were developed by Hannah Christensen, initially forming her PhD, with supervision by Profs Hickman, Edmunds and Dr Trotter. Subsequently these were further developed by Dr Christensen with ongoing advice from Dr Trotter and Profs Edmunds and Hickman.

These models were the first to comprehensively assess the potential impact of ‘MenB’ vaccines in late stage clinical trials, appropriately accounting for herd effects through vaccine disruption of transmission. The UoB-led research found that 27% of cases could be prevented over the lifetime of a birth cohort by vaccinating infants (with a vaccine preventing disease only) at 2, 3, 4 and 12 months of age [1]. At a willingness-to-pay of GBP 30,000 per Quality Adjusted Life Year, such a strategy could be cost-effective [1]. If the vaccine prevents transmission in addition to preventing disease, substantial disease reductions (71%) could be produced after 10 years by routinely vaccinating infants in combination with a large-scale catch-up campaign (1-17 years), due to the high levels of carriage in teenagers [4]. This could be cost-effective at GBP 17 per vaccine dose [1].

From 2011, the UoB-led team further developed the models in response to the availability of new data and requests by the JCVI. Model results considering several different ‘MenB’ vaccine scenarios, and the uncertainty in several of the model parameters, were produced, estimating the number of cases averted by vaccination and in what age groups over time. The cost-effectiveness of each programme was evaluated and the maximal vaccine price estimated for each scenario to be considered cost-effective in the UK [2]. Additionally, we were commissioned to tailor the models for Germany [3] and Belgium by the health authorities in these countries; Dr Christensen led the research team, which included UoB post-doctoral researchers Drs Tom Irving and Emily Nicoli.

3. References to the research

[1] Christensen H, Hickman M, Edmunds WJ, Trotter CL. Introducing vaccination against serogroup B meningococcal disease: An economic and mathematical modelling study of potential impact. Vaccine. 2013; 31(23): 2638-46. DOI: 10.1016/j.vaccine.2013.03.034

[2] Christensen H, Trotter CL, Hickman M, Edmunds WJ. Re-evaluating cost effectiveness of universal meningitis vaccination (Bexsero) in England: modelling study. BMJ. 2014; 349:g5725. DOI: 10.1136/bmj.g5725

[3] Christensen H, Irving T, Koch J, Trotter CL, Ultsch B, Weidemann F, Wichmann O, Hellenbrand W. Epidemiological impact and cost-effectiveness of universal vaccination with Bexsero® to reduce meningococcal group B disease in Germany. Vaccine. 2016; 34(29): 3412-9. DOI: 10.1016/j.vaccine.2016.04.004

[4] Christensen H, May M, Bowen L, Hickman M, Trotter CL. Meningococcal carriage by age: a systematic review and meta-analysis. Lancet Infectious Diseases. 2010; 10(12): 853-861. DOI: 10.1016/S1473-3099(10)70251-6

Grants:

[i] Christensen H. Investigating the potential benefit of enhanced or alternative interventions for infectious disease control: a focus on adolescent vaccination and contact tracing, National Institute of Health Research, Post-Doctoral Fellowship, 1 January 2013 to 31 December 2015 GBP240,296 (peer-reviewed grant for post-doctoral fellowship)

[ii] Christensen H. Modelling the impact of vaccination targeted against serogroup B meningococcal disease, National Institute of Health Research, Researcher Development Award, 1 October 2007 to 30 September 2010, GBP 184,596 (peer-reviewed grant for doctoral fellowship)

4. Details of the impact

Meningococcal disease is a leading infectious cause of death in young children in the UK. The disease progresses rapidly even with appropriate treatment and can leave survivors with severe disabling after-effects, including amputation, skin scarring and neurological damage. At the time of initial model development for this work, a broadly effective vaccine against group B meningococcal disease was not available, though several candidate ‘MenB’ vaccines were in late stage clinical trials.

Impact on vaccination policy in the UK

In January 2013, once the first broadly effective vaccine against MenB disease (Bexsero) was granted an EU license, policy makers needed to urgently consider if and how to utilise it. In the UK, the requirement for the JCVI to only recommend vaccines that are cost-effective means that mathematical models are used as a key tool to inform policy making, as they can explore multiple different scenarios.

The underpinning research by UoB had indicated which introductory vaccine strategy would have the greatest impact in terms of meningococcal case reduction and estimated the cost-effectiveness of the programme [1]. As a result of submitting evidence on UoB’s research results to a JCVI call for evidence on issues relating to meningococcal vaccination in 2011, Dr Christensen was invited to present the findings of the ongoing model development at closed JCVI meetings in February, April, June 2013, and February 2014 [A].

In March 2014, the JCVI recommended the introduction of Bexsero in the UK with a schedule from UoB’s model that offered the greatest direct protection at reduced cost [2], subject to a cost-effective vaccine price [B]. JCVI’s position statement on the use of Bexsero explained that a “key component” in JCVI’s assessment of the drug was “a study on the impact and cost-effectiveness of different vaccination strategies using Bexsero® conducted by the University of Bristol and London School of Hygiene and Tropical Medicine” [Bi p.2]. UoB’s research is discussed at length (pp.2-3) and cited on five occasions in the statement [Bi]. The vaccine has been offered free on the NHS to babies at 2, 4 and 12 months of age since September 2015 and forms part of the ongoing national programme [B].

Public Health impact in the UK

Bexsero vaccine uptake has been high. In 2019/20, 92.5% of 12 month olds had been vaccinated [C]. The programme has been effective at reducing cases of meningococcal disease [D] and the associated morbidity and mortality. Cases in vaccine-eligible infants halved in the first 10 months of the programme, irrespective of the infants’ vaccination status, and subsequent data have shown a sustained reduction in MenB cases compared with pre-vaccine levels in those targeted for vaccination (Figure 1). By the third year of the programme there was a 75% reduction in MenB cases in children who were fully eligible for vaccination [E]. Due to the vaccine’s composition, it also offers some protection against other capsular groups and, whilst case numbers are small, there is evidence that the vaccine has also reduced MenW disease in infants [D].

Economic impacts for the NHS

UoB’s models suggested vaccination would only be cost-effective at a low vaccine price [2]. The JCVI can only recommend introducing a vaccine if it is deemed cost-effective, thus UoB’s models were critical to their decision to recommend the vaccine and at what price.

These were the only independent models considered by JCVI [B]. The list price for the Bexsero vaccine in the UK was GBP 75 per vaccine dose; however, UoB’s final model results suggesting ≤GBP 7 per dose [2] were used to inform the procurement process, thus leveraging a considerable saving to the NHS. As for all vaccines procured for the NHS, the final price paid for the vaccine is confidential. Notwithstanding, if the negotiated price of the vaccine was close to that suggested by UoB’s final model, it can be assumed that the research could currently save the Department of Health approximately GBP 136 million annually on delivering the programme (difference between GBP 75 and GBP 7 for a 3-dose vaccine given to a birth cohort annually of 722,881 UK infants with 92.5% uptake).

Impact on international vaccination policy

The models developed for the UK have been adapted by the UoB-led group in collaboration with international researchers to inform Bexsero policy decisions in Belgium (2014) [G] and Germany (December 2013) [H]. Our group was approached by researchers at the Robert Koch Institute and the Belgian Healthcare Knowledge Centre and commissioned to undertake the work. Models for these countries [3] indicated that whilst vaccination could reduce case numbers, immunisation would be beyond that normally considered cost-effective; consequently, these countries have not recommended widespread introduction of the vaccine [G, H].

Embedded image

Figure 1: MenB cases in children under 5 years of age during 2013/2014–2018/2019 surveillance years (September–August following year) in England (solid line) compared with MenB cases predicted by trends among unvaccinated childhood cohorts (dashed line) over the same period. The arrow indicates the start of the MenB infant immunisation programme. Only around half of the birth cohorts in children under 5 in this figure were eligible for the Bexsero vaccine, thus underestimating the true impact of the vaccine in those who actually received it [F]. In children who were fully eligible for vaccination there was a 75% reduction in MenB cases by the third year of the programme [E].

5. Sources to corroborate the impact

[A] JVCI (2014). Minutes of the meeting on Tuesday 11 and Wednesday 12 February 2014, Department of Health

[B] i) JVCI (2014). JVCI position statement on use of Bexsero® meningococcal B vaccine in the UK

ii) JCVI (2020). Supporting statement – JCVI Chair

[C] NHS Digital (2020). Childhood Vaccination Coverage Statistics - England 2019-20

[D] i) PHE (2018). Invasive meningococcal disease in England: annual laboratory confirmed reports for epidemiological year 2017 to 2018

ii) PHE (2018). Recent epidemiology of meningococcal disease and impact of immunisation programmes in the UK

[E] i) Parikh et al. (2016) Effectiveness and impact of a reduced infant schedule of 4CMenB vaccine against group B meningococcal disease in England: a national observational cohort study. Lancet, 388 (10061). 2775-2782. DOI: 10.1016/S0140-6736(16)31921-3

ii) Ladhani et al. (2020). Vaccination of Infants with Meningococcal Group B Vaccine (4CMenB) in England. N Engl J Med, 382(4):309-317. DOI: 10.1056/NEJMoa1901229

[F] Isitt et al. (2020). Success of 4CMenB in preventing meningococcal disease: evidence from real-world experience. Archives of Disease in Childhood, 105:784-790. DOI: 10.1136/archdischild-2019-318047

[G] i) Belgian Health Care Knowledge Centre (KCE) (2014). KCE Report 231. A quadrivalent vaccine against serogroup B meningococcal disease: a cost-effectiveness study

ii) Belgian Health Care Knowledge Centre (KCE) (2020). Supporting statement – Medical epidemiologist

[H] i) Robert Koch Institute (Dec 2013). Statement of the Standing Vaccination Commission (STIKO) at the Robert Koch Institute (RKI) on the status of the evaluation of new meningococcal B vaccine Bexsero®, Epidemiologisches Bulletin 49. (translation available).

ii) Robert Koch-Institute (2020) Supporting statement – Infectious Disease Epidemiologist, on behalf of the MenB working group at the Robert Koch-Institute

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Societal
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

University of Bristol (UoB) led the development, trialling and implementation of the IRIS (Identification and Referral to Improve Safety) programme across 46 areas of England and Wales, including training in over 1000 general practices. This programme, evaluated through a research collaboration between UoB and Queen Mary, University of London, has supported over 20,000 women patients in England and Wales to reduce their exposure to violence and improve their mental health and quality of life. The IRIS programme is cited and recommended by UK Home Office and Welsh Government policy and strategy, as well as NICE health guidance and standards. IRIS has also been used as an exemplar to inform initiatives in Palestine, Brazil, Nepal and Sri Lanka, as well as informing global World Health Organisation guidelines.

2. Underpinning research

Domestic violence and abuse (DVA) against women, a major public health and clinical problem, requires a healthcare response. Historically, clinicians in general and GPs in particular have not responded effectively to the needs of patients experiencing DVA. Most clinicians have little or no training, fail to identify patients experiencing abuse and are uncertain about further management after disclosure.

In 2007/2008, the University of Bristol (UoB), in collaboration with Queen Mary, University of London (QMUL) and funded by The Health Foundation [i], led a cluster randomised controlled trial [1], evaluating a training and support programme delivered by ‘advocate-educators’ based in third sector DVA agencies. A total of 48 eligible general practices in Bristol and Hackney (London) were randomised to intervention or control groups. The intervention programme included practice-based training sessions for clinicians and administrative teams, a prompt within the electronic medical record to ask about abuse, and a referral pathway to a named DVA advocate (who also delivered the training and further consultancy to the practices). The latter was undertaken because advocacy support to survivors of DVA reduces their risk of further abuse and improves mental health outcomes.

One year after the second training session (2009), advocacy agencies recorded 278 self and direct referrals of patients from intervention practices and 40 from control practices (intervention incident rate ratio 6·6, 95% confidence interval 4·1 to 10·7) [1]. Intervention practices recorded 641 disclosures of DVA and control practices recorded 236 (intervention rate ratio 3·1, 95% confidence interval 2·2 to 4·3) [1]. The trial established that a training and support programme targeted at primary care staff improves recorded identification of women experiencing domestic violence and referral to specialist domestic violence (DV) agencies. Linked research included a cost-effectiveness study of the trial intervention [2], a qualitative study of the experiences of survivors of DVA receiving IRIS support [3], an interrupted time series of the service implementation and sustainability of the IRIS programme in north London [4], and a further cost-effectiveness analysis of post-trial NHS implementation [5]. The national cost-effectiveness study, carried out in collaboration with University College London, found that the IRIS model has retained its cost-effectiveness in translation from trial intervention to a widely commissioned national programme [5]. Moreover, the interrupted time series analysis showed that when an area decommissions IRIS, referrals fall sharply [4].

A distinctive and pioneering aspect of the trial was the close collaboration with third sector domestic violence organisations (Nia and Next Link), which were directly involved in the trial design, intervention delivery and national implementation. Following the success of the IRIS trial the team created IRIS – strengthening impact (IRISimp), an implementation vehicle to roll-out the IRIS model into general practices across the country. This two-year programme of work was undertaken in conjunction with and funded by the Health Foundation [ii]. It facilitated the commissioning of the IRIS model by CCGs and local authorities and funded the advocate educator training. A Department of Health Innovation, Excellence and Strategic Development Grant [iii] supported further implementation of IRIS in England. In 2017, with support from an ESRC impact accelerator award [iv] a social enterprise, IRISi, was created to facilitate further national scaling up of the general practice IRIS intervention and implementation of IRIS-related research. The latter included IRIS ADVISE [6] – an adaption of IRIS for sexual health settings that has been evaluated in east London and Bristol [v].

3. References to the research

[1] Feder G, Davies RA, Baird K, Dunne D, Eldridge S, Griffiths C, Gregory A, Howell A, Johnson M, Ramsay J, Rutterford C, Sharp D. (2011). Identification and Referral to Improve Safety (IRIS) of women experiencing domestic violence with a primary care training and support programme: a cluster randomised controlled trial. Lancet, 378(9805):1788-1795. DOI: 10.1016/S0140-6736(11)61179-3

[2] Devine A, Spencer A, Eldridge S, Norman R, Feder G. (2012). Cost-effectiveness of Identification and Referral to Improve Safety (IRIS), a domestic violence training and support programme for primary care: a modelling study based on a randomised controlled trial. BMJ Open, 2(3): e001008. DOI: 10.1136/bmjopen-2012-001008

[3] Malpass A, Sales K, Johnson M, Howell A, Agnew-Davies R, Feder G. (2014). Women's experiences of referral to a domestic violence advocate in UK primary care settings: a service-user collaborative study. British Journal of General Practice, 64(620): 151-158. DOI: 10.3399/bjgp14X677527

[4] Sohal AH, Feder G, Boomla K, Dowrick A, Hooper R, Howell A, Johnson M, Lewis N, Robinson C, Eldridge S, Griffiths C. (2020). Improving the healthcare response to domestic violence and abuse in UK primary care: interrupted time series evaluation of a system-level training and support programme. BMC Medicine, 18(1): 48. DOI: 10.1186/s12916-020-1506-3

[5] Barbosa EC, Verhoef TI, Morris S, Solmi F, Johnson M, Sohal A, El-Shogri F, Dowrick S, Ronalds C, Griffiths C, Eldridge S, Lewis NV, Devine A, Spencer A, Feder G. (2018). Cost-effectiveness of a domestic violence and abuse training and support programme in primary care in the real world: updated modelling based on an MRC phase IV observational pragmatic implementation study. BMJ Open, 8(8): e021256. DOI: 10.1136/bmjopen-2017-021256

[6] Sohal AH, Pathak N, Blake S, Apea V, Berry J, Bailey J, Griffiths C , Feder G. (2018). Improving the healthcare response to domestic violence and abuse in sexual health clinics: feasibility study of a training, support and referral intervention. Sex Transm Infect. 94(2): 83-87. DOI: 10.1136/sextrans-2016-052866

Key funding:

[i] Feder G. Identification and referral to improve safety (IRIS), The Health Foundation + Department of Health, 2007 – 2010, GBP388,434 + 40,000 Primary care domestic violence trial

[ii] Feder G. IRIS – strengthening impact (IRISimp), The Health Foundation, 2010 – 2013, GBP184,074

[iii] Feder G. IRIS implementation, Department of Health Innovation, Excellence and Strategic Development Grant, 2013-14, GBP173,226

[iv] Feder G IRISi Ltd – Social Enterprise Set Up, 2017, ESRC Impact Acceleration Account and Support, GBP15,000

[v] Feder G Evaluation of IRIS implementation in sexual health settings, Elizabeth Blackwell Institute, GBP50,886

4. Details of the impact

IRIS was a landmark trial [1] in DVA research, evaluating a training and support programme, including a referral pathway, designed to improve the response of general practice to women experiencing domestic violence. It had an initial impact on national policy and service implementation in the two years after its publication in 2011. Here we focus on its impact post-August 2013.

Benefits to women and practitioners

Embedded image Figure 1 - Cumulative total referrals to IRIS from across England, Wales and Northern Ireland (2011 – 2020) [A].

Up to March 2020, 48 localities in England and Wales have commissioned the IRIS programme; 1,036 practices have been trained and over 20,544 women (Figure 1) referred from these practices to DV services [A]. The other benefit for patients is a safer and more appropriate response of clinicians to disclosure of domestic violence, a core feature of the IRIS intervention. We have evidence for this impact from feedback from patients who disclosed abuse to their GPs and were referred to an IRIS advocate educator [A (p.12)] and evidence of the sustained effectiveness of the IRIS model from an interrupted time series study of IRIS implementation in north London [5].

A total of 302 general practices received training during April 2019 – March 2020, with 265 clinical training sessions, 157 for reception staff, and 132 refresher courses. IRIS reaches an older demographic of women who we know are less well represented in specialist DVA services. It is a positive feature of IRIS being able to reach an otherwise invisible groups of survivors.

In response to the COVID-19 pandemic, IRIS moved from a fully face-to-face to a fully virtual programme, including webinar versions of all training packages. As a result, all IRIS Advocate Educators have been able to continue supporting patients during the pandemic. National data shows an initial reduction in referral cases (March-April 2020) followed by a renewed increase in referrals (May-June 2020). IRIS has been able to collect feedback on their support from 1,500 women. 98% were pleased to have been referred to an Advocate Educator. In response to other questions, more than 80% said they felt safer, more confident, more able to cope, and optimistic about the future. For example: “I was unaware of what types of abuse I have been going through and it has opened my eyes for a better and brighter future for my unborn child and myself. Thank you for everything it has been appreciated”. [A]

Furthermore, IRIS ADVISE – an adaption of IRIS for sexual health settings – has been piloted in east London and Bristol [6]. It is now being commissioned in Manchester [Bi] and commissioners in other areas have expressed an interest.

Impact on national policy

In 2013, IRIS was cited in the Home Office’s Domestic Homicide Reviews – Common Themes Identified as Lessons to be Learned [C], as a way to improve local provision. The 2014 NICE DVA guidelines [Di] had a specific training and support recommendation for primary care, based explicitly on IRIS and directly informing a NICE DVA quality standard [Dii]. In 2016, the UK Home Office’s refreshed Violence Against Women and Girls Strategy (2016-2020) endorsed IRIS as a key part of the strategy and included the programme in its action plan [E]. IRIS was recommended for local adoption by the government’s National Statement of Expectations (NSE) for Violence Against Women and Girls Services and the IRIS programme was promoted in the Home Office’s Modern Crime Prevention Strategy [F (p.13)]. In Wales, IRIS was similarly endorsed as an innovative approach for early intervention in the National Strategy on Violence against Women, Domestic Abuse and Sexual Violence (2016-2021) [G]. IRIS has recently been cited in the MOPAC (Mayor's Office for Policing And Crime) Violence Against Women and Girls strategy: The London Tackling Violence Against Women and Girls Strategy 2018-2021 [H], as an example of good work within the health sector (Greater London Authority, 2018). The UK INCADVA (Inter-Collegiate and Agency Domestic Violence Abuse) forum’s June 2020 evidence submission to Parliament pressed for uniform national implementation of the IRIS programme within the statutory instruments of the UK’s Domestic Abuse Bill [J].

Benefits to NHS staff

Intermediate beneficiaries from the widespread implementation of IRIS have been the doctors, nurses and other members of the practice teams in the 1,036 IRIS practices in England and Wales. Feedback from general practice teams (20,000 individuals) [A (p.13)] following training shows an increase in participant knowledge and described the session as ‘invaluable and addressed a real hole in our learning’. Nineteen out of twenty clinicians would recommend IRIS training to a colleague. Following IRIS training, GP reception teams reported that their confidence to deal with and respond appropriately to patients experiencing DVA rose from 4.2 to 8.3/10. [A]

Impact on international policy

The landmark 2013 World Health Organisation publication titled Responding to intimate partner violence and sexual violence against women: WHO clinical and policy guidelines [I] drew heavily on UoB’s research [1]. Specifically, this research helped frame their approach, and in making recommendations about the training of healthcare providers there was specific citation of the IRIS model [I (p.33)]. IRIS has been the basis of two European projects and is now informing interventions in an NIHR Global Health Group (Healthcare responding to violence and abuse, HERA) in Palestine, Brazil, Nepal and Sri Lanka, including wider country-specific implementation (e.g. implementation in Sao Paulo) [Bii].

Economic impact

Based on the results of our cost-effectiveness modelling [2] which has been updated using our non-trial data [5], we estimate the annual societal cost saving associated with IRIS is greater than GBP2,400,000. This modelling indicated that implementation of the IRIS programme is cost-effective as judged by NICE criteria, generates societal cost savings and is likely to reduce NHS costs. This estimated cost saving is conservative, as it does not include benefits to children exposed to DVA.

5. Sources to corroborate the impact

[A] IRIS (2020). IRIS Identification & Referral to Improve Safety

[B] i) Greater Manchester Health & Social Care Partnership (2020). Supporting Letter – Consultant in Public Health

ii) São Paulo Municipal Health Secretariat (2020). Supporting Letter - Technical Director

[C] Home Office (Nov 2013). Domestic homicide reviews: Common themes identified as lessons to be learned IRIS recommended for local and national approach (p.4-5).

[D] i) NICE (2014). Public health guideline [PH50]: Domestic violence and abuse: multi-agency working. IRIS economic model is the basis for recommendation 16.

ii) NICE (2016). Quality standard [QS116]: Domestic violence and abuse

[E] HM Government (2019). Ending Violence against Women and Girls 2016 - 2020,

(pp.21, 27, 53).

[F] Home Office (2016). Modern Crime Prevention Strategy , (p.13).

[G] Welsh Government (2016). National Strategy on Violence against Women, Domestic Abuse and Sexual Violence – 2016 - 2021 (p.23).

[H] Greater London Authority (2018). A Safer City for Women and Girls The London Tackling Violence Against Women and Girls Strategy 2018-2021 (p.32-33).

[I] WHO (2013). Responding to intimate partner violence and sexual violence against women: WHO clinical and policy guidelines (cites [1]).

[J] Domestic Abuse Bill (2019-21). Written evidence submitted by the INCADVA (Inter-Collegiate and Agency Domestic Violence Abuse) Forum (DAB57)

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Patients around the world are more likely to receive the most effective healthcare, at affordable cost, thanks to methods developed by University of Bristol researchers for combining and critiquing evidence. These methods are routinely used by the National Institute for Health and Care Excellence (NICE) to develop recommendations for healthcare in England and Wales and inform guidance on whether new and existing medicines/treatments are made available within the NHS. They are also used by pharmaceutical companies and consultancy firms in submissions to NICE, by academic groups critiquing those submissions, and by similar bodies responsible for healthcare policy in other countries.

2. Underpinning research

Healthcare policy and guidelines are developed by expert committees based on appraisals of the evidence for clinical and cost-effectiveness of treatment options. Randomised controlled trials (RCTs) are the best way to compare the effects of different treatments. When multiple RCTs have been conducted, evidence synthesis methods are used to combine their findings, and these pooled estimates are used to assess which treatments deliver the greatest health benefits and represent best value for money. The robustness of the resulting recommendations relies on the use of appropriate methods for evidence synthesis and thorough critiques of model assumptions, the available RCT evidence and, where no RCT evidence is available, relevant non-randomised evidence. University of Bristol (UoB) researchers have developed a suite of methods for evidence synthesis and critical appraisal of the evidence to support robust healthcare decision-making. Of the research described below, only reference [1] was included in a REF2014 impact case study.

Network meta-analysis (NMA) methods

Network meta-analysis (NMA) [1] combines RCT results to compare multiple (more than two) treatment options, based on a connected network of treatments directly compared in various combinations within individual RCTs. NMA is particularly relevant for decisions between multiple treatment options, because a single RCT comparing all options is not typically available, or even feasible, and some treatment pairs may not have been directly compared in any RCT. NMA respects the randomisation in individual RCTs, allows ranking of treatments according to clinical and cost-effectiveness, and gives more precise estimates than standard meta-analyses that compare just two treatments that have been directly compared in ‘head-to-head’ RCTs. However, NMA assumes the included RCTs do not differ in factors that modify the treatment effect, so that direct estimates from RCTs comparing a pair of treatments are similar to indirect estimates from the remaining evidence (the consistency assumption).

The UoB researchers developed methods and computer code (for freely available statistical software WinBUGS) to conduct NMA for a range of different outcomes (probabilities, rates, continuous, ordinal, survival) and to assess the consistency assumption [1]. Assessing consistency between direct and indirect estimates is important for decision-makers to assess robustness of NMA estimates. UoB researchers co-led in the development of an algorithm implemented in the GeMTC package (for freely available statistical software R) to automate this task and facilitate inconsistency checking [2]. Population adjustment methods have been proposed when the consistency assumption does not hold and individual participant data are available for one study. UoB researchers reviewed these methods, clarified the underlying assumptions and statistical properties, and provided recommendations for their use in assessing effectiveness and cost-effectiveness of treatments [3].

Reconstruction of survival curve data

The impact of treatments on life-expectancy is often a key consideration, especially in oncology, and cost-effectiveness can be very sensitive to models used for survival. Comparing different survival models requires access to individual participant data from each RCT. However, those making submissions to reimbursement agencies do not have access to individual participant data from their competitors’ RCTs, only the published survival curves. UoB researchers developed an algorithm to reconstruct individual participant data from published survival curves and provide R-code to implement the algorithm [4]. This enables companies and evidence review groups to compare different survival models, so that committees can see how sensitive estimates of clinical and cost-effectiveness are to different survival models and, in turn, account for this in their decision-making.

Assessing risk of bias in RCTs and non-randomised studies

Studies conducted with lower methodological rigour can lead to exaggerated treatment effect estimates. Committees that appraise evidence therefore need to be aware of methodological flaws in both RCT and non-RCT evidence and account for this in their decision-making. UoB researchers co-led in the development of a tool to assess risk of bias in RCTs [5] and led on equivalent research for non-randomised studies (ROBINS-I) [6]. Both tools are adopted in the Cochrane Handbook for Systematic Reviews of Interventions and are widely used across the world.

3. References to the research

[1] NICE Decision Support Unit Technical Support Documents (TSDs) Evidence Synthesis series (TSD-ES) (2011): http://nicedsu.org.uk/technical-support-documents/evidence-synthesis-tsd-series/ and published in abridged form as a series of 7 papers: Dias S, Welton NJ, Sutton AJ, Ades AE. Evidence synthesis for decision making. Medical Decision Making 2013 33:597-691. (MDM1-7). www.wiley.com/en-gb/Evidence+Synthesis+for+Decision+Making+in+Healthcare-p-9781118305409

[2] van Valkenhoef G, Dias S, Ades AE, Welton NJ. Automated generation of node-splitting models for assessment of inconsistency in network meta-analysis. Research Synthesis Methods 2016. 7:80-93. DOI: 10.1002/jrsm.1167.

[3] NICE Decision Support Unit Technical Support Document TSD18: on Population Adjusted Indirect Comparisons (2016): http://nicedsu.org.uk/technical-support-documents/population-adjusted-indirect-comparisons-maic-and-stc/ and published in abridged form: Phillippo DM, Ades AE, Dias S, Palmer S, Abrams K, Welton NJ. Methods for population-adjusted indirect comparisons in health technology appraisal. Medical Decision Making. 2018. 38:200-211. DOI: 10.1177/0272989X17725740.

[4] Guyot P, Welton NJ, Ouwens MJNM, Ades AE. Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves. BMC Medical Research Methodology 2012. 12:9 DOI: 10.1186/1471-2288-12-9.

[5] Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JAC. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011; 343: d5928. DOI: 10.1136/bmj.d5928.

[6] Sterne JAC, Hernán MA, Reeves BC, Savović J, … , Whiting PF, Higgins JPT. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions BMJ 2016; 355:i4919. DOI: 10.1136/bmj.i4919.

4. Details of the impact

The National Institute for Health and Clinical Excellence (NICE) issue technology appraisal guidance on whether new or existing treatments are effective, represent good value for money, and can be provided to NHS patients in England (with the guidance also adopted in Wales). The NHS is legally obliged to fund treatments recommended by NICE’s technology appraisals, and so the appraisals directly impact the treatment options available to patients. NICE also issue clinical guidelines for healthcare professionals to help them decide on appropriate treatments and services for their patients. Whilst NICE clinical guidelines are not mandatory, their uptake is generally good ( www.nice.org.uk/about/what-we-do/into-practice/measuring-the-uptake-of-nice-guidance/impact-of-guidance). NICE technology appraisals and clinical guidelines are based on both clinical and cost-effectiveness, therefore adoption of their recommendations secures more health-related quality of life per pound spent by the NHS and, hence, improves outcomes for patients.

The methods for evidence synthesis and critical appraisal tools developed by UoB researchers are used by pharmaceutical companies [a] and consultancy firms [b] preparing submissions to NICE technology appraisals, academic groups critiquing those submissions, and NICE guideline developers [c]. Here we demonstrate how the methods are routinely used in NICE technology appraisal guidance [c][d] and NICE clinical guidelines [c][e], and so directly influence the resulting recommendations and treatment options available, improving health-related quality of life. Further, the methods have had global impact: they are also recommended and used in submissions to healthcare reimbursement agencies in several other countries [a][b][f], in both insurance- and state-funded health systems, enabling better-informed decisions and supporting equitable and optimum resource allocation by health service purchasers around the world.

Use of UoB methods in NICE Technology Appraisals (TAs) and Clinical Guidelines (CGs)

Two reviews by UoB of the evidence synthesis methods used in all NICE Technology Appraisal (TA) guidance issued [d] and all NICE Clinical Guidelines (CGs) published [e] between 1 October 2017 and 30 September 2020, have determined the percentage that used UoB’s methods [1-6]. The results, presented below, are based on the145 TAs [d] and 62 CGs [e] that were either new guidance or updated guidance containing new analyses during that period.

Network meta-analysis (NMA) methods

NMA was conducted in 51% of the TAs [d]. Across a variety of clinical areas, UoB’s NMA methods [1] were cited in 36.6% and implemented in 35.9% of all TAs [d], and cited and implemented in 33.9% of CGs [e]. We can expect the use of UoB’s NMA methods to be similar for the earlier part of the current REF period (August 2013-September 2017), given that these recent results are in line with those from an earlier analysis (2009-2013), conducted for the research group’s REF2014 Impact Case Study [j]. Among the 2017-2020 CGs, automated node-splitting method to assess inconsistency [2] was cited in 21% of CGs and implemented in 11.3% of CGs [e]. UoB’s review, critique and recommendations for population adjustment indirect comparisons [3] was cited in 24.8% of TAs and implemented in 19.3% of TAs [d].

Reconstruction of survival curve data

UoB’s algorithm to reconstruct survival data from published Kaplan-Meier curves [4] has been widely used in submissions to NICE TAs, cited in 32.4% of TAs and implemented in 31% of TAs [d]. The algorithm was cited and implemented in 3.2% of CGs [e].

Risk of bias of RCTs and non-randomised evidence

The risk of bias tool for RCTs [5] is cited in 22.8% of TAs and implemented in 20.0% of TAs [d]. It is cited in 50% of CGs and implemented in 83.9% of CGs [e]. The ROBINS-I risk of bias tool for non-randomised studies [6] is cited in 19.4% of TAs and implemented in 16.1% of TAs [d] and cited and implemented in 9.7% of CGs [e].

Illustrative examples of impact arising from NICE TAs and CGs using UoB methods

TA384 Nivolumab for advanced melanoma / TA417 Nivolumab for treated or metastatic renal cell carcinoma

In TA384, Bristol Myers Squibb used the Guyot algorithm [4] to reconstruct survival data to inform the indirect comparison between two forms of treatment for renal cell carcinoma (a kidney cancer): nivolumab and BRAF inhibitors in BRAF mutant positive patients (p.178 of committee papers [g] reference 196). The Evidence Review Group (ERG) considered use of the method to be appropriate (pp. 445-6 in committee papers [g] ref 26), noting that it allows different survival curves to be fitted and compared. They further note that costs of the BRAF inhibitors were sensitive to this choice (costs differ by about GBP18,000, p 488 and p.500 committee papers **[g]**), but that nivolumab remained cost-effective (p.505 of committee papers [g] section 4.3.2). The company used the Cochrane risk of bias tool [5] to critically appraise the included studies (pp. 447-8 of committee papers **[g]**). The committee concluded that nivolumab is likely to cost less than an additional GBP30,000 per quality adjusted life year gained compared with existing treatment options and recommended it as a cost-effective option for the NHS. The NICE impact report for cancer [g] (Figure on p.10 of the report) showed there was a rapid increase in prescriptions of nivolumab after the TA384 guidance was issued in February 2016, from 100,000mg in early 2016 to over 300,000mg within just a few months. This indicates that patients are benefiting from the increased quality of life that nivolumab brings. A similar increase in prescriptions was seen for TA417 (Nivolumab for treated or metastatic renal cell carcinoma) issued in November 2016 [g] which also used the Guyot algorithm [4] (p.459 of committee papers).

TA510 Daratumumab monotherapy for treating relapsed and refractory multiple myeloma

For this TA, individual participant data were obtained for the comparator treatments for multiple myeloma (a bone marrow cancer): (POM+DEX) and (PANO+BORT+DEX) using the Guyot algorithm [4]; this enabled estimation of hazard ratios comparing daratumumab with existing treatment options, which would not otherwise be possible (p.213 committee papers **[h]**). The company performed a matched adjusted indirect comparison (MAIC), which the Evidence Review Group (ERG) critiqued using Phillippo et al [3], highlighting the high level of uncertainty in the MAIC and the need to adjust for more factors and seek validation (pp. 688-9 or the committee papers **[h]**). The company adjusted for additional factors but was unable to validate the adjustment method (pp. 9-10 4.12 final appraisal determination document **[h]**). The committee recommended managed access through the Cancer Drugs Fund to collect data to resolve some of the uncertainties around clinical effectiveness, including the MAIC, as highlighted by the ERG using Phillippo et al [3] (pp. 20-23 final appraisal determination document **[h]**). It is predicted that 705 patients per annum will benefit from access to daratumumab while data are collected to determine if it is a clinically and cost-effective treatment for routine commissioning on the NHS (p.3 section 3.3 managed access agreement **[h]**).

NG158 Venous thromboembolic diseases: diagnosis, management and thrombophilia testing

Recommendations on pharmacological treatment in people with suspected or confirmed deep vein thrombosis and/or pulmonary embolism employed NMA to compare multiple interventions using methods and code from [1] (p.17 point 20 and Appendix O of Document D **[i]**). The automated node-splitting algorithm [2] was used to assess the consistency assumption (p.754 of Document D **[i]**). The Cochrane risk of bias tool [5] was used to assess the RCTs and quasi-RCTs, and the ROBINS-I tool [6] was used to assess the other studies (p.128 of Document D **[i]**). The resource impact report published in March 2020 [i] resulting from recommendations 1.3.8, 1.3.15, 1.3.17 (informed by Document D **[i]**), is estimated to save GBP0.4 million in 2020/21, rising to a saving of GBP2.1 million in 2024/25 (p.3 Resource Impact Report, Table 1 (total a+b) **[i]**).

Use of UoB methods by reimbursement agencies globally

UoB have further reviewed methods guidance for evidence synthesis in submissions to reimbursement agencies (similar to NICE for England and Wales), issued between 2014 and 2020, in Australia (Pharmaceutical Benefits Advisory Committee), Canada (Canadian Agency for Drugs and Technologies in Health), France (Haute Autorité de Santé), Germany (Institut für Qualität und Wirtschaftlichkeit im Gesunheitwesen), Ireland (Health Information and Quality Authority), the Netherlands (Zorginstituut Nederland), the USA (Agency for Healthcare Research and Quality), and the World Health Organisation (WHO) [f]. The Technical Support Document Evidence Synthesis (TSD-ES) series and corresponding Medical Decision Making papers [1] are cited in the methods guidance in Canada, England and Wales, France, Germany, Ireland, the Netherlands, and the USA [f]. The automated method for node-splitting to assess inconsistency [2] is cited in the methods guidance in Ireland, the Netherlands, and the USA [f]. TSD18 [3] and the corresponding paper on population adjusted indirect comparisons is cited in the methods guidance in England and Wales, France, and Ireland [f]. The algorithm to reconstruct survival data from published survival curves [4] is cited in the methods guidance in Canada [f]. The risk of bias tool for RCTs [5] is cited in the methods guidance in Australia, Ireland, the USA and the WHO, and the updated version 2 tool (published in 2019) is cited in the methods guidance in England and Wales [f]. The ROBINS-I tool [6] is cited in the methods guidance in Australia, England and Wales, the USA, and the WHO [f]. The use of UoB methods in international submissions in France, Sweden, Canada, Australia, South Korea and the USA is confirmed in letters from pharmaceutical firms AstraZeneca and Eli Lilly [a], and the consultancy firms Precision Health Economics and Outcomes Research and Clifton Insight [b].

Commercial impact

The use of methods developed by UoB researchers by pharmaceutical firms in about 36% of all submissions to NICE TAs [d] represents a substantial impact in supporting commercial activity, confirmed in the letters from pharmaceutical companies [a] and consultancy companies [b]. These methods are used in submissions to other reimbursement organisations worldwide [a][b][f].

5. Sources to corroborate the impact

[a] AstraZeneca (2021) Supporting letter – Statistical Innovation Group, Oncology Data Science & Analytics

Eli Lilly (2021) Supporting letter – Principal Research Scientist

[b] Precision Health Economics and Outcomes Research (2021) Supporting letter – Chief Scientist

Clifton Insight (2021) Supporting letter - Director

[c] NICE Centre for Guidelines (2020) Supporting letter - Senior Technical Adviser (Health Economics)

NICE Centre for Health Technology Evaluation (CHTE) (2021) Supporting letter – Deputy CEO and Director of CHTE

[d] Review of evidence synthesis methods used in all NICE Technology Appraisal (TA) guidance issued 1/10/17 – 30/9/20

[e] Review of evidence synthesis methods used in all NICE Clinical Guidelines (CGs) published 1/10/17 – 30/9/20

[f] Review of Guidance on Methods for Evidence Synthesis for International Reimbursement Agencies

[g] Nivolumab for advanced melanoma (TA384) and renal cell carcinoma (TA417) evidence:

NICE (2015) TA384 committee papers

NICE (2018) Impact Report for Cancer

NICE (2016) TA417 committee papers

[h] Daratumumab for relapsed and refractory multiple myeloma (TA510) evidence:

NICE (2017) TA510 Committee papers

NICE (2017) Final appraisal determination document

NICE (2019) Managed access agreement

[i] Pharmacological treatments for venous thromboembolic diseases (NG158) evidence:

NICE (2020) Document D: Pharmacological Treatment

NICE (2020) Resource impact report

[j] REF2014 (2014) Patients, organisations providing clinical guidelines, and commercial

companies benefit from new approach to comparing multiple healthcare options

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

In 2016, the ProtecT (Prostate testing for cancer and Treatment) trial published the first and only robust randomised evidence about clinical and patient-reported outcomes following surgery, radiotherapy, and active monitoring treatments for clinically localised prostate cancer. These results have provided men and clinicians with comparative information showing similar risks of mortality and different risks of metastases, disease progression, and harms to sexual, urinary, and bowel function and quality of life caused by treatments, at a median of 10 years’ follow-up. ProtecT trial evidence has changed health policy and clinical practice through updated guidelines and optimised treatment. ProtecT continues to improve patient health and care by enabling informed and evidence-based treatment decision-making.

2. Underpinning research

Prostate cancer is a common disease in older men and over 11,000 die from it each year in the UK. Around 25,000 men each year are diagnosed with clinically localised disease (confined within the prostate gland), often after having a blood test for PSA (Prostate Specific Antigen). Many of these cancers remain small and slow growing during a man’s lifetime, but some become aggressive and life-threatening. Curative radical surgery or radiotherapy can be given, but they can cause damaging side-effects to sexual, urinary and bowel function. Some clinicians wanted to develop programmes of monitoring/surveillance to avoid or delay radical treatment and its effects until/unless needed. Randomised trials to evaluate these very different treatment approaches were urgently needed.

ProtecT, funded by NIHR, is the first and only randomised trial aiming to compare active monitoring, radical surgery, and radical radiotherapy in men diagnosed with localised prostate cancer. From 2001 to 2009, over 111,000 men attended a ProtecT study appointment in general practices around nine UK cities and 82,429 men received a PSA-test. After imaging and prostate biopsies, 2,664 men were diagnosed with localised prostate cancer and, of these, 1,643 (62%) agreed to be randomised between surgery, radiotherapy, and active-monitoring in the ProtecT trial [1]. The primary outcome was defined as prostate cancer mortality at a median of 10-years’ follow-up, data were collected on a wide range of clinical secondary outcomes [2], and men completed validated urinary/sexual/bowel function and quality-of-life patient-reported outcome measures (PROMs) each year [3].

Key findings related to impact

ProtecT outcomes were published in 2016 [4, 5], finding very low levels of prostate cancer mortality (<1%) at a median of 10 years’ follow-up, and no evidence of a difference between surgery, radiotherapy, and active-monitoring. There were also no differences between the groups in all-cause mortality, but there was a higher rate of metastases (cancer spread) in the active-monitoring group (6%) compared with 3% in each of the surgery and radiotherapy groups [4]. Sexual, urinary and bowel problems were quantified by PROMs, with the highest rates of incontinence and impotence in the surgery group, and a high rate of impotence and some bowel symptoms in the radiotherapy group [5]. In the active-monitoring group, there was an expected gradual decline in sexual and urinary function with age, but serious functional problems were avoided unless men changed to a radical treatment during follow-up [5]. The ProtecT results thus provided robust evidence about the comparative risks of harms to sexual, urinary and bowel function caused by radical treatments, balanced against the small increased risk of progression and metastases from active monitoring [4, 5].

Clinically localised prostate cancers are usually categorised into two groups indicating whether they are at a lower or higher risk of cancer progression and spread. Policy and practice has increasingly tried to optimise treatment and reduce harms caused by ‘over-treatment’ (radical treatment not needed by men with low-risk cancer), and ‘under-treatment’ (radical treatment not given when needed for intermediate/high-risk cancer). As 66% of ProtecT participants had low-risk and 34% intermediate/high-risk disease [6], the study’s results have addressed both issues.

Key researchers

The ProtecT study is a collaboration between the Universities of Bristol, Oxford, and Cambridge. Co-Principal Investigators are Donovan (Bristol), Hamdy (Oxford), Neal (Cambridge/Oxford). Oxford/Cambridge researchers contributed clinical expertise. University of Bristol researchers contributed trial design/conduct and methodological expertise (Lane - trial coordination, Metcalfe/Peters - statistics, Noble - health economics, Blazeby - quality of life, Martin - epidemiology, and Wade - qualitative research).

3. References to the research

[1] Donovan JL, Young GJ, Walsh EI, Metcalfe C, Lane JA, Martin RM and 26 members of the ProtecT study group. A prospective cohort and extended comprehensive-cohort design provided insights about the generalizability of a pragmatic trial: the ProtecT prostate cancer trial. Journal of Clinical Epidemiology, 2018, 96: 35-46. DOI: 10.1016/j.jclinepi.2017.12.019

[2] Lane JA, Donovan JL, Davis M, Walsh E, Dedman D, Down L, Turner EL, Mason MD, Metcalfe C, Peters TJ, Martin RM, Neal DE, Hamdy FC & ProtecT study group. Active monitoring, radical prostatectomy, or radiotherapy for localised prostate cancer: study design and diagnostic and baseline results of the ProtecT randomised phase 3 trial. Lancet Oncology, 2014; 15, 10: 1109-18. DOI: 10.1016/S1470-2045(14)70361-4

[3] Lane JA, Metcalfe C, Young G, Peters TJ, Blazeby J, Avery K, Dedman DJ, Down L, Mason MD, Neal DE, Hamdy FC. & Donovan JL. Patient-reported outcomes in the ProtecT randomised trial of clinically localised prostate cancer treatments: study design and baseline urinary, bowel and sexual function and quality of life. BJUI Urological Oncology, 2016; 118: 869-879. DOI: 10.1111/bju.13582

[4] Hamdy FC, Donovan JL, Lane A, Mason M, Metcalfe C, Holding P, Davis M, Peters TJ, Turner EL, Martin RM and 26 members of the ProtecT study group. 10-year outcomes after monitoring, surgery, or radiotherapy for localized prostate cancer . New England Journal of Medicine. 2016; 375, 15: 1415-1424. DOI: 10.1056/NEJMoa1606220

[5] Donovan JL, Hamdy FC, Lane A, Mason M, Metcalfe C, Walsh E, Blazeby J, Peters TJ, and 26 members of the ProtecT study group. Patient-reported outcomes after monitoring, surgery, or radiotherapy for prostate cancer. New England Journal of Medicine, 2016; 375, 15: 1425-1437. DOI: 10.1056/NEJMoa1606221

[6] Bryant RJ, Oxley J, Young GJ, Lane JA, Metcalfe C, Davis M, Turner EL, Martin RM, and 14 members of the ProtecT study group and Donovan JL, Hamdy FC. The ProtecT trial: analysis of the patient cohort, baseline risk stratification and disease progression. BJUI 2020, 125: 506-514. DOI: 10.1111/bju.14987

Grant: Hamdy FC, Donovan JL, Neal DE (co-PIs), Peters TJ, Martin RM, Lane JA, Metcalfe C, et al. The ProtecT trial: a multi-centre randomised controlled trial of treatments for localised prostate cancer. NIHR HTA Programme (Ref: 96/20/06 & 96/20/99) 1/5/2001-30/6/2021. Sponsor: Oxford University. Value: GBP39.4 million.

4. Details of the impact

The ProtecT trial outcome papers published in 2016 [4, 5], provided the first (and only) clear and robust comparative evidence about the risks and benefits of the three major treatments for localised prostate cancer. ProtecT had the following impacts: (a) changed health policy to influence clinical practice, (b) changed clinical practice to avoid harm and optimise treatment, and (c) continues to improve health and care by enabling informed evidence-based treatment decisions:

(a) Changed health policy to influence clinical practice

Publication of the ProtecT outcomes led to UK NICE launching an exceptional review “to determine the clinical and cost-effectiveness of treatments for localised prostate cancer”, directly referring to ProtecT as “the only UK-based study, making it directly applicable to current practice in the NHS” [A p.11]. An updated guideline: NG131 Prostate cancer: diagnosis and treatment was issued in 2019 [B] with changes to three major recommendations based on ProtecT evidence:

  1. Treatment of low-risk prostate cancer2019-NG131 new recommendation was to “offer a choice between active surveillance, radical prostatectomy or radical radiotherapy to people with low-risk localised prostate cancer for whom radical treatment is suitable” [B p.13]. (Changed from 2014-CG175: “offer active surveillance… as an option to men with low-risk localised prostate cancer”) [C].

  2. Treatment of intermediate-risk prostate cancer2019-NG131 new recommendation was to “offer radical prostatectomy or radiotherapy and consider active surveillance for people with intermediate-risk localised prostate cancer” [B p.19].

(Changed from 2014-CG175: “consider active surveillance for men with intermediate-risk localised prostate cancer”) [C].

  1. Informing evidence-based treatment decision-making2019-NG131 new recommendation advising clinicians and patients to use Table 3, comprising “factors to consider … using evidence from a large UK trial (ProtecT) … to discuss the benefits and harms of each treatment option” when deciding on treatment for low- and intermediate-risk prostate cancer [B].( No such Table was included in 2014-CG175) [C].

Major international clinical guidelines rapidly incorporated ProtecT results, e.g.:

  • American Urological Association/American Society for Radiation/Society of Urologic Oncology, 2017, citing ProtecT evidence for treatment of localised prostate cancer [Di].

  • European Association of Urology/European Society for Radiation Oncology/ European Society of Urogenital Radiology/International Society of Geriatric Oncology, 2017, citing ProtecT “level 1 data to help patients navigate the choice between active monitoring and treatment, and balance the risks and benefits” [Dii p.8].

  • US Preventive Services Task Force recommendation of “individual decision by men” for prostate cancer screening, referring to evidence of “overdiagnosis, overtreatment, and treatment complications” from ProtecT, [Diii p.1902].

(b) Changed clinical practice and avoided harm by reducing over-treatment

Before ProtecT, studies in the UK and USA showed that over 90% of men diagnosed with localised prostate cancer received radical treatment, usually surgery. As ProtecT recruited successfully (2001-9), there was growing awareness of the need to reduce the level of radical treatment. NICE guidelines in 2008 and 2014 relied on expert opinion (including from ProtecT investigators) to “offer” active surveillance as an option, particularly for men with low-risk disease. Further, in 2014, the National Prostate Cancer Audit (NPCA) was established to assess the quality of services in England and Wales. NPCA set a major benchmark – to “reduce over-treatment of men with low-risk prostate cancer” – by auditing the percentage of men with low-risk prostate cancer receiving radical treatment. NPCA estimated 28% of men were over-treated in 2014 [Ei]. In 2016, it was 12%, and NPCA authors commented, “the proportion of men with low-risk disease being potentially ‘over-treated’ is an area of concern, especially given the recent publication of the ProtecT study,” [Ei p.47-8]. In the years after the publication of ProtecT, over-treatment reduced further to 8% in 2017, and to 4% in 2018 and 4% again in 2019 [Eii].

In addition, NPCA reported serious concern that over-treatment varied so widely (from 0% to 94%) across the 51 hospital-clusters in England [Ei]. Following ProtecT study publication, geographical variation in over-treatment largely disappeared (0% to 16%), with no concerning outliers [Eii, Figure 2].

(c) Continues to improve patient health and care through informed evidence-based treatment decision-making

Men newly diagnosed with clinically localised prostate cancer, their families, and the clinicians involved in prostate cancer care (urologists, oncologists, nurses, and general practitioners) can now consider the comparative benefits and harms of the main treatment modalities based on robust evidence from the ProtecT study to inform treatment decision-making. They can balance the clear risks of treatment harms and benefits in the context of similar very low levels of mortality risk, based on ProtecT trial evidence [4, 5]. This affects the decision-making of over 23,000 men diagnosed each year with low- or intermediate-risk prostate cancer in England alone [Eii]. Guidelines across the UK [B], Europe and the USA [D] encourage consideration of the ProtecT evidence in decision-making indicating wide reach and impact.

ProtecT evidence also directly reached men through over 400 media stories (review of 33 published within 30 days [Fi]), popular prostate cancer charity websites (such as Cancer Research UK [Fii] and Prostate Cancer UK [Fiii]), and the high social media presence of the study [Fiv] (paper [4] ranked 5th for social media impact in 2017 (63rd in 2020)).

ProtecT evidence reached clinicians and service providers through high citation papers (1,500 [4] and 700 [5], with paper [4] being listed as one of the NEJM’s 12 notable articles of 2016 [Gi] and Altmetric’s 22nd most impactful paper globally that year [Gii]); and through editorials in key specialist clinical journals [H] as well as updated guidelines [B, D].

Summary: ProtecT outcomes published in 2016 changed clinical practice and health policy, and the evidence continues to improve patient health and care by optimising treatment and enabling informed evidence-based treatment decision-making.

5. Sources to corroborate the impact

[A] NICE (2019). NICE Guideline [NG131]: [G] Evidence review for active surveillance, radical prostatectomy or radical radiotherapy in people with localised prostate cancer

[B] NICE (2019). NICE Guideline [NG131]: Prostate cancer: diagnosis and management

See Table 3 and pp.13-19 for references to ProtecT

[C] NICE (2014). CG175 Prostate cancer diagnosis and treatment

[D] i) American Urological Association, American Society for Radiation, Society of Urologic Oncology (2017). Clinically Localized Prostate Cancer: AUA/ASTRO/SUO Guideline

ProtecT references [4 (50), 5 (41) (and 52)] - these cited as providing evidence for guideline recommendations numbers 4, 7, 9, 16, 19, 29, 33.

ii) EAU-ESTRO-ESUR-SIOG (European Association of Urology-European Society for Radiation Oncology-European Society of Urogenital Radiology-International Society of Geriatric Oncology) prostate cancer guidelines panel. Prostate cancer and the ‘John West’ effect. European Urology 2017; 72: 7-9. DOI: 10.1016/j.eururo.2017.02.006

ProtecT references [4, 5] cited (p.8).

iii) US Preventive Services Task Force. Screening for prostate cancer. JAMA. 2018; 319 (18): 1901-1913. DOI: 10.1001/jama.2018.3710 ProtecT references [4, 5] cited (p.1902).

[E] National Prostate Cancer Audit (NPCA) for England and Wales:

i) Annual Report 2016 and

ii) Annual Report 2019

[F] Media:

i) Westerman et al. Media reporting of ProtecT: a disconnect in information dissemination? Prostate cancer and prostatic diseases 2017: 1-6. DOI: 10.1038/pcan.2017.27

ii) CRUK (2016). A trial comparing treatment approaches for prostate cancer (ProtecT)

iii) Prostate Cancer UK (2016). Long-term study shows active surveillance offers same 10-year survival rate as radiotherapy or surgery

iv) ProtecT paper [4] ranked 5th for social media impact in 2017 (63rd in 2020) https://www.nejm.org/doi/metrics/10.1056/NEJMoa1606220

[G] Citations:

i) New England Journal of Medicine (NEJM) (2017). Notable Articles of 2016 ProtecT paper [4] listed in 12 “most notable” 2016 NEJM papers

ii) Altmetric (2016). Article #22 of 100 ProtecT paper [4] listed 22nd in Top 100 Articles of 2016 by Altmetric

[H] Editorials (small selection):

i) Albertsen P. Who Should Consider Active Surveillance? J Urology, 2016, 196:1604-5. DOI: 10.1016/j.juro.2016.09.068

ii) Spratt DE. To ProtecT our patients with prostate cancer. JAMA Oncology, 2017, 3:1461-2. DOI: 10.1001/jamaoncol.2017.0274

iii) Wang et al. ‘ProtecTion’ from over-treatment: does an RCT finally answer the question in localized prostate cancer? BJU International, 2017, 119:513–514. DOI: 10.1111/bju.13734

iv) Cooperberg MR. What early ProtecT results have confirmed about risk-stratified prostate cancer management. European Urology, 2017; 71:389-90. DOI: 10.1016/j.eururo.2016.10.017

v) Sharma V, Karnes TJ. To serve and ProtecT: has the pendulum swung too far towards surveillance? European Urology, 2020, 77:331-2. DOI: 10.1016/j.eururo.2019.12.007

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

As the global use of in vitro fertilisation (IVF) increased, it was crucial to determine which IVF treatments work best in which circumstances, to inform couples, funders and stakeholders. To address these challenges, Lawlor and colleagues implemented novel analytical approaches in the Human Fertilisation and Embryology Authority (HFEA) register data, working with key stakeholders to enhance the evidence underpinning IVF treatment, and this research has led to substantial changes in clinical practice. The research helped to stimulate a 15 percentage point increase in the number of single embryo transfers in the UK over the period 2013-2016 (from 45% to 60%), with associated reductions in multiple pregnancies and preterm births. Furthermore, the work supported NHS Scotland’s decision to increase NHS-funded IVF cycles from two to three and reduce variation in IVF provision in Scotland.

2. Underpinning research

One in six couples are infertile. In vitro fertilisation (IVF) is a routine treatment for most forms of infertility. However, it is time consuming and emotionally demanding for couples, with rates of livebirth per cycle in high income countries of 25-40% (depending on prognostic factors, in particular a woman’s age). Costs per cycle are relatively high, and NHS provision is limited; across the UK, 60% of cycles are couple-funded, though with considerable geographic variation. Providers often use surrogate markers of success (including fertilisation or pregnancy rate) in marketing to couples. Hence couples, funders and stakeholders have identified the need to determine which IVF treatments work best and in which circumstances. Randomised controlled trials (RCTs) in reproductive medicine rarely, if ever, have adequate power to detect reasonable target differences in the key outcome of live-birth rates; indeed, only 2% of meta-analyses of such RCTs have been shown to have sufficient power in this respect. Moreover, no previous observational studies had explored whether the associations between the number of embryo transfers and various outcomes differed according to maternal age.

To address these research challenges, Lawlor and colleagues have undertaken a series of analyses using a comprehensive UK-wide dataset of all IVF cycles taking place since 2003. This body of research has demonstrated the following.

Determined the effect of single, two or three embryo transfers on live-birth success and perinatal outcomes [1]. Multiple embryo transfer increases clinical pregnancy rates, incentivising providers and patients. Yet, multiple pregnancy arising from multiple embryo transfer is associated with adverse outcomes for the baby. Lack of evidence on the balance between live-birth success and adverse perinatal outcomes with different numbers of embryos transferred in one treatment led to widespread variation in embryo transfer practice nationally and globally. By 2010 it was recognised (by couples, clinicians and funders) that the question of whether it was best to transfer one or more embryos was of paramount importance and two large RCTs were funded (one in the UK and one in Australia). Both of these RCTs were stopped early because of failure to recruit. The UK trial recruited just 23 of a planned 700 participants, and the Australian trial just 27 of a planned 1000 participants. Recruitment was poor because of couple treatment preferences – for double embryo transfer in the UK and single in Australia. In any case, neither trial would have addressed the best practice for women aged over 37 years, since they were excluded. Previous observational studies also lacked power to detect effects in women over the age of 40 years, for whom a double transfer may be the last opportunity to complete a family of two children.

Using data on 124,148 IVF cycles, which resulted in 33,514 live-births, Lawlor and colleagues showed that in women younger than 40 years, a single fresh embryo transfer, followed by subsequent single frozen transfer, resulted in an equivalent live-birth rate and lower risk of harm (fewer multiple births, preterm births and small for gestational age babies), compared with those occurring following a double embryo transfer. Furthermore, for the first time, they showed that in women aged 40 years or older, double embryo transfer resulted in a higher live-birth rate and lower risk of harm than single embryo transfers [1]. In both age groups, transfer of three embryos reduced live-birth rates and increased adverse outcomes [1]. It was recommended that single embryo transfer should be the routine approach in women younger than 40 years and a double embryo transfer the norm in those older than 40 years, with triple transfers phased out.

Determined the benefit of repeat treatment cycles, including how many cycles were required to obtain a live-birth rate similar to that in couples conceiving naturally, and whether it was worth continuing with further cycles if an initial cycle failed to yield oocytes [2]. Using prospectively collected UK-wide data on over 150,000 women collected over nearly a decade from 2003, Lawlor and colleagues showed that the cumulative live-birth rate in all women continued to increase up to nine cycles. In women younger than 40 years (and of any age using donor eggs), couples could achieve a cumulative live-birth rate (68%) similar to that of couples conceiving naturally with six cycles [2]. This provided the evidence for funding more than one or two cycles and has made demonstrable differences in Scotland where up to three cycles per couple are now NHS-funded. The research also challenged traditional assumptions that low or zero egg retrievals in a cycle implied that further cycles should be limited as live-birth was unlikely. Contrary to these assumptions, Lawlor’s team found that egg retrieval for each cycle was independent; in other words, zero retrieval in one cycle did not influence live-birth success in subsequent cycles [2].

Identified accurate predictors of live-birth success using data from 144,018 IVF cycles. Lawlor and colleagues identified key characteristics associated with live-birth rates relating to couples (e.g. woman’s age, nature and duration of infertility) and treatments (e.g. use of donor eggs and intracytoplasmic sperm injection (ICSI)) . In addition, they elucidated how these factors interacted with each other – for example, the increased live-birth rates with donor eggs were apparent at all ages but strongest at older ages, and ICSI increased live-birth rates in those with male-related infertility [3]. The prediction model these researchers developed was found to predict outcomes with greater accuracy than the existing model, not just in their original research but also in an external validation study they carried out on 130,960 cycles in the UK[4]. They have also produced an online tool and smart phone app based on their prediction model, for use by couples and clinicians.

3. References to the research

  1. Lawlor DA, Nelson SM. Effect of age on decisions about the numbers of embryos to transfer in assisted conception: a prospective study. Lancet, 2012; 379: 521-527. DOI: 10.1016/S0140-6736(11)61267-1

  2. Smith ADAC, Tilling K, Nelson SM, Lawlor DA. Live-birth rate associated with repeat in vitro fertilization treatment cycles. JAMA, 2015; 314: 2654-2662. DOI: 10.1001/jama.2015.17296

  3. Nelson SM, Lawlor DA. Predicting live birth, preterm delivery, and low birth weight in infants born from in vitro fertilisation: a prospective study of 144,018 treatment cycles. PLoS Medicine, 2011; 8(1): e1000386. DOI: 10.1371/journal.pmed.1000386

  4. Smith AD, Tilling K, Lawlor DA, Nelson SN. External validation and calibration of IVFpredict: a national prospective cohort study of 130,960 in vitro fertilisation cycles. PLoS One, 2015; 8;10(4):e0121357. DOI: 10.1371/journal.pone.0121357

4. Details of the impact

Reduced IVF related multiple birth rate in the UK

Lawlor and colleagues’ research demonstrating the benefit of single embryo transfer in women younger than 40 years, and of a double transfer in older women, has enhanced the efforts of the HFEA to increase single embryo transfer and hence reduce harm associated with IVF [A-D].

Between 2008 and 2012, single embryo transfer in the UK increased from 18% to 45%, and multiple birth rates decreased from 25% to 15% by 2011 [A]. These improvements became static from 2011 and transfer of three embryos was more common in the UK than most European countries [A]. The HFEA used findings from Lawlor and colleagues’ research [1] to promote single embryo transfers in younger women and double transfer in older women. This has led to a further increase in single embryo transfers (45% to 60% from 2013 to 2016) and associated decreases in multiple pregnancies and multiple births [B, C]. The Chief Executive of HFEA describes the importance of the research in ‘providing continued momentum for our campaign to promote ‘one at a time’ embryo transfers and see IVF related multiple births, with their associated risk of preterm birth and low birth weight, reduced.’ [D]. The statement further confirms the continued declines in multiple births, with HFEA’s target of a maximum 10% of live-births being multiple births achieved by 2017 and further declining to 8% by 2018 [D].

Changing practice in relation to repeat treatment cycles

Prior to work by Lawlor and colleagues, governments and insurance companies internationally limited the number of IVF cycles they would fund. In the UK there was variation across countries, and by clinical commissioning groups (CCG) within England, with no country/CCG providing NHS funding for more than two cycles. Clinicians and funders cautioned against further cycles (even when couple-funded) following a cycle where no eggs were retrieved. Lawlor and colleagues’ research, showing that live-birth rates continued to increase with successive IVF cycles, regardless of the number of oocytes retrieved [2], was cited by the Scottish National Infertility Group in their 2016 government report to request an increase in the number of NHS-funded treatment cycles [E (p.17)]. This resulted in Scotland changing its guidelines to recommend up to three (from the previous limit of two) full cycles for eligible patients to be funded by the NHS from 2017 [F]. As a result of these changes, equity of access to IVF and the number of cycles funded by the NHS in Scotland increased, such that by 1st April 2017, all newly referred couples who were eligible were provided with up to three NHS-funded cycles [F]. Since publication of this response to Lawlor and colleagues’ research, the proportion of all IVF cycles in Scotland funded by the NHS has increased from 56% to 62% [G]. The action by Scotland was welcomed by patient support groups, ‘We commend the Scottish Government both for recognising the importance of treating this medical condition, and for taking action to help the one-in-six couples affected by infertility’ [H].

Lawlor and colleagues’ research made a major contribution to NICE (supported by the HFEA, the Royal College of Obstetrics and Gynaecology (RCOG) and patient groups) increasing pressure on CCGs to implement NICE guidelines. Lawlor and colleagues’ research [3, 4] and bespoke analyses undertaken by Lawlor for NICE, contributed to the economic evaluation used by NICE Fertility guidance (CG156) on access criteria for IVF (Chapter 14) (2013). On the basis of that economic evaluation NICE recommended, for the first time, that funding be provided by the NHS for up to three IVF cycles. In subsequent revisions of those NICE guidelines (in 2015 and 2017) presentation of Lawlor’s economic evaluation remained, and there is greater emphasis on the recommendation that up to three cycles be NHS-funded [Ii]. Lawlor and colleagues more recent (2015) research, showing continued increases in live-birth success with repeat cycles [2], has been used by NICE to further emphasize to CCGs in England why funding three cycles is important [Iii]. In conjunction with the RCOG and patient groups, the HFEA have directly issued guidance to each CCG in England, notifying them of the strong evidence and NICE guidelines, meaning it is imperative that they support up to three IVF cycles [D, J]. The Chief Executive of HFEA notes that ‘As an authority with a remit to support equitable and fair access to infertility treatments, we value research, such as this by Prof Lawlor and colleagues, that we have been able to use in our guidance to commissioning groups in England.’ [D].

5. Sources to corroborate the impact

  1. HFEA (2015). Improving outcomes for fertility patients: multiple births [accessed 30.10.20].

Report and associated data for download were used to estimate changes in single embryo transfers and multiple births from 2008 to mid-2013 – i.e. to provide a baseline against which our research subsequently influenced change.

  1. HFEA (2018). Fertility treatment 2014 – 2016 trends and figures [downloaded 30.12.20]. HFEA registry data used to analyse change in use of single embryo transfers and multiple births with IVF from 2013 to 2016 (for comparison with baseline data obtained from A above).

  2. HFEA (2020). Fertility treatment 2018: trends and figures [accessed 30.12.20].

UK statistics for IVF and DI treatment, storage, and donation. Human Fertilisation and Embryology Authority. Providing data on SET and multiple pregnancy rates for 2017.

  1. HFEA (2020). Submitted testimony from the Chief Executive of the HFEA.

  2. National Infertility Group (2016). National Infertility Group Report [accessed 30.12.20].

Report to the Scottish Government recommending that they increase the number of NHS-funded IVF cycles agreed by them an implemented in 2017. Cites Figure 2 [2] (p.17).

  1. NHS Scotland (2018). Chief Executive’s Annual Report 2017/18 [accessed 30.12.20].

  2. HEFA (2019). Fertility treatment 2017: trends and figures [accessed 30.12.20].

Used to obtain data on changes in the proportion of cycles funded by the NHS in devolved UK countries between 2015 and 2017.

  1. i) BBC (2017). Scottish government to fund three IVF cycles on NHS [accessed 30.12.20].

Action of the Scottish government widely reported in the media.

ii) Fertility Fairness (2017). Gold standard: Scotland the first country to provide 3 NHS-funded IVF cycles for all eligible couples [accessed 30.12.20].

Action also praised by patient groups.

  1. i) NICE (2013, 2015, 2017). CG156 Fertility problems: assessment and treatment

Health economic model and recommendations in chapter 14, on NHS funded access to IVF and has remained in place in 2015 and 2017 revisions.

ii) NICE (2014). News: The importance of 3 full cycles of IVF [accessed 30.12.20].

Use of Lawlor’s research by NICE to re-emphasise the importance of funding three rather than two IVF cycles on the NHS.

  1. HFEA (2019). Commissioning guidance for fertility treatment [accessed 30.12.20].

Commissioning guidance regarding funding three cycles of IVF.

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Easy availability of the means of suicide and access to detailed information on suicide and self-harm are associated with high lethality suicide attempts and influence population suicide rates. University of Bristol (UoB) research has provided definitive evidence that bans on highly toxic pesticides (n=110,000 deaths/year) reduce suicide rates whilst alternative approaches to prevention are ineffective. UoB research also found that easy access to media reports and online discussion of suicide methods (viewed by around 1 in 4 adults with high suicide intent) increase suicide and self-harm rates. These findings have shaped global health, agricultural and media policy and guidance. Emerging evidence shows that pesticide bans are dramatically reducing the number of global deaths from pesticide poisoning.

2. Underpinning research

Restricting access to commonly used, highly lethal methods of suicide is one of the most effective approaches to preventing suicide. The risk of death varies enormously depending on the method used in a suicide attempt and most people do not make repeat attempts. ‘Cognitive’ as well as physical access is important. Widespread availability of information and dialogue about suicide and suicide methods on the internet and in other media increases the cognitive availability of suicide and choice of method [1].

Physical access to suicide methods: pesticide self-poisoning

Pesticide self-poisoning is one of the most frequently used suicide methods worldwide, accounting for over 110,000 deaths/year, i.e. one-in-seven of the world’s 800,000 annual suicide deaths. The risk of death following an overdose of paracetamol or most antidepressants is under 1%, whereas after taking just a tablespoonful of the toxic weedkiller Paraquat it is over 50%. The pesticide industry’s preferred approach to restricting access to hazardous pesticides is the use of lockable ‘safe-storage’ devices, rather than sales bans or regulation. Industry has promoted the ‘safe-storage’ approach in low-income countries. The University of Bristol (UoB) has conducted empirical and review-based research, in collaboration with colleagues from the University of Edinburgh, University of Copenhagen (Denmark), University of Peradeniya (Sri Lanka), the National Taiwan University, Korea University College of Medicine (South Korea); the University of Sydney (Australia) and the World Health Organization (WHO). This has demonstrated that ‘safe-storage’ of pesticides is ineffective, whereas pesticide sales bans are followed by falls in method-specific and overall suicide rates.

UoB researchers used interrupted time series models to evaluate the impact on suicide rates of pesticide bans in South Korea, Sri Lanka, and Bangladesh (all summarized in [2]). In all cases the bans were followed by falls in pesticide suicide rates (ranging from 41% in Sri Lanka to 49% in South Korea) and overall suicides (ranging from 24% in Bangladesh to 8% in Sri Lanka). In an economic cost-effectiveness modeling study using data from 14 countries carried out in collaboration with WHO, UoB researchers found that banning hazardous pesticides could result in about 28,000 fewer suicide deaths each year at an annual cost of International (I) $0.007 per capita (95% Uncertainty Interval (UI) 0.006–0.008) [3].

In the world’s largest randomised controlled trial of a suicide prevention intervention (56,000 households in rural Sri Lanka) UoB research found no evidence that providing lockable pesticide storage devices to farmers reduced the incidence of pesticide suicide [4]. After 3-years follow-up, the rate ratio (RR) for pesticide self-poisoning in intervention vs. control villages was 0.93, 95% Confidence Interval (CI) 0.80–1.08; p=0.33) and there was also no evidence of a reduction in the number of suicide deaths using all methods (RR 1.22, 95% CI 0.88–1.68]).

Cognitive access to suicide and self-harm methods: media and online representations

UoB researchers have also shown that easily accessible high-lethality methods of suicide described or discussed in media reports, websites and other online spaces can influence uptake of suicide methods in populations – a process known as ‘contagion’. For example, they found that rates of charcoal burning suicide in South Korea increased in the year following the extensively publicised suicide of a celebrity by charcoal burning, rising from <1% of suicides to 5%, possibly contributing to already rising rates of suicide in South Korea [5].

They have also demonstrated the ease of access to suicide and self-harm content on the internet. In a UK study [1], interviews with hospitalised patients who had attempted suicide showed that many had strategically researched suicide methods online. In the same study, young people with suicidal feelings or self-harm behaviour reported ‘stumbling’ across online information about suicide methods. Online help services, however, were mostly criticised by users for not meeting the specific needs of those experiencing suicidal thoughts. In a further study, UoB researchers found accessibility of information about suicide methods online increased markedly from 2007 to 2014 [6]. These findings indicated a need for further action to improve online safety and develop novel online help approaches.

3. References to the research

  1. Biddle L, Derges J, Goldsmith C, Donovan J, Gunnell D. Using the internet for suicide-related purposes: Contrasting findings from young people in the community and self-harm patients admitted to hospital. PLoS One. 2018; 13, e0197712. DOI: 10.1371/journal.pone.0197712

  2. Gunnell D, Knipe D, Chang S, Pearson M, Konradsen F, Lee W, Eddleston M. Prevention of suicide with regulations aimed at restricting access to highly hazardous pesticides: a systematic review of the international evidence. Lancet Global Health. 2017; 5, e1026-e1037. DOI: 10.1016/S2214-109X(17)30299-1

  3. Lee YY, Chisholm D, Eddleston M, Gunnell D, et al. The cost-effectiveness of banning highly hazardous pesticides to prevent suicides due to pesticide self-ingestion across 14 countries: an economic modelling study. Lancet Global Health. 2020; 9, e291-e3000. DOI: 10.1016/S2214-109X(20)30493-9

  4. Pearson M, Metcalfe C, Jayamanne S , Gunnell D, Weerasinghe M, Pieris R, Priyadarshana C, Knipe DW, et al. Effectiveness of household lockable pesticide storage to reduce pesticide self-poisoning in rural Asia: a community-based, cluster-RCT. Lancet. 2017; 390, 1863-1872. DOI: 10.1016/S0140-6736(17)31961-X

  5. Chen Y-Y, Yip PSF, Chan CH, Fu K-W, … Gunnell D. The Impact of a Celebrity's Suicide on the Introduction and Establishment of a New Method of Suicide in S. Korea. Archives of Suicide Research. 2014; 18: 221-226. DOI: 10.1080/13811118.2013.824840

  6. Biddle L, Derges J, Mars B, Heron J, Donovan J, Potokar J, Piper M, Wyllie C, Gunnell D. Suicide and the Internet: Changes in the accessibility of suicide-related information between 2007 and 2014. J. of Affective Disorders. 2016; 190: 370-375. DOI: 10.1016/j.jad.2015.10.028

Key Grants

  1. Biddle L, Gunnell D, Donovan J, Wyllie C, Potokar J. Exploring the use of the Internet in relation to suicidal behaviour: identifying priorities for prevention. Department of Health Policy Research Programme, 2013 – 2015, GBP234,496

  2. Eddleston M, Gunnell D, Metcalfe C, Hawton K, Konradsen F, Dawson A, Jayamanne S Wickremasinghe A. A community trial to determine whether 'Safe Storage' reduces pesticide self-poisoning in rural Asia. Wellcome Trust. 2010-2014, GBP1,006,000

4. Details of the impact

A. Impact on international health and agricultural policies

Global pesticide guidance

Suicide reduction is a target set by the UN’s Sustainable Development Goals (SDGs) as an indicator of healthy lives and wellbeing (SDG 3). UoB research “ has been important in

helping WHO formulate its strategy to attain the suicide reduction target” (Head, Mental Health Unit, WHO) [A]. Notably, it has been influential to UN recommendations, made by WHO and Food and Agriculture Organisation (FAO), to ban highly hazardous pesticides. The WHO/FAO’s joint guidance for pesticide regulators to prevent suicide (2019) [B] (commissioned from and co-authored by UoB researchers), draws on UoB’s research findings to state: “ Regulatory action… indicates that many suicide deaths can be prevented by bans on specific pesticides. In Sri Lanka, for instance, bans are thought to have led to 93 000 fewer suicide deaths between 1995 and 2015”. The guidance goes on to recommend: “ identifying highly hazardous pesticides for withdrawal” and “ taking regulatory actions to phase out the most hazardous pesticides”. Furthermore, the guidance cites UoB trial evidence [4] indicating that the industry-preferred alternative (lockable storage devices) is ineffective: “ The one randomized controlled trial that was large enough in scale … to test the effectiveness of lockable household pesticide storage containers found no evidence of effectiveness”.

Gunnell was a member of the WHO expert panel (2018-19) that worked with health economists to model the cost-effectiveness of pesticide regulation, concluding that “ national bans are cost-effective in countries where a high proportion of suicides are attributable to pesticide self-poisoning” [A] [3]. Based on this analysis, pesticide bans were recommended by WHO as a ‘Best Buy’ (a cost-effective and feasible intervention) for non-communicable disease at the World Health Assembly in November 2020 [A].

UoB research on preventing pesticide suicide was included in the 2016 World Bank report on suicide prevention (six UoB research papers cited) [Ci]. In addition, the WHO World Suicide Report (2014) [Cii] cited UoB evidence that pesticide regulations would result in fewer suicide death, as well as UoB’s recommendations to ban high lethality pesticides.

International pesticide bans and impact of bans on suicide rates

Governments/Ministries of Agriculture in several countries have banned highly hazardous pesticides in recent years [D]:

  1. Taiwan banned paraquat in 2018 [Di, Dii].

  2. Nepal banned aluminium phosphide and five other pesticides in 2019

  3. Malaysia banned paraquat in 2020

  4. India banned 12 highly hazardous pesticides in 2018 and a further six in 2020 [Dviii].

WHO health economists estimate that pesticide bans in the 14 countries they studied could result in an estimated 28,000 (95% UI 24,000–32,000) fewer suicide deaths each year [4]. Evidence supporting this claim is beginning to emerge. For example, in Taiwan, the annual number of suicide deaths from pesticide poisoning fell by 37% in 2019, almost 200 fewer deaths [Di]. Even larger declines have been seen in Sri Lanka [Div] and South Korea.

B. Impacts on media practice and policy

UoB researchers have raised awareness among UK policymakers, UK news journalists, and the global online industry, of the risks of contagion arising from publicising suicide and self-harm methods. As a result, UoB researchers have shaped media policy debate, journalistic practices and online media policy. These steps all promote the safety of media users by limiting access to content that could lead to suicide.

UK policy: online suicide content and user safety regulatory proposal

Evidence from Biddle and colleagues, which scoped ‘encouraging or assisting suicide’ as a distinct form of online harm, fed directly into recommendations made to Government in order to moderate harmful content and support users. The Health Select Committee Report on Suicide Prevention (March 2017) “ urges the Government to closely examine the findings of that [UoB’s] research and to report back to us on the action that it proposes to take as a result” [Ei p.35]. The 2018 All-Party Parliamentary Group on Social Media and Young People’s Mental Health and Wellbeing inquiry report, acknowledging Biddle’s contribution, recommends Government introduces a statutory code of conduct for social media providers to protect the mental health of UK users [Eii]. The UK Government White Paper on Online Harms (2019) [Eiii] subsequently proposed a new regulatory framework for online safety, which will establish “ a new statutory duty of care to make [online tech] companies take more responsibility for the safety of their users and tackle harm caused by content or activity on their services” (p.7). Specifically addressing suicide, it states “ Companies will be required to take robust action to address harmful suicidal and self-harm content that provides graphic details of suicide methods and self-harming, including encouragement of self-harm and suicide” (p.72).

UK media sector’s awareness of contagion

Working with Samaritans – a research/ policy active organisation and the only charitable provider of suicide support in the UK – UoB have delivered training sessions with local and national UK news editors and journalists to advise on how to report suicide to prevent method contagion [Fii-v]. This has included a presentation to the Independent Press Standards Organisation (IPSO) in 2016, which was reported by the Deputy Chair of IPSO in The Press Gazette [Fi], a publication for UK journalists (200,000 unique visitors to its website per month). In the article, the Deputy Chair remarks that speakers from UoB and Oxford University “ provided what was to my mind powerful evidence about the net increase in suicides due to excessive detail in both news reports and dramas” before recommending “ Next time you’re running a story on suicide please stop and consider a simple equation: weigh up the potential benefits to anybody of including those details, and the possibility that by leaving them out you might, realistically, save a life.” [Fi].

Global online provider guidelines: reducing access to suicide and self-harm content

In 2017, UoB and Samaritans co-hosted a series of awareness-raising engagements for the online industry including roundtable events held with safety and policy leads with jurisdictions encompassing the UK, Europe, the Middle East and Africa from Google, Twitter, Facebook, Wikimedia, Apple, YouTube and Instagram. This culminated in the establishment of a three-year strategic partnership between Samaritans, the online industry and the Department of Health and Social Care to improve management of suicide content online. A key output from this partnership is Samaritans’ guidelines for online providers published in 2020, with Dr Biddle as academic advisory panel member [G]. Aimed at policymakers and moderators of sites, platforms, forums and search engines hosting user-generated content, these guidelines are the first to provide best practice principles for managing self-harm and suicide content online [I].

Facebook and Instagram self-harm prevention policies

Biddle was consulted by Facebook and Instagram (over 2.7 billion and 1 billion monthly users, respectively) to provide expert input into their review of safety policies relating to self-harm content. This led to participation in an international expert roundtable and a subsequent change to Facebook’s [Hi] and Instagram’s [Hii] policies, published February 2019, and listing Dr Biddle as an advisor. Reflecting UoB’s research recommendations [1,6] the updated policies disallow users to share graphic content of self-harm. For instance, Instagram announced: “ following a comprehensive review with global experts and academics on youth, mental health and suicide prevention… We will not allow any graphic images of self-harm, such as cutting” [Hii].

Improving online help

UoB findings [1,6] around suicidal individuals’ preferences for live and immediate online help services were used to inform Samaritans’ digital strategy, which has been fundamental to the establishment of an ‘online chat’ service now running three evenings a week [I]. Samaritans receive over 3 million requests for support annually.

5. Sources to corroborate the impact

[A] WHO (2020). Supporting statement – Head, Mental Health Unit, Department of Mental Health and Substance Use

[B] WHO/FAO (2019). Preventing suicide: a resource for pesticide registrars and regulators

[C] i) World Bank (2016). Mental, Neurological, and Substance Use Disorders: Disease Control Priorities, Third Edition (Volume 4). See: Chapter 9, Suicide

ii) WHO (2014). World Suicide Report cites two UoB research papers on pesticide suicide

[D] i) National Taiwan University (2021). Supporting statement - Associate Professor, Institute of Health Behaviors and Community Sciences

ii) Chang S, Gunnell D. (2019). Banning paraquat would prevent nearly 200 deaths from suicide per year in Taiwan. Taiwanese J. Psychiatry. DOI: 10.4103/tpsy.tpsy_24_19

iii) Knipe et al. ( Gunnell) (2017). Preventing deaths from pesticide self-poisoning - learning from Sri Lanka's success. Lancet Global Health, 5. DOI: 10.1016/S2214-109X(17)30208-5

iv) Ministry of Health and Welfare, Taiwan (2019) Correspondence - Director of the Department of Mental and Oral Health

v) Nepali Times (2020). Suicide by pesticide in Nepal

vi) MalayMail (2019). Report: Govt to ban sales of paraquat from Jan 2020

vii) DownToEarth (2018). India bans 18 pesticides, has many more to go

[E] i) Minutes and presentation from APPG sessions

ii) House of Commons (2017). Health Committee: Suicide Prevention

iii) All Party Parliamentary Group (2018). #NewFilters to manage the impact of social media on young people’s mental health

iv) HM Government (2019) White Paper on Online Harms

[F] i) Press Gazette (2016). How editors can save lives by taking special care when reporting on suicide

Presentations and training examples:

ii) 10.10.17 - Invited talk (with Fraser, Samaritans) to Coalition Working Group on tackling Daesh/ISIS propaganda and use of media. Foreign and Commonwealth Office.

iii) 24.04.17 - Media influence on Suicide. Invited presentation to UK News Editors meeting at University of Derby (invitation from IPSO vice-chair). Audience – approx. 50 news editors, journalism students and IPSO members (including chair).

iv) 22.06.16 - Research and research presentation (with Hawton, Oxford, & Fraser, Samaritans) to Independent Press Standards Organisation (IPSO) Board and staff.

v) 25.06.15 - Meeting with Editor, News Editor + 8 reporters and 4-5 editors from SW papers – Cheltenham / Yeovil / Torbay etc to discuss suicide reporting (with Fraser, Samaritans).

[G] Samaritans (2020). Online harms guidelines Acknowledges Biddle, p14.

[H] i) Facebook (2019). Partnering with Experts to Protect People from Self-Harm and Suicide

ii) Instagram (2019). Changes We’re Making to Do More to Support and Protect the Most Vulnerable People who Use Instagram

[I] i) Samaritans (2020). Supporting statement - Assistant Director, Research & Influencing

ii) Biddle L et al. (2020). Online help for people with suicidal thoughts provided by charities and healthcare organisations: a qualitative study of users’ perceptions. Social Psychiatry & Psychiatric Epidemiology, 55, 1157-1166. DOI: 10.1007/s00127-020-01852-6

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

The cluster randomised trial of prostate specific antigen (PSA) testing to screen for prostate cancer (the CAP trial), conducted by the University of Bristol, found that while PSA testing increases the detection of low-risk prostate cancers, it does not save lives. These results published in 2018: (1) have informed UK and international guidelines on PSA-based screening; and (2) were used to update GP and Patient Information sheets produced by Public Health England (January 2020), aimed at enabling men to make a fully informed decision about whether or not to undergo screening. In intention to treat analyses, we showed that if PSA-based screening were to be offered to all men aged 50-69 in England and Wales, the impact over and above current practice, on the secondary care budget could be at least GBP250 million in the first year.

2. Underpinning research

Ideally, aggressive prostate cancers should be identified and treated early. However, for many men, prostate cancer is slow-growing and may never cause harm during a man’s lifetime. Detecting these clinically insignificant cancers (‘overdetection’) may lead to overtreatment and seriously impact on quality of life through anxiety surrounding the diagnosis, the possibility of infection following a biopsy, and impotence and incontinence following surgery or radiotherapy. Healthcare providers may also be burdened with unnecessary costs.

Screening for prostate cancer can be conducted using tests that measure blood levels of a protein known as prostate-specific antigen (PSA). However, using PSA as a screening test is controversial because it cannot distinguish between aggressive and non-aggressive prostate cancers. Consequently, up to a half of all screen-detected prostate cancers may be ‘overdetected’. It is therefore critical to ensure that any potential gains in mortality and quality of life achieved through PSA screening, are not outweighed by harms from overdetection and overtreatment.

The publication of two major trials in 2009, one from Europe and the other from the USA, failed to resolve the controversy surrounding PSA-based, population-wide prostate cancer screening. However, the CAP trial succeeded in providing high-quality UK-based evidence, by obtaining extensive and complete (>99%) long-term follow-up for over 400,000 men [3.1-3.5]. CAP, conducted by the University of Bristol (UoB) in collaboration with the Universities of Oxford and Cambridge, and funded by Cancer Research UK (CRUK) and the Department of Health [i,ii], was the largest randomised controlled trial ever to investigate prostate cancer screening. It set out to find out if inviting men for a single PSA test would help detect high-risk / aggressive prostate cancers earlier and if treating these earlier would mean that the men live longer.

CAP randomised 415,357 men aged 50-69 years registered with 573 general practices in eight cities in England and Wales between 2001-2009. Men in the intervention-group practices were invited to undergo PSA testing. Control-group practices undertook standard (unscreened) UK practice. The trial compared 189,386 men who were invited to have a one-off PSA test with 219,439 men who were not invited for screening. The primary outcomes – prostate cancer-specific and all-cause mortality after a median 10-years follow-up – were published in JAMA in March 2018 [3.1].

Insights

The CAP trial detected significantly more prostate cancers in the screened (8,054, 4.3%) than the control (7,853, 3.6%) group, with a five-fold-increase in detection rate during the first 18 months of the screening period (10.42 versus 2.18 per 1,000 person-years in the screened vs control groups). The intervention mainly increased the detection of low-risk prostate cancers, and there was no evidence of any difference in prostate cancer mortality (the primary outcome [3.2]), between the screened and control groups after a median 10-year follow-up [3.1]: 549 out of 189,386 men died in the screened group (0.30 per 1,000 person-years) compared with 647 out of 219,439 in the control group (0.31 per 1,000 person-years). There was no difference in all-cause mortality (c.13%).

Key researchers

CAP was jointly conducted by the Universities of Bristol and Oxford. Principal investigators at UoB: Martin (Lead PI); Donovan (Joint PI); University of Oxford: Hamdy (Joint PI) and Neal (Joint PI, initially based at Cambridge). University of Oxford PIs contributed clinical expertise. UoB researchers contributed expertise in RCT design, data management and analysis: Turner (trial coordinator); Metcalfe and Sterne (statisticians); Noble (health economists).

3. References to the research

3.1 Martin RM, Donovan JL, Turner EL, Metcalfe C, Young GJ, Walsh EI, Lane JA, Noble S, Oliver SE, Evans S, Sterne JAC, Holding P, Ben-Shlomo Y, Brindle P, Williams NJ, Hill EM, Ng SY, Toole J, Tazewell MK, Hughes LJ, Davies CF, Thorn JC, Down E, Davey Smith G, Neal DE, Hamdy FC, for the CAP Trial Group. (2018). Effect of a Low-Intensity PSA-Based Screening Intervention on Prostate Cancer Mortality: The CAP Randomized Clinical Trial. JAMA, 319(9):883–895. DOI: 101001/jama.2018.0154 Altmetric ranked in top 1% of all published research outputs (Altmetric score 885, 2 November 2020, jamanetwork.altmetric.com/details/34003282 ),120 citations and 32,429 views.

3.2 Turner EL, Metcalfe C, Donovan JL, Noble S, Sterne JAC, Lane JA, Walsh E, Hill EM, Down L, Ben-Shlomo Y, Oliver SE, Evans S, Brindle P, Williams NJ, Hughes LJ, Davies CF, Ng SY, Neal DE, Hamdy FC, Albertsen P, Reid CM, Oxley J, McFarlane J, Robinson MC, Adolfsson J, Zietman A, Baum M, Koupparis A, Martin RM. (2016). Contemporary accuracy of death certificates for coding prostate cancer as a cause of death: Is reliance on death certification good enough? A comparison with blinded review by an independent cause of death evaluation committee. British Journal of Cancer, 115(1): 90-4. DOI: 10.1038/bjc.2016.162

3.3 Young GJ, Harrison S, Turner EL, Walsh EI, Oliver SE, Ben-Shlomo Y, Evans S, Lane JA, Neal DE, Hamdy FC, Donovan JL, Martin RM, Metcalfe C. (2017). Prostate-specific antigen (PSA) testing of men in UK general practice: a 10-year longitudinal cohort study. BMJ Open, 7(10):e017729. DOI: 10.1136/bmjopen-2017-017729

3.4 Turner E, Metcalfe C, Donovan J, Noble S, Sterne J, Lane JA, Avery K, Down L, Walsh E, Davis M, Ben-Shlomo Y, Oliver S, Evans S, Brindle P, Williams N, Hughes L, Hill E, Davies C, Ng SY, Neal D, Hamdy F, Martin RM. (2014). Design and preliminary recruitment results of the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). British Journal of Cancer, 110(12):2829-36. DOI: 10.1038/bjc.2014.242

3.5 Thorn JC, Turner EL, Hounsome L, Walsh E, Down L, Verne J, Donovan JL, Neal DE, Hamdy FC, Martin RM, Noble SM, the CAP trial group. (2016). Validating the use of Hospital Episode Statistics data and comparison of costing methodologies for economic evaluation: an end-of-life case study from the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). BMJ Open, 6:e011063. DOI: 10.1136/bmjopen-2016-011063

Grant information

i) Martin RM. Evaluating population-based screening for localized prostate cancer in the United Kingdom: the (Comparison Arm for ProtecT) study. CRUK/DoH, 2004-2017, GBP4,644,314

ii) Martin RM. Evaluating the long-term effectiveness and cost-effectiveness of population-based screening and treatment for prostate cancer: the CAP and ProtecT RCTs. CRUK, 2017-2021, GBP961,403

4. Details of the impact

Prostate cancer places a significant burden on public health globally, causing an estimated 6 million years of life lost in 2016, a figure that is forecast to rise to 12 million by 2040. Amongst UK males, prostate cancer is the most commonly diagnosed cancer, affecting 1 in 8 men, and is the second commonest cause of cancer death.

The CAP trial provided the first and only robust evidence comparing a low-intensity PSA-based screening strategy (a single screen) for prostate cancer with no screening, minimal contamination [3.3], and was designed to reduce overdetection and overtreatment while seeking a mortality benefit. It showed that while PSA-based screening increases the detection of low-risk prostate cancers, it does not save lives. The results were disseminated widely, including through print and broadcast media locally, nationally and internationally that involved interviews with Martin and Turner. The CAP trial won the 2018 Office for National Statistics (ONS) Research Excellence Awards, recognising outstanding use of ONS research data for public benefit . (“The award winning submission from Emma and her team shows the fantastic public benefit that can be achieved through innovative methodology, exceptional collaboration and excellent use of Secure Research Data” Director for Methods Data Research at the ONS). The CAP trial is cited as a highlight in CRUK’s timeline of lifesaving research [5.1ii].

In the current REF period, the results of the CAP trial have informed UK and international guidelines on the use of the PSA test for prostate cancer screening, helping to avoid harms to men and reduce unnecessary costs to the NHS and globally (such as in the USA).

1. Impacts on UK and international health policy and professional practices

The research has helped policymakers make evidence-based decisions about the population impact of PSA-based screening for prostate cancer. The CAP trial led to changes in health policy and professional guidelines around the world, with clinicians and health services now advised to encourage individualised shared decision-making (informing men of the possible harms and benefits and supporting decision making) rather than routine screening. These new guidelines help ensure that patients (men aged 50-69 years), GPs and urologists are better informed about the benefits and harms of PSA screening for prostate cancer.

1.1 New UK guidance on PSA tests

The CAP trial provided the UK National Screening Committee (NSC) with high-quality, UK-based evidence to inform new Public Health England (PHE) guidance for GPs on the balance of benefits and harms of PSA-based prostate cancer screening, published in January 2020. The importance of the CAP results in these guidelines is confirmed in writing by the Director of the UK NSC [5.2i].

On 6 March 2018, the Royal College of General Practitioners released a statement [5.3] in response to the CAP paper published the same day [3.1]. This stated that “ the College does not recommend that the PSA test is offered routinely to men who do not present with prostate cancer symptoms”. Further, it praised CAP as a “ large, high-quality study” that is “really useful in backing up our calls for GPs to have better access to a more specific and sensitive test than the PSA test” [5.3].

1.2 New international guidance on PSA tests

In the USA, the results of CAP had a major influence on the recommendations of the United States Preventative Services Task Force (USPSTF), a public health body, published in May 2018 [5.4]. These advised that the decision to screen is a complex one, and that men should be carefully counselled about the benefits and harms of screening to make a fully informed decision. The Bristol research team liaised regularly with the USPSTF in the year prior to publication once they had undertaken the CAP analysis, providing USPSTF with a draft manuscript and advising on the timing of publication. The USPSTF recommendations, published May 2018, cited CAP’s results [3.1] and were delayed until the CAP trial publication (March 2018) so that the results of CAP could be included in the Evidence Report that informed USPSTF’s recommendations [5.4]. The American Urological Association (AUA) also included CAP (citing 3.1) in its body of evidence underpinning clinical guidelines on Early Detection of Prostate Cancer (June 2018) [5.4]. The AUA also argues for shared decision-making for men aged 50-69 years who are considering PSA screening.

In other countries, the trial results [3.1] were cited in updated urological and oncological guidelines for the early detection of prostate cancer. For example, Clinical Guidelines for the Screening and Early Detection of Prostate Cancer in Denmark were updated in 2019: “Neither systemic nor opportunistic screening of prostate cancer is recommended”, evidence rated as strong [5.5i]. Italian guidelines also updated in 2019 “informed of the (many) risks and (limited) benefits associated with the test” [5.5ii]. The European Urology Association (EAU) cites CAP results in their review of the frequency and intervals of PSA testing [5.5iii]. The Canadian Urological Association (CUA) cited initial CAP results [3.4] in its guidelines published in 2017. The Canadian guidelines precede the publication of CAP’s full trial results in 2018, but it recognised that these results would likely feed into future reviews [5.6].

In September 2018, a rapid recommendation on prostate cancer screening with PSA testing was published in the BMJ [5.7]. This guidance, developed by an international panel for urological surgeons, was triggered by the results of CAP [3.1], published earlier that year: “ The Rapid Recommendations executive felt [CAP]— taken together with extended follow-up data from existing trials—required a new appraisal of the body of evidence for patients and clinicians.” Drawing on evidence from CAP and other studies, the Recommendation advises: “ Shared decision making is needed for men considering screening to make a decision consistent with their individual values and preferences. However, clinicians need not feel obligated to systematically raise the issue of PSA screening with their patients”.

2. Economic impacts: reduced costs to healthcare providers

Health policy changes occurring as a result of the trial, will reduce unnecessary costs to the health authorities around the world who adopt the revised screening guidelines. In the UK, the costs of annual routine screening have been estimated to be GBP1 billion, were it to be introduced by the NHS, according to a School of Health and Related Research (ScHARR) report to the NSC in March 2013 [5.8]. The ScHARR report explains: “ Routine screening for prostate cancer clearly will have a significant impact on resource use, both for screening and diagnosis of cancers, but also for the treatment or monitoring of cancers that would otherwise remain unidentified. The resources most impacted are those required for screening itself. [Annual screening] would result in almost 10 million more PSA tests per year and 1.4 million biopsies. Whilst a large increase in many resources would be required (e.g. GP nurse sessions, PSA tests, radical treatments, outpatient appointments) there would be some small savings in others relating to the diagnosis and treatment of more advanced disease.”

The impact of introducing PSA-based screening test has a measurable effect on secondary care costs. In an intention-to-treat analysis of the CAP trial [3.5], offering PSA-based screening was associated with additional secondary care costs of circa GBP40 per man in the intervention compared with the control arm in the first year following randomisation, suggesting that if PSA-based screening was to be offered to all men aged 50-69 in England and Wales, the impact on the secondary care budget (over and above current NHS practice) could be over GBP250 million in the first year.

3. Impact on patient and clinician understanding through new information sources on PSA-based screening

  • A CRUK public information page on prostate cancer screening [5.1i] has received 55,574 unique views since the CAP trial results were published, with a spike of 3,089 views on the day of publication, which CRUK described as “by far the biggest driver to the page”.

  • PHE developed a leaflet for well men [5.2iii], published in January 2020 (with the impact of the CAP trial confirmed in writing by the Director of the UK NSC [5.2i]).

  • Authoritative summaries of the CAP trial results (NIHR Signal; CLAHRC Bite) [5.9] were written to provide information to clinicians about the trial and its implications.

4. Impacts on health and wellbeing

The conduct of the trial underpinned the UK NSC longstanding policy of awaiting the publication of the primary results of CAP before making a final decision on the introduction of a national screening programme (Minutes, Nov 2015) [5.10]. The decision to await the results has potentially prevented harms of overdetection for between 129,948 (reasonably assuming a lower limit of 20% overdetection) and 259,896 (reasonably assuming an upper limit of 40% overdetection) men aged 50-74 per year.

5. Sources to corroborate the impact

5.1 i) CRUK (2018). Blog: Why a one-off PSA test for prostate cancer is doing men more harm than good

ii) CRUK (2019). Beating cancer: our progress

5.2 i) UK NSC (2020). Testimonial letter – Director - Refers to the recommendation that population-based screening for prostate cancer should not be introduced.

ii) UK NSC (2020). Rapid Review: Screening for Prostate Cancer

iii) PHE (2020). Prostate specific antigen testing: advice for well men aged 50 and over

iv) PHE (2020). Advising well men about PSA test for prostate cancer: information for GPs

5.3 Royal College of General Practitioners (2018). PSA tests should not be offered routinely to men without symptoms of prostate cancer, says College

5.4 i) USPSTF (2018). Screening for Prostate Cancer US Preventive Services Task Force Recommendation Statement

ii) USPSTF (2018). Prostate-Specific Antigen–Based Screening for Prostate Cancer Evidence Report and Systematic Review for the US Preventive Services Task Force

iii) AUA (2018). Early Detection of Prostate Cancer

5.5 i) Danish Prostate Cancer Group (DAPROCA) (2019) Clinical Guideline for the Screening and Early Detection of Prostate Cancer

ii) Italian Association of Medical Oncology (AIOM), with Italian Society of Urology (SIU) and Italian Society of Uro-Oncology (SIUrO) (2019). Prostate Cancer Guidelines

iii) European Association of Urology (EAU) (2019). Guidelines on Prostate Cancer

5.6 CUA (2017). Canadian Urological Association recommendations on prostate cancer screening and early diagnosis

5.7 i) Tikkinen et al. (2018). BMJ, 362:k3581. DOI: 10.1136/bmj.k3581

ii) Ilic et al. (2018). BMJ, 362:k3519. DOI: 10.1136/bmj.k3519 International meta-analysis conducted to inform rapid recommendation above [5.2ii].

5.8 ScHARR report (2013) to the NSC

5.9 i) NIHR (2018). Single routine offer of a blood test for prostate cancer did not save lives

ii) CLAHRC Bite (2018). A study investigating a single blood test to screen for prostate cancer (the CAP trial)

5.10 UK NSC (2015). Meeting minutes November 2015

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

University of Bristol research utilising trials, joint registry analysis and evidence synthesis has profoundly changed the practice of joint replacement globally. It has led to:

  • The abandonment of stemmed metal-on-metal hip replacements and hip resurfacing in women

  • A ten-fold reduction in the use of hip resurfacing in men

  • A 50% increase in use of unicompartmental knee replacements

  • Increased utilisation of spinal anaesthetic and posterior surgical approach to the hip in order to decrease post-operative mortality

  • Change in patient care pathways to reduce pain, improve function and adopt cost-effective treatments

These changes have led to a substantial reduction in revision rates (by approximately half) for hip and knee replacements in England and Wales, as captured by the National Joint Registry, decreased risk of mortality for patients undergoing joint replacement and improved patient outcomes.

2. Underpinning research

Research at the University of Bristol (UoB) has changed the practice of joint replacement worldwide through a comprehensive programme of research using a combination of research methods centred on the National Joint registry (NJR) for England and Wales. In addition, the research team have developed and implemented methods for monitoring surgeon, unit and implant performance, thereby ensuring iterative and ongoing improvement in the delivery of care.

  1. Identification of failing implants

UoB research published in 2012 (1), revealed catastrophically high failure rates in stemmed metal-on-metal hip replacements, as well as in hip resurfacing in women. This led to the worldwide abandoning of these procedures. Further research conducted by the research team in 2018 found that this type of hip replacement was responsible for over 8,000 excess revision procedures at a cost of over GBP100 million in England and Wales alone.

  1. Identifying the most clinically and cost-effective implants

There is large variation in performance between different implants that are commonly used for joint replacement. The research team utilised network meta-analysis and health economic modelling (2) to determine that the most clinically and cost-effective implants for hip replacement are implants fixed with cement and use small diameter heads. Using these implants for all patients would save between GBP252 million to GBP281 million in England and Wales in the next decade. The NJR annual reports show an ongoing decline in usage of less effective and cost-effective uncemented hip replacement stems.

  1. Reducing perioperative mortality for patients undergoing hip and knee replacement

The research team demonstrated that partial knee replacements were associated with a lower risk of mortality than total knee replacement (3) and that they lasted on average over 25 years (4). This led to the increased utilisation of partial knee replacements. The research team’s publications in The Lancet (3, 5) showed that chemical and mechanical thromboprophylaxis, spinal anaesthetic and the posterior surgical approach for the hip, all reduce the risk of mortality for patients undergoing joint replacement. NJR data show a continuous increase in use of these three co-interventions.

  1. Reducing pain after joint replacement

Approximately 20% of patients experience long-term pain after hip and knee replacement. The UoB research has demonstrated that the injection of local anaesthetic around the surgical site during joint replacement leads to decreased long-term pain after hip, but not knee, replacement and has also established the cost-effectiveness of this intervention for hip replacement (6).

3. References to the research

  1. Smith AJ, Dieppe P, Vernon K, Porter M, Blom AW; on behalf of the National Joint Registry of England and Wales. Failure rates of stemmed metal-on-metal hip replacements: analysis of data from the National Joint Registry of England and Wales. Lancet. 2012; 379(9822): 1199-204. DOI: 10.1016/S0140-6736(12)60353-5

  2. Fawsitt CG, Thom HHZ, Hunt LP, Nemes S, Blom AW, Welton NJ, et al. Choice of Prosthetic Implant Combinations in Total Hip Replacement: Cost-Effectiveness Analysis Using UK and Swedish Hip Joint Registries Data. Value Health. 2019; 22(3): 303–12. DOI: 10.1016/j.jval.2018.08.013

  3. Hunt LP, Ben-Shlomo Y, Clark EM, Dieppe P, Judge A, MacGregor AJ, Tobias JH, Vernon K, Blom AW, on behalf of the National Joint Registry for England and Wales. 45-day mortality after 467,779 knee replacements for osteoarthritis from the National Joint Registry for England and Wales: an observational study. Lancet. 2014; 384(9952): 1429-36. DOI: 10.1016/S0140-6736(14)60540-7

  4. Evans JT, Walker RW, Evans JP, Blom AW, Sayers A, Whitehouse MR. How long does a knee replacement last? A systematic review and meta-analysis of case series and national registry reports with more than 15 years of follow-up. Lancet. 2019; 393(10172): 655-663. DOI: 10.1016/S0140-6736(18)32531-5

  5. Hunt LP, Ben-Shlomo Y, Clarke EM, Dieppe P, Judge A, MacGregor AJ, Tobias JH, Vernon K, Blom AW on behalf of the National Joint Registry for England, Wales and Northern Ireland. 90-day mortality after 409,096 total hip replacements for osteoarthritis, from the National Joint Registry for England and Wales: a retrospective analysis. Lancet. 2013; 382: 1097-1104. DOI: 10.1016/S0140-6736(13)61749-3

  6. Wylde V, Lenguerrand E, Gooberman-Hill R, Beswick AD, Marques E, Noble S, Horwood J, Pyke M, Dieppe P, Blom AW. Effect of local anaesthetic infiltration on chronic postsurgical pain after total hip and knee replacement: the APEX randomised controlled trials. Pain. 2015; 156(6): 1161-70. DOI: 10.1097/j.pain.0000000000000114

4. Details of the impact

According to the World Health Organisation, musculoskeletal conditions are the leading contributor to global disability. In the UK, treatment consumes 30% of NHS primary care consultations and 25% of surgical interventions. Two of the most common interventions are hip and knee replacement, with over 100,000 each performed in England and Wales annually. Hip and knee replacement rates range between 150 and 300 each per 100,000 in developed countries. Annual NHS expenditure on hip and knee replacements is over GBP1 billion and over GBP3 billion in the United States.

Around 10% of joint replacements fail, requiring complex revision surgery, and 20% of patients experience long-term pain. NICE provide recommendations on implants used in joint replacement, surgical approaches and the use of injections around the surgical site on the basis of the UoB research in order to reduce revision rates, improve outcomes and decrease pain. The UoB research showing that metal-on-metal hip replacements should not be used, and will avoid 8,000 excess revisions, led to the virtual cessation of the use of these implants in the UK, Australia and Canada by 2018.

1. Identifying failing implants and changing practice

NICE identifies acceptable revision rates as 5% at 10 years; the research team found rates far in excess of this when metal-on-metal stemmed hip replacements (1) and hip resurfacings were used. This led to the MHRA issuing a Medical Device Alert [Ai], reinforced by the British Orthopaedic Association and British Hip Society [Aii], recommending against their use in all but exceptional circumstances and that targeted surveillance should occur for any such recipients. The NICE Technology appraisal guidance [Ci] cites UoB’s work (1) and evidence from the NJR annual reports [B], in its recommendations on revision rates and implants for hip replacement.

The US Food and Drugs Administration has cited UoB’s research (1) and further work on the risk of cancer following implantation of metal-on-metal hip implants in its recommendations on market approval for hip replacements (FDA 2013) and Biological Response to Metal Implants [D]. The FDA now approves no stemmed metal-on-metal hip replacement systems and only two resurfacing systems for marketing in the US. Of those approved, one has strictly limited indications in the manufacturer Field Safety Notice informed by UoB’s recommendations and findings. The New Zealand Medicines and Medical Devices Safety Authority (2013) and the European Commission Scientific Committee on Emerging and Newly Identified Health Risks (2014) [E], have issued guidance citing UoB’s research on the outcomes of metal-on-metal hip replacements, including research on the risk of developing cancer, in their recommendations.

Prior to publication of UoB’s research (1), over 1 million metal-on-metal total hip and resurfacing implants were implanted worldwide. The research team identified that the use of approximately 70,000 of these implants in the NJR were responsible for 8,000 excess revisions, at a cost of over GBP100 million. This equates to over 110,000 avoidable revisions worldwide. UoB’s recommendations have led to the virtual cessation of the use of these implants (UK: 466 in 2018 vs 13,630 in 2008 [B]; Australia: 1% (2013-2018) vs 9.8% (2006-2012) (peak 17% 2007) [F]). Citing UoB’s work, the FDA recommends the use of Unique Device Identifiers [G] to allow monitoring and prevent recurrence of the devastating impact of these implants. The NJR, for which the research team have been responsible for statistical analysis and specialist research for over a decade, was cited as a “global exemplar” of medical device registries by the Under Secretary of State for Health and Social Care, Jo Churchill MP, in her report to Parliament (2020).

2. Identifying the most clinically and cost-effective implants

The research on the cost-effectiveness of hip implants (2) has informed recommendations of the Analysis and Policy Observations (APO) of Australia and New Zealand 2019 [Hi], and the research on how long hip replacements last has been cited by the Dutch Institute of Health [Hii]. In the UK, the Getting it Right First Time (GIRFT) initiative is a leading NHS Improvement programme. Data utilised by GIRFT are provided by the UoB team’s analysis of NJR data [I]. The programme has adopted UoB’s recommendations in terms of implant selection (2, 5) [I], and change in clinical practice is demonstrated by data from the NJR which demonstrate increased use of cemented stems and abandonment of larger heads [B]. If all hip replacements performed were conducted as cemented hip replacements, this would save between GBP252 million and GBP281 million in England and Wales alone over the next decade. The success of the GIRFT programme, underpinned by UoB data, has seen it rolled out across all surgical specialties in the UK.

3. Improved patient care and reduced perioperative mortality

The UoB research has explored treatment factors that are associated with peri-operative mortality for patients undergoing hip and knee replacement. The research (1) was cited by NICE Technology Appraisal guidance [TA304] (2014) providing evidence-based recommendations on artificial hips and hip resurfacing for treating end‑stage arthritis of the hip in adults [Ci], specifically in making recommendations aimed at decreasing peri-operative mortality. The latest NICE guidance on hip and knee replacement [Cii] cites the UoB research on surgical approaches and anaesthesia to improve outcomes for patients undergoing joint replacement. These recommendations have been widely adopted as demonstrated by NJR data, showing an increase in the use of mechanical and chemical thromboprophylaxis and the use of spinal anaesthetic for total hip replacement [B]. In 2011, prior to the UoB team’s published research, the percentage of patients not receiving chemical prophylaxis for hip replacement was 13% (~ 13,000 patients); this fell to 2% in 2019. For knee replacement, the proportion not receiving chemical prophylaxis fell from 15% (~ 15,000 patients) in 2011 to 1% in 2019. The proportion of patients undergoing hip replacement who received a spinal anaesthetic in the period 2008-2012 was 42%, increasing to 59% in the period 2013-2017 (~17,000 more cases per annum); the corresponding proportions for knee replacement were 43% and 57% respectively (~ 15,000 cases per annum) [B]. Also, 90-day mortality rates have decreased by 7% in hip replacement and 10% for knee replacement in the period 2014 to 2019 [B].

4. Reducing pain after joint replacement

The UoB publications showing the efficacy of peri-operative wound infiltration in reducing post-operative pain (6) have contributed to widespread adoption of these techniques, particularly in rapid recovery pathways. The research team’s work was cited in guidance from the Canadian Agency for Drugs Technology and Health [J] and NICE guideline NG157 [Cii] in the UK, with NICE now recommending peri-operative wound infiltration in all patients.

5. Sources to corroborate the impact

[A] i) MHRA (2017). Medical Device Alert: All metal-on-metal (MoM) hip replacements: updated advice for follow-up of patients

ii) British Orthopaedic Association (BOA) (2017). BOA/BHS Statement on Metal on Metal Hip Implants – Update from the MHRA

[B] NJR (2020). 17th Annual Report 2020: Surgical data to 31st December 2019

[C] i) NICE (2014). Technology appraisal guidance [TA304]: Total hip replacement and resurfacing arthroplasty for end-stage arthritis of the hip

ii) NICE (2020). NG157: Joint replacement (primary): hip, knee and shoulder

[D] FDA (2019) White paper: Biological Responses to Metal Implants, Cites [1].

[E] European Commission (2014). Scientific Committee on Emerging and Newly Identified Health Risks (SCENIHR) Opinion on: The safety of Metal-on-Metal joint replacements with a particular focus on hip implants

[F] Australian Orthopaedic Association (2019). Australian Orthopaedic Association National Joint Replacement Registry 20th Annual Report

[G] FDA (2014). Unique Device Identifiers (UDIs): A Roadmap for Effective Implementation

[H] i) Grattan Institute (2019). Saving private health 1: reining in hospital costs and specialist bills, Cites [2].

ii) Rijksinstituut voor Volksgesondheid en Milluw (Dutch Institute of Health) (2019). Verkenning Economische Evaluaties Implantaten (Exploratory Study on Economic Assessments of Implants)

[I] i) GIRFT / BOA (2015). A national review of adult elective orthopaedic services in England

ii) GIRFT (2020). Getting It Right in Orthopaedics

GIRFT reports acknowledge Blom and use of NJR datasets

[J] Canadian Agency for Drugs Technology and Health (CADTH) (2017). CADTH Issues in Emerging Health Technologies, Outpatient (Same-Day) Total Hip Replacement, Issue 152.

Submitting institution
University of Bristol
Unit of assessment
2 - Public Health, Health Services and Primary Care
Summary impact type
Health
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Hepatitis C Virus (HCV) is a blood-borne infection that causes considerable global morbidity. Research from the University of Bristol on the impact and cost-effectiveness of HCV treatment, especially in preventing HCV transmission has:

  • guided the World Health Organisation’s (WHO) treatment guidelines (2018) that expand HCV treatment to all patient groups;

  • underpinned the WHO’s Global Health Strategy (2016) to eliminate HCV as a public threat by 2030, initiating a global expansion in HCV treatment;

  • guided over ten countries’ HCV elimination initiatives.

Early data suggest that elimination strategies in Australia and Scotland have respectively decreased chronic HCV prevalence by 42% and 71% among people who inject drugs, the most affected patient group.

2. Underpinning research

HCV is an important cause of liver disease. In high-income countries, most chronic HCV is among people who inject drugs (PWID) whereas more disseminated epidemics involving other transmission routes (mainly through unsafe medical injections and procedures) can occur in low- and middle-income countries. Amongst PWID, needle and syringe programmes and opioid substitution therapy are the primary HCV prevention interventions but, prior to our research, evidence quantifying their impact and cost-effectiveness for reducing HCV transmission was minimal. Although HCV is a curable infection, the coverage of HCV treatment has traditionally been low and not recommended among people with risk of re-infection, such as PWID.

Since 2010, Vickerman and Hickman at the University of Bristol (UoB) have led a substantial body of work, including intervention studies, epidemiological analyses, systematic reviews, infectious disease and economic modelling, that has transformed the evidence base for the prevention and treatment of HCV among PWID and other groups at risk of HCV transmission.

HCV prevention and treatment among PWID and other high-risk groups

UoB researchers produced the first strong evidence (culminating in a Cochrane systematic review (1), published 2017) that needle and syringe programmes and/or opioid substitution therapy can reduce the risk of HCV acquisition amongst PWID by over 50%. This evidence was used in our modelling, which showed that needle and syringe programmes and opioid substitution therapy are highly cost-effective in the UK and USA. UoB developed the first dynamic model of HCV transmission that showed the potential prevention impact of HCV antiviral treatment and that treatment scale-up among PWID could eliminate HCV (2). UoB researchers found that treating PWID who have active infection risk is likely to be more cost-effective than treating people with no infection risk and could avert up to two new HCV infections for each person treated (3). We also identified the importance of combining the scale-up of HCV treatment with opioid substitution therapy and needle and syringe programmes for reducing HCV transmission and minimising the need for re-treatment (4), showing that ambitious HCV elimination targets could not be achieved without this scale-up. In the UK, we projected that from 5 to 10% of PWID with chronic HCV need treating each year to eliminate HCV by 2030. We have produced similar models for 11 sites and countries in Europe and 21 countries worldwide. UoB researchers also investigated the HCV epidemic among men who have sex with men (MSM) and found that, among this group, HCV elimination is possible with achievable scale-up of HCV treatment.

HCV prevention around the world

UoB research has demonstrated the large prevention impact that HCV treatment could have across the world (5,6) and showed that it is cost-effective to test and treat in lower- and middle-income countries. However, our analyses emphasise that achieving HCV elimination will always need a focus on PWID given their large global contribution to HCV transmission; a recent analysis by UoB suggests PWID contribute 43% of incident infections globally (7).

3. References to the research

  1. Platt L, Minozzi S, Reed J, Vickerman P, Hagan H., French C, Jordan A, … Hickman M (2017). Needle syringe programmes and opioid substitution therapy for preventing hepatitis C transmission in people who inject drugs. Cochrane Database Systematic Review, 9: 1-89. DOI: 10.1002/14651858.CD012021.pub2

  2. Martin NK, Vickerman P, Grebely J, Hellard M, Hutchinson SJ, Lima VD, Foster GR, Dillon JF, Goldberg DJ, Dore GJ, Hickman M. (2013). HCV treatment for prevention among people who inject drugs: Modeling treatment scale-up in the age of direct-acting antivirals. Hepatology, 58(5): 1598-1609. DOI: 10.1002/hep.26431

  3. Martin NK, Vickerman P, Dore GJ, Grebely J, Miners A, Cairns J, Foster GR, Hutchinson SJ, Goldberg DJ, Martin TCS, Ramsay M, Hickman M. (2016). Prioritization of HCV treatment in the direct-acting antiviral era: An economic evaluation. J. Hepatology. 65:17-25. DOI: 10.1016/j.jhep.2016.02.007

  4. Martin NK, Hickman M, Hutchinson SJ, Goldberg D, Vickerman P. (2013). Combination Interventions to Prevent HCV Transmission among People Who Inject Drugs: Modeling the Impact of Antiviral Treatment, Needle and Syringe Programs, and Opiate Substitution Therapy. Clinical Infectious Diseases, 57(2): S39-45. DOI: 10.1093/cid/cit296

  5. Lim AG, Walker JG, Mafirakureva N, Khalid GG, Qureshi H, Mahmood H , Trickey A, Fraser H, Aslam K, Falq G, Fortas C, Zahid H, Naveed A, Auat R, Saeed Q, Davies CF, Mukandavire C, Glass N, Maman D, Martin NK, Hickman M, May MT, Hamid S, Loarec A, Averhoff F, Vickerman P. (2020). Effects and cost of different strategies to eliminate hepatitis C virus transmission in Pakistan: a modelling analysis. Lancet Global Health, 8(3): e440-e450 DOI: 10.1016/S2214-109X(20)30003-6

  6. Trickey A, Fraser H, Lim A, Walker J, Peacock A, College S, Leung J, Grebely J, Larney S, Martin NK, Degenhardt L, Hickman M, May MT, Vickerman P. (2019). Modelling the potential prevention benefits of a treat-all hepatitis C treatment strategy at global, regional and country levels: A modelling study. J. Viral Hepatitis, 26:1388-1403. DOI: 10.1111/jvh.13187

  7. Trickey A, Fraser H, Lim A, Peacock A, College S, Walker J, Leung J, Grebely J, Larney S, Martin N, Hickman M, Degenhardt L, May MT, Vickerman P. (2019). The Contribution of Injection Drug Use to Hepatitis C Virus Transmission Globally, Regionally, and at Country Level: A Modelling Study. Lancet Gastroenterol Hepatol, 4(6), 435-44. DOI: 10.1016/S2468-1253(19)30085-8

4. Details of the impact

Globally, HCV affects 71 million infected individuals and causes 400,000 deaths each year. UoB research has made an important contribution to reducing this burden through research that has defined effective and cost-effective interventions that has underpinned the development of global and national strategies to manage and eliminate HCV. These have led to measurable improvements in patient health.

Impact on HCV prevention guidelines

UoB research strengthened the weak evidence for the impact and cost-effectiveness of opioid substitution therapy and needle and syringe programmes. This evidence has been central to HCV prevention guidelines around the world [ D,E,Hi,Ii]. In the UK, UoB’s modelling and evidence synthesis underpins UK National Institute for Health and Care Excellence (NICE) Public Health Guidance (2008 and 2014) on needle and syringe programmes and has influenced recent recommendations for the crucial role of needle and syringe programmes and opioid substitution therapy for achieving HCV elimination in England (2019) [ E], Scotland (2019) [ Ii] and Georgia (2017) [ Hi]. It has also underpinned recommendations to scale-up needle and syringe programmes in the US (2019) [ D].

Impact on HCV treatment guidelines

UoB research on the impact and cost-effectiveness of HCV treatment as prevention among PWID and MSM has been instrumental in changing HCV-treatment guidelines globally. In 2017, WHO commissioned modelling research from UoB, which showed that a ‘treat-all’ policy would achieve prevention benefits; this formed part of the evidence used to change WHO’s HCV treatment guidelines published in 2018 [ C] to a treat-all policy. These new guidelines contrasted with prior guidance that had restricted HCV treatment to people based on disease stage. Further, the European Association for the Study of the Liver (2018) [ A], and the American Association for the Study of Liver Disease (2020) [ B] have both primarily used UoB modelling evidence to advocate for the prevention benefits of HCV treatment and to recommend treatment for patient groups at risk of re-infection, including PWID [ A,B] and MSM [ A].

These new treatment guidelines have been central to development of national HCV elimination strategies in Georgia, Scotland and Australia, which now recommend the prioritisation of HCV treatment to PWID alongside scaling up other prevention interventions [ Hi,Ii,Ji].

Impact on elimination strategies

UoB research uncovered the extent to which treatment and prevention scale-up will be needed to reduce HCV-transmission to negligible levels in different global settings. In particular, the research was crucial for the WHO 2016 Global Health Sector Strategy (GHSS) on Viral Hepatitis [ Fi], which proposed the elimination of viral hepatitis as a major public health threat by 2030. Our modelling showed elimination was possible by 2030 and was used to produce the prevention and treatment targets needed for eliminating HCV as proposed by WHO [ Fii]. The WHO strategy to eliminate HCV has been instrumental for many countries developing National HCV elimination initiatives (124 by February 2019 [ Fiii]), resulting in substantial increases in treatment in many countries (including Georgia and Australia, see Figure 1) and globally [ Fiii]. Our prevention and treatment targets are the foundation for all National HCV elimination initiatives.

UoB research has also guided HCV elimination programmes in Georgia (through their yearly technical advisory group) [ Hi,Hii], Scotland (strategy cites nine UoB studies) [ Ii], Australia (strategy cites UoB research (1) as primary evidence for using HCV treatment as a prevention strategy among PWID) [ Ji] and Pakistan [ G]. The UoB researchers presented their findings on how to optimise the costs of achieving HCV elimination in Pakistan at an invitation-only Technical Meeting for World Hepatitis Day in 2019. This policy-shaping meeting was hosted by WHO and the Pakistan Ministry of National Health Services, Regulations and Coordination (NHSRC). The outcome of the Meeting was the Islamabad Declaration for Hepatitis Elimination 2019 and an official announcement by Dr Arif Alvi (President of Pakistan) of a Prime Minister’s plan for eliminating viral hepatitis in Pakistan [ Gii]. Our work has supported Pakistan’s treatment targets and budget requirements for achieving HCV elimination, published in Lancet Global Health ( 5) with associated press articles in all major English language newspapers in Pakistan [ Giii].

Impacts on patient health

Embedded image (b) Chronic prevalence in Georgia

(d) Chronic prevalence in PWID in Australia Embedded image

(c) Australia treatment scale-up in PWID Embedded image

(a) Georgia treatment scale-up Embedded image There is empirical evidence from Scotland and Australia that national elimination strategies, underpinned by UoB’s research, have had a profound effect on the number of PWID who have been treated over time (Fig.1). Emerging data from Scotland shows that after four years of treatment scale-up in Tayside (2017-2020; Fig.1e/f), chronic HCV prevalence fell by 71% among PWID, as motivated and predicted by UoB research [ Iii]. Similarly, chronic HCV prevalence decreased by 42% in the first two years (2016-2017; Fig.1c/d) of scaling up HCV treatment in Australia [ Jii]. In Georgia, our modelling suggests chronic HCV prevalence has reduced by 37% and mortality by 14% by February 2019 (Fig.1a/b) as published in Lancet Global Health [ Hii].

Embedded image (f) Chronic prevalence in PWID in Tayside

Embedded image (e) Tayside treatment scale-up in PWID

Figure 1: Treatment scale-up and impact in Georgia (a and b; modelling from [ Hii]), PWID in Australia (c and d; data adapted from [ Jii]), and PWID in Tayside, Scotland (e and f; extension of data from [ **Iiii]**). Treatment figures also show dates over which our initial Main papers were published (2011-2013), when EASL (European Association for the study of the Liver) first recommended treating PWID (August 2014), and when WHO published their Global Health Strategy to eliminate HCV (June 2016; WHO GHSS).

5. Sources to corroborate the impact

[A] European Association for the study of the Liver (EASL) (2018). Recommendations on Treatment of Hepatitis C. See refs 216-218, 253 and 254 (p.35), including (2) and (4) above. Our studies are used as main evidence for prevention benefits of treating PWID, and that this can result in achieving elimination if also scale up needle and syringe programmes.

[B] American Association for the Study of Liver Disease (AASLD) (2020). HCV Guidance: Recommendations for Testing, Managing, and Treating Hepatitis C. See pp.194-197 (3 papers by Martin and Fraser, including 2 and 4 above) for Guidelines for PWID and pp.201 (2 papers by Martin) for Guidelines for MSM. Our studies are used as main evidence for showing treating MSM or PWID can have impact and be cost-effective.

[C] WHO (2018). Guidelines for the Care and Treatment of Persons Diagnosed with Chronic Hepatitis C Virus Infection. See p.viii for acknowledgement of UoB’s modelling and web Annex 4 for our modelling as in ref (6) above.

[D] CDC (2019). Summary of Information on The Safety and Effectiveness of Syringe Services Programs (SSPs). See refs 8 and 22 (1 and 4 above) - evidence for benefits of SSP for HCV.

[E] PHE (2019). Hepatitis C in England 2019 Working to eliminate hepatitis C as a major public health threat. See refs 44, 48 and 49 (p.27), including (1) above.

[F] i) WHO (2016). Global Health Sector Strategy on Viral Hepatitis 2016-2021. Towards Ending Viral Hepatitis. UoB modelling used to develop the strategy to eliminate HCV as discussed in the WHO testimonial letter [Fii].

ii) WHO (2020). Testimonial letter - Unit Head, Strategic Information, Analysis and Data Use HIV, Hepatitis and STI Department

iii) WHO (2019). Presentation: Global progress towards hepatitis elimination – An update Slide 5 gives increasing number of countries that have a national hepatitis plan and slide 7 gives increase in global treatments from 2015 to 2017.

[G] i) The Economist Intelligence Unit (2019). A Renewed Commitment: Pakistan’s policy response to hepatitis B and C. See p.4 modelling as in ref (5) above.

ii) WHO (2019). Press release: 15 million people affected with hepatitis B and C in Pakistan: Government announces ambitious plan to eliminate hepatitis

iii) Media reports for ref (5).

[H] i) Georgia’s Ministry of Labour, Health, and Social Affairs (2017). National Hepatitis C Virus Elimination Progress Report, 2015-2017. See pp.69-70 for UoB modelling results, and recommendation 2A.1 on page 16.

ii) Walker J,… Vickerman P (2020). Interim effect evaluation of the hepatitis C elimination programme in Georgia: a modelling study. Lancet Global Health, 8(2): e244-e253. DOI: 10.1016/S2214-109X(19)30483-8

[I] i) Health Protection Scotland (2019). Scotland’s Hepatitis C Action Plan: Achievements of the First Decade and Proposals for a Scottish Government Strategy (2019) for the Elimination of both Infection and Disease Nine UoB studies (including 2 and 4 above) cited advocating for prevention and treatment interventions among PWID for achieving elimination.

ii) Hickman et al. (2019). Evaluating the Population Impact of Hepatitis C Direct Acting Antiviral Treatment as Prevention for People Who Inject Drugs (Epitope) - a Natural Experiment (Protocol). BMJ Open, 9(9): e029538. DOI: 10.1136/bmjopen-2019-029538

iii) Palmateer et al. (2020). Reductions in the population prevalence of HCV viraemia among people who inject drugs associated with scale-up of direct-acting antiviral therapy in community drug services: Real world data. Unpublished.

Two papers present data showing decline in HCV prevalence among PWID when scale up treatment and our modelling that underpinned this.

[J] i) Gastroenterological Society of Australia (2018). Australian recommendations for the management of hepatitis C virus infection: a consensus statement (September 2018).

UoB research (2) is ref 5 (p.4).

ii) Iversen et al. (2019). Association between Rapid Utilisation of Direct Hepatitis C Antivirals and Decline in the Prevalence of Viremia among People Who Inject Drugs in Australia. J Hepatol, 70(1): 33-39. DOI: 10.1016/j.jhep.2018.09.030 Paper presents data showing decline in HCV prevalence among PWID when scale up treatment

Showing impact case studies 1 to 9 of 9

Filter by higher education institution

UK regions
Select one or more of the following higher education institutions and then click Apply selected filters when you have finished.
No higher education institutions found.
Institutions

Filter by unit of assessment

Main panels
Select one or more of the following units of assessment and then click Apply selected filters when you have finished.
No unit of assessments found.
Units of assessment

Filter by continued case study

Select one or more of the following states and then click Apply selected filters when you have finished.

Filter by summary impact type

Select one or more of the following summary impact types and then click Apply selected filters when you have finished.

Filter by impact UK location

UK Countries
Select one or more of the following UK locations and then click Apply selected filters when you have finished.
No UK locations found.
Impact UK locations

Filter by impact global location

Continents
Select one or more of the following global locations and then click Apply selected filters when you have finished.
No global locations found.
Impact global locations

Filter by underpinning research subject

Subject areas
Select one or more of the following underpinning research subjects and then click Apply selected filters when you have finished.
No subjects found.
Underpinning research subjects