Skip to main

Impact case study database

The impact case study database allows you to browse and search for impact case studies submitted to the REF 2021. Use the search and filters below to find the impact case studies you are looking for.

Search and filter

Filter by

  • Loughborough University
   None selected
  • 34 - Communication, Cultural and Media Studies, Library and Information Management
   None selected
   None selected
   None selected
   None selected
   None selected
   None selected
Waiting for server
Download currently selected sections for currently selected case studies (spreadsheet) (generating)
Download currently selected case study PDFs (zip) (generating)
Download tags for the currently selected case studies (spreadsheet) (generating)
Currently displaying text from case study section
Showing impact case studies 1 to 4 of 4
Submitting institution
Loughborough University
Unit of assessment
34 - Communication, Cultural and Media Studies, Library and Information Management
Summary impact type
Cultural
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Public understanding of media and everyday life under communist rule remains dominated by stereotypes formed during the Cold War. Loughborough research challenged these stereotypes, and proposed a more nuanced understanding, which avoids the binary division of communist East versus liberal democratic West and acknowledges the diversity of communist societies. The research findings informed museum exhibitions in the UK, USA, and three east European counties, and a BBC Four documentary, reaching 170,000 museum visitors and 700,000 TV viewers, leading to the following impacts: 1) a transformed understanding of communist media and everyday life among cultural industry professionals; 2) improved understanding among museum visitors and TV viewers, and 3) enriched museum collections and larger and more diverse audiences.

2. Underpinning research

This impact builds on a body of externally funded research on Eastern European media and culture, conducted at the Centre for Research in Communication and Culture at Loughborough since 2006. A central aspect examines cultural and media history and memory, with a focus on the Cold War. This work challenges stereotypical perceptions of everyday life and culture under communist rule as backward and pervaded by propaganda, highlights important similarities with the West, and reveals significant differences between communist countries.

Two interconnected research strands were developed. The first was led by Professor Mihelj, comprised research on media and everyday life during communism, and was funded by the British Academy ( On the Margins of Europe, 2006-2007, **[R1]**) and the Leverhulme Trust ( Screening Socialism, 2013-2016, **[R2, R3, R4]**). The early work focused on the print media in Yugoslavia, showing how journalists appropriated the idea of the Cold War as a bipolar conflict to negotiate the relationship between ideology and everyday realities [R1]. More recently, Mihelj led an interdisciplinary research team to develop the first transnational study of television and everyday life under communism, covering five countries [R3, R4]. Unlike prior research, the project’s focus extended beyond official policies, elite discourses and news genres, to examine fictional and entertainment programmes and to investigate how television was used by audiences. The results showed that explicit propagandistic content was rare, that TV programming had much in common with Western public broadcasting, and that audience preferences were often at odds with official ideologies. Rather than perpetuating propaganda, television influenced political developments in unexpected ways, especially during key historical moments such as the fall of the Berlin Wall. The research also revealed notable cross-country differences, with some countries considerably more open to the West and more tolerant of dissent. Extending the reach of this research, Mihelj also studied the role of television in post-communist memory [R2].

The second strand of research, led by Professor Reid, focused on everyday life in the Soviet Union [R5]. Reid sought to understand how the social, material and cultural transformations that took place in the USSR after Stalin’s death – including rapid modernization, formation of a consumer society, growing availability of everyday technologies (including ICT), and increased international contact – were experienced by ‘ordinary people’. Examining the move by millions of citizens to new, prefabricated housing built in the 1960s, Reid investigated the ways individuals and households made home in these standard spaces. Challenging Cold War stereotypes of passive subjects, Reid found that homemakers negotiated their relations with the state over the exercise of taste, consumption, DIY, and the appropriation of state-produced consumer goods. Contrary to the standard Cold War emphasis on shortage, Reid’s research attends to the production of new ‘needs’, including the need for technologies such as television sets.

Together, Mihelj and Reid’s research developed a multifaceted account of the interactions between media, processes of change affecting everyday life, and political developments in communist Eastern Europe.

3. References to the research

[R1]: Mihelj, S. (2011) ‘Negotiating Cold War Culture: Uplifting the Working People, Entertaining the Masses, Cultivating the Nation’, Comparative Studies in Society and History 53(3): 509-539. doi:10.1017/S0010417511000235

[R2]: Mihelj, S. (2017) ‘Memory, Post-socialism, and the Media: Nostalgia and Beyond’, European Journal of Cultural Studies 20(3): 235-251, doi: 10.1177/1367549416682260.

[R3]: Mihelj, S. and Huxtable, S. (2016) ‘The Challenge of Flow: State Socialist Television between Revolutionary Time and Everyday Time’, Media, Culture & Society 38(3): 332–48. doi:10.1177/0163443715594869.

[R4]: Mihelj, S., and Huxtable, S. (2018) From Media Systems to Media Cultures: Understanding Socialist Television. doi: https://doi.org/10.1017/9781108525039. Cambridge: Cambridge University Press.

[R5]: Reid, S.E. (2016) ‘Cold War Binaries and the Culture of Consumption in the Late Soviet Home’, Journal of Historical Research in Marketing 8 (1): 17 – 43. doi:10.1108/JHRM-09-

2015-0038.

Mihelj’s research was funded by a British Academy Small Grant ( On the Margins of Europe: Media, Space and Identity between Migrant Borders, 2006–07, £7,450) and the Leverhulme ( Screening Socialism: Television and Everyday Life in Socialist Eastern Europe, 2013–16, £242,000). All research outputs were peer reviewed and published in leading journals or book series. Mihelj’s 2018 book received pre-publication endorsements from key figures in the fields of media research, communist media, and Eastern European history (Dan Hallin, Anikó Imre, Stephen Lovell and Barbie Zelizer) and a commendation from the British Association for Film, Television and Screen Studies in the Best Monograph Prize 2019 category. Reid’s 2016 article was awarded the Emerald Publishing Literati Awards for Excellence Outstanding Paper.

4. Details of the impact

Building on their research, Mihelj and Reid advised on and curated three exhibitions in five countries and a BBC Four documentary. Details of four impact pathways are as follows:

  • *They Never Had it Better: Everyday Life in Yugoslavia was a traveling exhibition developed by the Museum of Yugoslavia in Belgrade, Serbia (2014-2015), which then travelled to the Historical Museum of Bosnia and Herzegovina in Sarajevo (2015-2016) and to the Museum of Contemporary History in Ljubljana, Slovenia (2016-2017). The exhibition was curated by Ana Panić, with Mihelj as External Advisor [S1, S2]. It attracted positive reviews in three countries [S3] and awards for the best curator and best exhibition in Serbia in 2014-15 by the Association of Art Historians in Serbia [S1].

  • *Currency of Communism (2017-2018) was the first ever exhibition dedicated to communism at the British Museum. It was curated by Thomas Hockenhull, with Mihelj and Reid as External Advisors [S4] and received a large amount of favourable coverage in the UK and abroad [S5, p. 9].

  • *Watching Socialism: The Television Revolution in Eastern Europe (2019) was dedicated specifically to television and everyday life and opened at the Wende Museum in Los Angeles, the only specialist Cold War museum in the USA. Mihelj and Reid were lead curators, and Mihelj’s research also informed tour guide training [S7].

  • *The Fall of the Berlin Wall with John Simpson (2019) was a TV documentary produced by Alleycats TV for BBC Four, to mark the 30th anniversary of the fall of the Berlin Wall. Mihelj acted as expert interviewee and advisor [S9].

Through these impact pathways, Mihelj and Reid helped transform the public understanding of media and everyday life under communism, contributed to professional development of cultural industry professionals, as well as facilitated the enrichment of cultural heritage and diversification and enlargement of audiences, thus achieving impact in three key areas.

1. Transformed understanding among cultural industry professionals

Through their interventions, Mihelj and Reid contributed to professional development of museum and media professionals in five major museums and a TV production company in five countries, through transforming their understanding of the role of the media and everyday life in communist Europe. The initial plan for They Never Had It Better exhibition made little reference to the media, and this angle was added as a result of Mihelj’s contribution. As noted by the Director of Museum of Yugoslavia, Mihelj provided “ invaluable advice and assistance to the exhibition curator” and as a result, “ the exhibition was enhanced considerably and paid more attention to television than it otherwise would[S1]. For the Wende Museum, the Watching Socialism exhibition was the first exhibition dedicated entirely to media history, and as the Chief Curator Dr Joes Segal explained, Mihelj and Reid’s contribution “ was absolutely essential for making this exhibition happen” and “ presented an opportunity to venture into an aspect of Cold War history that has so far remained neglected in our collection and activities[S7]. As a result of the collaboration, several curators and visitor engagement staff at Wende “ developed an in-depth understanding of communist television and media more generally, and their place in everyday life[S7]. Tour guides also appreciated “ being able to talk about research” and thereby “ communicate that the exhibition is also about how people experience television, not just what was on view on television[S7].

Mihelj and Reid’s knowledge about the role of consumption and currency in everyday life had a similarly transformative impact on the Currency of Communism exhibition, and contributed to the curator’s professional development, as highlighted in his report [S5, p.4]. As noted by the Head of Department of Coins and Medals, Mihelj and Reid “ impacted on the conceptualization of the exhibition and on the exhibits and texts through which the concept was represented”. Their intervention “ enhanced [the curator’s] understanding of alternative exchange mechanisms”, “ led to a restructuring of the treatment of gender” in the exhibition, and stimulated “ a more rounded approach which highlighted the ways in which currency was used in the context of everyday life, consumption and leisure[S4]. In the case of the Berlin Wall documentary, Mihelj revealed crucial aspects of historical information that neither the director, Des Henderson, nor the key protagonist of the documentary, BBC Foreign Affairs Editor John Simpson, were aware of. Specifically, Mihelj was able to point out the critical role of Western reporting, live TV coverage, and cross-border audience reception in the fall of the Berlin Wall. The moment when Mihelj explains this dynamic to John Simpson formed, as the director of the documentary explained, “ the heart and soul of the film”, and “ no-one else […] could have really told him that with as much authority as Professor Mihelj did[S9]. Mihelj’s intervention thus transformed the narrative arc of the documentary and constituted a key moment of surprise for both the documentary’s narrator Simpson and for the audience.

Mihelj and Reid’s contributions left a legacy in partner institutions, inspiring professionals to produce further work that engages media history and everyday life. The collaboration led the Museum of Yugoslavia “ to pay more attention to media as an integral part of the cultural heritage we collect and exhibit[S1]. The Wende Museum emphasized the importance of the “ accumulated knowledge and expertise in media history among our staff” as a result of the collaboration with Mihelj and Reid, and is planning “ another exhibition on another aspect of media and communication history, in the near future” [ S7].

2. Improved understanding among museum visitors and TV viewers

Mihelj and Reid’s impact reached a combined total of over 864,000 museum visitors and TV viewers in five countries. The BBC documentary reached 585,000 viewers in the during its first broadcast on 7th November 2019 and attracted 104,947 iPlayer requests within four weeks [S9], the travelling exhibition attracted close to 30,000 visitors in three countries [S1, S2], the British Museum exhibition was attended by 141,000 visitors [S5], and the Wende Museum exhibition attracted over 3,300 visitors [S7].

Audience research conducted among museum visitors at the British Museum [S6] and the Wende Museum [S8] confirmed that the exhibitions, and specifically the aspects influenced by Mihelj and Reid’s research, improved visitors’ understanding of media and everyday life in communist Europe. Qualitative interviews with 84 visitors of the British museum exhibition [S6] demonstrated that aspects of the exhibition influenced by Mihelj and Reid’s research led to new knowledge and greater enjoyment. A significant number of interviewees brought up alternative exchange and reward systems as something they were not aware of prior to attending the exhibition, with one visitor noting that “ it hadn’t really occurred to me that money is less important in a society that is less capitalist[S6, p. 6]. Several visitors also commented on similarities with the West or noted the diversity of countries [S6, p. 6-7]. The inclusion of everyday objects also proved effective, with several visitors mentioning such items as key points of entry for their engagement with the exhibition, and a source of pleasure [ S6, p. 7-8, 10]. Several visitors also noted the prominence of female heroines on banknotes, thus confirming the effectiveness of Mihelj and Reid’s suggestion to restructure the treatment of gender [S6, p. 8].

A similar study was conducted among visitors at the Wende Museum, based on thematic analysis of 78 visitor interviews [S8]. Prior to visiting the exhibition, 36 (46%) interviewees associated communist TV with propaganda or state control, and 16 (21%) expected it to compare unfavourably with Western television in terms of quality, content, or form. Most interviewees thought their perceptions changed considerably thanks to the exhibition. 22 (37%) reported being surprised at the range of genres, with one interviewee noting that “ it never dawned on me that they would have game shows going on[S8, p. 5] while another highlighted the surprisingly large amount of entertainment and cultural imports [S8, p. 6]. Another common conclusion was that communist television programming and audience interests were less distant from their own experiences, with one interviewee commenting: “ You can tell that it was a lot more open than I thought it was before. It was really pretty similar to American television at the time,” [S8, p. 6]. Several respondents (18%) also commented on children’s programming in this context, with one noting that it “ helped complicate the narrative of Soviet bloc countries … there was also television programming for kids, and cartoons, and regular homelife going on throughout this period[S8, p. 7].

Visitors also expressed interest in the presence of socialist advertising, western imports, and access to Western television signals. For instance, one interviewee noted that he “ wasn’t aware of how easily people had access to Western television”, while another noted that he was “ surprised to see that there were many American TV shows[S8, p. 8[. When asked to discuss similarities and differences with Western television, interviewees focused heavily on similarities, primarily in terms of aesthetics (28%) but also genres (19%). A notable proportion of participants (14%) highlighted similarities with regards to propaganda. According to one participant, both communist and Western television “ tried to show from one point of view how great their systems were”, while another concluded “ It’s all kind of the same in the sense that we’re all trying to, you know, promote our ideals.” [S8, p. 11]. A significant proportion of participants (19%) also argued that the exhibition led to a change in their attitudes to Western media, in the sense that they became more critical of contemporary Western media, for instance because they became more aware of ideological messages [S8, pp. 13-14].

To ascertain the impact of the TV documentary, the market research agency Opinium was commissioned to conduct a study comprising of a two-wave survey (before and after viewing) and qualitative follow-up interviews [S10]. The first survey wave was conducted among 536 viewers selected from a nationally representative sample of BBC Four viewers who regularly watch history documentaries. The second wave was conducted among 257 viewers (of the initial 536) who watched the Berlin Wall documentary. Results showed that the documentary was well received, with 86% stating that it made them more aware of the role of television in the Cold War, and 74% agreeing that the discussion of the role of television was one of the highlights of the programme [S10, p. 7]. The comparison of the two waves confirmed that the documentary increased understanding of Cold War television and its impact on politics. In the first wave, only 22% of respondents knew that East German citizens were able to watch West Germany TV, and only 21% were able to correctly identify Schabowski as the politician announcing border regime changes during a TV press conference. After viewing, the proportions increased to 59% and 68% [S10, p. 4-5]. The documentary also inspired viewers to learn more about the subject: 60% of participants stated they intend to find out more about the media in the Cold War as a result of watching the documentary [S10, p. 7].

3. Enriched cultural heritage and larger and more diverse audiences

Thanks to Mihelj and Reid’s interventions, exhibitions in five museums in five different countries included several objects relevant to the history of media and everyday life during communism, and most of these were new acquisitions that will remain in museum collections and enable the three institutions to re-use them in future exhibitions. This also means that Mihelj and Reid’s work has contributed to enriching the cultural heritage of the Cold War. For instance, the They Never Had It Better exhibition included several TV-related objects which since remained in the collections of the three participating museums in three countries [S1, S2, S3]. The exhibition also included an extensive public engagement component, which involved the acquisition of everyday objects via donations from the public [S1, S2]. These donations included several TV sets, which were added to collections in the three countries [S1, S2]. For the Currency of Communism exhibition, Mihelj and Reid’s assistance with the selection and sourcing of exhibits led the British Museum to acquire archival photos and medals from the period, and materials from Reid’s private collection [S4], thus enriching national collections of communist material culture [S5, p.1].

Mihelj and Reid’s impact on cultural heritage was particularly notable in the case of the Watching Socialism exhibition. Their advice and existing links with heritage institutions in Eastern Europe was instrumental in expanding Wende’s collection, both by adding objects relevant to media history (TV sets and antennas, everyday domestic objects, archival photos and video) and by expanding the regional scope of the collection (while most of Wende’s original collection was sourced from East Germany, it now includes several objects originating from the Soviet Union, Hungary, Poland, Romania and socialist Yugoslavia). As Wende’s Chief Curator explained, this expansion of the collection “enables us to tell a more complex story about everyday life through comparing these items with those from East Germany that we already had. As these new objects are now in our collection, we are likely to use them in later exhibitions” [S7].

Through generating richer and more diverse collections and narratives of the past, Mihelj and Reid’s work also helped partners reach larger, new, or more diverse audiences. In south-eastern Europe, the travelling exhibition enabled the museums, which are traditionally attracting primarily foreign visitors, to strengthen their connection with local audiences: the Historical Museum in Sarajevo noticed a surge in the proportion of domestic audiences [S3], and the Museum of Yugoslavia in Belgrade noted a considerably higher proportion of families, with parents using the exhibition to introduce children to their personal experiences of life under communism [S1]. The BBC documentary had an audience share of 2.6%, which is considerably higher than the slot average of 2.1% [S9]. Finally, the British Museum exhibition attracted the largest share of all free exhibitions held that year, a higher than average proportion of younger visitors, and visitors from central and Eastern Europe, suggesting that “ it enabled the museum to attract new audiences” [S5, p. 9].

5. Sources to corroborate the impact

[S1] Letter, Director of the Museum of Yugoslavia.

[S2] Letter, Director of the National Museum of Contemporary History.

[S3] Selected media coverage and reviews of the They Never Had It Better? exhibition.

[S4] Letter, Department of Coins and Medals, The British Museum.

[S5] Tom Hockenhull: ‘ The Currency of Communism – Art Fund New Collecting Award’ (curator’s final report, prepared for the funder of the exhibition).

[S6] Leila Wilmers: The Currency of Communism: A Study of Visitor Understanding, Learning and Engagement’.

[S7] Letter, Chief Curator and Director of Programming, Wende Museum.

[S8] Leila Wilmers: Watching Socialism: A Study of Visitor Understanding, Learning and Engagement’.

[S9] Letter, Producer and Director, Alleycats TV.

[S10] Opinium Research: ‘Loughborough University – Reception of Documentary’.

Submitting institution
Loughborough University
Unit of assessment
34 - Communication, Cultural and Media Studies, Library and Information Management
Summary impact type
Societal
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

While the BBC has a duty to provide duly accurate and impartial news for all communities, including rural communities, its coverage has been regularly attacked for being inaccurate on rural issues and exhibiting a London/metropolitan bias. Against this background, the BBC Trust commissioned the Centre for Researchers in Communication and Culture (CRCC) to conduct a large-scale analysis of news output. Based on this, the Trust made a series of recommendations, and the BBC Executive implemented the following changes to improve the BBC’s accuracy and impartiality: 1) appointed new staff, including a senior figure tasked with championing rural affairs; 2) enhanced the use of existing expertise and implemented better internal information sharing processes; 3) diversified the sources used in rural news; and 4) provided new opportunities for journalists to develop experience and knowledge of rural issues and policy.

2. Underpinning research

Deacon, Downey, Stanyer and Wring, together with other members of the Centre for Research in Communication and Culture (CRCC), have, since 1992, developed world-leading expertise and experience in conceptually and methodologically innovative, empirically extensive content analyses of impartiality, accuracy and partisanship in broadcast and print journalism, both nationally and internationally. Content analysis is a well-established and widely used research method in communication and media studies. The CRCC has pioneered the development of large-scale media content analysis of political events and contentious political and social issues.

The CRCC has developed and fine-tuned a variety of measures to indicate impartiality, accuracy and partisanship, and improved procedures for the human coding and analysis of large samples of broadcast and press reporting [R1]. These measures and practices have shaped regular analyses of news coverage of general elections, and national and regional referenda [R2, R3], and the impartiality reviews of the BBC’s reporting of the Israeli- Palestinian conflict and the Arab Spring, for the BBC Board of Governors and BBC Trust [R4]. The impact demonstrated in the report on BBC’s news and current affairs coverage of rural matters in the UK [R5, R6] is a consequence of this expertise and experience and contributed to improving the impartiality and accuracy of BBC output.

For R5, CRCC researchers examined a total of 1500 hours of the BBC’s output, equating to 106 days of coverage of rural issues on selected days from September 2012 to December 2013. The study analysed selected news, current affairs and factual programming on radio and television across all BBC channels, as well as BBC online news, local, indigenous minority language news programmes, and a range of non-BBC news output. In total, nearly 1700 relevant items were identified and coded across 48 outlets.

Our research made the following key findings:

  • The attention paid to rural matters varied across BBC outlets. There was a strong contrast in the performance of specialist programmes and local news compared to national news networks. The latter lacked an understanding of the often-complex nature of rural controversies, presenting matters as an overly simplistic binary conflict [R5, R6].

  • On network news output, there was a limited diversity of rural voices present, with coverage on the UK-wide BBC network dominated by 'a small number of charities and NGOs[R5, R6] and there was a ‘ disproportionate amount of time given to the views of celebrities[R5, R6].

  • The use of visuals on national network news was often rudimentary using a stock set of images. For example, in terms of Bovine TB, visuals focused on healthy badgers rather than sick cows [R5, R6].

  • The unique challenges and perspectives of rural people, communities and businesses were overlooked by the main network news channels, and the national news networks often ignored the policy differences of the devolved nations [R5].

3. References to the research

R1: Deacon, D. (2007). Yesterday’s Papers and Today’s Technology: Digital Newspaper Archives and ‘Push Button’ Content Analysis. European Journal of Communication, 22(1), 5–25. https://doi.org/10.1177/0267323107073743

R2: Deacon, D., Wring, D. & Golding, P. (2006). Same Campaign, Differing Agendas: Analysing News Media Coverage of the 2005 General Election. British Politics 1, 222–256 https://doi.org/10.1057/palgrave.bp.4200020

R3: Deacon, D., & Smith, D. (2020). The politics of containment: Immigration coverage in UK General Election news coverage (1992–2015). Journalism, 21(2), 151–171. https://doi.org/10.1177/1464884917715944

R4: Downey, J. Stanyer, J., Deacon, D., & Wring, D. (2012). Impartiality and Accuracy Review of the BBC’s Coverage of Events Known as the Arab Spring: A Content Analysis. London: BBC Trust. https://www.bbc.co.uk/bbctrust/our_work/editorial_standards/impartiality/arab_spring.html

R5: Stanyer, J., Deacon, D., Downey, J., & Wring, D. (2014). Rural Areas in the UK Impartiality Review: A Content Analysis for the BBC Trust. London: BBC Trust. http://downloads.bbc.co.uk/bbctrust/assets/files/pdf/our_work/rural_impartiality/content_analysis.pdf

R6: Stanyer, J. (2020) Biased or Balanced? Assessing BBC news and current affairs performance in covering the Badger Cull in England. Journal of Rural Studies. 81, 59-67. Online First. https://doi.org/10.1016/j.jrurstud.2020.11.011

This impact case study is underpinned by a body of research funded by the Economic and Social Research Council in 2002 (L33330300168) and the BBC Trust in 2011 (£75,597 GBP) and again 2013 (£78,852 GBP). The reports R4 and R5 underwent rigorous internal and external review. R4 underpinned a case study for Loughborough’s REF 2014 submission. In written letters of support [S5], leading experts in the field of communication research consider R5 internationally excellent in terms of originality, significance, and rigour, and at least of 2-star quality. Emeritus Professor Jay Blumler (Leeds) observes that the originality of the research was ‘ internationally unprecedented’, it was ‘ impeccably rigorous’ and in significance terms, it was crucial to Heather Hancock meeting the Trust’s remit satisfactorily. Professor Stephen Cushion (Cardiff) says, ‘ *the report is internationally excellent, setting a new benchmark for academics studying rural affairs news output.*’ Professor Jesper Stromback (Gothenburg) notes of the report: ‘ its originality, significance and rigour would be recognised internationally.’

4. Details of the impact

According to most recent Ofcom data the BBC remains ‘ the most-used news provider across all platforms’ in the UK, with ‘ 73% of UK adults’ saying, ‘ they use any BBC source for news’ (Ofcom, 2020). In 2018-19 alone, the BBC produced 22,643 hours of news and current affairs output (Ofcom, 2019), spending £315m TV news and current affairs programming. The reach of the BBC is even greater for rural areas, where 96% of adults rely on BBC outputs (Ofcom, 2019). The BBC is required by Royal Charter to deliver duly accurate and impartial news and current affairs, including on rural matters. To ensure this obligation was being fulfilled the BBC Trust, as the BBC’s governing body at the time, commissioned the CRCC to conduct an analysis of BBC coverage. The findings of this research [R5] were central to the recommendations of the Trust’s Impartiality Review of June 2014 [S1]. The recommendations were then implemented by the BBC Executive (the committee with responsibility ‘ for delivering the BBC's services in accordance with the strategy agreed by the Board, and for all aspects of operational management’ (BBC.com). The changes that occurred in response to our research were highlighted in a 2015 follow-up report [S2]. Further, interviews with senior BBC journalists in 2019 confirmed the continuity of this impact [S3, S4].

Together, these reports [S1, S2, S6] and interviews [S3, S4] demonstrate the reach and significance of our impact. Heather Hancock, the author of the 2014 review, noted that she drew ‘ heavily’ on our findings when making her proposals [S1, p.7]. The BBC Trust noted, in their end of charter report, that these reviews ‘ proved fundamental in maintaining and improving standards in BBC content[S6, p.22]. Based on our research, the accuracy and impartiality of BBC’s rural reporting was improved in the following ways.

Impact 1: Improved promotion of rural issues across the BBC network via the appointment of a Rural Affairs Champion and other posts

Based on our research showing the varied visibility of rural issues across the BBC, the Trust identified the need for ‘ a senior figure to take an editorial oversight role, championing rural affairs across network output, devolved, regional and local programmes[S1, pp.11-12]. The BBC Executive appointed the BBC Environment, Food, Rural Affairs & Natural History Executive Editor, Dimitri Houtart, as Rural Affairs Champion in 2015, a role he continues to hold in 2020 [S2, p.7; S3]. The Rural Affairs Champion noted that this was ‘ a significant intervention that led to a series of changes designed to improve the reporting of rural matters which are still in place[S3]. The Champion had success in working both across the network in providing briefing notes on rural stories, and with ‘ individual news programme teams to encourage the coverage of rural affairs and the inclusion of rural views’ [S2, p. 2; S3]. For example, since 2014, the editors and network news teams have been briefed on a range of topics, including for example, ‘ milk prices, organic production, the badger cull, and problems with the Rural Payment Agency’ [S2, p.7]. The outcome, the Executive noted, has been that these subjects have been ‘ covered by our flagship programmes’ [S2, p.7]. These briefings have continued [S3]. For example, during UK General Election campaigns, the Champion has circulated briefing notes on important rural matters. In the 2015 campaign:

This led to issues such as rural broadband, solar farms and wind turbines, and access to services and transport featuring on the One and Six O’clock news, and Radio 4’s Today[S2, p.9].

The Executive extended the remit of two BBC journalists, and BBC Northern Ireland made two journalistic appointments to improve rural affairs coverage [S2, p. 8]. The responsibilities of Claire Marshall and Tom Heap, in the Science and Environment news team, were expanded to include rural affairs, a remit they still hold [S2]. The Executive noted that the Science and Environment team had success in gaining coverage of a broader variety of rural issues on the main network news outlets [S2, p.9; S4]. For example, in 2015, a range rural issues were covered that might have been missed, according to the Executive, these included the following:

  • Changes in legislation and regulation affecting rural communities

Pesticides: Commercial farmers’ efforts to safeguard wildlife and improve yields (One O’clock News; Six O’clock News; 1800 News 24); EU pesticide legislation (Today; Radio bulletins; BBC Breakfast; One O’clock News; BBC Online); Pesticide ban affecting crops (Six O’clock News; 1800 News 24); Closure of animal health testing laboratories (on Today; Six O’clock News; PM; 1800); Milk prices (Six O’clock News; Ten O’clock News 1800); End of milk quotas (One O’clock News; Six O’clock News; Ten O’clock News);

  • Concerns affecting those living in rural areas

Rural Crime Figures (BBC Breakfast; One O’clock News; Six O’clock News; PM; 1800 News 24); Planning changes threaten affordable rural housing (Six O’clock News; Ten O’clock News; World at One); Concerns of rural voters (Six O’clock News). Rural manifestoes (Today);

  • Environmental and wildlife conservation developments relevant to rural communities

Farmland bird decline (One O’clock News; Six O’clock News; Ten O’clock News 1800); Beaver colony can stay in the wild (Six O’clock News; 1800); Putting a value on nature reserves and parks (Six O’clock News); Tree disease (Six O’clock News; Ten O’clock News; PM; 1800);

  • Technological advances and more efficient and sustainable farming

New design of pylons (One O’clock News; Six O’clock News); ‘Cutting edge farming technology’ (on Breakfast News and Today; Radio 4).

Impact 2: Improved use of existing BBC expertise on rural affairs from the regions and specialist programmes

Based on our findings showing the limited in-depth understanding of rural issues, the Trust recommend the main network news outlets better use expertise currently based in the regions and specialist programmes [S1, pp.11-12]. In response, the BBC Executive extended the briefs of three regional correspondents so that they would have a special responsibility to provide rural affairs stories to network news [S2, p.6]. The three correspondents were: ‘ *West Midlands - David Gregory Kumar (Rural Affairs Correspondent, Birmingham); East - Richard Daniel (Correspondent, Look East / Radio Suffolk); East Yorkshire & Lincolnshire - Paul Murphy (Environment and Rural Affairs Correspondent, BBC Hull)*’ [S2, p.6]. In 2020, these correspondents remain in these roles and are widely used [S3]. They have had success in getting a range of stories on rural matters on network news bulletins and have raised awareness of rural matters on BBC network news [S2, p.2., S4].

Links were also established and developed between BBC network news and specialist programmes such as Countryfile and Farming Today [S2, p.7, S3]. The Executive determined that an Environment and Rural Affairs Correspondent would be based in Bristol to improve links between network news output and Farming Today [S2, p.7]. The Executive report notes that Farming Today team have provided packages for network radio news on a range of rural issues. Links were also developed between Countryfile and BBC News so that Countryfile reporters could contribute to network news programmes [S2, p.7]. These links have enabled reporters from these programmes to regularly ‘ contribute reports on rural issues to TV bulletins and offer expertise on radio news programmes’ and provide ‘ explanation and clarification of stories[S2, pp.7-8, S3].

Impact 3: Increased diversity of rural voices in the news

Based on our research finding highlighting the limited diversity of rural voices in coverage, the Trust emphasized the need to improve contacts for journalists. In response there was ‘ a concerted effort to revitalise the BBC’s rural contacts list across a wide range of expertise[S1, pp.11-12]. In 2015, the BBC Executive noted that the rural affairs Champion and Carol Rubra (Health, Science and Environment Assignment Editor, BBC News) at the Rural Affairs Unit 'compiled a pan-BBC rural affairs contacts list and a news contacts list of planning teams ' [S2, p.7]. They also noted regular meetings between the Countryfile team and the Rural Affairs Champion to ensure ‘ that radio and television share contacts and information[S2, p.7]. The Executive note that network news programmes ‘ regularly call the Farming Today team for explanation or clarification of stories, to help source contributors, or for experts’ comments[S2, p.8]. An interview with our research team in 2019 confirmed that network news was still making use of the contacts of the Rural Affairs Unit in Bristol [S3]. The Unit’s ‘ expertise is regularly called upon, and they supply packages for network radio and television news on a range of rural issues and provide all important clarification and explanation of a range of rural matters’ [S3].

Impact 4: Provided new opportunities for journalists to exchange ideas and experiences and to develop knowledge of rural issues

Finally, to overcome a lack of in-depth understanding on rural issues and devolved policy matters identified in our research, the Trust recommended instigating opportunities for journalists and programme makers to discuss rural issues and policy ‘ with a wider mix of institutional and local voices[S1, pp.11-12]. The change implemented by the BBC Executive involved a thrice yearly Rural Affairs Committee meeting for BBC and non-BBC stakeholders. After this, there is a further follow-up meeting ‘ so that BBC staff from News, the regions, radio and television, have a chance to discuss stories and collaborate face-to- face[S2, p.8, S3]. The report, and interviewees, acknowledge that these meetings provide a ‘ very valuable’ opportunity for editorial staff ‘ *scattered across the UK to meet and discuss this area of output.*’ [S2, p.5, S3]. A BBC journalist who attends these meetings noted they are a ‘ great opportunity to discuss developments and key issues for staff across the UK[S4]. In addition, there have been one-off special events such as a Rural Affairs Awayday and the College of Journalism’s ‘ expert day’ designed to bring together experts and BBC journalists [S2, p.17]. These special events provide additional ‘ opportunities to discuss stories and collaborate face-to-face[S2, p.17].

5. Sources to corroborate the impact

S1: BBC Trust (2014) BBC Trust Impartiality Review: BBC Coverage of Rural Areas in the UK. London: BBC Trust. ( S1 is the public report overseen by Heather Hancock and commissioned by the BBC Trust, which makes a series of recommendations to improve the impartiality and accuracy of the BBC output.)

S2: BBC Trust (2015) BBC's Coverage of Rural Areas in the UK: The BBC Trust's Conclusions on the Executive's Follow-up Report. ( S2 is the BBC Executive’s response to the BBC Trust report documenting the changes made in response to the recommendations in S1.)

S3: Letter from XXXXXXXX, BBC XXXX XXXX XXXX XXXX XXXX and XXXX XXXX Executive Editor and XXXXX XXXXX XXXXX, including interview notes for 12 December, 2019.

S4: Letter from XXXXXXXX, BBC XXXX XXXX XXXX and XXXX Correspondent, Birmingham, including interview notes for 19 December, 2019.

S5: Letters testifying to the quality of the underpinning research.

S6: BBC Trust (2017) BBC Trust: End of Charter Report. London: BBC Trust. ( S6 is the final report from the BBC Trust testifying to the importance of the reviews in improving BBC impartiality and accuracy.)

Submitting institution
Loughborough University
Unit of assessment
34 - Communication, Cultural and Media Studies, Library and Information Management
Summary impact type
Societal
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Rigorous and timely monitoring of news media are vital during major elections and referenda, where citizens rely heavily on news coverage to inform their understanding and evaluations of manifestos, candidates, and parties. Research conducted at Loughborough University’s Centre for Research in Communication and Culture (CRCC) provided unique ‘real time’ analysis of mainstream news coverage of all major UK campaigns since 2015 (three General Elections and the EU Referendum). The overall impact of the research has been to improve the quality of media coverage and public debate during elections and referenda. This has been achieved through (1) helping politicians and journalists raise public awareness of inequality of media access, (2) enabling campaigners and journalists to identify and challenge media partisanship, and (3) improving the balance of media agendas.

2. Underpinning research

Research conducted by David Deacon, Dominic Wring, James Stanyer, John Downey, Emily Harmer and David Smith has provided authoritative, timely and accessible statistical analyses of the performance of the major news media during the most significant recent UK political campaigns (2015, 2017 and 2019 UK General Elections and 2016 EU Referendum). These studies used rigorous manual content analysis methods to examine more than 11,000 relevant news reports and commentaries published during the four campaigns. Producing this kind of high-quality data at scale in a highly restricted time frame is a huge intellectual and logistical challenge. Manual content analysis is labour intensive but remains the methodological ‘gold standard’ for analysing multi-faceted content.

Findings from all four studies were published as the campaigns unfolded through weekly reports, accessible via Loughborough University’s main website, and supported by intensive social media and other publicity activities. The reports provided measures of ‘stopwatch balance’ (how equitable and diverse was the coverage of rival politicians?), ‘directional balance’ (how positively or negatively were competing protagonists represented?) and ‘agenda balance’ (which issues were foregrounded or neglected?). Key findings from the four studies included evidence of:

  • An intensification in pro-Conservative press partisanship across the three General Elections [ R5];

  • The dominance of Conservative sources in press and TV coverage of the EU Referendum, and the narrow range of issues reported in the debate over UK withdrawal during that campaign [ R3, R6];

  • The intermittent news-worthiness of ‘Europe/Brexit’ related coverage across three General Elections, despite its manifest significance [ R1, R2, R4];

  • The persistent underrepresentation of women in coverage throughout the four campaigns [ R4];

  • The reduction in multi-party representation since the 2015 Election [ R2, R4, R6];

  • A greater policy focus in TV news in GE2017 and GE2019 compared to GE2015, which was dominated by coverage of the electoral process itself rather than substantive manifesto issues [ R4].

The research built on an unbroken legacy of ‘real time’ analysis of General Election news coverage dating back to 1992, when Loughborough University collaborated with the Guardian newspaper to provide the first ever examination of UK broadcast and print coverage published during the actual election campaign itself. The most recent studies remain the only news audits that combine comprehensive examinations of both press and television content, thereby enabling analysis of the related inter-media dynamics. Furthermore, by conducting the research across all four campaigns, the analysis was uniquely positioned to combine immediate and longitudinal comparative perspectives. This has enhanced the value of the findings to external stakeholders.

3. References to the research

[ R1] Deacon, D., and Smith, D. (2020) ‘The politics of containment: Immigration coverage in UK General Election news coverage (1992-2015)’ Journalism, 21(2): 151–171. https://doi.org/10.1177/1464884917715944

[ R2] Deacon, D. and Wring, D. (2016) ‘The UK Independence Party, Populism and the British News Media: Competition, Collaboration or Containment?’ European Journal of Communication, 31(2): 169-84. https://doi.org/10.1177/0267323115612215

[ R3] Deacon, D. and Wring, D. (2017) ‘One Party, Two issues: UK News Media Reporting of the EU Referendum’ in J. Mair et al. (eds) Brexit, Trump and the Media, London: Abramis, pp.36-44.

[ R4] Deacon, D., Downey, J., Smith, D., Stanyer, J. , Wring, D. (2019) ‘A Tale of Two Parties: Press and Television Coverage of the Campaign’ in D. Wring et al. (eds) Political Communication in Britain: Campaigning, Media and Polling in the 2017 General Election [ R5] Wring, D. & Deacon, D. (2019) ‘A Bad Press’ in Cowley, P. & Kavanagh, D., The British General Election of 2017. Hampshire: Palgrave Macmillan, pp. 347-384.

[ R6] Smith, D., Deacon, D., and Downey, J. (2020) ‘Inside Out: the UK Press, Brexit and Strategic Populist Ventriloquism,’ European Journal of Communication, https://doi.org/10.1177/0267323120940917

All outputs were peer reviewed and/or commissioned by leading journals or book series. The 2015 General Election study was funded by a grant from the peer reviewed British Academy/Leverhulme Small Grant Scheme (SG142216). The 2017 and 2019 General Elections were snap elections and the 2016 Referendum timing was only confirmed four months before the vote. For these studies, we secured internal University funding in order to work rapidly and responsively. The team was awarded the Loughborough University Vice-Chancellor’s Award for Research Excellence for their analysis of the 2016 EU Referendum.

4. Details of the impact

The four campaigns occurred in a context of tumultuous political change, with each framed by controversy over the UK’s future relations with Europe. Three of the four campaigns also produced unanticipated outcomes. It is especially challenging to make rapid and prominent interventions in these highly charged and competitive environments. Deacon, Wring, Stanyer, Downey, Harmer and Smith developed five impact pathways to ensure immediate and sustained high visibility for their research throughout each campaign:

(1) Weekly news audit reports and commentaries: during the five weeks of campaigning before each polling day (seven weeks in the EU Referendum case), the team produced weekly commentaries and statistical reports. Every instalment identified and measured trends in news coverage and was published on a bespoke University website. During the 2015 campaign, the site received 8.2K visitors and 6.7K unique users. These figures increased exponentially over time, with our 2016 Referendum analysis achieving 26.8K views and 21.3K unique users and our analysis of the 2019 election reaching 36.7K visitors and 30.7K unique users. We wrote additional analytical pieces to promote every instalment published during each campaign for a range of influential blog sites and online journals. These included the ESRC sponsored UK in a Changing Europe, the Press Gazette and Campaign for Press and Broadcasting Freedom. We published fourteen articles in The Conversation (the highly respected independent on-line site for academic expert opinion) across the four campaigns. These received a total of 97K readers, with an average of 6930 readers per item [ S1].

(2) Social media: key findings from every report were distributed via Twitter, Facebook and other channels. Our tweets aggregated 2.64 million Twitter impressions and 172k engagements across the four campaigns. These figures only capture Loughborough account-linked tweets and social media activity prior to polling day. They do not include the wider, more substantial circulation of our findings by external users nor their post-vote distribution. During every campaign, leading politicians, opinion-forming journalists, and influential public figures retweeted and commented on our findings, thereby significantly enhancing the public reach of the research. These included, Labour Leader, Jeremy Corbyn, Conservative Cabinet Minister, Esther McVey, Shadow Chancellor, John McDonnell, former Downing Street strategist Alastair Campbell, ex-Deputy Prime Minister John Prescott, singer Lily Allen, musician Mick Hucknall, senior SNP politician Angus MacNeil, actor Rob Delaney, and prominent journalistic commentators such as Owen Jones ( The Guardian), George Monbiot ( The Guardian), Stephen Smith ( Financial Times) and Jim Waterson ( The Guardian) [S2, pp. 40-53].

(3) Media relations: Advanced copies of CRCC reports were released to selected contacts at the Press Association, Guardian, Independent, BBC and Huffington Post; additional data analysis was requested and provided to various journalists including the flagship ITV political programme Peston, the Guardian, Independent and Huffington Post. Weekly news and video releases were also distributed and in 2019 we produced our own podcasts. Together these activities generated considerable news interest in the research. Nationally, these included items in The Observer, Peston, Huffington Post, BBC Radio 4, The Financial Times, Daily Mirror and Daily Mail. Internationally, the research was reported by numerous outlets including the New York Times, China Today, Al Jazeera and CNBC [S1],[S2],[S3],[S4],[S5]

(4) Post-mortem events : after each campaign, the team hosted a collaborative event, at which journalists, political strategists, pollsters and other external stakeholders reflected on the campaigns and the key takeaways [S1].

(5) High level briefings for senior policy makers: team members received numerous invitations invited to present findings in person to numerous high-status external stakeholders, including public bodies such as the Welsh Assembly, Ofcom and the French Embassy [S1].

A major factor in securing high levels of public and media reach was gaining recognition for the significance and authoritativeness of our research evidence. In 2015, Ivor Gaber, a

former political journalist with BBC, ITN and C4 and now Professor of Journalism at the University of Sussex, observed of the research: ‘It’s the gold standard if you like…People recognise it as the definitive statement of media agendas, media bias and so forth and also in particular compared to other surveys, it covers both press and broadcasting and that is very useful’ [S9]. In 2017, Gaby Hinsliff, former political editor of the Observer, stated the Loughborough studies were ‘the British equivalent’ of Harvard University’s Shorenstein Center on Media, Politics and Public Policy (‘Is Labour fighting shocking media bias or does it need to get its act together?’, The Observer, 20/5/2017).

This research improved the quality of media coverage and public debate during elections and referenda. This was achieved through three impacts which depended on close and continuous engagement with media sources. It is important to emphasise that Journalists and news editors were significant external stakeholders in their own right, as the research addressed directly their professional practices.

1. Helping politicians and journalists raise public awareness of inequality of media access

This impact derived from the monitoring of ‘stopwatch balance’ [R2], [R3], [R4]. Loughborough’s analysis extended beyond checking party political imbalances (such as the dominance of Conservative sources in the Referendum coverage) to consider wider issues concerning media diversity. For example, the CRCC identified major gender inequalities in the reporting of all four campaigns covered by this impact case study. During the Referendum, former Deputy Labour Leader Harriet Harman wrote to Ofcom, complaining that broadcast coverage had been dominated by men and it was “ time for women’s voices to be heard” (24/5/2016) [S3, pp. 2-3]. Ms Harman cited Loughborough’s data at the public launch of her complaint - which also involved three Shadow Secretaries of State and received blanket national press coverage– and in her formal submission to Ofcom [S3, pp. 7-16]. Loughborough’s research showed there was a marked shift in TV news coverage following the MP’s intervention. In the 12 weekdays before Harman’s Ofcom complaint, women accounted for 20 percent of the political sources appearing on primetime TV news coverage of the Referendum. For the same period after the intervention, this figure increased to 31 percent - a statistically significant difference [S3, p.17]. This change was partly the result of a shift in the dynamics of the campaign that followed directly from the complaint. According to the Financial Times, both the official Remain and Leave campaigns nominated women politicians to represent them in the ITV Referendum debate held on 9 June in direct response to these criticisms, with Boris Johnson the only male among the six campaigners onstage [S3, pp. 4-6]. Our evidence in 2016 was also used to support public interventions by the Fawcett Society and Operation Black Vote raising concerns about the lack of diversity witnessed in the Referendum campaign [S3, pp. 18-21]. In the 2019 General Election, our findings were cited by Dr Helen Pankhurst, great granddaughter of suffragette Emmeline Pankhurst, to highlight enduring gender inequalities in media reporting [S3. pp.22]. In February 2019 Conservative Cabinet minister Esther McVey, quoted CRCC statistics on the gender imbalance of Referendum news coverage in launching her ‘Ladies for Leave’ pressure group. The video on Twitter had more than 872k views and 10k tweet engagements.

2. Enabling campaigners and journalists to identify and challenge media partisanship

This impact links to Loughborough’s research on trends in the ‘directional balance’ of campaign coverage [R2], [R5]. UK national newspapers routinely endorse parties (and positions) during campaigns, and typically most press opinion has nominally supported the Conservatives. But political partisanship is not an ‘either’/‘or’ matter: there are several gradations in the strength of these endorsements. Most significantly this is expressed in the degree of routine positive/negative editorial treatment of candidates and policies. In recognition of this, the CRCC developed a methodology for calculating the aggregated strength of individual news outlets’ support/opposition for competing positions. By linking these calculations to circulation, the team were able to show that pro-Leave coverage had a significantly wider public distribution than pro-Remain coverage in the 2016 EU Referendum, despite equal numbers of daily titles supporting either campaign [R3]. This methodology also demonstrated that anti-Labour coverage intensified significantly in the 2019 General Election. Both these findings received considerable public and media exposure and the latter findings were cited by senior politicians. For example, on 19 December 2019, Labour Leader Jeremy Corbyn retweeted a link to our analysis of press partisanship with the comment ‘ *What was it about our plans to make the super-rich pay their fair share that the billionaire press barons didn't like?*’ [S2, p.51]. This tweet generated more than 45K additional engagements within three days. Other senior Labour politicians also drew attention to Loughborough’s data, including the Shadow Chancellor and Shadow Transport Secretary [S1, pp.30-32]. On occasion, the interpretation (but not the integrity) of our evidence was the subject of public debate and this further expanded its reach. For example, following a complaint from a Daily Mirror political correspondent, the BBC Radio 4 statistics programme More or Less ran a segment assessing contrasting interpretations of Loughborough’s figures relating to the prominence (or not) of Jeremy Corbyn in the reporting of the 2016 EU Referendum [S7].

Loughborough’s methodology has been adopted by opinion-forming media outlets. In December 2019, when researching the role of mobile news apps in alerting voters to political content, The Guardian acknowledged it was: ‘Following a methodology applied by Loughborough University to analyse print news’. It has since reused the method to conduct further investigations into the partisan treatment of the Royal family and celebrities [S6].

3. Improving the balance of media agendas

This impact relates to the findings on ‘agenda balance’ [R2], [R3], [R6] and has been achieved in three ways. First, the research promoted reflexivity about the nature of the news and its significance during campaigns. As Richard Hooper, Producer of BBC R4’s The Media Show, commented after his show’s review of the 2019 election ‘The inclusion of Loughborough’s research enhanced the quality of the debate, making it more informed and increasing the awareness and understanding of the role of the media among the participants’ [S4]. Second, leading journalists and editors approached us on many occasions for data to assist them in developing new lines of editorial enquiry about media-campaign dynamics. For example, we frequently furnished data and analysis to ITV’s flagship current affairs show Peston to expose important aspects of the mediation of the campaigns [S5, pp.3-8]. In October 2018, following intense political debate over the implications Brexit held for custom arrangements for Northern Ireland, on our own initiative we provided the programme with findings demonstrating how little coverage there had been of Northern Ireland and border issues during the Referendum campaign itself. The results were prominently reported in the programme and afterwards Kishan Koria, producer of ITV’s Peston show stated:

‘We are always on the lookout for the best research and data to help tell the story of what is happening in politics and we've come to find the Loughborough University CRCC an incredible resource to help us do this’ [ S5, p.2].

Third, our research also influenced wider editorial strategies in campaign reporting. For example, the BBC consciously increased the substantive policy focus of its news coverage in the 2017 General Election after our research helped to highlight the inordinately high percentage of coverage that focused on the political drama rather than the policy substance of the preceding 2015 campaign [ S8].

5. Sources to corroborate the impact

Source 1: Portfolio of publicity activities related to CRCC campaign analyses, 2015-2020. Source 2: Media and social media reach of campaign analyses, 2015-2020.

Source 3: Harriet Harman letter to Ofcom and accompanying evidence, 2016. Source 4: Letter from Richard Hooper, BBC R4 Media Show producer, 2019. Source 5: Letter from Kishan Koria, editor. ITV Peston Show, 2018.

Source 6: The Guardian’s adoption of CRCC methodology, 2019 - 2020.

Source 7: Discussion of CRCC research on BBC R4’s More or Less programme, 2016. Source 8: Changes in BBC content, 2015 -2017.

Source 9: Testimonies about CRCC research, 2015.

Submitting institution
Loughborough University
Unit of assessment
34 - Communication, Cultural and Media Studies, Library and Information Management
Summary impact type
Societal
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

Effective communication underpins successful organizations and even saves lives, but most communication training and guidance is not evidence-based. Loughborough University research identified communicative practices that achieve better engagement from users of public, private, and third sector services, which underpinned training using the ‘Conversation Analytic Role-play Method’ (a training approach developed at Loughborough). Training led to improvements in 1) the ability of police negotiators to bring suicide crisis negotiations to a successful outcome ( Metropolitan Police, Police Scotland); 2) the ability of dispute resolution services, government, and court services to engage clients more effectively (UK Ministry of Justice, USA Superior Court; UK Government-funded Advisory, Conciliation and Arbitration Service); 3) patient satisfaction at GP surgery receptions in England, and 4) client experience and economic success of digital technology products and services in global organizations ( Typeform; Toshiba).

2. Underpinning research

While most people agree that effective communication underpins many aspects of an effective organization, the communication skills industry is largely informed by popular science, self-help literature, and guru-led events, often with no scientific basis. Research conducted at Loughborough’s Centre for Research in Communication and Culture led by Stokoe identified linguistic practices that increase the effectiveness of communication between service providers and their users, across a range of organizational settings.

Based on conversation analysis of the audio recordings of real-life conversations supplied by beneficiaries, Stokoe and colleagues showed that changing the design of a question, phrase, or word, can alter conversational trajectories and outcomes, in spoken and written communication. For example, using data collected during an ESRC-funded project on neighbour disputes (2005-2008), they began to analyse initial inquiry calls to community mediation organizations. Stokoe and colleagues found that when potential clients were asked if they were “willing” to mediate they were more likely to say “yes” than when asked if they were “interested” in mediating. They confirmed this finding by studying other types of mediation service [R1]. Findings like these were used to develop a new kind of communication training method - the ‘Conversation Analytic Role-play Method’. CARM works by taking anonymized clips of real talk from the research and playing them, line-by-line, to workshop participants. Participants can identify what works and how, based on real conversations and underpinning analysis. ESRC follow-on funding (2011-12) supported the development and testing of the training methodology. Stokoe also conducted research on traditional forms of role-play-based communication training and assessment and found that a) role-played interaction does not reproduce real encounters and b) professionals often reproduce the tactics they are trained to use but these are ineffective in real life – meaning that CARM training was more authentic than traditional role-play [R2].

Stokoe and colleagues identified effective practices across multiple contexts, including key words and phrases that make a difference to outcomes [R3]. For example, when negotiators ask persons in crisis to “speak” to them, it is more effective than asking them to “talk”, even though they are trained to ask to “talk” [R4]. The success of the training for community mediators led to a series of research projects across public, private and third sectors. Since 2014, the research team conducted further work in a range of settings, including new mediation sectors (e.g., family mediation), cold-call sales [R3, R5], calls to doctors’ surgeries [R6], and police suicide crisis negotiation [R3, R4], based on data supplied by our beneficiaries. A key problem for many of these professionals is to engage the person they are talking to, including prospective sales clients and suicidal persons in crisis, so that the subsequent conversation has a chance of a productive outcome.

In addition to the conversational components of resistance and how to overcome it, the research team also identified key communicative practices for building relationships (or ‘rapport’, in the popular literature) and effective service provision [R5]. They have shown that what happens inside conversations is strongly associated with its outcomes. For example, when salespeople omit the ‘small talk’ at the start of conversations with prospective clients, the conversation is more likely to end with an appointment [R3]. They have also shown that the way service providers (e.g., GP receptionists) conclude calls is strongly associated with patient satisfaction scores at the national feedback level [R6].

3. References to the research

R1: Sikveland, R.O., & Stokoe, E. (2016). Dealing with resistance in initial intake and inquiry calls to mediation: The power of “willing”. Conflict Resolution Quarterly, 33 (3), 235-254. DOI: 10.1002/crq.21157.

R2: Stokoe, E. (2013). The (in)authenticity of simulated talk: Comparing role-played and actual conversation and the implications for communication training. Research on Language and Social Interaction, 46 (2), 1-21. DOI: 10.1080/08351813.2013.780341.

R3: Stokoe, E., Humă, B., Sikveland, R.O., & Kevoe-Feldman, H. (2019). When delayed responses are productive: Being persuaded following resistance in conversation. Journal of Pragmatics, 155, 70-82. DOI: 10.1016/j.pragma.2019.10.001

R4: Sikveland, R.O., & Stokoe, E., (2020). Should police negotiators ask to ‘talk’ or ‘speak’ to persons in crisis? Word selection and overcoming resistance to dialogue proposals. Research on Language and Social Interaction, 53 (3), 324-340. DOI: 10.1080/08351813.2020.1785770

R5: Humă, B., & Stokoe, E. (2020). The anatomy of first-time and subsequent business-to-business ‘cold’ calls. Research on Language and Social Interaction, 53 (2), 271-294. DOI: 10.1080/08351813.2020.1739432

R6: Stokoe, E., Sikveland, R.O., & Symonds, J. (2016). Calling the GP surgery: Patient burden, patient satisfaction, and implications for training. British Journal of General Practice, 66 (652), e779-e785. DOI: 10.3399/bjgp16X686653

The body of work was funded by competitively-awarded funding from the Economic and Social Research Council (RES-148-25-0010; £125K, 2005-8) including follow-on funding to develop the Conversation Analytic Role-play Method’ (RES-189-25-0202; £48K, 2011-12).

4. Details of the impact

Building on research findings about effective communication practice, Stokoe and colleagues developed three impact pathways:

  • The first pathway was the ‘Conversation Analytic Role-play Method’ ( CARM), a communication training method developed at Loughborough University with ESRC funding. CARM takes research findings about effective communication practice and presents anonymized audio extracts in real time to training participants. CARM guides people through actual instances of professional practice to see what works. CARM won a prestigious Wired Innovation Fellowship in 2015, enabling international visibility [S1].

  • The second pathway, which enhanced the international visibility of CARM, comprised numerous prestigious invitations to science communication events, starting with an episode of BBC Radio 4’s The Life Scientific dedicated to Prof Stokoe’s research and biography (2013) which led, in turn, to an invited TED talk in 2014 (currently 870K views), three lectures at The Royal Institution between 2015-16 (currently 50K views) and other public science events around the world (e.g., at Google, Microsoft, New Scientist) .

  • The third pathway was direct integration of research insights into organizations’ written communications via CARM consultancy work.

The international visibility of Loughborough’s conversation analytic research changed public understanding of communication sufficiently to create demand for CARM’s evidence-based training. As a result, CARM generated enough income between 2014-2020 to employ four PDRAs for between three months to five years each, and Prof Stokoe was invited to join the UK government’s Scientific Advisory Group for Emergencies (SAGE) behavioural science sub-group, as well as Independent SAGE’s behaviour group . Taken together, the three pathways led to the following impacts.

  1. Improved communication outcomes in suicide crisis negotiation

Research findings [R3, R4] led to changes to the language used by crisis negotiators, “challenging the training status quo” and improving communication with people in suicidal crisis [S2]. In 2015, Commander Duncan Jarrett OBE and Superintendent Chula Rupasinha from the Hostage and Crisis Negotiation Unit of the Metropolitan Police invited Stokoe and colleagues to work with them. The Head of UK National Training “took the rare step of releasing negotiation tapes” [S5] and we worked with their training lead to co-produce the training. In March 2017, we trained every single Metropolitan Police negotiator at their UK National Hostage course, as well as visiting attendees from regional police forces, international guests from the FBI, and from other areas of policing (e.g., Operational Communications in Policing). Following the training, negotiators reported better outcomes “as a direct result of the language used”, and noted that the training

“has had a specific impact on our negotiations from the opening gambit and throughout the dialogue … and help[ed] bring incidents to a swift conclusion” [S2].

On hearing about the work with the Metropolitan Police, in 2018 the Head of Border Policing Command at the Organised Crime and Counter Terrorism Unit invited Stokoe and colleagues to roll-out the training to every Police Scotland negotiator. Following the training in 2019, the heads of training and operations reported that “the research is fully embedded within negotiator training courses and materials.” [S2]. The reach of the training has since extended beyond negotiators to every new officer in Police Scotland via the hostage and crisis unit’s input into tactical communication [S2].

2. Improved engagement of potential clients of dispute resolution services

Our research enabled dispute resolution services – that provide alternatives to expensive court-based interventions – to better engage potential clients to participate in them. People in disputes often resist alternative dispute resolution services and overcoming this resistance is thus crucial to the success of dispute resolution [R1, R3]. Starting with mediation services, Stokoe and colleagues changed the way practitioners in mediation services dealt with initial telephone inquiries from callers to convert them into clients. By training over 4000 mediators (2014-2018) from community, family and other types of mediation , across 200 services in UK, USA and Australia, mediators adopted practices that were more likely to get clients to agree to become clients [S3]. For example, from the Board of the UK College of Mediators, Laura Kirkpatrick and Julie Farrell (who also founded in 2016 their own mediation service, Solution Talk) reported that CARM training enabled them to

“make changes when we pick up the phone [and] get people in conflict and stress to the table to negotiate or mediate” [S3].

The Chair of the UK College of Mediators and a CEO of Relate, the national marriage guidance organization (which also provides mediation), said that CARM is “acknowledged widely in the mediation world as ground-breaking” [S3] and, because many mediators work across numerous organizations, including government task forces, the reach of this impact was extended via a UK Government campaign in 2014 to engage people in family mediation. The then Minister of Justice, Simon Hughes MP, invited Stokoe to join the Family Mediation Task Force to change how mediation is promoted and write the text for a national video, poster, and leaflet campaign [S4]. Deputy Director of Family Justice, John Hall, reported that as a “direct consequence” of Stokoe’s input” [R1, R3], the Ministry of Justice redesigned their “promotional video and related leaflets/posters” [S4]. The Ministry of Justice described this campaign as having “the best return on investment, reaching large volumes of people over the duration of the campaign.” The reach of the work was also extended internationally, as the Superior Court for Washington DC, USA (which serves 5.3M citizens), who had previously invited Stokoe to deliver CARM training, adopted the campaign using Stokoe’s text, creating versions for community and family mediation in English and Spanish [S4].

Furthermore, because some mediators also work with or for Advisory, Conciliation and Arbitration Service (ACAS),** Stokoe was invited to run eight regional CARM training events between 2014-2018 and was then contracted to train every senior advisor and all internal trainers across the organization (2019-2020) – 250 conciliators across England, Wales, and Scotland [S5]. The aim was to support conciliators who “have a tough time trying to persuade people that conciliation is a worthwhile process … we tend to find that conciliators have to repeat conversations which adds to time on the phone. And because government funding is becoming more limited over time, we must work as efficiently as possible” [S5]. ACAS’s Chief Operations Officer, working with a conciliation manager who organized all the training sessions, reported that, following the training, conciliators changed the language they used to describe services, and changed the timing of their explanations of services in initial conversations with clients, producing more “efficient and seamless” calls [S5].

3. Improved patient satisfaction with telephone inquiries to UK GP receptions

Even though all UK GP surgeries experience similar resourcing challenges, they vary greatly with regards to reported patient satisfaction. In 2015, Dr Graham Todd, responsible for Quality Improvement Science at Health Education England, commissioned Stokoe and colleagues to conduct research to identify best practice in patient calls to GP practices. Dr Todd supplied recordings of patient calls to four surgeries. Dr Todd reported that

“findings showed that very simple phrases and words are associated with increased patient satisfaction on the GP Patient Survey. As a practice, how our receptionists speak to patients has changed significantly.” [S6].

Based on research findings [R6] about how to meet the requests made in incoming calls to surgeries, eight CARM events took place across England, training ~80 receptionists from ~20 practices and therefore reaching ~200,000 patients. Following the training in 2017, indicators from the quarterly GP National Survey on key aspects of GP receptionist provision improved. The proportion of patients describing the “experience of booking an appointment” as ‘good’ increased from 76% to 95%, compared to no change across the UK during the same period. And the proportion of patients reporting that the “GP receptionist was helpful” increased from 66% to 77% in those surgeries trained, while the national picture remained constant [S6].

4. Improved client experience and economic success of digital technology products and services in global organizations

Our research on client engagement [R1, R5] was sought in 2018-19 by Typeform, a global ‘software as a service’ company (and iconic Silicon Valley start-up) with three million subscribers who use Typeform’s templates to create online surveys. Typeform wanted to increase the ‘conversationality’ of their product because “conversational forms are better than regular forms” and “because conversation creates a better user experience and thereby more results” [S8]. Typeform funded Stokoe to work with them for four months to integrate research findings about effective question design [R1-R6] into the product to address business metrics such as completion rates and new customer registrations” [S7]. As a result of redesigning the questions in Typeform’s survey templates, and creating assets for marketing, design, machine learning, and customer experience teams [S7] their CEO reported in 2019 that “customers are now enabled to increase the effectiveness of the forms in terms of completion rate” [S7]. The CEO further reported that

“the immediate beneficiary is Typeform itself, but the end user is the real beneficiary – our customers who are actually now creating typeforms with different templates and different guidance. Their forms are a critical part of their business process, we want to maximize their changes for as good a completion rate as possible, so that they can convert a potential new lead into a customer and then into revenue” [S7].

The same underpinning research was sought by *Toshiba Tec Imaging Systems who identified the need for research-based rather than anecdotally driven communication training [S8]. Many businesses ‘cold call’ other businesses “as a large part of the way the technology industry generates sales” but these achieve “low percentage appointment rates” (National Sales Director, Toshiba Tec) [S8]. Toshiba commissioned us to identify the communication practices that led to more sales appointments [R3, R5]. Research findings underpinned subsequent CARM training for its authorised Business Partners across the UK and Ireland in 2016-17. Toshiba’s National Sales Director reported that, because of the training, salespersons were enabled to

“reduce call time, making calls more successful, but also enabled businesses to make more calls [and] our dealers report up to a 30% increase in appointment-making[S8].

One of Toshiba’s sales franchises who attended the training, Print Copy Scan, reported that appointments “we have made over the phone have doubled, and as a result, sales have increased” [S8]. Toshiba reported economic benefit having “seen a 100% increase in unit sales over the last five years and Liz and her team have been a major contributor to that success” [S8].

5. Sources to corroborate the impact

S1: Wired Innovation award for CARM (2015) as part of its celebration of forward-thinking innovators who have the ‘potential to make a significant impact on the world’.

S2: Testimonial from Police Scotland (29.11.19) with appended evidence from Metropolitan Police and Operational Communications in Policing.

S3: Testimonial from Solution Talk (29.11.19) with incorporated evidence from College of Mediators and Relate CEO.

S4: Letters from various Ministry of Justice staff, including Rt. Hon Simon Hughes (then Minister of Justice) about family mediation (15.11.13 to 18.12.14), with US Superior Court testimonial appended. The first letter was in support of an ESRC Impact Prize in 2014.

S5: Testimonial from Chief Operations Officer and a conciliation manager at ACAS - Advisory, Conciliation and Arbitration Service - (18.12.20) regarding the impact of nationwide CARM training.

S6: Testimonial from Dr Graham Todd (1.11.19), responsible for Quality Improvement Science at Health Education England, regarding GP reception practice training, with evidence of increased satisfaction from patients appended.

S7: Testimonial from Typeform (13.8.19) regarding embedding research into software products.

S8: Testimonial from Toshiba Tec (November 2019) with appended evidence of sales appointment increases from Print Copy Scan.

Showing impact case studies 1 to 4 of 4

Filter by higher education institution

UK regions
Select one or more of the following higher education institutions and then click Apply selected filters when you have finished.
No higher education institutions found.
Institutions

Filter by unit of assessment

Main panels
Select one or more of the following units of assessment and then click Apply selected filters when you have finished.
No unit of assessments found.
Units of assessment

Filter by continued case study

Select one or more of the following states and then click Apply selected filters when you have finished.

Filter by summary impact type

Select one or more of the following summary impact types and then click Apply selected filters when you have finished.

Filter by impact UK location

UK Countries
Select one or more of the following UK locations and then click Apply selected filters when you have finished.
No UK locations found.
Impact UK locations

Filter by impact global location

Continents
Select one or more of the following global locations and then click Apply selected filters when you have finished.
No global locations found.
Impact global locations

Filter by underpinning research subject

Subject areas
Select one or more of the following underpinning research subjects and then click Apply selected filters when you have finished.
No subjects found.
Underpinning research subjects