Impact case study database
Search and filter
Filter by
- University of South Wales / Prifysgol De Cymru
- 10 - Mathematical Sciences
- Submitting institution
- University of South Wales / Prifysgol De Cymru
- Unit of assessment
- 10 - Mathematical Sciences
- Summary impact type
- Technological
- Is this case study continued from a case study submitted in 2014?
- No
1. Summary of the impact
Researchers from the University of South Wales (USW) created a suite of statistical tools that formed a central component of the intellectual property of a high-growth start-up company, RUMM Ltd. The company approached university statisticians to develop new real time data analysis methods to improve their energy management software and strengthen their competitive advantage. The USW research improved the data-analytics capability of the company, critically leading to new intellectual property which underpinned the acquisition of the company by a major British energy supplier, RWE npower Ltd in March 2015, generating significant economic and environmental impacts, through client cost savings and a reduction in carbon emissions across the UK. The research also contributed to economic regeneration in the deprived communities in the South Wales valleys through the training and upskilling of employees and the reinvestment of shareholder income into new start-up companies.
2. Underpinning research
The initial interest at the University in time series forecasting of energy usage began with a collaboration between the University of Glamorgan (now University of South Wales) and South Wales Electricity Board (SWALEC). SWALEC, one of the 12 electricity and supply distribution companies privatised in 1990 and serving the South Wales region, sought academic partners to assist in improving their understanding of patterns of electricity demand. Prof Alan Ryley and Prof Jamal Ameen, both based in Mathematical Sciences at the University, jointly supervised Dr. Hasan Al-Madfai’s doctoral thesis on weather corrected electricity demand forecasting [3.1] which was supported by Senior Economists at SWALEC. The general approach involved the analysis of time series, specifically extracting patterns from energy demand measured at discrete moments in time and thus using them as forecasting tools. In particular, two novel time series modelling approaches were introduced and developed as part of this research project; profiles ARIMA (based on the widely used time series forecasting method AutoRegressive Integrated Moving Average) and a variability decomposition method, with the former utilizing an event-driven Hierarchical Profiling Approach (HPA) in which different elements of energy usage were divided into deterministic profiles and stochastic components.
Al-Madfai was subsequently appointed as a Lecturer in Mathematics at the University in 2002 replacing Ryley within the Mathematical Sciences group, and in the following years, along with other co-authors, continued to develop the HPA method and its applications to numerous data sets, including crime forecasting [3.2], air pollution from carbon monoxide emissions [3.3] and further energy usages [3.4]. This expertise resulted in a collaboration with two engineers, Dr. Steve Lloyd and Mr. Steve Thomas from the University whose interests in energy usage by medium-sized enterprises led to the establishment of RUMM Ltd (Remote Utility Monitoring and Management), a spin-out company from the University launched in 2005 to provide significant savings in energy, cost and carbon emissions to manufacturing and utility sectors. Al-Madfai’s pre-existing interest in energy management enabled the identification of a weakness in the data analysis of RUMM. A comparison of the information needs of effective energy management against the existing and widely used methods identified a failure to detect irregular behaviour in datasets measured in a time domain rather than a frequency domain, partly due to then-current benchmark time series methods having been developed on the assumption that errors are homoskedastic (that is, the variance of the error term in the regression model is constant). The customer data obtained by RUMM revealed electricity demand time series that were heavily influenced by the presence of multiple seasonalities and heteroskedasticity, and therefore requiring a bespoke approach to the calculation of prediction limits for the detection of usage behaviour patterns for energy management.
To develop the statistical tools necessary to analyse the large data sets obtained by RUMM Ltd, an EPSRC CASE award was granted and held between the University and RUMM [3a]. The award funded a PhD student, who was appointed in 2008 and based in the Mathematical Sciences group, resulting in the award of a doctoral degree in 2013 [3.5]. The doctoral study focussed on the development of an analytical technique capable of detecting irregular behaviour on half-hourly time series which were under the influence of multiple seasonalities and heteroskedasticities. These two goals were requirements of the data held by RUMM, where data from its business users were collected at discrete and regular moments in time and analysed to detect unusual patterns and identify a cause of any unusual activity. To achieve the project aims, the HPA method, which had not been developed to model heteroskedasticity nor previously been applied to time series having multiple seasonal components, was extended from forecasting to the field of process control, the novel Generalised HPA method. This modified time series method was incorporated into a procedure to detect irregular consumption before and after a change in use was made, determining the significance of the numbers of observations falling outside the prediction limits of the Generalised HPA, and thus leading a process control tool that improved RUMM’s energy management methodology. Due to commercial sensitivity, this work was embargoed for a period of 2 years from its completion [5.3]. Thus, the statistical methodology, initially developed by Al-Madfai alongside Ryley and Ameen, and then later by a research student, formed a central component of RUMM’s intellectual property.
3. References to the research
[3.1] Al-Madfai, H (2002). Weather corrected electricity demand forecasting. PhD Thesis, University of Glamorgan. https://pure.southwales.ac.uk/en/studentthesis/weather-corrected-electricity-demand-forecasting(2e066cc4-58b1-4694-9937-ee8f57fbed02).html [This is the first application of the time series HPA methodology to energy usage.]
[3.2] Ivaha, C., Al-Madfai, H., Higgs, G. and Ware, J.A. (2007). The simple spatial disaggregation approach to spatio-temporal crime forecasting. International Journal of Innovative Computing, Information and Control, 3(3), p509-523. ISSN 1349-4198. [Use of HPA method used to model incidents of criminal damage in a metropolitan city.]
[3.3] Al-Mafdai, H., Snelson, D. G. and Geens, A. J. (2008). Modelling the multi-year air quality time series in Edinburgh: an application of the Hierarchical Profiling Approach. In Air Pollution XVI, Eds. Brebbia, C.A. and Longhurst, J. W. S, WIT Press, Southampton, p49-56. https://books.google.co.uk/books?id=CQQwv3nlhBwC&pg [Use of HPA method to investigate air quality at sites in a city centre.]
[3.4] Al-Madfai, H., Akinwale, A., Lloyd, S., Thomas, S. and Lakin, S. (2009). Using hierarchical profiling approach (HPA) forecasts of multi-year half-hourly electricity consumption as a tool in energy management. 29th International Symposium on Forecasting, https://isf.forecasters.org/pdfs/isf/ISF2009_Proceedings.pdf (page 130) [Conference: demonstration of HPA method applied to data of the form used by RUMM Ltd.]
[3.5] Akinwale, A. (2013). Detecting irregular energy consumption through analytical techniques. PhD Thesis, University of Glamorgan. (Director or studies Hasan Al-Madfai; supervisors Steve Thomas, Steve Lloyd & Steve Lakin) https://pure.southwales.ac.uk/en/studentthesis/detecting-irregular-energy-consumption-through-analytical-techniques(b8e99688-de4c-41f0-a40c-0a2a04e2895d).html [The work refined the techniques used by RUMM and due to commercial sensitivity was embargoed for 2 years during the acquisition of RUMM by RWE npower.]
Related research grant:
[3a] EPSRC SME Industrial Case Studentship Award. Detecting Irregular Energy Consumption through Analytical Techniques (DICTAT). University of Glamorgan in partnership with RUMM Ltd.
4. Details of the impact
Background to RUMM Ltd and collaboration with USW
RUMM Ltd [5.1] was a new company launched in South Wales by engineering lecturers, Dr Steve Lloyd and Mr Steve Thomas, as a spin-out company from the University in 2005 following a collaborative project with local companies to remotely monitor their energy consumption. The unique service offered by RUMM was aimed at medium-sized businesses, benchmarking their energy usage against critical parameters and the subsequent application of statistical process control techniques to reduce their energy bills and their carbon footprint. These savings aided the businesses in achieving targets in the wake of deregulation of the energy supply infrastructure in the UK and the increased political drivers for carbon reduction.
RUMM’s technology provided a remote assessment of each client’s energy use, typically using between 20-60 meters per site that measured energy consumption at key locations. Time series data from each meter was transmitted to RUMM’s server in 30-minute intervals where it was automatically analysed using RUMM’s proprietary software package, Internet Based Analytical Software Suite (IBASS). IBASS provided the client with a visualisation of energy consumption and targets of energy consumption using data analytics. Automatic alarms were sent to the users whenever a meter identified an abnormally high energy use. For example, an alarm would be triggered by a machine being left on outside of normal operating hours. However, the analysis of the time series data in IBASS, which was central to the RUMM model’s ability to detect inconsistent behaviour was identified by the company as basic; it simply compared energy usage in successive half-hourly intervals in a rudimentary manner and lacked any sophistication to deal with changes in demand due, for example, to seasonal differences. To generate the greatest possible savings in energy consumption and carbon emissions, the company sought a collaboration with the University to improve its energy management methodology.
Pathway to impact
In 2006 RUMM approached Al-Madfai to develop the advanced statistical tools they needed to improve the analysis of their clients’ energy and utility data, and management of usage. Following the identification of the presence of multiple seasonalities and heteroskedasticity in RUMM’s clients’ data, Al-Madfai and the company submitted a collaborative bid for funding from the EPSRC for an Industrial CASE PhD Studentship [3a] (titled Detecting Irregular Energy Consumption Through Analytical Techniques (DICTAT)), which was awarded in 2008. Akinbami Akinwale was recruited to the project as the research student, to build on Al-Madfai’s own PhD work [3.1] to develop an analytical technique that could be used as an energy management tool in detecting irregular behaviour of a time series [3.5]. To achieve this, the Hierarchal Profiling Approach (HPA) originally developed by Al-Madfai, Ryley and Ameen and extended from 2002 by Al-Madfai and co-workers, was extended further. Process control techniques were developed to detect abnormalities extracted from RUMM’s time series data that identified “non-standard” consumption profiles, while accounting for the seasonalities and variabilities embedded within the data ( https://youtu.be/xs1YboaQhT8). This enabled development of a remote monitoring and alarming system for the detection of irregular consumption patterns. With research outcomes having contributed to continuous upskilling of RUMM staff and to upgrades to IBASS, the statistical tools utilising HPA completed by Al-Madfai and co-workers formalised the toolkit as a key component of RUMM Ltd’s intellectual property and its competitive advantage from 2013 onwards. The intellectual property in the results of this research project were assigned to the company on the 31st March 2015 in a legal agreement [5.2a] to allow the company to incorporate them into IBASS Version 6 [5.2b] as a key part of a commercial deal with a major energy provider RWE npower. RUMM continued to deliver services supported by IBASS until 2019 when the company was fully subsumed into the new parent company.
Impact: Acquisition of RUMM by RWE npower
By the end of year trading on 31st August 2014, RUMM Ltd had an annual turnover of approximately £1.3 million, generating £200 000 pre-tax profit [5.3]. On 31st March 2015, RUMM was purchased by RWE npower Ltd [5.4], known as one of the “Big Six UK Energy Suppliers” and a subsidiary of E.ON UK from January 2019. The statistical analysis and control tools developed by Al-Madfai and co-workers formed a central component of the company’s intellectual property. To quote Mr. Steve Thomas (the commercial director of RUMM Ltd) on its sale to npower, “If Hasan [ Al-Madfai] wasn’t there, it couldn’t have been done” [5.5].
At the point of acquisition, RUMM was reported to have saved its customers £43 million in energy costs, reduced energy consumption by 600 million kWh with a concomitant reduction of carbon emissions by almost 300 000 tonnes [5,1, 5.6]. RWE npower paid [text removed for publication] for RUMM [5.7], and immediately began rolling out RUMM’s energy-saving approaches to its customers in the second quarter of 2015.
Impact: ongoing benefits of RUMM to RWE npower and its UK clients
Following the acquisition of RUMM by RWE npower, RUMM became part of npower’s Business Solutions suite of packages, under its “Energy HQ” umbrella [5.8], which continues to be offered to its customers. Later in 2015, RWE npower became the first power utility to be awarded the Carbon Trust triple standard for significant reduction measures across energy, waste and water, with the acquisition of RUMM cited as one of “[two] key developments that led to certification” [5.9]. Npower’s Low Carbon & Behaviour Change EMS Manager reported of RUMM a year after acquisition: “It’s already produced clear and proven benefits for firms, big and small, saving businesses we have worked with over £26m” [5.10], demonstrating the value to npower of the IP purchased. It was anticipated by npower’s Chief Executive that by rolling out RUMM’s technology across its customers, £4 billion could be saved from the UK’s annual fuel bill for businesses across its 23 000 commercial customers [5.6]. Npower targeted savings of between 3-15% for each of its customers through its focus on “RUMM’s behavioural approach to energy” [5.10].
Impact: upskilling of employees
A key philosophy of RUMM Ltd was the upskilling of its employees. Based in Ystrad Mynach, Caerphilly County Borough, RUMM’s 30 employees [5.6] were predominantly drawn from local communities that display poor educational achievements and high overall deprivation, and the majority of staff were appointed to positions requiring high technical skill sets. The 2019 Welsh Index of Multiple Deprivation ( Welsh Index of Multiple Deprivation (WIMD) 2019: results report (gov.wales)) identified Caerphilly County as the 4th most education deprived and 5th most employment deprived local authority of 22 in Wales (by percentage of Lower Layer Super Output Areas in the 50% most deprived such areas). As a result of the development of the HPA method and its incorporation into IBASS, a number of RUMM’s staff were upskilled in their statistical knowledge [5.5], adding further commercial value to the company (as evidenced by RUMM Ltd’s sale price [5.7]) and reducing both employment and educational deprivation in the region. Further, a former research student working within RUMM subsequently became a director, and post-sale developed Blue Sky Equity Ltd (see below), exemplifying, through the collaboration, the research-driven development at USW of entrepreneurship skills of students and staff.
Impact: investments from profit generation
Shareholders’ income from the sale of RUMM Ltd has led to further new company starts and investments in start-up companies from 2015 to 2020. One example is the bio-technology company Blood Line Ltd [5.11], founded in 2017 by two of the ex-RUMM directors to develop technological aids for people with diabetes, making use of statistical techniques to model relationships between food intake, exercise, and key biometric parameters. Further examples include investments in the four companies by another ex-director of RUMM, including Blue Sky Equity Ltd which was established to specifically invest in start-up companies [5.12].
5. Sources to corroborate the impact
[5.1] RUMM website (historical). Contains list of clients with testimonials. Available on web archive: https://web.archive.org/web/20190224011638/http://rumm.co.uk/
[5.2] RUMM IP Transfer Agreements March 2015: [5.2a] Deed of Variation; [5.2b] RUMM request to University of Glamorgan to embargo outcomes of EPSRC SME Industrial Case Studentship Award: DICTAT while the outcomes were incorporated into IBASS6. CONFIDENTIAL
[5.3] Full accounts for year ending 31st August 2014 Companies House: RUMM Ltd (Turnover £1.3million. Pre-tax profit £0.2 million.)
[5.4] Statement from npower on purchase of RUMM Ltd.
[5.5] Letter from Mr Steve Thomas (former director, shareholder and company secretary of RUMM Ltd.) confirming Al-Madfai’s contribution.
[5.6] Details on purchase of RUMM by npower https://www.ft.com/content/c9a96ace-d79a-11e4-94b1-00144feab7de
[5.7] Letter confirming sale price of RUMM to npower (Head of Commercial Client Services, USW Commercial Services Ltd.). CONFIDENTIAL
[5.8] Npower’s business solution packages (Energy HQ), into which the IP of RUMM was incorporated since 2015 https://energy-hq.co.uk/
[5.9] “Npower earns energy sector’s first Carbon Trust Carbon Trust triple certification”, edie: empowering sustainable business, Faversham House, 17 September 2015 https://www.edie.net/news/5/npower--leading-by-example--as-energy-sector-s-first-triple-standard-company/
[5.10] “Save Energy the RUMM Way!”, Energy Management: Energy Savings Solutions, 8 April 2016 https://companysuggestion.wordpress.com/category/energy-saving-solutions/
[5.11] Blood Line Ltd Companies house records: https://beta.companieshouse.gov.uk/company/10596269
[5.12] Companies house records for RUMM ex-director: https://beta.companieshouse.gov.uk/officers/nGXLmAWr61ryEBRT2hH9DQHlA7w/appointments
- Submitting institution
- University of South Wales / Prifysgol De Cymru
- Unit of assessment
- 10 - Mathematical Sciences
- Summary impact type
- Technological
- Is this case study continued from a case study submitted in 2014?
- No
1. Summary of the impact
Accurate weather and climate forecasts have an important effect on the economy, agriculture, and public safety, which means improved forecasting methods benefit society through numerous and diverse channels. Central to these forecasts are the use of computer models. Researchers at the University of South Wales have made significant contributions to weather and climate prediction models used by various agencies around the world with impact on practitioners and enhanced performance. These include 1) numerical schemes constructed for and used by National Aeronautics and Space Administration (NASA) and 2) new test cases to evaluate computer models for weather and climate predictions have been developed and used by numerous organisations around the world, including European Centre for Medium-Range Weather Forecasts (ECMWF) and Deutscher Wetterdienst (DWD), with concomitant impact on their stakeholders.
2. Underpinning research
To formulate accurate and reliable weather forecasts, computers are used to numerically solve the underlying model equations and thus the predictions obtained rely on the quality of the computation methods applied. Global climate modelling systems are employed for both weather and climate predictions and consist of many different components. One such component is the atmospheric model, which itself comprises two different parts: the dynamical core and the physical parameterizations. The dynamical core is crucial – it is responsible for capturing the dynamical behaviour of the Earth's atmosphere via numerical integration of the governing fluid dynamics equations. No two dynamical cores are alike, and their individual successes suggest that no perfect model exists. It is important to assess the dynamical core in isolation, to understand whether the numerical methods used are capturing the required phenomena (such as positivity and correlations in tracer transport, correct wave propagation, or precipitation when dynamics and physics are coupled). To this end, a standard set of idealized test cases need to be created, having analytical initial conditions and known solutions or features of solutions. These test cases can then be used by operational centres to evaluate the performance of their model whilst in development, and hence influence key design aspects of their dynamical cores. This testing leads to model improvements, and so, builds confidence in an organisation’s model, making them more prepared to share it. This allows broad benefits to the wider operational modelling community and thus, through improved weather and climate forecasting, to society as a whole.
Kent, at the University of South Wales, has been at the forefront of idealised dynamical core testing. He has designed, developed, and implemented new idealised test cases that evaluate the performance of atmospheric dynamical cores. Alongside researchers from University of California Davis, University of Michigan, Stony Brook University and National Centre of Atmospheric Research (all USA), he is also a co-organiser of the Dynamical Core Model Intercomparison Project (DCMIP) and the associated workshops of 2012 and 2016. The goal of DCMIP, which commenced in 2008, is to establish a worldwide community that intercompares cutting-edge dynamical core models and provides a forum to exchange ideas and advance education on dynamical core development [3.1]. For example, DCMIP 2016 had attendees from north and south America, Europe, Africa and Asia at various stages of their careers ranging from established researchers through to research students. In particular, Kent’s test cases developed for the 2016 workshop (including non-divergent three-dimensional prescribed velocities for tracer transport, the propagation of gravity waves in non-hydrostatic regimes, and simplified cyclone and supercell storm test) have been used or assessed by at least nine international weather and climate modelling groups that attended the DCMIP workshops [3.1,3.2] (see also Section 4: Details of impact).
Related to the dynamical core of an atmospheric model is the linear model, which is used to describe the forward evolution of perturbations and the backwards evolutions of sensitivities which are required to measure the discrepancies in the model with respect to observations and the background state. The linear model is computationally efficient and as such is a key tool in data assimilation and the estimation of sensitivity to initial conditions. Although the linear model is based upon the dynamical core, often these are developed independently, and it is important to understand how they interact. Indeed, the optimum numerical methods for the full dynamical core are not always the optimum methods for the linear model.
Since 2015, Kent has worked with staff at NASA to help develop their new linear model. Kent’s research resulted in the construction of a novel numerical scheme that improves linear tracer transport through improved accuracy and stability and has been implemented by NASA as part of their GEOS-5 weather and climate prediction model [3.3]. Further, Kent has built on his work with DCMIP to develop a number of test cases for linear models, enabling NASA to have confidence in the performance of the linear model of GEOS-5 [3.4]. NASA are currently using the scheme devised by Kent for tracer transport within the linear model, with plans to expand its use to the dynamic variables in their model.
3. References to the research
[3.1] Ullrich PA, Jablonowski C, Kent J, Lauritzen PH, Nair R, Reed KA, Zarzycki CM, Hall DM, Dazlich D, Heikes R, Konor C, Randall D, Dubos T, Meurdesoif Y, Chen X, Harris L, Kühnlein C, Lee V, Qaddouri A, Girard C, Giorgetta M, Reinert D, Klemp J, Park S-H, Skamarock W, Miura H, Ohno T, Yoshida R, Walko R, Reinecke A, and Viner K (2017), DCMIP2016: A Review of Non-hydrostatic Dynamical Core Design and Intercomparison of Participating Models. Geosci. Model Dev., 10, 4477-4509. https://doi.org/10.5194/gmd-10-4477-2017
[3.2] Zarzycki CM, Jablonowski C, Kent J, Lauritzen PH, Nair R Reed KA, Ullrich PA, Hall DM, Dazlich D, Heikes R, Konor C, Randall D, Chen X, Harris L, Giorgetta M, Reinert D, Kühnlein C, Walko R, Lee V, Qaddouri A, Tanguay M, Miura H, Ohno T, Yoshida R, Park S-H, Klemp J, and Skamarock WC (2019), DCMIP2016: The Splitting Supercell Test Case. Geosci. Model. Dev., 12, 879-892, https://doi.org/10.5194/gmd-12-879-2019
[3.3] Holdaway D, and Kent J (2015), Assessing the tangent linear behavior of common tracer transport schemes and their use in a linearized atmospheric general circulation model. Tellus A. 67, 1. https://doi.org/10.3402/tellusa.v67.27895
[3.4] Kent J, and Holdaway D (2017), An Idealised Test Case For Assessing The Linearization of Tracer Transport Schemes in NWP Models. Quarterly Journal of the Royal Meteorological Society. 143, p. 1746-1755. https://doi.org/10.1002/qj.3027
4. Details of the impact
Improved weather forecasts and climate predictions have a significant effect on the economy and on public safety, ranging from better use of energy reserves to advanced warnings of natural disasters [5.1]. Accurate global modelling systems rely on accurate numerical methods to solve the corresponding equations. The development of these methods, along with their careful assessment and evaluation, is essential for improving forecasting capabilities and having confidence in the model results. Kent’s new approach has significantly improved the accuracy, stability and computational efficiency compared to older schemes and enhanced confidence in the predictive capabilities of the models.
Novel modelling system developed by Kent leads to improvements in NASA’s technologies
Kent designed and developed a new tracer transport scheme for NASA’s GEOS-5 (their operational model for weather and climate prediction) linear model. This scheme became the default option in NASA’s GEOS-5 linear model in 2018 [5.2, 5.3] and, as a direct result, showed immediate improved performance over the previous model version as confirmed by the Data Assimilation Lead for the Global Modeling and Assimilation Office at NASA:
“The improvements in the linearized GEOS model as a result of the implementation of the dynamical core with HK [Holdaway and Kent] scheme were very impressive, and significant compared against gains seen for implementation of other components.” [5.2]
[Text removed for publication] the NASA model improves their forecast ability, and thus impacts their model and data users. NASA’s work on global weather and climate predictions is used to inform industry, government and the public in the both the United States and world-wide [5.1,5.5], with vast volumes of data being open-access (e.g. https://earth.nullschool.net/). Within the Global Modeling and Assimilation Office of NASA alone, 20 missions currently exploit aspects of the GEOS system which in turn impact on further campaigns [5.6]. Since NASA share their climate data and models with other centres, such as the National Oceanic & Atmospheric Administration (NOAA) [5.7], improvements to their model mean improvements to the quality of this data world-wide and allow NASA to achieve its key missions. The GEOS linear model is also being used by the Joint Center for Satellite Data Assimilation (JCSDA) whose member organisations include NASA, NOAA, the U.S Navy and the U.S. Air Force. JCSDA is developing JEDI, a data assimilation system, to become a world-leader in environmental analysis and prediction. The use of Kent’s method in GEOS-5 has led to [text removed for publication] the JEDI system as stated by JEDI’s Development Team Research Member [5.3]:
“The HK scheme is by far the most efficient transport scheme available in the GEOS linearized model, making it very attractive for use in JEDI…. [The HK scheme] offers excellent matching between the nonlinear transport and the linearized transport and the best performance compared to other forms of linearized advection tested in GEOS.” [5.3]
Following the success of Kent’s scheme within the GEOS system, NASA is currently implementing another method of Kent for other variables within the linear model of GEOS-5, such as vorticity, temperature and pressure [5.3, 5.4a].
Creating a worldwide standard for test cases in atmospheric models
In 2016, Kent presented his research at a DCMIP workshop, providing at least 9 atmospheric modelling groups around the world with attendees from 5 different continents with a new set of standard idealised test cases that assess the dynamical core’s performance when coupled to simplified physics routines. The groups that took part in the workshop are truly international and drawn from a mixture of higher educational institutions and governmental funded agencies including:
National Center for Atmospheric Research, Boulder, CO, USA.
Laboratoire de Météorologie Dynamique, Institut Pierre-Simon Laplace (IPSL), Paris, France.
Geophysical Fluid Dynamics Laboratory (GFDL), Princeton, NJ, USA (the developers of the dynamical core used in NASA’s GEOS-5 model).
European Centre for Medium-Range Weather Forecasts (ECMWF), Reading, UK.
Environment and Climate Change Canada (ECCC), Dorval, Québec, Canada.
Max Planck Institute for Meteorology, Hamburg, Germany.
Deutscher Wetterdienst (DWD), Offenbach am Main, Germany.
Naval Research Laboratory, Monterey, CA, USA.
Japan Agency for Marine-Earth Science and Technology, Yokohama, Kanagawa, Japan.
The Scientist attending on behalf of the European Centre for Medium-Range Weather Forecasts, an independent intergovernmental organisation supported by 34 member states, noted that:
“The test cases developed by Dr. James Kent of the University of South Wales and used at the DCMIP 2016 workshop are becoming a worldwide standard in evaluating dynamical cores in the atmospheric modelling community.” [5.8]
These groups used the test cases to assess and give confidence in their different models and used the results to guide their model design decisions [5.8, 5.9]:
“… by using these tests, we have great confidence in the performance of IFS-FVM and hence are continuing to develop this technology.” [5.8]
This increased model confidence and improved design decisions impacts both the model data itself and external users. For example, DWD provide services to numerous organisations including the German Government, private weather forecast agencies, TV stations, as well as more than 20 national weather services worldwide [5.10a]. Following DCMIP-2016, DWD used Kent’s test cases to assess and verify their ICON model dynamical core giving them, and hence their stakeholders, confidence that the ICON model is performing well and producing accurate forecasts. Indeed, DWD acknowledged that Kent’s test cases have made valuable contributions to their ICON model [5.10b]:
“… we discovered that the ICON dynamical core erroneously conserves total mass instead of just dry air mass…. we have designed a new approach to remedy the conservation problem….” [5.10b]
In addition, using his knowledge of test cases from DCMIP along with the requirements of the tracer transport linear model from NASA, since 2017 Kent has also created a new set of idealised test cases specifically for linear models. These tests have subsequently been used on NASA’s GEOS-5 linear model, which again highlight the improvements made by Kent [5.4].
Kent’s research has therefore directly impacted multiple national and international weather and climate modelling groups, which make use of his modelling systems. By enhancing their performance and services, his research has also indirectly impacted these groups’ extensive partner organisations and customers worldwide.
5. Sources to corroborate the impact
[5.1] NASA Socio-Economic Impacts: https://www.nasa.gov/sites/default/files/files/SEINSI.pdf (pages 14-16)
[5.2] Letter from the Data Assimilation Lead for the Global Modeling and Assimilation Office at NASA, confirming Kent’s key contributions to the project and the resultant impact. CONFIDENTIAL
[5.3] Letter from Research Member of the Joint Effort for Data assimilation Integration (JEDI) development team, NASA and UCAR, confirming Kent’s contributions to the GEOS-5 linear model and impact on JEDI. CONFIDENTIAL
[5.4] NASA technical reports:
[5.4a] Development and Applications of the FV3 GEOS-5 Adjoint Modeling System, https://ntrs.nasa.gov/search.jsp?R=20170005229
[5.4b] Comparison of the Tangent Linear Properties of Tracer Transport Schemes Applied to Geophysical Problems,
[5.5] NASA provides capabilities to predict climate, weather, and natural hazards; manage resources; and inform environmental policy https://www.nasa.gov/sites/default/files/atoms/files/fy_2020_congressional_justification.pdf
(SCMD-8, page 271 of PDF file)
[5.6] Users of GEOS data within NASA: https://gmao.gsfc.nasa.gov/NASA_missions/
[5.7] Use of FV3 by NASA, National Centres for Environmental Prediction (NCEP) and National Oceanic and Atmospheric Administration (NOAA)
https://cpaess.ucar.edu/sites/default/files/meetings/2019/documents/Holdaway.pdf (page 3)
[5.8] Letter from Scientist at ECMWF, confirming DCMIP impact on IFS-FVM model verification. CONFIDENTIAL
[5.9] Dynamical Core Model Intercomparison Project: https://www2.cisl.ucar.edu/events/summer-school/dcmip/2016/dcmip-2016
[5.10] Deutscher Wetterdienst’s use of Kent’s test cases:
[5.10a] DWD’s ICON model and users.
[5.10b] Letter from Scientist at DWD, confirming DCMIP impact on ICON model verification. CONFIDENTIAL