Skip to main

Impact case study database

The impact case study database allows you to browse and search for impact case studies submitted to the REF 2021. Use the search and filters below to find the impact case studies you are looking for.

Search and filter

Filter by

  • The University of Surrey
   None selected
  • 11 - Computer Science and Informatics
   None selected
   None selected
   None selected
   None selected
   None selected
   None selected
Waiting for server
Download currently selected sections for currently selected case studies (spreadsheet) (generating)
Download currently selected case study PDFs (zip) (generating)
Download tags for the currently selected case studies (spreadsheet) (generating)
Currently displaying text from case study section
Showing impact case studies 1 to 3 of 3
Submitting institution
The University of Surrey
Unit of assessment
11 - Computer Science and Informatics
Summary impact type
Technological
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

A range of novel methods has been developed for supporting transactions between, and collaborations amongst, agents in a distributed ecosystem of services. Since 2015, Balena (an SME that develops, deploys and manages connected devices) has benefitted from Surrey’s research resulting in; company growth from 5 to 102 employees, a total of $31.4 million in funding, and a 280% increase in annual income reaching $1.9 million in 2020. Balena has also expanded its customer base, supplying solutions to a wide range of sectors, including drones and robotics, transportation, manufacturing, energy, agriculture, digital signage, and building management.

2. Underpinning research

Our ambition in the programme of research relating to this case study was to provide a formal underpinning to the development of software infrastructure for SMEs to deliver innovative services and products on a global basis. Our work covered three broad areas: (i) generation of information systems from business requirements; (ii) foundational infrastructure for the development and deployment of innovative services; and (iii) organisational aspects of distributed and agile software development.

This work, led by Krause and Moschoyiannis, was primarily funded under an EU “Digital Ecosystem” theme (2002 - 2011), applying the following Surrey-defined definition:

"A digital ecosystem is an interactive system established between a set of active agents and an environment within which they engage in common activities."

Although very general, we had a specific architecture/environment in which the agents (usually services) were governed by models expressed in the SBVR notation [R1]. This, in conjunction with the then-emerging move towards RESTful interfaces, enabled us to generate a suite of tools that could support service transactions within the context of a compiled SBVR model as well as the compilation of SBVR into SQL queries and persistence layer [R2, R3, R4].

These afore-mentioned publications were focused on the implementation level and resulted in a suite of tools published under an open-source licence. However, we also wanted to be sure that transactions amongst multiple agents/services within this environment were well behaved and recoverable, and so supported the architecture with more formal studies based on a true-concurrency (non-interleaving) semantics to ensure the framework would scale without the emergence of pathologies [R5, R6].

While we had ambitions to embed this work in a fully open Peer-to-Peer architecture, with no central points of control or failure, the core framework still met the goals of providing a framework for deploying at scale fleets of agents whose behaviour, individually and collectively, could be easily adapted/updated via the structured natural language interface of our SBVR editor.

Our open-source tools were tested out in production during 2012. The start-up company, Renew, had developed bomb-proof recycling bins that could be used in busy locations. Renew aimed to monetise this with advertising revenue from LCD displays attached to the bins. The concept won a contract with the City of London in the lead up to the Olympic games primarily because of the potential for rapid communication with the public, via the screens, in case of an emergency scenario. Our open-source tools [R2, R3] were used to develop, deploy and maintain the display services across all the bins in the City, demonstrating the viability of these open-source tools for the first time, which were built upon by Balena.

3. References to the research

Razavi A, Moschoyiannis S, Krause P (2009) An open digital environment to support business ecosystems, Peer-to-Peer Networking and Applications 2 (4) pp. 367-397 Springer DOI: 10.1007/s12083-009-0039-5

Moschoyiannis S, Marinos A, Krause P (2010) Generating SQL queries from SBVR rules, Lecture Notes in Computer Science: Semantic Web Rules 6403 pp. 128-143 Springer-Verlag Berlin. DOI: 10.1007/978-3-642-16289-3_12

Marinos A, Krause P (2009) Using SBVR, REST and Relational Databases to develop Information Systems native to the Digital Ecosystem, 2009 3rd IEEE International Conference on Digital Ecosytems and Technologies pp. 424-429 IEEE. DOI: 10.1109/DEST.2009.5276719

Marinos A, Razavi A, Moschoyiannis S, Krause P (2009) RETRO: A Consistent and Recoverable RESTful Transaction Model, 2009 IEEE International Conference on Web Services, Vols 1 and 2 pp. 181-188 IEEE. DOI: 10.1109/ICWS.2009.99

Moschoyiannis S, Krause PJ (2015) True Concurrency in Long-running Transactions for Digital Ecosystems, Fundamenta Informaticae 138 (4) pp. 483-514 IOS Press. DOI: 10.3233/FI-2015-1222

Moschoyiannis S, Razavi AR, Zheng YY, Krause P (2008) Long-running Transactions: semantics, schemas, implementation, Proceedings of 2nd IEEE International Conference on Digital Ecosystems and Technologies pp. 208-215 IEEE. DOI: 10.1109/DEST.2008.4635168

Funding:

FP6-IST, 034824 (June 2006 – May 2010), £561,411, University of Surrey.

EPSRC, Evolution and Resilience of Industrial Ecosystems (ERIE), EP/H021779/1 (June 2010 – May 2016) £3,344,524, Moschoyiannis, Krause et al.

4. Details of the impact

It is estimated that by 2022, the number of connected electronics worldwide will hit 29 billion, of which around 18 billion will occupy the burgeoning internet of things (IoT) subcategory [S1].

Surrey’s research and development of novel methods for supporting transactions between and collaborations amongst agents in a distributed ecosystem of services underpinned the decision by Dr Alexandros Marinos – a former Surrey PhD student and PDRA – to found the start-up company Balena (formerly RuleMotion) in 2011 with the aim of commercialising research outputs from Surrey’s Digital Ecosystem programme. Marinos was supported in this venture by Krause and Moschoyiannis, who together aimed to use Surrey’s expertise to make managing IoT devices as straightforward as configuring PC peripherals. Both Krause and Moschoyiannis continue as advisors to this company, with Krause also being a shareholder.

Impact on Balena’s product offering

The conceptual basis, and many of the technical outputs from Surrey’s Digital Ecosystems research group, are deeply embedded in the products and ethos of Balena. Balena’s API platform, open-sourced as “S3” [S2, S3] in its entirety, is a direct descendant of the work reported in [R2, R3]. SBVR is still used in production, and the system still compiles to SQL as described in these outputs [S4]. Founder and CEO Marinos states, “<...> it remains central to our core business and has been a key facilitator of our agile way of working.” [S2]

Balena’s first product, launched in 2012, was a syntax-directed editor for SBVR that could compile structured natural language models to SQL [R2]; this remains at the core of the Balena API. The rebranding of the original company to “Balena.io” in late 2013 coincided with the full-scale launching of their support for service management in fleets of IoT devices, which exploited the service composition and transactional research of [R1, R5, R6].

Balena as a catalyst for innovation

While the Balena product stack has been expanded significantly during the company's life, the Balena API remains at the heart of their IoT Infrastructure. Our research work [R2, R3, R4] was amongst the first to use “RESTful” ways of working with connected resources, and this remains at the heart of the Balena way of working. The use of a restricted set of verbs to interact with resources (including devices, applications, users, and more) provides a unified interface with which to interact with this diversity of resources. This way of working has almost universally replaced the baroque service-oriented architectures prevalent at the start of the new millennium. However, what made, and still makes, the API approach scalable and easy to use was the embedding of REST into a structured natural language interface using SBVR and the automated mapping into an SQL persistence layer [R2, R3]. This means that users of Balena do not need specialised knowledge of the service-oriented architecture and database technology in order to set up and manage a fleet of interacting resources [S4].

This ease of setting up the management of a fleet of resources is an aspect of Balena that is repeatedly mentioned as a primary reason for moving to Balena by innovative IoT businesses [S5, S6, S7]. The robust transaction model [R4, R5, R6] is less visible to the SME end-users but is recognised in terms of the quality of service they can provide [S5]. The concept of forward recovery formalised in [R5] is particularly important as it enables dynamic updating of micro-services to be facilitated without loss of service. This is particularly important for safety-critical examples, such as when Balena is used to manage fleets of drones [S5], with even the updating of a complete software stack having been demonstrated mid-flight. [S5] also reinforces how Balena enabled Skycatch to rapidly respond to a first-time request for a fleet of several hundred of their surveillance drones, scaling from the operation of small numbers to fleets of potentially thousands of drones simply through integrating Balena into their product stack.

Ease of use is especially illustrated in [S6], where the use of Balena was used by Figure Devices to take a prototype idea developed in a maker space into production support of hundreds of instances.

The importance of being able to support live updates of software [R4, R6] without “bricking” devices (making them unusable for a period) was a key driver behind OpenROV’s migration to Balena [S7].

However, Balena is not just a key enabler for innovation-driven SMEs. The use of Balena to support one of Europe’s biggest IoT hackathons and subsequent use for Bosch’s own products is described in [S8]. Again, the Balena dashboard features here; a core part of Balena that originated in Surrey’s research programme [R2, R3].

The appeal to such a broad customer base has led to an acceleration of demand for Balena; across all their customers, the number of devices supported by Balena’s infrastructure grew from c15,000 in January 2018 to over 70,000 in May 2019.

Growth of Balena

Three years after moving the company’s base to Washington, Seattle in 2013, it managed to attract $9 million in venture capital from Threshold Ventures, GE Ventures, Ericsson, and Aspect Ventures. With a subsequent $5 million in funding, Balena geared up for expansion, flush with $14.4 million raised in a series B round led by OpenView and existing investors. The infusion has fuelled its workforce's growth, distributed across its Seattle headquarters, satellite offices in London & Athens, and globally. The number of devices on Balena’s platform is growing at a rate six times year-over-year, and that customer acquisition is on the upswing. Balena now counts Bosch, Booster, Allscripts, Tapp, Zume Pizza, OpenDoor, Sonder, smart home systems company Dwelo, smart roof start-up Sense, HVAC monitoring and controls provider Enerbrain, and smart building controls developer Mount Kelvin among its customer base [S1].

Balena has now raised a total of $31.4 million in funding since April 2015 [S10]. The last two years, especially, have seen accelerating growth in Annual Recurring Revenue, from just under $500,000 in January 2018 to $1.9 million in May 2019. The company has grown from 5 employees in 2013 to over 100 employees, distributed globally [S9, S10].

5. Sources to corroborate the impact

  1. Discussion of Balena’s placement in the market for IoT device management: https://venturebeat.com/2019/07/24/balena-raises-14-4-million-to-simplify-iot-device-management/

  2. Testimonial from Balena CEO. (PDF)

  3. The open-source pinejs project can be found at: https://github.com/balena-io/pinejs

  4. An example of the generation of the model layer for a new application can be found at: https://github.com/balena-io/pinejs/blob/master/docs/GettingStarted.md

  5. Use of Balena to support fleets of drones: https://vimeo.com/393555024

  6. Use of Balena to grow a start up from a maker space to a company supporting hundreds of product items: https://vimeo.com/128400259

  7. Use of Balena to support live updates of software: https://www.balena.io/blog/openrov-case-study

  8. The use of Balena to support one of Europe’s biggest IoT hackathons, and subsequent use for Bosch’s own products is described in: https://www.balena.io/blog/remotely-managing-and-deploying-to-iot-devices-at-scale-with-balena

  9. Pitchbook confirmation of investment in Balena: https://pitchbook.com/profiles/company/111631-69#overview

  10. Crunchbase Company Profile & Funding – Balena https://www.crunchbase.com/organization/resin-io

Submitting institution
The University of Surrey
Unit of assessment
11 - Computer Science and Informatics
Summary impact type
Technological
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

In modern engineering, design problems often need to balance multiple, often conflicting, considerations. By creating and making widely available a Platform for evolutionary multi-objective optimisation, complex design problems can now be solved in-silico. The Platform enables solutions to be generated that are demonstrably superior to competing designs. It has been used to generate solutions for advanced designs of hybrid electric vehicle controllers and the optimisation of vehicle dynamics across a range of different driving scenarios. It is in routine use in Honda Research & Development. The Platform has been made available in GitHub for more widespread use. Thus, beneficiaries are development organisations in a wide range of industries, the public and the environment, since the design solutions are able to incorporate multiple factors, including those relating to cutting emissions, for example.

2. Underpinning research

Evolutionary algorithms have been in use for solving complex engineering problems since the 1990s. However, many real-world complex engineering problems require a solution that is a trade-off between multiple, possibly competing, objectives.

Jin has led Surrey’s research contribution in this area since 2010. Whilst many evolutionary algorithms were developed that were successful in obtaining Pareto optimal solutions ( i.e., where there is no way of improving any objective without degrading at least one other objective), the efficiency of such Pareto-based multi-objective evolutionary algorithms (MOEA) seriously degraded when the number of objectives was more than three [R1]. The latter was a situation that was widely seen in many real-world problems. These are distinguished as many-objective optimisation problems and required a new generation of evolutionary algorithms to be developed.

Our work on the development of a knee-point driven evolutionary algorithm addressed this problem by preferring knee points of the nondominated fronts in the current population of candidate solutions in selection for the next generation. The work presented in [R2] showed this approach to be very effective in accelerating the convergence of the population to the Pareto optimal front and maintaining diversity of the solutions.

An alternative to the convergence enhancement approach of [R2] and others is to divide a complex problem into a number of sub-problems and solve them in a collaborative manner. In [R3], we proposed a reference vector-guided algorithm for many-objective optimisation. The reference vectors can be used not only to decompose the original problem into a number of single-objective sub-problems but also to elucidate user preferences to target a preferred subset of the whole Pareto front (PF). As well as providing competitive performance when evaluated against benchmark test suites, we also showed that reference vectors are effective and cost-efficient for preference articulation, an important requirement for real-world problems.

As the research community continued to expand the range of many-objective evolutionary algorithms, they were extensively evaluated using a set of benchmark test problems. However, these, in turn, were mostly based on general optimisation problems where the performance was evaluated using performance indicators originally proposed for multi-objective optimisation with two or three objectives. To bridge the gap between this state of academic research and industrial need, we compared three state of the art algorithms to solve a seven-objective optimisation problem in hybrid electric vehicle control [R4]. By proposing a novel generic preference articulation method, we demonstrated that the three algorithms were capable of identifying optimal solutions preferred by the decision-maker and showed that our algorithm [R3] achieved the best balance between convergence and diversity and was most effective in articulating the user preference.

Whilst playing an active role in the development of evolutionary algorithms, we noticed that there lacked an up-to-date and comprehensive software platform for researchers to properly benchmark existing algorithms and for practitioners to apply selected algorithms to solve their real-world problems. The demand for such a common tool was even more urgent, given that the source code of many proposed algorithms had not been made publicly available. To address these issues, we developed a MATLAB platform for evolutionary multi-objective optimisation, called PlatEMO [R5], which now includes more than 150 many-objective evolutionary algorithms (including ours) and more than 300 multi-objective test problems, along with several widely used performance indicators.

We continue to address the current limitations of evolutionary algorithms, which are especially an issue when applied to many-objective optimisation problems [R6]. We are currently able to evaluate these against 15 objective real-world problems. They are added into PlatEMO as soon as they have been evaluated and peer-reviewed.

Overall, our research’s two distinguishing features are: (1) its leading role in pushing forward the numbers of objectives that can be handled, and (2) the evaluation of our algorithms on real-world problems in addition to the public benchmark data sets.

3. References to the research

The quality of the underpinning research is evidenced through the publication of scientific papers in peer-reviewed journals and conferences.

[R1] Y. Jin, “Surrogate-assisted evolutionary computation: Recent advances and future challenges” in Swarm and Evolutionary Computation, vol. 1, pp. 61-70. (2011) DOI: 10.1016/j.swevo.2011.05.001

[R2] X. Zhang, Y. Tian, and Y. Jin, “A knee point driven evolutionary algorithm for many-objective optimization” in IEEE Trans. Evol. Comput., vol. 19, no. 6, pp. 761–776. (2014) DOI: 10.1109/TEVC.2014.2378512

[R3] R. Cheng, Y. Jin, M. Olhofer, and B. Sendhoff, “A reference vector guided evolutionary algorithm for many-objective optimization” in IEEE Trans. Evol. Comput., vol. 20, no. 5, pp. 773-791. (2016) DOI: 10.1109/TEVC.2016.2519378

[R4] R. Chen, T. Rodemann, M. Fischer, M. Olhofer and Y. Jin, “Evolutionary Many-Objective Optimization of Hybrid Electric Vehicle Control: From General Optimization to Preference Articulation” in IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 1, no. 2, pp. 97-111. (2017) DOI: 10.1109/TETCI.2017.2669104

[R5] Y. Tian, R. Cheng, X. Zhang, and Y. Jin, “PlatEMO: A MATLAB platform for evolutionary multi-objective optimization [educational forum]” in IEEE Computational Intelligence Magazine, vol. 12, no. 4, pp. 73-87. (2017) DOI: 10.1109/MCI.2017.2742868

[R6] Q. Liu, Y. Jin, M. Heiderich, T. Rodemann and G. Yu, "An Adaptive Reference Vector-Guided Evolutionary Algorithm Using Growing Neural Gas for Many-Objective Optimization of Irregular Problems" in IEEE Trans. Cybern. (2020) DOI: 10.1109/TCYB.2020.3020630

4. Details of the impact

Modern engineering design problems need to meet multiple, often conflicting, objectives. Research work undertaken at Surrey has a wide range of applicability but has demonstrated impact in three specific areas:

  1. Optimisation of hybrid vehicle energy management controllers;

  2. Optimisation of vehicle dynamics in various driving scenarios;

  3. Making available a comprehensive, general-purpose platform for evolutionary multi-objective optimisation under an open-source licence.

Hybrid Vehicle Energy Management:

Hybrid vehicles, with both electric and internal combustion power sources are gaining popularity as a means of reducing greenhouse gas emissions. Approximately 240,000 of these vehicles have been registered in the UK alone since 2012.

Hybrid vehicle energy management has, in the past, been seen as simply a matter of minimising fuel consumption. However, more objectives need to be taken into account if we are to optimise the overall reduction in environmental impact and take into account the overall driving experience. Whilst CO2 emissions are closely correlated with fuel consumption, the emission of other greenhouse gases is associated with other phases of the internal combustion engine running cycle; emissions of nitrous oxides, for example, mostly occur when the engine is on, and the catalytic converter has not yet reached its operating temperature. In addition, the control strategy needs to minimise the usage of the engine within urban environments. However, recent studies have shown that hybrid vehicles can exhibit higher pollution levels in use than those claimed by the manufacturers [S1]. As a result, the overall assessment of the environmental impact of hybrid vehicles is now recognised as vitally important to avoid a backlash against their usage [S2]. For example, drivers may alter their driving practices to optimise their own preferences for noise reduction and charging frequency and this, in turn, can negatively impact vehicle emissions [S2]. Thus, it is important for the controller to optimise against a broader range of objectives to ensure a satisfactory driving experience is obtained whilst still meeting the pollution reduction objectives.

We therefore worked with Honda Research and Development to demonstrate that our research work can optimise against seven objectives: fuel consumption; battery charge/discharge cycling; engine operation changes; engine emissions; perceived engine noise; engine usage in urban operation; average battery state of charge level. This work showed that our “RVEA” algorithm [R3] provided an effective balance between convergence and diversity of solutions, supporting an approach that achieved the objectives preferred by the decision-maker [R4]. This positive experience has motivated the continued usage of MOEAs at Honda Research & Development Europe.

{Text removed for publication}

Optimisation of vehicle dynamics:

Vehicle stability at higher speeds is another important and challenging factor that must be addressed in vehicle design. For both safety and comfort, the vehicle must remain stable, predictable and controllable under a wide variety of road surface conditions and maintenance states. The vehicle behaviour is mainly influenced by the interaction of suspension components, the steering subsystem and tyre characteristics. This leads to a high number of adjustment factors and results in many possible variations depending on the vehicle targets. The trade-off between vehicle dynamics, ride comfort and road holding capability makes the definition of the perfect chassis setting challenging. This is normally tested using pre-production prototypes but testing and corrections to the design at this phase are both very expensive, usually requiring a number of redesign-test cycles. Honda R&D Germany has developed a simulation-based optimisation and evaluation approach that both reduces the cost and enhances the effectiveness of this design phase [S4]. Our algorithms are providing an important contribution to this technology. Honda R&D has been using our optimisation platform PlatEMO [R5] since 2019. Although PlatEMO contains a broad range of candidate algorithms, in an independent evaluation our “KnEA” algorithm was shown to be amongst the first class of performers on benchmark 7-objective problems [S5]. {Text removed for publication}

Open Science support:

Our generation of impact is not just focused on Honda. All the algorithms, together with reports on their evaluation against real-world problems, are in the public domain. In addition, the evolutionary multi-objective optimisation platform PlatEMO [R4] (co-developed with the Institute of Bioinspired Intelligence and Mining Knowledge of Anhui University, China) is available free of charge to academia and industry [S6]. The importance of PlatEMO in building external confidence in the claims of the research community has been recognised by over 1,200 scientists from 40 countries who have (co-)authored papers citing it. In addition, PlatEMO is now (December 2020) in use at 22 industrial and public sector organisations, including Honda, Jaguar, Huawei, Ericsson, Diehl Aviation (Germany), AIST (Japan), Caterpillar Propulsion AB (Sweden) [S7].

5. Sources to corroborate the impact

https://www.transportenvironment.org/press/plug\-hybrids\-new\-emissions\-scandal\-tests\-show\-higher\-pollution\-claimed, Accessed December 2020.

P. Plötz, C. Moll, G. Bieker, P. Mock, Y. Li, “Real World Usage of Plug-in Hybrid Vehicles: Fuel Consumption, Electric Driving and CO2 Emissions”, The International Council for Clean Transportation White Paper, September 2020, https://theicct.org/sites/default/files/publications/PHEV-white%20paper-sept2020-0.pdf

Testimonial {Text removed for publication}

M. Heiderich and T. Friedrich, New approach for improvement of vehicle performance by using a simulation-based optimization and evaluation method, Honda R&D Europe Technical Report, 2016, https://link.springer.com/content/pdf/10.1007/978-3-658-14219-3_21

K. Li, R. Wang, T. Zhang and H. Ishibuchi, "Evolutionary Many-Objective Optimization: A Comparative Study of the State-of-the-Art" in IEEE Access, vol. 6, pp. 26194-26214, 2018, DOI: 10.1109/ACCESS.2018.2832181

PlatEMO GitHub Repository https://github.com/BIMK/PlatEMO

Analysis of PlatEMO Usage (.xlsx file)

Submitting institution
The University of Surrey
Unit of assessment
11 - Computer Science and Informatics
Summary impact type
Societal
Is this case study continued from a case study submitted in 2014?
No

1. Summary of the impact

The impact concerns the introduction of verifiability into electronic voting. Areas of impact are society, commerce, public policy and services. Beneficiaries are voters, public and private sector election services, and policy makers.

Deployment in the State of Victoria, Australia, enabled accessibility for voters with accessibility needs. We have provided verifiability for electronic voting in real elections run by UK market leader Civica Election Services.

The research has also impacted on policy proposals on electronic voting for organisations (e.g., the Knight review on industrial action balloting for UK Government) as well as for those formulating national and international government policy.

2. Underpinning research

Electronic voting can engage a much greater proportion of an electorate than traditional voting, and provide greater accessibility to potentially marginalised groups, but voters must be sure that their vote remains both secret and unchanged. Our research has focussed since 2004 on technical proposals for the introduction of ‘ verifiability’ into electronic voting systems while preserving the secret ballot: verifiability provides mechanisms and processes to enable voters to verify that their vote has been recorded as intended, and independent parties (including voters) to verify the result.

Schneider has led Surrey’s research contribution in this area since 2004. The Prêt-à-Voter electronic voting system, for use at polling stations, was first proposed in 2005 and enhanced in 2006 [R1] by Schneider and collaborators. This system used cryptography in a novel way to provide each voter with a paper receipt which captures how their vote was cast but in a way that does not expose the vote. This uses a ballot form with the candidate names in a random order on one half, and the boxes to mark the vote on the other half. When the list of candidate names is separated from the voter’s selection (and destroyed), the remaining half constitutes a receipt while maintaining secrecy of the ballot. Proposals to enable verifiability in practice on top of this system were brought together in [R2] by Schneider, Heather and others.

An early proof-of-concept prototype was developed at Surrey (with support from collaborators at the University of Newcastle) for the VoComp University Voting System Competition in 2007. This won Best System Design [S1].

Another research contribution was the first practical implementation of a ‘Web Bulletin Board’ [R3]: a trusted, tamper-proof mechanism for collecting and providing election verifiability data. This was a key ‘idealised’ component in the literature on verifiable electronic voting. However, no one had previously produced a practical design and implementation for deployment in real elections. Our research demonstrated the realisation of verifiability in practice.

The first steps to a practical system was the design of the vVote system used in the November 2014 Victorian State Election, Australia [R3, R4, R5], which included the Web Bulletin Board as a key element. This was a collaborative effort over the period 2011-2014 involving the Surrey team led by Schneider and Heather, with partners in Australia including the Victorian Electoral Commission, and academic partners in Luxembourg. This system again used novel cryptographic protocols for the generation of ballots such as used by Prêt-à-Voter, and, crucially for the geographically remote voters, the real-time printing of ballot forms.

Schneider and Treharne’s more recent research over the period 2017-2019 [P6, P7, R6] has developed a way to extend verifiability mechanisms to the more challenging arena of voting over the internet. Here the research focused on designing a way to augment existing internet voting systems with a verifiability layer, so that it is easily deployable with any preferred voting platform, while maintaining integrity and privacy requirements, the first time this has been done, with positive feedback from voter trials [R6].

3. References to the research

The quality of the underpinning research is evidenced through the publication of scientific papers in peer reviewed journals and conferences and competitively won, peer-reviewed grants.

[R1] David Chaum, Peter Ryan and Steve Schneider, A Practical Voter-Verifiable Election Scheme, European Symposium on Research in Computer Security (ESORICS), pp118-139, Springer LNCS 3679, (2005).

[R2] Peter Ryan, David Bismark, James Heather, Steve Schneider and Zhe Xia, The Prêt à Voter Verifiable Election System, IEEE Transactions in Information Security and Forensics, 4(4): 662-673 (2009). DOI: 10.1109/TIFS.2009.2033233

[R3] Chris Culnane, Steve Schneider, A peered bulletin board for robust use in verifiable voting systems, IEEE 27th Computer Security Foundations Symposium, (2014). DOI: 10.1109/CSF.2014.20

[R4] Craig Burton, Chris Culnane, James Heather, Thea Peacock, Peter Y. A. Ryan, Steve Schneider, Sriramkrishnan Srinivasan, Vanessa Teague, Roland Wen, Zhe Xia, A Supervised Verifiable Voting Protocol for the Victorian Electoral Commission, 5th International Conference on Electronic Voting (EVOTE), Lecture Notes in Informatics 205, (2012).

[R5] Chris Culnane, Peter YA Ryan, Steve Schneider, Vanessa Teague, vVote: a verifiable voting system, ACM Transactions on Information and System Security (TISSEC) 18(1), (2015). DOI: 10.1145/2746338

[R6] Mohammed Alsadi and Steve Schneider, Verify My Vote: Voter Experience, 5th International Joint Conference on Electronic Voting (E-Vote-ID), TalTech Press (2020).

Projects

[P1] Heather, J., Schneider, S., (Surrey) Ryan, M. (Birmingham): Trustworthy Voting Systems, EPSRC, April 2009 — October 2014, £1.5M.

[P2] Heather, J.: Real World Secure Elections, Leverhulme Trust, September 2010 – August 2011, £40,660

[P3] Schneider, S., Heather, J.: Software for the Verifiable Election System Demonstrator, Victorian Electoral Commission, March 2012-July 2012, £13,000

[P4] Schneider, S., Heather, J.: Design Specification for the Verifiable Election System, Victorian Electoral Commission, August 2012 — December 2012, £5,770

[P5] Schneider, S., Heather, J.: vVote voting system implementation, Victorian Electoral Commission, July 2013 — December 2014, £103K

[P6] Schneider, S., Treharne, H., Dupressoir, F., (Surrey) McBurney, P., Dhillon, A., Mahmoodi, T. (KCL), Trusted and Transparent Voting Systems, EPSRC September 2017 – October 2020, £615k

[P7] Schneider, S., Treharne, H., Dupressoir, F. Adding Voter-Verifiability to Online Elections and Real-World Trials, Impact Acceleration Account University of Surrey 2017: £39,972

4. Details of the impact

The impact is concerned with the introduction of verifiability into electronic voting: its use in real elections in Australia and the UK; and influence on policy in the UK.

Australia: For the Victorian State Parliamentary Election in November 2014, the Victorian Electoral Commission (VEC) desired to ensure accessibility to a secret ballot for voters who might otherwise be disenfranchised, but security was a key consideration. VEC chose the University of Surrey’s verifiable vVote system [R3, R4, R5] as they felt it offered the most trustworthy solution [S4]. Voters in the State of Victoria who were visually impaired, mobility impaired, or had a language other than English, were able to cast binding ballots electronically using the Surrey vVote system across the State of Victoria. The system was also made available to all voters resident in the UK who voted at Victoria House, London. The team from Surrey led by Schneider worked with VEC to adapt the vVote system to their specific requirements, providing particular expertise on the back end which managed all the cryptography and the capture and handling of the votes. A feedback survey established that voter satisfaction was high.

The VEC reported “This was comparable to, or better than the findings in 2010, and pleasing considering the new steps introduced with the verification processes in 2014. Of the open-ended questions asked of the London electors, almost all answers were positive about the system. Overall, this is an important finding that shows independent verification is not an impost on electors when voting electronically [S2].

The then Director of Electronic Voting at VEC, Craig Burton, reported that “the success of the deployment swung the discussion [see S3] and approach to e-voting across the various Australian election commissions, by demonstrating that verifiable voting was technically feasible and that “the system has embedded the notion of verifiability […] it is now understood across the industry as a key security feature.” Indeed, many current competitor systems now claim to incorporate forms of verifiability. With respect to improving inclusion of potentially marginalised groups, Burton reported that he “trialled the system with profoundly physically disabled people”, and that “access to this system for them, were it legislated, would represent the first time in many disabled people’s lives where they could participate privately and independently in an election. For the profoundly physically disabled this may be one of the very few acts they can perform on their own at all. [S4].

UK: In the UK statutory elections are paper-based. However, organisations (e.g., trades unions, building societies, professional organisations, political parties, student unions) also run ballots. Civica Election Services (CES; formerly Electoral Reform Services Ltd) are the UK market leader in this sector with over 90% market share. In recent years, remote electronic voting has become popular to provide convenience for those entitled to vote, as well as allowing for cost saving and rapid elections. In the period October 2018-September 2019, we developed the approach [R6] to introduce verifiability into the CES existing internet voting system. This was used on binding ballots with clients, including an election for the Royal College of Nursing in July 2019 with an electorate of 40,000. Approximately 40% of votes cast used the verification system to check their vote. Another example is the ballot with the College of Podiatry in October 2019. Philip Wright, CES Technical Director, reported “the experience of having run verifiable ballots has demonstrated to the business that this can be done in a way that is commercially viable and attractive to customers […] it is clear that verifiability plays a key role.” He further comments that it has “enhanced our offering and market position without negatively impacting on the use of our core product.” [S5]

UK Policy – Industrial Actions Balloting: Schneider co-authored the technical annex for Sir Ken Knight’s Independent Review on Electronic Balloting for Industrial Action [S6] commissioned by the Department for Business, Energy and Industrial Strategy (BEIS), and made a direct impact on its policy recommendations [S7]. The annex together with Schneider’s involvement in the round table discussions and a fact-finding trip with Sir Ken to Cybernetica in Estonia “led directly to one of the key recommendations in [Sir Ken’s] report that verifiability should be included in electronic balloting systems when used for industrial action ballots” [S7] for consideration by UK Government developing policy on remote, electronic voting. Schneider also chairs the Institution of Engineering and Technology (IET) Working Group on Electronic Voting which includes members from industry, academia, government from UK and internationally, whose report ‘Internet Voting for the UK’ (October 2020) [S8] includes verifiability as a key recommendation.

5. Sources to corroborate the impact

Australia:

[S1] VoComp.org (archive site): https://web.archive.org/web/20160317221515im_/http://vocomp.org/results.php.html

[S2] Inquiry into electronic voting, Parliament of Victoria Electoral Matters Committee, May 2017 (Victorian Government Report on the electronic voting element of the 2014 Election).  https://www.parliament.vic.gov.au/419-emc/inquiry-into-electronic-voting (Also PDF)

[S3] Building an open source eVoting system: The vVote experience, Peter Scheffer, ComputerWorld 15 July 2016  https://www2.computerworld.com.au/article/603488/building-an-open-source-evoting-system-vvote-experience/ (Also PDF)

[S4] Testimonial from Craig Burton, Manager Special Projects, Victorian Electoral Commission (PDF)

UK Civica trials:

[S5] Testimonial from Mr Phil Wright, Technical Director of Civica UK’s Democracy and Engagement Division, Civica Election Services (PDF)

UK Policy:

[S6] Independent review of electronic balloting for industrial action, Sir Ken Knight, Annex A  https://www.gov.uk/government/publications/electronic-balloting-for-industrial-action-knight-review (Also PDF)

[S7] Testimonial from Sir Ken Knight (PDF)

[S8] Internet Voting in the UK report from IET Working Group on e-voting, October 2020, https://www.theiet.org/media/7025/internet-voting-in-the-uk.pdf  (Also PDF)

Showing impact case studies 1 to 3 of 3

Filter by higher education institution

UK regions
Select one or more of the following higher education institutions and then click Apply selected filters when you have finished.
No higher education institutions found.
Institutions

Filter by unit of assessment

Main panels
Select one or more of the following units of assessment and then click Apply selected filters when you have finished.
No unit of assessments found.
Units of assessment

Filter by continued case study

Select one or more of the following states and then click Apply selected filters when you have finished.

Filter by summary impact type

Select one or more of the following summary impact types and then click Apply selected filters when you have finished.

Filter by impact UK location

UK Countries
Select one or more of the following UK locations and then click Apply selected filters when you have finished.
No UK locations found.
Impact UK locations

Filter by impact global location

Continents
Select one or more of the following global locations and then click Apply selected filters when you have finished.
No global locations found.
Impact global locations

Filter by underpinning research subject

Subject areas
Select one or more of the following underpinning research subjects and then click Apply selected filters when you have finished.
No subjects found.
Underpinning research subjects