Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems
- Submitting institution
-
University of Edinburgh
- Unit of assessment
- 11 - Computer Science and Informatics
- Output identifier
- 156250734
- Type
- D - Journal article
- DOI
-
10.14778/3231751.3231765
- Title of journal
- Proceedings of the VLDB Endowment (PVLDB)
- Article number
- -
- First page
- 1303
- Volume
- 11
- Issue
- 10
- ISSN
- 2150-8097
- Open access status
- Technical exception
- Month of publication
- June
- Year of publication
- 2018
- URL
-
-
- Supplementary information
-
-
- Request cross-referral to
- -
- Output has been delayed by COVID-19
- No
- COVID-19 affected output statement
- -
- Forensic science
- No
- Criminology
- No
- Interdisciplinary
- No
- Number of additional authors
-
11
- Research group(s)
-
A - Computer Systems
- Citation count
- 8
- Proposed double-weighted
- No
- Reserve for an output with double weighting
- No
- Additional information
- Introduces a novel system: Chi, where its users can write high-level policies to efficiently re-configure a large-scale stateful stream processing system. System has been deployed into production and reduces the cost of running a Microsoft stream processing cluster by up to 10x. The novel designs proposed by Chi has led to 3 international patents filed by Microsoft (contact: Principal Big Data R&D Manager). Chi enables many self-tuning data processing systems to be implemented easily. It motivates an additional novel system named Cameo accepted for publication in NSDI’21. Its research significance helped the authors win a Microsoft Azure Research Award (2018).
- Author contribution statement
- -
- Non-English
- No
- English abstract
- -