Impact case study database
- Submitting institution
- The University of Bolton
- Unit of assessment
- 23 - Education
- Summary impact type
- Societal
- Is this case study continued from a case study submitted in 2014?
- No
1. Summary of the impact
Paradoxically, the greater the benefit of educational technology standards the greater their invisibility; All Technology Enhanced Learning platforms/systems rely on ‘boring’ technical standards that allow the ‘interesting’ to flourish. This Longitudinal research has resulted in improved experiences and outcomes for (1) Learners,** more effective & efficient technology for **(2) Tutors **(3) Institutions and (4) Industry and has contributed to the development of standards deployed in systems across international education networks. Every international Higher and Further Education institution deploying a Virtual Learning Environment uses standards and every admission system in the UK uses a coding system underpinned by the research.
2. Underpinning research
The work reported here builds on activity described in the 2014 RAE Education submission and continues to support the development of interoperability specifications, and the stakeholder groups highlighted in (1)(2)(3)(4) who directly benefitting from them. Formerly the Centre for Educational Technology & Interoperability Standards (CETIS) activities were absorbed into the School of Education with applied research focussed on the early developmental stage of both formal approaches and informal community Technology Enhanced Learning (TEL) specifications and their practical adoption in commercial /institutional systems worldwide.
A significant part of UOB research activity representing the UK national interests through JISC has been in partnership and support of IMS http://www.imsglobal.org/ during the period of the REF work has focussed on two key international initiatives IMS Question and Test Interoperability (QTI) (Paper 3.1) and IMS learning Tools interoperability (LTI) (Paper 3.6) . These projects involved UOB undertaking extensive qualitative research in specific areas firstly (a) the establishment of focus groups to provide evidence and data to determine the user requirements to inform the development of these two specifications. Secondly (b) in controlled testing of the specifications in Learning scenarios and integrating with Learning analytics services interoperating with Virtual Learning Environments (VLE’s) and finally (c) in undertaking a qualitative evaluation of the LTI specification performance with the Moodle VLE. This work served to inform the ongoing development of the two specifications which are both now widely adopted in TEL systems.
In 2015, as part of the HESA data and information improvement programme, UoB provided evidence of user requirements to inform the development of a new HE coding system to replace the obsolescent Joint Academic Coding System (JACS) the system used by HE institutions to classify academic subjects and modules. The work involved qualitative research using focus groups, case studios to provide evidence of the requirements of the sector of a replacement system. The replacement system Higher Education Classification of Subjects (HECOS) ( https://www.hesa.ac.uk/innovation/hecos ) (Paper 3.7) was implemented in 2019.
In 2014, as part of the EU FP7 Project Learning Analytics Community Exchange (LACE) (Papers 3.2,3.3,3.5) https://cordis.europa.eu/project/id/619424 UoB led the evaluation of the use of Learning analytics. Qualitative research involved the engagement of focus groups in structured methods, including a policy Delphi to assess the feasibility and desirability of possible future states. Specific detailed work undertaken included a qualitative evaluation of the efficacy of the experience Application Profile Interface (xAPI) specification. The specification provides for the collection of digital experiences and the sharing of the data collected across multiple learning systems.
Work also included cross disciplinary collaboration with Business colleagues in to the Realising an Applied Gaming Ecosystem (RAGE) project (Papers 3.4 ,3.6)
https://cordis.europa.eu/project/id/644187 in the evaluation and testing of the LTI and xAPI specifications with learners using applied games. This work forms a substantial part of the UoB Business (UoA17) submission to this REF exercise.
3. References to the research
- Bogaerts, J., Hoffmann, T., Howard, R., Kraan, W., McKell, M., Smythe, C. (Eds) (2015) IMS Question and Test Interoperability (QTI): Overview Version 2.2. IMS Global Learning Inc.
http://www.imsglobal.org/question/qtiv2p2/imsqti_v2p2_oview.html
- Griffiths, D., Brasher, A., Clow, D., Ferguson, R., Yuan, L. (2016). Visions of the Future. Learning Analytics Community Exchange Horizon Report, Public Deliverable –D3.2. Available at http://www.laceproject.eu/deliverables/d3-2-visions-of-the-future-2/
3.3 Ferguson, R., Clow, D., Griffiths, D., & Brasher, A. (2019). Moving Forward with Learning Analytics: Expert Views. Journal of Learning Analytics, 6(3), 43-59.
https://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/6162
3.4 Grigorov, A., Bontchev, B. P. BoyTchev,P., Stefanov,K., Westera, W Nyamsuren,E., Bahreini,K. Prada,R., Hollins, P. Moreno,P. (2018) The RAGE Game Software Components Repository for
Supporting Applied Game Development, International Journal of Serious Games Vol 4 Issue 3 Page
59
3.5 Hollins, P., Griffiths, D., Vander Vegt, W., Manjon, B., Stefanov, K., Westera, W., Wilson, S. Martinez- Ortiz, I., Glass, J., Cooke.J., Paton, T. Hemnje,M.,Pomazansky,A. (2018) RAGE Asset Integration Methodology D1.2 Public Deliverable https://research.ou.nl/en/publications/d12 asset-integration-methodology
3.6 Kraan, W., Paul, A. (2015) The Higher Education Classification of Subjects (HECoS) vocabulary. HEDIP project public deliverable 4. http://ubir.bolton.ac.uk/2768/
4. Details of the impact
Work has contributed to enhanced teaching and learning through improvements in system interoperability, and been instrumental in supporting Open Educational Resources (OER), practice, development of analytics. Impact of the 2014 case study continues, but the inclusion of new research and impact means that it is not a continuing case study. In order to achieve maximum impact, the work is closely aligned to interoperability initiatives of key international partners, Jisc (UK), CEN (Europe), and IMS GLC (USA).
This work is important to stakeholders (1) Learners, (2) Tutors, (3) Institutions and (4) Industry; as a lack of interoperability can leave educational content, e-portfolios, course information and data locked into proprietary systems. This limits flexibility, freedom of choice, and prevents learners, tutors and institutions from communicating freely or exchanging data across educational platforms. The impact of the UoB work in specifications is as follows:
IMS Question and Test Interoperability (QTI) (Paper 3.1) and IMS learning Tools interoperability
(LTI) (p3.6)
IMS is an international educational technology specifications membership consortium with over 500 members. UoB wok informed the development of specifications including QTI and LTI. The contributions of Griffiths, Hollins, Cooper and Kraan into the development of the QTI specifications since 2010 cumulated in the publication of QTI 2.2 in 2015, with Kraan as author. QTI is the world’s only open interoperability format for computer aided assessment, and has been adopted by many of the world’s major eLearning companies (890 QTI and 262 LTI certified products) https://site.imsglobal.org/certifications (Accessed September 2020)
Benefits: (1) Access to digital assessment and assessment item banks across most VLE’s to improve learning outcomes. Seamless access to digital tools via their VLE.
(2) An ability to incorporate a variety of digital assessment pedagogic activities in most VLE’s. An ability to incorporate external pedagogic digital tools for deployment within their VLE.
(3) Effective and efficient application of digital assessment with seamless technical integration to their VLE of choice. An ability to extend the functionality of their VLE to tutors through the addition of digital tools.
HECOS (p3.7)
UoB was engaged by HESA as part of the HEDIP project in 2014 to undertake technical and social research to inform the development of a new course coding system. The HECOS system reflected both technical and community requirements for more flexibility than the previous set of fields and subjects in JACS. In 2019 HESA confirmed the requirement for all HE to move from the existing JACS system and to adopt HECOS as their primary coding for identifying the area of study of all courses. The system is now used in every Higher Education institution (165 in total) in the UK and used by University and College Admission Systems (UCAS), the students loan company and the Foreign and Commonwealth Office.
Benefits: (1) Greater clarity for applicants to HE on the course content and modules.
To provide clear information relating to students relating to their course, content.
Efficient coding and clarity relating to their course content and module offerings.
Learning Analytics Community Exchange (LACE) (p3.2,3.3,3.5) and experience Application Profile Interface (xAPI) (p3.2,3.3,3.5)
UoB led interoperability work in LACE, researching the emerging landscape of specifications, particularly xAPI, and reflecting this back to the communities of practice working in the field. The work of LACE has contributed to the increase in the use of learning analytics in educational domains. The work has also stimulated and supported the use of learning analytics by a number of other European projects.
Benefits: (1) Improved learning outcomes supported by formative analytics.
The ability to monitor student progress to make appropriate interventions
mprove student retention through interventions and data information.
Realising an Applied Gaming Ecosystem (RAGE) project (Papers 3.4 ,3.6)
The project evaluated the use of xAPI in applied games and LTI for data exchange with VLE’s.
creating demonstrators for the use of LTI in conjunction with serious games and learning analytics. The recommended scenario of xAPI integration into Moodle stimulated early adoption by international games development companies in France, Germany and the UK. The success of the research, in collaboration with other partners (UCM), led to the inclusion in the RAGE asset portal of a number of demonstrations of the xAPI service as a viable asset in the RAGE ecosystem.
LTI Benefits: (1) Access to immersive learning activities through their VLE.
(2) The ability to incorporate immersive learning experiences through their VLE
(3) Improved data exchange across their systems and the ability to support pedagogic approaches involving immersive digital technologies.
(4) The ability to integrate their products with institutional VLE’s
5. Sources to corroborate the impact
XCRI: Alan Paull Associates: https://www.xcri.alanpaull.co.uk/ . Alan Paull will provide a statement of support.
HECOS. https://www.hesa.ac.uk/innovation/hecos . We believe that statements of support would be forthcoming. (Andy Youell)
Jisc xAPI: https://github.com/jiscdev/xapi/blob/master/common_structures.md https://www.jisc.ac.uk/learning-analytics
http://www.laceproject.eu/deliverables/d7-1-interoperability-studies.pdf Ruth Drysdale of Jisc
Rob Abel of IMS Global Learning and https://site.imsglobal.org/certifications
Games companies involved in RAGE
Tore Hoel
Projects working with LACE
Alan Berg, University of Amsterdam and Apereo Foundation
- Submitting institution
- The University of Bolton
- Unit of assessment
- 23 - Education
- Summary impact type
- Societal
- Is this case study continued from a case study submitted in 2014?
- No
1. Summary of the impact
Research carried out at the university of Bolton produced a set of “theories of action” which has informed the pedagogic practices of 28 schools, with 3000 teachers, and resulted in an improved educational experience for over 19,000 students. Similarly, the Leadership for Powerful Learning school improvement programme which consisted of a series of six workshops for nominated school leaders of primary schools in Bolton has significantly enhanced their capacity provide high quality teaching and enhanced student learning.
2. Underpinning research
The case study is underpinned by a lifelong commitment to school improvement and the quality of teaching and learning in schools. Much of the origins of the theoretical basis on which the Powerful learning series was designed can be traced back to Hopkins’ School Improvement Trilogy (Hopkins 2001, 2007 & 2013) which put forward an ‘integrated model of school improvement’ that provided a guide to strategic action for school improvement.
The passion for school improvement then led Professor Hopkins to pursue a practical yet theoretical approach to pedagogic strategies that could act as a mechanism to facilitate meaningful change and whole school improvement. The practical strategies looked to adopt a “curiosity” approach to drive powerful learning and first introduced the concept of “Theories of Action” for teaching and learning [3.4].
The “theories of Action” adopted the approach that teaching is a profession, and just like any other, there is a series of actions which can result in a presumed set of outcomes. The research established professional protocols that were substantiated by a high level of empirical educational research literature [3.2].
As the research continued to deepen its understanding of the theories of action and began to embed them within instructional rounds five important findings where produced [3.5]. The first was that despite the phase or context of schooling, the theories of action were in most cases very similar. Second, this is not a ‘pick and mix’ approach—all the theories of action have to be integrated into the teacher’s professional repertoire if they are to impact in a sustained way on student learning. Third, and most importantly, all the theories of action are characterised by an approach to teaching that has enquiry at its centre [3.1]. Fourth, some of the theories of action relate to the school and some to the practice of individual teachers. Fifth, all the theories of action have a high level of empirical support in the educational research literature.
As a result of the series of Powerful Learning Manuals Professor Hopkins was then invited to apply his theories of action, in action, as his research attracted the attention of local schools within the Bolton Learning Partnership (BLP). As such, the instructional rounds where then further refined through the development of Theories of Action which emerged out of collaborative Instructional Rounds. The process included the participation of 28 schools, 3000 teachers and over 19,000 students all of which developed and refined the Theories of Action protocol for teachers to utilise in their approach to teaching.
However, despite the well documented success of the theories of action with the BLP Professor Hopkins noticed that framing Theories of Action, and ensuring access to professional learning, did not always result in enhanced student achievement. Nor did these steps necessarily lead to the Theories of Action becoming embedded in a school’s professional practice. This then led to “Leadership for powerful learning” which documents overwhelming importance of leadership in the pursuit of realising a collective moral purpose. The findings stepped through four contrasting, but complementary styles of leadership each tasked in their different ways with achieving the goal of school improvement, the underlying proposition being that a synthesis of these styles and skills should overcome both the challenge of ‘social complexity’ and the paradox of ‘change and no-change’ [3.3], [3.6].
3. References to the research
Hopkins, David (2014) A Teacher’s Guide to Classroom Research, (Fifth Edition) Buckingham: Open University Press, [ISBN-13: 978-0335-26468-1].
Hopkins, David and Craig, Wayne (2015) Curiosity and powerful learning. Education Today, 65 (2). pp. 4-11. ISSN 0013-1547
Hopkins, David and Craig, Wayne (2015) Leadership for Powerful Learning. Curiosity and powerful learning series, McREL Australia. ISBN 978099265326 [Kindle Edition available on Amazon].
Hopkins, David and Craig, Wayne, with Knight, Oli (2015) Curiosity and Powerful Learning. Curiosity and powerful learning series, McREL Australia. ISBN 9780994265319 [Kindle Edition available on Amazon].
Hopkins, David and Baumber, J. (2019) Getting to the Heart of System Reform – A micro strategy for large scale educational change. Educational Futures, 10 (2), December, pp 3-27. ISSN: 1758-2199
Hopkins, D, (2020) Unleashing Greatness – A Strategy for School Improvement. Australian Educational Leader, 42(3), pp. 8-17.
4. Details of the impact
.
The impact that has arisen as a result of the research documented in section 2 has positively influenced primary and secondary schools across Bolton through the adoption of pedagogic practices and protocols that are substantiated by a high level of empirical educational research literature and refined in practice.
The Bolton Learning Partnership brought together 28 schools, 3000 members of academic staff and over 19,00 students to utilise the theories of action and instructional rounds documented within the curiosity and powerful learning. The BLP reported that the use of theories of action and instructional rounds where seen to increase academic success amongst pupils, improved recall during reviews of prior learning and in response to test questions indicated a stronger vocabulary.
Chris Bingley, Assistant Head Teacher at Thorn leigh Salesian college stated that through adopting the instructional rounds model has had an informal link to academic success, Improved recall during reviews of prior learning and responses to test questions has indicated a stronger vocabulary size, there's been a positive shift in learning climate because of the expectations that students use academic vocabulary in the classroom [5.2].
Simon Cordell, Assistant Vice Principal at Little Lever School stated that they have looked to create the perfect learning environment by adopting an entry protocol for all staff and students which is having a positive effect on the pupil engagement at the start of the lesson [5.3].
Rebecca McCarthy, Word of the week Strategy Lead at Rivington High School stated that the introduction of the language mastery initiative at Rivington had helped the students to access tier two vocabulary which assists students in developing their understanding in the curriculum in all of their subjects [5.3].
The impact however goes far beyond the 19,000 pupils detailed above as the BLP documented that their engagement with the research had significantly enhanced professional repertoire of all staff at the schools who had developed their own technical skills and knowledge through adhering to the protocols implemented. Through embedding the theories of action into school culture the positive effects are expected to pertain for the foreseeable future as the school adopts the practical guides to whole school improvement which has the potential to alter the trajectory of the next generation of children within the borough.
The Leadership for Powerful Learning school development programme took the next steps to ensuring those witnessed benefits to student outcomes then fully embedded within school practice as it delivered a series of six workshops to nominated educational leaders of primary schools in Bolton which increased the awareness of leadership in the pursuit of realising a collective moral purpose. To date the programme has supported at least 25 primary schools in strengthening their capacity to provide high quality teaching, enhancing student learning, and managing change effectively. Engagement with the programme has already resulted in a more strategic approach to school improvement, enhanced student outcomes that are attested to by LA school advisers. An example of the impact of the programme is provided by OFSTED in their inspection of St Ethelbert’s RC Primary School, Bolton, in 2018, which states that as a result of the programme “...leaders are successfully developing the curriculum in areas such as reading, writing and mathematics. Subject leaders work well together to provide pupils with opportunities to make connections in their learning across the curriculum and to undertake learning activities that excite and engage pupils’ thinking.”
As the understanding and evidence grew for the beneficial impact teachers and school leaders could have when implementing instructional rounds so did the attention of leading academics and practitioners around the world. As such, Professor Hopkins was invited to be a keynote speaker at several internationally acclaimed conferences such as; The Ministry of Education Cyprus (2016), Bastow Leadership Institute Melbourne (2016) and the Australian Council for Educational Leadership (2017, 2017) which significantly increased capacity within the field as the dissemination of the key research findings enhanced the fields understanding of school improvement and system leadership. The findings where then also presented at the British Educational Studies Association annual International Conference in 2018 which was hosted at the University of Bolton. in January 2018 Professor Hopkins presented his findings on the success of his newfound Curiosity and Powerful Learning approach in a keynote speech for the TEDxUniversityofBolton and as of today has been viewed a total of 5,888 times on YouTube alone and was also published on the official TED Talks account which holds more than 21.4M subscribers.
5. Sources to corroborate the impact
https://www.boltonlearningpartnership.org.uk/case-studies/ Confirms the Inclusion of Professor Hopkins in designing “theories of action” across school within BLP
https://www.youtube.com/watch?v=CX1UWQMscIc&t=192s Confirms the use and impact of the research led by Professor Hopkins on the Academic Vocabulary of students at BLP schools.
https://www.youtube.com/watch?v=sBl3Eo0-vsE Confirms the use and impact of the research led by Professor Hopkins on the Learning Environment, Expectations and Relationships of students at BLP schools.
St Ethelbert’s RC Primary School OFSTED recent school inspection.
“Senior leaders receive a range of opportunities to develop their leadership skills further. For example, connections made with a local university enable leaders to look in detail at ‘leadership for powerful learning’. As a result, leaders are successfully developing the curriculum in areas such as reading, writing and mathematics. Subject leaders work well together to provide pupils with opportunities to make connections in their learning across the curriculum and to undertake learning activities that excite and engage pupils’ thinking.” P.3