
Heriot-Watt University has purchased Explorance MLY to provide comprehensive analysis of open comments derived from student surveys.
The University, which has five campuses across the world in Edinburgh, Scottish Borders, Orkney, Dubai and Malaysia, has set out a commitment to “make better use of the data we are collecting” from around 27,000 students.
Explorance MLY will be used to analyse qualitative feedback in all student surveys, including course/module evaluation surveys, annual surveys, welcome week surveys, the Postgraduate Taught Experience Survey, and the Postgraduate Research Experience Survey.
Kirsty Scanlan, Director of Strategic Planning, Performance and Projects, explained: “We have a very healthy provision of data from these surveys, but have lacked the software to make the most of it. Open comments are a rich source yet extremely time consuming to process. Our team has been internally reviewing qualitative data, manually cleaning this as it would include personal details of staff or students themselves, and then getting that feedback to appropriate staff members.
“As a university we want to embrace AI in appropriate and sensible ways, to support what we cannot provide, and MLY will help us to make better use of the data we are collecting. With 17,000 responses to student surveys, and on average five open-ended questions in each survey, there are around 100,000 open comments to process. Through MLY’s analysis we will be able to better identify local challenges, ensure that subject/discipline areas are targeted, and provide insight to local leaders more swiftly to make staff and students’ lives easier.
“We also want to increase the rate of responses, particularly on internal surveys, so the more data pushed through MLY the better we can utilise it. MLY has the advantage of being informed by masses of cohorts of data from other collections around the world, so whilst it may tell us what we already know it gives us the evidence to back it up.”
Business Intelligence Analyst Richard Cooper first came across Explorance MLY at the HESPA Annual Conference in February. “I was not actively seeking anything else to add to our systems, but it dawned on me that MLY could be a really useful tool to help us out in the long term, with potential to make a really positive change across a number of areas,” he said.
“Student surveys are looked after on an annual basis by a two-person team. These are heavy to manage, and the manual analysis of open comments became too much, too laborious. Now, with MLY software doing the analysis for us, we can work through multiple thousands of responses. Even for those students who are not responding there will also be an impact as we will now get richer insight from those that do.”
“Whilst we are just staring our journey with Explorance, they are great to work with. I attended Explorance World, which this was an eye-opening experience, and they were very welcoming even prior to being a customer. Ultimately we hope that MLY becomes transformational.”
Setting the project in the context of the University’s Strategic Plan, Kirsty added: “In our current strategy we have a performance indictor on student satisfaction, and this will be at the heart of our next strategy too. We have made a commitment that feedback is listened to, acknowledged, and utilised, and student experience is at the heart of process development. Heriot-Watt is unique in that we have the same academic provision in Dubai and Malaysia as we do in the UK, and student surveys are also truly global. We are keen to see how MLY helps with Malaysia where English is not first language, and consolidate our global campus. There has to be a consistent global student experience.”
John Atherton, VP Sales – EMEA at Explorance, commented: “We are delighted to have Heriot-Watt University join the growing number of institutions using Explorance MLY for AI-powered qualitative analysis. Thematically analysing free-text comments from student surveys is a huge challenge for universities, in terms of time and resources, but MLY distills data-driven actionable feedback from huge amounts of unstructured comments. With machine learning models purpose-built for higher education, MLY has specialised provision that identifies recommendations and alerts from student feedback.”
Kirsty is one of the speakers from universities in the UK, Europe and beyond have been confirmed in the programme for Explorance’s annual Bluenotes Europe conference, which will be held at etc.venues Monument in London on 20th-22nd November.
The conference, which this year is titled ‘Feedback for the Brave: Transforming Education with AI-Driven Insights and Student Feedback’, will attract delegates from all around Europe. With a combination of keynote speeches, panel discussions, university presentations, structured networking and a technology zone, the event aspires to be a global exchange of ideas for feedback-based continuous improvement for teaching excellence and student success.
John said: “We are excited to host Bluenotes Europe, which brings together leaders across higher education to share insights, strategies and innovations that turn feedback data into actionable outcomes. Attendees will gain a comprehensive understanding of how feedback analytics informs decision-making, shapes impactful strategies, and enhances overall performance.
“They will have the opportunity to network with student feedback leaders and share strategies that amplify the student voice to drive institutional success; engage in thought-provoking discussion that dives deeper into the impact of student feedback on teaching effectiveness and student success; attend presentations showcasing how cutting-edge AI technologies are transforming student feedback’s potential; and join hands-on sessions that demonstrate how to streamline processes using automation to gather, interpret and utilise student feedback, from module evaluations to student experience data.
“We will hear from Explorance partner universities already benefiting from Blue, our course evaluation surveys software, and MLY, which supports enhanced qualitative analysis of student insights emerging in surveys.”
Among the conference highlights are:
Keynote speeches
- Transforming Student Feedback: Leveraging Generative AI for Actionable Data: Christina Bifulco, Associate Director for Teaching and Learning Analytics, Rutgers University.
- Building a Braver Future with Feedback / The Future of Explorance MLY: Samer Saab, CEO, Explorance.
University presentations
- Pleasing all the People all the Time: Mark Warnes, Senior Research Fellow; and Elsa Ranjith, Senior Project Manager, Anglia Ruskin University.
- Future Ready Mentoring: An Assessment of Impact and Effectiveness: Matthew Abley, Institutional Research Analyst, University of Westminster.
- Enhancing Student Evaluations with Blue: Adapting a Robust System to Meet New Needs and Organisational Changes: Line Sassersen, Evaluation Consultant, Copenhagen Business School.
- Manchester and MLY: Janine Holdway, Head of Teaching and Learning Delivery; Daniel Bayes, Teaching and Learning Officer; and Sarah Williams, Teaching and Learning Manager, University of Manchester.
- Out of the Blue: Consolidation of Student Survey Activity to Maximise Engagement: Dr Elena Zaitseva, Head of Student Voice and Evaluation; Dr Phil Carey, Dean, Teaching and Learning Academy; and Fenna Boerkamp, Institutional Researcher, Liverpool John Moores University.
- Enhancing Graduation Ceremonies: Using Blue to Capture Graduates’ Experiences and Insight: Rebecca Hampstead, Student Voice Manager and Emilly Daniels, Student Voice Assistant, Kingston University.
Panel discussion
- Quantitative v Qualitative Insights in Student Feedback: featuring Maksymilian Karczmar, Student Engagement Officer, Cardiff University; Christina Bifulco, Associate Director for Teaching and Learning Analytics, Rutgers University; and Kirsty Scanlan, Director of Strategic Planning, Performance and Projects, Heriot-Watt University; moderated by Kristin Huber, Quality Development Expert, University of St.Gallen.
To register for Explorance Bluenotes Europe 2024, please visit the conference website.