NZ Business Podcast - Paul Spain
00:39:25 · Paul Spain
[00:39:25] S1: Yeah. And have you built some, you know, technology platforms to help, you know, support these processes and and make it easier to get, you know, what you need, something that really is a a really, you know, good fit for the outcomes that you're looking for Yep. You know, without just, you know, trying to use off the shelf tools that that may not may not be, you know, always relevant.
00:39:48 · Jamie Beaton
[00:39:48] S0: You bet. So in 2017, launched the Crimson app, and we've basically been heavily investing behind this. So it really makes student and tutor experience really efficient. So on the tutor side, you log online, you know, all your sessions are tracked. After every session, you fill out a session report, which, you know, gives us an update on how the student's progressing. The student reviews the tutor experience as well. The parents can access analytics and reports on how those interactions are moving. We... The the parents and tutors can access score reports as well for how the kids' testing is going. And then the student can log in to all these other resources on the platform too. And then all of that's synced to invoicing, so the tutors can then quickly get paid efficiently so we can process large numbers of invoice payments around the world, you know, fast. And then there's also community functions as well where people can interact with one another too. And then there's secure chat, etcetera, which is very important for child safety. So, yeah, we've gone pretty hard on those features, and it's been pretty essential for us. And we're adding more and more sophisticated features. So for example, we're adding some, you know, different kind of algorithmic analytic engines so that, for example, saying you and I are speaking in a class, there's five of us in a classroom, and, you know, you're not speaking very much or actually you're speaking a lot. And that's a change because last week in economics, you weren't as engaged. We can, you know, really drive out those trends and engagement from, you know, student to student to student, and also how the the the teachers, you know, classroom style is evolving as well, and uses analytics to inform coaching sessions, pressure development, and also, you know, reports for the parents too. And so
00:41:09 · Paul Spain, Jamie Beaton
[00:41:09] S1: Because this is happening in an online context. Which is revolutionary. Yeah. Actually draw all that data [00:41:14] S0: that Totally. [00:41:14] S1: You know, in a normal classroom, you wouldn't have unless you, you know, you initially had some, you know Yeah. [00:41:19] S0: Micro files and, [00:41:20] S1: you know, auditing Totally. Processes. So So that's an advantage. Fascinating. [00:41:25] S0: Yeah. And and think about this. When So you go through school, how much data do you actually know about, you know, your own high school performance? You do a test every so often, you do some exams, but you sit in hours and hours of classes, and you don't know, you know, how you're engaging, how you're participating, what that looks like compared to other successful students. In the online schooling world or the online tutoring world, you know, we have all of these datasets of high achieving kids and, you know, what their, you know, engagement metrics were like. And then we can see when a child's not, you know, syncing with those trends, and we can do that by geography, by personality, etcetera. And so the online analytics, I think, will be quite revolutionary in schooling. Even, students are doing part time online schooling, the amount of insights they're gonna get from, you know, every hour they spend online compared to the physical world in which nothing is recorded or analyzable, will be quite profound. So that's a good example where technology gives you quite a big leg up in the online world.
00:41:25 · Jamie Beaton, Paul Spain
[00:41:25] S0: Yeah. And and think about this. When So you go through school, how much data do you actually know about, you know, your own high school performance? You do a test every so often, you do some exams, but you sit in hours and hours of classes, and you don't know, you know, how you're engaging, how you're participating, what that looks like compared to other successful students. In the online schooling world or the online tutoring world, you know, we have all of these datasets of high achieving kids and, you know, what their, you know, engagement metrics were like. And then we can see when a child's not, you know, syncing with those trends, and we can do that by geography, by personality, etcetera. And so the online analytics, I think, will be quite revolutionary in schooling. Even, students are doing part time online schooling, the amount of insights they're gonna get from, you know, every hour they spend online compared to the physical world in which nothing is recorded or analyzable, will be quite profound. So that's a good example where technology gives you quite a big leg up in the online world. [00:42:12] S1: And what do you do in terms of measuring your customer satisfaction? Yep. You have measuring how parents are feeling about things, how students are feeling. What does that picture look like? And then how do you utilize that information?
00:42:27 · Jamie Beaton
[00:42:27] S0: Yeah. It's it's a really good question. So there's broadly two types of metrics. One is satisfaction. One is outcomes. Now one of our values at Crimson is student outcome obsessed, which basically speaks to the fact that ultimately, you know, you can make a child happy by giving them a doughnut, but what really, you know, matters is, you know, how the outcome's improving. And we strive to, you know, within a safe environment where they've got mentors, they've got mental health support, etcetera. But we we don't wanna make things easy because these are formative years where you wanna be growing academically. Sure. So a couple of metrics. First of all, Net Promoter Score, you know, easy one. So students and parents regularly, various key check ins through these NPS surveys, and they give us a sense of, you know, how the how the family is feeling. And there's benchmarks across the education industry within our particular subsector of the industry and the, you know, the broader satisfaction scores. That's one. Then there's the, you know, microfeedback after every lesson, which is kinda like the uber star rating, you know, one to five. And then that's often quite binary data with lots of fives and occasionally some zeros. And then that that is really useful data to collect and analyze as well. Then there are extra layers of data we look at. For example, if if you're my tutor and I'm your student, how regularly I book with you if I... If it's at my discretion is a really good indicator for engagement. Right? So those types of metrics. So that's some of the satisfaction metrics. Then on the outcomes, we do pretest diagnostics when people come on board around what schools we think they can get into based on their current stats, and also how they're currently looking in, for example, math and English. Then we can look at the, you know, the final outcomes. What do they get into? What schools do they get into? How did that sync to their, you know, potential when they first started? And then what value add is Crimson added, which I guess we call the alpha, which is a term from finance. So we look at those metrics at an individual per capita level, and then we look at this as an aggregate.
00:44:05 · Jamie Beaton, Paul Spain
So we've got company goals like how many students get into, you know, top x university, and then what percentage of kids get into one of their overall schools, things like that. And then, for example, within our school, we've got specific targets for, you what percentage of kids get certain grades, a a star, etcetera, what's their baseline improvement rates, things like this. So we're taking quite a systematic approach to this, which you don't really see in traditional schooling that much. [00:44:27] S1: Yeah. And then once you've got that data, how do you act on it? Right? You're looking in these, you know, whatever it might be, too many lower scores in one area or another, or, you know, do you track that back to the individual, you know, tutors and so on that are involved, and then, you know, that that plays out in in terms of, you know, the You bet. Yeah. Role within Crimson? How does