Financial Modeler's Corner
00:22:23 · Giles Male, Peter Fuller, Ian Schnoor, Paul Barnhurst
[00:22:23] S4: And Because you... Because your users can choose between them. [00:22:27] S1: So easy. I mean, it would be so... Let's say, Ilya releases this, like, fantastic model, which is just very different from from Anthropic models. And then I... You know, customers would be able to use Tracelight, and we would use both the models for different tasks. Right? And so the value of orchestration would grow. But people have been thinking that for a long time and it hasn't happened and it might not happen. Right? It might just be scaling all the way. I don't know. [00:22:55] S4: And just to delve on that, because the way you just used the word orchestration, I'd never thought of. Because to me, I was thinking sort of within, I don't know, like a cloud environment, you have a sub agent team of agents. But you're actually talking about the orchestration of potentially the use of different LLMs [00:23:15] S3: We already know. [00:23:15] S4: Within this... Yeah. Okay. Oh, wow. Okay. [00:23:17] S2: Well, think about... If I can say one thing, I think, Giles, when you think about it, you're selecting which model to use within an LLM. They're just selecting which model to use of all LLMs. [00:23:30] S4: But but but but also by the sounds of it, but this is what the... I wanna just make sure I understand. Orchestration for me would be like within a a a a workflow, you're actually delving within different LLMs from different providers within a workflow.
00:23:30 · Giles Male, Peter Fuller
[00:23:30] S4: But but but but also by the sounds of it, but this is what the... I wanna just make sure I understand. Orchestration for me would be like within a a a a workflow, you're actually delving within different LLMs from different providers within a workflow. [00:23:44] S1: Yeah. So for example, if you upload 500 pages of PDFs into Tracelight and say, here's contracts, read contracts, transcribe, and build a model. Right? It would be Gemini reading the... Reading those PDFs, and then it would be today, Claude, doing the modeling for you. Right? So it already happens in our in our product. And, you know, on our kind of pro tier as well and our max tier, you can choose between using the kind of frontier intelligence. Right? Or we have efficient mode as well where we'll use, yeah, like a smaller cheaper model. Right? But people get way more usage out of their out of their subscription. And today, those are from different providers. [00:24:36] S4: Do you have a strong view on... And again, this has come up in a couple of places recently. Do you have a strong view on, you know, choosing the most powerful model out there at the moment versus having a really strong harness and set up, however that is kind of implemented. Do you get a sense of like what is better if that's fair?
00:24:36 · Giles Male, Peter Fuller
[00:24:36] S4: Do you have a strong view on... And again, this has come up in a couple of places recently. Do you have a strong view on, you know, choosing the most powerful model out there at the moment versus having a really strong harness and set up, however that is kind of implemented. Do you get a sense of like what is better if that's fair? [00:24:59] S1: I mean, I don't think we've yet reached the, like, the point where the tasks where you care about are saturated by the behind the frontier models. Right? So, I mean, if you are building a big complicated spreadsheet, you definitely do wanna be using Opus five or 5.6. Right? And, you know, I... We will get to a point, I think, where the saturation will occur, and it it'll probably happen quite fast. Right? Uncomfortably fast. Where, like... Yeah. I mean, Opus five is really, really strong. And so when you've got when you've got Opus six or 6.5, I I don't know if it's worth spending all the money on the on the tokens to get six or 6.5 to write your your formulas. Right? You should be getting it to do something else. So... But we we haven't reached that point yet, in my opinion.
00:24:59 · Peter Fuller, Ian Schnoor
[00:24:59] S1: I mean, I don't think we've yet reached the, like, the point where the tasks where you care about are saturated by the behind the frontier models. Right? So, I mean, if you are building a big complicated spreadsheet, you definitely do wanna be using Opus five or 5.6. Right? And, you know, I... We will get to a point, I think, where the saturation will occur, and it it'll probably happen quite fast. Right? Uncomfortably fast. Where, like... Yeah. I mean, Opus five is really, really strong. And so when you've got when you've got Opus six or 6.5, I I don't know if it's worth spending all the money on the on the tokens to get six or 6.5 to write your your formulas. Right? You should be getting it to do something else. So... But we we haven't reached that point yet, in my opinion. [00:25:59] S3: I mean, listen. I love... I I can't even imagine waking up every day and wondering, is there gonna be an announcement that is just, like, you... Do you even sleep? Like, every hour, something can happen that might, you know, cause you to, you know, flip over or, or... You know, mean, like, it's just... I can't imagine being in a place where... That is changing so fast, but surely, you... I mean, you must be feeling you're doing the 100 meter sprint every day, and wondering what's the newest release. What's that like? Talk about what that's like wondering... Yeah. Obviously, anticipating any days a competitor or a a frontier model might release something that's different. What's the feeling like to be in that environment right now? I
00:25:59 · Ian Schnoor, Peter Fuller
[00:25:59] S3: I mean, listen. I love... I I can't even imagine waking up every day and wondering, is there gonna be an announcement that is just, like, you... Do you even sleep? Like, every hour, something can happen that might, you know, cause you to, you know, flip over or, or... You know, mean, like, it's just... I can't imagine being in a place where... That is changing so fast, but surely, you... I mean, you must be feeling you're doing the 100 meter sprint every day, and wondering what's the newest release. What's that like? Talk about what that's like wondering... Yeah. Obviously, anticipating any days a competitor or a a frontier model might release something that's different. What's the feeling like to be in that environment right now? I [00:26:43] S1: really look forward to the releases. I I like... I I don't know. I think you guys maybe imagine that I might be nervous about them or scared. I I'm [00:26:52] S3: nervous. I I I [00:26:54] S1: I really, really look forward to them because I know that if a really, really strong model comes out, I'm gonna... We're gonna click that model into into Tracelight and next day, we're gonna have really happy users. Right? So and so I feel really, really good about that. And, you know, we're we're at we're at a point now. We... We've signed a lot of kind of big enterprise enterprise customers. Right? And, yeah, and making those users happy and it is is... Yeah. Feels great.
00:27:25 · Ian Schnoor
[00:27:25] S3: So I love it. Listen. I love it. I think that's the right healthy mindset anyway. I mean, you... You'd be... You couldn't do it if you were just stressed and nervous and worried all day long. You can't... You... And that's not that's not gonna be... But, no, I I love that. It's, listen. Obviously, we are we are in the fastest changing, evolving segment of any market than anyone is. We we talk. We have conversations and talk about events as though they're, like, milestone events. They were, like, over a five or ten year duration as they would normally be in most industries, and yet they were talking weeks. Right? Well, remember remember way back in March when we thought this? Well, that was because it changed from February. Right? Like, it it is... We're we're all in the same year here still, and it's... We're excited about where where it goes. Do you wanna do you wanna talk... Can you tell us a little bit about... I mean, I know we're... We've been with you for a while. Can you tell us about what the what is the what is the... Well, can you talk about the future a little bit? Like, what is what is the future of Tracelight? What are you talking about? What are your short term dreams in the long term? Like, what... Can you talk to, you know, our audience about what does that look like?