00:00:00 · Brett Caughran, Matt Stockton, Khe Hy
[00:00:00] S0: Trying something that you think is impossible for AI to do and it actually does it. [00:00:05] S1: And basically that's when you're building these tools or designing these systems. It's kind of figuring out the right mix of how you structure your data and how you kind of tie these tools or these agents into that data so that they can kind of find [00:00:16] S2: what they need. You're working on a model on one laptop with, you know, the plug in. You go home to your other laptop, you forgot to sync it. Then you're like SOL. [00:00:32] S0: All right, welcome to the next episode of Invest with AI, where we explore the intersection of fundamental investing and artificial intelligence. I'm really excited to have Matt Stockton here today. Twitter is a wonderful animal if you know how to use it well. There's a lot of noise. The noise to signal ratio is incredibly high, but it's a wonderful place to find smart people sharing smart things about AI. Matt is one of those accounts that I've followed religiously. He's been working a lot on the deployment of AI into firms. And so we thought it'd be great to have him here today and talk about some of the things he's working on, some of the challenges he's facing and where we're at in deployment of AI. So sort of my mind, view Matt as a little bit of a one man FDE shop. FDE is the hottest thing going right now in AI. So Matt, thanks for thanks for being with us. Maybe start with just a little bit of your background and what you're working on.
00:01:29 · Matt Stockton
[00:01:29] S1: Yeah, sure. No, I'm glad to be here. Thanks for inviting me on. Yeah, so I'm Matt Stockton. I've been building software professionally for about twenty years now. And for the last decade, mostly focused in kind of classical data infrastructure, machine learning, you know, building trained models, things like that, operating them. And then, you know, a couple years back when large language models kind of started hitting the scene, I got just kind of really deep into them and really wanted to understand how that that world connected to to classical data stuff. And so it just went deep, and, you know, that kind of turned into me helping companies implement tools or capabilities using these large language models. In my background, I've spent most of my time bouncing between hedge funds and kind of VC backed tech startups in the FinTech space.
00:02:23 · Khe Hy
[00:02:23] S2: Thank you, Matt. And definitely, Matt is one of those accounts where every time I read a tweet from his, my IQ goes up a little bit. You know, what I'm also noticing on this conversation is that the three of us have had the luxury of stepping away from a full time job to explore this. And it's something that I definitely, I know none of us take for granted because imagine trying to keep up with this fire hose of information if you're working fourteen hours on a trading desk. Right? So, Matt, I wanted to start off. You and I have been chatting a bunch about this kind of the latest struggle that I've seen with my training and consulting clients, which I'm kind of loosely calling the challenge to transition from single player mode to multiplayer mode. And what I mean by that is it's funny, right? We spent the last decade, fifteen years, like getting everything into the cloud. Everything is shared. Everything is SaaS. And then now, you know, with the advent of co work and code at OpenCLaw, everything moves back onto the local machine, right? And so you have two laptops, you're working on a model on one laptop with, you know, the plug in. You go home to your other laptop, you forgot to sync it, then you're like SOL. And you know, this idea that, you know, everyone's kind of taking context that they need for their individual contributor task, you know, copying it onto their local machine, running their analysis, and pushing their information back into the shared drive, like, that doesn't feel like a scalable way of sharing knowledge, of using AI. And so you and I have been talking a bunch about, for lack of a better term, a company resource brain, right? How do you take institutional knowledge that both in structure, you know, structured data, unstructured data, there's a lot of it over ten, fifteen, twenty years. It's in people's email boxes and people want to just talk to it from co work or code or codex. How should we be thinking about this exercise? Yeah. Yeah.
00:04:33 · Matt Stockton
[00:04:33] S1: No, it's an interesting question, and I think you're right in terms of, like, taking this from single player mode to multiplayer mode. There's a lot of benefits, I think, even from teams kind of sharing their workflows. Like if someone discovers a workflow that's working with these tools, like having a way to share that. But you're right, ultimately, it kind of all traces back to the data, like where is the data living? How are you storing it? How are you capturing it in your workflows? And, know, lots of the smaller firms, like they don't really have rigid or robust processes to do this. And so sometimes you're coming in and you're looking at it and you kind of have to figure out, okay, we have this historical way of storing information. How do we structure that in a way so that we can get utility or value out of these models? And I guess the way that I kind of think about it initially is, like, you definitely don't want to boil the ocean when you're coming in and trying to solve this problem. Like, I like to take a very much like a job to be done approach. Okay, let's try to break down what you're trying to do as a firm or as a company. Let's name those workflows. And then take one or two of them and try to systematize it, try to operationalize it, try to figure out, Hey, is the data not landing in a shared spot? How can we make that happen? Hey, is that data not connected to our tools? How can we make that happen? So I like the concept of this digital brain and talking to your data and all that stuff. But you kind of have to tease apart, you know, what are the sources of information you care about? Are you actually capturing those in your workflows? And, know, just try to make incremental progress, right? And then I think another big thing here is kind of have to have everyone on board, right? You have to have the team on board if the way of doing things to get value out of these tools requires you to capture some new data or something like that. You got to have to, you got to get people aligned on that process change.
00:06:26 · Khe Hy
[00:06:26] S2: Do you think that, you know, there's a big push, especially in like the power user community, AI community of, you know, really good folder structures with markdown files, with metadata, with indices, kind of bypassing bypassing the very kind of heavily structured, you know, relational databases. Do you think that that works you know, that works well for an individual contributor, but does the folder structure with, you know, good markdown files and tagging, does that, can that expand beyond, you know, a small group of individuals?
00:07:04 · Matt Stockton
[00:07:04] S1: Yeah, yeah. It's an interesting topic. And basically, like, just kind of drilling out a level, right, when we talk about these models, know, they obviously have to have access to data. And the models, it turns out they're really good at exploring folder structures, like using the tools that are kind of baked into them to open folders and look through things and search files. And that's actually really it's really useful for kind of unstructured data. You know, you think about creating some taxonomy where you're organizing your data by company or by theme or something like that, and have these tools be able to search that. That's super useful. I think there's definitely still a spot for structured relational data. Like you still need databases and data warehouses, especially for, you know, the numbers. So it's kind of a mix, right? And basically, that's when you're building these tools or designing these systems, it's kind of figuring out the right mix of how structure your data and how you kind of tie these tools or these agents into that data so that they can kind of find what they need.