Second in Command: The Chief Behind the Chief with Cameron Herold
00:27:28 · Victoria Weller
[00:27:28] S2: Yeah, I do think that OpenAI has like a was a pioneer in creating that fundamental shift or creating that that mind blowing moment for people first interacting with ChatGPT and understanding like AI is here to change the world. But then I think from the text space where ChatGPT operates to the visual space where DALL-E or Midjourney operate and then the voice space where ElevenLabs is dominating at the moment. And I think the people to your question of who should be using it, I think there's also almost no limit to this. The immediate thought is content creators. So for example, you with podcasts or audio books, but also with shorter narration of videos or shorts, even like the voiceovers for any length length of video, movie or film can be done with ElevenLabs. But then you can continue thinking about it. And if you have awareness just going through your day, you can see almost infinite use cases for text to speech. One of the most unique ones I found within our customer base is a hospital that uses ElevenLabs to read out before a surgery, all the possible side effects and consequences and everything that has to be read out to the patient before the surgery. And for that, also you understand why you wouldn't want it to be too robotic. And maybe even a doctor that reads this has to like rush through it and is too robotic. So a really good use case for that, but not one that I would have thought of in a dark room coming up with use cases. But one that I'm also really excited about is for accessibility. So we found that on the B2C side, there are many users that use ElevenLabs for text to speech, be it because they can they're visually impaired and they have a hard time reading. And it's so much nicer to have a human voice reading things to you rather than a robotic one, especially if you spend the majority of your day with text readers, etc. Or people that have lost their voice as a result of throat cancer or similar and or have trouble like with stutters or finishing their sentences. There's so many physical things that can impede your speech that where ElevenLabs unlocks the option to speak again and even to speak again in your original voice. For those that have changed their voice over the course of time, they can have their old voices back or even their voice back period. So I think in the accessibility space, it's also super exciting.
00:30:23 · Victoria Weller, Cameron Herold
That's on the B2C side. And we also serve to enterprise customers. And there it's another, you open a plethora box, think it's called, right? Pandora's box. When there's just there's so much in there, like from automotive to like that hospital use case to gaming studios, to production companies everywhere. The first moment I had with ElevenLabs was when I heard about it and then I took the bus home. And every station there's a voice that announces the next stop. And my mind just went to the operational costs of creating these recordings for me to know which bus stop is next. And then there's a diversion and suddenly the bus driver has to tell me what the next stop is. And somehow it's almost impossible to understand them. And so for me, was like, okay, transportation, huge use case, probably a smaller one if you look at our enterprise suite now. But even there, like in day to day life, there's so much text to speech that could be leveraged. [00:31:34] S1: So I just thought of a bizarre use case. My mom passed away twenty years ago and there's an email that she wrote me that I reread frequently and it would be wonderful to be able to hear it in her voice. That would be something that if we ever had her voice that could easily, find videos of her speaking, could train AI to be able to speak and then have her read the email to me of. [00:31:52] S2: Yeah. You know what, that is actually a use case that comes up a lot for for mothers, but also other family members. [00:32:00] S1: And we
00:32:00 · Cameron Herold, Victoria Weller
[00:32:00] S1: And we [00:32:00] S2: just implemented a workflow specifically for that, for the compliance parts of it. There are two ways on ElevenLabs to clone a voice. The first is instant voice cloning, where you upload thirty seconds of audio and then you get a voice clone and you can read any text out loud in the specific voice. And then there's professional voice cloning, which is a higher quality voice clone for which you need thirty minutes of input data. And because we want to ensure that the people cloning those voices have the rights to the voice, that it's their We have a voice capture as part of the flow. So you upload your samples, and then there's a flow in which you are confronted with a random sentence and you have to read it out loud. And then we manually go through to ensure that those voices are the same. And only if that proof exists, that it's your voice, can go through. We allow the model to train on the uploaded data. And if you wanted to do that for your mother, there would be no way to pass So that voice we've implemented a workaround where if you provide sufficient sufficient information to prove that you are like the next of kin or have permissions over your mother's voice, we allow to professionally train, professionally clone those voices as well.
00:33:27 · Cameron Herold
[00:33:27] S1: That's incredible. So one of the questions I had written down was around the legality of it and the prevention of the deepfake, you know, videos and audio. And one of the big scary... I don't think it's a meme. I think it is actually happening. Are these audio messages, like voice messages that someone is getting from their mom? You know, I'm in trouble. Don't call me. Don't email me. Send money to this number, or they're going to kill me. And it's a fake. It's literally a Yes. Like, how are we preventing those kinds of things from happening? Is that is that from the training?
00:34:04 · Victoria Weller, Cameron Herold
[00:34:04] S2: I think the the... There's so many aspects of this and definitely something also that's really important to think about and to continue thinking about as AI gets better in all the different facets that exist. And I think a huge component of this is education, being aware or creating that awareness in the public that AI can now be almost anywhere and to have a critical eye when being confronted with a piece of content. The first pieces of this, I think I remember when Photoshop was being used more and like you would see posters of photographs and you would think like, oh my god, these people are flawless. And then it'll be like, no, things are photoshopped. And I think the next shift of seeing or hearing content should be to think like, is this real or is this generated? So I think there's a huge educational component. But of course, a single company like it would be lazy to say the public just has to be aware and then we solve it. There are also safeguards that we can roll out as part of developing the tech. And I think every AI company that is innovating at the moment has an ethical responsibility to develop safeguards. [00:35:22] S1: Is that around like watermarks, like the kind of watermarks?
00:35:22 · Cameron Herold, Victoria Weller
[00:35:22] S1: Is that around like watermarks, like the kind of watermarks? [00:35:26] S2: For example, watermarks. We have, as an example, what I just mentioned with the voice captures implemented that. But we also have a service called AI speech classifier where you can upload an audio snippet and it will tell you whether it was generated with ElevenLabs. So if you were targeted and got a voice memo saying I'm in trouble, don't email me, don't text me, you could upload it to the AI voice classifier. You don't even need an ElevenLabs account for that. And then it will tell you with 90% certainty whether or not it was created more than 90%. I think it's like almost 100% certainty whether it was created with ElevenLabs or not. And that's a really handy tool to have for certainty around audio content. [00:36:21] S1: Is there a is there a person on your team who could do a twenty or thirty minute demo of... And q and a of what ElevenLabs could do? We have, you know, members from 17 countries in our COO Alliance. I would love to get them some exposure to what ElevenLabs is doing. Is there somebody that I can reach out to you later and get them to do a a demo via Zoom to our team of of [00:36:42] S2: Yeah. [00:36:42] S1: Of, you know, three to five b to c, a few b to b, etcetera use cases? [00:36:48] S2: Yeah, for sure. I think I wouldn't even be able able to do that. [00:36:53] S1: That would be amazing. [00:36:54] S2: Put you in touch with someone from the revenue team that is closer to the enterprise customers.