Tech Deciphered podcast

57 – Are we in a Generative AI Bubble?

0:00
NaN:NaN:NaN
Manda indietro di 15 secondi
Manda avanti di 15 secondi
Did we go from a broad bubble to a gen AI bubble? What is the current state of AI and generative AI? What has been commoditized and what is still distinctive? What does the future hold?Navigation:Intro (01:34)The State of AI / gen AIOn the negative sideOn the positive sideOur takeConclusionOur co-hosts:Bertrand Schmitt, Entrepreneur in Residence at Red River West, co-founder of App Annie / Data.ai, business angel, advisor to startups and VC funds, @bschmittNuno Goncalves Pedro, Investor, Managing Partner, Founder at Chamaeleon, @ngpedroOur show: Tech DECIPHERED brings you the Entrepreneur and Investor views on Big Tech, VC and Start-up news, opinion pieces and research. We decipher their meaning, and add inside knowledge and context. Being nerds, we also discuss the latest gadgets and pop culture news Subscribe To Our Podcast Bertrand SchmittWelcome to Tech Deciphered, episode 57. This episode will be about generative AI, and we will be asking the question, "Are we in a generative AI bubble?"Bertrand SchmittIn our last episode, we talked about AI, what was the latest happening in terms of endpoints, PCs, Macs, iPhones, and is it a risk? Is it a benefit? Today, we'll talk about what's happening with GenAI. Is it overhyped? Is it too much investment? On the plus side, we'll be wondering, okay, maybe it's not a bubble after all, or even if it's one, is it such an issue because basically is it laying the foundation for a new stage, a new scale of AI for an act two of generative AI. Good to talk to you today, Nuno.Nuno Goncalves PedroNice to talk to you as well, Bertrand. I'll start with my answer. It is a bubble and it isn't. I'll come back to that. I'll leave you guys on that cliffhanger. Let's start maybe a little bit with where we are in the state of AI and GenAI. Are we at commodity level or not? Adoption levels that we're seeing in the market. Interesting report from McKinsey. Some around the state of AI, they did over 1,300 interviews. It was really a survey format around AI and GenAI adoption.Nuno Goncalves PedroSome, like the conclusions, increased adoption of AI in at least one business function. Over the last year, this dramatic increase. I'm not really sure. Everyone that said, yes, we're using it is actually using it. I take that with a grain of salt. This is self-reported, again, and so everyone has to be using GenAI, but everyone's aware of it. I'm sure there's an increase in adoption for sure.Nuno Goncalves PedroThe second piece that I feel is a little bit more exciting is what are the functional areas of companies that are using AI and generative AI more actively? Maybe not super mega surprising marketing and sales, which is core to some companies, but relatively support function. A little bit surprising to me that people are seeing product in our service development as number two. Surprising to me that software engineering is so low. Again, maybe no software engineer has actually filled in anything around that. That's why it's so low or middle of the board, or they don't know what their engineers are doing, really, which is also interesting.Nuno Goncalves PedroThen very low on strategy and corporate finance were business analysis, triangulation of data, or using ChatGPT, et cetera, I would have taken a little bit for granted that people would be using it. A bit surprising on that. Just feel it's an interesting... Again, self-reported, it's a survey. Some interesting conclusions on both sides in terms of the functions, et cetera. Some the conclusions as well on the rapid ascendancy of generative AI.Bertrand SchmittYeah, for me, what I'm quite impressed, I must say, is how fast generative AI has picked up. I don't think I remember any new technologies that move so fast in terms of adoption, because here we are already talking about adoption metrics. I mean, it moved from nowhere in 2022, 33% in 2023, 65% in 2024. Basically, as high as the adoption of AI, the general AI adoption took seven years to get there.Bertrand SchmittHere it's two years. I'm not sure I remember any technologies that move so fast in terms of adoption. It took years and years for smartphone to get there. It took 5, 10 years for cloud computing to get there. It's really fast, I must say for me, is my first reaction.Bertrand SchmittIn terms of function, marketing, I'm not surprised. That's where you can use generative AI to generate content relatively easily. It's not mission-critical content, it's content you can review. At the same time, it can give you some clear benefits in terms of moving pretty fast and needing less resources. I guess for some other function like software engineering, I think right now, I guess the biggest issue is that you cannot trust it. It's not something that you are ready to deploy in production so quickly, very different from content for marketing.Nuno Goncalves PedroMaybe perhaps a little bit more interesting is the article from Tomasz Tunguz from Redpoint. I hope he's still at Redpoint, and I didn't say anything wrong.Bertrand SchmittI'm not sure, actually.Nuno Goncalves PedroAround the evolution. He was at Redpoint.Bertrand SchmittHe was.Nuno Goncalves PedroAround the evolution of AI and this notion that it might be following the sigmoid logic, so log scale sometimes. Then sometimes exponential in terms of curves, so the exponential improvement and then log curve, which is flattening out for those who are not familiar with log curves. I would even say maybe it then looks a little bit linear, because if it's exponential and then log, then it's basically it looks a little bit linear. A little bit of argumentation around, are we going for the next S-curve? Are we going for the next log curve? Where are we on development? I think our intuition is probably telling us that there's more stuff to come still on this technology stack.Nuno Goncalves PedroAlthough this technology stack, as we know, the whole use of transformers to get us to where we got to buy OpenAI and all the other players is definitely, according to everyone that I talk to, not what's going to take us to AGI. It's definitely not what is going to take us to the big innovations, the big next themes and the next levels.Bertrand SchmittI really like the way OpenAI has categorized the different level of AI similar to self-driving cars. As a reminder, level one was a chatbot layer, robots that can chat with you. You could argue, interestingly enough, this level one is what used to be actually considered something very hard and the proof we have made AGI, I guess everyone now realize that Turing test is absolutely not enough.Bertrand SchmittLevel two: reasoners, robots that use logic to solve problems. Level three: agents, robots that act independently of humans. Level four: innovators, robots that create new ideas independently. Level five: organizations, robots that replicate the work of AI.Bertrand SchmittAt this stage, where are we? OpenAI say it's close to move from level one to level two. We will see. As you say, I tend to agree that at this stage, I feel that we are getting some plateau. Just to be clear, things keep improving. Don't get me wrong, there are very clear metrics that we improve stuff, but it feels more an improvement through brute force. Let's move from that many terabytes of data to 10X that terabytes of data. As a source, let's move from 1,000 GPUs to 10,000 GPUs.Bertrand SchmittYes, of course, you are improving stuff and the magic things with the current foundational models is that they scale very well with more data as long as quality stays good, and they scale very well with more GPUs. I guess the only issue at this stage is that it doesn't feel that there will be quantum leaps with this technology in terms of moving to level two, level three, without any separate breakthrough.Nuno Goncalves PedroYes. We know OpenAI is using other methods and other technology pieces into their technology stack beyond transformers, et cetera. It's already very apparent that they are. But still, the analogy of this with the self-driving car levels, which if you remember, is also level one through level five. Magically enough, it's very similar.Nuno Goncalves PedroFor those who are unaware, probably today, the best case scenarios that we see out there is like a level three. Some cars don't even have beyond level two. It's like they're telling you, there's a car on your lane or whatever, that's nothing. A little bit like the Tesla experience today is on the level three thing.Nuno Goncalves PedroWe're very far from level five. I'm sure, Bertrand, you've had similar stories. We've been promised self-driving cars for a long. I remember from my perspective, the penny dropped when I looked very heavily into the space, spent over a year looking at companies that were deeply embedded in the architecture of self-driving. Then at some point in time, I ended up spending time in this specific space with just simulation. The area where you simulate behaviour of cars to get those driving miles, but there are actually no cars on roads. It's actually a simulation.Nuno Goncalves PedroThe first thing is, 80% of the players I said was just BS. It looked like gaming simulations using Unreal, and there was no factoids to it. There was no physics to it. There was nothing that they were really testing. Then you got to the other 20%, and you realized these guys are a little bit more legit. Then you realize, well, there's things that they're not simulating, for example, like rain and snow, and what happens if there's ice on the road? At some point you're like, "But that's pretty critical, right?'Nuno Goncalves PedroThat's when you realize I spent probably a lot of time around this, 2016, 2017, when you were like, "Oh, my God, this is going to happen." You're like, "No, not anytime soon." Again, this promise that we're going to achieve AGI with a stack right now, I feel is totally overblown....

Altri episodi di "Tech Deciphered"