Future of programming

So we should also have the humility. As amazing as the LLMs are now, it could be that they eventually plateau. We haven't seen any evidence of it yet, and I think this is also why we're seeing this absolute gobsmacking levels of investment, because so far the scaling laws are true, and the more billions are poured in, the more intelligence comes out.

`4:09:48`

I find that the cynic approach to this is the meme, where you see the guy in front of the computer who's like, um, "Whatever. Are you gonna destroy the world?" And then the computer says, "I'm gonna destroy the world." And then the guy says, "Oh," right? Like, this is so cynical that they're just aping us. They're just telling us what was in the training data or whatever. When I interact with the agents, I was just doing this yesterday, or this morning, I was working on this, AmaBot system, right? And it's doing this coordination with multiple workers, and I had multiple agents running at the same time. And at one point, the main agent who's doing the coordination steps on the toe of another agent and-... kind of ruins their work. Its ability to convey regret and being sorry was uncanny. Again, I don't know, is that a real projection of true remorse? But I don't know. With most humans-... they express some level of regret. Is that true remorse? Hard to tell, but maybe it also just doesn't matter.

`4:11:26`

There totally is that. I see it all the time in, in the traces where it just reasons wrong, right? It went down one alley and then it realizes that was a blind alley and it's gotta go back, and so they're like, "Oh yeah, I got this wrong," and then it'll provide the reasons for why it think it got these things wrong. And you're like, this is uncannily human-like. This is indistinguishable from the kind of consciousness you would recognize in a human. Again, does that mean that it truly is or isn't? I don't need the answer to that question actually to be able to appreciate what we have in this moment.

`4:13:04`

I think where it's gonna be harder is once we put these systems into-

`4:13:08`

Yes. Humanoid robots. Which just happens to be the plot of every sci-fi movie ever, which is also an amazing premonition, not only the Terminator movies and Skynet and that going wrong, but then also just Blade Runner, right? Insertion dates, expiration times, Tyrell Corporation.

`4:13:49`

I set up OpenClaw when it first came out, and that was my KEF bot-... that I-... this was like in February, I think. I was really just enamored by the fact that this was how it worked, and then the new communication model of just texting your agent seemed really great. So at the time, we were looking at MCP, this protocol for making it easier for agents to talk to your system, and I found the protocol to be unreasonably cumbersome, just not very elegantly designed because in part it wasn't designed for what we were trying to make it do. We were trying to-- I was trying to make it talk to a web system, and it was designed for stateful interactions of other kinds on local machines, and therefore it required all sorts of cumbersome setup and dance and, and I was just like, "I don't wanna write this by hand." Now, of course, today I would never write it by hand, but at the time I was thinking, "I have to write this by hand. I don't wanna write it by hand. So what's a different way? Could the agents just use the web interfaces we already have?" And I set it off on a trial to have it sign up for Fizzy, which was the product we had just released at the time. And it goes to the Fizzy site and, and starts filling it out, and then it goes like, "Hey, I don't have an email address. Signing up for this service requires an email address." And the first thing I thought, like, "Oh man, now I gotta set up an email address." And then I thought, "No, you set up an email address.