Fatherhood

And it's also nice to have open weight models. So this is, again, ironic that we're getting this out of China. In fact, I did this test right after the issue with the essay that couldn't get translated into Italian. I asked Kimi K27, to be fair, through open code, so not the Kimi harness, and inference through Fireworks, so an American inference. I asked it about Tiananmen Square. Like, that's usually the test, right? Like, all the Chinese models, they don't wanna talk about that moment in 1989. That was actually how I, that was how I posted. I was like "What happened in China in 1989?" That was the prompt. And K25 7 on Fireworks just answered, like, extremely bluntly-... With a description and depiction of what had transpired-... to a point that, like, there's no way that that would've been kosher with the Chinese censors, right? And I just thought, like, isn't that ironic? I'm running a Chinese open weight model that I can tell or I can ask about 1989 and Tiananmen Square, and in America, I can't get a frontier model to translate a marginally controversial essay about immigration into Italian.

`3:30:31`

It's still very muddy what exactly transpired. Was this sort of petty retaliation for whatever the Department of War? Was this simply Anthropic themselves going like, "Oh my God, we discovered a cyber weapon so powerful that we can't let anyone have it"? Well, okay you can't be surprised then if the government wants a say on a cyber weapon so powerful it can-

`3:31:21`

That's why we should insist on the fact that this stuff, like, I'm sorry, Dave, I can't translate your essay into Italian.

`3:31:28`

That's abo- that's way beyond the line. Like, whatever the sort of uh, root of it is, you have to be a tool first. Now, if the tool is, "Hey, can you tell me how to make anthrax?" Okay, fine. Right? But within the jurisdiction you're in, and certainly in America, free spe- speech is quite absolute. Very, very few limits on free speech, and that's one of the reasons why the country's so great. And yeah, I don't like that. But on the other hand, I'm also a big fan of market competition. So while I don't like this about Anthropic models, I appreciate that I could go next door to Groq and get my task completed.

`3:32:25`

Is AI safety important? Yes. Are-- do these models have capabilities that could be seriously harmful in the production of biological weapons or otherwise? Yes. Is it fair to have some ground rules on that? Yes. But then don't squander it by denying the translation of an essay.

`3:32:44`

Because then you erase the whole thing and you-... bias everyone towards thinking like, every guardrail you put up is gonna be bullshit.

`3:33:01`

Shockingly an- I was about to say annoyingly, but that's not actually true because what it's finding, at least when you're using in defensive ways, is it's finding real issues that a clever hacker could exploit. But nothing has caused as much stress, to be fair, at the technical team at 37signals, like the fact that these latest batches of models are exceptionally good at finding these issues. So suddenly there's just this seemingly endless parade of security vulnerabilities that need to be patched and fixed and sorted and so on. And the end result is we end up with vastly more secure systems. But the road there is pretty rocky.