• 1 Post
  • 1.13K Comments
Joined 3 years ago
cake
Cake day: March 22nd, 2024

help-circle


  • As someone who isn’t totally uninterested in animal welfare the shrimp argument always makes me generally grumpy. Like, I’ll grant that it’s better to use a stunner than to not and that it’s probably a good use of $15, but the whole problem with EAs is that they have significantly more than $15 at their disposal. Like, if you just do the naive multiplication you’ll end up missing out on two things. On the one side opportunities that require a lot more than $15 to have a positive impact that are going otherwise underserved. On the other, more important side, their emphasis on economic efficiency leaves them blind to the completely avoidable harms that are inflicted in the accumulation of that much money. That’s how grifters like SBF work their way in, and why the whole enterprise seems to be earning a reputation as a way to make tech billionaires feel better about themselves rather than actually making the world a better place.





  • I imagine that it’s the same thing that programmers have been dealing with. Basically everyone I’ve talked to has acknowledged that code reviews are important parts of the software development process, but nobody has ever said they like them. Now here comes the glorious LLM future where in order to maximize productivity you get to do nothing but code reviews forever, only worse because the answer to “what were they thinking when they wrote this” is always “lmao fuk u”. Even ignoring what kind of consequence that kind of change would have on the actual progress of the field of mathematics, it also just makes being a mathematician into a different kind of day-to-day job, and one that most people who are currently in the field would likely find far less satisfying. And unlike the programmers they’re not even paid some absurd amount of money for it [citation needed].



  • And they will say things like the writer of this piece who says ‘we know how they work.’ We don’t, actually.

    Okay, but we really actually do. There’s nothing magic about the kind of statistical brute force that these things operate on. The training stage breaks down and identifies patterns in the source data, and the operational model uses those patterns to “predict” what a person would say next. The patterns that these things identify are incredibly complex and can’t be easily traced or understood in practical terms, but fundamentally these are still stochastic parrots.

    Especially if you want to go into the Christian context, no church is going to ascribe the ineffable miracle of life to a multiplication of matrices, no matter how many dimensions they have in the math.










  • Joyless and also bloodless. Like, there is plenty to criticize about the “I guess I got isekai’d to Gor and now I’ve got a sexy slave harem” premise. But somehow he still manages to write with barely any actual empathy for the victims of that system, foregrounds how hard it is for our hero to bravely abstain from that sweet wolf sex and how maybe it’s not even the right thing to do, and then after confronting the horrifying realities for all of one scene proceeds to write the character out of the story without even giving her a fucking name in the text. Like, he somehow wrote a story about rescuing sex slaves that feels more pro-sex-slavery than a story that just embraces the sleaze of it.



  • It might be wishful thinking, but it would also answer the question: why now? It’s not like the concerns are meaningfully different now compared to when the bubble started. If they were so convinced that the AI future was both inevitable and possibly catastrophic, they could have followed Yud into the “research foundation” game rather than accelerating the timeline. I guess they’re probably more convinced than I am that the latest round of security breaches are actually a sign of new capabilities in the models, but it still feels really convenient. Frontier model advancements have been slowing down and costs have been accelerating exponentially, and now they’re taking the line that they’re choosing to slow progress and spend less money on arguably their biggest cost center.