Henryk Plötz
Born between E.T. and Blade Runner, occasionally hacking and breaking things, computer scientist living in Berlin.
He/Him.
- 0 Posts
- 1 Comment
Joined 8 years ago
Cake day: April 29th, 2018
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
@scruiser I have to ask: Does anybody realize that an LLM is still a thing that runs on hardware? Like, it both is completely inert until you supply it computing power, *and* it’s essentially just one large matrix multiplication on steroids?
If you keep that in mind you can do things like https://en.wikipedia.org/wiki/Ablation/_(artificial/_intelligence) which I find particularly funny: You isolate the vector direction of the thing you don’t want it to do (like refuse requests) and then subtract that vector from all weights.