That was a super interesting quote by Karparthy that an LLM is basically always dreaming an output and when we like it we call it useful and creative and when we don’t call call it a hallucination
I think of it like this: we're looking through a tunnel at the world on the other side. This world is incredible, and we can see where the tunnel leads. Unfortunately, we can't see how long this tunnel is. It's longer than it seems to most folks who see this sort of wizardry.
Still, it's kind of amazing that we can see where this is going. We just shouldn't expect it to be ready for prime time any time soon, and maybe that's good: we can plan for the inevitable better.
That was a super interesting quote by Karparthy that an LLM is basically always dreaming an output and when we like it we call it useful and creative and when we don’t call call it a hallucination
I think of it like this: we're looking through a tunnel at the world on the other side. This world is incredible, and we can see where the tunnel leads. Unfortunately, we can't see how long this tunnel is. It's longer than it seems to most folks who see this sort of wizardry.
Still, it's kind of amazing that we can see where this is going. We just shouldn't expect it to be ready for prime time any time soon, and maybe that's good: we can plan for the inevitable better.