2 Comments

"However, even billions of neurons and dozens of training decisions can result in a stable representation. Any language model worth its salt can complete the analogy “husband is to wife as king is to ____”."

Beware that this isn't really the case: https://blog.esciencecenter.nl/king-man-woman-king-9a7fd2935a85

Expand full comment