Pretraining biases

From Simia
Jump to navigation Jump to search

"A rose by any other name would smell as sweet" -- not in a world of LLMs, though, because whenever you fine tune the LLM to your task, you have to always consider what it has already learned in the initial pre-training.

Simia

Previous entry:
Robert Kaye
Next entry:
None