Pretraining biases

From Simia
Revision as of 09:14, 26 February 2026 by Denny (talk | contribs) (Created page with "{{pubdate|{{subst:CURRENTDAY}}|{{subst:CURRENTMONTHNAME}}|{{subst:CURRENTYEAR}}}} "A rose by any other name would smell as sweet" -- not in a world of LLMs, though, because w...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

"A rose by any other name would smell as sweet" -- not in a world of LLMs, though, because whenever you fine tune the LLM to your task, you have to always consider what it has already learned in the initial pre-training.

Simia

Previous entry:
Robert Kaye
Next entry:
None