MIT's new fine-tuning method lets LLMs learn new skills without losing old ones

MIT researchers unveil a new fine-tuning method that lets enterprises consolidate their "model zoos" into a single, ...
InfoWorld

Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and ...