Why we started Oblio Labs
Catastrophic forgetting is well studied for full-parameter training. We want to know how much of that work survives the move to LoRA.
announcement catastrophic-forgetting lora
Research
Experiments and results from our work on catastrophic forgetting in fine-tuned models.