absolutely buzzzzzzing about the doc-to-lora stuff here. sakana use a hypernetwork to adapt an LLM to doc-specific knowledge in a single forward pass 🤯
We are excited to introduce Doc-to-LoRA and Text-to-LoRA, two related papers exploring how to make LLM customization faster. By training a hypernetwork to generate LoRA adapters on the fly, models instantly internalize new info. Blog: pub.sakana.ai/doc-to-lora/ Doc-to-LoRA: arxiv.org/abs/2602.15902
0 reposts0 likes