Announcement_17
Our paper RaReCache is now on arXiv! We explore whether a large model can reuse a small model’s KV cache by rereading only the tokens that matter.
Our paper RaReCache is now on arXiv! We explore whether a large model can reuse a small model’s KV cache by rereading only the tokens that matter.