LensVLM: Compressing long context as images, expanding only relevant pages
by victormustar on 9/23/2026, 6:36:29 PM
https://huggingface.co/apple/LensVLM-9B
Comments
by: taylorfinley
Oh My Pi has done this for a while now, they call it Snap compact.
9/23/2026, 11:30:45 PM
by: rao-v
I really like this approach! I sort of think of the vision encoder here as an expensive high fidelity RAG encoder.<p>The thing I’d love to do with a system like this is train it to be KV cache ordering independent (ie permutation invariant at the page level). Basically each page’s KV cache should be understandable by the model in any ordering - which would allow you to go one step further and treat the KV cache of the vision encoded page as the <i>chunk</i> for the model to reason over.<p>Then all these zoom in for more detail tricks will extend naturally.
9/23/2026, 10:05:35 PM
by: lathoa
Interesting approach. thanks
9/23/2026, 10:09:30 PM