arXiv NLP
techCenter
Lngram v2: Latent N-Gram Memory with Interpretable Discrete Representationstranslating…
arXiv:2609.03426v1 Announce Type: new
Abstract: Transformers lack a native lookup mechanism, requiring repeated dense computation to recognize and reuse local static patterns. Lngram v1 introduces tokenizer-independent conditional memory through discrete latent n-gram…
Keywords#Latent N-Gram#Discrete#Lngram#Memory#Discrete Representations
Comments
Sign in to join the discussion.
Loading comments…