Research indexJournal article
Implicitly learning token semantics
Tie
SPIRE - Sciences Po Institutional REpository1 Jan 2026Open access
NobleIDark:/48914/w1/20261006/3613F3B7DOI10.13140/rg.2.2.30432.34566/1
Journal articleOpen access
Implicitly learning token semantics
Tie · SPIRE - Sciences Po Institutional REpository · 2026
NobleIDark:/48914/w1/20261006/3613F3B7DOI10.13140/rg.2.2.30432.34566/1
Free to read at the publisher
You can read the abstract here, or the full text at the publisher.
Abstract
Roken, a fast implicit recurrent deep learning model of semantic attention is proposed for the purposes of large language model next-token and sequence-to-sequence learning.