#long-context
3 briefs tagged #long-context.
Research
Researchers target sparse attention for long-context AI
New papers propose sparse-attention and neural-memory methods to cut long-context inference costs.
arXiv cs.CL+1 outlet·3h ago
Research
Alaya-EVOKE targets persistent interactive world models
The paper proposes external world-state memory and long-horizon supervision for interactive generation.
HF Daily Papers·Aug 13
Research
Motif 3 report details 314B-parameter MoE model
The technical report describes a sparse decoder-only model with 13.2B active parameters per token.
HF Daily Papers+1 outlet·Aug 10