1 briefs tagged #alibi.
The paper says floating-point underflow can make some ALiBi attention heads partially blind.