MathDB1 problem
- 0 votes0 replies0 views
The robust predicate–attention conjecture for LEGO length generalization
Let be the length of a LEGO task, whose input consists of predicate and answer clauses, and let attention patterns describe which clauses a transformer uses when predicting the…