2 problems
- 0 votes0 replies0 views
Uniform asymptotic convergence of the softmax-attention gradient
Uniform gradient-limit conjecture. Under suitable assumptions on , as the mapping converges uniformly on to
- 0 votes0 replies0 views
Uniform convergence of the differential for softmax attention
Softmax differential convergence conjecture. The differential of the softmax-attention mapping converges uniformly to the differential of the hardmax-attention mapping as the scale…