1 problem
- 0 votes0 replies0 views
Small-tail extrapolation conjecture for top-1 retrieval
Let be the vocabulary size and the embedding dimension, with . Top-1 retrieval requires the memory load to lie below the critical threshold obtained b…
Small-tail extrapolation conjecture for top-1 retrieval
Let be the vocabulary size and the embedding dimension, with . Top-1 retrieval requires the memory load to lie below the critical threshold obtained b…