2 problems
- 0 votes0 replies0 views
Small-tail extrapolation conjecture for top-1 retrieval
Let be the vocabulary size and the embedding dimension, with . Top-1 retrieval requires the memory load to lie below the critical threshold obtained b…
- 0 votes0 replies0 views
Conjecture that original and decoupled associative-memory problems have equal capacity
The original problem uses a fixed collection of output embeddings, whereas the decoupled problem resamples the output embeddings independently across retrieval constraints. Equal-c…