MRL Performance loss
#14
by psych0v0yager - opened
What is the expected performance loss for reducing the embedding output dim? What degredation should I expect going from 4096->1024, or 4096->256? Is it better to use the 0.6B model that natively outputs 1024 dims or the 8B model with MRL enabled?