Abrinoxus@lemmy.today to Aneurysm Posting@sopuli.xyz · 21 days agod whalemmy.todayimagemessage-square17linkfedilinkarrow-up1342arrow-down17file-text
arrow-up1335arrow-down1imaged whalemmy.todayAbrinoxus@lemmy.today to Aneurysm Posting@sopuli.xyz · 21 days agomessage-square17linkfedilinkfile-text
minus-squareMeron35linkfedilinkarrow-up4·20 days agoA fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions. It’s not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though. Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/
A fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions.
It’s not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though.
Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/