2508.21290

Total: 1

#1 Efficient Code Embeddings from Code Generation Models [PDF10] [Copy] [Kimi13] [REL]

Authors: Daria Kryvosheieva, Saba Sturua, Michael Günther, Scott Martens, Han Xiao

jina-code-embeddings is a novel code embedding model suite designed to retrieve code from natural language queries, perform technical question-answering, and identify semantically similar code snippets across programming languages. It makes innovative use of an autoregressive backbone pre-trained on both text and code, generating embeddings via last-token pooling. We outline the training recipe and demonstrate state-of-the-art performance despite the relatively small size of the models, validating this approach to code embedding model construction.

Subjects: Computation and Language , Artificial Intelligence , Information Retrieval

Publish: 2025-08-29 01:18:15 UTC