Used in: vendored/nomic/code_vectors.bin, vendored/nomic/code_tokens.txt
Static token embeddings extracted from nomic-embed-code (7B parameter code embedding model, Apache-2.0 license).
Token vectors are extracted via full inference from the nomic-embed-code model:
- Load nomic-embed-code (7B, Qwen2.5-Coder-7B base)
- Filter vocabulary to ~40K code-relevant alphanumeric tokens
- Per-token inference → 768-dim float vectors
- Simulated attention (K=32 neighbors, 3 iterations, α=0.3)
- Mean centering (anisotropy fix)
- Int8 quantization (×127 scaling) → ~12MB binary blob
The 7B model is NOT bundled or used at runtime — only the pre-computed static vectors are included.
- Model: https://huggingface.co/nomic-ai/nomic-embed-code
- License: Apache-2.0
- Vendored from: DeusData/codebase-memory-mcp (MIT license)
- Original extraction script:
scripts/extract_nomic_vectors.py - Pre-built vectors:
vendored/nomic/code_vectors.bin,vendored/nomic/code_tokens.txt
- Original extraction script:
See vendored/nomic/LICENSE and vendored/nomic/NOTICE for full license text.