Skip to content

feat(runtime): add GGUF HTTP transcription wrapper#3303

Merged
LauraGPT merged 1 commit into
mainfrom
codex/gguf-http-server
Jul 22, 2026
Merged

feat(runtime): add GGUF HTTP transcription wrapper#3303
LauraGPT merged 1 commit into
mainfrom
codex/gguf-http-server

Conversation

@LauraGPT

Copy link
Copy Markdown
Collaborator

Summary

Adds a lightweight OpenAI-compatible HTTP wrapper for the existing llama.cpp / GGUF command-line binaries.

  • new runtime/llama.cpp/server/funasr_gguf_server.py standard-library server
  • accepts POST /v1/audio/transcriptions multipart uploads and returns {\"text\": ...}
  • forwards requests to the configured llama-funasr-* binary with -m, -a, optional --vad, optional --backend, and extra forwarded args
  • documents local startup and curl usage in runtime/llama.cpp/README.md

Fixes #3298.

Validation

  • python3 -m pytest -q runtime/llama.cpp/tests/test_gguf_server.py runtime/llama.cpp/tests/test_release_workflow.py runtime/llama.cpp/tests/test_backend_flags.py -q
  • python3 -m py_compile runtime/llama.cpp/server/funasr_gguf_server.py
  • git diff --check

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@LauraGPT
LauraGPT merged commit b798e26 into main Jul 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

can you start a llama server for llamacpp builds?

1 participant