feat: add Gonka Broker as an LLM provider#12906
Open
iamoeco wants to merge 1 commit into
Open
Conversation
Contributor
|
All contributors have signed the CLA ✍️ ✅ |
Author
|
I have read the CLA Document and I hereby sign the CLA |
Author
|
The only failing check is jetbrains-tests, and it's failing on the flaky testAutocomplete() IDE-integration test (com.intellij.ide.starter.driver UI driver, AssertionFailedError at Autocomplete.kt:42), surrounded by headless X-server/xkbcomp/AT-SPI warnings. This is unrelated to this PR: Kotlin/Java compilation and the :test unit tests pass, and the change only adds an inert OpenAI-compatible provider (plus two entries in autodetect.ts) — nothing that touches autocomplete. All TypeScript checks (core, packages/openai-adapters, e2e) are green. Could a maintainer re-run the jetbrains-tests job? Thanks! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds Gonka Broker as a first-class, named LLM provider. Gonka Broker is an OpenAI-compatible gateway to decentralized Gonka compute, implemented as a thin subclass of the existing
OpenAIprovider.Because the provider exposes a public, OpenAI-compatible
/v1/modelsendpoint, users can setmodel: AUTODETECTand Continue discovers the available models automatically — no hardcoded model list, so no follow-up PR is needed when models change.This mirrors the existing OpenAI-compatible gateway providers (e.g. Nebius, Tensorix). It adds the provider class + registration, the
openai-adaptersroute, the VS Code config-schema entry, the onboarding UI entry, and a docs page. The provider serves chat/completions only, so it is intentionally not added to the embeddings or reranker enums.Files:
core/llm/llms/Gonkabroker.ts— new provider class extendingOpenAI(apiBasehttps://proxy.gonkabroker.com/v1/).core/llm/llms/index.ts— register the provider inLLMClasses.core/llm/autodetect.ts— addgonkabrokertoPROVIDER_HANDLES_TEMPLATINGandPARALLEL_PROVIDERS.packages/openai-adapters/src/index.ts— routegonkabrokerthroughopenAICompatible.packages/openai-adapters/src/types.ts— addgonkabrokerto the OpenAI-compatible provider union.gui/src/pages/AddNewModel/configs/providers.ts— onboarding entry (usesAUTODETECT).extensions/vscode/config_schema.json— addgonkabrokerto the model-provider enum + onboarding description.docs/customize/model-providers/more/gonkabroker.mdx— provider documentation page.docs/docs.json— add the docs page to the "More Providers" sidebar.AI Code Review
@continue-reviewChecklist
Screen recording or screenshot
Config-only provider — it adds no new UI surface beyond the standard provider entry. Verified against the live API through the
openai-adapterspath:AUTODETECTdiscovered the served models from/v1/models.MiniMaxAI/MiniMax-M2.7returned a valid response.Tests
No automated tests were added, consistent with the existing OpenAI-compatible provider additions (e.g. Nebius, Tensorix), which add none. Verified manually with a real API key:
AUTODETECTreturns the live model list fromhttps://proxy.gonkabroker.com/v1/models.chatCompletionNonStreamtoMiniMaxAI/MiniMax-M2.7returns a valid completion.Summary by cubic
Add
gonkabrokeras an OpenAI-compatible LLM provider for chat/completions, withAUTODETECTmodel discovery from the public/v1/modelsendpoint.Gonkabrokerprovider extendingOpenAIwithapiBasehttps://proxy.gonkabroker.com/v1/.openAICompatibleinpackages/openai-adaptersand added to its provider types.LLMClasses; added to templating and parallel-provider lists for autodetect.config_schema.jsonenum entry and onboarding UI entry (usesAUTODETECT).Written for commit 2d1e0f0. Summary will update on new commits.