Skip to content

Add JetInfer as an inference provider - #2402

Closed
hsdxpro wants to merge 1 commit into
huggingface:mainfrom
hsdxpro:jetinfer-provider
Closed

Add JetInfer as an inference provider#2402
hsdxpro wants to merge 1 commit into
huggingface:mainfrom
hsdxpro:jetinfer-provider

Conversation

@hsdxpro

@hsdxpro hsdxpro commented Aug 23, 2026

Copy link
Copy Markdown

Registers JetInfer as an inference provider, per the register-as-a-provider guide.

  • Hub org: https://huggingface.co/jetinfer (Team plan)
  • API: strictly OpenAI-compatible chat completions at https://api.jetinfer.com/v1conversational only, so the helper extends BaseConversationalTask with no overrides
  • Live now, e.g. GET https://api.jetinfer.com/v1/models (pricing + context_length exposed per the billing spec); streaming, tool calling and structured output verified
  • Billing endpoint (nano-USD) and Inference-Id response header already implemented on our side

First model to map once enabled: Qwen/Qwen3.8-27B.


Note

Low Risk
Additive provider registration with no auth, routing, or payload logic changes beyond a new OpenAI-compatible conversational helper.

Overview
Adds JetInfer as an inference provider for chat completions, using the standard BaseConversationalTask against https://api.jetinfer.com (no custom request/response mapping).

Wires jetinfer into provider types, hub org mapping, helper lookup, and README so clients can route conversational requests with provider: "jetinfer".

Reviewed by Cursor Bugbot for commit 57ba90b. Bugbot is set up for automated code reviews on this repo. Configure here.

JetInfer (https://huggingface.co/jetinfer) serves open-weight models through
a strictly OpenAI-compatible chat completions API, so the conversational
helper needs no overrides.
@hanouticelina

Copy link
Copy Markdown
Contributor

Hey there!

Thank you for your interest in becoming an Inference Provider and for the excellent work you've put into this integration!
We really appreciate the effort.

However, we're currently in a consolidation phase focusing on growing usage of Inference Providers via new features and integrations rather than expanding to new partners. This means we've temporarily paused onboarding new providers while we work on these improvements.

We're not able to provide a specific timeline for when we'll resume new provider onboarding, but we'd love to revisit this integration in the future.

In the meantime:

  • Grow your presence on Hugging Face — publish models, datasets, and Spaces.
  • Grow your Hugging Face organization — build a community around your work.
  • Consider upgrading to a Team plan — this is a requirement for further integration as per the Inference Providers doc.

Thanks again for your contribution and understanding!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants