Add memra as a model library - #2382
Merged
Merged
Conversation
memra is a Rust + CUDA inference engine for NVIDIA Blackwell workstation and consumer cards, serving GGUF and safetensors over an OpenAI-compatible API. I maintain it. - filter: false — one model carries the tag today, well under the 100-model bar. - countDownloads: GGUF files are self-contained, so one file is one load; safetensors checkpoints are counted by config.json, which is one per repo, because counting shards would overestimate a sharded model by its shard count. - The snippet leads with the hardware requirement, so nobody installs it expecting it to run on an unsupported card, and shows both the one-shot generation and the server. It also notes that a repo containing several GGUF files needs a :<substring> to pick one, which is what the engine's hf: resolver asks for. pnpm check, pnpm test and pnpm format:check all pass in packages/tasks.
avifenesh
requested review from
SBrandeis,
Wauplin,
gary149,
julien-c,
ngxson and
pcuenca
as code owners
August 17, 2026 03:09
Wauplin
reviewed
Aug 26, 2026
Wauplin
approved these changes
Aug 26, 2026
Wauplin
left a comment
Contributor
There was a problem hiding this comment.
Looks good thank you!
Expect 2-3 days before getting it live on the Hub 🤗
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds memra to
model-libraries.tswith a snippet, per Adding a library to the Hub.What it is. A from-scratch inference engine in Rust + CUDA for NVIDIA Blackwell workstation and consumer cards (
sm_120a, with a compile-gated Hopper lane), serving GGUF and safetensors over an OpenAI-compatible HTTP API. MIT. I maintain it.Prerequisite. A model already carries the tag:
?filter=memrareturns Avifenesh/Qwen3.8-27B-NVFP4-MTP-GGUF (~3k downloads).filter: false— one tagged model today, far under the 100-model bar for the models-page filter.countDownloads: path_extension:"gguf" OR path:"config.json". Two artifact shapes, one counted file each:rkllmandlitert-lmalready use.config.json, which is one per repo. Countingpath_extension:"safetensors"would overestimate a sharded model by its shard count, which the docs explicitly warn against.Snippet. Three short blocks:
hf:resolver, noting that a repo containing several GGUF files needs:<substring>to pick one (which is exactly what the resolver's error asks for).Checks. In
packages/tasks:pnpm run check(tsc) clean,pnpm test22 passed,pnpm run format:checkclean.Note
Low Risk
Additive registry and static snippet strings in
packages/tasks; no auth, inference, or download-count logic changes in this diff.Overview
Registers memra as a Hub model library so repos tagged with
library_name: memraget the standard model-page treatment (label, repo link, usage snippets). The library is not added to the models-page filter (filter: false), consistent with a small catalog.Model pages show three snippets: install via the upstream
install.sh(with Blackwell / driver notes), one-shot chat generation withrun-genandhf:${model.id}(including multi-GGUF:<substring>selection), and an OpenAI-compatiblememra-serverone-liner bound to the current model.Reviewed by Cursor Bugbot for commit 88f4041. Bugbot is set up for automated code reviews on this repo. Configure here.