Repository navigation
Replies: 1 comment
|
Moved to official issue tracker for triage and bug tracking: #8312 |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Summary
There is a fundamental architectural disconnect in OpenCodex's core Combo system (
src/codex/catalog/aggregation.ts):When a combo combines both text-only models (e.g. DeepSeek V4.1 Flash) and vision-capable models (e.g. Gemini 3.8 Flash, Claude Sonnet) for failover/load-balancing, OpenCodex derives the combo's catalog metadata by taking a strict intersection of input modalities.
This causes the entire combo to be declared as
input_modalities: ["text"], artificially stripping vision capability from all downstream client apps (DeepSeek Harness, Droid, Raycast, OpenCode, Qoder, Claude Code, etc.), even though OpenCodex's runtime proxy already supports multimodal failover perfectly.Root Cause in
src/codex/catalog/aggregation.tsIn
deriveComboCatalogModel:Because
intersectStringsrequires 100% of member targets to declareimage, any combo configured for speed with a multimodal fallback (such as DeepSeek + Gemini) has itsimagemodality dropped completely.Why This Is Broken
Proxy Runtime Actually Works:
When testing an image payload directly against OpenCodex proxy (
/v1/chat/completionsor/v1/responses) using comboss, the failover logic insrc/combos/failover.tsandsrc/server/responses/core-combo.tsgracefully routes the image request to the vision-capable target and responds with HTTP 200 OK.Client UIs Are Artificially Blocked:
Because the generated catalog declares the combo as text-only:
"The current model does not support images; switch to a model that does"and disables user submission.noImageSupport: true.vision: { supported: false }.Suggested Fix
In
src/codex/catalog/aggregation.ts, when deriving a combo's input modalities:Unless the user explicitly set
combo.imageInput = "disabled", if any member of the combo supportsimage, the combo should inherit theimagemodality:This ensures the catalog accurately reflects the proxy's runtime failover capabilities across all connected applications.
All reactions