feat(web): add language model inputModalities capability plumbing#1372
feat(web): add language model inputModalities capability plumbing#1372whoisthey wants to merge 2 commits into
Conversation
Add an optional `inputModalities` declaration to language model config and expose a resolved capability set to the client. - Schema: add optional `inputModalities` (`text` | `image` | `pdf`) to every provider definition in `schemas/v3/languageModel.json` and regenerate the schema types/snippets. - Add a fail-closed `resolveModelInputModalities` resolver that defaults to text-only when a model does not declare its input modalities. - Expose the resolved `inputModalities` on the client-safe `LanguageModelInfo` (populated via `getConfiguredLanguageModelsInfo` and the MCP ask path). This is groundwork for chat file attachments. It adds no attachment UI and no live provider capability probing yet. Co-authored-by: Cursor <cursoragent@cursor.com>
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Co-authored-by: Cursor <cursoragent@cursor.com>
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Workflows to automatically generate PRs for you. |
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Workflows to automatically generate PRs for you. |
1 participant
Lays the groundwork for chat file attachments by teaching Sourcebot which input modalities a configured language model can accept.
inputModalitiesdeclaration (text|image|pdf) to every provider definition inschemas/v3/languageModel.json, and regenerates the schema types/snippets.resolveModelInputModalitiesresolver (packages/web/src/features/chat/modelCapabilities.ts): when a model does not declare its input modalities, it is treated as text-only.inputModalitieson the client-safeLanguageModelInfo(populated viagetConfiguredLanguageModelsInfoand the MCP ask path).This is pure capability plumbing. It adds no attachment UI and no live provider capability probing (both are future work; see the
tryResolveAnthropicThinkingConfigprecedent inllm.server.ts).