Generative UI & in-app AI
draftedconfidence: lowearly: 1/12 of this tier graded so far (0 overturned) — the public scorecard →
recommendation
Vercel AI SDK for streaming chat + tool-calling (TanStack AI is the emerging type-safe alternative — pre-1.0, watch it); assistant-ui/Tambo for prebuilt chat UI; Streamdown to render streaming markdown. Very fast-moving (confidence: low) — treat picks as current-best, not settled.
- render model output as live components → json-render
- agent-style UI → Cedar
- already TanStack-stack (Query/Router/Start) or want image/speech/video generation hooks → TanStack AI (pre-1.0, pin)
Low confidence — fast-moving or lightly-vetted domain: treat the pick as a vetted lead and prototype before committing.
Options & tradeoffs
| option | tradeoff | evidence |
|---|---|---|
| Vercel AI SDK / json-render | streaming chat + tool-calling; json-render renders model output as components (now RN too) | ships in 3/34 |
| assistant-ui / Tambo | prebuilt chat/generative-UI components; Tambo 1.0 adds state persistence + streaming, self-host or cloud | |
| Cedar / Streamdown | Cedar = agent-UI toolkit; Streamdown = streaming-markdown renderer for LLM output | |
| TanStack AI (@tanstack/ai + ai-react) | type-safe TS AI SDK — streaming chat, tool calling, agents, host-side MCP client, generation hooks (useGenerateImage/Speech/Video, useTranscription) beyond chat; 7-provider adapters; pre-1.0 (0.40, active 2026-07) — the first real Vercel-AI-SDK alternative | 198k/wk |
npm weekly downloads (from the corpus's last signals run): ai 16.8M · @tanstack/ai 198k · @tanstack/ai-react 77k
Verified notes
Distinct from on-device inference (RB-E-ONDEVICE-AI) — this is cloud-LLM app UI. Very fast-moving; recommend tentatively (confidence: low). Adjacent: Vercel's Eve is a file-based agent framework (an agent = a folder of tools/connections/channels/schedules; MCP connections, human-approval gates, sandboxed subagents) — that's the agent BACKEND you'd then surface through these UI libs, not a React UI library itself.
Canonical reading
Editorial annotations on why each piece matters — the articles themselves are the originals; read them there.
The core generative-UI mental model: tools return structured JSON that maps to React component props; the client-side switch-statement scaling problem; and the server-side createStreamableUI/RSC solution for streaming components during generation.
The architecture behind streaming-markdown rendering (the Streamdown problem): repairing incomplete markdown before parsing, block-level memoization to avoid re-parsing every token, processor caching, and startTransition for smooth streaming.
Sources
- json-render.dev/docs/ai-sdk
- github.com/tambo-ai/tambo
- registry.npmjs.org/@tanstack/ai/latest
- tanstack.com/blog/generation-hooks
Related in ai: ondevice-ai · ai-devtools