Skip to content

chore: add serving to dev-playground, template, and docs#241

Merged
pkosiec merged 8 commits intomainfrom
pkosiec/serving-3-playground-docs
Apr 10, 2026
Merged

chore: add serving to dev-playground, template, and docs#241
pkosiec merged 8 commits intomainfrom
pkosiec/serving-3-playground-docs

Conversation

@pkosiec
Copy link
Copy Markdown
Member

@pkosiec pkosiec commented Apr 3, 2026

Summary

  • Add serving demo page to dev-playground with chat-style streaming UI
  • Add serving plugin to app templates and appkit init scaffolding
  • Include plugin documentation and auto-generated API reference docs

Demo

model-serving-demo-compressed.mp4

PR Stack — Model Serving

# PR Description
1 #239 Serving connector & plugin
2 #240 Type generator, Vite plugin & UI hooks
3 this PR Dev-playground, template & docs

@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 735aa72 to 9b7bcc1 Compare April 3, 2026 10:06
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 12b1ac0 to c9134db Compare April 3, 2026 10:08
@pkosiec pkosiec changed the title feat: add serving to dev-playground, template, and docs chore: add serving to dev-playground, template, and docs Apr 3, 2026
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 9b7bcc1 to e2336c1 Compare April 3, 2026 10:16
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch 4 times, most recently from 68b663f to 9dc0a15 Compare April 3, 2026 11:22
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 2657962 to 8687067 Compare April 3, 2026 12:25
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch 2 times, most recently from 908304d to 7e16c81 Compare April 3, 2026 13:32
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 1d503de to a8ebf5e Compare April 9, 2026 14:23
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 7e16c81 to 106c9f5 Compare April 9, 2026 14:27
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from a8ebf5e to cccf049 Compare April 9, 2026 14:46
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from fa130f2 to 4b7692c Compare April 9, 2026 14:46
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from cccf049 to ac0a669 Compare April 9, 2026 17:40
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 4b7692c to 9db55cb Compare April 9, 2026 17:40
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from ac0a669 to 10204a8 Compare April 10, 2026 08:13
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 9db55cb to 6d2c6cc Compare April 10, 2026 08:13
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 10204a8 to 6c85231 Compare April 10, 2026 08:22
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 6d2c6cc to c2b8e5d Compare April 10, 2026 08:22
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 6c85231 to e1068f6 Compare April 10, 2026 08:25
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from c2b8e5d to 04406bd Compare April 10, 2026 08:25
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from e1068f6 to c428977 Compare April 10, 2026 13:26
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 04406bd to 8ac9638 Compare April 10, 2026 13:26
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 8ac9638 to 7a444f3 Compare April 10, 2026 14:19
Base automatically changed from pkosiec/serving-2-types-hooks to main April 10, 2026 15:46
pkosiec added 8 commits April 10, 2026 17:52
Integrate the Model Serving plugin into the dev-playground app with a
chat-style streaming demo page. Add serving plugin to app templates
and appkit init scaffolding. Include plugin documentation and
auto-generated API reference docs.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
Build the full message array synchronously in handleSubmit and pass it
to stream() via the new overrideBody parameter, instead of relying on
useMemo recomputation via setTimeout.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
Replace dual-source pattern (onComplete + streaming bubble) with a
useEffect that commits the assistant message on streaming→false
transition, then calls reset(). Eliminates both the duplicate
response and missing subsequent responses.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
The Message interface includes an id field used as a React key. When
spreading messages into the API payload, this extra field was included,
which could cause the Databricks serving endpoint to reject subsequent
requests. The first message worked because the messages array was empty.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
The template computed body via useMemo([messages, input]), causing the
invoke callback to be recreated on every state change. This triggered
the useEffect cleanup that aborted in-flight requests. Use a stable
empty body and pass the real messages via invoke(overrideBody).

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
…T_NAME in playground and docs

Also add execution context section documenting OBO-by-default behavior.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
- Rename display string in dev-playground serving route
- Fix wrongly renamed DATABRICKS_SERVING_ENDPOINT_CLASSIFIER in docs

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
The plugin is now auto-included by the dev server. Remove manual
imports from dev-playground and template vite configs, and update
docs to reflect that no user configuration is needed.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 7a444f3 to 0a60482 Compare April 10, 2026 15:54
@pkosiec pkosiec merged commit 6a00264 into main Apr 10, 2026
7 checks passed
@pkosiec pkosiec deleted the pkosiec/serving-3-playground-docs branch April 10, 2026 16:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants