-
Notifications
You must be signed in to change notification settings - Fork 278
[release 2026.4] Cline demo #4557
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
przepeck
wants to merge
11
commits into
releases/2026/4
Choose a base branch
from
przepeck/cline_demo
base: releases/2026/4
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
11 commits
Select commit
Hold shift + click to select a range
361302f
cline demo first version
przepeck 4bad1e5
better mcp usage instruction + pics
przepeck 2cc343b
save
przepeck 6105045
kv_cache_precision for gemma4
przepeck 1671d9a
remove gemma4 from cline demo
przepeck 3f6fd50
Qwen3.6 and Qwen3-Coder-Next, simplfy the deployment section, review …
przepeck ff46222
remove MCP section, add gpt and Qwen3.5-9B, removed LFM2.5-8B
przepeck e1a1de7
review changes
przepeck a8f0bc3
Merge branch 'releases/2026/4' into przepeck/cline_demo
przepeck 2b8d80d
adding integration to integration registry
przepeck ce161fa
pics and idle model management mention
przepeck File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,123 @@ | ||
| # Cline Coding Agent with OpenVINO Model Server {#ovms_demos_cline_integration} | ||
|
|
||
| ## Intro | ||
| [Cline](https://cline.bot/) is an autonomous coding agent extension for Visual Studio Code. It can read and edit | ||
| files, run terminal commands, browse the web and call tools exposed by MCP servers, all driven by an LLM reachable | ||
| through an OpenAI-compatible API. This demo shows how to serve that LLM locally with OpenVINO Model Server (OVMS) | ||
| so that Cline runs entirely on your own machine, without sending code or prompts to an external service. | ||
|
|
||
|
|
||
| ## Requirements | ||
| - Windows (standalone package) or Linux (Docker) | ||
| - Visual Studio Code with the [Cline extension](https://marketplace.visualstudio.com/items?itemName=saoudrizwan.claude-dev) installed | ||
| - Make sure that Cline works with `next` version (to change it go to Visual Studio Code settings and search `@ext:saoudrizwan.claude-dev`, check `next` option from dropdown) | ||
| - Hardware: Tested on Intel Core Ultra iGPU with 32GB RAM and a discrete Intel Arc B70 GPU (dedicated VRAM). `Qwen3-Coder-Next` can be deployed on iGPU with 64GB RAM on board. | ||
| - Memory requirements depend on the chosen model (see table below) | ||
|
|
||
|  | ||
|
|
||
| ## Suggested models | ||
|
|
||
| | Model | HF Link | Notes | | ||
| |---|---|---| | ||
| | `OpenVINO/Qwen3.8-27B-int8-ov` | [link](https://huggingface.co/OpenVINO/Qwen3.8-27B-int8-ov) | Vision-capable (VLM); general purpose chat/agent model | | ||
| | `OpenVINO/Qwen3.6-35B-A3B-int4-ov` | [link](https://huggingface.co/OpenVINO/Qwen3.6-35B-A3B-int4-ov) | Vision-capable (VLM); general purpose chat/agent model | | ||
| | `OpenVINO/Muse-Glimmer-30B-int4-ov` | [link](https://huggingface.co/OpenVINO/Muse-Glimmer-30B-int4-ov) | Vision-capable (VLM); general purpose chat/agent model | | ||
| | `OpenVINO/gpt-oss-20b-int4-ov` | [link](https://huggingface.co/OpenVINO/gpt-oss-20b-int4-ov) | General purpose chat/agent model | | ||
| | `OpenVINO/Qwen3-Coder-Next` | **To be published soon** | Big coding model; available only on iGPU with minimum 64GB of RAM | | ||
| | `OpenVINO/Qwen3.5-9B-int4-ov` | [link](https://huggingface.co/OpenVINO/Qwen3.5-9B-int4-ov) | Smaller model, use when RAM/VRAM is limited or for quick, low-latency edits; not recommended for harder coding tasks | | ||
|
|
||
| ## Deploy OVMS | ||
|
|
||
| ### Windows: deploying on bare metal | ||
|
|
||
| All models can be deployed with the same command, only `--source_model` parameter should be changed to desired model. | ||
| ```bat | ||
| mkdir c:\models | ||
| ovms --model_repository_path c:\models --source_model OpenVINO/Qwen3.8-27B-int8-ov --rest_port 8000 | ||
| ``` | ||
|
|
||
|
|
||
| ### Linux: via Docker | ||
|
|
||
| All models can be deployed with the same command, only `--source_model` parameter should be changed to desired model. | ||
| ```bash | ||
| mkdir -p ${HOME}/models | ||
| export GPU_ARGS=$(if ls /dev/dri/render* >/dev/null 2>&1; then echo "--device /dev/dri --group-add $(stat -c '%g' /dev/dri/render* | head -n1)"; fi) | ||
| docker run -d -p 8000:8000 --rm --user $(id -u):$(id -g) -v ${HOME}/models:/models/:rw ${GPU_ARGS} \ | ||
| openvino/model_server:latest-gpu \ | ||
| --model_repository_path /models --source_model OpenVINO/Qwen3.8-27B-int8-ov --rest_port 8000 | ||
| ``` | ||
|
|
||
| ## Set Up Visual Studio Code | ||
|
|
||
| ### Install the [Cline extension](https://marketplace.visualstudio.com/items?itemName=saoudrizwan.claude-dev) | ||
|
|
||
| ### Point Cline at your OVMS instance | ||
|
|
||
| Open Cline's settings and add a new API provider configuration: | ||
| - **API Provider:** `OpenAI Compatible` | ||
| - **Base URL:** `http://localhost:8000/v1` | ||
| - **API Key:** any placeholder value, e.g. `unused` (unless configured on OVMS server side) | ||
| - **Model ID:** value provided as `--source_model`, e.g. `OpenVINO/Qwen3.8-27B-int8-ov` or as the `--model_name` e.g. `ovms-model` | ||
|
|
||
|  | ||
|
|
||
| Cline lets Plan mode and Act mode use different models/providers, so you can, for example, use | ||
| `Qwen3.6-35B-A3B-int4-ov` for Plan-mode reasoning and switch to `Qwen3.8-27B` (on B70) for Act-mode code changes. | ||
| You can set that checking **Use different models for Plan and Act modes**. | ||
|
|
||
| Running two large models like these at the same time can exceed available RAM/VRAM, so configure OVMS's | ||
| [idle servable management](../../docs/idle_servable_management.md) (preview feature) to keep only the model used by | ||
| the active mode loaded; switching modes in Cline then wakes up the other model on demand instead of requiring both | ||
| to be resident at once. | ||
|
|
||
| ## Usage examples | ||
|
|
||
| ### Chat (Plan mode) | ||
| Ask a question about the codebase without letting Cline make changes: | ||
| ```text | ||
| Explain how request validation works in this repository and list the files involved. | ||
| ``` | ||
|
|
||
| ### Coding / agentic (Act mode) | ||
| Switch to Act mode and give Cline a task that requires editing files and running commands: | ||
| ```text | ||
| Add a unit test for the `parseConfig` function and run the test suite to confirm it passes. | ||
| ``` | ||
| Cline will use its built-in tools (file read/write, terminal, browser) to make the change and verify it, relying on | ||
| OVMS's auto-detected tool-call format (derived from the model's chat template) to turn the model's tool calls into | ||
| these actions. | ||
|
|
||
| ### Image input | ||
| With `Qwen3.8-27B-int8-ov`, `Qwen3.6-35B-A3B-int4-ov` or `Muse-Glimmer-30B-int4-ov` deployed as a VLM, attach an | ||
| image to a Cline chat message, e.g.: | ||
| ```text | ||
| [attach a screenshot of a UI bug] | ||
| What is wrong with this layout and which CSS file should I fix? | ||
| ``` | ||
| Image attachments are only available when the configured model declares `supportsImages` in Cline's model | ||
| configuration; enable it for the custom OpenAI-compatible model entry when using a vision-capable model like | ||
| `Qwen3.8-27B-int8-ov`. | ||
|
|
||
| ## `reasoning_effort` usage | ||
|
|
||
| Cline exposes a reasoning-effort control that is sent as part of the chat | ||
| completion request. OVMS supports the OpenAI API `reasoning_effort` field natively, so this setting is honored | ||
| across all of the suggested models above, regardless of the underlying chat template. | ||
| It may be changed in Cline's **Settings** under **Reasoning Effort** section. | ||
|
|
||
| ## Coding task | ||
|
|
||
| For coding task example check [CodingAgenticWorflow Demo](https://github.com/intel-samples/agentic-demos/tree/main/CodingAgenticWorkflow#setup-ovms-server). | ||
|
|
||
| ## Agentic and coding capabilities summary | ||
|
|
||
| - **Agentic**: Act mode combines the model's tool-calling ability (auto-detected by OVMS from the model's chat | ||
| template) with Cline's built-in tools (terminal, file read/write, browser) and any MCP servers you register, | ||
| letting Cline plan and execute multi-step tasks autonomously. | ||
| - **Coding**: Use `Qwen3.8-27B` on B70 or `Qwen3-Coder-Next` on iGPU for the strongest code generation/editing quality among the suggested models; | ||
| fall back to `Qwen3.5-9B` for lightweight or latency-sensitive edits. | ||
| - **MCP**: any MCP server (weather, filesystem, browser, etc.) becomes available to Cline the same way it is | ||
| available to the OpenAI Agents SDK example in the agentic AI demo. | ||
| - **Image input**: use `Qwen3.8-27B`, `Qwen3.6-35B-A3B-int4-ov` or `Muse-Glimmer-30B-int4-ov` for prompts that include screenshots or diagrams. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
wrong port used