VS Code: Prompt Editor for LLMs (GPT4, Llama, Mistral, etc.)

What matters technically here is that prompt work is being treated like application configuration, not just ad hoc experimentation. By moving prompts, model choices, and runtime settings into .aiconfig files, teams can place generative AI behavior under source control, review changes, and promote the same artifacts across development workflows. That creates a clearer boundary between prompt authoring and application logic, which is especially useful when multiple engineers need to collaborate on iterative model behavior.

The architecture also highlights a practical integration pattern: the editor is not the model runtime itself, but a VS Code front end that launches a Python-backed service using the AIConfig SDK. That means the operational dependencies are split across the IDE, the local Python environment, and any registered provider or extension. For teams, the trade-off is flexibility versus environment discipline: local setup, package versions, and custom registries must remain consistent if prompts are to behave predictably across machines.

For enterprise adoption, the extensionโ€™s value is in abstraction and extensibility. A single interface for remote and local models can reduce tooling sprawl, while support for custom parsers makes it easier to adapt to internal endpoints or specialized model workflows. At the same time, this pattern creates governance questions around credential handling, provider routing, and which model capabilities are exposed to developers in a shared workspace.

In practice, the operational win is tighter feedback loops. Prompt chaining, model swapping, and version-controlled configs can help teams test behavior before wiring it into production code. But that only works well if the surrounding process treats prompt files as first-class artifacts with review, dependency management, and clear ownership.


AIConfig Extension for Visual Studio Code

Overview

AIConfig Editor turns VS Code into a generative AI prompt IDE, allowing you to run models from any provider (OpenAI, Google, Hugging Face, your local computer…) or any modality (text, image, audio) in a single universal playground. The prompts and model settings get saved in a .aiconfig.yaml or .aiconfig.json file, which can be source controlled and used in your application code via the AIConfig SDK.
Read the full documentation for more details
EditorUI Demo Video

Getting Started

First use

  1. Install the AIConfig Editor extension.
  2. Run the AIConfig: Welcome command (CMD+SHIFT+P -> AIConfig: Welcome), and follow the steps. Welcome
  3. Check out some of our cookbook templates for inspiration!

Next use

  • Create an untitled aiconfig using the AIConfig: Create New command (CMD+SHIFT+P -> AIConfig: Create New) to launch an Untitled aiconfig.

Key Features

  • Access local and remote models in one place. Access all generative AI models in a single place, directly in your IDE. Out-of-the-box support for text, image, and audio models.
  • Universal prompt engineering playground. Swap between models, chain prompts together, and create prompt templates. Use these prompts in code using the AIConfig SDK.
  • Version control prompts. Manage prompts and model settings in config files that you can put in source control, right beside your code.
  • Connect to your own models and endpoints. Extend AIConfig to work with any model and endpoint. See custom models section for more details.

Supported Models

This extension supports all major foundation models from major model providers. For more details, please see https://aiconfig.lastmileai.dev/docs/overview/model-parsers/.
Provider Model Language Support
OpenAI GPT3.5 Python โœ… Built-in
OpenAI GPT4 Python โœ… Built-in
OpenAI Dall-E 3 Python โœ… Built-in
Azure OpenAI GPT3.5, GPT4 Python โœ… Built-in
AWS Bedrock Claude Python โœ… Built-in
HuggingFace Inference Endpoints Text Generation, Text-to-image, Text-to-speech, Summarization, Translation, Automatic Speech Recognition Python โœ… Built-in
Google PaLM 2 Python โœ… Built-in
Google Gemini Python โœ… Built-in
Meta Llama 2 Python Extension
Meta Llama Guard Python Extension
HuggingFace Transformer Pipelines Text Generation Python Extension

How it works

AIConfig Editor is the UI for AIConfig, which is a JSON/YAML schema for storing generative AI prompts, models and model settings as a config file.
For example, check out this sample aiconfig that handles function calling and prompt chaining.
On install, the extension installs the Original Postython-aiconfig/" target="_blank" rel="noreferrer noopener nofollow" shape="rect">python-aiconfig pip package in your Python environment. On open, when you open a *.aiconfig.yaml file in VS Code, this extension launches a Python server which is running the AIConfig SDK. As you edit and run prompts in the editor, the server uses the AIConfig SDK to run those prompts. This provides you with a lot of flexibility, because you can install additional AIConfig Extensions in your Python environment, and use them in the editor.

Extensibility and Customization

Read How it works for some additional context.
When you use the AIConfig Editor, the extension installs python-aiconfig in your Python env. You can install additional extensions and dependencies in the same Python env, and then use them in the AIConfig Editor.

Instructions

  1. pip3 install <extension_package> in your python env (e.g. pip3 install aiconfig-extension-hugging-face for Hugging Face models via Transformers, Diffusers and Inference endpoints)
  2. Run AIConfig: Create Custom Model Registry command (CMD+SHIFT+P -> AIConfig: Create Custom Model Registry) ModelRegistry
  3. Register the additional models from the package imported in Step 1. e.g.
  4. Copy the full sample
from aiconfig_extension_hugging_face import (โ€ฉ    HuggingFaceText2ImageDiffusor,โ€ฉ    HuggingFaceTextGenerationTransformer,โ€ฉ    HuggingFaceTextSummarizationTransformer,โ€ฉ)โ€ฉโ€ฉfrom aiconfig import AIConfigRuntimeโ€ฉโ€ฉโ€ฉdef register_model_parsers() -> None:โ€ฉ    """Register model parsers for HuggingFace models."""โ€ฉโ€ฉ    text_to_image = HuggingFaceText2ImageDiffusor()โ€ฉ    AIConfigRuntime.register_model_parser(text_to_image, text_to_image.id())โ€ฉโ€ฉ    text_generation = HuggingFaceTextGenerationTransformer()โ€ฉ    AIConfigRuntime.register_model_parser(โ€ฉ        text_generation, text_generation.id()โ€ฉ    )โ€ฉ    text_summarization = HuggingFaceTextSummarizationTransformer()โ€ฉ    AIConfigRuntime.register_model_parser(โ€ฉ        text_summarization, text_summarization.id()โ€ฉ    )โ€ฉ
  1. Open an *.aiconfig.yaml (e.g. CMD+SHIFT+P -> AIConfig: Create New), and now you can use the custom extension in the editor! HuggingFace
To define you own extensions, please see Extensibility docs.
https://marketplace.visualstudio.com/items?itemName=lastmile-ai.vscode-aiconfig

Enjoyed this article? Sign up for our newsletter to receive regular insights and stay connected.