Add Fabric Data Agent plugin — create, test, tune agents via MCP

[harigouthami]

What

Adds a plugin for managing Microsoft Fabric Data Agents from VS Code via GitHub Copilot.

Components

• 1 Agent: fabric-data-agent-manager — Full lifecycle management (create, configure, publish, query, tune)
• 3 Skills:
  • fabric-data-agent-create — End-to-end guided agent setup with SQL validation
  • fabric-data-agent-test — CSV-based accuracy testing with tolerance matching
  • fabric-data-agent-tune — Diagnose and fix failing queries
• 1 Plugin: fabric-data-agent — Bundles the agent and skills

How It Works

Uses MCP tools to connect to Fabric APIs (Management, OpenAI, SQL endpoint, OneLake DFS). Everything runs through natural language in Copilot Chat — no portal, no notebooks.

Key innovations:

• SQL validation: Every few-shot query is tested against the database before adding
• Knowledge from Git: Auto-generates instructions from TMDL semantic model files
• Accuracy testing: CSV test runner with configurable tolerance (default 5%)
• Tune loop: Reproduce -> Diagnose -> Fix -> Publish -> Re-test

Prerequisites

• Azure CLI (az login)
• Fabric workspace access (Contributor role)
• Fabric Data Agent MCP server (setup instructions)

Testing

• Created an agent with 7 tables, 8 few-shots in ~4 minutes
• Achieved 100% accuracy on 3-question test suite
• Successfully diagnosed and fixed a case-sensitivity issue in the tune workflow

[github-actions]

🔍 Skill Validator Results

4 resource(s) checked | ✅ All checks passed

Full output

Only one of --plugin, --skills, or --agents can be used at a time.

Note: Errors were found. These are currently reported as warnings and do not block merge. Please review and address when possible.