feat: add instrument-for-experiments skill#160
Draft
ceyniustranberg wants to merge 1 commit into
Draft
Conversation
Adds an opinionated, experiment-driven instrumentation skill alongside the existing `instrument-*` omnibus skills. Where `instrument-product-analytics` casts a wide net (10–15 events of generic business value), this skill scopes instrumentation to the events one specific experiment needs to be measurable: hypothesis → one primary metric → 1–3 secondary metrics → inventory existing events → capture only the gaps → verification insight → hand off to experiment creation. Motivated by direct customer feedback (n8n) that they do not want to instrument their codebase "for the sake of it" — they want a focused path from "we want to A/B test X" to "events flowing that let us measure X." The skill renders into `omnibus-instrument-for-experiments.zip` via the existing build pipeline; no registry or build script changes required. Pulls in six PostHog docs as bundled references: experiments/metrics, experiments/best-practices, experiments/exposures, experiments/installation, product-analytics/capture-events, and getting-started/identify-users. Generated-By: PostHog Code Task-Id: 226e3d8f-099c-4322-8a72-538fc572895a
🧙 Wizard CIRun the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands: Test all apps:
Test all apps in a directory:
Test an individual app:
Show more apps
Results will be posted here when complete. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds an opinionated, experiment-driven instrumentation skill alongside the existing
instrument-*omnibus skills.Where
instrument-product-analyticscasts a wide net (10–15 events of generic business value), this skill scopes instrumentation to the events one specific experiment needs to be measurable:funnel/mean/ratio/retention).read-data-schemabefore adding anything new.instrument-product-analyticsreferences).Motivated by direct customer feedback (n8n): they explicitly do not want to instrument their codebase "for the sake of it" — they want a focused path from "we want to A/B test X" to "events flowing that let us measure X." The standard product-analytics sweep was the wrong shape for that audience.
What this PR does NOT do
docs-onlyskill (workflow + best practices, not framework-specific snippets).omnibus-instrument-for-experiments.zipappears indist/skills/.instrument-product-analytics— it routes there for general coverage and to the PostHog MCP experiment creation skill for the actual experiment step.Files
transformation-config/skills/omnibus/instrument-for-experiments/config.yaml— single-variantdocs-onlyskill with 6 shared docs (experiments/metrics, experiments/best-practices, experiments/exposures, experiments/installation, product-analytics/capture-events, getting-started/identify-users).transformation-config/skills/omnibus/instrument-for-experiments/description.md— the 10-step skill body with the{references}placeholder.Test plan
pnpm testpasses (60/60).pnpm builddiscovers the new skill —omnibus-instrument-for-experiments.zipis emitted.SKILL.mdwith all 6 docs pulled intoreferences/.instrument-for-experimentsvs. e.g.instrument-experiment-metricsorscoping-experiment-instrumentation.Context
Slack thread: Christophe ↔ Vincent, Friday 2026-05-29 — n8n engagement. Target was Monday 2026-06-01.