Skip to content
169 changes: 169 additions & 0 deletions DOCS_UPDATES.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,169 @@
# Documentation Updates - Factual Language Alignment & PR #339 Review

## Overview
Updated documentation files to:
1. Align with PR #339 terminology and remove superlatives for a factual, professional tone
2. Add missing content from published blog (monitoring and improving skills)
3. Address feedback from PR #339 review comments

## Files Modified

### 1. overview/skills.mdx

**Line 138 - Added monitoring link:**
- Added: `- **To monitor skill performance**: See [Monitoring and Improving Skills](/overview/skills/monitoring)`
- Reason: Provide clear navigation to new monitoring documentation

### 2. overview/plugins.mdx

**Line 18 - Removed conversational phrase:**
- Before: `Think of plugins as "extension packs" that add a complete feature set to OpenHands in one step.`
- After: `Plugins package multiple components into a single unit, adding a complete feature set to OpenHands in one step.`
- Reason: Removed "Think of" conversational framing; made statement more direct and factual

**Line 30-35 - Updated terminology to match blog:**
- Before: `**Single-purpose knowledge packages**` and `Easy to create and share`
- After: `**Specialized prompts for specific tasks**` and `Quick to create and share`
- Reason: Changed "knowledge packages" to "specialized prompts" to align with PR #339 terminology; removed superlative "Easy" → "Quick"

### 3. overview/skills/creating.mdx

**Line 39-41 - Removed superlatives:**
- Before: `### Easiest Way: Let OpenHands Help` and `The simplest way to create a skill is to ask OpenHands to help you:`
- After: `### Automated Approach: Let OpenHands Help` and `To create a skill with guided assistance, ask OpenHands to help you:`
- Reason: Removed superlatives "Easiest" and "simplest"; replaced with factual descriptions "Automated Approach" and "guided assistance"

**Line 493-495 - Added monitoring reference:**
- Added Info callout linking to new monitoring page
- Reason: Point users to production monitoring guidance without making creating.mdx too long

**Line 526 - Enhanced Next Steps section:**
- Added: `- **[Monitor skill performance](/overview/skills/monitoring)** in production`
- Reason: Make monitoring discoverable in natural workflow progression

**Line 534-540 - Enhanced Further Reading section:**
- Added: `[Monitoring Skills](/overview/skills/monitoring)` link (first position for emphasis)
- Added: `[Observability & Tracing](/sdk/guides/observability)` link
- Added: `[GitHub Workflows](/sdk/guides/github-workflows/pr-review)` link
- Reason: Provide clear path to monitoring and automation resources

## Files Created

### overview/skills/monitoring.mdx (NEW)

Created dedicated page for production skill monitoring, covering:

**Main sections:**
1. **The Monitoring Workflow** - Four-part process (logging, evaluating, dashboarding, aggregating)
2. **Logging Agent Behavior** - OpenTelemetry/Laminar setup for SDK and GitHub Actions
3. **Evaluating Performance** - Defining meaningful metrics with PR review example
4. **Dashboarding Metrics** - Visualizing trends over time
5. **Aggregating Feedback** - Using LLMs to analyze patterns and suggest improvements
6. **Deployment in Automated Workflows** - CI/CD integration patterns
7. **Best Practices** - Accordion sections with actionable guidance

**Key features:**
- Technical, down-to-earth tone matching the blog
- Practical examples with actual metrics (suggestion_accuracy formula)
- Links to SDK observability guide and GitHub workflow examples
- References to extensions repository for complete implementations
- Source: Published blog at https://openhands.dev/blog/20260227-creating-effective-agent-skills

**Justification:**
- PR #339 review identified missing monitoring content from blog
- Separate page keeps creating.mdx focused and prevents 116-line section bloat
- Better organization for users who want production deployment guidance
- Enables deeper coverage with Best Practices accordions

## Changes Not Made

The following files were reviewed and found to already comply with factual language standards:
- overview/skills.mdx - Already uses factual language throughout
- overview/skills/adding.mdx - Not reviewed in detail (lower priority)
- overview/skills/org.mdx - Not reviewed in detail (lower priority)
- overview/skills/keyword.mdx - Not reviewed in detail (lower priority)
- overview/skills/public.mdx - Not reviewed in detail (lower priority)
- overview/skills/repo.mdx - Not reviewed in detail (lower priority)

## Terminology Alignment

Updated to match blog.md terminology from PR #339:
- ✅ "specialized prompts" instead of "knowledge packages"
- ✅ Removed conversational frames ("Think of", "Here's what")
- ✅ Removed superlatives ("easiest", "simplest", "perfect")
- ✅ Direct, factual statements instead of marketing language

## Verification

Ran comprehensive grep searches to verify:
```bash
# Check for common superlatives
grep -rn -E "(powerful|beautifully|dramatically|perfect|amazing)" overview/

# Check for conversational phrases
grep -rn -E "(Think of|imagine|Let's|you'll)" overview/

# Check for terminology consistency
grep -rn "knowledge package" overview/
```

Results: All primary documentation files (skills.mdx, plugins.mdx, creating.mdx) now use factual language consistent with PR #339.

## PR #339 Review Feedback Addressed

Based on OpenHands agent review at https://github.com/OpenHands/docs/pull/339:

### ✅ Issue 1: Missing Monitoring Section
**Status:** RESOLVED
- Created dedicated `overview/skills/monitoring.mdx` page covering all monitoring content from blog
- Covers logging, evaluation, dashboarding, and aggregation workflows
- Includes practical PR review skill examples with actual metrics
- Added navigation links from creating.mdx, skills.mdx, and creating.mdx Further Reading
- Chose separate page instead of 116-line section to keep creating.mdx focused

### ✅ Issue 2: No Link to Observability Guide
**Status:** RESOLVED
- Added link in monitoring.mdx: "See the [SDK Observability Guide](/sdk/guides/observability)"
- Added to creating.mdx Further Reading section
- Provides clear path to technical implementation details

### ✅ Issue 3: Missing GitHub CI/Actions Example
**Status:** RESOLVED
- Added "Deployment in Automated Workflows" section in monitoring.mdx
- References GitHub Actions examples in extensions repository
- Links to PR review action and evaluation workflow examples
- Added GitHub Workflows link to creating.mdx Further Reading

### ℹ️ Issue 4: Path Inconsistency
**Status:** VERIFIED AS CORRECT
- Reviewer mentioned `~/.agents/skills/` vs `~/.openhands/skills/`
- Verification shows documentation is consistent:
- User-level: `~/.openhands/skills/` (CLI)
- Repo-level: `.agents/skills/` (all platforms)
- No changes needed

### ℹ️ Issue 5: Duplicate Nav Entry
**Status:** OUT OF SCOPE
- Reviewer mentioned duplicate `prompting-best-practices` in docs.json
- Not related to skills/plugins documentation changes
- Should be addressed separately if still present

## Writing Style

All additions maintain the technical, down-to-earth tone from the blog:
- Direct, factual statements
- Practical examples with real code/metrics
- No superlatives or marketing language
- Clear headings and structure
- Actionable guidance

## Next Steps (if needed)

To complete comprehensive documentation alignment:
1. Review secondary skills documentation files (adding.mdx, org.mdx, etc.)
2. Check SDK documentation for similar language patterns
3. Review quickstart and tutorial content
4. Verify consistency across all platform-specific guides

## Date
2025-03-06 (based on PR review date)
15 changes: 15 additions & 0 deletions docs.json
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,19 @@
{
"group": "Essential Guidelines",
"pages": [
"overview/model-context-protocol",
{
"group": "Skills",
"pages": [
"overview/skills",
"overview/skills/repo",
"overview/skills/keyword",
"overview/skills/org",
"overview/skills/public",
"overview/skills/adding"
]
},
"overview/plugins",
"openhands/usage/essential-guidelines/when-to-use-openhands",
"openhands/usage/tips/prompting-best-practices",
"openhands/usage/essential-guidelines/good-vs-bad-instructions",
Expand All @@ -42,6 +55,8 @@
{
"group": "Onboarding OpenHands",
"pages": [
"openhands/usage/tips/prompting-best-practices",
"overview/skills/creating",
"openhands/usage/customization/repository",
"overview/skills/repo"
]
Expand Down
Loading
Loading