Initial commit
This commit is contained in:
133
skills/baseline-quality-assessment/reference/components.md
Normal file
133
skills/baseline-quality-assessment/reference/components.md
Normal file
@@ -0,0 +1,133 @@
|
||||
# Baseline Quality Assessment Components
|
||||
|
||||
**Purpose**: V_meta(s₀) calculation components for strong iteration 0
|
||||
**Target**: V_meta(s₀) ≥ 0.40 for rapid convergence
|
||||
|
||||
---
|
||||
|
||||
## Formula
|
||||
|
||||
```
|
||||
V_meta(s₀) = 0.4 × completeness +
|
||||
0.3 × transferability +
|
||||
0.3 × automation_effectiveness
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Component 1: Completeness (40%)
|
||||
|
||||
**Definition**: Initial pattern/taxonomy coverage
|
||||
|
||||
**Calculation**:
|
||||
```
|
||||
completeness = initial_items / estimated_final_items
|
||||
```
|
||||
|
||||
**Achieve ≥0.50**:
|
||||
- Analyze ALL available data (3-5 hours)
|
||||
- Create 10-15 initial categories/patterns
|
||||
- Classify ≥70% of observed cases
|
||||
|
||||
**Example (Error Recovery)**:
|
||||
```
|
||||
Initial: 10 categories (1,056/1,336 = 79.1% coverage)
|
||||
Estimated final: 12-13 categories
|
||||
Completeness: 10/12.5 = 0.80
|
||||
Contribution: 0.4 × 0.80 = 0.32
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Component 2: Transferability (30%)
|
||||
|
||||
**Definition**: Reusable patterns from prior art
|
||||
|
||||
**Calculation**:
|
||||
```
|
||||
transferability = borrowed_patterns / total_patterns_needed
|
||||
```
|
||||
|
||||
**Achieve ≥0.30**:
|
||||
- Research similar methodologies (1-2 hours)
|
||||
- Identify industry standards
|
||||
- Document borrowable patterns (≥30%)
|
||||
|
||||
**Example (Error Recovery)**:
|
||||
```
|
||||
Borrowed: 5 industry error patterns
|
||||
Total needed: ~10
|
||||
Transferability: 5/10 = 0.50
|
||||
Contribution: 0.3 × 0.50 = 0.15
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Component 3: Automation (30%)
|
||||
|
||||
**Definition**: Early identification of high-ROI automation
|
||||
|
||||
**Calculation**:
|
||||
```
|
||||
automation_effectiveness = identified_tools / expected_tools
|
||||
```
|
||||
|
||||
**Achieve ≥0.30**:
|
||||
- Frequency analysis (1 hour)
|
||||
- Identify top 3-5 automation candidates
|
||||
- Estimate ROI (≥5x)
|
||||
|
||||
**Example (Error Recovery)**:
|
||||
```
|
||||
Identified: 3 tools (all with >20x ROI)
|
||||
Expected final: 3 tools
|
||||
Automation: 3/3 = 1.0
|
||||
Contribution: 0.3 × 1.0 = 0.30
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Quality Levels
|
||||
|
||||
### Excellent (V_meta ≥ 0.60)
|
||||
|
||||
**Achieves**:
|
||||
- Completeness: ≥0.70
|
||||
- Transferability: ≥0.60
|
||||
- Automation: ≥0.70
|
||||
|
||||
**Effort**: 6-10 hours
|
||||
**Outcome**: 3-4 iterations
|
||||
|
||||
### Good (V_meta = 0.40-0.59)
|
||||
|
||||
**Achieves**:
|
||||
- Completeness: ≥0.50
|
||||
- Transferability: ≥0.30
|
||||
- Automation: ≥0.30
|
||||
|
||||
**Effort**: 4-6 hours
|
||||
**Outcome**: 4-5 iterations
|
||||
|
||||
### Fair (V_meta = 0.20-0.39)
|
||||
|
||||
**Achieves**:
|
||||
- Completeness: 0.30-0.50
|
||||
- Transferability: 0.20-0.30
|
||||
- Automation: 0.20-0.30
|
||||
|
||||
**Effort**: 2-4 hours
|
||||
**Outcome**: 5-7 iterations
|
||||
|
||||
### Poor (V_meta < 0.20)
|
||||
|
||||
**Indicates**:
|
||||
- Minimal baseline work
|
||||
- Exploratory phase needed
|
||||
|
||||
**Effort**: <2 hours
|
||||
**Outcome**: 7-10 iterations
|
||||
|
||||
---
|
||||
|
||||
**Source**: BAIME Baseline Quality Assessment
|
||||
Reference in New Issue
Block a user