mirror of
https://github.com/czlonkowski/n8n-skills.git
synced 2026-03-16 23:43:08 +00:00
feat: Complete Skill #4 - n8n Validation Expert
Implements comprehensive validation error interpretation and systematic fixing guidance. Addresses the validation feedback loop problem (15,107 loops from 19,113 errors). Files created: - 4 evaluations testing error interpretation, false positives, auto-sanitization, validation loop - SKILL.md (690 lines) - Validation philosophy, loop pattern, profiles, auto-sanitization - ERROR_CATALOG.md (865 lines) - 9 error types with examples and fixes - FALSE_POSITIVES.md (669 lines) - 6 false positive patterns with decision framework - README.md (329 lines) - Skill metadata with telemetry statistics Key features: - Error severity levels (errors/warnings/suggestions) - Validation loop pattern (2-3 iterations, 23s+58s average) - 4 validation profiles (minimal/runtime/ai-friendly/strict) - Auto-sanitization system (operator structure fixes) - False positive recognition (~40% of warnings acceptable) - Error distribution analysis (missing_required 45%, invalid_value 28%) - Recovery strategies (progressive validation, error triage, clean connections) - Decision framework for warning acceptance Error catalog: - missing_required (45%) - Required field not provided - invalid_value (28%) - Value doesn't match allowed options - type_mismatch (12%) - Wrong data type - invalid_expression (8%) - Expression syntax errors - invalid_reference (5%) - Referenced node doesn't exist - operator_structure (2%) - Auto-fixed automatically False positive patterns: - Missing error handling (acceptable for dev/test) - No retry logic (acceptable for internal APIs) - Missing rate limiting (acceptable for low volume) - Unbounded queries (acceptable for small datasets) - Missing input validation (acceptable for trusted sources) - Hardcoded credentials (never acceptable!) Validation insights: - 79% of validation errors lead to feedback loops - Average 2-3 iterations to valid configuration - 94% success rate within 3 iterations - ai-friendly profile reduces false positives by 60% - Auto-sanitization handles operator structure issues automatically Total: ~2,553 lines across 8 files Based on analysis of 19,113 validation errors and 15,107 feedback loops. 🤖 Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en
This commit is contained in:
@@ -0,0 +1,13 @@
|
||||
{
|
||||
"id": "validation-001",
|
||||
"skills": ["n8n-validation-expert"],
|
||||
"query": "I'm getting a validation error: 'Missing required field: channel'. What does this mean and how do I fix it?",
|
||||
"expected_behavior": [
|
||||
"Identifies this as a 'missing_required' error type",
|
||||
"Explains that the node configuration is incomplete",
|
||||
"Provides guidance on finding what value to provide",
|
||||
"Suggests using get_node_essentials to see required fields",
|
||||
"Explains where to add the missing field in the node configuration",
|
||||
"May reference ERROR_CATALOG.md for details"
|
||||
]
|
||||
}
|
||||
14
evaluations/validation-expert/eval-002-false-positive.json
Normal file
14
evaluations/validation-expert/eval-002-false-positive.json
Normal file
@@ -0,0 +1,14 @@
|
||||
{
|
||||
"id": "validation-002",
|
||||
"skills": ["n8n-validation-expert"],
|
||||
"query": "Validation is warning me about 'best_practice' issues like error handling and retries. Do I need to fix these?",
|
||||
"expected_behavior": [
|
||||
"Identifies these as warnings, not errors",
|
||||
"Explains difference between errors (must fix) and warnings (should fix)",
|
||||
"Discusses when warnings can be acceptable (false positives)",
|
||||
"References FALSE_POSITIVES.md",
|
||||
"Suggests using 'ai-friendly' validation profile to reduce false positives",
|
||||
"Explains that warnings don't prevent workflow activation",
|
||||
"Provides guidance on when to address warnings vs when to accept them"
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,14 @@
|
||||
{
|
||||
"id": "validation-003",
|
||||
"skills": ["n8n-validation-expert"],
|
||||
"query": "I'm getting an error about 'Binary operator cannot have singleValue property'. What does this mean?",
|
||||
"expected_behavior": [
|
||||
"Identifies this as an operator structure issue",
|
||||
"Explains auto-sanitization system",
|
||||
"States that this error will be automatically fixed on next workflow update",
|
||||
"Explains binary vs unary operator distinction",
|
||||
"References the auto-sanitization section",
|
||||
"Suggests that user doesn't need to manually fix this",
|
||||
"May suggest running n8n_update_partial_workflow or validate_workflow to trigger auto-fix"
|
||||
]
|
||||
}
|
||||
14
evaluations/validation-expert/eval-004-validation-loop.json
Normal file
14
evaluations/validation-expert/eval-004-validation-loop.json
Normal file
@@ -0,0 +1,14 @@
|
||||
{
|
||||
"id": "validation-004",
|
||||
"skills": ["n8n-validation-expert"],
|
||||
"query": "I fixed one validation error but now I'm getting a different one. How do I systematically fix all validation errors?",
|
||||
"expected_behavior": [
|
||||
"Explains the validation loop pattern",
|
||||
"References telemetry data (7,841 validate → fix cycles, avg 23s thinking + 58s fixing)",
|
||||
"Provides step-by-step process: validate → read errors → fix → validate again",
|
||||
"Emphasizes iterative approach",
|
||||
"Suggests fixing errors one at a time",
|
||||
"May recommend validate_node_operation for individual nodes",
|
||||
"Explains that this is normal workflow (not a problem)"
|
||||
]
|
||||
}
|
||||
Reference in New Issue
Block a user