835 Commits

Author SHA1 Message Date
Romuald Członkowski
1bbfaabbc2 fix: add structural hash tracking for workflow mutations (#422)
* feat: add structural hashes and success tracking for workflow mutations

Enables cross-referencing workflow_mutations with telemetry_workflows by adding structural hashes (nodeTypes + connections) alongside existing full hashes.

**Database Changes:**
- Added workflow_structure_hash_before/after columns
- Added is_truly_successful computed column
- Created 3 analytics views: successful_mutations, mutation_training_data, mutations_with_workflow_quality
- Created 2 helper functions: get_mutation_success_rate_by_intent(), get_mutation_crossref_stats()

**Code Changes:**
- Updated mutation-tracker.ts to generate both hash types
- Updated mutation-types.ts with new fields
- Auto-converts to snake_case via existing toSnakeCase() function

**Testing:**
- Added 5 new unit tests for structural hash generation
- All 17 tests passing

**Tooling:**
- Created backfill script to populate hashes for existing 1,499 mutations
- Created comprehensive documentation (STRUCTURAL_HASHES.md)

**Impact:**
- Before: 0% cross-reference match rate
- After: Expected 60-70% match rate (post-backfill)
- Unlocks quality impact analysis, training data curation, and mutation pattern insights

Conceived by Romuald Członkowski - www.aiadvisors.pl/en

* fix: correct test operation types for structural hash tests

Fixed TypeScript errors in mutation-tracker tests by adding required
'updates' parameter to updateNode operations. Used 'as any' for test
operations to maintain backward compatibility while tests are updated.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* chore: remove documentation files from tracking

Removed internal documentation files from version control:
- Telemetry implementation docs
- Implementation roadmap
- Disabled tools analysis docs

These files are for internal reference only.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* chore: remove telemetry documentation files from tracking

Removed all telemetry analysis and documentation files from root directory.
These files are for internal reference only and should not be in version control.

Files removed:
- TELEMETRY_ANALYSIS*.md
- TELEMETRY_MUTATION_SPEC.md
- TELEMETRY_*_DATASET.md
- VALIDATION_ANALYSIS*.md

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* chore: bump version to 2.22.18 and update CHANGELOG

Version 2.22.18 adds structural hash tracking for workflow mutations,
enabling cross-referencing with workflow quality data and automated
success detection.

Key changes:
- Added workflowStructureHashBefore/After fields
- Added isTrulySuccessful computed field
- Enhanced mutation tracking with structural hashes
- All tests passing (17/17)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* chore: remove migration and documentation files from PR

Removed internal database migration files and documentation from
version control:
- docs/migrations/
- docs/telemetry/

Updated CHANGELOG to remove database migration references.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en
v2.22.18
2025-11-14 13:57:54 +01:00
Romuald Członkowski
597bd290b6 fix: critical telemetry improvements for data quality and security (#421)
* fix: critical telemetry improvements for data quality and security

Fixed three critical issues in workflow mutation telemetry:

1. Fixed Inconsistent Sanitization (Security Critical)
   - Problem: 30% of workflows unsanitized, exposing credentials/tokens
   - Solution: Use robust WorkflowSanitizer.sanitizeWorkflowRaw()
   - Impact: 100% sanitization with 17 sensitive patterns redacted
   - Files: workflow-sanitizer.ts, mutation-tracker.ts

2. Enabled Validation Data Capture (Data Quality)
   - Problem: Zero validation metrics captured (all NULL)
   - Solution: Add pre/post mutation validation with WorkflowValidator
   - Impact: Measure mutation quality, track error resolution
   - Non-blocking validation that captures errors/warnings
   - Files: handlers-workflow-diff.ts

3. Improved Intent Capture (Data Quality)
   - Problem: 92.62% generic "Partial workflow update" intents
   - Solution: Enhanced docs + automatic intent inference
   - Impact: Meaningful intents auto-generated from operations
   - Files: n8n-update-partial-workflow.ts, handlers-workflow-diff.ts

Expected Results:
- 100% sanitization coverage (up from 70%)
- 100% validation capture (up from 0%)
- 50%+ meaningful intents (up from 7.33%)

Version bumped to 2.22.17

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

Co-Authored-By: Claude <noreply@anthropic.com>

* perf: implement validator instance caching to avoid redundant initialization

- Add module-level cached WorkflowValidator instance
- Create getValidator() helper to reuse validator across mutations
- Update pre/post mutation validation to use cached instance
- Avoids redundant NodeSimilarityService initialization on every mutation

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: restore backward-compatible sanitization with context preservation

Fixed CI test failures by updating WorkflowSanitizer to use pattern-specific
placeholders while maintaining backward compatibility:

Changes:
- Convert SENSITIVE_PATTERNS to PatternDefinition objects with specific placeholders
- Update sanitizeString() to preserve context (Bearer prefix, URL paths)
- Refactor sanitizeObject() to handle sensitive fields vs URL fields differently
- Remove overly greedy field patterns that conflicted with token patterns

Pattern-specific placeholders:
- [REDACTED_URL_WITH_AUTH] for URLs with credentials
- [REDACTED_TOKEN] for long tokens (32+ chars)
- [REDACTED_APIKEY] for OpenAI-style keys
- Bearer [REDACTED] for Bearer tokens (preserves "Bearer " prefix)
- [REDACTED] for generic sensitive fields

Test Results:
- All 13 mutation-tracker tests passing
- URL with auth: preserves path after credentials
- Long tokens: properly detected and marked
- OpenAI keys: correctly identified
- Bearer tokens: prefix preserved
- Sensitive field names: generic redaction for non-URL fields

Fixes #421 CI failures

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: prevent double-redaction in workflow sanitizer

Added safeguard to stop pattern matching once a placeholder is detected,
preventing token patterns from matching text inside placeholders like
[REDACTED_URL_WITH_AUTH].

Also expanded database URL pattern to match full URLs including port and
path, and updated test expectations to match context-preserving sanitization.

Fixes:
- Database URLs now properly sanitized to [REDACTED_URL_WITH_AUTH]
- Prevents [[REDACTED]] double-redaction issue
- All 25 workflow-sanitizer tests passing
- No regression in mutation-tracker tests

Conceived by Romuald Członkowski - www.aiadvisors.pl/en

---------

Co-authored-by: Claude <noreply@anthropic.com>
v2.22.17
2025-11-13 22:13:31 +01:00
Romuald Członkowski
99c5907b71 feat: enhance workflow mutation telemetry for better AI responses (#419)
* feat: add comprehensive telemetry for partial workflow updates

Implement telemetry infrastructure to track workflow mutations from
partial update operations. This enables data-driven improvements to
partial update tooling by capturing:

- Workflow state before and after mutations
- User intent and operation patterns
- Validation results and improvements
- Change metrics (nodes/connections modified)
- Success/failure rates and error patterns

New Components:
- Intent classifier: Categorizes mutation patterns
- Intent sanitizer: Removes PII from user instructions
- Mutation validator: Ensures data quality before tracking
- Mutation tracker: Coordinates validation and metric calculation

Extended Components:
- TelemetryManager: New trackWorkflowMutation() method
- EventTracker: Mutation queue management
- BatchProcessor: Mutation data flushing to Supabase

MCP Tool Enhancements:
- n8n_update_partial_workflow: Added optional 'intent' parameter
- n8n_update_full_workflow: Added optional 'intent' parameter
- Both tools now track mutations asynchronously

Database Schema:
- New workflow_mutations table with 20+ fields
- Comprehensive indexes for efficient querying
- Supports deduplication and data analysis

This telemetry system is:
- Privacy-focused (PII sanitization, anonymized users)
- Non-blocking (async tracking, silent failures)
- Production-ready (batching, retries, circuit breaker)
- Backward compatible (all parameters optional)

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* fix: correct SQL syntax for expression index in workflow_mutations schema

The expression index for significant changes needs double parentheses
around the arithmetic expression to be valid PostgreSQL syntax.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* fix: enable RLS policies for workflow_mutations table

Enable Row-Level Security and add policies:
- Allow anonymous (anon) inserts for telemetry data collection
- Allow authenticated reads for data analysis and querying

These policies are required for the telemetry system to function
correctly with Supabase, as the MCP server uses the anon key to
insert mutation data.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* fix: reduce mutation auto-flush threshold from 5 to 2

Lower the auto-flush threshold for workflow mutations from 5 to 2 to ensure
more timely data persistence. Since mutations are less frequent than regular
telemetry events, a lower threshold provides:

- Faster data persistence (don't wait for 5 mutations)
- Better testing experience (easier to verify with fewer operations)
- Reduced risk of data loss if process exits before threshold
- More responsive telemetry for low-volume mutation scenarios

This complements the existing 5-second periodic flush and process exit
handlers, ensuring mutations are persisted promptly.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* fix: improve mutation telemetry error logging and diagnostics

Changes:
- Upgrade error logging from debug to warn level for better visibility
- Add diagnostic logging to track mutation processing
- Log telemetry disabled state explicitly
- Add context info (sessionId, intent, operationCount) to error logs
- Remove 'await' from telemetry calls to make them truly non-blocking

This will help identify why mutations aren't being persisted to the
workflow_mutations table despite successful workflow operations.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

* feat: enhance workflow mutation telemetry for better AI responses

Improve workflow mutation tracking to capture comprehensive data that helps provide better responses when users update workflows. This enhancement collects workflow state, user intent, and operation details to enable more context-aware assistance.

Key improvements:
- Reduce auto-flush threshold from 5 to 2 for more reliable mutation tracking
- Add comprehensive workflow and credential sanitization to mutation tracker
- Document intent parameter in workflow update tools for better UX
- Fix mutation queue handling in telemetry manager (flush now handles 3 queues)
- Add extensive unit tests for mutation tracking and validation (35 new tests)

Technical changes:
- mutation-tracker.ts: Multi-layer sanitization (workflow, node, parameter levels)
- batch-processor.ts: Support mutation data flushing to Supabase
- telemetry-manager.ts: Auto-flush mutations at threshold 2, track mutations queue
- handlers-workflow-diff.ts: Track workflow mutations with sanitized data
- Tests: 13 tests for mutation-tracker, 22 tests for mutation-validator

The intent parameter messaging emphasizes user benefit ("helps to return better response") rather than technical implementation details.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: bump version to 2.22.16 with telemetry changelog

Updated package.json and package.runtime.json to version 2.22.16.
Added comprehensive CHANGELOG entry documenting workflow mutation
telemetry enhancements for better AI-powered workflow assistance.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: resolve TypeScript lint errors in telemetry tests

Fixed type issues in mutation-tracker and mutation-validator tests:
- Import and use MutationToolName enum instead of string literals
- Fix ValidationResult.errors to use proper object structure
- Add UpdateNodeOperation type assertion for operation with nodeName

All TypeScript errors resolved, lint now passes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

Co-Authored-By: Claude <noreply@anthropic.com>

---------

Co-authored-by: Claude <noreply@anthropic.com>
v2.22.16
2025-11-13 14:21:51 +01:00
Romuald Członkowski
77151e013e chore: update n8n to 1.119.1 (#414) v2.22.15 2025-11-11 22:28:50 +01:00
Romuald Członkowski
14f3b9c12a Merge pull request #411 from czlonkowski/feat/disabled-tools-env-var
feat: Add DISABLED_TOOLS environment variable for tool filtering (Issue #410)
v2.22.14
2025-11-09 17:47:42 +01:00
czlonkowski
eb362febd6 test: Add critical missing tests for DISABLED_TOOLS feature
Add tests for two critical features identified by code review:

1. 10KB Safety Limit Test:
   - Verify DISABLED_TOOLS environment variable is truncated at 10KB
   - Test with 15KB input to ensure truncation works
   - Confirm first tools are parsed, last tools are excluded
   - Prevents DoS attacks from massive environment variables

2. Security Information Disclosure Test:
   - Verify error messages only reveal attempted tool name
   - Ensure full list of disabled tools is NOT leaked
   - Critical security test to prevent configuration disclosure
   - Tests defense against information leakage attacks

Test Coverage:
- Total tests: 47 (up from 45)
- Both tests passing
- Addresses critical gaps from code review

Files Modified:
- tests/unit/mcp/disabled-tools-additional.test.ts

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 17:27:57 +01:00
czlonkowski
821ace310e refactor: Improve DISABLED_TOOLS implementation based on code review
Performance Optimization:
- Add caching to getDisabledTools() to prevent 3x parsing per request
- Cache result as instance property disabledToolsCache
- Reduces overhead from 3x to 1x per server instance

Security Improvements:
- Fix information disclosure in error responses
- Only reveal the attempted tool name, not full list of disabled tools
- Prevents leaking security configuration details

Safety Limits:
- Add 10KB maximum length for DISABLED_TOOLS environment variable
- Add 200-tool maximum limit to prevent abuse
- Include warnings when limits are exceeded

Code Quality:
- Add clarifying comment for defense-in-depth guard in executeTool()
- Change logging level from info to debug for frequent operations
- Add comprehensive JSDoc to TestableN8NMCPServer test classes
- Document test wrapper pattern and exposed methods

Test Updates:
- Update test to verify 200-tool safety limit enforcement
- All 45 tests passing with improved coverage

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-09 17:00:23 +01:00
czlonkowski
53252adc68 feat: Add DISABLED_TOOLS environment variable for tool filtering (Issue #410)
Added DISABLED_TOOLS environment variable to filter specific tools from registration at startup, enabling deployment-specific tool configuration for multi-tenant deployments, security hardening, and feature flags.

## Implementation

- Added getDisabledTools() method to parse comma-separated tool names from env var
- Modified ListToolsRequestSchema handler to filter both documentation and management tools
- Modified CallToolRequestSchema handler to reject disabled tool calls with clear error messages
- Added defense-in-depth guard in executeTool() method

## Features

- Environment variable format: DISABLED_TOOLS=tool1,tool2,tool3
- O(1) lookup performance using Set data structure
- Clear error messages with TOOL_DISABLED code
- Backward compatible (no DISABLED_TOOLS = all tools enabled)
- Comprehensive logging for observability

## Use Cases

- Multi-tenant: Hide tools that check global env vars
- Security: Disable management tools in production
- Feature flags: Gradually roll out new tools
- Deployment-specific: Different tool sets for cloud vs self-hosted

## Testing

- 45 comprehensive tests (all passing)
- 95% feature code coverage
- Unit tests + additional test scenarios
- Performance tested with 1000 tools (<100ms)

## Files Modified

- src/mcp/server.ts - Core implementation (~40 lines)
- .env.example, .env.docker - Configuration documentation
- tests/unit/mcp/disabled-tools*.test.ts - Comprehensive tests
- package.json, package.runtime.json - Version bump to 2.22.14
- CHANGELOG.md - Full documentation

Resolves #410

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-09 16:26:47 +01:00
Romuald Członkowski
2010d77ed8 Merge pull request #407 from czlonkowski/feat/telemetry-quick-wins-validation-errors
feat: Telemetry-driven quick wins to reduce AI agent validation errors by 30-40%
v2.22.13
2025-11-08 19:09:27 +01:00
czlonkowski
caf9383ba1 test: Add comprehensive edge case coverage for telemetry quick wins
Added 20 edge case tests based on code review recommendations:

**Duplicate ID Validation (4 tests)**:
- Multiple duplicate IDs (3+ nodes with same ID)
- Duplicate IDs with same node type
- Duplicate IDs with empty/null node names
- Duplicate IDs with missing node properties

**AI Agent Validator (16 tests)**:

maxIterations edge cases (7 tests):
- Boundary values: 0 (reject), 1 (accept), 51 (warn), MAX_SAFE_INTEGER (warn)
- Invalid types: NaN (reject), negative decimal (reject)
- Threshold testing: 50 vs 51

promptType validation (4 tests):
- Whitespace-only text (reject)
- Very long text 3200+ chars (accept)
- undefined/null text (reject)

System message validation (5 tests):
- Empty/whitespace messages (suggest adding)
- Very long messages >1000 chars (accept)
- Special characters, emojis, unicode (accept)
- Multi-line formatting (accept)
- Boundary: 19 chars (warn), 20 chars (accept)

**Test Quality Improvements**:
- Fixed flaky system message test (changed from expect.stringContaining to .some())
- All tests are deterministic
- Comprehensive inline comments
- Follows existing test patterns

All 20 new tests passing. Zero regressions.

Concieved by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-08 18:49:59 +01:00
czlonkowski
8728a808ac fix: AI Agent validator not executing due to nodeType format mismatch (Critical)
Fixed critical bug where AI Agent validator never executed, missing 179 configuration errors (30% of all telemetry-identified failures).

The Bug:
- Switch case checked for '@n8n/n8n-nodes-langchain.agent' (full package format)
- But nodeType was normalized to 'nodes-langchain.agent' before reaching switch
- Result: AI Agent validator never matched, never executed

The Fix:
- Changed case to 'nodes-langchain.agent' to match normalized format
- Now correctly catches prompt configuration, maxIterations, error handling issues

Files Changed:
- src/services/enhanced-config-validator.ts:322 - Fixed nodeType format
- tests/unit/services/enhanced-config-validator.test.ts - Added validateAIAgent to mock and verification test
- CHANGELOG.md - Added bug fix section to 2.22.13 (not separate version)

Testing:
- npm test -- tests/unit/services/enhanced-config-validator.test.ts
- ✓ All 51 tests pass including new AI Agent validation test

Discovery:
Discovered by n8n-mcp-tester agent during post-deployment verification of 2.22.13 improvements. The agent attempted to validate an AI Agent node configuration and discovered the validator was never being called.

Impact:
- Without fix: 179 AI Agent configuration errors (30%) go undetected
- With fix: All AI Agent validation rules now execute correctly

Version: 2.22.13 (kept under same version as original implementation)

Concieved by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-08 18:25:20 +01:00
czlonkowski
60ab66d64d feat: telemetry-driven quick wins to reduce AI agent validation errors by 30-40%
Enhanced tools documentation, duplicate ID errors, and AI Agent validator based on telemetry analysis of 593 validation errors across 3 categories:
- 378 errors: Duplicate node IDs (64%)
- 179 errors: AI Agent configuration (30%)
- 36 errors: Other validations (6%)

Quick Win #1: Enhanced tools documentation (src/mcp/tools-documentation.ts)
- Added prominent warnings to call get_node_essentials() FIRST before configuring nodes
- Emphasized 5KB vs 100KB+ size difference between essentials and full info
- Updated workflow patterns to prioritize essentials over get_node_info

Quick Win #2: Improved duplicate ID error messages (src/services/workflow-validator.ts)
- Added crypto import for UUID generation examples
- Enhanced error messages with node indices, names, and types
- Included crypto.randomUUID() example in error messages
- Helps AI agents understand EXACTLY which nodes conflict and how to fix

Quick Win #3: Added AI Agent node-specific validator (src/services/node-specific-validators.ts)
- Validates prompt configuration (promptType + text requirement)
- Checks maxIterations bounds (1-50 recommended)
- Suggests error handling (onError + retryOnFail)
- Warns about high iteration limits (cost/performance impact)
- Integrated into enhanced-config-validator.ts

Test Coverage:
- Added duplicate ID validation tests (workflow-validator.test.ts)
- Added AI Agent validator tests (node-specific-validators.test.ts:2312-2491)
- All new tests passing (3527 total passing)

Version: 2.22.12 → 2.22.13

Expected Impact: 30-40% reduction in AI agent validation errors

Technical Details:
- Telemetry analysis: 593 validation errors (Dec 2024 - Jan 2025)
- 100% error recovery rate maintained (validation working correctly)
- Root cause: Documentation/guidance gaps, not validation logic failures
- Solution: Proactive guidance at decision points

References:
- Telemetry analysis findings
- Issue #392 (helpful error messages pattern)
- Existing Slack validator pattern (node-specific-validators.ts:98-230)

Concieved by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-08 18:07:26 +01:00
Romuald Członkowski
eee52a7f53 Merge pull request #406 from czlonkowski/fix/helpful-error-changes-vs-updates
fix: Add helpful error messages for 'changes' vs 'updates' parameter (Issue #392)
v2.22.12
2025-11-08 13:39:26 +01:00
czlonkowski
a66cb18cce fix: Add helpful error messages for 'changes' vs 'updates' parameter (Issue #392)
Fixed cryptic "Cannot read properties of undefined (reading 'name')" error when
users mistakenly use 'changes' instead of 'updates' in updateNode operations.

Changes:
- Added early validation in validateUpdateNode() to detect common parameter mistake
- Provides clear, educational error messages with examples
- Fixed outdated documentation example in VS_CODE_PROJECT_SETUP.md
- Added comprehensive test coverage (2 test cases)

Error Messages:
- Before: "Diff engine error: Cannot read properties of undefined (reading 'name')"
- After: "Invalid parameter 'changes'. The updateNode operation requires 'updates'
  (not 'changes'). Example: {type: "updateNode", nodeId: "abc", updates: {...}}"

Testing:
- Test coverage: 85% confidence (production ready)
- n8n-mcp-tester: All 3 test cases passed
- Code review: Approved with minor optional suggestions

Impact:
- AI agents now receive actionable error messages
- Self-correction enabled through clear examples
- Zero breaking changes (backward compatible)
- Follows existing patterns from Issue #249

Files Modified:
- src/services/workflow-diff-engine.ts (10 lines added)
- docs/VS_CODE_PROJECT_SETUP.md (1 line fixed)
- tests/unit/services/workflow-diff-engine.test.ts (2 tests added)
- CHANGELOG.md (comprehensive entry)
- package.json (version bump to 2.22.12)

Fixes #392

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-08 13:29:22 +01:00
Romuald Członkowski
0e0f0998af Merge pull request #403 from czlonkowski/feat/workflow-activation-operations v2.22.11 2025-11-07 07:54:33 +01:00
czlonkowski
08a4be8370 fix: Add missing typeVersion to workflow activation test nodes
Fixed TypeScript linting errors in workflow-diff-engine.test.ts by adding
typeVersion: 1 to all test nodes that were missing it.

Fixes CI linting failures in Test Suite workflow.

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-07 00:12:36 +01:00
czlonkowski
3578f2cc31 test: Add comprehensive test coverage for workflow activation/deactivation
Added 25 new tests to improve coverage for workflow activation/deactivation feature:
- 7 tests for handlers-workflow-diff.test.ts (activation/deactivation handler logic)
- 8 tests for workflow-diff-engine.test.ts (validate/apply activate/deactivate operations)
- 10 tests for n8n-api-client.test.ts (API client activation/deactivation methods)

Coverage improvements:
- Branch coverage increased from 77% to 85.58%
- All 3512 tests passing

Tests cover:
- Successful workflow activation/deactivation after updates
- Error handling for activation/deactivation failures
- Validation of activatable trigger nodes (webhook, schedule, etc.)
- Rejection of workflows without activatable triggers
- API client error cases (not found, already active/inactive, server errors)

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-06 23:58:34 +01:00
czlonkowski
4d3b8fbc91 fix: Remove outdated "Cannot activate" limitation from test expectations
After implementing workflow activation/deactivation operations, the
"Cannot activate" limitation no longer applies. Updated the test to
match the current API capabilities.

Related to #399

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-06 23:27:13 +01:00
czlonkowski
5688384113 fix: Update test expectations for workflow activation response format
The workflow activation/deactivation implementation added two new fields
to the response details object (active and warnings). Updated test
expectations to match the new response format.

Fixes CI test failures in handlers-workflow-diff.test.ts

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-06 23:14:11 +01:00
czlonkowski
346fa3c8d2 feat: Add workflow activation/deactivation via diff operations
Implements workflow activation and deactivation as diff operations in
n8n_update_partial_workflow tool, following the pattern of other
configuration operations.

Changes:
- Add activateWorkflow/deactivateWorkflow API methods
- Add operation types to diff engine
- Update tool documentation
- Remove activation limitation

Resolves #399
Credits: ArtemisAI, cmj-hub for investigation and initial implementation
Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-11-06 22:49:46 +01:00
czlonkowski
3d5ceae43f updated date 2025-11-06 00:21:41 +01:00
czlonkowski
1834d474a5 update privacy policy 2025-11-06 00:20:36 +01:00
Romuald Członkowski
a4ef1efaf8 fix: Gracefully handle FTS5 unavailability in sql.js fallback (#398)
Fixed critical startup crash when server falls back to sql.js adapter
due to Node.js version mismatches.

Problem:
- better-sqlite3 fails to load when Node runtime version differs from build version
- Server falls back to sql.js (pure JS, no native dependencies)
- Database health check crashed with "no such module: fts5"
- Server exits immediately, preventing Claude Desktop connection

Solution:
- Wrapped FTS5 health check in try-catch block
- Logs warning when FTS5 not available
- Server continues with fallback search (LIKE queries)
- Graceful degradation: works with any Node.js version

Impact:
- Server now starts successfully with sql.js fallback
- Works with Node v20 (Claude Desktop) even when built with Node v22
- Clear warnings about FTS5 unavailability
- Users can choose: sql.js (slower, works everywhere) or rebuild better-sqlite3 (faster)

Files Changed:
- src/mcp/server.ts: Added try-catch around FTS5 health check (lines 299-317)

Testing:
-  Tested with Node v20.17.0 (Claude Desktop)
-  Tested with Node v22.17.0 (build version)
-  All 6 startup checkpoints pass
-  Database health check passes with warning

Fixes: Claude Desktop connection failures with Node.js version mismatches

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en
v2.22.10
2025-11-04 16:14:16 +01:00
Romuald Członkowski
65f51ad8b5 chore: bump version to 2.22.9 (#395)
* chore: bump version to 2.22.9

Updated version number to trigger release workflow after n8n 1.118.1 update.
Previous version 2.22.8 was already released on 2025-10-28, so the release
workflow did not trigger when PR #393 was merged.

Changes:
- Bump package.json version from 2.22.8 to 2.22.9
- Update CHANGELOG.md with correct version and date

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: update n8n update workflow with lessons learned

Added new fast workflow section based on 2025-11-04 update experience:
- CRITICAL: Check existing releases first to avoid version conflicts
- Skip local tests - CI runs them anyway (saves 2-3 min)
- Integration test failures with 'unauthorized' are infrastructure issues
- Release workflow only triggers on version CHANGE
- Updated time estimates for fast vs full workflow

This will make future n8n updates smoother and faster.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: exclude versionCounter from workflow updates for n8n 1.118.1

n8n 1.118.1 returns versionCounter in GET /workflows/{id} responses but
rejects it in PUT /workflows/{id} updates with the error:
'request/body must NOT have additional properties'

This was causing all integration tests to fail in CI with n8n 1.118.1.

Changes:
- Added versionCounter to excluded properties in cleanWorkflowForUpdate()
- Tested and verified fix works with n8n 1.118.1 test instance

Fixes CI failures in PR #395

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: improve versionCounter fix with types and tests

- Add versionCounter type definition to Workflow and WorkflowExport interfaces
- Add comprehensive test coverage for versionCounter exclusion
- Update CHANGELOG with detailed bug fix documentation

Addresses code review feedback from PR #395

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

---------

Co-authored-by: Claude <noreply@anthropic.com>
v2.22.9
2025-11-04 11:33:54 +01:00
Romuald Członkowski
af6efe9e88 chore: update n8n to 1.118.1 and bump version to 2.22.8 (#393)
- Updated n8n from 1.117.2 to 1.118.1
- Updated n8n-core from 1.116.0 to 1.117.0
- Updated n8n-workflow from 1.114.0 to 1.115.0
- Updated @n8n/n8n-nodes-langchain from 1.116.2 to 1.117.0
- Rebuilt node database with 542 nodes (439 from n8n-nodes-base, 103 from @n8n/n8n-nodes-langchain)
- Updated README badge with new n8n version
- Updated CHANGELOG with dependency changes

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude <noreply@anthropic.com>
2025-11-03 22:27:56 +01:00
Romuald Członkowski
3f427f9528 Update n8n to 1.117.2 (#379) v2.22.8 2025-10-28 08:55:20 +01:00
Liz
18b8747005 Update CLAUDE_CODE_SETUP.md (#276)
* Update CLAUDE_CODE_SETUP.md

docs: Improve CLI setup for PowerShell and scope management

This commit introduces two improvements to the CLAUDE_CODE_SETUP.md documentation to enhance user experience, particularly for Windows users and those managing configuration scopes.

1.  Add PowerShell-Compatible Commands:
    The original `claude mcp add` commands use a syntax that fails in native Windows PowerShell due to its parameter parsing. This change adds dedicated code blocks for PowerShell, which correctly wrap the `-e` arguments in single quotes.

2.  Clarify Configuration Scope Management:
    The documentation previously lacked guidance on the default configuration scope and how to switch to a `project` scope. A new "Tips" section has been added to:
    - Explain the default scope and the purpose of `--scope project`.
    - Provide a clear, recommended CLI method for switching scopes.
    - Offer an advanced, manual method by editing the `.claude.json` file.

* Update CLAUDE_CODE_SETUP.md  again
2025-10-27 22:43:48 +01:00
Daniel Ishi
749f1c53eb docs: Emphasize MCP_MODE=stdio requirement for Claude Desktop (#377)
Fixes #376

Without this environment variable, Claude Desktop shows JSON parsing errors
because debug logs contaminate the JSON-RPC stdout channel.

Added prominent warning to Quick Start section explaining:
- Why MCP_MODE=stdio is required
- What happens without it (JSON parse errors)
- How it prevents the issue (suppresses console output)

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

Co-authored-by: Claude Code Assistant <noreply@anthropic.com>
2025-10-27 22:40:44 +01:00
Romuald Członkowski
892c4ed70a Resolve GitHub Issue 292 in n8n-mcp (#375)
* docs: add comprehensive documentation for removing node properties with undefined

Add detailed documentation section for property removal pattern in n8n_update_partial_workflow tool:
- New "Removing Properties with undefined" section explaining the pattern
- Examples showing basic, nested, and batch property removal
- Migration guide for deprecated properties (continueOnFail → onError)
- Best practices for when to use undefined
- Pitfalls to avoid (null vs undefined, mutual exclusivity, etc.)

This addresses the documentation gap reported in issue #292 where users
were confused about how to remove properties during node updates.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix: correct array property removal documentation in n8n_update_partial_workflow (Issue #292)

Fixed critical documentation error showing array index notation [0] which doesn't work.
The setNestedProperty implementation treats "headers[0]" as a literal object key, not an array index.

Changes:
- Updated nested property removal section to show entire array removal
- Corrected example rm5 to use "parameters.headers" instead of "parameters.headers[0]"
- Replaced misleading pitfall with accurate warning about array index notation not being supported

Impact:
- Prevents user confusion and non-functional code
- All examples now show correct, working patterns
- Clear warning helps users avoid this mistake

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

---------

Co-authored-by: Claude <noreply@anthropic.com>
v2.22.7
2025-10-26 11:07:30 +01:00
Romuald Członkowski
590dc087ac fix: resolve Docker port configuration mismatch (Issue #228) (#373) v2.22.6 2025-10-25 23:56:54 +02:00
Romuald Członkowski
ee7229b4db Merge pull request #372 from czlonkowski/fix/sync-package-runtime-version-2.22.3
fix: resolve release workflow YAML parsing errors with script-based approach
2025-10-25 21:23:10 +02:00
czlonkowski
b6683b8381 fix: resolve merge conflicts with main
Resolved conflicts in:
- package.json: accepted main's version (2.22.5)
- package.runtime.json: accepted main's version (2.22.5)
- .github/workflows/release.yml: kept script-based fix over heredoc approach

The script-based approach from this branch fixes the YAML parsing issues
that the main branch's heredoc approach causes.

Concieved by Romuald Członkowski - www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-25 21:11:19 +02:00
czlonkowski
b2300429fd fix: resolve release workflow YAML parsing errors with script-based approach
Replace heredoc-in-command-substitution pattern with script-based release notes
generation to fix YAML parser interpretation issues.

Root cause:
- GitHub Actions YAML parser interprets heredoc content inside $() as YAML structure
- Line 149 error: parser expected ':' after '### Initial Release'
- Pattern: NOTES=$(cat <<EOF...) causes content to be parsed as YAML

Solution:
- Created scripts/generate-initial-release-notes.js (mirrors generate-release-notes.js)
- Script outputs markdown that YAML parser doesn't interpret
- Keeps --- separators (safe in script output, not in heredocs)
- Consistent pattern across workflow (all release notes from scripts)

Benefits:
- Fixes CI failures since Oct 24 (commit 0e26ea6)
- YAML validates successfully with Python yaml.safe_load()
- Easier to test and maintain release note generation
- No need to change --- to ___ separators

Testing:
- Script generates correct markdown locally
- YAML syntax validated
- TypeScript builds and type checks pass

Fixes: Release workflow runs 18806809439, 18806655633, 18806137471, etc.
Related: PR #371 (different approach attempted)

Concieved by Romuald Członkowski - www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-25 21:00:17 +02:00
Romuald Członkowski
b87f638e52 Merge pull request #370 from czlonkowski/claude/version-bump-2.22.5-011CUTuNP2G3vGqSo8R9uubN
chore: bump version to 2.22.5
2025-10-25 17:19:15 +02:00
Claude
1f94427d54 chore: bump version to 2.22.5
Version bump to trigger automated release workflow and verify that the
YAML syntax fix (commit 79ef853) works correctly.

Previous release attempt for 2.22.4 failed due to YAML syntax error
(emoji in heredoc). This version bump will test the complete release
pipeline end-to-end.

Concieved by Romuald Członkowski - www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-25 14:58:01 +00:00
Romuald Członkowski
2eb459c80c Merge pull request #369 from czlonkowski/claude/investigate-npm-deployment-011CUTuNP2G3vGqSo8R9uubN 2025-10-25 14:54:57 +02:00
Claude
79ef853e8c fix: remove emoji from heredoc in release workflow to fix YAML parsing
The emoji (🎉) on line 147 inside the heredoc was causing GitHub Actions
YAML parser to fail with "Invalid workflow file" error on line 149.

Root cause analysis:
- Emojis work fine in echo statements throughout workflows
- But emojis as literal content inside heredocs within YAML break the parser
- The UTF-8 bytes of the emoji confuse GitHub Actions' YAML interpreter
- Error was reported at line 149 but caused by emoji on line 147

Solution:
- Removed emoji from heredoc content in release notes generation
- Heredoc now contains plain ASCII text only
- This follows the same pattern as other heredocs in the workflow

Related: Previous similar fix in commit 952a97e which changed from quoted
multi-line strings to heredocs. This fix completes that work by ensuring
heredoc content is parser-safe.

Fixes: https://github.com/czlonkowski/n8n-mcp/actions/runs/18802795662

Concieved by Romuald Członkowski - www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-25 12:23:28 +00:00
Romuald Członkowski
2682be33b8 fix: sync package.runtime.json to match package.json version 2.22.4 (#368) 2025-10-25 14:04:30 +02:00
czlonkowski
9f291154f2 fix: sync package.runtime.json to match package.json version 2.22.4
Addresses version desynchronization that caused release workflow failures.
The package.runtime.json was stuck at 2.22.0 while package.json advanced to 2.22.3,
preventing npm package publication since v2.21.1.

Changes:
- Bump package.json to 2.22.4
- Update package.runtime.json to 2.22.4 via sync script
- Ensures release workflow will properly detect version change

This fix will allow the automated release workflow to publish v2.22.4 to npm
and create the corresponding GitHub release.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-10-25 13:50:44 +02:00
Romuald Członkowski
bfff497020 Merge pull request #367 from czlonkowski/claude/review-issues-011CUSqcrxxERACFeLLWjPzj
…ssue #349)

Addresses "Cannot read properties of undefined (reading 'map')" error by adding validation and fallback handling for n8n API responses.

Changes:

Add response structure validation in listWorkflows, listExecutions, listCredentials, and listTags methods
Handle edge case where API returns array directly instead of {data: [], nextCursor} wrapper object
Provide clear error messages when response format is unexpected
Add logging when using fallback format handling
This fix ensures compatibility with different n8n API versions and prevents runtime errors when the response structure varies from expected.

Fixes #349

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-10-25 13:29:45 +02:00
czlonkowski
e522aec08c refactor: Eliminate DRY violation in n8n API response validation (issue #349)
Refactored defensive response validation from PR #367 to eliminate code duplication
and improve maintainability. Extracted duplicated validation logic into reusable
helper method with comprehensive test coverage.

Key improvements:
- Created validateListResponse<T>() helper method (75% code reduction)
- Added JSDoc documentation for backwards compatibility
- Added 29 comprehensive unit tests (100% coverage)
- Enhanced error messages with limited key exposure (max 5 keys)
- Consistent validation across all list operations

Testing:
- All 74 tests passing (including 29 new validation tests)
- TypeScript compilation successful
- Type checking passed

Related: PR #367, code review findings
Files: n8n-api-client.ts (refactored 4 methods), tests (+237 lines)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-10-25 13:19:23 +02:00
Claude
817bf7d211 fix: Add defensive response validation for n8n API list operations (issue #349)
Addresses "Cannot read properties of undefined (reading 'map')" error
by adding validation and fallback handling for n8n API responses.

Changes:
- Add response structure validation in listWorkflows, listExecutions,
  listCredentials, and listTags methods
- Handle edge case where API returns array directly instead of
  {data: [], nextCursor} wrapper object
- Provide clear error messages when response format is unexpected
- Add logging when using fallback format handling

This fix ensures compatibility with different n8n API versions and
prevents runtime errors when the response structure varies from expected.

Fixes #349

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-10-25 10:48:11 +00:00
Romuald Członkowski
9a3520adb7 Merge pull request #366 from czlonkowski/enhance/http-validation-suggestions-361
enhance: Add HTTP Request node validation suggestions (issue #361)
2025-10-24 17:55:05 +02:00
czlonkowski
ced7fafcbf fix: address code review findings for HTTP Request validation
- Make protocol detection case-insensitive (HTTP://, HTTPS://, Http://)
- Refactor API endpoint detection to prevent false positives
- Add subdomain pattern detection (api.example.com)
- Use regex with word boundaries for path patterns
- Add test coverage for edge cases:
  * Uppercase protocol variants
  * False positive URLs (therapist, restaurant, forest)
  * Case-insensitive API path detection
  * Null/undefined URL handling

All 50 tests passing. Addresses critical issues from PR #366 code review.

Conceived by Romuald Członkowski - www.aiadvisors.pl/en
2025-10-24 17:19:20 +02:00
czlonkowski
ad4b521402 enhance: Add HTTP Request node validation suggestions (issue #361)
Added helpful suggestions for HTTP Request node best practices after thorough investigation of issue #361.

## What's New

1. **alwaysOutputData Suggestion**
   - Suggests adding alwaysOutputData: true at node level
   - Prevents silent workflow failures when HTTP requests error
   - Ensures downstream error handling can process failed requests

2. **responseFormat Suggestion for API Endpoints**
   - Suggests setting options.response.response.responseFormat
   - Prevents JSON parsing confusion
   - Triggered for URLs containing /api, /rest, supabase, firebase, googleapis, .com/v

3. **Enhanced URL Protocol Validation**
   - Detects missing protocol in expression-based URLs
   - Warns about patterns like =www.{{ $json.domain }}.com
   - Warns about expressions without protocol

## Investigation Findings

**Key Discoveries:**
- Mixed expression syntax =literal{{ expression }} actually works in n8n (claim was incorrect)
- Real validation gaps: missing alwaysOutputData and responseFormat checks
- Compared broken vs fixed workflows to identify actual production issues

**Testing Evidence:**
- Analyzed workflow SwjKJsJhe8OsYfBk with mixed syntax - executions successful
- Compared broken workflow (mBmkyj460i5rYTG4) with fixed workflow (hQI9pby3nSFtk4TV)
- Identified that fixed workflow has alwaysOutputData: true and explicit responseFormat

## Impact

- Non-Breaking: All changes are suggestions/warnings, not errors
- Actionable: Clear guidance on how to implement best practices
- Production-Focused: Addresses real workflow reliability concerns

## Test Coverage

Added 8 new test cases covering:
- alwaysOutputData suggestion for all HTTP Request nodes
- responseFormat suggestion for API endpoint detection
- responseFormat NOT suggested when already configured
- URL protocol validation for expression-based URLs
- No false positives when protocol is correctly included

## Files Changed

- src/services/enhanced-config-validator.ts - Added enhanceHttpRequestValidation()
- tests/unit/services/enhanced-config-validator.test.ts - Added 8 test cases
- CHANGELOG.md - Documented enhancement with investigation findings
- package.json - Bump version to 2.22.2

Fixes #361

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en
2025-10-24 16:51:18 +02:00
Romuald Członkowski
b18f6ec7a4 Merge pull request #364 from czlonkowski/fix/if-node-connection-separation
fix: add warnings for If/Switch node connection parameters (issue #360)
2025-10-24 15:06:58 +02:00
czlonkowski
95ea6ca0bb fix: update test expectations for validateOnly mode to include warnings field
Fixed failing CI test by updating test expectations to match the new response
structure that includes a details.warnings field in validateOnly mode.

Changes:
- Updated test mock to include warnings: [] in applyDiff response
- Updated test expectations to include details: { warnings: [] }

Related to issue #360 fix.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en
2025-10-24 14:53:44 +02:00
czlonkowski
a4c7e097e8 fix: pass warnings through MCP handler to user
Fixed critical bug where warnings were generated by the diff engine
but not included in the MCP response, making them invisible to users.

Now warnings are properly passed through in all return paths:
- Success path (workflow updated)
- validateOnly path (dry run mode)
- Failure path (continueOnError mode)

This completes the fix for issue #360, ensuring users receive helpful
guidance when using sourceIndex instead of branch/case parameters.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-24 14:28:36 +02:00
czlonkowski
0778c55d85 fix: add warnings for If/Switch node connection parameters (issue #360)
Implemented a warning system to guide users toward using smart parameters
(branch="true"/"false" for If nodes, case=N for Switch nodes) instead of
sourceIndex, which can lead to incorrect branch routing.

Changes:
- Added warnings property to WorkflowDiffResult interface
- Warnings generated when sourceIndex used with If/Switch nodes
- Enhanced tool documentation with CRITICAL pitfalls
- Added regression tests reproducing issue #360
- Version bump to 2.22.1

The branch parameter functionality works correctly - this fix adds helpful
warnings to prevent users from accidentally using the less intuitive
sourceIndex parameter.

Conceived by Romuald Członkowski - https://www.aiadvisors.pl/en

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-24 14:17:30 +02:00
Romuald Członkowski
913ff31164 Merge pull request #363 from czlonkowski/fix/release-workflow-yaml-syntax
fix: resolve YAML syntax error in release.yml workflow
2025-10-24 14:00:27 +02:00