Updates:
- Updated n8n from 1.113.3 to 1.114.3
- Updated n8n-core from 1.112.1 to 1.113.1
- Updated n8n-workflow from 1.110.0 to 1.111.0
- Updated @n8n/n8n-nodes-langchain from 1.112.2 to 1.113.1
- Rebuilt node database with 536 nodes
- Updated template database (2647 → 2653, +6 new templates)
- Sanitized 24 templates to remove API tokens
Performance Improvements:
- Optimized template update to fetch only last 2 weeks
- Reduced update time from 10+ minutes to ~60 seconds
- Added getMostRecentTemplateDate() to TemplateRepository
- Modified TemplateFetcher to support date-based filtering
- Update mode now fetches templates since (most_recent - 14 days)
All tests passing (933 unit, 249 integration)
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
Implements comprehensive improvements to the two-phase query optimization:
- **Ordering Stability**: Use CTE with VALUES clause to preserve exact Phase 1 ordering
Prevents any ordering discrepancies between Phase 1 ID selection and Phase 2 data fetch
- **Defensive ID Validation**: Filter IDs for type safety before Phase 2 query
Ensures only valid positive integers are used in the CTE
- **Performance Metrics**: Add detailed logging with phase1Ms, phase2Ms, totalMs
Enables monitoring and quantifying the optimization benefits
- **DRY Principle**: Extract buildMetadataFilterConditions helper method
Eliminates code duplication between searchTemplatesByMetadata and getMetadataSearchCount
- **Comprehensive Testing**: Add 4 integration tests covering:
- Basic two-phase query functionality
- Ordering stability with same view counts
- Empty results early exit
- Defensive ID validation
All tests passing (36/37, 1 skipped)
Build successful
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
Problem:
- search_templates_by_metadata with no filters caused Claude Desktop timeouts
- Query loaded ALL templates with metadata_json and decompressed workflows
- With 2,646 templates, this caused significant performance issues
Solution:
- Implement two-phase query optimization:
1. Phase 1: SELECT id only (fast, no workflow data)
2. Phase 2: Fetch full records only for matching IDs (decompress only needed rows)
- Prevents loading/decompressing thousands of rows when only 20 are needed
Performance Impact:
- No filters: Now responds instantly instead of timing out
- With filters: Same fast performance, minimal overhead
- Only decompresses the exact number of rows needed (limit parameter)
Testing:
- Tested with no filters: ✅ 2,646 templates, returned 5 in <1s
- Tested with complexity filter: ✅ 262 templates, returned 3 in <1s
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Change from exponential backoff to fixed 1-minute polling interval
- Log status on EVERY check (not just on status change)
- Show check number and elapsed time in each log
- Increase max timeout to 120 minutes (was 100 attempts with variable times)
- Add better status symbols for completed/failed states
This fixes the issue where batches completed on OpenAI's side but monitoring
appeared to hang because it was waiting too long between checks.
Note: Error files with API tokens are now excluded from commits for security.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
Template Updates:
- Add npm script for incremental template fetch (fetch:templates:update)
- Create MEMORY_TEMPLATE_UPDATE.md with comprehensive documentation
- Update 48 new templates (2598 → 2646 total)
- Latest template now from September 24, 2025
Metadata Generation Fixes:
- Update model from gpt-4o-mini to gpt-5-mini-2025-08-07
- Remove temperature parameter (not supported in batch API)
- Increase max_completion_tokens from 1000 to 3000
- Add comprehensive error file handling to batch-processor
- Process failed requests and assign default metadata
- Save error files for debugging (temp/batch/)
Test Updates:
- Update all test files to use gpt-5-mini-2025-08-07 model
- 3 test assertions updated in metadata-generator.test.ts
- 1 test option updated in batch-processor.test.ts
Documentation:
- Add troubleshooting section for metadata generation
- Include error handling examples
- Document incremental vs full rebuild modes
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Fix getTemplatesByCategory to use parameterized SQL concatenation
- Fix searchTemplatesByMetadata to handle empty string filters
- Change truthy checks to explicit undefined checks for filter parameters
- Update test expectations to match secure parameterization patterns
All 21 tests in template-repository-security.test.ts now pass ✓
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
- Fix method name mismatches in template repository tests
- Enhance node categorization logic for AI/ML nodes
- Correct test expectations for metadata search
- Add missing schema properties in MCP tools
- Improve detection of agent and OpenAI nodes
All 21 failing tests now passing
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
- Fix template service tests to include description field
- Add missing repository methods for metadata queries
- Fix metadata generator test mocking issues
- Add missing runtime dependencies (openai, zod) to package.runtime.json
- Update test expectations for new template format
Fixes CI failures in PR #194
Co-Authored-By: Claude <noreply@anthropic.com>
- Fix SQL injection vulnerability in template-repository.ts
- Use proper parameterization with SQLite concatenation operator
- Escape JSON strings correctly for LIKE queries
- Prevent malicious SQL through filter parameters
- Add input sanitization for OpenAI API calls
- Sanitize template names and descriptions before sending to API
- Remove control characters and prompt injection patterns
- Limit input length to prevent token abuse
- Lower temperature to 0.3 for consistent structured outputs
- Add comprehensive test coverage
- 100+ new tests for metadata functionality
- Security-focused tests for SQL injection prevention
- Integration tests with real database operations
Co-Authored-By: Claude <noreply@anthropic.com>
- Implement OpenAI batch API integration for metadata generation
- Add search_templates_by_metadata tool with advanced filtering
- Enhance list_templates to include descriptions and optional metadata
- Generate metadata for 2,534 templates (97.5% coverage)
- Update README with Template Tools section and enhanced Claude setup
- Add comprehensive documentation for metadata system
Enables intelligent template discovery through:
- Complexity levels (simple/medium/complex)
- Setup time estimates (5-480 minutes)
- Target audience filtering (developers/marketers/analysts)
- Required services detection
- Category and use case classification
Co-Authored-By: Claude <noreply@anthropic.com>
- Implement OpenAI batch API integration for metadata generation
- Add metadata columns to database schema (metadata_json, metadata_generated_at)
- Create MetadataGenerator service with structured output schemas
- Create BatchProcessor for handling OpenAI batch jobs
- Add --generate-metadata flag to fetch-templates script
- Update template repository with metadata management methods
- Add OpenAI configuration to environment variables
- Include comprehensive tests for metadata generation
- Use gpt-4o-mini model with 50% cost savings via batch API
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Add template-node-resolver utility to handle various input formats
- Support bare node names (e.g., 'slack' → 'n8n-nodes-base.slack')
- Handle partial prefixes (e.g., 'nodes-base.webhook')
- Implement case-insensitive matching
- Add intelligent expansions for related node types
- Update template repository to use resolver for fuzzy matching
- Add comprehensive test suite with 23 tests
This addresses improvement #1.1 from the AI agent enhancement report,
reducing failed template queries by ~50% and making the API more intuitive
for both AI agents and human users.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Add pagination support to all template search/list tools
- Consistent response format with total, limit, offset, hasMore
- Support for customizable limits (1-100) and offsets
- Add new list_templates tool for browsing all templates
- Returns minimal data (id, name, views, node count)
- Supports sorting by views, created_at, or name
- Efficient for discovering available templates
- Enhance get_template with flexible response modes
- nodes_only: Just list of node types (minimal tokens)
- structure: Nodes with positions and connections
- full: Complete workflow JSON (default)
- Update database_statistics to show template count
- Shows total templates, average/min/max views
- Provides complete database overview
- Add count methods to repository for pagination
- getSearchCount, getNodeTemplatesCount, getTaskTemplatesCount
- Enables accurate pagination info
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Add gzip compression for workflow JSONs (89% size reduction)
- Filter templates with ≤10 views to remove low-quality content
- Reduce template count from 4,505 to 2,596 high-quality templates
- Compress template data from ~75MB to 12.10MB
- Total database reduced from 117MB to 48MB
- Add on-the-fly decompression for template retrieval
- Update schema to support compressed workflow storage
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Fixed better-sqlite3 ES module imports across all tests
- Updated template repository method to handle undefined results
- Fixed all database column references to match schema
- Corrected MCP transport initialization
- All integration tests now passing
- Database now contains 499 templates (was 399)
- FTS5 index properly populated with all template entries
- Fixed quote escaping in FTS5 queries to prevent syntax errors
- Verified FTS5 search returns correct results (162 for "webhook")
- Fixes template search in Docker deployments
The previous database had empty FTS5 tables causing search to fail.
This update ensures the FTS5 index is properly synchronized and
handles special characters in search queries.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Add FTS5 pre-creation in fetch-templates.ts before data import
- Create prebuild-fts5.ts script to ensure FTS5 tables exist
- Improve logging in template-repository.ts for better debugging
- Add npm script 'prebuild:fts5' for manual FTS5 setup
This ensures template search works consistently in Docker mode
where runtime FTS5 table creation might fail due to permissions.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Added runtime FTS5 detection in database adapters
- Removed FTS5 from required schema to prevent "no such module" errors
- FTS5 tables/triggers created conditionally only if supported
- Template search automatically falls back to LIKE when FTS5 unavailable
- Works in ALL SQLite environments (Claude Desktop, restricted envs, etc.)
This ensures search_templates() works correctly regardless of SQLite build,
while still providing optimal performance when FTS5 is available.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Add TemplateSanitizer utility class for detecting and replacing API tokens
- Update template repository to automatically sanitize on save
- Add sanitize:templates command to clean existing templates
- Uses pattern matching to detect various API token formats
- Fixes GitHub push protection blocking database updates
Note: Database will be updated separately after code is deployed
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
- Changed template time window from 6 months to 1 year
- Added robust incremental template fetcher that saves as it goes
- Successfully fetched and saved 399 templates (up from 199)
- Added npm script 'fetch:templates:robust' for better error handling
- Templates now save incrementally to prevent data loss on errors
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Move TemplateFetcher import to dynamic import in fetchAndUpdateTemplates
- Templates now work everywhere since they just read from database
- axios only loaded when actually fetching new templates
- Fixes Docker runtime error while keeping full template functionality
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
- Add 4 new MCP tools for workflow templates
- Integrate with n8n.io API to fetch community templates
- Filter templates to last 6 months only
- Store templates in SQLite with full workflow JSON
- Manual fetch system (not part of regular rebuild)
- Support search by nodes, keywords, and task categories
- Add fetch:templates and test:templates npm scripts
- Update to v2.4.1
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
