feat: implement Firecrawl web scraping integration

- Add Firecrawl SDK dependency for web scraping functionality
- Create /api/scrape endpoint to handle website content extraction
- Replace mock data with real Firecrawl API integration
- Add recent sources section showing scraped content excerpts
- Update UI to display scraping success/error messages
- Fix API response structure handling for Firecrawl integration

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Rosario Moscato
2025-09-22 20:01:58 +02:00
parent f31780cbf5
commit d380d68555
8 changed files with 986 additions and 20 deletions

View File

@@ -9,6 +9,7 @@
"lint": "eslint"
},
"dependencies": {
"@mendable/firecrawl-js": "^4.3.5",
"@radix-ui/react-progress": "^1.1.7",
"@radix-ui/react-slot": "^1.2.3",
"class-variance-authority": "^0.7.1",