feat: implement Firecrawl web scraping integration

- Add Firecrawl SDK dependency for web scraping functionality
- Create /api/scrape endpoint to handle website content extraction
- Replace mock data with real Firecrawl API integration
- Add recent sources section showing scraped content excerpts
- Update UI to display scraping success/error messages
- Fix API response structure handling for Firecrawl integration

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
Rosario Moscato
2025-09-22 20:01:58 +02:00
parent f31780cbf5
commit d380d68555
8 changed files with 986 additions and 20 deletions

13
docs/business/overview.md Normal file
View File

@@ -0,0 +1,13 @@
# Overview
This is an AI Podcast Generation app that converts a URL into a natural sounding podcast audio file.
# Core Features
## Scrape Website
The user enters a URL and the app then use Firecrawl to extract the website content.
## Generate Conversation
The app then uses the AI SDK v5 (OpenAI gpt-5-mini as the model) to create a conversation between 2 hosts discussing the scraped content.
## Generate Podcast Audio
Use the Elevenlabs SDK to generate the dialog from the conversation text.