Firecrawl MCP Setup

1. User: "Analyze the content of this blog post: [URL]"
2. Agent uses firecrawl_scrape to get the content
3. Agent summarizes and analyzes the text

When asked to analyze a web page:
1. Use firecrawl_scrape to get the content
2. Focus on the main content (set onlyMainContent: true)
3. Provide a concise summary and key insights

1. User: "Research our top 5 competitors' pricing pages"
2. Agent uses firecrawl_batch_scrape with 5 URLs
3. Agent uses firecrawl_extract to get structured pricing data
4. Agent compares and creates a report

For competitor research:
1. Use batch_scrape for multiple URLs
2. Extract key information like pricing, features, target audience
3. Create a comparison table
4. Highlight our advantages and areas for improvement

1. User: "Find all blog posts on example.com"
2. Agent uses firecrawl_map to discover all URLs
3. Agent filters URLs containing "/blog/"
4. Agent uses batch_scrape to get content
5. Agent categorizes and summarizes posts

To discover content on a website:
1. Use firecrawl_map to get all URLs
2. Filter relevant URLs based on patterns
3. Use batch_scrape for multiple pages
4. Organize content by topic or date

1. User: "Extract product details from these pages"
2. Agent uses firecrawl_extract with JSON schema:
   {
     "name": "string",
     "price": "number",
     "stock": "boolean",
     "rating": "number"
   }
3. Agent returns structured data

For structured data extraction:
1. Define a clear JSON schema for the data
2. Use firecrawl_extract with the schema
3. Validate extracted data for completeness
4. Format results in a table or JSON

You are a web research specialist. When users ask you to research a topic:
1. Use firecrawl_search to find relevant sources
2. Use firecrawl_scrape or batch_scrape to get full content
3. Analyze and synthesize information
4. Provide citations with URLs
5. Summarize key findings in bullet points

User: "Research the latest developments in quantum computing"
Agent: [Uses firecrawl_search("quantum computing 2024", limit=10)]
       [Uses firecrawl_batch_scrape on top 5 results]
       "Here are the latest developments in quantum computing:
       - IBM announced a 1000+ qubit processor (Source: [URL])
       - Google achieved quantum advantage in optimization problems (Source: [URL])
       - New error correction methods show promise (Source: [URL])
       ..."

You monitor competitor websites and news sources for updates.
- Check specific URLs daily
- Compare new content with previous versions
- Highlight changes and new information
- Alert team if significant updates detected

User: "Check if competitor X has updated their pricing page"
Agent: [Uses firecrawl_scrape on competitor pricing URL]
       [Compares with previously stored data]
       "Changes detected on competitor X pricing page:
       - Basic plan increased from $49 to $59/month
       - New Enterprise tier added at $299/month
       - Free trial extended from 7 to 14 days"

You collect product data from e-commerce websites.
- Extract product name, price, availability, ratings
- Use structured extraction (firecrawl_extract)
- Store data in a consistent format
- Track price changes over time

User: "Collect product data from these 20 URLs"
Agent: [Uses firecrawl_extract with schema:
        {
          "product_name": "string",
          "price": "number",
          "currency": "string",
          "in_stock": "boolean",
          "rating": "number",
          "review_count": "number"
        }]
       "Extracted data from 20 products:
       [Displays formatted table with all product information]"

{
  "formats": ["markdown", "html"],
  "onlyMainContent": true,
  "includeTags": ["article", "main", "section"],
  "excludeTags": ["nav", "footer", "aside", "advertisement"],
  "waitFor": 3000,
  "timeout": 30000
}

Use firecrawl_map to get all URLs → Filter relevant sections

Use firecrawl_crawl with includePaths: ["/products/*", "/blog/*"]

Use firecrawl_extract on discovered URLs with structured schema