Run the ScrapeGraph MCP server as a Meshagent service and interact with its tools in the cloud.

Required Environment Variables

Steps

  1. Install Meshagent CLI & Dependencies:

    pip install "meshagent[all]"
    
  2. Authenticate with Meshagent:

  3. Start a Meshagent Room Service with the MCP Server:

    meshagent service test \
      --room=test \
      --role=agent \
      --image=meshagent/mcp-scrapegraph:latest \
      --env MESHAGENT_PORT=8001 \
      --env SGAI_API_KEY=YOUR_SGAI_API_KEY \
      --port="num=8001 path=/webhook liveness=/ type=meshagent.callable" \
      --name=mcp-scrapegraph-service
    
    • Note: This command launches the ScrapeGraph MCP server as a Meshagent service inside a room named test. Include your real SGAI_API_KEY.
    • Tip: Rooms automatically close if they go inactive.
  4. Join the Room with a Chatbot Agent:

    meshagent chatbot join \
      --room=test \
      --agent-name=sample \
      --name=sample \
      --toolkit=mcp-scrapegraph
    
    • Starts a chatbot agent in the test room with access to the ScrapeGraph toolkit.
    • You can add multiple toolkits to the same agent in one room.
    • After running, the CLI will display a link to interact with the agent and its tools through your browser.

Tools Available

ScrapeGraph MCP Server provides these tools:

ToolShort Description
markdownifyConvert a webpage into clean, formatted markdown.
searchscraperPerform AI-powered web searches with structured results.
smartscraperExtract structured data from a webpage using AI.

Tools Details

Tool: markdownify

Convert a webpage into clean, formatted markdown.

ParameterTypeDescription
website_urlstringURL of the webpage to convert

Tool: searchscraper

Perform AI-powered web searches with structured results.

ParameterTypeDescription
user_promptstringSearch query or instructions

Tool: smartscraper

Extract structured data from a webpage using AI.

ParameterTypeDescription
user_promptstringInstructions for what data to extract
website_urlstringURL of the webpage to scrape