BizLead Finder Store/nexify/website-content-crawler

Website Content Crawler (Live AI/LLM Scraper)

Official ActorMCP Standby Ready

nexify/website-content-crawlerv3.6.294.5K users4.9 (512 reviews)2048 MB RAMPay per event: $1.50 / 1,000 pages

Crawl websites and extract clean text & Markdown content to feed AI models, LLM applications, vector databases (Pinecone, Qdrant), or RAG pipelines.

Actor Input Configuration

Auto-rendered from input_schema.json

Start URLs (Real Live Websites)*startUrlsarray

Enter real URLs to crawl live right now! Our backend engine will fetch and parse these actual URLs.

Max pages to crawlmaxCrawlPagesnumber

Maximum number of pages the crawler will visit.

Content FormatoutputFormatselect

Choose how the extracted article content should be formatted.

Remove cookie banners & popupsremoveCookieWarningsboolean

Automatically strip GDPR/cookie modals and navigation menus.

Enable Remove cookie banners & popups

Memory allocation: 2048 MB • Proxy: Auto-Rotate

Live Actor Execution Log

Click “Start Actor Run” to execute this Actor and stream live container logs & dataset items here.

Sample Dataset Output

Preview of structured records returned by this Actor

[
  {
    "url": "https://example.com",
    "title": "Example Domain",
    "markdown": "# Example Domain\n\nThis domain is for use in illustrative examples in documents.",
    "wordCount": 28,
    "linksCount": 1,
    "statusCode": 200,
    "crawledAt": "2026-10-24T13:15:00Z"
  }
]

Install BizLead Finder AppPWA

Pasang di HP Android, iOS & Desktop 1-Klik