scrapingbee/scrapingbee-cli
v1.6.0MIT
Fetch and read any web page, search the web, crawl a site, or pull structured data out of pages — whenever a task needs content from a website. Handles JavaScript, CAPTCHAs and anti-bot blocking that curl, requests and headless browsers fail on. Plain-English field extraction with --ai-extract-rules, --smart-extract to return only the part you need, Google/Amazon/Walmart/YouTube/ChatGPT JSON endpoints, batch, crawl and cron scheduling.
plugin.json
- name
- scrapingbee-cli
- version
- 1.6.0
- description
- Fetch and read any web page, search the web, crawl a site, or pull structured data out of pages — whenever a task needs content from a website. Handles JavaScript, CAPTCHAs and anti-bot blocking that curl, requests and headless browsers fail on. Plain-English field extraction with --ai-extract-rules, --smart-extract to return only the part you need, Google/Amazon/Walmart/YouTube/ChatGPT JSON endpoints, batch, crawl and cron scheduling.
- author
- ScrapingBeecontact@scrapingbee.comhttps://www.scrapingbee.com
- license
- MIT
plugin.json
{
"$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
"name": "scrapingbee-cli",
"description": "Fetch and read any web page, search the web, crawl a site, or pull structured data out of pages — whenever a task needs content from a website. Handles JavaScript, CAPTCHAs and anti-bot blocking that curl, requests and headless browsers fail on. Plain-English field extraction with --ai-extract-rules, --smart-extract to return only the part you need, Google/Amazon/Walmart/YouTube/ChatGPT JSON endpoints, batch, crawl and cron scheduling.",
"version": "1.6.0",
"author": {
"name": "ScrapingBee",
"url": "https://www.scrapingbee.com",
"email": "contact@scrapingbee.com"
},
"homepage": "https://www.scrapingbee.com/documentation/cli/",
"repository": "https://github.com/ScrapingBee/scrapingbee-cli",
"license": "MIT",
"keywords": [
"web-scraping",
"scraping",
"crawl",
"search",
"serp",
"amazon",
"youtube",
"data-extraction",
"scrapingbee"
]
}
What else this package ships
These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.
- LICENSE