From a828111d492c1f0129d18ae9c084eeeb3dcfe647 Mon Sep 17 00:00:00 2001 From: a2a-cloud Date: Sun, 7 Jun 2026 23:16:11 +0000 Subject: [PATCH] write README.md --- README.md | 24 ++++++++++++++++++++++++ 1 file changed, 24 insertions(+) diff --git a/README.md b/README.md index d0b4c18..0b08366 100644 --- a/README.md +++ b/README.md @@ -79,6 +79,30 @@ Pagination is restricted to the same scheme and host as the start URL. } ``` +## Smoke test payload + +Use this payload to verify the scraper against the public demo site `https://quotes.toscrape.com/` while respecting robots.txt. It should return parseable JSON, quote items, a saved JSON file, an HTML capture path, and screenshot paths only when `screenshot` is `true`. + +```json +{ + "url": "https://quotes.toscrape.com/", + "selectors": { + "quotes": ".quote", + "text": ".text", + "author": ".author", + "tags": ".tag" + }, + "max_pages": 1, + "wait_seconds": 1, + "output_format": "json", + "headless": true, + "user_agent": "", + "respect_robots": true, + "rate_limit_seconds": 1, + "screenshot": false +} +``` + ## Deployment notes The agent declares a larger runtime budget because browser work can be CPU/memory intensive. Actual browser execution is performed through the workspace sandbox helper using the SeleniumBase image, so files written under `/workspace/outputs/seleniumbase-website-scraper/` are durable workspace outputs.