# Scrape or crawl web pages

Acquire / http

A variant of [Fetch from the web](https://meridian.online/operations/fetch-from-the-web).

Fetch web pages, following links from a start page if asked, and keep their content or HTML elements.

Page: <https://meridian.online/operations/fetch-from-the-web/scrape-or-crawl-web-pages>

## Status

Not built yet.

arcform does not do this yet. [Its place on the roadmap](https://meridian.online/roadmap#fetch-from-the-web)

## What other tools call it

Meridian's classification; an independent blind rating agreed on 95.7% of 324 rows (variant, version 3).

- KNIME Analytics Platform: [`KNIME Web Interaction (Labs) (extension)`](https://api.hub.knime.com/extensions/org.knime.python.features.web) (read 2026-09-27)
- KNIME Analytics Platform: [`Webpage Retriever`](https://api.hub.knime.com/nodes/*_8Xu5w4lsg_0hzf3?details=full) (read 2026-09-27)
- RapidMiner Studio: [`Crawl Web`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/crawl_web_modern.html) (read 2026-09-27)
- RapidMiner Studio: [`Get Page`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/get_webpage.html) (read 2026-09-27)
- RapidMiner Studio: [`Process Documents from Web`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/process_web_modern.html) (read 2026-09-27)
- VisiData: [`scrape (loader)`](https://github.com/saulpw/visidata/blob/7609212ec2febafa9caba7183cbebfaf49627909/visidata/loaders/scrape.py#L22) (read 2026-09-23)
- VisiData: [`scrape-cells`](https://github.com/saulpw/visidata/blob/7609212ec2febafa9caba7183cbebfaf49627909/visidata/loaders/scrape.py#L175) (read 2026-09-23)