# Fetch from the web Acquire / http HTTP GET or POST, REST, SOAP, GraphQL, web scraping Page: ## Status Not built yet. arcform does not do this yet. [Its place on the roadmap](https://meridian.online/roadmap#fetch-from-the-web) arcform has `http_fetch` for downloading a file from a URL. arcform has `html_link_discover` for collecting links from an index page. ## Variants - Download a file from a URL: Fetch a file from a web address, saving it or reading it as a table. - [Read an OData feed](https://meridian.online/operations/fetch-from-the-web/read-an-odata-feed): Read entities from an OData service, following its paging links. - [Call a web API for each row](https://meridian.online/operations/fetch-from-the-web/call-a-web-api-for-each-row): Send one HTTP request per input row, built from its values, and add the response to that row. - [Receive incoming HTTP requests](https://meridian.online/operations/fetch-from-the-web/receive-incoming-http-requests): Listen on an endpoint and turn each HTTP request that arrives into a row. - Call a REST API: Send an HTTP request to a web API, with headers, body and pagination, and turn the response into rows. - [Read an RSS feed](https://meridian.online/operations/fetch-from-the-web/read-an-rss-feed): Read the entries of RSS feeds into rows. - [Scrape or crawl web pages](https://meridian.online/operations/fetch-from-the-web/scrape-or-crawl-web-pages): Fetch web pages, following links from a start page if asked, and keep their content or HTML elements. - [Call a SOAP web service](https://meridian.online/operations/fetch-from-the-web/call-a-soap-web-service): Call a method of a SOAP or XML-RPC web service, usually described by WSDL, and return its result. ## What other tools call it Meridian's classification; an independent blind rating agreed on 86.2% of 312 rows (exact class, version 2). - Azure Data Factory: [`Copy activity source data stores: Generic protocol (family)`](https://learn.microsoft.com/en-us/azure/data-factory/connector-overview) (read 2026-09-27) - Azure Data Factory: [`External call`](https://learn.microsoft.com/en-us/azure/data-factory/data-flow-external-call) (read 2026-09-27) - Azure Data Factory: [`Web Activity`](https://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity) (read 2026-09-27) - Alteryx Designer: [`Download`](https://help.alteryx.com/current/en/designer/tools/developer/download-tool.html) (read 2026-09-27) - Bruin: [`ingestr: http source`](https://getbruin.com/docs/bruin/ingestion/http.html) (read 2026-09-27) - Duckle: [`GraphQL`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - Duckle: [`HTTP`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - Duckle: [`OData`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - Duckle: [`REST`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - Duckle: [`SOAP`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - Duckle: [`Webhook`](https://github.com/slothflowlabs/duckle/blob/f85f8960edfb6efbf4cb89d58a7b32e16df0e867/website/docs/components.html) (read 2026-09-25) - EasyMorph: [`Download file`](https://help.easymorph.com/doku.php?id=transformations:downloadfile) (read 2026-09-27) - EasyMorph: [`Import from OData`](https://help.easymorph.com/doku.php?id=transformations:importodata) (read 2026-09-27) - EasyMorph: [`Import from Web API`](https://help.easymorph.com/doku.php?id=transformations:importwebapi) (read 2026-09-27) - EasyMorph: [`Incoming HTTP Request`](https://help.easymorph.com/doku.php?id=transformations:incominghttprequest) (read 2026-09-27) - EasyMorph: [`Iterate Web Request`](https://help.easymorph.com/doku.php?id=transformations:iteratewebrequest) (read 2026-09-27) - EasyMorph: [`Web Request`](https://help.easymorph.com/doku.php?id=transformations:webrequest) (read 2026-09-27) - AWS Glue: [`REST API`](https://docs.aws.amazon.com/glue/latest/dg/rest-api-connections.html) (read 2026-09-27) - Apache Hop: [`HTTP`](https://hop.apache.org/manual/latest/workflow/actions/http.html) (read 2026-09-27) - Apache Hop: [`HTTP Post`](https://hop.apache.org/manual/latest/pipeline/transforms/httppost.html) (read 2026-09-27) - Apache Hop: [`HTTP client`](https://hop.apache.org/manual/latest/pipeline/transforms/http.html) (read 2026-09-27) - Apache Hop: [`OData input`](https://hop.apache.org/manual/latest/pipeline/transforms/odata-input.html) (read 2026-09-27) - Apache Hop: [`REST Client`](https://hop.apache.org/manual/latest/pipeline/transforms/rest.html) (read 2026-09-27) - Apache Hop: [`Web services lookup`](https://hop.apache.org/manual/latest/pipeline/transforms/webservices.html) (read 2026-09-27) - KNIME Analytics Platform: [`Container Input (Raw HTTP)`](https://api.hub.knime.com/nodes/*C_KWY7ILldSbn3Wk?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`DELETE Request`](https://api.hub.knime.com/nodes/*qHyuqf6K9q6qpfCo?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`GET Request`](https://api.hub.knime.com/nodes/*jrLgNd_aIVOrfPsF?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`HEAD Request`](https://api.hub.knime.com/nodes/*QyvUoYynIb8B2cPd?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`KNIME Web Interaction (Labs) (extension)`](https://api.hub.knime.com/extensions/org.knime.python.features.web) (read 2026-09-27) - KNIME Analytics Platform: [`KNIME Web Service Client (extension)`](https://api.hub.knime.com/extensions/org.knime.features.ext.webservice.client) (read 2026-09-27) - KNIME Analytics Platform: [`PATCH Request`](https://api.hub.knime.com/nodes/*p7Ut87FYY_PSrZk2?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`POST Request`](https://api.hub.knime.com/nodes/*jDedZ_onUp4c833B?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`PUT Request`](https://api.hub.knime.com/nodes/*QNtcyg9ppUovyGNe?details=full) (read 2026-09-27) - KNIME Analytics Platform: [`Webpage Retriever`](https://api.hub.knime.com/nodes/*_8Xu5w4lsg_0hzf3?details=full) (read 2026-09-27) - Apache NiFi: [`HandleHttpRequest`](https://nifi.apache.org/components/org.apache.nifi.processors.standard.HandleHttpRequest/) (read 2026-09-27) - Apache NiFi: [`InvokeHTTP`](https://nifi.apache.org/components/org.apache.nifi.processors.standard.InvokeHTTP/) (read 2026-09-27) - Apache NiFi: [`ListenHTTP`](https://nifi.apache.org/components/org.apache.nifi.processors.standard.ListenHTTP/) (read 2026-09-27) - OpenRefine: [`Add column by fetching URLs…`](https://openrefine.org/docs/manual/columnediting#add-column-by-fetching-urls) (read 2026-09-27) - OpenRefine: [`Web addresses (URLs)`](https://openrefine.org/docs/manual/starting#web-addresses-urls) (read 2026-09-27) - Pentaho Data Integration: [`Call Endpoint`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Pentaho Data Integration: [`HTTP Post`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Pentaho Data Integration: [`HTTP client`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Pentaho Data Integration: [`REST Client`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Pentaho Data Integration: [`RSS Input`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Pentaho Data Integration: [`Web services lookup`](https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/pdi-transformation-steps-reference-overview) (read 2026-09-27) - Power Query M: [`Web and feed functions (family)`](https://learn.microsoft.com/en-us/powerquery-m/accessing-data-functions) (read 2026-09-27) - RapidMiner Studio: [`Crawl Web`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/crawl_web_modern.html) (read 2026-09-27) - RapidMiner Studio: [`Enrich Data by Webservice`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/services/enrich_data_by_webservice.html) (read 2026-09-27) - RapidMiner Studio: [`GET (REST)`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/rest/crud_get.html) (read 2026-09-27) - RapidMiner Studio: [`Get Page`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/get_webpage.html) (read 2026-09-27) - RapidMiner Studio: [`Get Pages`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/retrieve_webpages.html) (read 2026-09-27) - RapidMiner Studio: [`Process Documents from Web`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/process_web_modern.html) (read 2026-09-27) - RapidMiner Studio: [`Read RSS Feed`](https://docs.rapidminer.com/latest/studio/operators/extensions/Web%20Mining/read_rss.html) (read 2026-09-27) - RapidMiner Studio: [`Read URL`](https://docs.rapidminer.com/latest/studio/operators/data_access/files/read/read_url.html) (read 2026-09-27) - Talend: [`tAPIOperation`](https://help.qlik.com/talend/en-US/components/8.0/esb-rest/esb-rest-component) (read 2026-09-27) - Talend: [`tESBConsumer`](https://help.qlik.com/talend/en-US/components/8.0/esb-soap/esb-soap-component) (read 2026-09-27) - Talend: [`tESBProviderRequest`](https://help.qlik.com/talend/en-US/components/8.0/esb-soap/esb-soap-component) (read 2026-09-27) - Talend: [`tFileFetch`](https://help.qlik.com/talend/en-US/components/8.0/internet/internet-component) (read 2026-09-27) - Talend: [`tFindRegexlibExpressions`](https://help.qlik.com/talend/en-US/components/8.0/pattern-validation/pattern-validation-component) (read 2026-09-27) - Talend: [`tHTTPClient`](https://help.qlik.com/talend/en-US/components/8.0/http/http-component) (read 2026-09-27) - Talend: [`tHttpRequest`](https://help.qlik.com/talend/en-US/components/8.0/http/http-component) (read 2026-09-27) - Talend: [`tLastRegexlibExpressions`](https://help.qlik.com/talend/en-US/components/8.0/pattern-validation/pattern-validation-component) (read 2026-09-27) - Talend: [`tODataInput`](https://help.qlik.com/talend/en-US/components/8.0/internet/internet-component) (read 2026-09-27) - Talend: [`tREST`](https://help.qlik.com/talend/en-US/components/8.0/rest/rest-component) (read 2026-09-27) - Talend: [`tRESTClient`](https://help.qlik.com/talend/en-US/components/8.0/esb-rest/esb-rest-component) (read 2026-09-27) - Talend: [`tRESTRequest`](https://help.qlik.com/talend/en-US/components/8.0/esb-rest/esb-rest-component) (read 2026-09-27) - Talend: [`tRSSInput`](https://help.qlik.com/talend/en-US/components/8.0/rss/rss-component) (read 2026-09-27) - Talend: [`tRestWebServiceLookupInput`](https://help.qlik.com/talend/en-US/components/8.0/webservice/webservice-component) (read 2026-09-27) - Talend: [`tSOAP`](https://help.qlik.com/talend/en-US/components/8.0/soap/soap-component) (read 2026-09-27) - Talend: [`tWebService`](https://help.qlik.com/talend/en-US/components/8.0/webservice/webservice-component) (read 2026-09-27) - Talend: [`tWebServiceInput`](https://help.qlik.com/talend/en-US/components/8.0/webservice/webservice-component) (read 2026-09-27) - Talend: [`tXMLRPCInput`](https://help.qlik.com/talend/en-US/components/8.0/xmlrpc/xmlrpc-component) (read 2026-09-27) - VisiData: [`http (URL loader)`](https://github.com/saulpw/visidata/blob/7609212ec2febafa9caba7183cbebfaf49627909/visidata/loaders/http.py#L30) (read 2026-09-23) - VisiData: [`scrape (loader)`](https://github.com/saulpw/visidata/blob/7609212ec2febafa9caba7183cbebfaf49627909/visidata/loaders/scrape.py#L22) (read 2026-09-23) - VisiData: [`scrape-cells`](https://github.com/saulpw/visidata/blob/7609212ec2febafa9caba7183cbebfaf49627909/visidata/loaders/scrape.py#L175) (read 2026-09-23)