This document explains the Web Agent Scraper node, which automates web interactions and content extraction.
URL: Starting web address
Example: “https://www.gumloop.com/”
Actions: Sequence of interactions to perform
Use Advanced Scraping: Enable for restricted sites (more robust, but slower)
Note: Costs additional credits
Click:
Hover:
Scroll:
Write:
Select from Dropdown:
Wait:
Screenshot:
Scrape:
Scrape Source:
Get URL:
Get All URLs:
Output: Links separated by commas
Get Link by Label:
Get All Components by Label:
To get started quickly with website scraping, use one of these ready-made templates:
These templates are designed to simplify common scraping tasks and can be customized to fit your specific requirements.
In summary, the Web Agent Scraper node automates complex web interactions to collect content that requires multiple steps to access.
This document explains the Web Agent Scraper node, which automates web interactions and content extraction.
URL: Starting web address
Example: “https://www.gumloop.com/”
Actions: Sequence of interactions to perform
Use Advanced Scraping: Enable for restricted sites (more robust, but slower)
Note: Costs additional credits
Click:
Hover:
Scroll:
Write:
Select from Dropdown:
Wait:
Screenshot:
Scrape:
Scrape Source:
Get URL:
Get All URLs:
Output: Links separated by commas
Get Link by Label:
Get All Components by Label:
To get started quickly with website scraping, use one of these ready-made templates:
These templates are designed to simplify common scraping tasks and can be customized to fit your specific requirements.
In summary, the Web Agent Scraper node automates complex web interactions to collect content that requires multiple steps to access.