Skip to content
← All skills

Knowledge & Retrieval

Scraping Skill

Extract readable text from any URL the user shares.

Scraping skill overview diagram
01

How it works

The Scraping skill allows your agent to extract text content from a specific URL provided by the user during a conversation, enabling it to summarize articles, analyze competitor pages, or troubleshoot customer websites.

02

Key features

On-Demand Extraction

Read the content of any URL the user shares in chat.

Text Parsing

Extracts readable text from the HTML, ignoring nav and ads.

Contextual Analysis

Answer questions based specifically on the scraped content.

03

How to configure it

  1. 01

    Enable the Scraping skill in Launch Pad.

  2. 02

    Update Instructions to tell the agent how to handle URLs (e.g., 'If a user sends a link, scrape the page and provide a 3-bullet summary').

04

Frequently asked questions

Can the agent scrape pages behind a login?

No — Scraping only accesses publicly available URLs. It cannot log in or bypass paywalls.

Does it work on all websites?

It works on most standard HTML sites. Heavy client-side JavaScript SPAs or sites with strict anti-bot protections may not scrape successfully.

05

More Knowledge & Retrieval skills