Web Automation

Convert web pages and extract links automatically

17 nodes 298 145 Automatic trigger
Download

Workflow Description

Automation that transforms web page content into different formats and extracts links efficiently. Processes data in controlled batches and regulates requests to ensure optimal performance without server overload.

How it works

  1. 1.Manual trigger to start content processing
  2. 2.Convert pages to desired format through HTTP requests
  3. 3.Process data in separate batches with a defined maximum limit
  4. 4.Extract all links from the converted content
  5. 5.Pause between requests to prevent system overload
  6. 6.Return the list of extracted links

Use cases

  • Extract links from multiple pages and save them to a database
  • Convert HTML content to other formats and detect broken links
  • Automatically gather links from search results or product listings

Requirements

  • Web address or list of links to process
  • API or server capable of converting pages
  • Define reasonable batch limits to prevent connection failures

Service Value

Ready-made workflow template for automation delivery and service execution.

Apps Used

Split In Batches

Details

Trigger Automatic trigger
Nodes 17
Apps 1
Views 298
Downloads 145

How to Use

  1. 1.Click "Download Template"
  2. 2.Open your n8n dashboard
  3. 3.Go to Workflows > Import from File
  4. 4.Select downloaded file and configure credentials

Nodes Used (17)

/

When clicking ‘Test workflow’

Manual Trigger

#1

Wait

Wait

#2

Sticky Note36

Sticky Note

#3

Sticky Note28

Sticky Note

#4

Connect to your own data source

No Op

#5

Get urls from own data source

No Op

#6

Example fields from data source

Set

#7

Sticky Note33

Sticky Note

#8

Sticky Note34

Sticky Note

#9

Sticky Note35

Sticky Note

#10

Sticky Note37

Sticky Note

#11

40 items at a time

Limit

#12

10 at a time

Split In Batches

#13

Markdown data and Links

Set

#14

Split out page URLs

Split Out

#15

Retrieve Page Markdown and Links

HTTP Request

#16

Sticky Note38

Sticky Note

#17