Web Automation

Process large datasets in controlled batches

17 nodes 135 82 Automatic trigger
Download

Workflow Description

Automated workflow that splits large data collections into manageable batches, processes each batch sequentially, and controls processing speed through configurable limits and wait times between executions.

How it works

  1. 1.Trigger the workflow manually or automatically when data arrives
  2. 2.Divide data into batches according to the specified batch size
  3. 3.Process each batch individually with pauses between iterations
  4. 4.Send processed data via HTTP requests or to connected applications

Use cases

  • Handle large customer or product lists without overwhelming backend systems
  • Send bulk emails or notifications to thousands of users in organized waves
  • Synchronize data between multiple systems reliably and efficiently

Requirements

  • A data source containing lists or arrays to process
  • Configured batch size appropriate for your target system's capacity

Service Value

Ready-made workflow template for automation delivery and service execution.

Apps Used

Split In Batches

Details

Trigger Automatic trigger
Nodes 17
Apps 1
Views 135
Downloads 82

How to Use

  1. 1.Click "Download Template"
  2. 2.Open your n8n dashboard
  3. 3.Go to Workflows > Import from File
  4. 4.Select downloaded file and configure credentials

Nodes Used (17)

/

When clicking ‘Test workflow’

Manual Trigger

#1

Wait

Wait

#2

Sticky Note36

Sticky Note

#3

Sticky Note28

Sticky Note

#4

Connect to your own data source

No Op

#5

Get urls from own data source

No Op

#6

Example fields from data source

Set

#7

Sticky Note33

Sticky Note

#8

Sticky Note34

Sticky Note

#9

Sticky Note35

Sticky Note

#10

Sticky Note37

Sticky Note

#11

40 items at a time

Limit

#12

10 at a time

Split In Batches

#13

Markdown data and Links

Set

#14

Split out page URLs

Split Out

#15

Retrieve Page Markdown and Links

HTTP Request

#16

Sticky Note38

Sticky Note

#17