How can we process more than 500 records in this workflow?

Status: Open · Asked by WellnessVibe LLP on · 0 views

WellnessVibe LLP — Question ·
Hi Pabbly Team,

We have a Pabbly Connect workflow that processes workshop/customer records from Google Sheets and sends WhatsApp and Gmail notifications for each applicable record.

Our workflow is:

  1. Schedule (Pabbly) – Schedule Workflow

  2. DateTime Formatter (Pabbly) – Current Date

  3. DateTime Formatter – Workshop Date

  4. Google Sheets – Get Row(s)

  5. Code (Pabbly) – Run JavaScript

  6. Iterator (Pabbly) – Process Arrays

  7. JSON Extractor (Pabbly) – Extract JSON Data

  8. Iterator (Pabbly) – Process Arrays

  9. WhatsApp API – Send Notification

  10. Gmail – Send Email

  11. Code (Pabbly) – Run JavaScript

  12. Google Sheets – Add New Row

We are able to process around 500 records, but we need to process more than 500 records automatically.

For example, if our Google Sheet contains 1,000, 2,000, or more applicable records, we want the workflow to process all of them without manually splitting the data.

Could you please clarify:

  1. Is there a 500-record or iteration limit in Pabbly Connect?

  2. Which step in our workflow is responsible for this limitation?

  3. Is there a recommended way to use pagination or batch processing to process records in batches of 500 and then automatically continue with the next batch?

  4. Can Google Sheets – Get Row(s) retrieve records using an offset, starting row, or pagination mechanism?

  5. What is the recommended Pabbly architecture for processing 1,000–5,000+ Google Sheets records?

  6. Could the two Iterator steps in our workflow be causing an additional limitation because of nested/multiple iterations?

  7. Is there any Pabbly-native solution to process all records reliably without creating separate workflows for every 500 records?

We would appreciate your recommended approach for handling large-volume record processing in this workflow.

Thank you.

Back to all forum threads · Log in to reply