RSS only takes the most recent item in the list (not all new available since last ran)

[palo]

Hello, I am trying to run an RSS trigger which can only be ran at 24 hour intervals, the issue I am facing is that pebbly only processes the most recent item, where there could actually be 2+ new items since the last run.

I notice there are two "New item in feed" that I can choose from, one is in beta, but I cannot find any documentation to describe wha the differences are.

Does anyone know how I can get pabbly to process all new items since last trigger? thanks.

 

[Preeti Paryani]

Hello @palo

It looks like your workflow is set to trigger every 24 hours because you're currently using Pabbly Connect's free plan. To reduce the trigger time, you would need to upgrade to a paid plan. With the free plan, new items in your RSS feed will only be captured after 24 hours.

We recommend using the "New Item in Feed (BETA)" trigger for your workflow. However, please note that if your workflow doesn't include any paid steps, it will automatically be disabled after 6 hours. Also, we noticed that your workflow is currently disabled, so you'll need to enable it for it to work.

Keep in mind that the "New Item in Feed" trigger will only capture items added after the workflow was created. If you want to process all items added since the last trigger, you can set up a one-time workflow like this:

1. Scheduler: Set it to "Run Once."
2. RSS Get Items: Fetch all items in your RSS feed and capture the response in advanced format.
3. Iterator: Map the array response from the RSS feed.
4. Filter: Filter the items based on their publish date, ensuring only items published after the last trigger time are processed.
5. Add the required actions to process the filtered data.

Once this initial setup is done, your workflow will be ready to process new items added to the feed from that point onward. Let us know if you need further assistance!

 

[palo]

Hello @palo

It looks like your workflow is set to trigger every 24 hours because you're currently using Pabbly Connect's free plan. To reduce the trigger time, you would need to upgrade to a paid plan. With the free plan, new items in your RSS feed will only be captured after 24 hours.

We recommend using the "New Item in Feed (BETA)" trigger for your workflow. However, please note that if your workflow doesn't include any paid steps, it will automatically be disabled after 6 hours. Also, we noticed that your workflow is currently disabled, so you'll need to enable it for it to work.

Keep in mind that the "New Item in Feed" trigger will only capture items added after the workflow was created. If you want to process all items added since the last trigger, you can set up a one-time workflow like this:

1. Scheduler: Set it to "Run Once."
2. RSS Get Items: Fetch all items in your RSS feed and capture the response in advanced format.
3. Iterator: Map the array response from the RSS feed.
4. Filter: Filter the items based on their publish date, ensuring only items published after the last trigger time are processed.
5. Add the required actions to process the filtered data.

Once this initial setup is done, your workflow will be ready to process new items added to the feed from that point onward. Let us know if you need further assistance!

I understand about the 24 hour limitation, which I am ok with.
But if there are two new items in the RSS feed the run will only process the newest and skip the second newest. This would be an issue even if the scheduling was shortened to 10 mins. In the event that between each run there is more than one new item.

One thing you mentioned that caught my attention is that you said using the beta option, the workflow will auto deactivate it self after 6 hours?

 

[Deleted member 15445]

Hey @palo

Please include a paid action step in your workflow after the trigger. Workflows in Pabbly Connect will automatically turn off if they only contain free steps.

This is causing problems with capturing the RSS feed.

Give it a try and let us know if it resolves the issue for you.

 

[palo]

Hey @palo

Please include a paid action step in your workflow after the trigger. Workflows in Pabbly Connect will automatically turn off if they only contain free steps.

This is causing problems with capturing the RSS feed.

Give it a try and let us know if it resolves the issue for you.

My workflow does have non-free steps, and it has been running for many months.

But only recently I realised that it won’t process more than one item if the rss feed has more than one new item

 

[Deleted member 15445]

Hey @palo

We understand that it was running perfectly before, but currently this is the issue we need to resolve. Kindly add an action step in your workflow and turn it on to capture a response from RSS.

Let us know if it works for you.

 

[palo]

It’s currently on. And it processed one item total.
Only 1 of 2 new rss feed items was processed. The other was ignored.

 

[ArshilAhmad]

It’s currently on. And it processed one item total.
Only 1 of 2 new rss feed items was processed. The other was ignored.

Could you please share the Workflow URL where you are experiencing this issue?