• Instructions to Ask a Question

    Click on the "Ask a Question" button and select the application for which you would like to ask questions.

    We have 5 different products namely - Pabbly Connect, Pabbly Subscription Billing, Pabbly Email Marketing, Pabbly Form Builder, Pabbly Email Verification.

    The turnaround time is 24 hrs (Business Hours - 10.00 AM to 6.00 PM IST, Except Saturday and Sunday). So your kind patience will be highly appreciated!

    🚀🚀Exclusive Discount Offer

    Just in case you're looking for any ongoing offers on Pabbly, you can check the one-time offers listed below. You just need to pay once and use the application forever -
     

    🔥 Pabbly Connect One Time Plan for $249 (🏆Lifetime Access) -  View offer 

    🔥 Pabbly Subscription Billing One Time Plan for $249 (🏆Lifetime Access) - View offer

Saving ALL data to Google Sheets

rtpguy82

Member
I am wanting to setup my flow like this. But I am receiving errors.

I want the Trigger to be Twitter -> New post by user
I want the Action to be Google Sheets -> Add new row

It sounds simple enough right? Here is the problem:

I setup my Sheet to have a column for the User Name, Date, Text, Image URL, and Video URL

Then I mapped the fields to the appropriate Twitter fields when I built the flow.

I tested it, and the test was successful and all was well!

I found out later that when Pabbly checks Twitter and finds a new tweet, Twitter apparently doesn't include the exact same fields every time, so for example, if someone I follow sends a tweet with both a picture and a video, it works beautifully. However if they Tweet just a picture, or just a video, or even multiple pictures in one Tweet, then the data feed from Twitter to Pabbly (specifically the field names) are changed. So perhaps this Tweet doesn't have a video, so the video fields aren't just blank, they aren't there at all. When the automation runs, it goes down the list of field mappings I have setup between Twitter and my Sheet, and when it looks for that Video Field, and it isn't there, it causes the flow to fail. Same issue if a picture is missing, or if I set it up to save the URLS for multiple pictures but they only post one, it fails.

What I want to know is this. How can I set it up to where it just saves EVERY field it receives from Twitter and saves it to a Google Sheet. Since the fields that are sent to Pabbly seem to be dynamic and tailored to each individual tweet, is there a way to just save whatever Twitter send to Pabbly, so if there are extra images, the URLs would be included, or if a video or an image isn't sent as part of the Tweet, then Pabbly won't fail the process because it's looking for something that wasn't sent?

I am not stuck on Google Sheets either, so even of there is a way to save the entire data stream from Twitter to a plain text file, that works too!! Basically ALL I need is to take the information that Pabbly receives and save it. If it has media info, then I want to save those URLs, if it doesn't have media info, I still want the rest of the Tweet info. If they have 10 images and a video, I want to save all of those URLs. The way it is setup now, that isn't working as it will either not save the additional media URLs, or it will fail because it's looking for one that isn't there. Ideally, basically I just want all of the fields shown in the second screenshot to essentially just be automatically copy and pasted to a spreadsheet or plain text file, but I can't figure out how to do that because each tweet will provide different fields so it isn't as easy as as selecting what is there because next time there may be more or less fields causing items to be missed.

I hope that makes sense, and I explained it right! The attached image shows what I am referring to as Fields. The extended entities media 0 stuff is what I am referring to. If the tweet doesnt have an image or video. Those fields arent sent to Pabbly, so the task fails because a required data field is missing. Thanks for any help you can offer.
 

Attachments

  • Screenshot_20230331_155132_Chrome.jpg
    Screenshot_20230331_155132_Chrome.jpg
    519.5 KB · Views: 51
  • Screenshot_20230331_160259_Chrome.jpg
    Screenshot_20230331_160259_Chrome.jpg
    481.2 KB · Views: 54
  • Screenshot_20230331_224424_Chrome Canary.jpg
    Screenshot_20230331_224424_Chrome Canary.jpg
    361.2 KB · Views: 55

Supreme

Well-known member
Staff member
Hey @rtpguy82

If you are getting multiple values of media from Twitter and want to pass at once then we recommend you use the Line Itemzier action step after the trigger event which will process the multiple line and media in comma-separated values.


I hope this should work for your concern.
 

rtpguy82

Member
Actually, I just realized a better way to phrase my question, sorry about that! What I really meant to was ask if there is a way to saw the RAW response from Twitter to a text file (or XML, JSON, HTTP, CSV, or any other text format), without any kind of filtering, or mapping, or anything like that. Just save it exactly the way Pabbly receives it. That way I can manually filter through to find what I need. That part would be easy enough on my end if I could get the entire RAW response from the Twitter Trigger saved to a file.

If I could do that, it would be absolutely PERFECT!!
 
Top