Open Ai API very slow response.

[Jorge]

Your Workflow URL

https://connect.pabbly.com/workflow/mapping/IjU3NjYwNTZhMDYzZTA0M2Q1MjY4NTUzNTUxMzQi_pc

Your Task History ID

IjU3NjYwNTZhMDYzZTA0M2Q1MjY4NTUzNTUxMzQi_pc

Consent to Access & Modify

I authorize Pabbly Support to log in to my account and make changes to the specified workflow for troubleshooting.

Lately, the response from the OpenAI API has been very slow. In one step, I have two API requests, and what used to be fast is now very slow. I am using the GPT-4o version. Any suggestions to make the response faster? Thanks

 

[Preeti Paryani]

Hello @Jorge,

Thanks for sharing the details. The response time in this case is entirely dependent on the OpenAI API itself. Since the execution speed is managed on OpenAI’s end, we do not have control over the processing time. You may experience variations depending on their server load and response capacity at the given moment.

 

[Jorge]

I have another question, how much information can you process? I am trying to process approximately 160 Google reviews from a sheet to transfer them to a document, but it keeps loading for a long time. What version do you recommend? Im susin chat gpt 4o right now.

 

[ArshilAhmad]

In Pabbly Connect, you can pass data of no more than 250,000 characters in length, but that’s not the issue here.

Maximum Character Length

In Pabbly Connect fields have character length restrictions, meaning that the data entered into these fields cannot exceed 250,000 characters. Incase it exceeds the max allowed limit, then the below error will be shown - This means that any data entered or mapped from the previous step into a...

forum.pabbly.com

The issue is related to OpenAI not being able to process the large amount of data in sufficient time. You can try adding an Iterator to your workflow after 'Get Row(s)' action step. This will help you pass each review individually to OpenAI, so it can process it, then append the data in your Google Doc. You may need to setup the workflow in this manner.

Pabbly

connect.pabbly.com

Thanks & Regards,
Arshil Ahmad
Customer Support Associate
Pabbly.com
Rate your support