How to expose API from apigateway which invokes API with output as Stream ( response in word by word as chatGPT)

, ,
1

Product/components used and version/fix level:

API Gateway 10.11
IS_10.11_Core_Fix6
APIGateway_10.11.0.15.359

Detailed explanation of the problem:

Hi Experts, we have one rest API implemented in python for chatbot requirement and the output of this API is in stream. Means, if we test this API from curl, the output is getting populated word by word as like ChatGPT respose. when we exposed this API from API gateway , and test our API we are getting full response as a single text but not word by word. Somewhere our API gateway is caching the full response from Python API response. As per requirement if we test our API gateway API , that should also behave like the response from direct python API. Can you please help me in resolving this.

Error messages / full error message screenshot / log file:

No error but need to know the feasibility from API gateway.

Question related to a free trial, or to a production (customer) instance?

Production.

2

Dear Experts, any suggestions please

3

You can refer to the setting transferEncodingChunked_handleAsStream under Reverb.

Hope this helps.

2 Likes
4

This def showing great momentum towards how the SAG StreamSets emerging along with ChatGTP world of OpenAI modernization :slight_smile: