Cannot Archive Transactional Logs

Hello All,

I am having trouble with SoftwareAG API Gateway Archive and Purge function. I have tried contacting SoftwareAG support and can’t find a solution other than upgrade to 10.11.
I am using:

  1. Software AG Designer and API Gateway 10.5
  2. Licensed version of webMethods

When I tried use Archive function from API Management, there are out of memory error. I have tried to raise the heap memory to 6144, but still got the same error. We can only successfully Archive 5 minutes data, more than that, I got the out of memory error.

Current Configuration:

  • Segmented, with 3 nodes

  • Total Memory: 16gb

  • elasticsearch.yml
    http.max_content_length: 200mb

  • InternalDataStore/config/jvm.options
    -Xms4g
    -Xmx4g

  • WmAPIGateway/config/resources/elasticsearch/config.properties
    pg.gateway.elasticsearch.client.http.response.size=1000

  • custom_wrapper.conf
    wrapper.java.initmemory=2048
    wrapper.java.maxmemory= 6144

What are you trying to achieve? Please describe in detail.

When I checked the elasticsearch index for transactional logs, it shows that the total size is 497gb. Is there any way I can do Archive and Purging more than 5 minutes at a time?
Or is there any workaround, like using elasticsearch’s snapshot?
Ideally I would like to archive daily.

Do you get any error messages? Please provide a full error message screenshot and log file.

2021-11-25 00:26:35 WIB [YAI.0005.0025I] (tid=1359) [default][dc1api] Archive events data request of jobId 81dbf75b-fd81-447c-8a3d-4858a4b5a873 has been initiated
2021-11-25 00:27:01 WIB [YAI.0005.9999E] (tid=1359) [default][dc1api] Exception during the archive operation. Reason : java.lang.OutOfMemoryError: Java heap space
2021-11-25 00:27:01 WIB [YAI.0005.0027I] (tid=1359) [default][dc1api] Archive events data request of jobId 81dbf75b-fd81-447c-8a3d-4858a4b5a873 has been failed

Hi Dina,
Are you still facing this issue?

Hi Prabavathy,

Thank you for your reply. Yes we are still facing this issue.