IS crashed while handling Large FlatFile (40MB)

,
1

Hello RMG/Experts

We have build a framework to handle large flat file(40MB).But we are facing below problems.

The first couple Of time are successful and later Automatically restarting itself (2nd time when we put the file in FTP ).

Could you please suggest me on this. What are the changes I needs to be done.

2

Are you trying to FTP that large file using pub.client.ftp* services?

Since this is a huge file, make sure you are transferring it as stream and also try to compress the file along with adjusting the time out settings.

Assuming your IS MEM settings is capable to handle this large file processing.

HTH,
RMG

3

Yes,I am trying with FTP service and I am transferring Stream data.
Could you please let me know if the below properties are wrong .

watt.server.keepAliveTimeOut=15000(C:\SoftwareAG82\IntegrationServer\bin\server.bat).
tn.BigDocThreshold=
tn.xml.xqlthreshold=
tn.space.location=
tn.tspace.max=52,428,00.

4

What did you have set this currently and some of these are TN related.

tn.BigDocThreshold=
tn.xml.xqlthreshold=
watt.server.tspace.location =
watt.server.tspace.timeToLive=

Basically you need to tune the values pertaining to your environment and IS memory/Resource settings.

HTH,
RMG

5

Can you share some details around the service that actually consumes the file? Are you using an iterator?

Percio

6

Hi Percio,

Yes I am using an Iterator. The service invokes when the file has been put in FTP server and We are transferring data in streams.

Please help me out on this.

7

Thanks for the reply,

Could you please let me know what are the necessary settings I need to check in IS memory and Resource settings.Plese give me some light on this.

8

Laxman,

Are you able to share your code and a sample (small) file with us so we can take a look? Also, do you see any errors written to the server.log, wrapper.log, or nohup file prior to the crash?

Percio

9

Percio,

I am sorry,I could not share the code as I am connecting to client machine. And I dont see any errors server log.

10

Do you see any core/heap dumps in the filesystem folder IntegrationServer/instances/default (if you are on 9.x) or IntegrationServer after the IS crashed?

HTH,
RMG

11

Hi RMG,

I am working on webMehtods 82 version. Can we see Core/Heap dumps in the filesystem of webMethods 82 ?

12

Hello Percio,

I am also facing the same problem.

Where would I find the “wrapper.log” (it is not in the same directory (\webMethods82\IntegrationServer\logs) as the server.log

what is a “nohup” file…and how would I find, or generate it ?

Could you please suggest me.

Thanks,
Prem.

13

Prem,

I can’t remember if the IS was already running inside the Tanuki wrapper in 8.2. I think it was. I’m running 9.6 currently and the wrapper.log file is located under \profiles\IS_default\logs, but you won’t find yours there. Just run a search for wrapper.log under the Software AG home folder.

As for nohup, I’m guessing based on your backslashes that you’re running on Windows, right? In that case, it doesn’t apply to you. If you’re still interested though, there’s a ton of info online about when and how to use the nohup command.

Percio

14

Prem – You can find nohup file in the same location from where you kick-off the script in general. Which OS are you using.

Thanks,