Sure, here’s some info that I hope will help.
Sun Solaris 8 running on v480, 4G mem, 2CPU box. We’ve seen performance problems when multiple records are submitted to the integration server per flow. One being an LDAP update, one being a SQL read and create flat file, and a third one being incoming FTP and email out. And the numbers of records are not large by any means. For example the SQL read and flat file write is 2000 records. It was taking a few minutes with version 6.1, now with version 6.5 it has run as long as 14 hours! The slowness appears to happen logarithmic from what were seeing, or at least close to that. These flows happen to be fairly complex, so we’re still trying to figure out what is the common item in these flows that cause the problem. We don’t see anything unusual about cpu or memory usage on the server side, in fact it looks somewhat idle. But in the SQL example, we see 17 seconds between write fileIO’s on the server side, when it should be milliseconds. We’ve wondered about GC on the JVM, but the symptoms don’t suggest that, unless it’s pausing to do GC between every IO write, and the since each pass takes longer, that also does not point to GC. And you would think that a GC pause would be fairly consistent.
If you fire a new flow for each instance of data, performace appears to be okay. It’s only when a flow is required to process 1,000’s of records per invocation when we’re seeing the problems.
I can post more info as we figure out what’s the root cause of our problem.
I hope this helps! Cheers, …Kevin