I am working on an EAI project (webMethods 6.01 platform) that involves transporting large volumes of data “near real time”, which has been defined as “from source to target resource in 15 minutes or less.” I am trying to determine the optimal document size for IS to publish to the Broker. I crunched some numbers, and here is what I’ve found:
Document Size (KB) / Time on Broker (SECONDS)
20 / 3
100 / 3
200 / 3
1000 / 3
1500 / 10
2000 / 15
5000 / 72
10000 / 243
20000 / 1263
All of these tests were with guaranteed documents. Volatile documents yielded slightly better results, but nothing to get very excited about. These numbers suggest that the optimal document size for publishing to the Broker is about 1000 KB. I began seeing drastic diminishing returns as I increased the size from 1000 KB.
Also, IS and Broker are both installed on the same Sun Solaris 9 box.
Was the Broker designed to handle very large document sizes? Do these these numbers add up to you guys?