Jeyaraman,
I have not heard of a limit to the number of events published. What I do know is that there is a limit to the size of guaranteed events. Now you have not included enough information the accurately determine the problem that you are running into. Some good questions to answer would be.
- Have you configured the adapter to publish all the information for the records or only identifying information?
- Are you using the intelligent adapter that has a built-in notification operation or are you using the older notification adapter?
- Is the event/document that you are publishing from the db adapter guaranteed, persistent or volatile?
I am including a writeup of the 8MB limitation that might shed some light on your problem.
"8MB Maximum Transaction Limitation
‘Maximum document size of a guaranteed document type is restricted to the size of the Broker-guar.log. The guaranteed log file is 8 MB.’ – Administration and Analysis Tools, p107.
The implications of the 8 MB transaction limit on guaranteed events is great. In addition to just preventing single events larger than 8 MB combining many small events into one larger for performance reasons can also cause problems if the combined size is greater than 8 MB. The practice of combining several small events into one large one is referred to as buffering. webMethods tools themselves make frequent use of buffering.
The import process uses of event buffering and can encounter the 8MB limit when importing large adl files. Adl files larger than 8 MB runs the risk of encountering the 8MB limit, but adl files as large as 15 MB or greater have been known to successfully import. The content of an adl files seem to play a part in whether or not an event buffer greater than 8 MB will be created and published during the import process.
For brokers greater than 8MB this means the broker_save and broker_load cannot be reliably used for backups and migrations. The only solution is to break up the adl file by manually exporting it in pieces. For more information about migration please refer to the Migration Technical Brief. Backups can still be accomplished by backing up the data directory.
The 8 MB limit can also be encountered when publishing from adapters. When configuring an adapter to publish event using the work flow, those events will automatically be buffered, which means the total size of all the events published in one Integration Component must be less than 8 MB.
The same is true for the ATC Blueprints that are configured using the BI/ATE/Blueprint Editor. A simple workaround with its own implications is to select the ‘publish immediate’ option that is available, which avoids the problem. Please note that ‘publish immediate’ in reality means publish ASAP, not immediately."
One recommendation is to publish only one event per record in the database. The Enteprise Server architecture is event driven and is not really meant to support a batch process. Breaking the information out into individual events will most likely avoid the 8MB limitation for guaranteed events. Now making this change can have drastic implications on the rest of your implementation.
Another recommendation would be to change the event storage type from guaranteed to persistent. Of course this might be an unacceptable business risk.
A last recommendation that address your second question. You can modify the stored procedures that are created by the adapter. This would make it possible for you to prevent it from deleting all records and only delete 250. However you have to be very careful to delete the correct 250 records from the buffer table. A word of warning is to be very careful when you modify the sql triggers and stored procedures. Make s