I think the number 1 thing that determines when a document is too large is “what else is going on when the large doc arrives?” In some cases it may be a 100k doc that pushes it over the top.
What is the nature of the intermittent problems? Out of memory errors?