Navigating through a very large XML file in a web page

I have a very large XML file that needs to be displayed in my web page, may be as a tree structure. Visitors should be able to go to any level depth nodes and access the children elements or text element of those nodes.

I thought about using DOM parser with Java but dropped that idea as DOM would be stored in memory and hence its space consuming. Neither SAX works for me as every time there is a click on any of the nodes, my SAX parser parses the whole document for the node and its time consuming.

Could anyone please tell me the best technology and best parser to be used for very large XML files? is there any way with ASP etc.?

Please see reply here.


Would it not be best to use XQuery to extract the sections as needed once the user has selected a specific segment to view? This would perhaps obviate the need to store the entire document in memory where it could become a major issue as the number of concurrent users rises.

Stuart King