Hi All,
I need to map a large flat-file (over 20MB) into XML.
I am using the ffIterator feature in pub.flatFile:convertoToValues to optimize memory usage.
The input is read using pub.file:getFile service.
The question …
Does it matter whether I read the input as bytes or stream? Also, I see that I need to leave the “body” document (output of pub.file:getFile service) in the pipeline until the last iteration of the REPEAT loop. If I read in as bytes, this would mean I am carrying the whole file in memory throughout? Not sure how it works in case of a read as stream? Could someone please clarify this?
I am thinking that read as stream would be the solution here. But some guidance would certainly help.
Thanks in advance.