I have a flat file with size of 26 MB and having 250000 records with 5 columns each(Pipeline delimited). I need to parse each record and insert it into a database.
Currently I am loading the file as stream(pub.file:getFile) and using iterator to convert to values. Also performing the database insertion in the same iteration.
Its taking a huge time to complete the execution (More than 30 mins).
Can anybody suggest a better approach for it?
Any pointers are welcome.