You are right of course, @Martin_Wroblinski; I was only referring to tokenize as a standalone step 
@Nagendra_Prasad, yes I’ve had numerous requirements for string manipulation utilities that I had to build.
The most frequent one that I’ve used is a “search” type functionality to capture the number of ALL occurrences and positions, of a given substring (across multiple language encodings) in a single execution (link).
KM