After reading a text file into memory (the vast majority of them
will fit into RAM without any problems), you may perform
encoding detection (cf. stri_enc_detect2
),
conversion (cf. stri_encode
),
and for example split it into text lines with
stri_split_lines1
.