Ok. I can give this a shot. Would probably split it into two patches: one to keep sources in memory and only write them at the end, without changing functionality, and one to add the preprocessing function.

yes two patches is right way to go about this