Chunk could be reused #9
Description
Chunks allocated by RoughTokenizer and deallocated by OutputFormatter might be stored in a memory pool (probably a tbb::concurrent_vector<chunk_t*> operating as a stack), so time can be spared.
{{ message }}
Chunks allocated by RoughTokenizer and deallocated by OutputFormatter might be stored in a memory pool (probably a tbb::concurrent_vector<chunk_t*> operating as a stack), so time can be spared.