The _TraceFileParserWrapper hangs during handling large trace files #332

🐛 Describe the bug

Hi, I'm using HTA to process 8 ranks of large trace files. Each trace file is around 5G.
HTA hangs at parsing step.

HTA does finish the parsing successfully if I disable use_multiprocessing and parse the files sequentially or use 4 processing threads.

I'm doing this on a cluster node with more than 1T memory. Do you know what could be the root cause for hanging? Thank you~

Steps to reproduce

1. Prepare 8 large trace files (each >= 5G).
2. Parse the files and try to analysis:

ta = TraceAnalysis(trace_files=trace_files)
df = ta.get_temporal_breakdown(visualize=False)

Expected behavior

Should finish parsing and return temporal breakdown results.

Environment

OS: Ubuntu 22.04.5 LTS (Jammy).
Python 3.11.14,
HolisticTraceAnalysis Version: 0.5.0

Additional Info

No response