Making a big xml trace file

40 views
Skip to first unread message

William

unread,
Feb 23, 2016, 9:23:49 PM2/23/16
to ns-3-users
Dear members

My simulation needs a time for 2 days. I wanna store whole trace data into one xml file. so I use this API.
pAnim->SetMaxPktsPerTraceFile(999999999999999);

But xml trace file doesn't store the data more than 2GB, although simulation is still running. What should I do to make a big trace files for this?
Thanks in advance.

BR,

William.

Tommaso Pecorella

unread,
Feb 24, 2016, 3:31:01 AM2/24/16
to ns-3-users
Hi,

I'm deeply shocked that you're not able to understand what you're using. i'm even more shocked that you (and you're not the only one) are trying to misuse your own tools.
Why ? Because this makes our life harder.

T.

pdbarnes

unread,
Feb 24, 2016, 9:42:21 AM2/24/16
to ns-3-users
We've had good results with compressing/decompressing XML on the fly. We've seen compression ratios well over 20:1, which is possible because generated XML tends to be extremely repetitive.

With libxml2 this is a simple flag on opening the file for write. IIRC libxml2 recognizes compressed files automatically on read.

With compression we get the added benefit of faster access time from our NAS, since there is much less to move around.

With a little more work we've also split our largest XML stream into multiple files which we read in sequence.

YMMV,
Peter

Reply all
Reply to author
Forward
0 new messages