splitting large files (via msconvert?)

[Gautam Saxena]

I have some large MS raw files (eg 500 GB or greater). I'd like to ideally split it into "n" mzXML files of roughly the same size so that each X!Tandem process takes roughly the same amount of time. Is there a way to accomplish this elegantly using msconvert or some other technique? (For now, the MS files are Thermo raw files; however, they may be other MS vendor formats that we can convert to mzXML using msconvert or we may have the mzXML file itself as a starting point.)

[Gautam Saxena]

Bonus: Similarily, is there a way to break it up in "n" file sizes so that very roughly they correspond to certain sizes (eg 100 GB) each? Thus, if one MS file was say ~220 GB, it would be split into 2 files of roughtly ~100GB; but if another MS files were ~540 GB, it would be split into 5 files of roughly ~100GB. 

[Gautam Saxena]

FYI: I meant to write "MB" wherever I wrote "GB".

[Brian Pratt]

Not sure how helpful an answer this is, but (as you perhaps already know) there are several parallelized versions of X!Tandem that do that for you.

Brian

--
You received this message because you are subscribed to the Google Groups "spctools-discuss" group.

To view this discussion on the web visit https://groups.google.com/d/msg/spctools-discuss/-/Iox2AXtPMaoJ.

To post to this group, send email to spctools...@googlegroups.com.
To unsubscribe from this group, send email to spctools-discu...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/spctools-discuss?hl=en.

[Eric Deutsch]

There’s also a recent paper that describes such a strategy:

 

http://pubs.acs.org/doi/abs/10.1021/pr300561q

[Magnus....@gmail.com]

Yes, and the mzXML decomposer is available here: http://www.ms-utils.org/decomposition/. Please let us know if you encounter some problems running it.

~Magnus