Reccomand lossless compression for timeseries data
-
Hi
You mean compress when saving to file to reduce file size ?
Not sure other will do much better than lz4 unless someone knows a tool that is
exceptional good with floats directly.https://scicomp.stackexchange.com/questions/1671/compressing-floating-point-data
Is the file text or binary ?
-
Hi
You mean compress when saving to file to reduce file size ?
Not sure other will do much better than lz4 unless someone knows a tool that is
exceptional good with floats directly.https://scicomp.stackexchange.com/questions/1671/compressing-floating-point-data
Is the file text or binary ?
@mrjj Yes to save and append to file, text or binary does not matter as long as packed well.
In that article below it states:
Besides, while LZ4 compression ratios are good, although as good as what your typical zip utility delivers, they don’t leverage the nature of timeseries data.
Maybe something similar is available.
-
@mrjj Yes to save and append to file, text or binary does not matter as long as packed well.
In that article below it states:
Besides, while LZ4 compression ratios are good, although as good as what your typical zip utility delivers, they don’t leverage the nature of timeseries data.
Maybe something similar is available.
Hi
Yes if you can find a tool written to compress timeline data directly that should be better.While you wait for that to show up, you could try
https://github.com/disheng222/SZWhich at least was written with floats in mind.
