[ANN] VictoriaMetrics - fast open source time series database written in Go
643 views
Skip to first unread message
Aliaksandr Valialkin
Jun 18, 2019, 1:15:20 PM6/18/19
to golang-nuts
Hello all,
I'm happy to announce VictoriaMetrics - fast open source time series database written in Go - https://github.com/VictoriaMetrics/VictoriaMetrics .
It is written entirely in Go except of gozstd part, which is a cgo wrapper for zstd. It has the following features:
- It contains simple Go code without complex abstractions and fancy algorithms, so everyone can inspect it and contribute to it.
- It contains the minimum number of external dependencies - see go.mod. This means faster compile times and slimmer binaries. Read more about stripping dependency bloat here.
- It doesn't use mmap and WAL. Read more about this in the following articles:
- It is easy to configure and operate.
- It is designed to be used as long-term storage for Prometheus.
- It may collect data from multiple Prometheus instances via standard remote write API, so the data may be queried later in a single query (aka global querying view).
- It provides PromQL-compatible query language, so it may be used as drop-in replacement for Prometheus dashboards in Grafana.
- It is optimized for speed and low resource usage.
- It provides good on-disk compression that is better than Gorilla compression. This means more data may be stored without downsampling.
- It provides free open source cluster version.
Jason E. Aten
Jun 23, 2019, 5:34:30 PM6/23/19
to golang-nuts
very nice.
https://github.com/klauspost/compress just added zstd all in Go, might be a lovely way to remove the CGO dependency.
Aliaksandr Valialkin
Jun 23, 2019, 6:09:48 PM6/23/19
to Jason E. Aten, golang-nuts
On Sun, Jun 23, 2019 at 8:34 PM Jason E. Aten <j.e....@gmail.com> wrote:
very nice.https://github.com/klauspost/compress just added zstd all in Go, might be a lovely way to remove the CGO dependency.
I'm keeping eye on it! Currently cgo version of zstd has slightly better performance comparing to pure Go version - see https://github.com/klauspost/compress/tree/master/zstd#performance
David Anderson
Jun 23, 2019, 6:18:10 PM6/23/19
to Aliaksandr Valialkin, golang-nuts
Looks very nice, I look forward to checking it out.
I'm curious: why do you maintain separate trees for the single node vs. cluster version? Naively I would have assumed that single node == cluster codebase with a few features turned off at runtime, and there seems to be a lot of overlap between the branches. So I'm wondering what the history is :)
- Dave
--
You received this message because you are subscribed to the Google Groups "golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/6fcc8f99-0b52-4fe3-9d04-d7282b193ed0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Aliaksandr Valialkin
Jun 24, 2019, 9:52:27 AM6/24/19
to David Anderson, golang-nuts
On Sun, Jun 23, 2019 at 9:17 PM David Anderson <da...@natulte.net> wrote:
Looks very nice, I look forward to checking it out.I'm curious: why do you maintain separate trees for the single node vs. cluster version? Naively I would have assumed that single node == cluster codebase with a few features turned off at runtime, and there seems to be a lot of overlap between the branches. So I'm wondering what the history is :)
Though cluster version and single-node version have a big share of common code, cluster version has non-trivial amount of non-trivial code for RPC aka communications between nodes over the network. Single-node version should fit the majority of users because it is quite fast and scalable. So I decided moving non-trivial code related to cluster version to a separate branch, so users could understand and hack the code for single-node version without the need to investigate and understand the cluster code.
Klaus Post
Jul 11, 2019, 10:39:10 AM7/11/19
to golang-nuts
On Sunday, 23 June 2019 20:09:48 UTC+2, Aliaksandr Valialkin wrote:
On Sun, Jun 23, 2019 at 8:34 PM Jason E. Aten <j.e...@gmail.com> wrote:very nice.https://github.com/klauspost/compress just added zstd all in Go, might be a lovely way to remove the CGO dependency.I'm keeping eye on it! Currently cgo version of zstd has slightly better performance comparing to pure Go version - see https://github.com/klauspost/compress/tree/master/zstd#performance
Actually, that is only the Datadog cgo package and only for specific write sizes. It ties your cgo package for levels 1 & 3 (the only ones currently implemented) for streaming performance.
Either way, having it as an option for CGO_ENABLED=0 builds using the 'cgo' build tag, would probably make compiling/packaging it easier for a lot of people.
/Klaus
Aliaksandr Valialkin
Jul 11, 2019, 3:37:09 PM7/11/19
to Klaus Post, golang-nuts
This is really great idea! Will try implementing it.
Does github.com/klauspost/compress support all the levels for data decompression? VictoriaMetrics varies compression level depending on the data type. It would be great if github.com/klauspost/compress could decompress data compressed by the upstream zstd on higher compression levels.
Best Regards,
Aliaksandr
Aliaksandr
Klaus Post
Jul 11, 2019, 4:10:34 PM7/11/19
to golang-nuts
On Thursday, 11 July 2019 17:37:09 UTC+2, Aliaksandr Valialkin wrote:
This is really great idea! Will try implementing it.Does github.com/klauspost/compress support all the levels for data decompression? VictoriaMetrics varies compression level depending on the data type. It would be great if github.com/klauspost/compress could decompress data compressed by the upstream zstd on higher compression levels.
Decompression will work for all input. It is implementing the full spec.
Compression has "Fastest" and "Default" implemented, roughly matching level 1 and 3 in zstd in speed and performance. I plan on adding something around level 7-9 (as Better) and level 19 (as Best). But for it to be useful I have mainly focused on the fastest modes. I also am planning more concurrency in compression and decompression for streams - blocks will probably remain as single goroutines. For now I am taking a small break and having a bit of fun revisiting deflate and experimenting with Snappy.
If there is anything I can do to help feel free to ping me.
/Klaus
--Best Regards,
Aliaksandr
Michael Jones
Jul 11, 2019, 4:29:44 PM7/11/19
to Klaus Post, golang-nuts
I use Klaus' library to decompress ~GiB files that have been compressed by zstd command line (c/c++ code) at level 19. Works great.
--
You received this message because you are subscribed to the Google Groups "golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/b12c7562-b3a6-426b-bb1c-a62fcfc41714%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Michael T. Jones
michae...@gmail.com
michae...@gmail.com
Aliaksandr Valialkin
Jul 11, 2019, 4:55:53 PM7/11/19
to Michael Jones, Klaus Post, golang-nuts
On Thu, Jul 11, 2019 at 7:29 PM Michael Jones <michae...@gmail.com> wrote:
I use Klaus' library to decompress ~GiB files that have been compressed by zstd command line (c/c++ code) at level 19. Works great.
Thanks for sharing this information!
On Thu, Jul 11, 2019 at 9:10 AM Klaus Post <klau...@gmail.com> wrote:On Thursday, 11 July 2019 17:37:09 UTC+2, Aliaksandr Valialkin wrote:This is really great idea! Will try implementing it.Does github.com/klauspost/compress support all the levels for data decompression? VictoriaMetrics varies compression level depending on the data type. It would be great if github.com/klauspost/compress could decompress data compressed by the upstream zstd on higher compression levels.Decompression will work for all input. It is implementing the full spec.
Great! I filed feature request for implementing pure Go builds for VictoriaMetrics - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/94 .
--Compression has "Fastest" and "Default" implemented, roughly matching level 1 and 3 in zstd in speed and performance. I plan on adding something around level 7-9 (as Better) and level 19 (as Best). But for it to be useful I have mainly focused on the fastest modes. I also am planning more concurrency in compression and decompression for streams - blocks will probably remain as single goroutines. For now I am taking a small break and having a bit of fun revisiting deflate and experimenting with Snappy.If there is anything I can do to help feel free to ping me./Klaus--Best Regards,
Aliaksandr
You received this message because you are subscribed to the Google Groups "golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/b12c7562-b3a6-426b-bb1c-a62fcfc41714%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
----Michael T. Jones
michae...@gmail.com
You received this message because you are subscribed to a topic in the Google Groups "golang-nuts" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/golang-nuts/onlD1GIG00g/unsubscribe.
To unsubscribe from this group and all its topics, send an email to golang-nuts...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/CALoEmQwocTkYXf7bn39mxpkhuF%2Bynogb8BC6YwzXa9%3Dj89%3DvQw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Best Regards,
Aliaksandr
Aliaksandr
Michael Jones
Jul 11, 2019, 5:23:14 PM7/11/19
to Aliaksandr Valialkin, Klaus Post, golang-nuts
details...
celeste:gg mtj$ ls -l ~/corpora/go/corpusZ.tar
-rw-r--r-- 1 mtj staff 92386304 Jul 4 02:27 /Users/mtj/corpora/go/corpusZ.tar
-rw-r--r-- 1 mtj staff 92386304 Jul 4 02:27 /Users/mtj/corpora/go/corpusZ.tar
this is the Go corpus compressed in chunks and then gathered as a tar file. 92MB at zstd #19, original size is 752 311 514 bytes. (Zstd compresses some large Go files 50:1)
Here is looking for strings in that tar's unarchived, decompressed, Go code using gg (https://github.com/MichaelTJones/gg):
celeste:gg mtj$ gg -summary -log log -digits s pizza ~/corpora/go/corpusZ.tar
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: add(pair("blake", "eats pizza"))
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: t.Fatalf("after pizza, size = %d; want %d", d.dynTab.size, want)
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "piwatepizzapkonskowolayangroupharmacyshirahamatonbetsurgutsiracu" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000031.go: data: `{"tags": [{"list": [{"one":"pizza"}]}]}`,
/Users/mtj/corpora/go/corpusZ.tar::blob_000031.go: output: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000065.go: "raskaunbieidsvollpiwatepizzapkosaigawaplanetariuminanoplantation" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: add(pair("blake", "eats pizza"))
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: t.Fatalf("after pizza, size = %d; want %d", d.dynTab.size, want)
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "piwatepizzapkoninjamisonplanetariuminnesotaketakayamatsumaebashi" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: {"test :\n```bash\nthis is a test\n```\n\ntest\n\n:cool::blush:::pizza:\\:blush : : blush: :pizza:", []byte("test :\n```bash\nthis is a test\n```\n\ntest\n\n🆒😊:🍕\\:blush : : blush: 🍕")},
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: ":pizza:": "\U0001f355",
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: pizzaMessage := emoji.Sprint("I like a :pizza: and :sushi:!!")
performance
grep 16 matches
work 752 311 514 bytes, 170 302 873 tokens, 22 927 078 lines, 176 files
time 3.975375 sec elapsed, 25.803189 sec user + 0.985283 system
rate 189 242 887 bytes/sec, 42 839 444 tokens/sec, 5 767 273 lines/sec, 44 files/sec
cpus 7 workers (parallel speedup = 6.74x)
celeste:gg mtj$
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: add(pair("blake", "eats pizza"))
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: t.Fatalf("after pizza, size = %d; want %d", d.dynTab.size, want)
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000022.go: "piwatepizzapkonskowolayangroupharmacyshirahamatonbetsurgutsiracu" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000031.go: data: `{"tags": [{"list": [{"one":"pizza"}]}]}`,
/Users/mtj/corpora/go/corpusZ.tar::blob_000031.go: output: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000065.go: "raskaunbieidsvollpiwatepizzapkosaigawaplanetariuminanoplantation" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: add(pair("blake", "eats pizza"))
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: t.Fatalf("after pizza, size = %d; want %d", d.dynTab.size, want)
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "pizza",
/Users/mtj/corpora/go/corpusZ.tar::blob_000099.go: "piwatepizzapkoninjamisonplanetariuminnesotaketakayamatsumaebashi" +
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: {"test :\n```bash\nthis is a test\n```\n\ntest\n\n:cool::blush:::pizza:\\:blush : : blush: :pizza:", []byte("test :\n```bash\nthis is a test\n```\n\ntest\n\n🆒😊:🍕\\:blush : : blush: 🍕")},
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: ":pizza:": "\U0001f355",
/Users/mtj/corpora/go/corpusZ.tar::blob_000137.go: pizzaMessage := emoji.Sprint("I like a :pizza: and :sushi:!!")
performance
grep 16 matches
work 752 311 514 bytes, 170 302 873 tokens, 22 927 078 lines, 176 files
time 3.975375 sec elapsed, 25.803189 sec user + 0.985283 system
rate 189 242 887 bytes/sec, 42 839 444 tokens/sec, 5 767 273 lines/sec, 44 files/sec
cpus 7 workers (parallel speedup = 6.74x)
celeste:gg mtj$
This rate, 189 mb/sec, is on a 4 core 8 thread macbook pro and is the average over the whole corpus, so reflects not just lexical tokenization of 752 MB of Go code, grep-like regular expression matching for "pizza", but also Klaus' Go-only, native Zstandard decompression, which transforms the 92 MB tar file to the 752 MB of code. Here are timing numbers, per file, for Zstd expansion: (gg -log log)
celeste:gg mtj$ cat log
2019/07/11 10:05:31.433048 scan begins
2019/07/11 10:05:31.433240 processing files listed on command line
2019/07/11 10:05:31.433324 processing tar archive /Users/mtj/corpora/go/corpusZ.tar
2019/07/11 10:05:31.471641 206993 → 4023123 bytes (19.436×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000005.go.zst
2019/07/11 10:05:31.475658 97312 → 4889323 bytes (50.244×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000003.go.zst
2019/07/11 10:05:31.478435 588144 → 4058916 bytes ( 6.901×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000000.go.zst
2019/07/11 10:05:31.478751 252664 → 4343752 bytes (17.192×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000001.go.zst
2019/07/11 10:05:31.483804 254045 → 4245209 bytes (16.710×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000006.go.zst
2019/07/11 10:05:31.483819 93940 → 4666515 bytes (49.675×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000004.go.zst
2019/07/11 10:05:31.484640 212543 → 5266751 bytes (24.780×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000002.go.zst
2019/07/11 10:05:31.596666 796173 → 5097981 bytes ( 6.403×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000012.go.zst
2019/07/11 10:05:31.605878 222357 → 4149988 bytes (18.664×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000013.go.zst
2019/07/11 10:05:31.606986 115654 → 5244204 bytes (45.344×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000008.go.zst
2019/07/11 10:05:31.621446 202508 → 4353542 bytes (21.498×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000010.go.zst
2019/07/11 10:05:31.624954 326016 → 4010657 bytes (12.302×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000011.go.zst
2019/07/11 10:05:31.632554 207580 → 4065186 bytes (19.584×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000009.go.zst
2019/07/11 10:05:31.645472 174997 → 4008262 bytes (22.905×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000007.go.zst
2019/07/11 10:05:31.740442 426643 → 4001493 bytes ( 9.379×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000019.go.zst
2019/07/11 10:05:31.744056 264530 → 4046021 bytes (15.295×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000016.go.zst
2019/07/11 10:05:31.745338 627327 → 4004365 bytes ( 6.383×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000017.go.zst
2019/07/11 10:05:31.751263 258532 → 4042393 bytes (15.636×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000018.go.zst
2019/07/11 10:05:31.751756 471019 → 4008325 bytes ( 8.510×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000015.go.zst
2019/07/11 10:05:31.760835 379616 → 4320295 bytes (11.381×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000014.go.zst
2019/07/11 10:05:31.802144 556027 → 4003356 bytes ( 7.200×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000020.go.zst
2019/07/11 10:05:31.901767 372064 → 4193635 bytes (11.271×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000024.go.zst
2019/07/11 10:05:31.909306 397412 → 4554722 bytes (11.461×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000023.go.zst
2019/07/11 10:05:31.916362 1248756 → 8379069 bytes ( 6.710×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000026.go.zst
2019/07/11 10:05:31.932392 770723 → 4808476 bytes ( 6.239×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000022.go.zst
2019/07/11 10:05:31.970928 224452 → 4027062 bytes (17.942×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000025.go.zst
2019/07/11 10:05:32.002406 651210 → 4400457 bytes ( 6.757×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000027.go.zst
2019/07/11 10:05:32.004718 1231592 → 4316079 bytes ( 3.504×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000021.go.zst
2019/07/11 10:05:32.087856 353702 → 4029909 bytes (11.394×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000031.go.zst
2019/07/11 10:05:32.105936 848426 → 4039351 bytes ( 4.761×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000030.go.zst
2019/07/11 10:05:32.125037 650697 → 4003712 bytes ( 6.153×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000029.go.zst
2019/07/11 10:05:32.149261 518660 → 4008953 bytes ( 7.729×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000032.go.zst
2019/07/11 10:05:32.157127 654288 → 4007926 bytes ( 6.126×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000033.go.zst
2019/07/11 10:05:32.183090 896938 → 4703274 bytes ( 5.244×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000028.go.zst
2019/07/11 10:05:32.213361 744952 → 4053128 bytes ( 5.441×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000034.go.zst
2019/07/11 10:05:32.248550 491073 → 4008267 bytes ( 8.162×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000038.go.zst
2019/07/11 10:05:32.265478 680203 → 4001134 bytes ( 5.882×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000037.go.zst
2019/07/11 10:05:32.271071 734833 → 4000138 bytes ( 5.444×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000036.go.zst
2019/07/11 10:05:32.284729 360922 → 4005048 bytes (11.097×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000039.go.zst
2019/07/11 10:05:32.303961 308798 → 4018343 bytes (13.013×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000035.go.zst
2019/07/11 10:05:32.306066 391388 → 4010727 bytes (10.247×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000040.go.zst
2019/07/11 10:05:32.362341 484355 → 4001344 bytes ( 8.261×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000045.go.zst
2019/07/11 10:05:32.380463 375405 → 4000209 bytes (10.656×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000041.go.zst
2019/07/11 10:05:32.417273 358429 → 4046348 bytes (11.289×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000044.go.zst
2019/07/11 10:05:32.420960 375823 → 4378995 bytes (11.652×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000043.go.zst
2019/07/11 10:05:32.444477 730772 → 4246251 bytes ( 5.811×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000046.go.zst
2019/07/11 10:05:32.459183 604840 → 4027513 bytes ( 6.659×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000042.go.zst
2019/07/11 10:05:32.480410 518876 → 4008279 bytes ( 7.725×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000047.go.zst
2019/07/11 10:05:32.511231 330245 → 4667908 bytes (14.135×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000048.go.zst
2019/07/11 10:05:32.538113 641796 → 4017023 bytes ( 6.259×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000052.go.zst
2019/07/11 10:05:32.587558 686143 → 4358371 bytes ( 6.352×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000053.go.zst
2019/07/11 10:05:32.592458 1011230 → 4002547 bytes ( 3.958×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000051.go.zst
2019/07/11 10:05:32.597859 627406 → 4003373 bytes ( 6.381×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000050.go.zst
2019/07/11 10:05:32.605734 502047 → 4009282 bytes ( 7.986×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000049.go.zst
2019/07/11 10:05:32.655583 586706 → 4066973 bytes ( 6.932×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000054.go.zst
2019/07/11 10:05:32.679516 620595 → 4002107 bytes ( 6.449×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000059.go.zst
2019/07/11 10:05:32.687838 369297 → 4001749 bytes (10.836×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000058.go.zst
2019/07/11 10:05:32.691284 408358 → 4008987 bytes ( 9.817×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000055.go.zst
2019/07/11 10:05:32.744006 636283 → 4028244 bytes ( 6.331×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000060.go.zst
2019/07/11 10:05:32.768291 277219 → 4002291 bytes (14.437×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000057.go.zst
2019/07/11 10:05:32.781058 557989 → 4005679 bytes ( 7.179×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000056.go.zst
2019/07/11 10:05:32.822744 414283 → 4269034 bytes (10.305×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000061.go.zst
2019/07/11 10:05:32.835958 468418 → 4059427 bytes ( 8.666×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000066.go.zst
2019/07/11 10:05:32.847792 608908 → 4014328 bytes ( 6.593×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000062.go.zst
2019/07/11 10:05:32.888771 690474 → 4000820 bytes ( 5.794×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000065.go.zst
2019/07/11 10:05:32.897517 521619 → 4150632 bytes ( 7.957×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000067.go.zst
2019/07/11 10:05:32.921717 680148 → 4000246 bytes ( 5.881×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000064.go.zst
2019/07/11 10:05:32.956136 639151 → 4000706 bytes ( 6.259×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000063.go.zst
2019/07/11 10:05:32.962578 471848 → 4040865 bytes ( 8.564×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000073.go.zst
2019/07/11 10:05:32.991789 489327 → 4005132 bytes ( 8.185×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000068.go.zst
2019/07/11 10:05:33.020254 523091 → 4004755 bytes ( 7.656×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000069.go.zst
2019/07/11 10:05:33.025607 450401 → 4083159 bytes ( 9.066×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000072.go.zst
2019/07/11 10:05:33.029834 520708 → 4007521 bytes ( 7.696×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000074.go.zst
2019/07/11 10:05:33.050782 378552 → 4001925 bytes (10.572×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000071.go.zst
2019/07/11 10:05:33.118232 269084 → 4009476 bytes (14.900×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000080.go.zst
2019/07/11 10:05:33.138117 592627 → 4526083 bytes ( 7.637×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000075.go.zst
2019/07/11 10:05:33.140114 738182 → 4008928 bytes ( 5.431×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000070.go.zst
2019/07/11 10:05:33.167534 663139 → 4001954 bytes ( 6.035×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000079.go.zst
2019/07/11 10:05:33.177132 516721 → 4001675 bytes ( 7.744×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000081.go.zst
2019/07/11 10:05:33.189430 499878 → 4000568 bytes ( 8.003×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000078.go.zst
2019/07/11 10:05:33.216166 308152 → 4067621 bytes (13.200×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000076.go.zst
2019/07/11 10:05:33.249731 582032 → 4394445 bytes ( 7.550×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000082.go.zst
2019/07/11 10:05:33.269010 364537 → 4396798 bytes (12.061×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000087.go.zst
2019/07/11 10:05:33.283364 184365 → 4373843 bytes (23.724×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000088.go.zst
2019/07/11 10:05:33.287415 712220 → 4055369 bytes ( 5.694×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000077.go.zst
2019/07/11 10:05:33.321402 751294 → 4003781 bytes ( 5.329×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000086.go.zst
2019/07/11 10:05:33.324074 354366 → 4002277 bytes (11.294×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000085.go.zst
2019/07/11 10:05:33.334724 716464 → 4006384 bytes ( 5.592×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000094.go.zst
2019/07/11 10:05:33.355151 363508 → 4001510 bytes (11.008×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000083.go.zst
2019/07/11 10:05:33.400834 598521 → 4620592 bytes ( 7.720×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000095.go.zst
2019/07/11 10:05:33.409613 198910 → 4094836 bytes (20.586×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000089.go.zst
2019/07/11 10:05:33.435069 386309 → 4002560 bytes (10.361×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000084.go.zst
2019/07/11 10:05:33.445655 184047 → 4364073 bytes (23.712×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000090.go.zst
2019/07/11 10:05:33.457476 541657 → 4290849 bytes ( 7.922×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000092.go.zst
2019/07/11 10:05:33.470683 868726 → 4003490 bytes ( 4.608×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000093.go.zst
2019/07/11 10:05:33.495689 1260317 → 5556243 bytes ( 4.409×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000101.go.zst
2019/07/11 10:05:33.519851 579813 → 4005688 bytes ( 6.909×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000096.go.zst
2019/07/11 10:05:33.543813 672782 → 4002577 bytes ( 5.949×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000102.go.zst
2019/07/11 10:05:33.551926 566709 → 4006434 bytes ( 7.070×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000097.go.zst
2019/07/11 10:05:33.571590 569324 → 4041363 bytes ( 7.099×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000100.go.zst
2019/07/11 10:05:33.583279 200062 → 5051258 bytes (25.248×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000091.go.zst
2019/07/11 10:05:33.606004 472200 → 4024953 bytes ( 8.524×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000099.go.zst
2019/07/11 10:05:33.635531 575127 → 4001741 bytes ( 6.958×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000108.go.zst
2019/07/11 10:05:33.686650 534639 → 4012273 bytes ( 7.505×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000109.go.zst
2019/07/11 10:05:33.695229 1285860 → 5272770 bytes ( 4.101×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000103.go.zst
2019/07/11 10:05:33.720187 412864 → 4049274 bytes ( 9.808×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000107.go.zst
2019/07/11 10:05:33.720982 605166 → 4005251 bytes ( 6.618×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000098.go.zst
2019/07/11 10:05:33.737777 726153 → 4001435 bytes ( 5.510×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000104.go.zst
2019/07/11 10:05:33.755917 799097 → 4000015 bytes ( 5.006×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000106.go.zst
2019/07/11 10:05:33.773795 422867 → 4000786 bytes ( 9.461×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000115.go.zst
2019/07/11 10:05:33.810990 393810 → 4001894 bytes (10.162×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000110.go.zst
2019/07/11 10:05:33.847795 549097 → 4457876 bytes ( 8.119×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000114.go.zst
2019/07/11 10:05:33.863927 271390 → 4008218 bytes (14.769×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000105.go.zst
2019/07/11 10:05:33.867743 233106 → 4000444 bytes (17.161×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000111.go.zst
2019/07/11 10:05:33.867836 562574 → 4003299 bytes ( 7.116×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000116.go.zst
2019/07/11 10:05:33.911283 311625 → 4018660 bytes (12.896×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000112.go.zst
2019/07/11 10:05:33.925529 694084 → 4509171 bytes ( 6.497×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000113.go.zst
2019/07/11 10:05:33.929689 455910 → 4000240 bytes ( 8.774×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000122.go.zst
2019/07/11 10:05:33.943061 568708 → 4969481 bytes ( 8.738×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000117.go.zst
2019/07/11 10:05:33.999025 701356 → 4041892 bytes ( 5.763×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000121.go.zst
2019/07/11 10:05:34.019081 947328 → 5271725 bytes ( 5.565×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000123.go.zst
2019/07/11 10:05:34.046375 503850 → 4000020 bytes ( 7.939×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000118.go.zst
2019/07/11 10:05:34.067051 264587 → 4053813 bytes (15.321×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000120.go.zst
2019/07/11 10:05:34.088091 531199 → 4705989 bytes ( 8.859×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000129.go.zst
2019/07/11 10:05:34.091944 502142 → 4010187 bytes ( 7.986×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000119.go.zst
2019/07/11 10:05:34.121482 416870 → 4002183 bytes ( 9.601×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000124.go.zst
2019/07/11 10:05:34.126305 503153 → 4010237 bytes ( 7.970×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000130.go.zst
2019/07/11 10:05:34.137981 573336 → 4029106 bytes ( 7.027×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000128.go.zst
2019/07/11 10:05:34.203384 464844 → 4022011 bytes ( 8.652×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000127.go.zst
2019/07/11 10:05:34.209802 434146 → 4005918 bytes ( 9.227×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000125.go.zst
2019/07/11 10:05:34.226746 562023 → 4036194 bytes ( 7.182×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000126.go.zst
2019/07/11 10:05:34.253277 534846 → 4298152 bytes ( 8.036×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000136.go.zst
2019/07/11 10:05:34.283738 474416 → 4015827 bytes ( 8.465×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000135.go.zst
2019/07/11 10:05:34.297443 676273 → 4017143 bytes ( 5.940×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000137.go.zst
2019/07/11 10:05:34.350197 485533 → 4003784 bytes ( 8.246×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000134.go.zst
2019/07/11 10:05:34.367692 558522 → 4012951 bytes ( 7.185×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000133.go.zst
2019/07/11 10:05:34.379223 2771127 → 13048604 bytes ( 4.709×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000131.go.zst
2019/07/11 10:05:34.385873 2528170 → 10905639 bytes ( 4.314×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000132.go.zst
2019/07/11 10:05:34.420100 309923 → 4001685 bytes (12.912×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000143.go.zst
2019/07/11 10:05:34.440169 376289 → 4028740 bytes (10.707×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000142.go.zst
2019/07/11 10:05:34.447682 316988 → 4001667 bytes (12.624×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000144.go.zst
2019/07/11 10:05:34.496823 290607 → 4002723 bytes (13.774×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000141.go.zst
2019/07/11 10:05:34.522682 434315 → 4018276 bytes ( 9.252×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000150.go.zst
2019/07/11 10:05:34.529963 658292 → 4000448 bytes ( 6.077×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000140.go.zst
2019/07/11 10:05:34.543966 279896 → 4110833 bytes (14.687×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000151.go.zst
2019/07/11 10:05:34.572687 1086021 → 4494390 bytes ( 4.138×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000149.go.zst
2019/07/11 10:05:34.576312 611655 → 4095210 bytes ( 6.695×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000138.go.zst
2019/07/11 10:05:34.626874 317859 → 4172019 bytes (13.125×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000148.go.zst
2019/07/11 10:05:34.638622 376698 → 4003119 bytes (10.627×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000157.go.zst
2019/07/11 10:05:34.639242 533870 → 4003901 bytes ( 7.500×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000139.go.zst
2019/07/11 10:05:34.690782 274293 → 4083501 bytes (14.887×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000147.go.zst
2019/07/11 10:05:34.702534 744282 → 4006230 bytes ( 5.383×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000156.go.zst
2019/07/11 10:05:34.723371 291584 → 4168844 bytes (14.297×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000145.go.zst
2019/07/11 10:05:34.729076 422603 → 4006953 bytes ( 9.482×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000155.go.zst
2019/07/11 10:05:34.731728 711141 → 4008574 bytes ( 5.637×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000158.go.zst
2019/07/11 10:05:34.775064 603118 → 4136079 bytes ( 6.858×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000163.go.zst
2019/07/11 10:05:34.792702 340353 → 4424067 bytes (12.998×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000164.go.zst
2019/07/11 10:05:34.796162 618352 → 4002249 bytes ( 6.472×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000154.go.zst
2019/07/11 10:05:34.820524 289494 → 4036048 bytes (13.942×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000146.go.zst
2019/07/11 10:05:34.820605 309016 → 5260095 bytes (17.022×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000152.go.zst
2019/07/11 10:05:34.865440 131045 → 4280066 bytes (32.661×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000165.go.zst
2019/07/11 10:05:34.870480 406615 → 4000797 bytes ( 9.839×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000162.go.zst
2019/07/11 10:05:34.918977 252124 → 4012267 bytes (15.914×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000153.go.zst
2019/07/11 10:05:34.927295 456129 → 4042538 bytes ( 8.863×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000161.go.zst
2019/07/11 10:05:34.942748 717740 → 4319130 bytes ( 6.018×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000170.go.zst
2019/07/11 10:05:35.011325 731744 → 4013175 bytes ( 5.484×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000171.go.zst
2019/07/11 10:05:35.040012 565284 → 4163041 bytes ( 7.365×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000169.go.zst
2019/07/11 10:05:35.062413 289918 → 4000001 bytes (13.797×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000159.go.zst
2019/07/11 10:05:35.066697 703842 → 4000001 bytes ( 5.683×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000160.go.zst
2019/07/11 10:05:35.075955 190967 → 4197565 bytes (21.981×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000168.go.zst
2019/07/11 10:05:35.085458 290878 → 4010780 bytes (13.789×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000172.go.zst
2019/07/11 10:05:35.170622 97265 → 4243884 bytes (43.632×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000166.go.zst
2019/07/11 10:05:35.184665 171285 → 4069187 bytes (23.757×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000167.go.zst
2019/07/11 10:05:35.224262 534458 → 2880005 bytes ( 5.389×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000175.go.zst
2019/07/11 10:05:35.312594 619070 → 4002126 bytes ( 6.465×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000174.go.zst
2019/07/11 10:05:35.313823 518866 → 4350379 bytes ( 8.384×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000173.go.zst
2019/07/11 10:05:35.408361 scan ends
2019/07/11 10:05:35.408391 performance
2019/07/11 10:05:35.408400 grep 16 matches
2019/07/11 10:05:35.408408 work 752 311 514 bytes, 170 302 873 tokens, 22 927 078 lines, 176 files
2019/07/11 10:05:35.408417 time 3.975375 sec elapsed, 25.803189 sec user + 0.985283 system
2019/07/11 10:05:35.408424 rate 189 242 887 bytes/sec, 42 839 444 tokens/sec, 5 767 273 lines/sec, 44 files/sec
2019/07/11 10:05:35.408431 cpus 7 workers (parallel speedup = 6.74x)
celeste:gg mtj$
2019/07/11 10:05:31.433048 scan begins
2019/07/11 10:05:31.433240 processing files listed on command line
2019/07/11 10:05:31.433324 processing tar archive /Users/mtj/corpora/go/corpusZ.tar
2019/07/11 10:05:31.471641 206993 → 4023123 bytes (19.436×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000005.go.zst
2019/07/11 10:05:31.475658 97312 → 4889323 bytes (50.244×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000003.go.zst
2019/07/11 10:05:31.478435 588144 → 4058916 bytes ( 6.901×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000000.go.zst
2019/07/11 10:05:31.478751 252664 → 4343752 bytes (17.192×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000001.go.zst
2019/07/11 10:05:31.483804 254045 → 4245209 bytes (16.710×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000006.go.zst
2019/07/11 10:05:31.483819 93940 → 4666515 bytes (49.675×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000004.go.zst
2019/07/11 10:05:31.484640 212543 → 5266751 bytes (24.780×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000002.go.zst
2019/07/11 10:05:31.596666 796173 → 5097981 bytes ( 6.403×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000012.go.zst
2019/07/11 10:05:31.605878 222357 → 4149988 bytes (18.664×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000013.go.zst
2019/07/11 10:05:31.606986 115654 → 5244204 bytes (45.344×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000008.go.zst
2019/07/11 10:05:31.621446 202508 → 4353542 bytes (21.498×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000010.go.zst
2019/07/11 10:05:31.624954 326016 → 4010657 bytes (12.302×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000011.go.zst
2019/07/11 10:05:31.632554 207580 → 4065186 bytes (19.584×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000009.go.zst
2019/07/11 10:05:31.645472 174997 → 4008262 bytes (22.905×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000007.go.zst
2019/07/11 10:05:31.740442 426643 → 4001493 bytes ( 9.379×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000019.go.zst
2019/07/11 10:05:31.744056 264530 → 4046021 bytes (15.295×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000016.go.zst
2019/07/11 10:05:31.745338 627327 → 4004365 bytes ( 6.383×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000017.go.zst
2019/07/11 10:05:31.751263 258532 → 4042393 bytes (15.636×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000018.go.zst
2019/07/11 10:05:31.751756 471019 → 4008325 bytes ( 8.510×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000015.go.zst
2019/07/11 10:05:31.760835 379616 → 4320295 bytes (11.381×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000014.go.zst
2019/07/11 10:05:31.802144 556027 → 4003356 bytes ( 7.200×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000020.go.zst
2019/07/11 10:05:31.901767 372064 → 4193635 bytes (11.271×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000024.go.zst
2019/07/11 10:05:31.909306 397412 → 4554722 bytes (11.461×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000023.go.zst
2019/07/11 10:05:31.916362 1248756 → 8379069 bytes ( 6.710×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000026.go.zst
2019/07/11 10:05:31.932392 770723 → 4808476 bytes ( 6.239×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000022.go.zst
2019/07/11 10:05:31.970928 224452 → 4027062 bytes (17.942×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000025.go.zst
2019/07/11 10:05:32.002406 651210 → 4400457 bytes ( 6.757×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000027.go.zst
2019/07/11 10:05:32.004718 1231592 → 4316079 bytes ( 3.504×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000021.go.zst
2019/07/11 10:05:32.087856 353702 → 4029909 bytes (11.394×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000031.go.zst
2019/07/11 10:05:32.105936 848426 → 4039351 bytes ( 4.761×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000030.go.zst
2019/07/11 10:05:32.125037 650697 → 4003712 bytes ( 6.153×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000029.go.zst
2019/07/11 10:05:32.149261 518660 → 4008953 bytes ( 7.729×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000032.go.zst
2019/07/11 10:05:32.157127 654288 → 4007926 bytes ( 6.126×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000033.go.zst
2019/07/11 10:05:32.183090 896938 → 4703274 bytes ( 5.244×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000028.go.zst
2019/07/11 10:05:32.213361 744952 → 4053128 bytes ( 5.441×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000034.go.zst
2019/07/11 10:05:32.248550 491073 → 4008267 bytes ( 8.162×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000038.go.zst
2019/07/11 10:05:32.265478 680203 → 4001134 bytes ( 5.882×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000037.go.zst
2019/07/11 10:05:32.271071 734833 → 4000138 bytes ( 5.444×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000036.go.zst
2019/07/11 10:05:32.284729 360922 → 4005048 bytes (11.097×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000039.go.zst
2019/07/11 10:05:32.303961 308798 → 4018343 bytes (13.013×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000035.go.zst
2019/07/11 10:05:32.306066 391388 → 4010727 bytes (10.247×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000040.go.zst
2019/07/11 10:05:32.362341 484355 → 4001344 bytes ( 8.261×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000045.go.zst
2019/07/11 10:05:32.380463 375405 → 4000209 bytes (10.656×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000041.go.zst
2019/07/11 10:05:32.417273 358429 → 4046348 bytes (11.289×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000044.go.zst
2019/07/11 10:05:32.420960 375823 → 4378995 bytes (11.652×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000043.go.zst
2019/07/11 10:05:32.444477 730772 → 4246251 bytes ( 5.811×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000046.go.zst
2019/07/11 10:05:32.459183 604840 → 4027513 bytes ( 6.659×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000042.go.zst
2019/07/11 10:05:32.480410 518876 → 4008279 bytes ( 7.725×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000047.go.zst
2019/07/11 10:05:32.511231 330245 → 4667908 bytes (14.135×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000048.go.zst
2019/07/11 10:05:32.538113 641796 → 4017023 bytes ( 6.259×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000052.go.zst
2019/07/11 10:05:32.587558 686143 → 4358371 bytes ( 6.352×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000053.go.zst
2019/07/11 10:05:32.592458 1011230 → 4002547 bytes ( 3.958×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000051.go.zst
2019/07/11 10:05:32.597859 627406 → 4003373 bytes ( 6.381×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000050.go.zst
2019/07/11 10:05:32.605734 502047 → 4009282 bytes ( 7.986×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000049.go.zst
2019/07/11 10:05:32.655583 586706 → 4066973 bytes ( 6.932×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000054.go.zst
2019/07/11 10:05:32.679516 620595 → 4002107 bytes ( 6.449×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000059.go.zst
2019/07/11 10:05:32.687838 369297 → 4001749 bytes (10.836×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000058.go.zst
2019/07/11 10:05:32.691284 408358 → 4008987 bytes ( 9.817×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000055.go.zst
2019/07/11 10:05:32.744006 636283 → 4028244 bytes ( 6.331×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000060.go.zst
2019/07/11 10:05:32.768291 277219 → 4002291 bytes (14.437×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000057.go.zst
2019/07/11 10:05:32.781058 557989 → 4005679 bytes ( 7.179×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000056.go.zst
2019/07/11 10:05:32.822744 414283 → 4269034 bytes (10.305×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000061.go.zst
2019/07/11 10:05:32.835958 468418 → 4059427 bytes ( 8.666×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000066.go.zst
2019/07/11 10:05:32.847792 608908 → 4014328 bytes ( 6.593×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000062.go.zst
2019/07/11 10:05:32.888771 690474 → 4000820 bytes ( 5.794×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000065.go.zst
2019/07/11 10:05:32.897517 521619 → 4150632 bytes ( 7.957×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000067.go.zst
2019/07/11 10:05:32.921717 680148 → 4000246 bytes ( 5.881×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000064.go.zst
2019/07/11 10:05:32.956136 639151 → 4000706 bytes ( 6.259×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000063.go.zst
2019/07/11 10:05:32.962578 471848 → 4040865 bytes ( 8.564×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000073.go.zst
2019/07/11 10:05:32.991789 489327 → 4005132 bytes ( 8.185×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000068.go.zst
2019/07/11 10:05:33.020254 523091 → 4004755 bytes ( 7.656×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000069.go.zst
2019/07/11 10:05:33.025607 450401 → 4083159 bytes ( 9.066×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000072.go.zst
2019/07/11 10:05:33.029834 520708 → 4007521 bytes ( 7.696×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000074.go.zst
2019/07/11 10:05:33.050782 378552 → 4001925 bytes (10.572×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000071.go.zst
2019/07/11 10:05:33.118232 269084 → 4009476 bytes (14.900×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000080.go.zst
2019/07/11 10:05:33.138117 592627 → 4526083 bytes ( 7.637×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000075.go.zst
2019/07/11 10:05:33.140114 738182 → 4008928 bytes ( 5.431×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000070.go.zst
2019/07/11 10:05:33.167534 663139 → 4001954 bytes ( 6.035×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000079.go.zst
2019/07/11 10:05:33.177132 516721 → 4001675 bytes ( 7.744×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000081.go.zst
2019/07/11 10:05:33.189430 499878 → 4000568 bytes ( 8.003×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000078.go.zst
2019/07/11 10:05:33.216166 308152 → 4067621 bytes (13.200×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000076.go.zst
2019/07/11 10:05:33.249731 582032 → 4394445 bytes ( 7.550×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000082.go.zst
2019/07/11 10:05:33.269010 364537 → 4396798 bytes (12.061×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000087.go.zst
2019/07/11 10:05:33.283364 184365 → 4373843 bytes (23.724×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000088.go.zst
2019/07/11 10:05:33.287415 712220 → 4055369 bytes ( 5.694×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000077.go.zst
2019/07/11 10:05:33.321402 751294 → 4003781 bytes ( 5.329×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000086.go.zst
2019/07/11 10:05:33.324074 354366 → 4002277 bytes (11.294×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000085.go.zst
2019/07/11 10:05:33.334724 716464 → 4006384 bytes ( 5.592×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000094.go.zst
2019/07/11 10:05:33.355151 363508 → 4001510 bytes (11.008×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000083.go.zst
2019/07/11 10:05:33.400834 598521 → 4620592 bytes ( 7.720×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000095.go.zst
2019/07/11 10:05:33.409613 198910 → 4094836 bytes (20.586×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000089.go.zst
2019/07/11 10:05:33.435069 386309 → 4002560 bytes (10.361×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000084.go.zst
2019/07/11 10:05:33.445655 184047 → 4364073 bytes (23.712×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000090.go.zst
2019/07/11 10:05:33.457476 541657 → 4290849 bytes ( 7.922×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000092.go.zst
2019/07/11 10:05:33.470683 868726 → 4003490 bytes ( 4.608×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000093.go.zst
2019/07/11 10:05:33.495689 1260317 → 5556243 bytes ( 4.409×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000101.go.zst
2019/07/11 10:05:33.519851 579813 → 4005688 bytes ( 6.909×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000096.go.zst
2019/07/11 10:05:33.543813 672782 → 4002577 bytes ( 5.949×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000102.go.zst
2019/07/11 10:05:33.551926 566709 → 4006434 bytes ( 7.070×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000097.go.zst
2019/07/11 10:05:33.571590 569324 → 4041363 bytes ( 7.099×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000100.go.zst
2019/07/11 10:05:33.583279 200062 → 5051258 bytes (25.248×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000091.go.zst
2019/07/11 10:05:33.606004 472200 → 4024953 bytes ( 8.524×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000099.go.zst
2019/07/11 10:05:33.635531 575127 → 4001741 bytes ( 6.958×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000108.go.zst
2019/07/11 10:05:33.686650 534639 → 4012273 bytes ( 7.505×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000109.go.zst
2019/07/11 10:05:33.695229 1285860 → 5272770 bytes ( 4.101×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000103.go.zst
2019/07/11 10:05:33.720187 412864 → 4049274 bytes ( 9.808×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000107.go.zst
2019/07/11 10:05:33.720982 605166 → 4005251 bytes ( 6.618×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000098.go.zst
2019/07/11 10:05:33.737777 726153 → 4001435 bytes ( 5.510×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000104.go.zst
2019/07/11 10:05:33.755917 799097 → 4000015 bytes ( 5.006×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000106.go.zst
2019/07/11 10:05:33.773795 422867 → 4000786 bytes ( 9.461×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000115.go.zst
2019/07/11 10:05:33.810990 393810 → 4001894 bytes (10.162×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000110.go.zst
2019/07/11 10:05:33.847795 549097 → 4457876 bytes ( 8.119×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000114.go.zst
2019/07/11 10:05:33.863927 271390 → 4008218 bytes (14.769×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000105.go.zst
2019/07/11 10:05:33.867743 233106 → 4000444 bytes (17.161×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000111.go.zst
2019/07/11 10:05:33.867836 562574 → 4003299 bytes ( 7.116×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000116.go.zst
2019/07/11 10:05:33.911283 311625 → 4018660 bytes (12.896×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000112.go.zst
2019/07/11 10:05:33.925529 694084 → 4509171 bytes ( 6.497×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000113.go.zst
2019/07/11 10:05:33.929689 455910 → 4000240 bytes ( 8.774×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000122.go.zst
2019/07/11 10:05:33.943061 568708 → 4969481 bytes ( 8.738×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000117.go.zst
2019/07/11 10:05:33.999025 701356 → 4041892 bytes ( 5.763×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000121.go.zst
2019/07/11 10:05:34.019081 947328 → 5271725 bytes ( 5.565×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000123.go.zst
2019/07/11 10:05:34.046375 503850 → 4000020 bytes ( 7.939×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000118.go.zst
2019/07/11 10:05:34.067051 264587 → 4053813 bytes (15.321×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000120.go.zst
2019/07/11 10:05:34.088091 531199 → 4705989 bytes ( 8.859×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000129.go.zst
2019/07/11 10:05:34.091944 502142 → 4010187 bytes ( 7.986×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000119.go.zst
2019/07/11 10:05:34.121482 416870 → 4002183 bytes ( 9.601×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000124.go.zst
2019/07/11 10:05:34.126305 503153 → 4010237 bytes ( 7.970×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000130.go.zst
2019/07/11 10:05:34.137981 573336 → 4029106 bytes ( 7.027×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000128.go.zst
2019/07/11 10:05:34.203384 464844 → 4022011 bytes ( 8.652×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000127.go.zst
2019/07/11 10:05:34.209802 434146 → 4005918 bytes ( 9.227×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000125.go.zst
2019/07/11 10:05:34.226746 562023 → 4036194 bytes ( 7.182×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000126.go.zst
2019/07/11 10:05:34.253277 534846 → 4298152 bytes ( 8.036×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000136.go.zst
2019/07/11 10:05:34.283738 474416 → 4015827 bytes ( 8.465×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000135.go.zst
2019/07/11 10:05:34.297443 676273 → 4017143 bytes ( 5.940×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000137.go.zst
2019/07/11 10:05:34.350197 485533 → 4003784 bytes ( 8.246×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000134.go.zst
2019/07/11 10:05:34.367692 558522 → 4012951 bytes ( 7.185×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000133.go.zst
2019/07/11 10:05:34.379223 2771127 → 13048604 bytes ( 4.709×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000131.go.zst
2019/07/11 10:05:34.385873 2528170 → 10905639 bytes ( 4.314×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000132.go.zst
2019/07/11 10:05:34.420100 309923 → 4001685 bytes (12.912×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000143.go.zst
2019/07/11 10:05:34.440169 376289 → 4028740 bytes (10.707×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000142.go.zst
2019/07/11 10:05:34.447682 316988 → 4001667 bytes (12.624×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000144.go.zst
2019/07/11 10:05:34.496823 290607 → 4002723 bytes (13.774×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000141.go.zst
2019/07/11 10:05:34.522682 434315 → 4018276 bytes ( 9.252×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000150.go.zst
2019/07/11 10:05:34.529963 658292 → 4000448 bytes ( 6.077×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000140.go.zst
2019/07/11 10:05:34.543966 279896 → 4110833 bytes (14.687×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000151.go.zst
2019/07/11 10:05:34.572687 1086021 → 4494390 bytes ( 4.138×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000149.go.zst
2019/07/11 10:05:34.576312 611655 → 4095210 bytes ( 6.695×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000138.go.zst
2019/07/11 10:05:34.626874 317859 → 4172019 bytes (13.125×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000148.go.zst
2019/07/11 10:05:34.638622 376698 → 4003119 bytes (10.627×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000157.go.zst
2019/07/11 10:05:34.639242 533870 → 4003901 bytes ( 7.500×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000139.go.zst
2019/07/11 10:05:34.690782 274293 → 4083501 bytes (14.887×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000147.go.zst
2019/07/11 10:05:34.702534 744282 → 4006230 bytes ( 5.383×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000156.go.zst
2019/07/11 10:05:34.723371 291584 → 4168844 bytes (14.297×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000145.go.zst
2019/07/11 10:05:34.729076 422603 → 4006953 bytes ( 9.482×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000155.go.zst
2019/07/11 10:05:34.731728 711141 → 4008574 bytes ( 5.637×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000158.go.zst
2019/07/11 10:05:34.775064 603118 → 4136079 bytes ( 6.858×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000163.go.zst
2019/07/11 10:05:34.792702 340353 → 4424067 bytes (12.998×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000164.go.zst
2019/07/11 10:05:34.796162 618352 → 4002249 bytes ( 6.472×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000154.go.zst
2019/07/11 10:05:34.820524 289494 → 4036048 bytes (13.942×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000146.go.zst
2019/07/11 10:05:34.820605 309016 → 5260095 bytes (17.022×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000152.go.zst
2019/07/11 10:05:34.865440 131045 → 4280066 bytes (32.661×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000165.go.zst
2019/07/11 10:05:34.870480 406615 → 4000797 bytes ( 9.839×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000162.go.zst
2019/07/11 10:05:34.918977 252124 → 4012267 bytes (15.914×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000153.go.zst
2019/07/11 10:05:34.927295 456129 → 4042538 bytes ( 8.863×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000161.go.zst
2019/07/11 10:05:34.942748 717740 → 4319130 bytes ( 6.018×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000170.go.zst
2019/07/11 10:05:35.011325 731744 → 4013175 bytes ( 5.484×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000171.go.zst
2019/07/11 10:05:35.040012 565284 → 4163041 bytes ( 7.365×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000169.go.zst
2019/07/11 10:05:35.062413 289918 → 4000001 bytes (13.797×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000159.go.zst
2019/07/11 10:05:35.066697 703842 → 4000001 bytes ( 5.683×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000160.go.zst
2019/07/11 10:05:35.075955 190967 → 4197565 bytes (21.981×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000168.go.zst
2019/07/11 10:05:35.085458 290878 → 4010780 bytes (13.789×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000172.go.zst
2019/07/11 10:05:35.170622 97265 → 4243884 bytes (43.632×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000166.go.zst
2019/07/11 10:05:35.184665 171285 → 4069187 bytes (23.757×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000167.go.zst
2019/07/11 10:05:35.224262 534458 → 2880005 bytes ( 5.389×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000175.go.zst
2019/07/11 10:05:35.312594 619070 → 4002126 bytes ( 6.465×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000174.go.zst
2019/07/11 10:05:35.313823 518866 → 4350379 bytes ( 8.384×) decompress and scan /Users/mtj/corpora/go/corpusZ.tar::blob_000173.go.zst
2019/07/11 10:05:35.408361 scan ends
2019/07/11 10:05:35.408391 performance
2019/07/11 10:05:35.408400 grep 16 matches
2019/07/11 10:05:35.408408 work 752 311 514 bytes, 170 302 873 tokens, 22 927 078 lines, 176 files
2019/07/11 10:05:35.408417 time 3.975375 sec elapsed, 25.803189 sec user + 0.985283 system
2019/07/11 10:05:35.408424 rate 189 242 887 bytes/sec, 42 839 444 tokens/sec, 5 767 273 lines/sec, 44 files/sec
2019/07/11 10:05:35.408431 cpus 7 workers (parallel speedup = 6.74x)
celeste:gg mtj$
There is no doubt that Zstd is a brilliance, nor that Klaus' library is excellent.
Aliaksandr Valialkin
Jul 24, 2019, 4:13:25 PM7/24/19
to golang-nuts
Good news!
The decompression speed is also slightly lower for small blocks due to the allocation inside DecodeAll.
Reply all
Reply to author
Forward
0 new messages