Skip to content
Jingguo Yao edited this page Sep 23, 2016 · 3 revisions

changes-for-review vs perf-changes

Micro:

name                                     old time/op    new time/op    delta
NewTree-4                                   282ns ± 1%     460ns ± 5%  +63.05%         (p=0.000 n=8+10)
Insert-4                                   2.62µs ±11%    2.62µs ± 8%     ~            (p=0.858 n=9+10)
FastInsert-4                               2.51µs ± 1%    2.51µs ± 4%     ~             (p=0.737 n=7+9)
Delete-4                                   5.43µs ± 4%    5.21µs ± 4%   -4.05%          (p=0.008 n=9+9)
Get-4                                      8.30µs ± 8%    8.30µs ±10%     ~            (p=0.842 n=9+10)
RandomInsert-4                             2.63µs ± 8%    2.78µs ±12%     ~            (p=0.133 n=9+10)
RandomFastInsert-4                         2.64µs ±14%    2.73µs ±11%     ~            (p=0.278 n=9+10)
RandomDelete-4                             5.71µs ± 4%    5.66µs ± 8%     ~            (p=0.897 n=8+10)
RandomGet-4                                8.14µs ±14%    7.91µs ±16%     ~           (p=0.481 n=10+10)
InsertWithRangeGroupTestIntervals-4        2.08µs ± 8%    2.10µs ±10%     ~           (p=0.645 n=10+10)
FastInsertWithRangeGroupTestIntervals-4    2.05µs ±12%    2.06µs ± 8%     ~           (p=0.739 n=10+10)
DeleteWithRangeGroupTestIntervals-4        4.06µs ± 9%    4.25µs ± 7%     ~            (p=0.051 n=10+9)
GetWithRangeGroupTestIntervals-4           4.34µs ±10%    4.26µs ± 5%     ~            (p=0.315 n=10+9)
Insert4-4                                  1.37µs ± 8%    1.41µs ±10%     ~           (p=0.218 n=10+10)
FastInsert4-4                              1.37µs ± 8%    1.40µs ±10%     ~            (p=0.447 n=9+10)
Delete4-4                                  2.64µs ±12%    2.70µs ±11%     ~           (p=0.404 n=10+10)
Get4-4                                     2.74µs ±11%    2.70µs ±10%     ~           (p=0.796 n=10+10)
Insert8-4                                  2.63µs ±13%    2.55µs ± 3%     ~            (p=0.510 n=10+9)
FastInsert8-4                              2.53µs ±13%    2.49µs ± 5%     ~           (p=0.724 n=10+10)
Delete8-4                                  5.54µs ± 9%    5.37µs ±12%     ~           (p=0.218 n=10+10)
Get8-4                                     8.64µs ± 8%    8.33µs ± 4%   -3.49%         (p=0.035 n=9+10)
Insert100-4                                48.2µs ± 7%    47.7µs ± 3%     ~           (p=0.739 n=10+10)
FastInsert100-4                            44.4µs ± 4%    43.9µs ±10%     ~             (p=0.423 n=8+9)
Delete100-4                                 102µs ± 7%     103µs ± 3%     ~             (p=0.796 n=9+9)
Get100-4                                    293µs ± 9%     301µs ± 9%     ~           (p=0.529 n=10+10)
Insert1K-4                                  685µs ± 8%     705µs ± 6%     ~            (p=0.182 n=10+9)
FastInsert1K-4                              630µs ±13%     656µs ±12%     ~           (p=0.089 n=10+10)
Delete1K-4                                 1.50ms ± 8%    1.45ms ± 6%     ~           (p=0.280 n=10+10)
Get1K-4                                    4.12ms ±12%    3.90ms ± 8%     ~            (p=0.400 n=10+9)
Insert10K-4                                10.0ms ±10%    10.2ms ±16%     ~           (p=0.684 n=10+10)
FastInsert10K-4                            9.26ms ±14%    9.31ms ±11%     ~           (p=0.280 n=10+10)
Delete10K-4                                20.4ms ±11%    20.2ms ±10%     ~           (p=0.796 n=10+10)
Get10K-4                                   48.6ms ±17%    47.6ms ± 6%     ~            (p=0.905 n=10+9)
Insert100K-4                                113ms ± 9%     112ms ± 9%     ~           (p=0.853 n=10+10)
FastInsert100K-4                            109ms ± 6%     107ms ± 7%     ~           (p=0.218 n=10+10)
Delete100K-4                                250ms ± 7%     246ms ± 8%     ~           (p=0.529 n=10+10)
Get100K-4                                   518ms ± 4%     510ms ± 3%     ~            (p=0.211 n=9+10)
Insert1M-4                                  1.31s ± 8%     1.29s ± 8%     ~            (p=0.400 n=9+10)
FastInsert1M-4                              1.25s ± 7%     1.20s ± 3%   -3.49%        (p=0.015 n=10+10)
Delete1M-4                                  2.79s ± 4%     2.75s ± 3%     ~             (p=0.340 n=9+9)
Get1M-4                                     5.89s ± 7%     5.84s ± 4%     ~           (p=0.684 n=10+10)
RandomInsert4-4                            1.52µs ± 4%    1.53µs ± 8%     ~            (p=0.497 n=10+9)
RandomFastInsert4-4                        1.52µs ± 9%    1.55µs ± 5%     ~            (p=0.169 n=10+7)
RandomDelete4-4                            2.85µs ± 9%    2.86µs ±12%     ~           (p=0.853 n=10+10)
RandomGet4-4                               2.96µs ± 5%    2.77µs ±17%     ~            (p=0.070 n=8+10)
RandomInsert8-4                            2.84µs ±10%    2.87µs ± 9%     ~            (p=0.780 n=9+10)
RandomFastInsert8-4                        2.77µs ± 6%    2.85µs ±11%     ~            (p=0.356 n=9+10)
RandomDelete8-4                            5.71µs ± 5%    5.88µs ± 8%     ~            (p=0.304 n=8+10)
RandomGet8-4                               9.34µs ±30%    8.96µs ±17%     ~            (p=0.360 n=10+8)
RandomInsert100-4                          63.1µs ± 6%    65.7µs ±14%     ~            (p=0.278 n=9+10)
RandomFastInsert100-4                      62.3µs ± 7%    62.8µs ± 6%     ~           (p=0.796 n=10+10)
RandomDelete100-4                           123µs ± 8%     123µs ± 7%     ~           (p=0.912 n=10+10)
RandomGet100-4                             1.24ms ± 9%    1.21ms ±11%     ~            (p=0.549 n=9+10)
RandomInsert1K-4                           1.02ms ± 7%    1.03ms ± 5%     ~           (p=0.912 n=10+10)
RandomFastInsert1K-4                        970µs ± 8%     968µs ± 5%     ~           (p=0.853 n=10+10)
RandomDelete1K-4                           2.04ms ± 9%    2.05ms ± 5%     ~            (p=0.968 n=9+10)
RandomGet1K-4                               147ms ±19%     142ms ±14%     ~           (p=0.436 n=10+10)
RandomInsert10K-4                          17.6ms ±15%    17.9ms ± 6%     ~            (p=0.968 n=10+9)
RandomFastInsert10K-4                      16.4ms ±15%    16.7ms ±12%     ~           (p=0.853 n=10+10)
RandomDelete10K-4                          36.8ms ±16%    37.7ms ±10%     ~           (p=0.436 n=10+10)
RandomGet10K-4                              15.6s ±10%     15.0s ± 9%     ~           (p=0.105 n=10+10)
RandomInsert100K-4                          432ms ±21%     381ms ±24%     ~           (p=0.052 n=10+10)
RandomFastInsert100K-4                      401ms ± 8%     384ms ±20%     ~            (p=0.497 n=9+10)
RandomDelete100K-4                          864ms ± 9%     828ms ±16%     ~            (p=0.315 n=9+10)
RandomInsert1M-4                            9.16s ±13%     8.39s ±15%   -8.36%         (p=0.028 n=10+9)
RandomFastInsert1M-4                        8.60s ±14%     8.45s ±25%     ~           (p=0.481 n=10+10)
RandomDelete1M-4                            17.8s ± 3%     16.5s ±21%     ~            (p=0.101 n=8+10)

name                                     old alloc/op   new alloc/op   delta
NewTree-4                                  0.00B ±NaN%    0.00B ±NaN%     ~     (all samples are equal)
Insert-4                                     400B ± 0%      400B ± 0%     ~     (all samples are equal)
FastInsert-4                                 400B ± 0%      400B ± 0%     ~     (all samples are equal)
Delete-4                                     400B ± 0%      400B ± 0%     ~     (all samples are equal)
Get-4                                      1.92kB ± 0%    1.92kB ± 0%     ~     (all samples are equal)
RandomInsert-4                               400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomFastInsert-4                           400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomDelete-4                               400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomGet-4                                1.65kB ±16%    1.57kB ±37%     ~           (p=0.509 n=10+10)
InsertWithRangeGroupTestIntervals-4          400B ± 0%      400B ± 0%     ~     (all samples are equal)
FastInsertWithRangeGroupTestIntervals-4      400B ± 0%      400B ± 0%     ~     (all samples are equal)
DeleteWithRangeGroupTestIntervals-4          400B ± 0%      400B ± 0%     ~     (all samples are equal)
GetWithRangeGroupTestIntervals-4             704B ± 0%      704B ± 0%     ~     (all samples are equal)
Insert4-4                                    272B ± 0%      272B ± 0%     ~     (all samples are equal)
FastInsert4-4                                272B ± 0%      272B ± 0%     ~     (all samples are equal)
Delete4-4                                    272B ± 0%      272B ± 0%     ~     (all samples are equal)
Get4-4                                       448B ± 0%      448B ± 0%     ~     (all samples are equal)
Insert8-4                                    400B ± 0%      400B ± 0%     ~     (all samples are equal)
FastInsert8-4                                400B ± 0%      400B ± 0%     ~     (all samples are equal)
Delete8-4                                    400B ± 0%      400B ± 0%     ~     (all samples are equal)
Get8-4                                     1.92kB ± 0%    1.92kB ± 0%     ~     (all samples are equal)
Insert100-4                                5.70kB ± 0%    5.70kB ± 0%     ~     (all samples are equal)
FastInsert100-4                            5.70kB ± 0%    5.70kB ± 0%     ~     (all samples are equal)
Delete100-4                                5.70kB ± 0%    5.70kB ± 0%     ~     (all samples are equal)
Get100-4                                   94.7kB ± 0%    94.7kB ± 0%     ~     (all samples are equal)
Insert1K-4                                 53.2kB ± 0%    53.2kB ± 0%     ~     (all samples are equal)
FastInsert1K-4                             53.2kB ± 0%    53.2kB ± 0%     ~     (all samples are equal)
Delete1K-4                                 53.2kB ± 0%    53.2kB ± 0%     ~     (all samples are equal)
Get1K-4                                    1.00MB ± 0%    1.00MB ± 0%     ~     (all samples are equal)
Insert10K-4                                 538kB ± 0%     538kB ± 0%     ~     (all samples are equal)
FastInsert10K-4                             538kB ± 0%     538kB ± 0%     ~     (all samples are equal)
Delete10K-4                                 538kB ± 0%     538kB ± 0%     ~     (all samples are equal)
Get10K-4                                   10.1MB ± 0%    10.1MB ± 0%     ~     (all samples are equal)
Insert100K-4                               5.39MB ± 0%    5.39MB ± 0%     ~     (all samples are equal)
FastInsert100K-4                           5.39MB ± 0%    5.39MB ± 0%     ~     (all samples are equal)
Delete100K-4                               5.39MB ± 0%    5.39MB ± 0%     ~     (all samples are equal)
Get100K-4                                   101MB ± 0%     101MB ± 0%     ~     (all samples are equal)
Insert1M-4                                 53.9MB ± 0%    53.9MB ± 0%     ~     (all samples are equal)
FastInsert1M-4                             53.9MB ± 0%    53.9MB ± 0%     ~     (all samples are equal)
Delete1M-4                                 53.9MB ± 0%    53.9MB ± 0%     ~     (all samples are equal)
Get1M-4                                    1.01GB ± 0%    1.01GB ± 0%     ~     (all samples are equal)
RandomInsert4-4                              272B ± 0%      272B ± 0%     ~     (all samples are equal)
RandomFastInsert4-4                          272B ± 0%      272B ± 0%     ~     (all samples are equal)
RandomDelete4-4                              272B ± 0%      272B ± 0%     ~     (all samples are equal)
RandomGet4-4                                 440B ±13%      427B ±18%     ~             (p=0.906 n=8+9)
RandomInsert8-4                              400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomFastInsert8-4                          400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomDelete8-4                              400B ± 0%      400B ± 0%     ~     (all samples are equal)
RandomGet8-4                               1.66kB ±23%    1.67kB ±15%     ~            (p=0.886 n=10+9)
RandomInsert100-4                          3.98kB ± 0%    3.98kB ± 0%     ~     (all samples are equal)
RandomFastInsert100-4                      3.98kB ± 0%    3.98kB ± 0%     ~     (all samples are equal)
RandomDelete100-4                          3.98kB ± 0%    3.98kB ± 0%     ~     (all samples are equal)
RandomGet100-4                              318kB ±13%     309kB ± 9%     ~           (p=0.436 n=10+10)
RandomInsert1K-4                           38.6kB ±12%    39.5kB ± 7%     ~            (p=0.319 n=10+9)
RandomFastInsert1K-4                       39.6kB ± 7%    36.8kB ± 9%   -7.16%         (p=0.007 n=9+10)
RandomDelete1K-4                           39.2kB ± 6%    38.4kB ± 0%     ~             (p=0.247 n=8+7)
RandomGet1K-4                              28.6MB ± 1%    28.5MB ± 2%     ~           (p=0.529 n=10+10)
RandomInsert10K-4                           376kB ± 2%     379kB ± 4%     ~           (p=0.271 n=10+10)
RandomFastInsert10K-4                       377kB ± 3%     380kB ± 2%     ~           (p=0.271 n=10+10)
RandomDelete10K-4                           389kB ± 3%     385kB ± 3%     ~            (p=0.343 n=10+9)
RandomGet10K-4                             4.65GB ± 1%    4.66GB ± 1%     ~           (p=0.481 n=10+10)
RandomInsert100K-4                         3.80MB ± 1%    3.80MB ± 1%     ~           (p=0.971 n=10+10)
RandomFastInsert100K-4                     3.80MB ± 1%    3.81MB ± 1%     ~            (p=0.604 n=9+10)
RandomDelete100K-4                         3.86MB ± 1%    3.83MB ± 1%   -0.61%         (p=0.043 n=9+10)
RandomInsert1M-4                           37.9MB ± 0%    37.9MB ± 0%     ~           (p=0.684 n=10+10)
RandomFastInsert1M-4                       37.9MB ± 0%    37.9MB ± 0%     ~           (p=0.739 n=10+10)
RandomDelete1M-4                           38.3MB ± 0%    38.3MB ± 0%     ~            (p=0.604 n=10+9)

name                                     old allocs/op  new allocs/op  delta
NewTree-4                                   0.00 ±NaN%     0.00 ±NaN%     ~     (all samples are equal)
Insert-4                                     6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
FastInsert-4                                 6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
Delete-4                                     6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
Get-4                                        32.0 ± 0%      32.0 ± 0%     ~     (all samples are equal)
RandomInsert-4                               6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomFastInsert-4                           6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomDelete-4                               6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomGet-4                                  29.6 ± 9%      28.7 ±20%     ~           (p=0.534 n=10+10)
InsertWithRangeGroupTestIntervals-4          6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
FastInsertWithRangeGroupTestIntervals-4      6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
DeleteWithRangeGroupTestIntervals-4          6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
GetWithRangeGroupTestIntervals-4             17.0 ± 0%      17.0 ± 0%     ~     (all samples are equal)
Insert4-4                                    5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
FastInsert4-4                                5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
Delete4-4                                    5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
Get4-4                                       12.0 ± 0%      12.0 ± 0%     ~     (all samples are equal)
Insert8-4                                    6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
FastInsert8-4                                6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
Delete8-4                                    6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
Get8-4                                       32.0 ± 0%      32.0 ± 0%     ~     (all samples are equal)
Insert100-4                                  20.0 ± 0%      20.0 ± 0%     ~     (all samples are equal)
FastInsert100-4                              20.0 ± 0%      20.0 ± 0%     ~     (all samples are equal)
Delete100-4                                  20.0 ± 0%      20.0 ± 0%     ~     (all samples are equal)
Get100-4                                      588 ± 0%       588 ± 0%     ~     (all samples are equal)
Insert1K-4                                    111 ± 0%       111 ± 0%     ~     (all samples are equal)
FastInsert1K-4                                111 ± 0%       111 ± 0%     ~     (all samples are equal)
Delete1K-4                                    111 ± 0%       111 ± 0%     ~     (all samples are equal)
Get1K-4                                     5.99k ± 0%     5.99k ± 0%     ~     (all samples are equal)
Insert10K-4                                 1.00k ± 0%     1.00k ± 0%     ~     (all samples are equal)
FastInsert10K-4                             1.00k ± 0%     1.00k ± 0%     ~     (all samples are equal)
Delete10K-4                                 1.00k ± 0%     1.00k ± 0%     ~     (all samples are equal)
Get10K-4                                    60.0k ± 0%     60.0k ± 0%     ~     (all samples are equal)
Insert100K-4                                9.90k ± 0%     9.90k ± 0%     ~     (all samples are equal)
FastInsert100K-4                            9.90k ± 0%     9.90k ± 0%     ~     (all samples are equal)
Delete100K-4                                9.90k ± 0%     9.90k ± 0%     ~     (all samples are equal)
Get100K-4                                    600k ± 0%      600k ± 0%     ~     (all samples are equal)
Insert1M-4                                  98.8k ± 0%     98.8k ± 0%     ~     (all samples are equal)
FastInsert1M-4                              98.8k ± 0%     98.8k ± 0%     ~     (all samples are equal)
Delete1M-4                                  98.8k ± 0%     98.8k ± 0%     ~     (all samples are equal)
Get1M-4                                     6.00M ± 0%     6.00M ± 0%     ~     (all samples are equal)
RandomInsert4-4                              5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
RandomFastInsert4-4                          5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
RandomDelete4-4                              5.00 ± 0%      5.00 ± 0%     ~     (all samples are equal)
RandomGet4-4                                 11.9 ± 7%      11.2 ±29%     ~            (p=0.412 n=8+10)
RandomInsert8-4                              6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomFastInsert8-4                          6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomDelete8-4                              6.00 ± 0%      6.00 ± 0%     ~     (all samples are equal)
RandomGet8-4                                 29.7 ±12%      29.2 ±14%     ~           (p=0.519 n=10+10)
RandomInsert100-4                            15.0 ± 0%      15.0 ± 0%     ~     (all samples are equal)
RandomFastInsert100-4                        15.0 ± 0%      15.0 ± 0%     ~     (all samples are equal)
RandomDelete100-4                            15.0 ± 0%      15.0 ± 0%     ~     (all samples are equal)
RandomGet100-4                                750 ± 3%       747 ± 2%     ~           (p=0.425 n=10+10)
RandomInsert1K-4                             84.9 ±10%      86.1 ± 6%     ~            (p=0.362 n=10+9)
RandomFastInsert1K-4                         86.2 ± 6%      81.4 ± 8%   -5.59%         (p=0.008 n=9+10)
RandomDelete1K-4                             85.5 ± 5%      84.0 ± 0%     ~             (p=0.247 n=8+7)
RandomGet1K-4                               10.7k ± 0%     10.7k ± 0%     ~            (p=0.764 n=10+9)
RandomInsert10K-4                             708 ± 2%       715 ± 4%     ~           (p=0.240 n=10+10)
RandomFastInsert10K-4                         710 ± 3%       714 ± 2%     ~           (p=0.271 n=10+10)
RandomDelete10K-4                             729 ± 3%       721 ± 3%     ~            (p=0.343 n=10+9)
RandomGet10K-4                               177k ± 0%      177k ± 0%     ~           (p=0.593 n=10+10)
RandomInsert100K-4                          7.00k ± 1%     7.01k ± 1%     ~           (p=0.617 n=10+10)
RandomFastInsert100K-4                      7.02k ± 1%     7.02k ± 1%     ~           (p=0.684 n=10+10)
RandomDelete100K-4                          7.08k ± 1%     7.04k ± 1%     ~            (p=0.062 n=9+10)
RandomInsert1M-4                            69.7k ± 0%     69.7k ± 0%     ~           (p=0.811 n=10+10)
RandomFastInsert1M-4                        69.6k ± 0%     69.7k ± 0%     ~           (p=0.631 n=10+10)
RandomDelete1M-4                            70.0k ± 0%     70.1k ± 0%     ~            (p=0.618 n=10+9)

00_C:

name                               old time/op    new time/op    delta
Insert100_Cockroach-4                2.54ms ±16%    2.39ms ± 7%    ~            (p=0.095 n=10+9)
Insert1000_Cockroach-4               17.0ms ±23%    16.2ms ± 7%    ~            (p=0.156 n=9+10)
Update100_Cockroach-4                6.80ms ±18%    6.77ms ±15%    ~           (p=0.853 n=10+10)
Update1000_Cockroach-4               47.9ms ± 8%    48.6ms ± 5%    ~           (p=0.529 n=10+10)
Upsert100_Cockroach-4                9.00ms ±12%    8.60ms ± 6%    ~            (p=0.182 n=10+9)
Upsert1000_Cockroach-4               58.1ms ± 8%    59.3ms ±13%    ~           (p=0.631 n=10+10)
Delete100_Cockroach-4                3.26ms ±12%    3.00ms ± 5%  -7.93%        (p=0.005 n=10+10)
Delete1000_Cockroach-4               22.5ms ±10%    22.0ms ± 9%    ~            (p=0.447 n=9+10)
Scan100_Cockroach-4                   646µs ±10%     641µs ±10%    ~           (p=0.684 n=10+10)
Scan1000_Cockroach-4                 3.47ms ± 6%    3.41ms ± 8%    ~            (p=0.460 n=8+10)
Scan10000_Cockroach-4                32.3ms ±16%    31.3ms ±10%    ~           (p=0.436 n=10+10)
Scan1000Limit100_Cockroach-4          656µs ±12%     652µs ± 3%    ~            (p=0.842 n=10+9)
InterleavedSelect1000_Cockroach-4     110ms ± 6%     110ms ± 6%    ~            (p=0.842 n=9+10)
TrackChoices100_Cockroach-4          91.1µs ±18%    88.0µs ±10%    ~           (p=0.353 n=10+10)
TrackChoices1000_Cockroach-4         75.2µs ± 4%    74.7µs ± 7%    ~           (p=0.436 n=10+10)
InsertDistinct100_Cockroach-4        2.74ms ±29%    2.43ms ±15%    ~           (p=0.075 n=10+10)
WideTable100_Cockroach-4             21.3ms ± 9%    20.5ms ± 5%  -3.72%        (p=0.029 n=10+10)
WideTable1000_Cockroach-4             171ms ±10%     160ms ± 4%  -6.37%         (p=0.008 n=9+10)

name                               old alloc/op   new alloc/op   delta
Insert100_Cockroach-4                 529kB ± 0%     529kB ± 0%    ~            (p=0.079 n=9+10)
Insert1000_Cockroach-4               4.59MB ± 0%    4.59MB ± 0%    ~            (p=0.237 n=8+10)
Update100_Cockroach-4                 848kB ± 0%     848kB ± 0%    ~             (p=0.524 n=8+9)
Update1000_Cockroach-4               7.01MB ± 0%    7.01MB ± 0%    ~             (p=0.505 n=8+8)
Upsert100_Cockroach-4                 930kB ± 0%     930kB ± 0%    ~            (p=0.447 n=9+10)
Upsert1000_Cockroach-4               7.78MB ± 1%    7.77MB ± 1%    ~           (p=0.280 n=10+10)
Delete100_Cockroach-4                 165kB ± 2%     165kB ± 2%    ~           (p=0.912 n=10+10)
Delete1000_Cockroach-4               1.15MB ± 4%    1.15MB ± 4%    ~           (p=0.315 n=10+10)
Scan100_Cockroach-4                  54.1kB ± 0%    54.1kB ± 0%    ~            (p=0.191 n=10+8)
Scan1000_Cockroach-4                  322kB ± 0%     322kB ± 0%    ~            (p=0.878 n=10+8)
Scan10000_Cockroach-4                5.53MB ± 0%    5.53MB ± 0%    ~            (p=0.173 n=10+8)
Scan1000Limit100_Cockroach-4         54.6kB ± 0%    54.6kB ± 0%    ~           (p=0.266 n=10+10)
InterleavedSelect1000_Cockroach-4     795kB ± 0%     795kB ± 0%    ~            (p=0.968 n=10+9)
TrackChoices100_Cockroach-4          19.2kB ± 0%    19.2kB ± 0%  -0.02%         (p=0.019 n=10+9)
TrackChoices1000_Cockroach-4         20.6kB ± 0%    20.6kB ± 0%  +0.05%        (p=0.045 n=10+10)
InsertDistinct100_Cockroach-4         432kB ± 1%     433kB ± 1%    ~            (p=0.549 n=9+10)
WideTable100_Cockroach-4             2.60MB ± 0%    2.61MB ± 0%    ~            (p=0.497 n=10+9)
WideTable1000_Cockroach-4            23.5MB ± 0%    23.5MB ± 0%    ~           (p=0.796 n=10+10)

name                               old allocs/op  new allocs/op  delta
Insert100_Cockroach-4                 2.49k ± 0%     2.49k ± 0%    ~           (p=0.423 n=10+10)
Insert1000_Cockroach-4                21.5k ± 0%     21.5k ± 0%    ~            (p=0.193 n=7+10)
Update100_Cockroach-4                 3.71k ± 0%     3.71k ± 0%    ~             (p=0.165 n=8+9)
Update1000_Cockroach-4                29.4k ± 0%     29.4k ± 0%    ~             (p=0.604 n=8+8)
Upsert100_Cockroach-4                 5.76k ± 0%     5.76k ± 0%    ~            (p=0.440 n=8+10)
Upsert1000_Cockroach-4                44.5k ± 0%     44.4k ± 0%    ~           (p=0.393 n=10+10)
Delete100_Cockroach-4                 1.74k ± 0%     1.74k ± 0%    ~           (p=0.985 n=10+10)
Delete1000_Cockroach-4                12.6k ± 0%     12.6k ± 0%    ~            (p=0.727 n=10+9)
Scan100_Cockroach-4                     471 ± 0%       471 ± 0%    ~            (p=0.137 n=10+8)
Scan1000_Cockroach-4                  2.37k ± 0%     2.37k ± 0%    ~     (all samples are equal)
Scan10000_Cockroach-4                 21.2k ± 0%     21.2k ± 0%    ~     (all samples are equal)
Scan1000Limit100_Cockroach-4            480 ± 0%       480 ± 0%    ~     (all samples are equal)
InterleavedSelect1000_Cockroach-4     3.08k ± 0%     3.08k ± 0%    ~           (p=0.169 n=10+10)
TrackChoices100_Cockroach-4            83.0 ± 0%      83.0 ± 0%    ~     (all samples are equal)
TrackChoices1000_Cockroach-4           79.0 ± 0%      79.0 ± 0%    ~     (all samples are equal)
InsertDistinct100_Cockroach-4         3.60k ± 1%     3.61k ± 1%    ~             (p=0.397 n=9+9)
WideTable100_Cockroach-4              24.3k ± 0%     24.2k ± 0%    ~           (p=0.362 n=10+10)
WideTable1000_Cockroach-4              226k ± 0%      226k ± 0%    ~           (p=0.315 n=10+10)

Clone this wiki locally