Skip to content

Commit

Permalink
Update benchmarks for release
Browse files Browse the repository at this point in the history
  • Loading branch information
jimhester committed May 14, 2019
1 parent 2fd73a3 commit 3c67424
Show file tree
Hide file tree
Showing 8 changed files with 365 additions and 365 deletions.
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ status](https://www.r-pkg.org/badges/version/vroom)](https://cran.r-project.org/
maturing](https://img.shields.io/badge/lifecycle-maturing-blue.svg)](https://www.tidyverse.org/lifecycle/#maturing)
<!-- badges: end -->

The fastest delimited reader for R, **905.64 MB/sec/sec**.
The fastest delimited reader for R, **936.19 MB/sec/sec**.

But that’s impossible\! How can it be [so
fast](http://vroom.r-lib.org/articles/benchmarks.html)?
Expand All @@ -33,12 +33,12 @@ your R data-manipulation code are needed.
vroom also uses multiple threads for indexing, materializing
non-character columns, and when writing to further improve performance.

| package | version | time (sec) | speedup | throughput |
| :--------- | ---------: | ---------: | ------: | ------------: |
| vroom | 0.0.0.9000 | 1.84 | 44.28 | 905.64 MB/sec |
| data.table | 1.12.2 | 15.72 | 5.18 | 106.04 MB/sec |
| readr | 1.3.1 | 33.09 | 2.46 | 50.37 MB/sec |
| read.delim | 3.5.3 | 81.49 | 1.00 | 20.45 MB/sec |
| package | version | time (sec) | speedup | throughput |
| :--------- | ------: | ---------: | ------: | ------------: |
| vroom | 1.0.1 | 1.78 | 46.98 | 936.19 MB/sec |
| data.table | 1.12.2 | 15.81 | 5.29 | 105.40 MB/sec |
| readr | 1.3.1 | 33.86 | 2.47 | 49.23 MB/sec |
| read.delim | 3.5.3 | 83.64 | 1.00 | 19.93 MB/sec |

## Features

Expand Down
2 changes: 1 addition & 1 deletion inst/bench/all_character-benchmark.R
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ library(vroom)

# We want ~ 1000 rows to filter
num_levels <- 5
levels <- c("helpless_sheep", vroom:::random_name(num_levels - 1))
levels <- c("helpless_sheep", gen_name(num_levels - 1))

filt_p <- 1000 / rows

Expand Down
220 changes: 110 additions & 110 deletions inst/bench/all_character-times.tsv
Original file line number Diff line number Diff line change
@@ -1,113 +1,113 @@
package op type time size rows cols
vroom (full altrep)_base setup process 0.16081500000000004 400247578 1000000 25
vroom (full altrep)_base read process 2.274925 400247578 1000000 25
vroom (full altrep)_base print process 0.14704300000000003 400247578 1000000 25
vroom (full altrep)_base head process 2.5399999999997647e-4 400247578 1000000 25
vroom (full altrep)_base tail process 2.8200000000033754e-4 400247578 1000000 25
vroom (full altrep)_base sample process 0.002201999999999593 400247578 1000000 25
vroom (full altrep)_base filter process 0.15817499999999995 400247578 1000000 25
vroom (full altrep)_base aggregate process 1.914492 400247578 1000000 25
vroom (full altrep)_dplyr setup process 0.39251300000000006 400247578 1000000 25
vroom (full altrep)_dplyr read process 1.991326 400247578 1000000 25
vroom (full altrep)_dplyr print process 0.08802599999999972 400247578 1000000 25
vroom (full altrep)_dplyr head process 2.2099999999980469e-4 400247578 1000000 25
vroom (full altrep)_dplyr tail process 2.2799999999989495e-4 400247578 1000000 25
vroom (full altrep)_dplyr sample process 0.0035680000000000156 400247578 1000000 25
vroom (full altrep)_dplyr filter process 0.1369720000000001 400247578 1000000 25
vroom (full altrep)_dplyr aggregate process 1.023761 400247578 1000000 25
vroom_base setup process 0.157061 400247578 1000000 25
vroom_base read process 2.236058 400247578 1000000 25
vroom_base print process 0.13609800000000005 400247578 1000000 25
vroom (full altrep)_base setup process 0.167551 400247578 1000000 25
vroom (full altrep)_base read process 2.471107 400247578 1000000 25
vroom (full altrep)_base print process 0.1382460000000001 400247578 1000000 25
vroom (full altrep)_base head process 2.68000000000157e-4 400247578 1000000 25
vroom (full altrep)_base tail process 2.7599999999994296e-4 400247578 1000000 25
vroom (full altrep)_base sample process 0.00207899999999972 400247578 1000000 25
vroom (full altrep)_base filter process 0.1891980000000002 400247578 1000000 25
vroom (full altrep)_base aggregate process 1.9969069999999998 400247578 1000000 25
vroom (full altrep)_dplyr setup process 0.42736500000000005 400247578 1000000 25
vroom (full altrep)_dplyr read process 2.240727 400247578 1000000 25
vroom (full altrep)_dplyr print process 0.1040709999999998 400247578 1000000 25
vroom (full altrep)_dplyr head process 2.310000000003143e-4 400247578 1000000 25
vroom (full altrep)_dplyr tail process 2.3299999999970566e-4 400247578 1000000 25
vroom (full altrep)_dplyr sample process 0.003674000000000177 400247578 1000000 25
vroom (full altrep)_dplyr filter process 0.17770300000000017 400247578 1000000 25
vroom (full altrep)_dplyr aggregate process 1.2611019999999997 400247578 1000000 25
vroom_base setup process 0.167379 400247578 1000000 25
vroom_base read process 2.270127 400247578 1000000 25
vroom_base print process 0.13063400000000014 400247578 1000000 25
vroom_base head process 2.5999999999992696e-4 400247578 1000000 25
vroom_base tail process 2.469999999998862e-4 400247578 1000000 25
vroom_base sample process 0.0023240000000002148 400247578 1000000 25
vroom_base filter process 0.1676549999999999 400247578 1000000 25
vroom_base aggregate process 1.9296350000000002 400247578 1000000 25
vroom_dplyr setup process 0.34174899999999997 400247578 1000000 25
vroom_dplyr read process 2.168679 400247578 1000000 25
vroom_dplyr print process 0.1655000000000002 400247578 1000000 25
vroom_dplyr head process 2.789999999999182e-4 400247578 1000000 25
vroom_dplyr tail process 2.830000000000332e-4 400247578 1000000 25
vroom_dplyr sample process 0.003877999999999826 400247578 1000000 25
vroom_dplyr filter process 0.1785890000000001 400247578 1000000 25
vroom_dplyr aggregate process 1.1534760000000004 400247578 1000000 25
data.table setup process 0.05436000000000002 400247578 1000000 25
data.table read process 152.07533700000002 400247578 1000000 25
data.table print process 0.06427199999998834 400247578 1000000 25
data.table head process 0.0010900000000049204 400247578 1000000 25
data.table tail process 0.0013580000000104064 400247578 1000000 25
data.table sample process 0.005057999999991125 400247578 1000000 25
data.table filter process 0.06153800000001297 400247578 1000000 25
data.table aggregate process 0.8458790000000249 400247578 1000000 25
readr setup process 0.399425 400247578 1000000 25
readr read process 58.573277 400247578 1000000 25
readr print process 0.10792299999999955 400247578 1000000 25
readr head process 2.309999999994261e-4 400247578 1000000 25
readr tail process 2.3599999999390775e-4 400247578 1000000 25
readr sample process 0.003267000000001019 400247578 1000000 25
readr filter process 0.013816000000005602 400247578 1000000 25
readr aggregate process 0.3586479999999952 400247578 1000000 25
vroom_base tail process 2.5900000000023127e-4 400247578 1000000 25
vroom_base sample process 0.0021279999999999077 400247578 1000000 25
vroom_base filter process 0.14124900000000018 400247578 1000000 25
vroom_base aggregate process 2.0065910000000002 400247578 1000000 25
vroom_dplyr setup process 0.34423800000000004 400247578 1000000 25
vroom_dplyr read process 2.261866 400247578 1000000 25
vroom_dplyr print process 0.16124599999999978 400247578 1000000 25
vroom_dplyr head process 2.830000000000332e-4 400247578 1000000 25
vroom_dplyr tail process 3.44000000000122e-4 400247578 1000000 25
vroom_dplyr sample process 0.004240999999999939 400247578 1000000 25
vroom_dplyr filter process 0.17257100000000003 400247578 1000000 25
vroom_dplyr aggregate process 1.2831320000000002 400247578 1000000 25
data.table setup process 0.059195 400247578 1000000 25
data.table read process 171.273383 400247578 1000000 25
data.table print process 0.08404400000000578 400247578 1000000 25
data.table head process 0.0075310000000001764 400247578 1000000 25
data.table tail process 2.2599999999783904e-4 400247578 1000000 25
data.table sample process 0.03424499999999853 400247578 1000000 25
data.table filter process 0.09884700000000635 400247578 1000000 25
data.table aggregate process 0.8874380000000031 400247578 1000000 25
readr setup process 0.403877 400247578 1000000 25
readr read process 61.069503 400247578 1000000 25
readr print process 0.10698999999999614 400247578 1000000 25
readr head process 2.3799999999596366e-4 400247578 1000000 25
readr tail process 2.520000000032496e-4 400247578 1000000 25
readr sample process 0.003860000000003083 400247578 1000000 25
readr filter process 0.016100000000001558 400247578 1000000 25
readr aggregate process 0.36483100000000235 400247578 1000000 25
read.delim setup process 2.9999999999752447e-6 400247578 1000000 25
read.delim read process 98.527034 400247578 1000000 25
read.delim print process 0.008607999999995286 400247578 1000000 25
read.delim head process 2.3799999999596366e-4 400247578 1000000 25
read.delim tail process 2.8399999999351166e-4 400247578 1000000 25
read.delim sample process 0.0021509999999977936 400247578 1000000 25
read.delim filter process 0.02059500000000014 400247578 1000000 25
read.delim aggregate process 0.32988799999999685 400247578 1000000 25
vroom (full altrep)_base setup real 0.16083637811243534 400247578 1000000 25
vroom (full altrep)_base read real 0.5153441671282053 400247578 1000000 25
vroom (full altrep)_base print real 0.14707490615546703 400247578 1000000 25
vroom (full altrep)_base head real 2.5537097826600075e-4 400247578 1000000 25
vroom (full altrep)_base tail real 2.830270677804947e-4 400247578 1000000 25
vroom (full altrep)_base sample real 0.0022044749930500984 400247578 1000000 25
vroom (full altrep)_base filter real 0.15817818557843566 400247578 1000000 25
vroom (full altrep)_base aggregate real 1.915058271959424 400247578 1000000 25
vroom (full altrep)_dplyr setup real 0.39269142691046 400247578 1000000 25
vroom (full altrep)_dplyr read real 0.38097502011805773 400247578 1000000 25
vroom (full altrep)_dplyr print real 0.08806022023782134 400247578 1000000 25
vroom (full altrep)_dplyr head real 2.2344710305333138e-4 400247578 1000000 25
vroom (full altrep)_dplyr tail real 2.294541336596012e-4 400247578 1000000 25
vroom (full altrep)_dplyr sample real 0.003570348024368286 400247578 1000000 25
vroom (full altrep)_dplyr filter real 0.13698671758174896 400247578 1000000 25
vroom (full altrep)_dplyr aggregate real 1.024204721674323 400247578 1000000 25
vroom_base setup real 0.1571418633684516 400247578 1000000 25
vroom_base read real 0.4929252350702882 400247578 1000000 25
vroom_base print real 0.13614099891856313 400247578 1000000 25
vroom_base head real 2.616727724671364e-4 400247578 1000000 25
vroom_base tail real 2.5625014677643776e-4 400247578 1000000 25
vroom_base sample real 0.0023253331892192364 400247578 1000000 25
vroom_base filter real 0.1677540992386639 400247578 1000000 25
vroom_base aggregate real 1.9325566138140857 400247578 1000000 25
vroom_dplyr setup real 0.3418180840089917 400247578 1000000 25
vroom_dplyr read real 0.3906397498212755 400247578 1000000 25
vroom_dplyr print real 0.1656824080273509 400247578 1000000 25
vroom_dplyr head real 2.8124311938881874e-4 400247578 1000000 25
vroom_dplyr tail real 2.8490787371993065e-4 400247578 1000000 25
vroom_dplyr sample real 0.0039002550765872 400247578 1000000 25
vroom_dplyr filter real 0.17911646142601967 400247578 1000000 25
vroom_dplyr aggregate real 1.1539318971335888 400247578 1000000 25
data.table setup real 0.05436584912240505 400247578 1000000 25
data.table read real 38.50023495592177 400247578 1000000 25
data.table print real 0.016149474307894707 400247578 1000000 25
data.table head real 2.7443282306194305e-4 400247578 1000000 25
data.table tail real 3.418843261897564e-4 400247578 1000000 25
data.table sample real 0.0012947418726980686 400247578 1000000 25
data.table filter real 0.01572801312431693 400247578 1000000 25
data.table aggregate real 0.2257047868333757 400247578 1000000 25
readr setup real 0.4146842430345714 400247578 1000000 25
readr read real 58.62665019510314 400247578 1000000 25
readr print real 0.11058456869795918 400247578 1000000 25
readr head real 2.3294799029827118e-4 400247578 1000000 25
readr tail real 2.373233437538147e-4 400247578 1000000 25
readr sample real 0.0032696821726858616 400247578 1000000 25
readr filter real 0.013818309176713228 400247578 1000000 25
readr aggregate real 0.3588341837748885 400247578 1000000 25
read.delim setup real 4.365108907222748e-6 400247578 1000000 25
read.delim read real 98.64760148338974 400247578 1000000 25
read.delim print real 0.008608981035649776 400247578 1000000 25
read.delim head real 2.399706281721592e-4 400247578 1000000 25
read.delim tail real 2.862601540982723e-4 400247578 1000000 25
read.delim sample real 0.0021525691263377666 400247578 1000000 25
read.delim filter real 0.02059707697480917 400247578 1000000 25
read.delim aggregate real 0.3299999958835542 400247578 1000000 25
read.delim read process 101.713284 400247578 1000000 25
read.delim print process 0.008717999999987569 400247578 1000000 25
read.delim head process 2.5000000000829914e-4 400247578 1000000 25
read.delim tail process 2.950000000083719e-4 400247578 1000000 25
read.delim sample process 0.002209000000007677 400247578 1000000 25
read.delim filter process 0.02293799999999635 400247578 1000000 25
read.delim aggregate process 0.3366759999999971 400247578 1000000 25
vroom (full altrep)_base setup real 0.1707540500210598 400247578 1000000 25
vroom (full altrep)_base read real 0.5201758000184782 400247578 1000000 25
vroom (full altrep)_base print real 0.14553612802410498 400247578 1000000 25
vroom (full altrep)_base head real 2.70078016910702e-4 400247578 1000000 25
vroom (full altrep)_base tail real 2.7793797198683023e-4 400247578 1000000 25
vroom (full altrep)_base sample real 0.002082059974782169 400247578 1000000 25
vroom (full altrep)_base filter real 0.18949685600819066 400247578 1000000 25
vroom (full altrep)_base aggregate real 2.002723714977037 400247578 1000000 25
vroom (full altrep)_dplyr setup real 0.4331158720306121 400247578 1000000 25
vroom (full altrep)_dplyr read real 0.42821802297839895 400247578 1000000 25
vroom (full altrep)_dplyr print real 0.10464047401910648 400247578 1000000 25
vroom (full altrep)_dplyr head real 2.3197202244773507e-4 400247578 1000000 25
vroom (full altrep)_dplyr tail real 2.341370563954115e-4 400247578 1000000 25
vroom (full altrep)_dplyr sample real 0.0036828650045208633 400247578 1000000 25
vroom (full altrep)_dplyr filter real 0.1783616949687712 400247578 1000000 25
vroom (full altrep)_dplyr aggregate real 1.2702605620143004 400247578 1000000 25
vroom_base setup real 0.17089088301872835 400247578 1000000 25
vroom_base read real 0.5051923270220868 400247578 1000000 25
vroom_base print real 0.13063605298520997 400247578 1000000 25
vroom_base head real 2.6166398311033845e-4 400247578 1000000 25
vroom_base tail real 2.5965896202251315e-4 400247578 1000000 25
vroom_base sample real 0.002128543972503394 400247578 1000000 25
vroom_base filter real 0.14126127999043092 400247578 1000000 25
vroom_base aggregate real 2.0149478599778377 400247578 1000000 25
vroom_dplyr setup real 0.3447275949874893 400247578 1000000 25
vroom_dplyr read real 0.38647323002805933 400247578 1000000 25
vroom_dplyr print real 0.1615047290106304 400247578 1000000 25
vroom_dplyr head real 2.85135000012815e-4 400247578 1000000 25
vroom_dplyr tail real 3.445580368861556e-4 400247578 1000000 25
vroom_dplyr sample real 0.004243083007168025 400247578 1000000 25
vroom_dplyr filter real 0.1729669490014203 400247578 1000000 25
vroom_dplyr aggregate real 1.2871519309701398 400247578 1000000 25
data.table setup real 0.06339874397963285 400247578 1000000 25
data.table read real 44.26208626298467 400247578 1000000 25
data.table print real 0.022118255030363798 400247578 1000000 25
data.table head real 3.068770165555179e-4 400247578 1000000 25
data.table tail real 2.2702099522575736e-4 400247578 1000000 25
data.table sample real 0.009005239000543952 400247578 1000000 25
data.table filter real 0.02614653797354549 400247578 1000000 25
data.table aggregate real 0.2671384080313146 400247578 1000000 25
readr setup real 0.42917800100985914 400247578 1000000 25
readr read real 61.226204378996044 400247578 1000000 25
readr print real 0.11195083800703287 400247578 1000000 25
readr head real 2.3997697280719876e-4 400247578 1000000 25
readr tail real 2.52435973379761e-4 400247578 1000000 25
readr sample real 0.004168547980953008 400247578 1000000 25
readr filter real 0.016141924017574638 400247578 1000000 25
readr aggregate real 0.36815867095720023 400247578 1000000 25
read.delim setup real 4.409987013787031e-6 400247578 1000000 25
read.delim read real 101.9158352559898 400247578 1000000 25
read.delim print real 0.008741562021896243 400247578 1000000 25
read.delim head real 2.5100301718339324e-4 400247578 1000000 25
read.delim tail real 2.9526400612667203e-4 400247578 1000000 25
read.delim sample real 0.00220974296098575 400247578 1000000 25
read.delim filter real 0.022984564013313502 400247578 1000000 25
read.delim aggregate real 0.33764188701752573 400247578 1000000 25
Loading

0 comments on commit 3c67424

Please sign in to comment.