summarisebig: Grouped Summaries for Large 'arrow' Datasets
Provides a 'dplyr'-like interface for grouped summaries on large
'arrow' datasets. Complete summaries are attempted in 'arrow' first. When a
result can be reconstructed from 'arrow'-computable sufficient statistics,
an explicit MapReduce-style reduction and 'R' finalization strategy is
available. For arbitrary 'R' functions that require raw group observations,
complete groups are materialized in bounded chunks, with optional parallel
execution and shared-memory processing. The MapReduce strategy follows the
programming model described by Dean and Ghemawat (2008)
<doi:10.1145/1327452.1327492>.
| Version: |
0.1.0 |
| Depends: |
R (≥ 4.3.0) |
| Imports: |
arrow, dplyr, future, future.mirai, futurize, furrr (≥
0.4.0), purrr, rlang |
| Suggests: |
knitr, mori, rmarkdown, testthat (≥ 3.0.0), withr |
| Published: |
2026-09-21 |
| DOI: |
10.32614/CRAN.package.summarisebig (may not be active yet) |
| Author: |
Lorenzo Isella [aut, cre] |
| Maintainer: |
Lorenzo Isella <lorenzo.isella at gmail.com> |
| BugReports: |
https://github.com/larry77/summarisebig/issues |
| License: |
MIT + file LICENSE |
| URL: |
https://github.com/larry77/summarisebig,
https://larry77.github.io/summarisebig/ |
| NeedsCompilation: |
no |
| Materials: |
README, NEWS |
| CRAN checks: |
summarisebig results |
Documentation:
Downloads:
Linking:
Please use the canonical form
https://CRAN.R-project.org/package=summarisebig
to link to this page.