[#]rstats
Spent some time working with {duckplyr} and {arrow} to save population time series data as parquet files.
Wrote a generalised importing function so I can filter out what I need.
So if I only need 48K rows out of 390K, I only now load the rows I need, and the rest can stay untouched.
I'm pretty much sold on this file format already.
=> More informations about this toot | More toots from johnmackintosh@fosstodon.org
text/gemini
This content has been proxied by September (3851b).