Ancestors

Written by John MacKintosh on 2024-12-20 at 08:04

[#]rstats

Strategies for dealing with tidying multiple large CSV files, each of varying dimensions, which are in a list.

They all have the first 4 rows of useless text. Varying column widths.

The next several rows (could be one, could be four) are what should be column headers. No way of knowing how many there are without painstakingly going through each.

The last 6 rows are useless, and can be discarded.

I have a hacky solution but interested to hear how others would start to tackle this

=> More informations about this toot | More toots from johnmackintosh@fosstodon.org

Toot

Written by Tamás Stirling on 2024-12-20 at 09:02

@johnmackintosh Many fuctions that import tables have an argument for skipping the first N rows, I would use this built in functionality. I prefer read.csv() for importing tables it usually does the job.

If you can generalise your operations such that you do the same thing with each csv, then I think lapply() will also help. I would probably start with a vector of csv paths and then do each processing step with lapply().

=> More informations about this toot | More toots from stitam@fosstodon.org

Descendants