Option to Automatically Infer CSV Format

[domoritz]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

When parsing CSV files, I don't want to always provide information about e.g. the header (which defaults to false). It would be nice if the format could be inferred like the schema.

Describe the solution you'd like

Add an infer_format method.

[tustvold]

https://docs.rs/arrow-csv/latest/arrow_csv/reader/struct.Format.html#method.infer_schema

Edit: On re-read it looks like you're after the format, e.g. delimiter, header, I don't think this is possible to infer

[domoritz]

Yes, I am looking after inferring the format, not the schema. I am especially interested in the header since the default is false but many CSV files have a header.

[tustvold]

Unfortunately I can't think of a reliable way to do this

[domoritz]

There is not perfect way but if you find that the first row has strings while the subsequent ones have e.g. numbers it's probably a header.

Iirc duckdb had a pretty good automatic inference algorithm for csv parsing.