I was looking to import data from database and save it to parquet. The RowWriter is a good option, but it gets very complicated to deal with generics if you don't know data schema ahead of time (e.g. for "select *"), or if you have too many columns. To get data schema from DataReader is very simple, so probably won't be hard to implement
So looking for some helper method like WriteFromReader(IDataReader reader, WriterProperties props)
And something similar for reading
I was looking to import data from database and save it to parquet. The RowWriter is a good option, but it gets very complicated to deal with generics if you don't know data schema ahead of time (e.g. for "select *"), or if you have too many columns. To get data schema from DataReader is very simple, so probably won't be hard to implement
So looking for some helper method like
WriteFromReader(IDataReader reader, WriterProperties props)And something similar for reading