Ashraf Miah
Aug 18, 2023

--

So does this mean the test was fair? If some libraries made assumptions or had default settings that by luck worked for your particular dataset does that mean they were quicker in converting to parquet?

Would it not have been better to use a dataset that didn't cause or be affected by these issues?

--

--

Ashraf Miah

CTO, Data Scientist & Chartered Engineer (MEng CEng EUR ING MRAeS) with over 20 years experience in the Aerospace, Rail & Energy Industry.