@[email protected]M to Science [email protected]English • 2 months agoPandasmander.xyzimagemessage-square36fedilinkarrow-up1349arrow-down19
arrow-up1340arrow-down1imagePandasmander.xyz@[email protected]M to Science [email protected]English • 2 months agomessage-square36fedilink
minus-square@[email protected]linkfedilinkEnglish5•2 months agoI guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
minus-square@[email protected]linkfedilinkEnglish13•2 months agoCSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
minus-square@[email protected]linkfedilinkEnglish3•2 months agoOr they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
I guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
Why do you have to personally attack me like that?
Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
Fine! .csv.gz ftw!