@[email protected]M to Science [email protected]English • 4 months agoPandasmander.xyzimagemessage-square36fedilinkarrow-up1349arrow-down19
arrow-up1340arrow-down1imagePandasmander.xyz@[email protected]M to Science [email protected]English • 4 months agomessage-square36fedilink
minus-squareQuizzaciousOtterlinkfedilinkEnglish12•4 months agoI really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
minus-square@[email protected]linkfedilinkEnglish9•4 months agoYeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.
I really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
Yeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.