@[email protected]M to Data [email protected]English • 1 year agoData Engineering roadmaplemmy.mlimagemessage-square7fedilinkarrow-up113arrow-down11file-text
arrow-up112arrow-down1imageData Engineering roadmaplemmy.ml@[email protected]M to Data [email protected]English • 1 year agomessage-square7fedilinkfile-text
minus-squareAndylinkfedilinkEnglish1•1 year agoIsn’t Apache Arrow a table format rather than a batch processing tool? You could add SQLMesh as an alternative to dbt.
minus-square@[email protected]OPMlinkfedilinkEnglish1•1 year agothanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html
Isn’t Apache Arrow a table format rather than a batch processing tool?
You could add SQLMesh as an alternative to dbt.
thanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html