Data1984
Open in Telegram
This channel is mostly about data related stuff, some of the main topics are #DataEngineering #SQL #Python #cloud . Contact: @gorros
Show more662
Subscribers
No data24 hours
+57 days
+1130 days
Posts Archive
662
Lightning fast aggregations by distributing DuckDB across AWS Lambda functions | by BoilingData.com | Medium
https://boilingdata.medium.com/lightning-fast-aggregations-by-distributing-duckdb-across-aws-lambda-functions-e4775931ab04
662
GitHub - eto-ai/lance: Modern columnar data format for ML implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
https://github.com/eto-ai/lance
662
GitHub - MaterializeInc/datagen: Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
https://github.com/MaterializeInc/datagen
662
Pandas 2.0 and its Ecosystem (Arrow, Polars, DuckDB) | Airbyte
https://airbyte.com/blog/pandas-2-0-ecosystem-arrow-polars-duckdb
662
Build a poor man’s data lake from scratch with DuckDB | Dagster Blog
https://dagster.io/blog/duckdb-data-lake
662
Guide to Partitions Calculation for Processing Data Files in Apache Spark - DZone
https://dzone.com/articles/guide-to-partitions-calculation-for-processing-dat
662
AWS Lambdas - Python vs Rust. Performance and Cost Savings. - Confessions of a Data Guy
https://www.confessionsofadataguy.com/aws-lambdas-python-vs-rust-performance-and-cost-savings/
