en
Feedback
Data1984

Data1984

Open in Telegram

This channel is mostly about data related stuff, some of the main topics are #DataEngineering #SQL #Python #cloud . Contact: @gorros

Show more
662
Subscribers
No data24 hours
+57 days
+1130 days
Posts Archive
Lightning fast aggregations by distributing DuckDB across AWS Lambda functions | by BoilingData.com | Medium https://boilingdata.medium.com/lightning-fast-aggregations-by-distributing-duckdb-across-aws-lambda-functions-e4775931ab04

GitHub - eto-ai/lance: Modern columnar data format for ML implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming.. https://github.com/eto-ai/lance

Welcome - Data With Rust https://datawithrust.com/

GitHub - MaterializeInc/datagen: Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format. https://github.com/MaterializeInc/datagen

Home - Apache Doris https://doris.apache.org/

photo content

Pandas 2.0 and its Ecosystem (Arrow, Polars, DuckDB) | Airbyte https://airbyte.com/blog/pandas-2-0-ecosystem-arrow-polars-duckdb

Build a poor man’s data lake from scratch with DuckDB | Dagster Blog https://dagster.io/blog/duckdb-data-lake

Guide to Partitions Calculation for Processing Data Files in Apache Spark - DZone https://dzone.com/articles/guide-to-partitions-calculation-for-processing-dat

AWS Lambdas - Python vs Rust. Performance and Cost Savings. - Confessions of a Data Guy https://www.confessionsofadataguy.com/aws-lambdas-python-vs-rust-performance-and-cost-savings/

FirstMark | 2023 MAD (ML/AI/Data) Landscape https://mad.firstmarkcap.com/