Data1984

If you want to learn more about this project here is a review.

This use-case puts Apache Doris into perspective. I don't know many alternatives to Clickhouse as open-source data warehouse but it looks like Doris is one of them.

Nice to see new BI-as-Code tools.

I really like this visual about ACID, easy to refresh your understanding.

The new Elastic Search Query Language (ES|QL) looks a lot like Kusto Query Language (KQL) which I currently use a lot.

Important announcements from AWS re:Invent 2023: 1. Announcing zero-ETL integrations with AWS Databases and Amazon Redshift 2. AWS launches S3 Express One Zone, promises 10x write speed improvement 3. AWS announces support for large language models in Amazon Redshift ML

RAPIDS cuDF Accelerates pandas Nearly 150x with Zero Code Changes | NVIDIA Technical Blog https://developer.nvidia.com/blog/rapids-cudf-accelerates-pandas-nearly-150x-with-zero-code-changes/

Share via https://www.dremio.com/blog/exploring-the-architecture-of-apache-iceberg-delta-lake-and-apache-hudi/

Finally there is dedicated certification for data engineers from AWS https://aws.amazon.com/certification/certified-data-engineer-associate/

Share via https://lakefs.io/blog/jupyter-notebook-10-alternatives-2023/

Looks like data lineage, profile and quality are getting more attention in the data tools.

Share via https://cloud.google.com/blog/products/data-analytics/announcing-bigquery-studio/