Data1984
Kanalga Telegramβda oβtish
This channel is mostly about data related stuff, some of the main topics are #DataEngineering #AI #SQL #Python #cloud Contact: @gorros
Ko'proq ko'rsatish776
Obunachilar
-124 soatlar
-27 kun
-230 kun
Postlar arxiv
776
Edelbyte left stealth with $70M (Sequoia, Quiet Capital) at a ~$500M valuation. The four founders are ex-Azure Kusto (Azure Data Explorer) people, building agent-oriented search and analytics for hundreds of petabytes. It will compete with Snowflake, Databricks and ClickHouse. https://siliconangle.com/?p=853911
15 Noy, 02:23
776
Nice to see a lot of parallels with my PyData talk
- https://www.getdbt.com/blog/aws-dbt-semantic-layer-ai-agent-revenue-accuracy
- https://www.getdbt.com/blog/dbt-semantic-layer-ai-agent-adoption
31 Okt, 10:27
776
AI Engineering from Scratch | Free AI Engineering Course
https://aiengineeringfromscratch.com/
12 Okt, 02:52
776
+1
SLayer - an open-source semantic layer for AI agents.
The usual argument for giving agents more context is that it helps them write better SQL. SLayer takes a different angle: the problem isn't that agents write bad SQL, they're generally fine at that, it's that they don't know which SQL answers the question, so they guess, and the guess looks just as confident as a correct one. Same question, different query, sometimes a different number.
Instead of feeding the agent more context and hoping it reasons its way to the right query, SLayer gives it a governed set of pre-defined metrics to call. The agent still picks what it needs, but it never decides what "revenue" means or which tables to join, so the same question always returns the same, traceable answer.
Built by the team behind Motley, running as a library, CLI, or MCP/REST interface, no separate service required.
GitHub: github.com/MotleyAI/slayer
X: x.com/usemotley
Website: motley.ai/slayer
15 Iyul, 06:28
776
A drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive Al workloads.
https://github.com/lakehq/sail
24 Apr, 13:24
776
Karpathy posted his raw/ folder workflow for LLM context β a simple idea: dump your notes, PDFs, papers into one folder and feed it to the LLM.
Someone built a full system on top of it for Claude Code.
claude-memory-compiler hooks into your Claude Code sessions and automatically compiles them into a structured knowledge base. Every decision, pattern, lesson β extracted and cross-referenced into markdown articles.
The architecture is interesting:
β’ No RAG, no vector DB β just a smart index.md the LLM navigates
β’ Works at personal scale (50β500 articles) better than cosine similarity
β’ Runs on your existing Claude subscription, no extra API costs
https://github.com/coleam00/claude-memory-compiler14 Apr, 13:45
776
I just learned you can run Claude Code locally with Ollama.
Ollama 0.19 (preview, released yesterday) is now powered by Apple's MLX framework β and one thing that caught my attention as a Claude Code user: Ollama now reuses its cache across conversations, meaning less memory overhead and more cache hits when using a shared system prompt with tools like Claude Code.
That's a meaningful improvement for agentic workflows.
The setup is a single command:
ollama launch claude --model qwen3.5:35b-a3b-coding-nvfp4Whether you're working in an air-gapped environment or just tired of API costs β local coding agents are getting genuinely viable. (Requires a Mac with 32GB+ unified memory) https://ollama.com/blog/mlx
31 Mar, 11:50
776
ClickHouse MergeTree and HBase are the same thing at their core.
Not literally β but architecturally, they share the same DNA: the LSM Tree (Log-Structured Merge Tree).
Here's how it works:
1. Writes hit memory first β fast, no disk I/O
2. When memory fills, flush to an immutable sorted file on disk
3. Background compaction merges files β removes duplicates, applies deletes
4. Bloom filters + sparse indexes make reads fast without scanning everything
HBase calls these HFiles. ClickHouse calls them Parts. Cassandra calls them SSTables. Same idea.
What ClickHouse adds on top:
β
Columnar layout inside each part (OLAP-optimized)
β
The merge step does useful analytical work β deduplication (ReplacingMergeTree), summation (SummingMergeTree), pre-aggregation (AggregatingMergeTree)
β
Sparse indexing at granule level (8192 rows) rather than row-level
I still teach HBase in my data engineering course β as a NoSQL example and as a core part of the Hadoop ecosystem. And honestly, I started my DE career working with it.
Sometimes I wondered: is this too specific? Should I simplify the curriculum and drop it?
But my teaching philosophy has always been to explain technologies by focusing on what's fundamental and shared across many systems. And this connection β HBase and ClickHouse both rooted in LSM Trees β is exactly why that approach pays off.
The tools change. The patterns underneath them don't.
16 Mar, 10:48
776
π¦ PicoClaw is an ultra-lightweight personal AI Assistant inspired by nanobot, refactored from the ground up in Go through a self-bootstrapping process, where the AI agent itself drove the entire architectural migration and code optimization.
β‘οΈ Runs on $10 hardware with <10MB RAM: That's 99% less memory than OpenClaw and 98% cheaper than a Mac mini!
https://github.com/sipeed/picoclaw
11 Mar, 10:36
