Databases with V

Watched SQLite in Wasm: https://www.youtube.com/watch?v=oLYda9jmNpk If you are interested in SQLite, WASM, and Rust, you should watch this too. SQLSync runs WASM within WASM! Carl is an excellent presenter, by the way. - Carl makes a case about the local first apps and how they are better for UX. - Intro to SQLSync core it differs from CRDTs and uses git rebase like a model for merge and conflicts. - The core of SQLSync is in Rust, wraps over SQLite, and is compiled to WASM - The users can write custom logic that also gets compiled down to WASM (called `reducers`) - Then he figured out how to run WASM within WASM using WASMI (very cool project! - https://github.com/paritytech/wasmi)

Advent of Code is up - https://adventofcode.com/

TIL about Project Silica - https://www.microsoft.com/en-us/research/project/project-silica/ It's research project by Microsoft where they are trying to build a low cost, sustainable, and durable storage media for thousands of years. The trick? They store data in a glass > As a storage technology, Silica offers volumetric data densities higher than current magnetic tapes (raw capacity upwards of 7TB in a square glass platter the size of a DVD), and using beam steering of the laser beam, we’re able to achieve system-level aggregate write throughputs comparable to current archival systems. short intro video: https://www.youtube.com/watch?v=-rfEYd4NGQg this a bigger one, talks about internals: https://www.youtube.com/watch?v=V7L_wdEuQXs

At Reinvent, AWS launched S3 Express One Zone which gives sub ms latencies on S3. It is also about 8x expensive than S3. Here is a side project idea: building an LSM tree utilising S3 tiers. Level 0 data in Express One for fast access and rest of the data in regular S3. https://aws.amazon.com/blogs/aws/new-amazon-s3-express-one-zone-high-performance-storage-class/

> Promoting your database system or start-up with a shirt is almost as important as getting the thing to actually run. As I've told my students several times, in the world of databases you don't sell the steak, you sell the sizzle. Over the years, I've collected a number of shirts from database companies (mostly newer NoSQL and NewSQL start-ups). A good shirt can get people to feel like your DBMS is going to solve all of their application's database problems. https://www.cs.cmu.edu/~pavlo/blog/2016/07/my-favorite-database-shirts.html

2. Elizabeth Gilbert on Distinguishing Between Hobbies, Jobs, Careers, & Vocation: https://www.youtube.com/watch?v=0g7ARarFNnw

I have two short video recommendations: 1. A wholesome video by Bjarne Stroustrup: https://www.youtube.com/watch?v=-QxI-RP6-HM

Jane Street puzzles - https://www.janestreet.com/puzzles/current-puzzle/

one more: Implement a filesystem in Rust https://archive.fosdem.org/2022/schedule/event/misc_ntfs_rust/

This is a great site on database indexing and tuning. Lots of practical and sane advice - https://use-the-index-luke.com/ (shared by community member Stan)

Great article on the value of database skills and the large class of problems one can solve https://renegadeotter.com/2023/11/12/your-database-skills-are-not-good-to-have.html

This four part series explains how debuggers work and how to write one from scratch https://mostlynerdless.de/blog/2023/09/20/lets-create-a-python-debugger-together-part-1/

Blusky migrated from Postgres to SQLite 😲 https://github.com/bluesky-social/atproto/pull/1705

Someone from the community shared the previous video with me after seeing this Diskplorer post. Feel free to share such stuff with me and I will share in the community 😅

Found this great video - https://youtube.com/watch?v=Am-nXO6KK58 where they talk about databases work under heavy load on modern SSDs. They also talk about mixed workloads (read heavy, write heavy etc)

A real build of the Linux 6.1.14 kernel running in pure Scratch code! https://scratch.mit.edu/projects/892602496 (source - https://twitter.com/KumaTea0/status/1714059476251124104)

TIL you can configure git diff for the file types using this neat trick, you can track changes in SQLite DB -https://garrit.xyz/posts/2023-11-01-tracking-sqlite-database-changes-in-git

I found this tool called Diskplorer, which makes your hard disks go brrrrrrr (literally) and can be used to measure disk read latency at different read and write workloads Then it generates pretty graphs like these (check README for more) https://github.com/scylladb/diskplorer

"Exploring systems, boundaries, what you can and cannot do—such a great way to learn." https://ntietz.com/blog/that-time-i-wrote-malware/