How to DWH with Python
Open in Telegram
Data Engineering practices, cases and implementation hints šØāš» by @bryzgaloff
Show more461
Subscribers
No data24 hours
No data7 days
No data30 days
Data loading in progress...
Similar Channels
No data
Any problems? Please refresh the page or contact our support manager.
Tags Cloud
No data
Any problems? Please refresh the page or contact our support manager.
Incoming and Outgoing Mentions
---
---
---
---
---
---
Attracting Subscribers
April '23
April '23
+3
in 0 channels
March '23
+4
in 0 channels
Get PRO
February '23
+3
in 0 channels
Get PRO
January '23
+3
in 0 channels
Get PRO
December '22
+6
in 0 channels
Get PRO
November '22
+11
in 0 channels
Get PRO
October '22
+23
in 0 channels
Get PRO
September '22
+449
in 0 channels
| Date | Subscriber Growth | Mentions | Channels | |
| 29 April | 0 | |||
| 28 April | 0 | |||
| 27 April | 0 | |||
| 26 April | 0 | |||
| 25 April | +1 | |||
| 24 April | 0 | |||
| 23 April | 0 | |||
| 22 April | +1 | |||
| 21 April | 0 | |||
| 20 April | 0 | |||
| 19 April | 0 | |||
| 18 April | 0 | |||
| 17 April | 0 | |||
| 16 April | 0 | |||
| 15 April | 0 | |||
| 14 April | 0 | |||
| 13 April | 0 | |||
| 12 April | 0 | |||
| 11 April | 0 | |||
| 10 April | 0 | |||
| 09 April | 0 | |||
| 08 April | 0 | |||
| 07 April | 0 | |||
| 06 April | 0 | |||
| 05 April | +1 | |||
| 04 April | 0 | |||
| 03 April | 0 | |||
| 02 April | 0 | |||
| 01 April | 0 |
Channel Posts
Wow, have you known about this awesome hardware benchmarks page for ClickHouse? š¤© See it: https://benchmark.clickhouse.com/hardware/
Results are contributed by ClickHouse users with various setups: from local laptops and bare metal VMs to cloud filesystems like AWS EFS.
In particular, I was interested in AWS EFS/EBS comparison: both are quite bad when compared to bare metal (which is no surprise š¤) but with a huge advantage of EBS on cold runs šš»
Hot runs EFS/EBS performance is comparable: both are about 6 times worse than bare metal.
Thus, both options are good for a quick MVP. EC2+EBS is a simpler setup while EFS can be attached to a disposable serveless ClickHouse container run as an ECS task.
| 2 | #youtube #briefly #ethereum Ethereum Data Analysis and Ingestion in AWS
š„ YouTube talk + slides with transcription
What's inside:
ā Building a realtime API for calculating tokens balances.
ā Public vs own Ethereum nodes comparison.
ā Support for other EVM and non-EVM blockchains.
Pick the most suitable format, same story:
ā š Slides with a transcription for the video.
ā ā”ļø A super-quick summary (2 minutes read).
ā š° The original article, Medium. | 1 065 |
| 3 | #briefly #ethereum How to export a full Ethereum history into S3, efficiently
https://blockchain.works-hub.com/learn/how-to-export-a-full-ethereum-history-into-s3-efficiently-f37df
A brief summary of my original article about building a Data Platform for Ethereum:
ā Which node to use: a free public one, a node provider, or run your own?
ā Start querying right away: public BigQuery datasets with Ethereum data.
ā How large is the dataset and how to process it cost-efficiently?
ā Implementing a real-time Ethereum data ingestion.
Give it a chance if the original article is too long for you but you are interested in the best practices for Ethereum data engineering š | 692 |
| 4 | #article #ethereum Exporting the full history of Ethereum into S3
https://medium.com/@tony.bryzgaloff/how-to-dump-full-ethereum-history-to-s3-296fb3ad175 (author: @bryzgaloff)
What's inside:
ā BigQuery public datasets with Ethereum data: how to transfer to S3 quickly.
ā Alternative approach: exporting data from a public Ethereum node. No need to run your own node!
ā Processing uint256 with AWS Athena.
ā Processing realtime updates from Ethereum.
ā Best Data Engineering practices to process Ethereum data.
A short summary inside š | 1 970 |
