DevOps & SRE notes

Kubernetes-native IoT gateway https://github.com/Edgenesis/shifu

A day 0 tool for getting your app on k8s fast https://github.com/azure/draft

AWS Organizations Service Control Policies (SCPs) written in HashiCorp Terraform. https://github.com/ScaleSec/terraform_aws_scp

Diagram as code

from diagrams import Cluster, Diagram
from diagrams.aws.compute import ECS, EKS, Lambda
from diagrams.aws.database import Redshift
from diagrams.aws.integration import SQS
from diagrams.aws.storage import S3

with Diagram("Event Processing", show=False):
    source = EKS("k8s source")

    with Cluster("Event Flows"):
        with Cluster("Event Workers"):
            workers = [ECS("worker1"),
                       ECS("worker2"),
                       ECS("worker3")]

        queue = SQS("event queue")

        with Cluster("Processing"):
            handlers = [Lambda("proc1"),
                        Lambda("proc2"),
                        Lambda("proc3")]

    store = S3("events store")
    dw = Redshift("analytics")

    source >> workers >> queue >> handlers
    handlers >> store
    handlers >> dw

https://diagrams.mingrammer.com/docs/getting-started/examples

Good article about k8s and Zero-Downtime applications https://www.qovery.com/blog/how-to-achieve-zero-downtime-application-with-kubernetes

This post provides a comprehensive overview of Cloudflare's logging pipeline, detailing the various components and processes involved in managing, improving, and maintaining the internal logging systems. It covers the journey of logs from their inception to their storage, explaining the role of different technologies and methods used in this process. The article highlights Cloudflare's focus on scalability, high availability, and meeting service level objectives while handling immense volumes of log data. https://blog.cloudflare.com/an-overview-of-cloudflares-logging-pipeline/

Perfect presentation about zero-trust https://www.youtube.com/watch?v=0fkFj5XVnpY

Burrito is a TACoS (Terraform Automation Collaboration Software) Kubernetes Operator. https://github.com/padok-team/burrito

libvirt autoscaler module for k8s cluster-autoscaler https://github.com/PeterGrace/libvirt_autoscaler

The blog post details a case study on migrating Kubernetes clusters between AWS accounts using Velero. It covers the migration process, including the transfer of both Kubernetes and non-Kubernetes resources, and outlines specific steps and strategies adopted for this task. The post also shares lessons learned and insights gained during the migration, making it a useful resource for those looking to undertake similar projects. https://devopsdirective.com/posts/2023/11/velero-aws-account-migration/index.html

The blog post "Bootstrap an Air Gapped Cluster With Kubeadm" provides a comprehensive guide on setting up a Kubernetes cluster in an air-gapped environment using Kubeadm. It covers the challenges of deploying in a network-isolated environment and offers detailed steps and strategies to effectively overcome these obstacles. The guide is particularly useful for those looking to deploy Kubernetes in secure, restricted-access environments. https://kubernetes.io/blog/2023/10/12/bootstrap-an-air-gapped-cluster-with-kubeadm/

Kubernetes Cluster API Provider for Terraform Cloud https://github.com/hashicorp/cluster-api-provider-terraform-cloud

🪱 Kermoo offers resilience testing with Process Delays, Back-end Failures, CPU Simulations, and Memory Leaks. Boost your system reliability effortlessly. https://github.com/evryn/kermoo

The blog post "Architects & Tech Leads" explores the distinct roles of software architects and tech leads in product development teams. It discusses how these roles interact and work with product managers and engineering managers. The post delves into the challenges of defining these roles and the potential areas of conflict, emphasizing the importance of flexibility and collaboration in modern software development. It advocates for a synergistic approach, where each role complements the other, contributing to the overall success of the team. https://mikefisher.substack.com/p/architects-and-tech-leads