In this episode of Cloud Native Compass, hosts David Flanagan and Laura Santamaria dive deep into the complexities of the Kubernetes release cycle with guest Kat Cosgrove. Kat, a sub-project lead for SIGrelease in the Kubernetes project, shares her experiences and discusses issues such as burnout, handling drive-by PRs, and the nuances of managing a fast-moving open source project. They explore the structure of the release team, the challenges of maintaining CI stability, and the ever-evolving nature of contributing to Kubernetes. Alongside tech talk, the trio reminisces about their work history, the challenging debates over project management, and the quirks of maintaining open source projects. Kat also recommends a book, a movie, and an album, providing a well-rounded blend of tech insights and personal favorites.

Click here to watch a video of this episode.

Featuring

• David Flanagan - Host
• Laura Santamaria - Host
• Kat Cosgrove - Guest

• (00:00) - Introduction
• (00:08) - Meet the Hosts and Guest
• (01:24) - Kubernetes Release Process Overview
• (03:22) - Challenges in Kubernetes Release Management
• (04:08) - Team Structure and Roles
• (06:29) - Open Source Contributions and Burnout
• (11:06) - Managing CI and Bug Triage
• (15:28) - Release Delays and External Dependencies
• (16:51) - Press Embargoes and Publicity
• (20:46) - AI in Open Source Documentation
• (22:13) - The Challenges of Open Source Contributions
• (23:06) - The Auto PEP 8 Incident
• (23:49) - The Overwhelming Decisions of Maintainers
• (24:01) - The Etiquette of Open Source PRs
• (26:39) - Personal Experiences in Open Source
• (28:56) - The Accidental Involvement in Kubernetes
• (32:17) - The Chaos of SIG Release
• (34:31) - Kubernetes 2.0 and Backwards Compatibility
• (37:07) - Book, Movie, and Album Recommendations
• (38:51) - Conclusion and Farewell

Exploring Cloud Migrations & Infrastructure Strategies with Jason Hall of Chainguard

Click here to watch a video of this episode.

In this episode of the Cloud Native Compass podcast, hosts David Flanagan and Laura Santamaria chat with Jason Hall, Principal Engineer at Chainguard. They delve into Chainguard's migration from Kubernetes and Knative to Cloud Run, discussing the reasons behind the move, cost considerations, managing technical debt, and best practices for infrastructure management. The conversation also covers the benefits of using Cloud Run, their strategic use of BigQuery for event logging, and insights into least access security models. Tune in to learn more about navigating cloud-native environments and optimizing infrastructure.

Creators & Guests

• David Flanagan - Host
• Laura Santamaria - Host
• Jason Hall - Guest

• (00:00) - Introduction
• (00:52) - Jason Does Stuff
• (01:32) - Chainguard's Migration Journey
• (02:18) - Challenges with Kubernetes and Knative
• (04:33) - Adopting Cloud Run
• (12:15) - Multi-Region Deployment with Cloud Run
• (19:26) - Security and Authorization Practices
• (27:29) - Operational Decisions and Cost Considerations
• (33:07) - Debunking Kubernetes Myths
• (33:24) - The Illusion of Free Services
• (33:42) - Scaling Challenges and Solutions
• (37:00) - Convincing Leadership to Address Technical Debt
• (39:41) - Developer Environments in the Cloud
• (43:18) - Cloud Run vs. BigQuery Debate
• (47:20) - Security and Logging Best Practices
• (52:56) - Future Plans and Focus Areas
• (54:45) - Final Thoughts and Farewells

InfluxDB 3.0 Rewrite

InfluxDB, a time series database, underwent a major rewrite to create InfluxDB 3.0, also known as IOx. The decision to rewrite the database was driven by the need for strict control over memory management and high performance. The project started as a research endeavor and gradually gained traction within the company. The team decided to build around projects under the Apache Foundation, such as Apache Arrow and Apache Data Fusion. In April 2022, InfluxDB 3.0 was officially announced, aiming to improve performance, scalability, and cost-effectiveness for users.

IOx Database Engine

The new database engine, IOx, is designed to handle various types of observability and monitoring data, including metrics, traces, and logs. It aims to provide a single store for all these signals, eliminating the need for separate databases. However, querying the data efficiently is still a challenge that the team is working on. The goal is to make IOx the go-to solution for storing and querying observational data, not only for server infrastructure monitoring but also for sensor data use cases.

Challenges and Considerations

Working with logs, tracing, and structured events in time series databases poses challenges. The dynamic and inconsistent nature of schemas in logs and tracing use cases can make extracting structured fields difficult. Time series databases also have limitations in handling tracing front ends and require an index to map trace IDs to individual traces. While metrics, logs, and traces are the gold standard for observability, there is room for improvement in terms of usability and performance.

Flux and Data Fusion

Flux, a scripting language developed for InfluxDB 2.0, addresses user requests for more complex query logic and integration with third-party systems. InfluxDB 3.0 incorporates a parser in Rust to translate SQL queries into a Data Fusion query plan, benefiting from the performance optimizations of Data Fusion. However, bringing Flux to InfluxDB 3.0 proved challenging due to the large surface area of Flux and limited time and resources. Updating the Flux engine to use the 3.0 native API could potentially resolve these issues.

InfluxDB Development and Open Source Licensing

InfluxData is focused on improving the core query engine of InfluxDB and enhancing its capabilities and performance. They have created a separate community fork of Flux to allow collaboration on its development. Paul Dix, the co-founder, believes that true open source should be about freedom and expresses his intention to keep InfluxDB 3 as a permissively licensed project. He discusses the recent license change by HashiCorp and the growing distrust in the developer community towards VC-backed open source projects. Putting InfluxDB into a foundation may not be feasible due to the lack of multiple contributors.

Here are 5 key takeaways from this episode that you don't want to miss:

1️⃣ The People Problem: Laura Santamaria raises an important concern about verifying AI-generated outputs and tackling the challenge of the "people problem" in AI development.

2️⃣ Verifying Data Authenticity: JJ discusses the challenge of proving that a data blob originated from a specific model and how this issue is being addressed by companies like IBM through pile cleaning and legal penalties.

3️⃣ AI Misconceptions: We debunk some common misconceptions about AI, including the belief that it is an all-knowing fact machine.

4️⃣ Trusted AI: IBM's approach to building trusted models, with dedicated engineers responsible for cleaning and verifying data, is explained. Plus, we discover IBM's partnerships with Hugging Face to leverage the open-source ecosystem.

5️⃣ The Impact of AI: We delve into the potential positive and negative implications of AI, and how the rapid advancement of this technology presents challenges with trust and validation.

💡 Fun Fact: Did you know that 95% of open-source language models are trained on a data set called "the pile," which contains pirated and copyrighted material? Discover why this has implications for copyright and patent laws!

As always, the conversation in this episode is engaging and eye-opening. JJ Asghar provides insightful perspectives and sheds light on the future of AI development. Don't miss out on the valuable information shared!

Questions We Covered

1. How can the problem of untrusted data in AI models be effectively addressed?
2. Should companies like OpenAI and Microsoft be required to provide their data sets for verification purposes? Why or why not?
3. What are the potential risks and challenges associated with using AI technology without proper regulation?
4. Should AI creations be eligible for copyright protection? Why or why not?
5. How can we ensure the accuracy and trustworthiness of AI-generated data, especially when it comes to extracting information from sources like PDFs?
6. What are some potential positive impacts of AI technology, and how can we maximize its benefits while minimizing its negative implications?
7. How can the rapid advancement of AI technology be balanced with the need for trust and validation?
8. In what ways do copyright and patent laws need to evolve to accommodate AI technology?
9. What are the implications of China having its own set of laws and approaches to technology that may differ from other countries?
10. How can individuals navigate and better understand the AI space in order to make informed decisions and contributions?

We're back with an exciting new episode of Cloud Native Compass, and this time we're diving deep into the captivating world of eBPF. Join Laura Santamaria, David Flanagan, and special guest Liz Rice as they unravel the mysteries and explore the incredible potential of this powerful technology!

In this episode, you will learn:

1. The two parts of eBPF: Discover the kernel program and the user space interaction that make up the magic of eBPF.
2. Programming with eBPF: Explore the different options for writing eBPF programs, from bytecode form to higher-level languages like Rust.
3. Compilers and SDKs: Learn which compilers, like clang GCC and the Rust compiler, support eBPF bytecode and how SDKs can make your interaction with eBPF programs easier.
4. The Evolution of Packet Filtering: Trace the history of packet filtering, from its humble beginnings to the powerful and versatile capabilities of eBPF.
5. The Widespread Adoption: Uncover the sudden rise in eBPF's popularity, its impact on observability and performance, and the role it plays in modern networking.
Now, for a fascinating fun fact from the episode: Did you know that eBPF is now considered Turing complete? That's right! With its combination of features, eBPF has surpassed its humble start as a packet filtering tool and has become a full-fledged technology powerhouse.

Creators & Guests

• Laura Santamaria - Host
• David Flanagan - Host
• Liz Rice - Guest

• (01:46) - What is eBPF?
• (06:45) - The Rise of eBPF
• (09:40) - Why is eBPF Interesting?
• (16:00) - Who's using eBPF?
• (19:20) - eBPF for Developers
• (24:00) - Troubleshooting eBPF
• (27:11) - Future of eBPF

Curious about Istio's new deployment mechanism, Ambient Mesh? It allows you to use Istio service mesh without relying on sidecar proxies, which brings a bunch of improvements that Marino and Matt share throughout this episode; as well as a ton of deep dive technical implementation details.

Creators & Guests

• Laura Santamaria - Host
• David Flanagan - Host
• Marino Wijay - Guest
• Matt Turner - Guest

• (00:00) - - Introductions
• (01:50) - - What Ambient Mesh?
• (04:15) - - Why Ambient Mesh?
• (18:20) - - Waypoint Proxy
• (25:00) - - Trade Offs
• (34:20) - - Why Not eBPF?
• (39:50) - - Istio Graduation!

In this episode, hosts David and Laura, sit down with Laslo Fogas; a self proclaimed WebAssembly sceptic. They discuss the future of Cloud Native and improving the broken developer experience.

Creators & Guests

• Laura Santamaria - Host
• David Flanagan - Host
• Laszlo Fogas - Guest

In this episode of the Cloud Native Compass, host David Flanagan interviews Natan from Wix Engineering about event-driven architectures.

Natan shares his experience as a software engineer for almost 20 years and how working at Wix has improved his engineering skills. Wix has a powerful website building platform that has enabled people with different skill levels to build websites. They have expanded their reach from self-creators to agencies and web professionals and created a whole ecosystem platform. Wix has around 2,500 microservices in production, even more added every week, and they have a lot of visitors, around 1 billion unique visitors every month, which gives more than 500 billion HTTP requests per day and 70 billion Kafka events produced every day.

Let's learn how Natan and Wix build for success at some pretty stagger numbers.

Creators & Guests

• David Flanagan - Host
• Natan Silnitsky - Guest

• (00:00) - Introduction
• (02:25) - The Scale of Wix
• (08:50) - When & Why Event Driven Architectures
• (14:45) - Service Mesh
• (19:30) - Dev & Ops
• (27:15) - Schema Evolution & Versioning
• (34:00) - Introducing New Tools
• (37:15) - Cost Optimisation
• (44:44) - Plugs
• (00:00) - Chapter 10

Links

https://www.natansil.com/
https://www.wix.engineering/