|
News
|
|
Resilient Real-Time Data Streaming across the Edge and Hybrid Cloud
|
In this QCon Plus talk recording published in January, Kai Waehner explores different architectures and their trade-offs for transactional and analytical workloads. Real-world examples include financial services, retail, and the automotive industry.
|
|
The Wonders of PostgreSQL Logical Decoding Messages
|
In an InfoQ article published in March, Gunnar Morling, Senior Staff Software Engineer at Decodable, explores how PostgreSQL can emit messages into its write-ahead log (WAL) without updating actual tables. Logical decoding messages can be read using change data capture tools like Debezium. Stream processing tools like Apache Flink can be used to process these messages, e.g., enrich, transform, and route.
There are several use cases for logical decoding messages, including providing audit metadata, application logging, and microservices data exchange. However, there is no fixed schema for logical decoding messages; the application developer must define, communicate, and evolve the schema.
Interested readers can learn more about data engineering trends via the "InfoQ AI, ML, and Data Engineering Trends Report 2023" and the accompanying podcast.
|
|
Living on the Edge: Boosting Your Site's Performance with Edge Computing
|
Erica Pisani, senior software engineer at Netlify, presented at QCon London on what edge is, how running code and serving data on the edge can improve site performance, and how to leverage these options effectively in a site to maximize site performance with minimal architectural changes.
Pisani started explaining what Edge is, presenting the concepts of cloud regions and their availability zones, taking AWS as an example (the same applies to Google Cloud and Microsoft Azure). Pisani describes "The Edge" as data centers outside the availability zones.
|
|
Huawei Open Sources Kuasar, a Rust-Based Container Runtime
|
During the KubeCon + CloudNativeCon EU 2023 event, Huawei announced that it had open-sourced Kuasar, a Rust-based container runtime that supports multiple types of sandboxes, including microVMs, Linux containers, app kernels, and WebAssembly (Wasm) runtimes that can be valuable for edge use cases.
The topics of containers and Wasm were explored further in the InfoQ Cloud and DevOps Trends 2023 podcast, where the panelists noted, "We are seeing interesting adoption of cloud native frameworks and tooling across a broad range of systems, such as WebAssembly (Wasm), [and] eBPF".
|
|
The Guardian Optimizes Mobile Push-Notification Delivery Architecture
|
The technology team at the Guardian has used event-driven architecture to make mobile push notifications faster to improve readers' experiences. The original architecture, optimized for concurrency, has been suffering from delays in notification delivery. The engineers used improved observability to make significant gains through experimentation.
Guardian readers can use the mobile app to access content and register to receive breaking news alerts via push notifications. The event-driven architecture (EDA) behind that has been operating since 2009. Over time, notification delivery speeds have decreased, taking more than five minutes for some users, missing their goal of delivering notifications to 90% of the intended audience within two minutes.
|
|
Grab Reduces Traffic Cost for Kafka Consumers on AWS to Zero
|
|
|
|
Getting to Know Dapr with Mark Fussell and Yaron Schneider
|
In a recent episode of the InfoQ podcast, Thomas Betts talked to Mark Fussell and Yaron Schneider about the Distributed Applications Runtime, Dapr. In the latest InfoQ Architecture and Design Trends Report, Dapr is one of the early adopters of design ideas for portability and cloud-bound applications. Dapr provides APIs that abstract away the infrastructure details for modern applications, providing secure, best-practice implementations that work across any cloud, framework, and language.
In related news, Wes Reisz summarized the latest Dapr release that was announced at AppDeveloperCon, a co-located event at KubeCon + CloudNativeCon NA 2023 that ran in November in Chicago.
|
|
Datadog Creates Scalable Data Ingestion Architecture
|
Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs.
The architecture of Husky separates data ingestion, data compaction, and data reading workloads, which allows them to be scaled independently. All three workloads leverage a shared metadata store built on FoundationDB and a blob storage service that uses AWS S3. The data ingestion workload uses Apache Kafka to deliver events into the storage platform and route them internally to data writers.
Related to this topic, Thomas Betts recently sat down with Lily Mara, Engineering Manager at OneSignal, for an InfoQ podcast, "Building a Reliable Kafka Data Processing Pipeline with Lily Mara".
|
|
Java 21, the Next LTS Release, Delivers Virtual Threads, Record Patterns, and Pattern Matching
|
|
|
|
Keeping Go "Boring" in Go 1.21: How Google Grants Backward Compatibility
|
In a recent article, Google engineer Russ Cox detailed what Google does to ensure each new Go release honors Go’s backward-compatibility guarantee. This includes generalizing GODEBUG in Go 1.21 to cover even subtle incompatibility cases.
Introduced in Go 1, Go's backward-compatibility guarantee ensures all correct Go programs will continue to work with future language releases. Cox explains that this goal entails two major efforts: checking that each API change does not break anything and extensive testing to catch subtler incompatibility cases.
Sponsored
|
|
This cookbook provides practical insights into cloud challenges and success strategies, focusing on Amazon Web Services (AWS). Structured into technology-focused chapters, the book offers concise, self-contained “recipes” with clear problem statements, solutions, and discussions. Catering to both novices and experts, it uses real-world examples to demonstrate AWS applications, making it a valuable resource for career advancement. Download Now.
Download the “AWS Cookbook”, sponsored by DoIT International
|
|
|
|
