Articles

We keep hearing this: “AGI is coming.” But what exactly is AGI? Let’s explore this critical question. Three Different Lenses Let’s look at AI through three different lenses. The Economics Lens OpenAI defines AGI as “highly autonomous systems that outperform humans at most economically valuable work.” Their focus is entirely economic—it’s about jobs and economic productivity. When framed this way, the definition essentially states: if AI surpasses humans at most work that people are paid to perform, then we have achieved AGI. The moment AI can produce the majority of economically valuable work, we’ve crossed the AGI threshold. ...

“So, what kind of engineer are you?” “I’m a Python engineer.” Every time I hear this, I cringe a little. Not because Python isn’t amazing—it absolutely is. But because somewhere along the way, we’ve started defining ourselves by our tools instead of our craft. I’m sure you’ve heard it too: “I am an AWS engineer,” “I am a React developer,” as if the tool has become their entire professional identity. ...

There’s a really weird communication pattern that I keep seeing all the time in big companies and small companies. Picture this: You’re hiring an employee, consultant, contractor, whatever you want to call them. You think this person has good experience and you’re paying them hundreds of thousands of dollars. Once you hire them, you tell them, “Hey, I want you to do this.” This is super weird. You’re not explaining the problem. You’re just trying to use this person as a human tool. ...

I want to argue that you should build your product on microservices; not because of technical reasons, but because you should see it as a team management strategy. The Double-Edged Sword of Microservices Let’s zoom out and first remember what a microservice is. A microservice is basically a small, deployable piece of service that, when meshed together with others, forms a larger application. If you’re already working with microservices or even if you haven’t built any so far, you’ve probably heard about it. ...

Have you ever been in a meeting where people just keep putting band-aids on problems but don’t discuss how they came to that point? Let me talk about the decision chain mindset. Understanding the Decision Chain Picture this: You make a decision, or someone makes a decision at a high level. Let’s call this Decision A. Based on this decision, another decision is made. Let’s name it Decision B. And based on that, now you have to make another decision. Let’s call it Decision C. ...

I walked into my neighborhood coffee shop for my regular Americano, but walked out with a lesson, a leadership lesson. Let me explain. The Beginning This coffee shop opened here in my town around three years ago. Since then, I have become a regular customer. If I have time in the morning, I just walk there, I’m even the first or second customer, I have my morning coffee and walk back home. That’s how I start my days. ...

An Introduction to StarRocks: My Experience Using It (Plus My Docker Setup) I’ve been working on projects including StarRocks for the last couple of years. When I first used it, that shocked me how lightning-fast the queries are. I decided to write an article about StarRocks. This article will serve me as future notes too ;) Let’s dive. Table of Contents What is StarRocks? My Journey with StarRocks 2.1. Key Features That Makes StarRocks StarRocks Why Choose StarRocks? 3.1. Performance That Matters 3.2. Cost-Effective Scaling 3.3. Real-World Use Cases Architecture Deep Dive 4.1. Frontend (FE) Nodes 4.2. Backend (BE) Nodes Getting Started with StarRocks Using Docker 5.1. Quick Setup Guide 5.2. Repository Features Your First StarRocks Query Advanced Features to Explore 7.1. Materialized Views for Acceleration 7.2. Real-Time Data Ingestion 7.3. Window Functions for Advanced Analytics Performance Optimization Tips Monitoring and Operations 9.1. Key Metrics to Track 9.2. Backup and Recovery Community Conclusion 1. What is StarRocks? We can define StarRocks as high-performance analytical database designed for online analytical processing (OLAP) workloads. It was forked from Apache Doris but it has evolved into a powerful solution. ...

Table of Contents Introduction SIMD Implementation Fundamentals 2.1 AVX2 and 256-bit Registers 2.2 Memory Alignment Considerations 2.2.1 Unaligned Memory Access (Inefficient) 2.2.2 Aligned Memory Access (Efficient) 2.3 Loop Unrolling Technique 2.4 Compilation Requirements SIMD in Practice: Dot Product Case Study 3.1 Four Implementation Approaches 3.1.1 Scalar Implementation (Baseline) 3.1.2 Basic SIMD Implementation 3.1.3 Unrolled SIMD Implementation 3.1.4 Aligned SIMD Implementation Performance Analysis: Benchmark Results 4.1 Compilation Methodology 4.2 Results with -O3 Optimization 4.3 Results without -O3 Optimization 4.4 Compiler Optimization vs Manual SIMD: Key Insights 4.4.1 Compiler Auto-Vectorization is Remarkably Effective 4.4.2 Manual Optimization Value Depends on Context 4.4.3 Memory Hierarchy Effects Persist Regardless Conclusion & Practical Takeaways 5.1 Key Practical Takeaways 1. Introduction Do you keep hearing SIMD but don’t know what it is all about? Here is an article for you. SIMD is the go-to technique for squeezing every ounce of performance from modern CPUs. The promise of SIMD is: process 8 floating-point numbers simultaneously instead of one and in theory that will achieve 8x speed. That is just theory because there are other parameters that impact the results. ...

Table of Contents Introduction Prerequisites Project Setup Architecture Overview Exporting Models to ONNX Loading an ONNX Model Text Generation Pipeline Building the CLI Chat Interface Going Further Conversation Memory Temperature & Top-p Sampling Streaming Tokens Performance Optimizations Testing Deployment Considerations Conclusion TLDR ...

When building cloud applications that handle sensitive data, encryption isn’t optional, it’s essential. But there’s an important difference between just doing the basic encryption vs. implementing it correctly at scale. In this article, we’ll explore envelope encryption, a pattern that AWS, Google Cloud, and Azure all use internally and recommend for production applications. Table of Contents What Is Envelope Encryption? The Problem with Direct KMS Encryption The Envelope Encryption Solution Why This Is Superior Production Implementation with Google Cloud Prerequisites: Set Up Infrastructure Production-Ready Implementation Best Practices Common Pitfalls to Avoid Conclusion What Is Envelope Encryption? Envelope encryption is a cryptographic pattern where you use two layers of keys: ...