AI - Skyhaven Group

Skyhaven Group

AI

Integrating cognitive architectures to transform data into decision velocity and durable competitive advantage.

5 Bizarre Truths About Modern Logistics That AI is Forcing Us to Confront

5 Bizarre Truths About Modern Logistics That AI is Forcing Us to Confront

Introduction: The Deceptive Simplicity of A-to-B Here is a simple problem: move a thing from Point A to Point B. That’s it. That’s logistics. A child with a toy car solves it a hundred times a day. Humanity has been solving it since we first decided one rock

Cacao Seed to Halloween Treat

AgTech Featured

Cacao Seed to Halloween Treat

The journey of your Halloween candy is a global story. It begins with 4.5 million tons of cocoa beans, 70% of which are farmed in West Africa. This post breaks down how those beans are roasted, ground, and conched into the $4 billion worth of M&M's, Reese's, and Snickers that define the holiday.

AI-Ready Earth Observation: The New Engine for Agricultural Intelligence

AgTech Featured

AI-Ready Earth Observation: The New Engine for Agricultural Intelligence

A new class of data is revolutionizing agricultural productivity, sustainability, and resilience. Building on decades of evolution, from the 1990s birth of precision agriculture with GPS and yield monitors, through the 2000s rise of cloud connectivity and early EO constellations, we've reached a pivotal era where surging Earth

GPT-2 Source Code Notes, Part 3: The Transformer Anatomy (model.py)

GPT-2 Source Code Notes, Part 3: The Transformer Anatomy (model.py)

The GPT-2 model definition shows the transformer in its pure, uncluttered form. This article breaks down the block structure, residual pattern, MLP expansion, and weight tying.

GPT-2 Source Code Notes, Part 2: Sampling and Generation (sample.py)

GPT-2 Source Code Notes, Part 2: Sampling and Generation (sample.py)

Sampling in GPT-2 is almost minimalistic. Here we look directly at top-k, temperature, and the single-token autoregressive loop that drove early generation behavior.

GPT-2 Source Code Notes, Part 1: The Tokenizer (encoder.py)

GPT-2 Source Code Notes, Part 1: The Tokenizer (encoder.py)

GPT-2’s tokenizer is surprisingly readable. This article walks through how the reversible bytes to unicode mapping and BPE merge list actually work in practice.