Skip to content

All posts

Page 69 of 129

Transformers and Attention: How Models Decide Which Words to Look At

The core of the Transformer is self-attention: for each token, the model computes how relevant every other token is, then takes a weighted sum. This lets the model reach across distance to figure out that 'it' refers to 'cat' not 'mat' — and is the foundation for how it handles long documents.

Ahead of AI: How a Scholar Built 200K Subscribers by Publishing Monthly, Not Daily

Computational biology PhD turned UW-Madison professor Sebastian Raschka launched Ahead of AI on Substack in 2022, publishing monthly deep dives into LLM papers and architectures. Four years later: 200K+ subscribers, zero sponsorships, and a book-newsletter flywheel that proves low frequency and high depth can win in a crowded AI newsletter market.

ByteByteGo: From a Self-Published Book to a Million-Subscriber System Design Empire

Former Twitter/Apple/Zynga engineer Alex Xu self-published System Design Interview in 2020 and hit the Amazon bestseller list. In 2022, he and ex-Discord engineer Sahn Lam launched a Substack newsletter that crossed 26K subscribers in month one and hit one million in two and a half years. From book to newsletter, YouTube, and paid platform, ByteByteGo reached $3.5M ARR in 2024 with a 26-person team — all fully bootstrapped.

Daily Dose of Data Science: From a Cancelled Master's to 200K Newsletter Subscribers

Former Mastercard AI engineer Avi Chawla turned a cancelled US master's admission into a daily Substack newsletter — 150-word visual posts on data science. 10K subscribers in 5 months, income exceeding his full-time job, 200K+ subscribers and a paid course platform four years later.

Dense Discovery: 403 Issues of Deliberately Staying Small

Berlin-born, Melbourne-based designer Kai Brach spun his indie print magazine Offscreen into Dense Discovery, a weekly curated newsletter. Eight years, 403 issues, 36,000 subscribers, 63% open rate — deliberately not scaling, sustained by a single $649+ sponsor slot per issue and a Friends membership program. Proof that 'enough' is a viable business model.

Lenny's Newsletter: How an Ex-Airbnb PM Built the Most Influential Product Management Newsletter

Former Airbnb product lead Lenny Rachitsky left in 2019, wrote a viral Medium post, moved to Substack, and built a 1.2M-subscriber newsletter empire through obsessive quality (50+ revision cycles per post), a 40K-member Slack community, a top-ranked podcast, and an annual summit — all without hiring a single full-time employee.

Morning Brew: From a Michigan Dorm Room to a $75M Media Empire

Alex Lieberman started a PDF called Market Corner in his Michigan dorm, rewriting Wall Street Journal-style news in a casual, conversational tone. Five years later, Morning Brew hit 4 million subscribers and $13M in revenue, then sold to Insider Inc. for $75M. Their referral program accounted for up to 75% of new signups at its peak — one of the most successful growth engines in newsletter history.

Not Boring: When Writing Itself Becomes the Deal Flow

Former investment banker and startup VP Packy McCormick turned a COVID-era social club pivot into Not Boring, a long-form business analysis newsletter. In two years he hit 100K subscribers and $1M in sponsorship revenue, then extended the flywheel into three venture funds totaling $68M+ across 200+ investments — proving that writing can literally be deal flow.

One-Person Media Company: Ten Newsletter Cases and Four Revenue Playbooks

From Stratechery proving in 2014 that one person can make a living writing analysis to TLDR hitting $10M+ ARR in 2024 — ten newsletter cases distilled into four revenue playbooks, three content models, and one universal rule: format choice determines the ceiling.

The Pragmatic Engineer: From Uber Payments Lead to Substack's #1 Tech Newsletter

After six years managing Uber's payments infrastructure and witnessing pandemic layoffs, Gergely Orosz launched The Pragmatic Engineer on Substack. It hit #1 in tech within four months, crossed one million subscribers in three and a half years, and generates $1.5M+ annually — entirely from reader subscriptions, with zero ads or sponsors.

Stratechery: The Paid Newsletter Pioneer Who Proved the Model from a Taipei Apartment

Ben Thompson launched Stratechery full-time from his Taipei apartment in 2014 with a three-tier subscription model. Twelve years later, he has 40,000+ paid subscribers, $5M+ annual revenue, and created Aggregation Theory — the most influential business framework in tech analysis since Clayton Christensen. Substack's seed-round pitch was literally 'Stratechery-in-a-box.'

The Hustle: From a Hot Dog Stand to a $27M SaaS Acquisition

Sam Parr went from selling hot dogs in Nashville to building a 1.5M-subscriber business newsletter, then sold it to HubSpot for eight figures. The buyer didn't want the content — they wanted the mailing list as a SaaS lead funnel.

TLDR: How a Basement Side Project Became an Eight-Figure Ad-Only Newsletter Empire

Dan Ni — Yale math-econ grad, former Jane Street quant trader — left Wall Street after a rare medical condition, and launched TLDR from his parents' basement in Missouri with $50/day in Reddit ads. Eight years later: 13 verticals, 7.2 million subscribers, 22 fully remote employees, and eight-figure annual revenue — all from advertising, not a cent from readers.

FLUX: The Image Model Family Built by Stable Diffusion's Original Team, from 12B to a Self-Flow World Model

FLUX is Black Forest Labs' image-model family. The Stable Diffusion team launched it in August 2024 with a 12B rectified-flow transformer. Two years later it spans klein 4B ($0.014 and the only current Apache-2.0 model) / 9B, pro ($0.03), flex ($0.05), max ($0.07 with live web grounding), and open-weight 32B dev. FLUX 3 extends Self-Flow to video, synchronized audio, and robot actions. This guide covers the FLUX.1-to-FLUX 3 evolution, three-tier licensing, and model selection.

Speech and Audio Models: Four Years from Whisper Rewriting Open ASR to ElevenLabs Consolidating Voice APIs

Speech models split into two lines. Whisper led ASR: its MIT-licensed 1.55B model drove transcription cost toward zero in September 2022; after v2, v3, and turbo cut the decoder from 32 layers to four, OpenAI moved to closed gpt-4o-transcribe. In TTS, ElevenLabs grew to an $11B valuation and $500M ARR, while Kokoro (82M, Apache-2.0) and Chatterbox preserved self-hosting. Speech-to-speech Realtime APIs are now rewriting live conversation.

Video Generation Model Families: Sora Exits after a Two-year Arms Race Dominated by Veo 3.1, Kling 3.0, and Gen-4.5

Sora's February 2024 preview shocked the industry, but the landscape reversed in two and a half years: OpenAI closed the consumer Sora app in April 2026 and scheduled its API for retirement on September 24; Veo 3.1 became the narrative default with native audio and Flow; Kling 3.0 became a unified multimodal model with $240M annualized revenue; and Runway Gen-4.5 briefly led Artificial Analysis in a November 2025 snapshot while defending the professional market through enterprise workflows. This guide compares four families by generation, specifications, pricing, and use case.

When Search Returns Only 10 Results: Fixing CJK Recall in Cloudflare D1 FTS5 Hybrid Search

Querying “認證” returned only ~10 hits while 149 files (509 occurrences) matched; 41 posts and 76 chunks were found via LIKE, but D1 chunks_fts had 0 rows and unicode61/trigram both returned 0 for 2-char CJK terms. Fix: LIKE fallback with char-level OR first, then trigram migration + pnpm sync, then pagination beyond the hard limit of 12.

MiniMax: The Chat App Company That Built a Coding Model to Rival Frontier Labs

MiniMax started as a consumer chat app company, then M2.5 scored 80.2% on SWE-bench Verified at 1/10-1/20 the cost of Claude Opus; M3 (456B total / 45.9B active) became the first open-weight model to clear 59% on SWE-bench Pro, with 1M context powered by their novel Sparse Attention mechanism.

Nous Research: From Research Collective to Open-Source AI Ecosystem Rebel

Nous Research doesn't pretrain — they fine-tune and do RL. Hermes 4 scores 96.3% on MATH-500, NousCoder-14B improves Qwen3-14B's coding ability by 7% using only 24K training samples. But the real moat is Hermes Agent: 236K GitHub stars, #19 globally, 3,000 contributors.

Ornith: The Open-Source Coding Dark Horse Built on Self-Improvement RL

DeepReinforce's Ornith 1.5 family, trained with self-improvement RL: the 397B flagship scores 86.0 on SWE-bench Verified, matching Claude Opus 4.8; the 35B-A3B activates only 3B parameters per token yet leads every coding benchmark in its class; the 9B runs on phones. MIT-licensed, fully open-source.