Skip to content
All categories

ai

1264 posts

Cross-Attention and DiT: How Conditions Enter a Denoiser | CMU 10-423 Lecture 14

A complete worked example and answered variations for Cross-Attention and DiT: How Conditions Enter a Denoiser.

Q-Former and Scaling Laws: Bridging Frozen Models, Allocating a Fixed Budget | CMU 10-423 Lecture 15

Trace Q-Former queries and two-stage training, then compute a model/data split under a fixed compute budget.

Mixture of Experts: Separating Capacity from Active Computation | CMU 10-423 Lecture 16

A complete worked example and answered variations for Mixture of Experts: Separating Capacity from Active Computation.

Distributed Training: Splitting Data, Models, and Optimizer State | CMU 10-423 Lecture 17

A complete worked example and answered variations for Distributed Training: Splitting Data, Models, and Optimizer State.

Efficient Inference: FlashAttention, KV Caches, and Speculative Decoding | CMU 10-423 Lecture 18

A complete worked example and answered variations for Efficient Inference: FlashAttention, KV Caches, and Speculative Decoding.

Long Context: Fitting Input Is Not Reliable Retrieval | CMU 10-423 Lecture 19

Long Context: Fitting Input Is Not Reliable Retrieval | CMU 10-423 Lecture 19

State Space Models: From Recurrence to Convolution | CMU 10-423 Lecture 21

State Space Models: From Recurrence to Convolution | CMU 10-423 Lecture 21

Generative AI Risks: Turning Failures into Tests | CMU 10-423 Lecture 22

Generative AI Risks: Turning Failures into Tests | CMU 10-423 Lecture 22

Audio Understanding and Generation: Samples to Text, Tokens Back to Sound | CMU 10-423 Lecture 24

Compute frames, mel bins, and WER, then account for codec tokens and contrast diffusion sampling.

Video Generation: Modeling the Time Axis | CMU 10-423 Lecture 25

Video Generation: Modeling the Time Axis | CMU 10-423 Lecture 25

World Models and Alignment Theory: Action Interventions and Corrigibility Assumptions | CMU 10-423 Lecture 26

Separate three world representations and evidence of action control, then examine consensus costs and corrigibility theorem conditions.

LoRA: What Changes When Most Weights Stay Frozen | CMU 10-423 Lecture 10

A complete worked example and answered variations for LoRA: What Changes When Most Weights Stay Frozen.

Practice Exam: Diagnose Conceptual Gaps | CMU 10-423 Topic Guide

Use the public practice exam to diagnose assumptions, data flow, and evaluation errors through a worked probability example.

Open-Ended Evolution: A Reading Guide | Stanford CS329A Lecture 7

Open-ended evolution changes agent code and workflows; archives preserve branches, while held-out tests assess generalization.

Software Engineering Agents: A Reading Guide | Stanford CS329A Lecture 13

Program candidates need requirement-based counterexamples; speed matters only after correctness checks pass.

Agent Memory: A Reading Guide | Stanford CS329A Lecture 14

Retrieval, trained KV representations, and cache reuse address different bottlenecks; speed does not guarantee freshness.

aideep-dive

Spotify Technology: Internal Developer Tools, Now Packaged as a Brand for Other Companies

On 2026-10-07 Spotify grouped Confidence, Portal, Xirp and its Backstage plugins under one brand, Spotify Technology. Its bet: once AI makes code cheap, judgment becomes the bottleneck and shared organizational context becomes the asset. Revenue is undisclosed; Confidence has public pricing and a free plan; Xirp is a macOS-only beta.

Test-Time Compute: Finding the Right Answer Among More Attempts | Stanford CS329A Lecture 2

More candidates increase the chance of a correct solution; credible selection turns that chance into delivered success.

Robust Verification: Checking Steps Before Trusting an Answer | Stanford CS329A Lecture 3

A correct final answer does not validate its derivation; step feedback locates errors, but verifiers still need checking.

Tool and Code Feedback: Changing the Next Action | Stanford CS329A Lecture 4

Observations, tests, and principle-based critique supply different signals; identify the signal before choosing revision or training.