Skip to content

Applied Studies and Observations

An encyclopedia for the knowing ones.

100% Free
open access
1059
big ideas
88
subject pages
7
branches

Quick Access

AI Research

Architecture, training, and evaluation, for a research scientist

Full route
Staff Engineering

Systems, performance, and failure, for technical staff

Full route
Quant Research

Pricing, risk, and signal, for a systematic trading seat

Full route
Technical Advisory

Cost, supply, and regulation, for advising a decision

Full route

Directory

Introduction

Defines the scope, fixes the notation, names the terms of reuse.4 pages

Fundamentals

States what is true by construction, derives the machinery, writes the notation the field uses.20 pages
MathematicsVectors, matrices, derivatives, and probability, in the notation papers actually useTopology and GeometryDistance, shape, curvature, and why high-dimensional space stops being picturableStatisticsEstimation, inference, regression, and causality, plus how uncertain each number isStochastic ProcessesMarkov chains, state space models, volatility, and the behavior of tailsEconomicsSupply, demand, and cost curves, plus the incentive problems of asymmetric informationMacroeconomicsOutput, inflation, and cycles, and the schools that disagree about whySoftwareInterfaces, serialization, protocols, and the relational model every other page assumesData StructuresThe containers and their costs, what each makes cheap and quietly expensiveCompilers and RuntimesBetween the source you write and the instructions that actually runCryptographyGuarantees that hold against a deliberate adversary, and the assumptions beneathHardwareDies, memory hierarchies, interconnect, and why machine shape decides what is cheapOperating SystemsWhat the kernel does for you, and what it chargesDistributed SystemsMany machines presenting as one, and the consistency you trade for availabilityDatabasesHow data survives a crash, and what a query costsData EngineeringMoving data and keeping it trustworthy, through lineage, licensing, and schema contractsTraining DataThe training corpus, how it is filtered, and what synthetic data changesMachine LearningRegression, decision trees, gradient boosting, clustering, and Bayesian inferenceModelsHow a network is assembled, from token through embedding to attention blockTrainingHow a model acquires weights, by pretraining, fine-tuning, and preference optimizationInferenceWhat executes on a request, including the forward pass and decoding

Theory

Proves the results, carries the hypotheses each one needs, marks where they fail.12 pages

Application

Records what was built, prices what it cost, dates every claim.19 pages
RetrievalGiving a model facts it never trained on, by search and rerankingAgentsSystems choosing their next action, the tools they use, and recoverability boundsDiscoveryUsing models to prove theorems, and telling genuine results from plausible onesQuantitative TradingTurning a statistical edge into a position that survives transaction costsInterpretabilityReading what a trained network computes, and how much evidence holds upAlignmentMaking a system behave as intended, with measurable targets rather than hopeSimulationAnswering questions by running a system, when the mathematics will not closeRoboticsLearned control meeting contact, friction, and the cost of being wrongEngineering PracticeVersion control, testing, review, and release, which keep software changeableDeploymentServing a model to real traffic, with capacity, autoscaling, rollout, and failuresPerformance EngineeringMeasuring where time actually goes, and what optimization can possibly returnEvaluationKnowing whether a system works, through benchmarks, contamination, and statistical powerJudgment and Failed BetsHow the field decides under uncertainty, and what research taste actually isSecurityHow these systems are attacked, by prompt injection, poisoning, and extractionOpen SourceLicenses, stewardship, and dependency risk, including what open weights withholdGovernanceCopyright, regulation, and liability, plus the safety commitments labs actually signedSupply ChainThe physical path from sand to serving rack, and where it breaksCompute EconomyWho supplies compute, who buys it, and where the margin landsWhere the Field StandsCapability, compute, power, and economics as of September 2026

Appendix: General

Collects the terms, credits the work, indexes the named results.9 pages

Appendix: Interviews

Asks what the hard interviews test, shows the expected answer, times the work.6 pages

Appendix: Tangential Topics

Surveys the neighboring fields, preserves each vocabulary, connects them to the core.10 pages

Appendix: Whimsical Fun

Wagers on a probability estimate, settles it in cash, counts the cost of being wrong.8 pages