Inside TensorPlay: Finding a Kernel
How a + b reaches real instructions: two YAML contracts, one code generator, and a lock-free dispatcher that routes each operator to its kernel.
How a + b reaches real instructions: two YAML contracts, one code generator, and a lock-free dispatcher that routes each operator to its kernel.
How TensorPlay builds a tensor across DataPtr, Storage, TensorImpl, and Tensor: the move-only deleter, caching allocator, version guard, and zero-copy views.
References for the whole chapter, plus appendices: a source-code index, measurement scripts, and worked solutions for selected exercises.
Content-addressed caching, parallel compilation, fallback semantics, design comparisons against PyTorch 2 and XLA, measurement models, exercises, and labs.
GPU execution and Triton programming models, reduction kernels, multi-reduction fusion, launch configurations, epilogue fusion, and CUDA Graphs.