Flora Ma
Notes and analysis on LLM inference, GPU kernels, and systems engineering.
Recent posts
- 对照 Nano-vLLM 实现:读懂 vLLM 调度
先用轮次快照把 nano-vllm 的调度看透,再对照 vLLM V1 的 schedule(),讲清混批、chunked prefill、token 预算与抢占这几处关键分歧。
- Docker Tutorial
Docker concepts, everyday CLI commands, and its architecture — plus why reproducible containers matter for ML/DL work.
- Python Parallel and Concurrent Programming
Core concepts of parallel and concurrent programming — threads, processes, the GIL, synchronization primitives, and executor pools — and how they play out in Python.