Flora Ma

LLM inference & GPU systems

Projects

nano-vllm

TODO — one sentence on what it is and what was hard about it.

  • TODO — e.g. "Cut prefill latency 2.3x by batching prompts across requests."

Experience

TODO — Job Title · TODO — Company

TODO – Present

TODO

  • TODO — lead with the verb and end with the number.
  • TODO

Skills

Systems
TODO — CUDA, C++, ...
ML
TODO — PyTorch, ...
Tooling
TODO — Docker, ...

Education

TODO — Degree · TODO — Institution

TODO – TODO