Token throughput mathematical notation
Token throughput is a recurring research-paper notation family. Measures how many prompt or generated tokens a system processes per unit of wall-clock time at a stated load.
Token throughput: Measures how many prompt or generated tokens a system processes per unit of wall-clock time at a stated load. Example: Divide completed token work by how long it took.