Time to first token mathematical notation

Time to first token is a recurring research-paper notation family. Measures elapsed request time until the first generated output token becomes available, including prompt processing and scheduling.

Time to first token: Measures elapsed request time until the first generated output token becomes available, including prompt processing and scheduling. Example: Measure how long the user waits before generation visibly begins.