Prepare and test your skills
Prepare and test your skills
Concept
Topic in 1 exam domain
Also called: Time Per Output Token, TPOT
A metric measuring inference generation latency per token produced by the model.
1 objective in 1 of 6 domains
Last updated