2 comments

  • bookernath an hour ago

    Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.

  • badmonster0 20 minutes ago

    how does this compare with sglang