Back to Benchmarks

gemma-7b-it

text-generation

Uploaded: 25.02.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

deepinfra

fireworks-ai

lepton-ai

together-ai

groq

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.07 $/1M tks

0.07 $/1M tks

61.72 tks/sec

670.99 ms

16.2 ms

4057.47 ms

0 sec

0.2 $/1M tks

0.2 $/1M tks

155.98 tks/sec

642.89 ms

6.41 ms

969.85 ms

0 sec

0.07 $/1M tks

0.07 $/1M tks

107.5 tks/sec

1102.42 ms

9.3 ms

1911.74 ms

0 sec

0.2 $/1M tks

0.2 $/1M tks

132.58 tks/sec

874.02 ms

7.54 ms

2110.97 ms

0 sec

0.07 $/1M tks

0.07 $/1M tks

220.83 tks/sec

775.26 ms

4.53 ms

834.13 ms

0 sec