Meta: llama-3.1-8b:free

llama-3.1-8b:free
131.1K context128K outToolsStructured
Released Jul 23, 2024Knowledge cutoff 2023Updated Jul 23, 2024

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Mode chatTokenizer Llama3meta-llama/Meta-Llama-3.1-8B-Instruct

Pricing

Input price
$0.00/ 1M tokens
Output price
$0.00/ 1M tokens
Context window 128K tokensCompatible endpoints openaiVendor Meta

Performance

Loading performance data...

Usage & Ranking

Loading usage...

Supported parameters

All providers = every upstream serving this model supports it. Some providers = depends on which upstream handles the request. Default = the value sent when you leave the parameter unset.

ParameterProvidersDefault
frequency_penaltySome providers-
logit_biasSome providers-
logprobsSome providers-
max_tokensAll providers-
min_pSome providers-
presence_penaltySome providers-
repetition_penaltySome providers-
response_formatAll providers-
seedAll providers-
stopAll providers-
structured_outputsSome providers-
temperatureAll providers-
tool_choiceSome providers-
toolsSome providers-
top_kSome providers-
top_logprobsSome providers-
top_pAll providers-

Frequently asked questions

Similar models