Meta: llama-3-8b-instruct:free

llama-3-8b-instruct:free
131.1K context512 outToolsStructured
Released Apr 18, 2024Knowledge cutoff 2023Updated Apr 18, 2024

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This is the base 8B pre-trained version. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Mode chatTokenizer Llama3Quantization int4meta-llama/Meta-Llama-3-8B-Instruct

Pricing

Input price
$0.00/ 1M tokens
Output price
$0.00/ 1M tokens
Context window 131.1K tokensCompatible endpoints openaiVendor Meta

Performance

Loading performance data...

Usage & Ranking

Loading usage...

Supported parameters

All providers = every upstream serving this model supports it. Some providers = depends on which upstream handles the request. Default = the value sent when you leave the parameter unset.

ParameterProvidersDefault
frequency_penaltyAll providers-
logit_biasAll providers-
max_tokensAll providers-
min_pAll providers-
presence_penaltyAll providers-
repetition_penaltyAll providers-
response_formatAll providers-
stopAll providers-
structured_outputsAll providers-
temperatureAll providers-
top_kAll providers-
top_pAll providers-

Frequently asked questions

Similar models