Llama 3.1 8B Instruct
ChatMeta-Llama-3.1-8B-Instruct-FP8
Llama 3.1 8B Instruct on FlexAI: Meta LLM, Llama 3.1 Community license, served via the OpenAI-compatible Token Factory at the live market-tracked rate.
Context
16K tokens
API endpoint
/v1/chat/completions
Compatibility
OpenAI
Parameters
8B
License
Llama 3.1 Community
Hardware
H100
Quantization
FP8
Estimate your monthly cost
M tokens
M tokens
10M × $0.018/M input$0.18
2M × $0.027/M output$0.05
Estimated monthly cost$0.23
Estimate only, at the current market-tracked rate. Usage-based; no minimums.
Get an API keyQuick Start
Meta-Llama-3.1-8B-Instruct-FP8
from openai import OpenAI
client = OpenAI(
base_url="https://tokens.flex.ai/v1",
api_key="your-api-key",
)
response = client.chat.completions.create(
model="Meta-Llama-3.1-8B-Instruct-FP8",
messages=[
{"role": "user", "content": "Hello!"}
],
)
print(response.choices[0].message.content)