Llama

Llama 3.1 8B

meta-llama/Llama-3.1-8B

Create Deployment

Overview

Llama 3.1 8B is an instruction-tuned model built on Meta's Llama 3.1 architecture, featuring an optimized transformer design with 8 billion parameters. It incorporates Grouped-Query Attention (GQA) for improved inference efficiency and has been fine-tuned using SFT and RLHF for enhanced response accuracy. This model provides a balance of speed and performance, suitable for real-time conversational interfaces, content filtering, and data analysis applications with a 128K token context window.

Tags

CentML Optimized

Chat

Dedicated

LLM

API

Select a language: 
curl -X POST "https://api.centml.com/openai/v1/chat/completions" \
  -H "Authorization: Bearer *******************************************" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.1-8B",
    "messages": [{ "role": "system", "content": "You are a helpful assistant." }],
    "stream": false
  }'
from openai import OpenAI

client = OpenAI(
	api_key="*******************************************",
	base_url="https://api.centml.com/openai/v1"
)

completion = client.chat.completions.create(
    model="meta-llama/Llama-3.1-8B",
    messages=[{ "role": "system", "content": "You are a helpful assistant." }],
    stream=False,
)

print(completion.choices[0].message)
import OpenAI from "openai";

const client = new OpenAI(
	api_key="*******************************************",
	base_url="https://api.centml.com/openai/v1"
)

async function main() {
  const completion = await client.chat.completions.create({
    model: "meta-llama/Llama-3.1-8B",
    messages: [{ "role": "system", "content": "You are a helpful assistant." }],
    stream: false,
  });

  console.log(completion.choices[0])
}

main()