Model Library Llama 3.1 8b Instruct
Llama 3.1 8b Instruct
Active
Provider: Meta

Llama 3.1 8b Instruct

model="llama-3.1-8b-instruct"

A high-performance, open-weight AI model optimized for seamless integration through the Helyx API.

Model Capabilities

Accepts (Input)

Text Generation

Generates (Output)

Text Responses

Quick Integration

Python (OpenAI SDK)
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://helyxai.space/v1/chat/completions",
    api_key=os.environ.get("HELYX_API_KEY")
)

response = client.chat.completions.create(
    model="llama-3.1-8b-instruct",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "How do I use this model?"}
    ],
    max_tokens=16384
)

print(response.choices[0].message.content)

Architecture

Context Window

16,384 tokens

Max Input

16,384

Max Output

16,384

Usage Allowances

Free Plan (Default)

500,000 tokens / day

Automatically resets every 24 hours.

Developer Plan

100,000,000 tokens / day

Market Pricing Equivalency

Input (per 1M) $0.1000
Output (per 1M) $0.2500
Your Cost: $0.00 (Via Free Quota)