Model API

Llama 3.1 8b Instant API

Llama 3.1 8b Instant API on Aiduct. Llama 3.1 8b Instant routed by the Aiduct API gateway. 131,072 token context. View model parameters, pricing and integration examples.

Try this model Get an API key

Model ID

llama-3.1-8b-instant

Provider

openrouter

Capability

chat

Status

Available

Pricing and limits

Pricing is not published for this model yet. Check the catalog for current availability.

Context length: 131,072

Use this model

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.AIDUCT_API_KEY,
  baseURL: "https://api.aiduct.ai/v1",
});

const response = await client.chat.completions.create({
  model: "llama-3.1-8b-instant",
  messages: [{ role: "user", content: "Say hello in one sentence." }],
});

Supported parameters

messagestemperaturetop_pmax_tokensstreamstoptoolstool_choiceresponse_formatuser

Related API pages

API referenceEndpoint docs, authentication, and examples.Pricing tableCompare every public model and billing unit.PlaygroundTest requests from the browser before integrating.