Vercel AI Gateway

Llama 3.1 8B Instruct

Name: Llama 3.1 8B Instruct
Brand: Vercel AI Gateway

Canonical ID: vercel/meta/llama-3.1-8b

More Vercel AI Gateway models More llama-3.1-8b family models

Open Llama instruction model for multilingual chat, reasoning, and coding

Reasoning: No Tool use: Yes

Overview

text

Provider: Vercel AI Gateway
Family: llama-3.1-8b
Release date: 2024-07-23
Last updated: 2024-07-23
Input modalities: text
Output modalities: text

Pricing and Limits

Token pricing

Input: $0.03/1M
Output: $0.05/1M
Cached input: N/A

Context and output

Context window: 131,072
Max output tokens: 16,384
Qualified ID: vercel/meta/llama-3.1-8b

Model Summary

Llama 3.1 8B Instruct is a model listing in the Vercel AI Gateway provider catalog. It is categorized under the llama-3.1-8b family.

The model supports text modalities across input/output paths. Reported context capacity is 131,072. Pricing is listed at $0.03/1M input and $0.05/1M output.

Llama 3.1 8B Instruct

Overview

Pricing and Limits

Token pricing

Context and output

Model Summary

More From Vercel AI Gateway

Apex

Arrow 2

Arrow 2 Telos

Beam 1.0

Beam 1.0 (Free)

Claude 3.5 Sonnet (2024-06-20)

Claude Fable 5

Claude Fable 5.1