Skip to content
Meta

Llama 3.1 70B Instruct

Llama 3.1 70B Instruct introduced context of 131.1K tokens, eight-language multilingual support, and trained tool-use capability to the open 70B parameter class. This release defined Meta's approach to open frontier models. Your use subject to Meta's Terms & Privacy Policies.

Tool Use
Use with AI GatewayView docs
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.1-70b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ