Meta Llama 3 70B Instruct
meta-llama/llama-3-70b-instructMeta Llama 3 70B Instruct (meta-llama/llama-3-70b-instruct) is a llama 70.6B-parameter model from Meta Llama with a 8,192-token context window and 8,000 max output tokens, priced at $0.59/1M input and $0.79/1M output tokens. Available via the haimaker.ai OpenAI-compatible API.
Overview
Llama 3 70B Instruct is a chat model by Meta Llama. It has 70.6B parameters. It supports a 8K token context window.
Features & Capabilities
| Mode | chat |
| Context Window | 8,192 tokens |
| Max Output | 8,000 tokens |
| Function Calling | - |
| Vision | - |
| Reasoning | - |
| Web Search | - |
| Url Context | - |
Technical Details
| Architecture | LlamaForCausalLM |
| Model Type | llama |
| Base Model | meta-llama/Meta-Llama-3-70B |
| Languages | en |
| Library | transformers |
API Usage
from openai import OpenAI
client = OpenAI(
base_url="https://api.haimaker.ai/v1",
api_key="YOUR_API_KEY",
)
response = client.chat.completions.create(
model="meta-llama/llama-3-70b-instruct",
messages=[
{"role": "user", "content": "Hello, how are you?"}
],
)
print(response.choices[0].message.content)Frequently Asked Questions
What is the context window of Meta Llama 3 70B Instruct?
Meta Llama 3 70B Instruct (meta-llama/llama-3-70b-instruct) has a 8,192-token context window and supports up to 8,000 output tokens per request.
How much does Meta Llama 3 70B Instruct cost?
Meta Llama 3 70B Instruct is priced at $0.59 per 1M input tokens and $0.79 per 1M output tokens when accessed via the haimaker.ai OpenAI-compatible API.
How do I use Meta Llama 3 70B Instruct via API?
Send requests to https://api.haimaker.ai/v1/chat/completions with model "meta-llama/llama-3-70b-instruct" using any OpenAI-compatible SDK. Authentication uses a Bearer API key from https://app.haimaker.ai.
Use Meta Llama 3 70B Instruct with the haimaker API
OpenAI-compatible endpoint. Start building in minutes.