Meta AI's Llama 2 70B Hf is a chat model capable of function calling, JSON mode, reasoning, streaming, and text generation, with a context window of 4,096 tokens. It is genuinely best at dialogue use cases, having been fine-tuned for such applications.
Input
Output
Context
4K
Max Output
-
Parameters
69B
Input Modalities
Output Modalities
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Automatically route workloads to the right model for every task, every time.