AHN GDN For Qwen 2.5 Instruct 7B
ByteDance's AHN GDN For Qwen 2.5 Instruct 7B is a chat model that excels at converting lossless memory into fixed-size compressed representations for efficient long-context modeling. It is notable for its Artificial Hippocampus Networks (AHNs) architecture, which continually compresses token information outside the sliding attention window into a compact memory representation.
Input
Output
Context
33K
Max Output
8K
Parameters
21.3M
Technical Specifications
Model TypeChat
Context Window32,768 tokens
Max Output Tokens8,192 tokens
Parameters21.3M
Release DateOct 8, 2025
Training CutoffJun 30, 2024
Licenseapache-2.0
Open SourceYes
Input Modalities
Text
Output Modalities
Text
Capabilities
Estimated GPU Requirements for AHN GDN For Qwen 2.5 Instruct 7B
Estimates based on INT8 quantization. Actual requirements vary by framework and configuration.
Related Tools
Data sourced from official provider APIs and documentation
Last updated: Jun 24, 2026
Start building with the right model.
Automatically route workloads to the right model for every task, every time.