Aleph-Alpha has released Kolibri-1, a large language model available on Hugging Face under the Apache 2.0 license.
- The model contains 78 billion total parameters with 3.46 billion active parameters.
- It supports a context window of up to 1 million tokens.
- A technical report detailing the model's architecture and training is available from Aleph-Alpha.
The release provides an open-weight option for users requiring long-context capabilities.