Aleph-Alpha has released Kolibri-1, a large language model available on Hugging Face under the Apache 2.0 license.

  • The model contains 78 billion total parameters with 3.46 billion active parameters.
  • It supports a context window of up to 1 million tokens.
  • A technical report detailing the model's architecture and training is available from Aleph-Alpha.

The release provides an open-weight option for users requiring long-context capabilities.