Mistral has released Mistral Large 4, a large language model featuring 1 trillion total parameters and 49 billion active parameters.

  • The model utilizes a Mixture of Experts architecture to achieve its scale.
  • Open weights for the model are scheduled to be released at the end of the month.

The release marks Mistral's return to the competitive landscape with a significantly larger parameter count compared to previous iterations.