Huawei has open-sourced the Flash variant of its OpenPangu 2.0 model series, which features a 512K context window. The release includes weights, inference code, and training operations for the model containing 92 billion total parameters with 6 billion active.

  • OpenPangu 2.0 Flash: 92B total, 6B active parameters.
  • OpenPangu 2.0 Pro: 505B total, 18B active parameters, scheduled for release in July.
  • More open-source components are planned for later this year.