Kimi's K2 Opensource Language Model Supports Dynamic Resource Availability and New Optimizer

InfoQ — AI, ML & Data EngineeringMonday, November 17, 2025 at 8:35:00 AM
Kimi's K2 Opensource Language Model Supports Dynamic Resource Availability and New Optimizer
  • Kimi has released K2, a large language model with significant capabilities, including 32 billion activated parameters and 1.04 trillion total parameters, trained on an extensive dataset of 15.5 trillion tokens. This model's introduction of the MuonClip optimizer aims to address training instability, marking a notable advancement in AI model training.
  • The launch of K2 is crucial for Kimi as it positions the company at the forefront of AI development, showcasing its commitment to innovation and enhancing the reliability of language models. The zero loss spike during pre
  • While there are no directly related articles, the emphasis on training stability and advanced optimization techniques aligns with ongoing trends in AI development, highlighting the industry's focus on improving model performance and reliability.
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it