Codestral Mamba

Following the publishing of the Mixtral family, Codestral Mamba is another step in our effort to study and provide new architectures. It is available for free use, modification, and distribution, and we hope it will open new perspectives in architecture research. Codestral Mamba was designed with help from Albert Gu and Tri Dao.
Codestral Mamba

Codestral Mamba Codestral Mamba represents a progression in studying and offering new architectures, following the Mixtral family’s release. This model is freely available for use, modification, and distribution, with the aspiration of fostering new avenues in architecture research. Its development involved contributions from Albert Gu and Tri Dao.

Write a comment
No comments yet.