Mistral AI
Mistral: Mixtral 8x22B Instruct
mistralai/mixtral-8x22b-instruct
Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding, and reasoning - large context length (64k) - fluency in English, French, Italian, German, and Spanish See benchmarks on the launch announcement here. #moe
/ 1M tokens
/ 1M tokens
tokens
Limits
Context
65,536
tokens
Max output
52,428
80% of the context window
Parameters
140,630,071,296
Model facts
Author
Mistral AI
Tokenizer
Mistral
Modality
Text + File -> Text
Instruction format
Mistral
License
Apache-2.0
Knowledge cutoff
2024-01-31
Created
Apr 17, 2024
Hugging Face
mistralai/Mixtral-8x22B-Instruct-v0.1
Default generation parameters
temperature
0.3
Publication status
Modalities
Generation controls
Capability scores
Better than 3% of models compared