Microsoft
WizardLM-2 8x22B
microsoft/wizardlm-2-8x22b
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is an instruct finetune of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). To read more about the model release, click here. #moe
Input
$0.62
/ 1M tokens
Output
$0.62
/ 1M tokens
Context window
65.54K
tokens
Limits
Context
65,535
tokens
Max output
8,000
12% of the context window
Model facts
Author
Microsoft
Tokenizer
Mistral
Modality
Text -> Text
Instruction format
Vicuna
Knowledge cutoff
2024-04-30
Created
Apr 16, 2024
Hugging Face
microsoft/WizardLM-2-8x22B
Publication status
Hugging Face: unavailableLicense: not publishedParameter count: not published
Modalities
Input · TextOutput · Text
Generation controls
Frequency penaltyMax tokensPresence penaltyRepetition penaltyResponse formatSeedStopTemperatureTop kTop p