Laguna-S-2.1-NVFP4 / generation_config.json
joerowell's picture
Promote RC2->main: 1M context + fused-MoE ignore regex for cross-engine load; card updates (SGLang NVFP4 note, sampling defers to generation_config, new-checkpoint note)
f8fdfcd verified
Raw History Blame Contribute Delete
479 Bytes
{
"bos_token_id": 2,
"do_sample": true,
"eos_token_id": [
2,
24
],
"pad_token_id": 9,
"temperature": 1.0,
"top_p": 1.0,
"min_p": 0.0,
"top_k": 20,
"tool_call_parser": "poolside_v1",
"reasoning_parser": "poolside_v1",
"default_chat_template_kwargs": {
"enable_thinking": true
},
"speculative_config": {
"method": "dflash",
"source": "huggingface",
"model": "poolside/Laguna-S-2.1-DFlash",
"num_speculative_tokens": 15
}
}