Skip to content

vllm.tool_parsers.deepseekv4_tool_parser

DeepSeekV4ToolParser

Bases: DeepSeekV32ToolParser

DeepSeek V4 DSML tool parser.

V4 keeps the V3.2 DSML invoke/parameter grammar, but wraps tool calls in <｜DSML｜tool_calls> instead of <｜DSML｜function_calls>.

Source code in vllm/tool_parsers/deepseekv4_tool_parser.py 
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
class DeepSeekV4ToolParser(DeepSeekV32ToolParser):
    """
    DeepSeek V4 DSML tool parser.

    V4 keeps the V3.2 DSML invoke/parameter grammar, but wraps tool calls in
    ``<｜DSML｜tool_calls>`` instead of ``<｜DSML｜function_calls>``.
    """

    tool_call_start_token: str = "<｜DSML｜tool_calls>"
    tool_call_end_token: str = "</｜DSML｜tool_calls>"

    def get_structural_tag(self, request: ChatCompletionRequest):
        return get_model_structural_tag(
            model="deepseek_v4",
            tools=request.tools,
            tool_choice=request.tool_choice,
            reasoning=get_enable_structured_outputs_in_reasoning(),
        )