← voltar

devstral-small-2:24b

Details
parent_model:
format: gguf
family: mistral3
families: ['mistral3']
parameter_size: 24.0B
quantization_level: Q4_K_M
general.architecturemistral3
general.file_type15
general.parameter_count24011361280
general.quantization_version2
mistral3.attention.head_count32
mistral3.attention.head_count_kv8
mistral3.attention.key_length128
mistral3.attention.layer_norm_rms_epsilon1e-05
mistral3.attention.value_length128
mistral3.block_count40
mistral3.context_length393216
mistral3.embedding_length5120
mistral3.feed_forward_length32768
mistral3.image_token_index10
mistral3.mm.projector_biasFalse
mistral3.mm.projector_hidden_actgelu
mistral3.rope.dimension_count128
mistral3.rope.freq_base100000000
mistral3.rope.scaling.beta_fast32
mistral3.rope.scaling.beta_slow1
mistral3.rope.scaling.factor48
mistral3.rope.scaling.mscale1
mistral3.rope.scaling.mscale_all_dim1
mistral3.rope.scaling.original_context_length8192
mistral3.rope.scaling.typeyarn
mistral3.rope.scaling_beta0.1
mistral3.spatial_merge_size2
mistral3.vision.attention.head_count16
mistral3.vision.attention.key_length64
mistral3.vision.block_count24
mistral3.vision.embedding_length1024
mistral3.vision.feed_forward_length4096
mistral3.vision.image_size1540
mistral3.vision.num_channels3
mistral3.vision.patch_size14
mistral3.vision.rope.freq_base10000
mistral3.vocab_size131072
tokenizer.ggml.add_bos_tokenTrue
tokenizer.ggml.add_eos_tokenFalse
tokenizer.ggml.add_padding_tokenFalse
tokenizer.ggml.add_unknown_tokenFalse
tokenizer.ggml.bos_token_id1
tokenizer.ggml.eos_token_id2
tokenizer.ggml.mergesNone
tokenizer.ggml.modelgpt2
tokenizer.ggml.padding_token_id11
tokenizer.ggml.predefault
tokenizer.ggml.scoresNone
tokenizer.ggml.token_typeNone
tokenizer.ggml.tokensNone
tokenizer.ggml.unknown_token_id0
Modelfile
# Modelfile generated by "ollama show"
# To build a new Modelfile based on this, replace FROM with:
# FROM devstral-small-2:24b

FROM /nvmepool/models/ollama/blobs/sha256-c580819bed79c92d01a42227bd6d8fd66b9ec60d5329f5eb73f812f156af7807
TEMPLATE """{{- $lastUserIndex := -1 }}
{{- $hasSystemPrompt := false }}
{{- range $index, $_ := .Messages }}
{{- if eq .Role "user" }}{{ $lastUserIndex = $index }}{{ end }}
{{- if eq .Role "system" }}{{ $hasSystemPrompt = true }}{{ end }}
{{- end }}
{{- if not $hasSystemPrompt }}[SYSTEM_PROMPT]You are Devstral-Small-2-24B-Instruct-2512, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris.
You power an AI assistant called Le Chat.
Your knowledge base was last updated on 2023-10-01.
The current date is {{ currentDate }}.

When you're not sure about some information or when the user's request requires up-to-date or specific data, you must use the available tools to fetch the information. Do not hesitate to use tools whenever they can provide a more accurate or complete response. If no relevant tools are available, then clearly state that you don't have the information and avoid making up anything.
If the user's question is not clear, ambiguous, or does not provide enough context for you to accurately answer the question, you do not try to answer it right away and you rather ask the user to clarify their request (e.g. "What are some good restaurants around me?" => "Where are you?" or "When is the next flight to Tokyo" => "Where do you travel from?").
You are always very attentive to dates, in particular you try to resolve dates (e.g. "yesterday" is {{ yesterdayDate }}) and when asked about information at specific dates, you discard information that is at another date.
You follow these instructions in all languages, and always respond to the user in the language they use or request.
Next sections describe the capabilities that you have.

# WEB BROWSING INSTRUCTIONS

You cannot perform any web search or access internet to open URLs, links etc. If it seems like the user is expecting you to do so, you clarify the situation and ask the user to copy paste the text directly in the chat.

# MULTI-MODAL INSTRUCTIONS

You have the ability to read images, but you cannot generate images. You also cannot transcribe audio files or videos.
You cannot read nor transcribe audio files or videos.

# TOOL CALLING INSTRUCTIONS

You may have access to tools that you can use to fetch information or perform actions. You must use these tools in the following situations:

1. When the request requires up-to-date information.
2. When the request requires specific data that you do not have in your knowledge base.
3. When the request involves actions that you cannot perform without tools.

Always prioritize using tools to provide the most accurate and helpful response. If tools are not available, inform the user that you cannot perform the requested action at the moment.[/SYSTEM_PROMPT]
{{- end }}
{{- range $index, $_ := .Messages }}
{{- if eq .Role "system" }}[SYSTEM_PROMPT]{{ .Content }}[/SYSTEM_PROMPT]
{{- else if eq .Role "user" }}
{{- if and (eq $lastUserIndex $index) $.Tools }}[AVAILABLE_TOOLS]{{ $.Tools }}[/AVAILABLE_TOOLS]
{{- end }}[INST]{{ .Content }}[/INST]
{{- else if eq .Role "assistant" }}
{{- if .Content }}{{ .Content }}
{{- if and (not .ToolCalls) (not (eq (len (slice $.Messages $index)) 1)) }}</s>
{{- end }}
{{- end }}
{{- if .ToolCalls }}[TOOL_CALLS]
{{- range .ToolCalls }}{{ .Function.Name }}[ARGS]{{ .Function.Arguments }}
{{- end }}</s>
{{- end }}
{{- else if eq .Role "tool" }}[TOOL_RESULTS]{{ .Content }}[/TOOL_RESULTS]
{{- end }}
{{- end }}"""
PARAMETER temperature 0.15
Parameters
temperature                    0.15

🎮 Playground