gj.8SSKJr SSKrSSKrSSKrSSKrSSKJr SSKrS\R;a5\RRS\ "\"\ 5RS- 55 SSKrSSKJrJrJrJrJrJrJrJr S SjrS S jrSS jr\S :Xa\"5 gg)) annotationsN)Path NO_LOCAL_GGUFzgguf-py) ModelBase ModelTypeget_model_architectureget_model_classloggerprint_registered_models_mistral_common_installed_mistral_import_error_msgcURS5(a[USS5S-nOURS5(a[USS5S-S-nO^URS5(a[USS5S-S-S-nO0UR5(a [U5nO[SUS35eUS:a[SUS 35eU$) NKiMGzInvalid split size: z5, must be a number, optionally followed by K, M, or Grz, must be positive)endswithint isnumeric ValueError) split_strns convert_hf_to_gguf.pysplit_str_to_n_bytesrs#  #2 $ &   C  #2 $ & -   C  #2 $ & - 4       N/ {:opqq1u/ {:LMNN Hc$[R"SS9nURSSSS9 URS[SS 9 URS [/S QS S S9 URSSSS9 URS[SSS9 URSSSS9 URSSSS9 URS[SSS9 URSSSS9 URS[ SS S9 URS![S"S#S9 URS$SS%S9 URS&SS'S9 URS([S)S 9 URS*SS+S9 URS,SS-S9 URS.SS/S9 URS0SS1S9 URS2SS3S9 URS4SS5S9 URS6SS7S9 URS8SS9S9 URS:SS;S9 URS5 U$)?Nz5Convert a huggingface model to a GGML compatible file) descriptionz --vocab-only store_truezextract only the vocab)actionhelpz --outfilezSpath to write to; default: based on input. {ftype} will be replaced by the outtype.)typer!z --outtypef32f16bf16q8_0tq1_0tq2_0autor*zoutput format - use f32 for float32, f16 for float16, bf16 for bfloat16, q8_0 for Q8_0, tq1_0 or tq2_0 for ternary, and auto for the highest-fidelity 16-bit float type)r"choicesdefaultr!z --bigendianz'model is executed on big endian machinemodelzJdirectory containing model file or huggingface repository ID (if --remote)?)r"r!nargsz--use-temp-filez^use the tempfile library while processing (helpful when running out of memory, process killed)z --no-lazyz\use more RAM by computing all outputs before writing (use in case lazy evaluation is broken)z --model-namezname of the model)r"r,r!z --verbosezincrease output verbosityz--split-max-tensorsrzmax tensors in each splitz--split-max-size0zmax size per split N(M|G)z --dry-runzConly print out a split plan and exit, without writing any new filesz--no-tensor-first-splitz;do not add tensors to the first split (disabled by default)z --metadataz9Specify the path for an authorship metadata override filez--print-supported-modelszPrint the supported modelsz--remoteaq(Experimental) Read safetensors file remotely without downloading to disk. Config and tokenizer files will still be downloaded. To use this feature, you need to specify Hugging Face model repo name instead of a local directory. For example: 'HuggingFaceTB/SmolLM2-1.7B-Instruct'. Note: To access gated repo, set HF_TOKEN environment variable to your Hugging Face token.z--mmprojzExport multimodal projector (mmproj) for vision models. This will only work on some vision models. An 'mmproj-' prefix will be added to the output file name.z --code2wavzBExport the code2wav vocoder of a Qwen3-Omni model as its own GGUF.z--mtpzExport only the multi-token prediction (MTP) head as a separate GGUF, suitable for use as a speculative draft. An 'mtp-' prefix will be added to the output file name.z--no-mtpa?Exclude the multi-token prediction (MTP) head from the converted GGUF. Pair with --mtp on a second run to publish trunk and MTP as two files. Note: the split form duplicates embeddings, but even though the bundled default is more space-efficient overall, this allows differing quantization which may be more performant.z--mistral-formatz9Whether the model is stored following the Mistral format.z)--disable-mistral-community-chat-templateabWhether to disable usage of Mistral community chat templates. If set, use the Mistral official `mistral-common` library for tokenization and detokenization of Mistral models. Using `mistral-common` ensure correctness and zero-day support of tokenization for models converted from the Mistral format but requires to manually setup the tokenization server.z%--sentence-transformers-dense-moduleszWhether to include sentence-transformers dense modules. It can be used for sentence-transformers models, like google/embeddinggemma-300m. Default these modules are not included.z--fuse-gate-up-expszTFuse gate_exps and up_exps tensors into a single gate_up_exps tensor for MoE models.z+the following arguments are required: model) argparseArgumentParser add_argumentrstrr parse_argsprint_supported_modelsr-error)parserargss rr5r50s#  $ $KMF | % $ b #'_iow l 6 c Y  , m L k S$  L ( C ( c ( L R !, J 4 H "< ) <A <m \ Q  v <O < H 3L B / 8 l c    D  & &4::+= BC Krc[5nUR(a6[R"S5 [ 5 [ R "S5 UR(a#[R"[RS9 O"[R"[RS9 UR(adURnSSKJn /SQnUR (aUR#S5 U"UUS9n[%U5n[R&"SU35 OSn[%UR5nUR)5(d0[R"S US 35 [ R "S 5 [*R,R.[*R,R0[*R,R2[*R,R4[*R,R6[*R,R8[*R,R:S .nUR<S:=(d UR>S :gnUR@(a3U(a,[R"S5 [ R "S 5 URBb URBnO+U(a"[%SURESS5-S-5nOUn[R&"SURF35 URHn U (a[J(d[M[N5eURPn [RRT"5 X`RVn URX(a[ZR\O0UR^(a[ZR`O[ZRbn [dRf"XY5n U (dR[iX5n[R&"SU35 [kX[ZR\:HU [ZR`:HS9nOJURX(a"U RoS5cS5eSSK8J9n UnOSU ;a SSK:J;n UnOSSK:JURz(aS!UlBW"X[UURUR@URURURUR<[UR>5URURXUR URS"9nUR(aJ[R&"S#5 UR5 [R&"S$UR35 Oz[R&"S%5 UR5 U(a(URR[R3O URn[R&"S&U35 SSS5 g![la4 [R"SUS35 [ R "S 5 GNf=f!,(df  g=f)'NzSupported models:r)level)snapshot_download)LICENSEz*.jsonz*.mdz*.txtztokenizer.modelz *.safetensors)repo_idallow_patternsz#Downloaded config and tokenizer to zError: z is not a directoryrr#r0z*Error: Cannot use temp file when splittingz.//-z -{ftype}.ggufzLoading model: zModel architecture: )mmprojcode2wavzModel z is not supportedvision_encoderz&This model does not support multimodal) PixtralModelmoe)MistralMoeModel) MistralModelz)--mtp and --no-mtp are mutually exclusive)_Qwen35MtpMixinzG--mtp / --no-mtp are only supported for Qwen3.5/3.6 text variants todayT) is_big_endian use_temp_fileeagermetadata_override model_namesplit_max_tensorssplit_max_sizedry_runsmall_first_shardremote_hf_model_id'disable_mistral_community_chat_template#sentence_transformers_dense_modulesfuse_gate_up_expszExporting model vocab...z%Model vocab successfully exported to zExporting model...zModel successfully exported to )Rr5r6r r7r sysexitverboselogging basicConfigDEBUGINFOremoter-huggingface_hubr<rUappendrinfois_dirgguf LlamaFileTypeALL_F32 MOSTLY_F16 MOSTLY_BF16 MOSTLY_Q8_0 MOSTLY_TQ1_0 MOSTLY_TQ2_0GUESSEDrOrPrKoutfilereplacenamemistral_formatr ImportErrorrrTtorchinference_modeouttyperBrMMPROJrCCODE2WAVTEXTr load_hparamsr r NotImplementedErrorgetconversion.pixtralrEconversion.mistralrGrHmtpno_mtpconversion.qwenrI issubclassmtp_only bigendianno_lazymetadatarNrrQno_tensor_first_splitrV vocab_only write_vocab fname_outwriteparentossep)r9 hf_repo_idr<allowed_patterns local_dir dir_model ftype_mapis_splitris_mistral_formatrT output_type model_typehparamsmodel_architecture model_classrErGrHrImodel_instanceout_paths rmainrs   !!))!!,,""..""..##00##00""**0I%%)GT-@-@C-GH h AB   ||LL  2 23 <<NO   KK/)..!123++!:!:344.2.Z.Z+     - )-Y%%PTP]P]):L:Lclcqcq ((F !7!L  KK./A.BC D -.@XaXhXhJhuDMDVDVvVX [[;;/0< f>f f< 7&K g  :)K 7&K 88 LLD E HHQK 88t{{ 7k?;; fg {{%) "xx'+ $$YY37>>QUQcQc+/<<7;}}QUQ`Q`7;7M7M4HI\I\4]gkgsgs7;7Q7Q8BIMIqIq7;7M7M ' ?? KK2 3  & & ( KK?@X@X?YZ [ KK, -  "GO.2299:266(CUcUmUmH KK9(D Es '  v&8%99JKL   s2 B"[0-,Z/J [0/:[-)[0,[--[00 [>__main__)rr4returnr)rzargparse.Namespace)rNone) __future__rr1rZrrWpathlibrrqenvironpathinsertr4__file__rrc conversionrrr r r r r rrr5r__name__rrrs#  "**$HHOOAs4>009<=>     $odxFv zFr