Skip to content

[Bug] 无法正确识别模型文件 #2100

Description

@vibe-Chen

Reminder

  • I have read the above rules and searched the existing issues.

System Info

Ubuntu 24.04
KTransformers 0.6.3(在系统盘上)
Deepseek-V4-Flash(在另一个物理固态硬盘上)

Reproduction

(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$ kt model verify Deepseek-V4-Flash

⚠ HuggingFace Connection Failed

  Cannot connect to https://huggingface.co

  Auto-switching to HuggingFace mirror: hf-mirror.com

ℹ Verifying: Deepseek-V4-Flash
  Repository: huggingface:deepseek-ai/deepseek-v4-flash
  Local path: /media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F

  ✓ Fetched 62 file hashes from remote

    Using 16 parallel workers for SHA256 calculation
  ✓ Calculated 46 local file hashes

✗ Verification failed! 16 file(s) have issues

  Total files: 62
  ✓ Passed: 46
  ✗ Failed: 16

  Failed files:
    ✗ config.json (missing)
    ✗ encoding/encoding_dsv4.py (missing)
    ✗ encoding/test_encoding_dsv4.py (missing)
    ✗ encoding/tests/test_input_1.json (missing)
    ✗ encoding/tests/test_input_2.json (missing)
    ✗ encoding/tests/test_input_3.json (missing)
    ✗ encoding/tests/test_input_4.json (missing)
    ✗ generation_config.json (missing)
    ✗ inference/config.json (missing)
    ✗ inference/convert.py (missing)
    ✗ inference/generate.py (missing)
    ✗ inference/kernel.py (missing)
    ✗ inference/model.py (missing)
    ✗ model.safetensors.index.json (missing)
    ✗ tokenizer.json (missing)
    ✗ tokenizer_config.json (missing)

Do you want to repair (re-download) the failed files? [y/n] (y): n
[WARNING] Field "span" in type "ir.TupleType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "span" in type "ir.FuncType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "span" in type "ir.TensorMapType" duplicates an ancestor field in "ir.Type". Child types should not re-register inherited fields.
[WARNING] Field "binding_blocks" in type "script.ir_builder.relax.FunctionFrame" duplicates an ancestor field in "script.ir_builder.relax.SeqExprFrame". Child types should not re-register inherited fields.
[WARNING] Field "output" in type "script.ir_builder.relax.FunctionFrame" duplicates an ancestor field in "script.ir_builder.relax.SeqExprFrame". Child types should not re-register inherited fields.
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.TupleType' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.FuncType' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'span' in 'ir.TensorMapType' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'name' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'tag' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'attrs' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'shape' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'dtype' in 'relax.TEPlaceholderOp' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
[WARNING] Field "policy_type" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
[WARNING] Field "m_warp" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
[WARNING] Field "n_warp" in type "tl.GemmSPWarpPolicy" duplicates an ancestor field in "tl.GemmWarpPolicy". Child types should not re-register inherited fields.
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'policy_type' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'm_warp' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/tvm_ffi/registry.py:85: UserWarning: Field 'n_warp' in 'tl.GemmSPWarpPolicy' duplicates an ancestor field. Child types should not re-register inherited fields.
  info = core._register_object_by_index(type_index, cls)
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glm_ocr: No module named 'transformers.models.glm_ocr'
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glm_ocr_nextn: No module named 'transformers.models.glm_ocr'
[2026-07-21 21:40:12] WARNING registry.py:107: In import_model_classes: Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/home/deepseeker/桌面/Deepseek_kt6/python/lib/python3.12/site-packages/transformers/__init__.py)

Select a MoE model to verify:

┏━━━━━━┳━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━┳━━━━━━━━━┳━━━━━━━━┓
┃    # ┃ 名称              ┃ Path    ┃   Total ┃ Exps ┃ Act ┃ 仓库    ┃ SHA256 ┃
┡━━━━━━╇━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━╇━━━━━━━━━╇━━━━━━━━┩
│    1 │ Deepseek-V4-Flash │ /media/ │   148.7 │ 256  │  6  │ hf:deep │   ✗    │
│      │                   │ deepsee │      GB │      │     │ seek-ai │        │
│      │                   │ ker/Lin │         │      │     │ /deepse │        │
│      │                   │ ux_Mode │         │      │     │ ek-v4-f │        │
│      │                   │ ling/De │         │      │     │ lash    │        │
│      │                   │ epseek/ │         │      │     │         │        │
│      │                   │ Model/D │         │      │     │         │        │
│      │                   │ eepseek │         │      │     │         │        │
│      │                   │ -V4F    │         │      │     │         │        │
└──────┴───────────────────┴─────────┴─────────┴──────┴─────┴─────────┴────────┘

SHA256 Status: ○ Not checked | ✓ Passed | ✗ Failed

q
(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$ ls
config.json                       model-00024-of-00046.safetensors
encoding                          model-00025-of-00046.safetensors
generation_config.json            model-00026-of-00046.safetensors
inference                         model-00027-of-00046.safetensors
model-00001-of-00046.safetensors  model-00028-of-00046.safetensors
model-00002-of-00046.safetensors  model-00029-of-00046.safetensors
model-00003-of-00046.safetensors  model-00030-of-00046.safetensors
model-00004-of-00046.safetensors  model-00031-of-00046.safetensors
model-00005-of-00046.safetensors  model-00032-of-00046.safetensors
model-00006-of-00046.safetensors  model-00033-of-00046.safetensors
model-00007-of-00046.safetensors  model-00034-of-00046.safetensors
model-00008-of-00046.safetensors  model-00035-of-00046.safetensors
model-00009-of-00046.safetensors  model-00036-of-00046.safetensors
model-00010-of-00046.safetensors  model-00037-of-00046.safetensors
model-00011-of-00046.safetensors  model-00038-of-00046.safetensors
model-00012-of-00046.safetensors  model-00039-of-00046.safetensors
model-00013-of-00046.safetensors  model-00040-of-00046.safetensors
model-00014-of-00046.safetensors  model-00041-of-00046.safetensors
model-00015-of-00046.safetensors  model-00042-of-00046.safetensors
model-00016-of-00046.safetensors  model-00043-of-00046.safetensors
model-00017-of-00046.safetensors  model-00044-of-00046.safetensors
model-00018-of-00046.safetensors  model-00045-of-00046.safetensors
model-00019-of-00046.safetensors  model-00046-of-00046.safetensors
model-00020-of-00046.safetensors  model.safetensors.index.json
model-00021-of-00046.safetensors  tokenizer_config.json
model-00022-of-00046.safetensors  tokenizer.json
(/home/deepseeker/桌面/Deepseek_kt6/python) deepseeker@Fishbowl:/media/deepseeker/Linux_Modeling/Deepseek/Model/Deepseek-V4F$

Others

被KT标记为“丢失”的文件实际上已经存在于文件系统中,而尝试修复会从HF上重新下载这些文件,并准确无误地放回原位;随后又会被标记为“不匹配”或“丢失”。这似乎是没有正确配置路径所导致的。

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions