Update inference/README.md

This commit is contained in:
Xingkai Yu
2025-09-29 01:52:07 +00:00
committed by system
parent 74b7f117dc
commit 19510d6dc6

View File

@@ -9,5 +9,5 @@ python convert.py --hf-ckpt-path ${HF_CKPT_PATH} --save-path ${SAVE_PATH} --n-ex
Then chat with DeepSeek model at will!
```bash
export CONFIG=config_671B_v3.1.json
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive --temperature {T}
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive
```