huggingface的权重可以直接推理吗

[A-transformer]

https://huggingface.co/jiachengcui888
PIXAR-13B

我也在阿布，可以直接用吗？ 推理直接用吗？ 需要多大显存

[Jiacheng8]

Hi, thanks for your interest in PIXAR!

Unfortunately, HuggingFace hosted inference is not supported for this model.

To run inference, you will need to deploy the model yourself on a machine with a sufficiently large GPU (≥ 30 GB VRAM recommended, e.g. RTX A6000).

Please refer to the Interactive Inference section in our README:

python chat.py \
  --version jiachengcui888/PIXAR-13B \
  --vision_pretrained <path_to_sam_vit_h.pth> \
  --precision bf16 \
  --seg_prompt_mode seg_only

Also check out the demo notebooks in the playground/ directory for step-by-step examples.

Feel free to continue in this issue if you run into problems during setup!