Oskyla 烹茶室 - NPU
type: channel
link: https://archive.frytea.com/tag/NPU/
items: openFuyao InferNex AI推理集成部署 310P(300I Pro) 环境问题记录及解决

openFuyao InferNex AI推理集成部署 310P(300I Pro) 环境问题记录及解决
type: item
date: 2026-04-13T16:53:36+08:00
description: AI推理集成部署（InferNex）是一个专为云原生环境下AI推理服务优化所设计的端到端集成部署方案。该方案基于Kubernetes Gateway API Inference Extension (GIE) 和主流LLM技术栈构建，通过Helm Chart将开源网关、智能路由、高性能推理后端、全局KVCache管理、扩缩容决策框架及推理可观测体系等核心加速模块无缝集成。它提供从请求接入、动态路由、推理执行到资源管理与监控的完整加速链路，旨在提升推理吞吐量并降低TTFT/TPOT时延，实现一站式的高效AI服务部署体验。相关的文档如下：https://gitcode.com/openFuyao/sig-ai-inference/blob/main/docs/zh/ai_inference_infernex/user_guide/ai_inference_infernex.md#%E5%AE%89%E8%A3%85https://gitcode.com/openFuyao/InferNex因为官方仅针对 910 做了验证，手头只有一张 310P ，理论上是可以跑起来，但是需要做一系列修改，本文记录部署遇到的各种问题及其解决方案。部署后有几个 pod 一直起不来：NAMESPACE NAME READY STATUS RESTARTS AGE ai-inference vllm-pd-2p1d-01-decode-54cc4c7579-5h62w 0/1 Pending 0 5d18h ai-inference vllm-pd-2p1d-01-decode-6cd64bc69c-7slqg 0/1 Init:0/2 0 5d ai-inference vllm-pd-2p1d-01-prefill-5c546dbcc-thmkd 0/1 Pending 0 5d18h ai-inference vllm-pd-2p1d-01-prefill-fd68f87cf-jjdlc 0/1 Pending 0 5d hccn 问题似乎是 hccn 找不到[root@master1 ~]# kubectl -n ai-inference describe pod vllm-pd-2p1d-01-decode-6cd64bc69c-7slqg Name: vllm-pd-2p1d-01-decode-6cd64bc69c-7slqg Namespace: ai-inference Priority: 0 Service Account: default Node: master1/10.17.30.131 Start Time: Tue, 07 Apr 2026 09:31:33 +0800 Labels: app.kubernetes.io/instance=infernex-vllm-pd-2p1d-01 app.kubernetes.io/name=inference-backend openfuyao.com/dpSize=1 openfuyao.com/engine=vllm openfuyao.com/model=qwen-qwen3-8b openfuyao.com/pdGroupID=qwen3-8b-pd-01 openfuyao.com/pdRole=decode openfuyao.com/ppSize=1 openfuyao.com/tpSize=1 pod-template-hash=6cd64bc69c Annotations: checksum/config: 476b32f01fc96ff2896aee7fce288cd2b58cdb2ac825d1a22518798806847a2c huawei.com/AscendReal: Ascend310P-0 huawei.com/kltDev: Ascend310P-0 Status: Pending IP: IPs: <none> Controlled By: ReplicaSet/vllm-pd-2p1d-01-decode-6cd64bc69c Init Containers: mooncake-config-init: Container ID: Image: hub.oepkgs.net/openfuyao/mikefarah/yq:4.50.1 Image ID: Port: <none> Host Port: <none> Command: /bin/sh -c Args: set -e CONFIG_PATH="/app/mooncake.json" mkdir -p "$(dirname "$CONFIG_PATH")" cat > /tmp/mo…