Compute Rental
Ctrl K

Guide

Using Huawei MindIE

GuideIntegrationsFAQSupport
PricingBlog
Quick StartTop-Up and BillingAccelerating Access to Academic ResourcesQuick StartIntroductionMaintenance and TroubleshootingNetwork
PlatformJetBrain ProjectorTmpWebCal Scholars Program @2026Introduction to the Public Beta/Suqian Zone AAbout UsCopying Data Between InstancesAnalysis of Server Performance MetricsTidal Computing PowerLoad Balancing
Domestic ChipsUsing Huawei MindIEHuawei Ascend NPUMooreThread GPU
Environment SetupCUDA/cuDNNMinicondaPython3.XInstalling DependenciesOverviewImages
Enterprise FeaturesFlexible DeploymentElastic Deployment Release NotesBest Practices for Elastic DeploymentPerformance Metrics Monitoring
Container InstancesJupyterLabRemote SSH ConnectionSave the imageScaling ConfigurationMulti-machine, multi-GPU parallel processingDaemonOverviewChange the billing methodMigration Example (Same Region)Migration ExamplesRemote DesktopReset the system
Choosing a GPUGPU SelectionPerformance Testing
DataUpload DataDownload DataPublic DataPublic Cloud Storage (Highly Recommended)Compression / DecompressionFile StorageLocal data diskOverview
Best PracticesFileZillaGitGromacsHuggingFaceKataGoLinux BasicsMPIOpenCLPyCharm Remote DevelopmentR (RStudio) InstallationSSH TunnelTensorBoardRemote Development with VSCodeVisdomVulkanXShellOpen PortsWeChat MessagesPerformanceExpose multiple servicesMoney-Saving TipsComputation Precision IssuesSoftware Sources

Domestic Chips

Using Huawei MindIE

07/30/202640771 views

First, select the PyTorch MindIE image based on your version requirements:

Then refer to Huawei’s documentation: Inference Service Deployment (DeepSeek-R1-Distill-Qwen-7B) - AI Service Deployment - Solution Deployment Guide - RAG Integrated Solution Reference Practice - Kunpeng RAG Development Documentation - Kunpeng Community

Huawei’s documentation streamlines the steps:

  1. Prepare the model

  2. Edit the /usr/local/Ascend/mindie/latest/mindie-service/conf/config.json file, primarily to modify the model paths and Device Index, among other things. It is also important to set the httpsEnabled field in the config file to false, as certificates are generally not used in this scenario.

  3. Load environment variables:

source /usr/local/Ascend/ascend-toolkit/set_env.sh
source /usr/local/Ascend/nnal/atb/set_env.sh
source /usr/local/Ascend/atb-models/set_env.sh
source /usr/local/Ascend/mindie/set_env.sh
source /usr/local/Ascend/mindie/latest/mindie-service/set_env.sh
  1. Start the service
cd /usr/local/Ascend/mindie/latest/mindie-service/bin
./mindieservice_daemon
Next articleTop-Up and Billing
Compute Rental DocsBack to Guide