> ## Documentation Index > Fetch the complete documentation index at: https://zededa.mintlify.site/llms.txt > Use this file to discover all available pages before exploring further. > ## Agent Instructions > Use the documentation index to find relevant pages, then read the linked Markdown before answering and cite the source URL. > Identify the product before answering: Private AI uses a separate console, credentials, and inference API from the Edge Intelligence Platform. Do not apply instructions from one product to the other. > Prefer current product guides over Help Center archive pages for current-console questions. Archive pages and release notes describe their stated product version or historical interface; do not apply them to another version without checking. > Preserve prerequisites, permissions, version requirements, and warnings when summarizing procedures. Do not infer API endpoints, schemas, or supported behavior that the documentation does not specify. # Edge Inference Services for Managing AI Model Lifecycles > ZEDEDA Edge Inference Services is an AI model operations platform for deploying and managing machine learning models on nodes at scale. ## Introduction > [!NOTE] > > Edge Inference Services is not yet available in production. The Inference tab currently shows a Coming Soon placeholder. This article describes the intended functionality. ZEDEDA Edge Inference Services is a platform for managing the complete lifecycle of AI and machine learning (ML) models deployed to nodes. It bridges the gap between model development and production deployment, so data scientists, ML engineers, and DevOps teams can collaborate on a unified system. Edge Inference Services integrates directly into the ZEDEDA console. You access it through the **Inference** tab alongside your other infrastructure management tools. ### Prerequisites * An active ZEDEDA user account with access to the Inference tab. * At least one node onboarded to Edge Infrastructure Services if you plan to deploy models. See [Onboard Nodes](https://zededa.mintlify.site/new-ui/infrastructure-services/nodes/onboard-nodes.md). ## How It Works Edge Inference Services works in three stages: bring in your models, validate them on real hardware, and deploy them to your fleet. **Manage models.** You import models into the platform through several methods: upload from a Jupyter Notebook using the ZEDEDA Edge AI SDK, import asynchronously from an external provider such as HuggingFace, MLflow, or S3-compatible storage, or upload model files directly through the console. Each model lives inside an organization, which is a logical container that groups models by team, project, or environment. **Evaluate and benchmark.** Before committing to a production deployment, you can benchmark a model on actual edge hardware using the Evaluation feature. The platform selects the appropriate inference engine automatically based on the target hardware (for example, OpenVINO for Intel x86 or Triton for NVIDIA Jetson) and returns metrics for latency, throughput, and resource usage. **Deploy at scale.** After validation, you deploy models to a ZEDEDA Edge Kubernetes Service cluster or cluster group. Each deployment is a GitOps deployment request that another user with approval rights in the organization must approve before the model deploys. Deployed models include a configurable application layer for RESTful API exposure and custom data processing logic. ## Key Capabilities * **Centralized model inventory.** Browse, search, filter, and version-control all ML models across your organizations in one place. * **Multi-source import.** Import models from Jupyter Notebooks, from external providers (Hugging Face, Azure ML, MLflow, Amazon S3, Azure Blob Storage, Amazon SageMaker, NVIDIA NGC, or Qualcomm AI Hub), or by direct file upload. * **Hardware-aware benchmarking.** Test model performance on real edge hardware before deployment to measure latency, throughput, and resource usage. * **Fleet-scale deployment.** Deploy models to ZEDEDA Edge Kubernetes Service clusters or cluster groups using GitOps workflows and approval gates. * **Organization-based access control.** Separate models by team, project, or environment using organizations, each with independent access control settings. * **ZEIA integration.** Use [ZEIA](https://zededa.mintlify.site/new-ui/edge-inference-services/zeia.md) to query fleet metrics, model status, and deployment health in plain language. ## Supported Hardware | Platform | Inference engine | | - | - | | Intel x86\_64 | OpenVINO, vLLM, Ollama | | NVIDIA Jetson | Triton Inference Server, vLLM, Ollama | | Qualcomm iQ9 | Triton Inference Server, Genie | ## In This Section * [Edge Inference Services Overview](https://zededa.mintlify.site/new-ui/edge-inference-services/overview.md) * [Inference Dashboard](https://zededa.mintlify.site/new-ui/edge-inference-services/inference-dashboard.md) * [Inference Quick Start](https://zededa.mintlify.site/new-ui/edge-inference-services/inference-quick-start.md) * [Access and Navigate Edge Inference Services](https://zededa.mintlify.site/new-ui/edge-inference-services/access-and-navigation.md) * [Organizations, Users, and Roles](https://zededa.mintlify.site/new-ui/edge-inference-services/organizations-users-and-roles.md) * [Manage Providers](https://zededa.mintlify.site/new-ui/edge-inference-services/inference-model-providers.md) * [Manage Providers Using Jupyter Notebook Integration](https://zededa.mintlify.site/new-ui/edge-inference-services/providers-jupyter.md) * [Manage Models](https://zededa.mintlify.site/new-ui/edge-inference-services/manage-inference-models.md) * [Manage Models Using Jupyter Notebook Integration](https://zededa.mintlify.site/new-ui/edge-inference-services/models-jupyter.md) * [Benchmark Models and Manage Device Pools](https://zededa.mintlify.site/new-ui/edge-inference-services/inference-model-benchmarking.md) * [Monitor Benchmark Runs and Interpret Results](https://zededa.mintlify.site/new-ui/edge-inference-services/use-ondevice-eval-agent.md) * [Submit Model Deployment Requests](https://zededa.mintlify.site/new-ui/edge-inference-services/submit-model-deployment-requests.md) * [Approve and Validate Models](https://zededa.mintlify.site/new-ui/edge-inference-services/deployments-and-validation.md) * [Monitor Inference Jobs](https://zededa.mintlify.site/new-ui/edge-inference-services/jobs-and-monitoring.md) * [Use ZEIA to Query and Operate Your Fleet](https://zededa.mintlify.site/new-ui/edge-inference-services/zeia.md) * [Use Prevalidated Agents](https://zededa.mintlify.site/new-ui/edge-inference-services/prevalidated-agents.md) * [Use the Faulty Printed Circuit Board Detection Agent](https://zededa.mintlify.site/new-ui/edge-inference-services/faulty-pcb-detection-agent.md) * [Use the Autonomous Retail Billing Agent](https://zededa.mintlify.site/new-ui/edge-inference-services/autonomous-retail-billing-agent.md) * [Inference Troubleshooting](https://zededa.mintlify.site/new-ui/edge-inference-services/inference-troubleshooting.md)