Why we constructed the Safe AI Manufacturing unit
One 12 months in the past at NVIDIA GTC, Cisco and NVIDIA launched the Cisco Safe AI Manufacturing unit with NVIDIA. On the time, the problem for enterprises was clear: AI was transferring from science venture to strategic precedence, however the infrastructure and software program had been fragmented. Clients had been combating the complexity of standing up huge compute clusters for coaching, optimization, and inferencing, whereas making certain their knowledge remained safe and personal.
To unravel this, the Safe AI Manufacturing unit was constructed upon the muse of Cisco AI PODs, our modular reference structure primarily based on Cisco Validated Designs and NVIDIA Enterprise Reference Structure–compliant deployments. By integrating Cisco networking, compute, and companion storage with NVIDIA’s accelerated infrastructure, the full-stack AI POD permits enterprises to seamlessly deploy AI functions with enterprise-grade safety fused into the material. Embedded into every layer of the reference structure and wrapped round it’s the Cisco portfolio of safety and observability capabilities options. It gives companies with a dependable, safe, hardened path to coaching, optimization, and inferencing inside the core knowledge middle.
The rise of multi-agents all over the place
Within the final twelve months, the panorama of enterprise AI has shifted. We have now moved past easy generative AI chatbots and have now transitioned into the period of autonomous brokers that drive business-critical capabilities. The main driver immediately is the necessity to run these multi-agent techniques all over the place: within the core, within the cloud, and more and more, on the edge.
Nevertheless, this shift has revealed an enormous hurdle: Safety is presently the only greatest barrier to the enterprise adoption of AI brokers.
Not like a normal chatbot, an agent is autonomous; it has the facility to invoke APIs, entry knowledge lakes, and make selections, thus enabling groups to lower time to worth. These brokers depend on giant language fashions (LLMs) and small language fashions (SLMs) to supply reasoning context. If the mannequin offering that context is attacked or goes down, the affect is catastrophic:
- Compromised operational resolution making: If an agent managing warehouse logistics is hijacked via immediate injection, it might be manipulated to authorize incorrect delivery priorities or “ghost” stock, resulting in vital margin erosion and unfulfilled buyer orders.
- Essential workflow stagnation: In a high-velocity setting, if an edge mannequin goes down or its reasoning is corrupted, the automated course of stops. For a warehouse, this implies vehicles aren’t loaded and the provision chain grinds to a halt, straight impacting the quarterly backside line.
- Regulatory and compliance publicity: Brokers working on the edge usually deal with delicate knowledge. A safety breach that results in the exfiltration of personally identifiable info (PII) or proprietary predictive fashions can lead to huge regulatory fines and a everlasting lack of buyer belief.
Extending Safe AI Manufacturing unit throughout the core to the sting
To fulfill these challenges, Cisco is saying that it’s increasing Cisco Safe AI Manufacturing unit from the info middle to the sting, making certain safety follows the agent throughout the whole multi-agent spectrum.
With Cisco AI Protection, we offer a constant safety posture no matter location. Whether or not an agent is working a trillion-parameter LLM within the knowledge middle or a specialised SLM in a distant warehouse, Cisco ensures the mannequin is validated and the prompts are sanitized in actual time.
A brand new reference structure: Predicting stockouts for retail or manufacturing warehouses with Cisco Safe AI Manufacturing unit with NVIDIA and its ISV ecosystem
Whereas the Cisco AI POD gives a high-performance engine within the knowledge middle, a brand new problem for some organizations lies on the warehouse flooring. At GTC, we’re showcasing how a warehousing group can leverage Cisco and companion structure to seek out worth via visibility: understanding the precise second a stockout happens or a security hazard arises earlier than it impacts the morning shift. For IT, the problem is bridging the IT/OT hole by deploying and securing AI throughout tons of of distant websites with out making a administration nightmare. Extending visibility and operations from the core knowledge middle to the sting is about extra than simply {hardware}; it’s about getting the best intelligence to the best particular person, securely and at scale.
At GTC, we’re demonstrating this growth via a real-world answer extending the NVIDIA Multi-Agent Clever Warehouse blueprint. This demo showcases how specialised brokers can bridge the hole between IT and OT layers.
How the answer elements coordinate
The workflow begins on the edge, the place Vaidio acts because the “eyes” of the warehouse, monitoring video feeds for occasions like pallet stockouts. When a stockout or low inventory occasion is detected, Vaidio triggers a REST API name to an Aible agent working regionally on Cisco Unified Edge. This agent makes use of an SLM to supply fast reasoning context—deciding if a stockout is important sufficient to disrupt a pending cargo. If motion is required, the sting agent pings a core agent within the Cisco AI POD hosted within the knowledge middle, which queries the enterprise knowledge lake and LLM to calculate the income affect.
For the warehouse supervisor, this closes the IT/OT hole completely. As an alternative of manually cross-referencing spreadsheets or discovering empty cabinets too late, the supervisor has a 24/7 digital assistant that identifies issues, calculates the enterprise price, and triggers an expedited order robotically, eliminating “ghost stock” and conserving the provision chain transferring.
The answer structure
- Vaidio (the eyes): Working on Cisco Unified Edge nodes (3-4 nodes per website), Vaidio laptop imaginative and prescient containers make the most of NVIDIA L4 GPUs to watch the ground for stockouts or security hazards.
- Aible (the mind): An agentic platform orchestrating the workflow throughout the sting and core. When Vaidio detects a difficulty via a RESTful API, an Aible agent on the edge makes use of a neighborhood SLM (similar to Nemotron-3 Nano or Llama 3.3) to supply fast reasoning context.
- Cisco AI POD (the core): For heavy-duty predictive modeling, edge brokers talk again to the core AI POD (powered by NVIDIA GPUs). This core long-running agent powered by Aible understands methods to stability the affect of stockouts towards the price of expedited delivery, queries the warehouse knowledge lake to take the best selections primarily based on income affect and invoke delivery APIs.
- The deployment package deal: This answer runs Kubernetes 1.34 on Ubuntu 24.04 LTS with NVIDIA Driver 580.95.05 throughout each edge nodes and core AI POD infrastructure.
Cisco Intersight gives centralized AI server fleet administration throughout core and edge, delivering infrastructure lifecycle management, coverage consistency, configuration governance, and operational visibility throughout distributed AI environments.
This ensures the underlying compute platform stays constant, safe, and scalable, whereas utility and container orchestration function inside a validated, enterprise-ready infrastructure basis.
Cisco AI Protection and complete safety for AI brokers and functions
There’s a brand new actuality within the enterprise: multi-agent techniques. And Cisco is the one vendor that embeds safety into the material of the AI Manufacturing unit, defending every thing from the infrastructure to the brokers that dwell on it.
Cisco AI Protection gives a dual-layer protect from the info middle to the sting:
- Mannequin integrity and scanning: AI Protection scans the LLMs and SLMs via their uncovered APIs/endpoints. This identifies potential vulnerabilities in mannequin information and identifies the “AI Invoice of Supplies” (AI-BOM) to make sure provide chain integrity.
- Runtime guardrails: As brokers talk, AI Protection applies real-time insurance policies to sanitize prompts and responses. It detects immediate injections, prevents the technology of poisonous content material, and ensures that delicate knowledge—together with PII, PHI, and PCI—by no means leaves the safe setting.
- Platform safety: Cisco Unified Edge provides a bodily and firmware layer of safety, together with firmware roots of belief, locking bezels with intrusion detection, and Intel TDX/SGX for confidential computing.
The Aible distributed agent answer highlighted above advantages from all three layers of safety. It runs securely on Cisco Unified Edge and Cisco AI POD servers. The fashions utilized by it on the core and the sting are scanned by AI Protection. All language mannequin interactions of the brokers on the core and edge use the runtime guardrails by default.
The way forward for multi-agents all over the place
The transfer to multi-agent AI represents the subsequent industrial revolution of intelligence. By fixing the challenges of edge deployment and mannequin safety, Cisco helps prospects transfer previous the experimental section and into real-world manufacturing.
By bringing the NVIDIA Multi-Agent Clever Warehouse blueprint to life on Cisco structure, we’re lastly delivering the “chocolate” to either side of the enterprise. The Warehouse Supervisor positive aspects a 24/7 digital coordinator via Vaidio and Aible that automates important workflows and eliminates “ghost stock.” Concurrently, the IT worker positive aspects a safe, “drift-free” platform managed with Cisco Intersight and guarded by AI Protection. This isn’t only a technical achievement; it’s a production-ready answer that turns AI potential right into a aggressive benefit for the whole enterprise.
Keep tuned for our upcoming technical white paper, which is able to present a deep dive into the structure of the Safe Multi-Agent AI Manufacturing unit.
Able to speed up your time to worth? Contact your Cisco account consultant immediately to learn to lengthen your safe AI technique from the core to the sting or click on right here to be taught extra concerning the Cisco Safe AI Manufacturing unit with NVIDIA.
