How Is Nvidia Managing Chip Smuggling?
Nvidia has developed new tools for data center operators to enhance their ability to monitor the location of their chips. These tools provide insights into the geographic location of chips by checking the time delay between a chip and Nvidia's servers.…
Nvidia has developed new tools for data center operators to enhance their ability to monitor the location of their chips. These tools provide insights into the geographic location of chips by checking the time delay between a chip and Nvidia's servers. This feature is designed to integrate with the existing confidential computing features of Nvidia's graphics processors and is yet to be officially released. The tool will be available as a customer-installed option, ensuring no external control over the machines running the software.
Nvidia announced a new service for customers managing large GPU fleets, aimed at tracking the health and inventory of AI chips through a centralized dashboard. This service analyzes telemetry data from each GPU, allowing customers to monitor various parameters such as power spikes, memory usage, interconnect health, and potential hotspots. Early detection of airflow issues and aging components is also facilitated, optimizing system performance and reducing energy waste and downtime.
The agent, which will be open source, is part of Nvidia's commitment to software transparency, enabling customers to audit the data collected. Customer-installed, the agent transmits read-only data to an Nvidia NGC-hosted portal.
Nvidia has developed new tools for data center operators to enhance their ability to monitor the location of their chips.
Nvidia has confirmed that it cannot remotely alter or disable its chips. The telemetry is sent to Nvidia NGC solely for viewing and reporting purposes, with no ability to send data back to the GPU or deactivate it. This setup allows customers to manage their systems independently, with the information remaining under their control. The tools will debut on Nvidia's Blackwell chips, featuring enhanced security capabilities, while options for older generations are being considered.
The United States government seeks to enhance oversight on the distribution of high-end AI chips, particularly concerning restricted regions such as China. Nvidia's verification service enables customers to confirm the approved locations of their chips, using timing checks to detect unauthorized use in grey-market data centers. This approach addresses demands for tighter safeguards without compromising customer control over hardware. The service is designed to assist data centers in maintaining operational efficiency while supporting regulatory compliance.
Based on reporting by techround.co.uk.
