Virtual pools and resources using distributed networked processing units
Abstract
Various approaches for deploying and using virtual pools of compute resources with the use of infrastructure processing units (IPUs) and similar networked processing units are disclosed. A host computing system may be configured to operate a virtual pool of resources, with operations including: identifying, at the host computing system, availability of a resource at the host computing system; transmitting, to a network infrastructure device, a notification that the resource at the host computing system is available for use in a virtual resource pool in the edge computing network; receiving a request for the resource in the virtual resource pool that is provided on behalf of a client computing system, based on the request being coordinated via the network infrastructure device and includes at least one quality of service (QoS) requirement; and servicing the request for the resource, based on the at least one QoS requirement.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . A method performed at a host computing system for operating a virtual pool of resources in an edge computing network, the method comprising:
identifying availability of a resource at the host computing system; transmitting, to a network infrastructure device, a notification that the resource at the host computing system is available for use in a virtual resource pool in the edge computing network; receiving a request for the resource in the virtual resource pool, the request provided on behalf of a client computing system, wherein the request is coordinated via the network infrastructure device, and wherein the request includes at least one quality of service (QoS) requirement; and servicing the request for the resource, based on the at least one QoS requirement.
2 . The method of claim 1 , wherein the resource is a physical resource located at the host computing system, wherein the physical resource is accessible via an interconnect, and wherein servicing the request includes providing access to the physical resource.
3 . The method of claim 2 , wherein the interconnect is a Compute Express Link (CXL) interconnect, and wherein the physical resource is a CXL device that is accessible via a CXL root complex.
4 . The method of claim 1 , wherein the resource is a virtual resource accessible via at least one local virtual function or at least one remote virtual function, and wherein servicing the request includes providing access to the virtual function.
5 . The method of claim 4 , wherein the virtual resource corresponds to a central processing unit (CPU) or hardware compute device.
6 . The method of claim 1 , wherein the request is coordinated via the network infrastructure device based on a capability for the virtual resource pool to meet the QoS requirement.
7 . The method of claim 1 , wherein the request is coordinated via the network infrastructure device based on at least one of: attestation of the resource, attestation of the request, or attestation of the client computing system.
8 . The method of claim 1 , further comprising:
verifying an attestation of the request for the resource or attestation of the client computing system, using a trusted attestation server.
9 . The method of claim 1 , wherein the request is coordinated via the network infrastructure device and provided to the host computing system based on network telemetry evaluated by the network infrastructure device.
10 . The method of claim 1 , wherein the network infrastructure device is a switch, gateway, or access point, that is located in a network connecting the host computing system and the client computing system.
11 . The method of claim 1 , wherein the method is performed by a networked processing unit at the host computing system, wherein the request for the resource originates from another networked processing unit at the client computing system, and wherein the networked processing unit or the another network processing unit utilize peer discovery logic to associate the respective units.
12 . A host computing system, comprising:
a networked processing unit accessible in an edge computing network; and a storage medium including instructions embodied thereon, wherein the instructions, which when executed by the networked processing unit, configure the networked processing unit to:
determine an availability of a resource at the host computing system;
transmit, to a network infrastructure device, a notification that the resource at the host computing system is available for use in a virtual resource pool in the edge computing network;
receive a request for the resource in the virtual resource pool, the request provided on behalf of a client computing system, wherein the request is coordinated via the network infrastructure device, and wherein the request includes at least one quality of service (QoS) requirement; and
cause the host computing system to service the request for the resource, using at least the resource at the host computing system, based on the at least one QoS requirement.
13 . The computing system of claim 12 , wherein the resource is a physical resource located at the host computing system, wherein the physical resource is accessible via an interconnect, and wherein causing the host computing system to service the request includes providing access to the physical resource.
14 . The computing system of claim 13 , wherein the interconnect is a Compute Express Link (CXL) interconnect, and wherein the physical resource is a CXL device that is accessible via a CXL root complex.
15 . The computing system of claim 12 , wherein the resource is a virtual resource accessible via at least one local virtual function or at least one remote virtual function, and wherein causing the host computing system to service the request includes providing access to the virtual function.
16 . The computing system of claim 15 , wherein the virtual resource corresponds to a central processing unit (CPU) or hardware compute device.
17 . The computing system of claim 12 , wherein the request is coordinated via the network infrastructure device based on a capability for the virtual resource pool to meet the QoS requirement.
18 . The computing system of claim 12 , wherein the request is coordinated via the network infrastructure device based on at least one of: attestation of the resource, attestation of the request, or attestation of the client computing system.
19 . The computing system of claim 12 , wherein the instructions further configure the networked processing unit to:
verify an attestation of the request for the resource or attestation of the client computing system, using a trusted attestation server.
20 . The computing system of claim 12 , wherein the request is coordinated via the network infrastructure device and provided to the host computing system based on network telemetry evaluated by the network infrastructure device.
21 . The computing system of claim 12 , wherein the network infrastructure device is a switch, gateway, or access point, that is located in a network connecting the host computing system and the client computing system.
22 . The computing system of claim 12 , wherein the request for the resource originates from another networked processing unit at the client computing system, and wherein the networked processing unit or the another network processing unit utilize peer discovery logic to associate the respective units.
23 . A non-transitory machine-readable storage medium comprising information representative of instructions, wherein the instructions, when executed by processing circuitry of a host computing system, cause the processing circuitry to:
cause the processing circuitry to determine whether a resource at the host computing system is available for use in a virtual resource pool in an edge computing network; cause the host computing system to transmit, to a network infrastructure device, a notification that the resource at the host computing system is available for use in the virtual resource pool; cause the host computing system to process a received request for the resource in the virtual resource pool, the request provided on behalf of a client computing system, wherein the request is coordinated via the network infrastructure device, and wherein the request includes at least one quality of service (QoS) requirement; and cause the processing circuitry to service the request for the resource, based on the at least one QoS requirement.
24 . The non-transitory machine-readable storage medium of claim 23 , wherein the resource is:
a physical resource located at the host computing system that is accessible via an interconnect; or a virtual resource accessible via at least one local virtual function or at least one remote virtual function.
25 . The non-transitory machine-readable storage medium of claim 23 , wherein the request is coordinated via the network infrastructure device based on at least one of:
a capability for the virtual resource pool to meet the QoS requirement; or attestation provided from attestation of the resource, attestation of the request, or attestation of the client computing system.Join the waitlist — get patent alerts
Track US2023136615A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.