Memory queue handling techniques for reducing impact of high-latency memory operations

Abstract

Techniques for handling queuing of memory accesses prevent passing excessive requests that implicate a region of memory subject to a high latency memory operation, such as a memory refresh operation, memory scrubbing or an internal bus calibration event, to a re-order queue of a memory controller. The memory controller includes a queue for storing pending memory access requests, a re-order queue for receiving the requests, and a control logic implementing a queue controller that determines if there is a collision between a received request and an ongoing high-latency memory operation. If there is a collision, then transfer of the request to the re-order queue may be rejected outright, or a count of existing queued operations that collide with the high latency operation may be used to determine if queuing the new request will exceed a threshold number of such operations.

What is claimed is: 
     
         1 . A method of managing a queuing of access requests to one or more memory devices, the method comprising:
 receiving a memory access operation specifying an address;   queuing the memory access operation in a memory access queue, in which memory operations are queued according to the order in which they are received;   determining whether a high latency maintenance operation is being performed in a region of memory that includes the address;   responsive to determining that no high latency maintenance operation is being performed in the region of memory that includes the address, transferring the memory access operation to a re-order queue from which multiple pending memory operations are issued out-of-order; and   responsive to determining that a high latency maintenance operation is being performed in the region of memory, rejecting transferring the memory access operation to the re-order queue, whereby the transfer will be attempted at a subsequent time.   
     
     
         2 . The method of  claim 1 , further comprising responsive to determining that the re-order queue has an open entry, performing the determining whether the high latency maintenance operation is being performed, and only if no high latency memory operation is being performed in the region of memory, transferring the memory access operation to the re-order queue. 
     
     
         3 . The method of  claim 2 , wherein the determining further determines whether the re-order queue contains a threshold number of memory access operations specifying an address within the region of memory, and wherein the rejecting transferring the memory access operation is performed only if the re-order queue is full or the re-order queue already contains the threshold number of memory access operations specifying an address within the region of memory. 
     
     
         4 . The method of  claim 3 , wherein the threshold number of memory access operations is zero, wherein the transferring of any memory access operation specifying an address within the region of memory is rejected. 
     
     
         5 . The method of  claim 1 , wherein the high latency memory operation is a refresh operation. 
     
     
         6 . The method of  claim 1 , wherein the high latency memory operation is a bus calibration interval. 
     
     
         7 . The method of  claim 1 , wherein the determining further determines whether the re-order queue contains a threshold number of memory access operations specifying an address within the region of memory, and wherein the rejecting the transferring of the memory access operation is performed only if the re-order queue is full or the re-order queue already contains the threshold number of memory access operations specifying an address within the region of memory. 
     
     
         8 . The method of  claim 3 , wherein the threshold number of memory access operations is zero, wherein transfer of any memory access operation specifying an address within the region of memory is rejected. 
     
     
         9 . The method of  claim 1 , wherein the receiving a memory access operation is performed by a memory controller, and wherein the rejecting the transferring comprises issuing a retry operation response from a re-order queue controller. 
     
     
         10 . The method of  claim 9 , wherein the memory controller is integrated within a processor integrated circuit, and wherein the retry operation and the memory access operation are issued on an internal bus of the processor integrated circuit.