Hybrid Memory Cube Shows New Direction For High Performance Storage

April 12, 2013
The new Hyper Memory Cube standard looks to bring higher performance, higher capacity storage to servers and high end systems using 3D stacking and through silicon via's. It is designed to improved DRAM performance by a factor of 15.

Download this article in .PDF format
This file type includes high resolution graphics and schematics.

The final spec for the Hybrid Memory Cube (HMC) is done. Designed to improved DRAM performance by a factor of 15, the Hybrid Memory Cube Consortium (HMCC) standard specifies a high-speed, low-overhead memory protocol that targets the next generation of local storage for servers and networking devices. The architecture can employ 3D multilayer chips built using through silicon vias (TSV).

Related Articles

Memory layers typically are stacked on a logic layer that implements the HMC protocol. The first version of the standard supports up to eight memory layers with a maximum address space of 8 Gbytes. It also supports multiple cubes within a system to expand the amount of memory as well as the bandwidth available to the system (Fig. 1). These cubes are designed to replace the ubiquitous dual-inline memory module (DIMM) found in systems now.

The HMC specification defines two physical-layer (PHY) configurations: short reach and ultra-short reach. The short-reach configuration addresses runs up to 8 in. It consumes 6 jJ/bit and runs at 10 Gbits/s or 12.5 Gbit/s. The ultra-short-reach configuration is designed for runs under 3 in. It is energy optimized so it consumes only 1 to 2 pJ/bit. It runs at 10 Gbits/s. Both use a common packet protocol.

The cube includes 16 pairs of links. There are four channels with four links/channel. Each channel has a 40-Gbyte/s bandwidth or 160 Gbytes/s/cube. The packet protocol allows messages to be forwarded through adjacent cubes. This increases latency, though developers are already utilizing non-uniform memory access (NUMA) architectures with multichip, multicore configurations. Multilevel NUMA is more challenging from a software standpoint, but it offers significant advantages. The packet protocol also provides limited atomic operation support.

Figure 1. Hyper Memory Cube (HMC) storage uses high speed serial links. Modules can be linked together to provide more storage and bandwidth.

Stacking significantly reduces the footprint for memory. Switching to high-speed serial links reduces the number of connections and, along with linked cubes, greatly simplifies board layout. In theory, it would be possible to create a switch node without storage. Likewise, non-volatile memory could be added to the mix. For now, DRAM is where it’s at. HMCC has the support of the major players in storage and computing including Micron, Samsung, and Hynix.

The standard will have a major impact on adoption and interoperability. Initially single HMC designs will dominate but multicube solutions will be in high demand. Of all the emerging memory technologies, HMC is the one that will likely have the most impact in the long run.

Download this article in .PDF format
This file type includes high resolution graphics and schematics.
About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form. 

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below. 

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.  

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence. 

Sponsored Recommendations

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!