Review
A Comprehensive Review of Memory Architectures and Network Interfaces and Advancements in High-Bandwidth and Low-Latency Systems


This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright
The authors shall retain the copyright of their work but allow the Publisher to publish, copy, distribute, and convey the work.
License
Digital Technologies Research and Applications (DTRA) publishes accepted manuscripts under Creative Commons Attribution 4.0 International (CC BY 4.0). Authors who submit their papers for publication by DTRA agree to have the CC BY 4.0 license applied to their work, and that anyone is allowed to reuse the article or part of it free of charge for any purpose, including commercial use. As long as the author and original source are properly cited, anyone may copy, redistribute, reuse, and transform the content.
Received: 22 October 2025; Revised: 5 December 2025; Accepted: 19 December 2025; Published: 15 April 2026
This review discusses the significant advances in the architecture of memory systems, the enhancement of which has been among the most significant concerns in the process of creating systems with high bandwidth and low latency requirements. It has analyzed various fields that include virtually pipelined systems, millimeter-wave interface, and enhanced memory controllers, which would meet the requirements of high-performance computing (HPC). Among all the developments put in place, die-stacked DRAM (Dynamic Random Access Memory) systems offer a high bandwidth boost with the networks-on-chip scalable and meant to address the issues of congestion and incoherence in interconnecting cores. The literature survey also identifies some of the major developments in the mechanism of passing messages and memory management optimizations in distributed systems that have been found to be critical towards useful data transfer and processing in massive parallel computer systems. The advanced multi-port memory controllers are also observed to improve the bandwidth and efficiency in utilizing the resources. The review, however, points out some of the challenges that are still there, including the limitation of scalability of the centralized memory system, the latency issues of high-radix interconnects and the integration problems of heterogeneous computing systems. The evaluation highlights the need for new ways to tackle the limitations of current memory management techniques. Research will center on the possibilities of using machine learning to anticipate workloads and applying adaptive hybrid memory allocators to allocate across memory types dynamically. The goal of these techniques is to increase performance, bandwidth, latency, and energy efficiency in high-performance computing systems.
Keywords:
Networks-on-Chip Optimized Memory Management Memory Controllers Die-Stacked DRAM Distributed Systems Latency Heterogeneous Computing EnvironmentsReferences
- Agrawal, B.; Sherwood, T. High-bandwidth network memory system through virtual pipelines. IEEE ACM Trans. Netw. 2009, 17, 1029–1041. DOI: https://doi.org/10.1109/TNET.2008.2008646
- Wang, Q.; Guidotti, D.; Lin, F.; et al. Low latency high throughput memory-processor interface. In Proceedings of the 2012 IEEE 62nd Electronic Components and Technology Conference, San Diego, CA, USA, 29 May–1 June 2012. DOI: https://doi.org/10.1109/ECTC.2012.6249131
- Shao, M.H.; Zhao, R.T.; Liu, H.; et al. Challenges and recent advances in HfO2-based ferroelectric films for non-volatile memory applications. Chip 2024, 3, 100101.
- Lin, S.; Su, L.; Su, H.; et al. Design networks-on-chip with latency/bandwidth guarantees. IET Comput. Digit. Tech. 2009, 3. DOI: https://doi.org/10.1049/IET-CDT:20080036
- Cheriton, D.R.; Kutter, R.A. Optimized Memory-Based Messaging: Leveraging the Memory System for High-Performance Communication. Comput. Syst. 1996, 9, 179–215.
- Milton, J.; Zarkesh-Ha, P. Impacts of Topology and Bandwidth on Distributed Shared Memory Systems. Computers 2023, 12, 86. DOI: https://doi.org/10.3390/computers12040086
- Pandey, D.; Pandey, B.K.; Nassa, V.K.; et al. Optimized Throughput-Based Broadcasting for Next Generation Wireless Networks. In Emerging Engineering Technologies and Industrial Applications; IGI Global Scientific Publishing: Hershey, PA, USA, 2024. DOI: https://doi.org/10.4018/979-8-3693-1335-0.ch018
- Barthels, C.; Alonso, G.; Hoefler, T. Designing Databases for Future High-Performance Networks. IEEE Data Eng. Bull. 2017, 40, 15–26.
- Nguyen, X.-T.; Le, D.-H.; Bui, T.-T.; et al. A Flexible High-Bandwidth Low-Latency Multi-Port Memory Controller. Vietnam J. Sci. Technol. 2017, 56, 357–369. DOI: https://doi.org/10.15625/2525-2518/56/3/11103
- Benoit, A.; Perarnau, S.; Pottier, L.; et al. A Performance Model to Execute Workflows on High-Bandwidth-Memory Architectures. In Proceedings of the 47th International Conference on Parallel Processing, Eugene, OR, USA, 13–16 August 2018. DOI: https://doi.org/10.1145/3225058.3225110
- Fujiki, D.; Matsutani, H.; Koibuchi, M.; et al. Randomizing Packet Memory Networks for Low-Latency Processor-Memory Communication. In Proceedings of the 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP), Heraklion, Greece, 17–19 February 2016. DOI: https://doi.org/10.1109/PDP.2016.18
- Schulz, P.; Ong, L.; Abdullah, B.; et al. End-to-End Latency Distribution in Future Mobile Communication Networks. IEEE Access 2020. Available online: https://www.vodafone-chair.org/pbls/philipp-schulz/End-to-End_Latency_Distribution_in_Future_Mobile_Communication_Networks.pdf
- Cheema, S.S.; Shanker, N.; Hsu, C.H.; et al. One nanometer HfO₂‐based ferroelectric tunnel junctions on silicon. Adv. Electron. Mater. 2022, 8, 2100499.
- Setter, N.; Damjanovic, D.; Eng, L.; et al. Ferroelectric thin films: Review of materials, properties, and applications. J. Appl. Phys. 2006, 100, 051606.
- Santella, G.; Vatalaro, F. An approach to define Very High Capacity Networks with improved quality at an affordable cost. arXiv preprint 2020, arXiv:2011.03685. DOI: https://doi.org/10.48550/arXiv.2011.03685
- Li, S.; Huang, P.-C.; Banks, D.; et al. Low Latency, High Bisection-Bandwidth Networks for Exascale Memory Systems. In Proceedings of the Second International Symposium on Memory Systems, Alexandria, VA, USA, 3–6 October 2016; pp. 62–73. DOI: https://doi.org/10.1145/2989081.2989130
- Wertz, P.; Hespeler, B.; Kiessling, M.; et al. Next generation high data rate downlink subsystems based on a flexible APSK modulator applying SCCC encoding. In Proceedings of the 2016 International Workshop on Tracking, Telemetry and Command Systems for Space Applications (TTC), Noordwijk, The Netherlands, 13–16 September 2016.
- Hagendorf, O.; Pawletta, T. An approach for simulation based structure optimisation of discrete event systems. In Proceedings of the 2008 Spring Simulation Multiconference, Ottawa, ON, Canada, 14–17 April 2008; pp. 431–438.
- Hylton, A.; Raible, D.E.; Clark, G. On the Development and Application of High Data Rate Architecture (HiDRA) in Future Space Networks. In AIAA 2017-5415; American Institute of Aeronautics and Astronautics: Reston, VA, USA, 2017. DOI: https://doi.org/10.2514/6.2017-5415
- Agrawal, B.; Sherwood, T. Virtually pipelined network memory. In Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture, Orlando, FL, USA, 9–13 December 2006; pp. 197–207.
- Nikologiannis, A.; Katevenis, M. Efficient per-flow queueing in DRAM at OC-192 line rate using out-of-order execution techniques. In Proceedings of the IEEE International Conference on Communications, Helsinki, Finland, 11–14 June 2001; pp. 2048–2052.
- Iyer, S.; Kompella, R.R.; McKeown, N. Designing Packet Buffers for Router Linecards; Stanford University: Stanford, CA, USA, 2002.
- Garcia, J.; Corbal, J.; Cerda, L.; et al. Design and implementation of high-performance memory systems for future packet buffers. In Proceedings of the 36th Annual IEEE/ACM International Symposium on Microarchitecture, San Diego, CA, USA, 7–11 December 2003; pp. 372–384.
- Balusamy, B.; Abirami, R.N.; Kadry, S.; et al. Processing, Management Concepts, and Cloud Computing. In Big Data: Concepts, Technology, and Architecture; Wiley: Hoboken, NJ, USA, 2021; pp. 83–110.
- Kogge, P.; Bergman, K.; Borkar, S.; et al. Exascale Computing Study: Technology Challenges in Achieving Exascale Systems; DARPA IPTO: Arlington, VA, USA, 2008.
- Elnozahy, E.N.; Bianchini, R.; El-Ghazawi, T.; et al. System Resilience at Extreme Scale; DARPA IPTO: Arlington, VA, USA, 2008.
- Sarkar, V.; Amarasinghe, S.; Campbell, D.; et al. ExaScale Software Study: Software Challenges in Extreme Scale Systems; DARPA IPTO: Arlington, VA, USA, 2009.
- Jagasivamani, M. Resistive Ram Based Main-Memory Systems: Understanding the Opportunities, Limitations, and Tradeoffs. PhD Thesis, University of Maryland, College Park, MD, USA, 2020.
- Albutiu, M.-C.; Kemper, A.; Neumann, T. Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems. Proc. VLDB Endow. 2012, 5, 1064–1075.
- Alverson, B.; Froese, E.; Kaplan, L.; et al. Cray XC Series Network; Cray Inc.: 2012.
- Balkesen, C.; Teubner, J.; Alonso, G.; et al. Main-Memory Hash Joins on Modern Processor Architectures. IEEE Trans. Knowl. Data Eng. 2015, 27, 1754–1766.
- Zhou, X.; Chen, Y.; Kang, J. Recent progress in emerging non-volatile memories: Materials, devices, and applications. IEEE Trans. Electron Devices 2021, 68, 1023–1035.
- Raoux, S.; Wełnic, W.; Lelmini, D. Phase change materials and their application to nonvolatile memories. Chem Rev. 2010, 110, 240–267.
- Chen, A. ReRAM: History, status, and future. IEEE Trans. Electron Devices 2020, 67, 1420–1433.
- Zhou, Z.; Li, L.; Feng, Y.; et al. Advancing the frontiers of HfO₂-based ferroelectric memories: innovative concepts from materials to applications. Adv. Mater. 2025, 37, e09525. DOI: https://doi.org/10.1002/adma.202509525
- Imani, M.; Pampana, S.; Gupta, S.; et al. DUAL: Acceleration of Clustering Algorithms Using Digital-Based Processing In-Memory. In Proceedings of the 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), Athens, Greece, 17–21 October 2020; pp. 356–371. DOI: https://doi.org/10.1109/MICRO50266.2020.00039.
- Liao, J.; Dai, S.; Peng, R.C.; et al. HfO2-based ferroelectric thin film and memory device applications in the post-Moore era: A review. Fundam. Res. 2023, 3, 332–345. DOI: https://doi.org/10.1016/j.fmre.2023.02.010
- Lee, J.; Yang, K.; Kwon, J.Y.; et al. Role of oxygen vacancies in ferroelectric or resistive switching hafnium oxide. Nano Converg. 2023, 10, 55. DOI: https://doi.org/10.1186/s40580-023-00403-4
- Kanda, M.; Tokuda, T.; Fan, Q. 2025 IEEE Symposium on VLSI Technology and Circuits [Conference Reports]. IEEE Solid-State Circuits Mag. 2025, 17, 112–126. DOI: https://doi.org/10.1109/MSSC.2025.3611184
- Majumdar, S.; Zeimpekis, I. Back-End and Flexible Substrate Compatible Analog Ferroelectric Field-Effect Transistors for Accurate Online Training in Deep Neural Network Accelerators. Adv. Intell. Syst. 2023, 5, 2300391. DOI: https://doi.org/10.1002/aisy.202300391

Download
