Digital Technologies Research and Applications

Review

A Comprehensive Review of Memory Architectures and Network Interfaces and Advancements in High-Bandwidth and Low-Latency Systems

Rajeena, S., & Karimullah, S. (2026). A Comprehensive Review of Memory Architectures and Network Interfaces and Advancements in High-Bandwidth and Low-Latency Systems. Digital Technologies Research and Applications, 5(2), 63–74. https://doi.org/10.54963/dtra.v5i2.1745

Authors

  • Shaik Rajeena

    Department of Electronics and Communications, Annamacharya University, Rajampet 516115, India
  • Shaik Karimullah

    Department of Electronics and Communications, Annamacharya University, Rajampet 516115, India

Received: 22 October 2025; Revised: 5 December 2025; Accepted: 19 December 2025; Published: 15 April 2026

This review discusses the significant advances in the architecture of memory systems, the enhancement of which has been among the most significant concerns in the process of creating systems with high bandwidth and low latency requirements. It has analyzed various fields that include virtually pipelined systems, millimeter-wave interface, and enhanced memory controllers, which would meet the requirements of high-performance computing (HPC). Among all the developments put in place, die-stacked DRAM (Dynamic Random Access Memory) systems offer a high bandwidth boost with the networks-on-chip scalable and meant to address the issues of congestion and incoherence in interconnecting cores. The literature survey also identifies some of the major developments in the mechanism of passing messages and memory management optimizations in distributed systems that have been found to be critical towards useful data transfer and processing in massive parallel computer systems. The advanced multi-port memory controllers are also observed to improve the bandwidth and efficiency in utilizing the resources. The review, however, points out some of the challenges that are still there, including the limitation of scalability of the centralized memory system, the latency issues of high-radix interconnects and the integration problems of heterogeneous computing systems. The evaluation highlights the need for new ways to tackle the limitations of current memory management techniques. Research will center on the possibilities of using machine learning to anticipate workloads and applying adaptive hybrid memory allocators to allocate across memory types dynamically. The goal of these techniques is to increase performance, bandwidth, latency, and energy efficiency in high-performance computing systems.

Keywords:

Networks-on-Chip Optimized Memory Management Memory Controllers Die-Stacked DRAM Distributed Systems Latency Heterogeneous Computing Environments

References

  1. Agrawal, B.; Sherwood, T. High-bandwidth network memory system through virtual pipelines. IEEE ACM Trans. Netw. 2009, 17, 1029–1041. DOI: https://doi.org/10.1109/TNET.2008.2008646
  2. Wang, Q.; Guidotti, D.; Lin, F.; et al. Low latency high throughput memory-processor interface. In Proceedings of the 2012 IEEE 62nd Electronic Components and Technology Conference, San Diego, CA, USA, 29 May–1 June 2012. DOI: https://doi.org/10.1109/ECTC.2012.6249131
  3. Shao, M.H.; Zhao, R.T.; Liu, H.; et al. Challenges and recent advances in HfO2-based ferroelectric films for non-volatile memory applications. Chip 2024, 3, 100101.
  4. Lin, S.; Su, L.; Su, H.; et al. Design networks-on-chip with latency/bandwidth guarantees. IET Comput. Digit. Tech. 2009, 3. DOI: https://doi.org/10.1049/IET-CDT:20080036
  5. Cheriton, D.R.; Kutter, R.A. Optimized Memory-Based Messaging: Leveraging the Memory System for High-Performance Communication. Comput. Syst. 1996, 9, 179–215.
  6. Milton, J.; Zarkesh-Ha, P. Impacts of Topology and Bandwidth on Distributed Shared Memory Systems. Computers 2023, 12, 86. DOI: https://doi.org/10.3390/computers12040086
  7. Pandey, D.; Pandey, B.K.; Nassa, V.K.; et al. Optimized Throughput-Based Broadcasting for Next Generation Wireless Networks. In Emerging Engineering Technologies and Industrial Applications; IGI Global Scientific Publishing: Hershey, PA, USA, 2024. DOI: https://doi.org/10.4018/979-8-3693-1335-0.ch018
  8. Barthels, C.; Alonso, G.; Hoefler, T. Designing Databases for Future High-Performance Networks. IEEE Data Eng. Bull. 2017, 40, 15–26.
  9. Nguyen, X.-T.; Le, D.-H.; Bui, T.-T.; et al. A Flexible High-Bandwidth Low-Latency Multi-Port Memory Controller. Vietnam J. Sci. Technol. 2017, 56, 357–369. DOI: https://doi.org/10.15625/2525-2518/56/3/11103
  10. Benoit, A.; Perarnau, S.; Pottier, L.; et al. A Performance Model to Execute Workflows on High-Bandwidth-Memory Architectures. In Proceedings of the 47th International Conference on Parallel Processing, Eugene, OR, USA, 13–16 August 2018. DOI: https://doi.org/10.1145/3225058.3225110
  11. Fujiki, D.; Matsutani, H.; Koibuchi, M.; et al. Randomizing Packet Memory Networks for Low-Latency Processor-Memory Communication. In Proceedings of the 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP), Heraklion, Greece, 17–19 February 2016. DOI: https://doi.org/10.1109/PDP.2016.18
  12. Schulz, P.; Ong, L.; Abdullah, B.; et al. End-to-End Latency Distribution in Future Mobile Communication Networks. IEEE Access 2020. Available online: https://www.vodafone-chair.org/pbls/philipp-schulz/End-to-End_Latency_Distribution_in_Future_Mobile_Communication_Networks.pdf
  13. Cheema, S.S.; Shanker, N.; Hsu, C.H.; et al. One nanometer HfO₂‐based ferroelectric tunnel junctions on silicon. Adv. Electron. Mater. 2022, 8, 2100499.
  14. Setter, N.; Damjanovic, D.; Eng, L.; et al. Ferroelectric thin films: Review of materials, properties, and applications. J. Appl. Phys. 2006, 100, 051606.
  15. Santella, G.; Vatalaro, F. An approach to define Very High Capacity Networks with improved quality at an affordable cost. arXiv preprint 2020, arXiv:2011.03685. DOI: https://doi.org/10.48550/arXiv.2011.03685
  16. Li, S.; Huang, P.-C.; Banks, D.; et al. Low Latency, High Bisection-Bandwidth Networks for Exascale Memory Systems. In Proceedings of the Second International Symposium on Memory Systems, Alexandria, VA, USA, 3–6 October 2016; pp. 62–73. DOI: https://doi.org/10.1145/2989081.2989130
  17. Wertz, P.; Hespeler, B.; Kiessling, M.; et al. Next generation high data rate downlink subsystems based on a flexible APSK modulator applying SCCC encoding. In Proceedings of the 2016 International Workshop on Tracking, Telemetry and Command Systems for Space Applications (TTC), Noordwijk, The Netherlands, 13–16 September 2016.
  18. Hagendorf, O.; Pawletta, T. An approach for simulation based structure optimisation of discrete event systems. In Proceedings of the 2008 Spring Simulation Multiconference, Ottawa, ON, Canada, 14–17 April 2008; pp. 431–438.
  19. Hylton, A.; Raible, D.E.; Clark, G. On the Development and Application of High Data Rate Architecture (HiDRA) in Future Space Networks. In AIAA 2017-5415; American Institute of Aeronautics and Astronautics: Reston, VA, USA, 2017. DOI: https://doi.org/10.2514/6.2017-5415
  20. Agrawal, B.; Sherwood, T. Virtually pipelined network memory. In Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture, Orlando, FL, USA, 9–13 December 2006; pp. 197–207.
  21. Nikologiannis, A.; Katevenis, M. Efficient per-flow queueing in DRAM at OC-192 line rate using out-of-order execution techniques. In Proceedings of the IEEE International Conference on Communications, Helsinki, Finland, 11–14 June 2001; pp. 2048–2052.
  22. Iyer, S.; Kompella, R.R.; McKeown, N. Designing Packet Buffers for Router Linecards; Stanford University: Stanford, CA, USA, 2002.
  23. Garcia, J.; Corbal, J.; Cerda, L.; et al. Design and implementation of high-performance memory systems for future packet buffers. In Proceedings of the 36th Annual IEEE/ACM International Symposium on Microarchitecture, San Diego, CA, USA, 7–11 December 2003; pp. 372–384.
  24. Balusamy, B.; Abirami, R.N.; Kadry, S.; et al. Processing, Management Concepts, and Cloud Computing. In Big Data: Concepts, Technology, and Architecture; Wiley: Hoboken, NJ, USA, 2021; pp. 83–110.
  25. Kogge, P.; Bergman, K.; Borkar, S.; et al. Exascale Computing Study: Technology Challenges in Achieving Exascale Systems; DARPA IPTO: Arlington, VA, USA, 2008.
  26. Elnozahy, E.N.; Bianchini, R.; El-Ghazawi, T.; et al. System Resilience at Extreme Scale; DARPA IPTO: Arlington, VA, USA, 2008.
  27. Sarkar, V.; Amarasinghe, S.; Campbell, D.; et al. ExaScale Software Study: Software Challenges in Extreme Scale Systems; DARPA IPTO: Arlington, VA, USA, 2009.
  28. Jagasivamani, M. Resistive Ram Based Main-Memory Systems: Understanding the Opportunities, Limitations, and Tradeoffs. PhD Thesis, University of Maryland, College Park, MD, USA, 2020.
  29. Albutiu, M.-C.; Kemper, A.; Neumann, T. Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems. Proc. VLDB Endow. 2012, 5, 1064–1075.
  30. Alverson, B.; Froese, E.; Kaplan, L.; et al. Cray XC Series Network; Cray Inc.: 2012.
  31. Balkesen, C.; Teubner, J.; Alonso, G.; et al. Main-Memory Hash Joins on Modern Processor Architectures. IEEE Trans. Knowl. Data Eng. 2015, 27, 1754–1766.
  32. Zhou, X.; Chen, Y.; Kang, J. Recent progress in emerging non-volatile memories: Materials, devices, and applications. IEEE Trans. Electron Devices 2021, 68, 1023–1035.
  33. Raoux, S.; Wełnic, W.; Lelmini, D. Phase change materials and their application to nonvolatile memories. Chem Rev. 2010, 110, 240–267.
  34. Chen, A. ReRAM: History, status, and future. IEEE Trans. Electron Devices 2020, 67, 1420–1433.
  35. Zhou, Z.; Li, L.; Feng, Y.; et al. Advancing the frontiers of HfO₂-based ferroelectric memories: innovative concepts from materials to applications. Adv. Mater. 2025, 37, e09525. DOI: https://doi.org/10.1002/adma.202509525
  36. Imani, M.; Pampana, S.; Gupta, S.; et al. DUAL: Acceleration of Clustering Algorithms Using Digital-Based Processing In-Memory. In Proceedings of the 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), Athens, Greece, 17–21 October 2020; pp. 356–371. DOI: https://doi.org/10.1109/MICRO50266.2020.00039.
  37. Liao, J.; Dai, S.; Peng, R.C.; et al. HfO2-based ferroelectric thin film and memory device applications in the post-Moore era: A review. Fundam. Res. 2023, 3, 332–345. DOI: https://doi.org/10.1016/j.fmre.2023.02.010
  38. Lee, J.; Yang, K.; Kwon, J.Y.; et al. Role of oxygen vacancies in ferroelectric or resistive switching hafnium oxide. Nano Converg. 2023, 10, 55. DOI: https://doi.org/10.1186/s40580-023-00403-4
  39. Kanda, M.; Tokuda, T.; Fan, Q. 2025 IEEE Symposium on VLSI Technology and Circuits [Conference Reports]. IEEE Solid-State Circuits Mag. 2025, 17, 112–126. DOI: https://doi.org/10.1109/MSSC.2025.3611184
  40. Majumdar, S.; Zeimpekis, I. Back-End and Flexible Substrate Compatible Analog Ferroelectric Field-Effect Transistors for Accurate Online Training in Deep Neural Network Accelerators. Adv. Intell. Syst. 2023, 5, 2300391. DOI: https://doi.org/10.1002/aisy.202300391