NVIDIA and Samsung develop a new type of memory for AI: SOCAMM
By ForGeeks NVIDIA has taken the lead in the AI gas pedal market. These chips require large amounts of high-speed memory, most of which is now supplied by SK Hynix, while Samsung continues to work on getting approval for its HBM3E chips.
In the meantime, both companies are in secret talks to commercialize a new type of AI memory, SOCAMM (System on Chip Advanced Memory Module), which is seen as an evolution of current high-bandwidth chips. NVIDIA is also in talks with SK Hynix about this memory.
NVIDIA is also in talks with SK Hynix about this memory.
SOCAMM prototypes in testing
SOCAMM prototypes are being actively shared between the companies and NVIDIA. This memory promises to be a significant step up from the existing high bandwidth chips that are now the basis for AI gas pedals.
And it’s a significant step up from the existing high bandwidth chips that are now the basis for AI gas pedals.
SOCAMM has improved cost-to-performance efficiency and is designed with more ports to help reduce processing bottlenecks, a pressing issue in AI computing.
SOCAMM is also designed with more ports to help reduce processing bottlenecks, a pressing issue in AI computing.
Benefits of SOCAMM
SOCAMM is a detachable module that allows data center operators to swap and upgrade memory modules to improve on-the-go performance. With its compact size, more SOCAMM modules can be installed in a single location for improved computing capabilities.
Industry insiders say NVIDIA and companies such as Samsung are working on SOCAMM prototypes and conducting performance tests, with mass production expected by the end of 2025.
And industry insiders say NVIDIA and companies such as Samsung are working on SOCAMM prototypes and conducting performance tests, with mass production expected by the end of 2025.
Samsung’s opportunities in the memory market
The development of SOCAMM could give Samsung a chance to regain lost ground in the high-bandwidth memory market, where SK Hynix currently leads. With the growing interest in AI chips, and with possible delays in the delivery of NVIDIA’s Blackwell gas pedals, Samsung is hoping to receive large orders for its memory chips.
Samsung’s development of SOCAMM could give it a chance to win large orders for its memory chips.
Problems with HBM3E and Samsung’s outlook
Samsung is facing problems getting approval for its HBM3E chips for NVIDIA gas pedals, despite an endorsement from NVIDIA CEO, Jensen Huang, at GTC 2024. However, despite the challenges, Huang expressed confidence that Samsung will overcome the hurdles and go to market with HBM3E, which could have an impact on securing large orders for future Blackwell platforms.
Huang said he is confident that Samsung will overcome the hurdles and go to market with HBM3E, which could have an impact on securing large orders for future Blackwell platforms.
Closure
The SOCAMM memory innovation talks between NVIDIA and Samsung could change the AI market and lead to more opportunities for Samsung, despite the current difficulties in getting approvals for HBM3E chips. This could be an important technology milestone for supercomputers and data centers using artificial intelligence in the coming years.
The article NVIDIA and Samsung Develop New Type of Memory for AI: SOCAMM was first published on ITZine.ru.
