Memory has grown to nearly two-thirds of AI chip component costs

Epoch AI analysis shows that memory now accounts for nearly two-thirds of AI chip component costs, up from roughly half in 2019. The increasing size of AI models drives demand for high-bandwidth memory like HBM, making it the dominant cost factor over compute logic.