Key Growth Drivers in the AI Semiconductor Market
September 24, 2024
Note: We reveal investment insights through the quotes of top business leaders.
Key Takeaways
- Technological advancements in AI semiconductor design, driven by innovations in AI, compute power, and advanced semiconductor processes, are crucial for market growth.
- Robust demand for AI applications from major companies is fueling significant investments, particularly in emerging markets.
- Competitive dynamics emphasize the need for productivity improvements and innovation among key players like Intel, AMD, and NVIDIA to maintain market position.
- Supply chain resilience is essential to meet increasing demand and navigate industry volatility, highlighting the importance of strong supply chain management.
- Regulatory scrutiny and compliance challenges are shaping the landscape, necessitating strategic investments in manufacturing for national security and operational efficiency.
Technological advancements in AI semiconductor design
Technological advancements in AI semiconductor design are being driven by innovations in foundational technologies, such as AI and compute power (Intel), advanced semiconductor processes (TSMC), and significant growth in Neural Processing Units (Qualcomm). Generative AI is also accelerating capital and operational expenditures in the sector (AMD).
"Driving the shift are advancements in foundational technologies, including AI, semiconductor electronics, compute power and infrastructure solutions among others." --- (INTC, conference, 2024/06/12)
"TSMC ((TWSE: 2330, NYSE:TSM) today unveiled its newest semiconductor process, advanced packaging, and 3D IC technologies for powering the next generation of AI innovations with silicon leadership at the Company's 2024 North America Technology Symposium." --- (TSM, press release, 2024/04/24)
"Yeah, I think that's right. I mean, we've in my team anyway, we've had the thesis that for semiconductors, if you look at basically every single vertical of the economy, more capex and more opex go into computing and I think from my point of view, generative AI is just a massive accelerant of that and that's what we're seeing." --- (AMD, conference, 2024/05/29)
"Our sovereign AI opportunities continue to expand as countries recognize AI expertise and infrastructure at national imperatives for their society and industries. Japan's National Institute of Advanced Industrial Science and Technology is building its AI bridging cloud infrastructure 3.0 supercomputer with NVIDIA." --- (NVDA, earning call, 2025/02/04)
"Second, the NPU, it has been the largest area of silicon growth in those chips, so generation over generation, and one of the largest improvements has been the NPU for AI, and AI is driving a lot of silicon content in those devices because they expected computational capability to run those models." --- (QCOM, earning call, 2024/02/23)
Demand from AI applications and emerging markets
The demand for AI applications is robust, with companies like Alibaba, Amazon, IBM, Microsoft, and Google reporting significant investments and growth in AI-related services. This trend is driven by digital transformation and the need for advanced solutions, particularly in emerging markets.
"We're observing strong and sustained demand for AI products and solutions from our customers and are making significant investment to address this demand effectively." --- (BABA, earning call, 2025/Q1)
"which is adding to the number of companies moving their AI focus to AWS. We expect the combination of AWS' reaccelerating growth and high demand for gen AI to meaningfully increase year-over-year capital expenditures in 2024, which given the way the AWS business model works is a positive sign of the future growth." --- (AMZN, earning call, 2024/Q1)
"On demand, we continue to see and capitalize on solid demand in key areas around digital transformation, application modernization and Gen AI." --- (IBM, earning call, 2024/Q1)
"We continue to identify and evaluate opportunities to expand our datacenter locations and increase our server capacity to meet the evolving needs of our customers, particularly given the growing demand for AI services." --- (MSFT, sec filing, 2024/Q2)
"We've talked about how solutions like smart bidding use AI to predict future ad conversions and their value in helping businesses stay agile and responsive to rapid shifts in demand, and how products like Broad Match leverage LLMs to match ads to relevant searches and help advertisers respond to what millions of people are searching for." --- (GOOG, earning call, 2024/Q1)
Competitive landscape and investment trends
The competitive landscape in the AI semiconductor market is characterized by a focus on productivity improvements and innovation amidst rising competition. Companies like Intel and AMD emphasize ROI and cost structure enhancements, while NVIDIA is keenly aware of the need for continued innovation to maintain its market position.
"This will give you an opportunity to share the perspective to share the perspectives on navigating the rapidly evolving landscape and explore investment thesis." --- (INTC, conference, 2024/06/12)
"So we do think they are more and more not expanding, but more and more proof point from productivity improvement, people are getting return on investment to justify the market opportunity." --- (AMD, conference, 2024/06/05)
"I guess, Jensen, a bit of a longer-term question. I know Blackwell hasn't even launched yet, but obviously, investors are forward-looking and amidst rising potential competition from GPUs and custom ASICs, how are you thinking about NVIDIA's pace of innovation and your million-fold scaling over the last decade, truly impressive." --- (NVDA, earning call, 2025/Q1)
"And we kind of expect Q4 to run the similar trend. And as far to answer your second part, no, we don't guide – yet for fiscal ’25, but we do expect fiscal ’25 to continue to be strong, to show strong growth on our AI revenue. Vivek Arya: Thank you." --- (AVGO, earning call, 2024/Q3)
"We'll see meaningful ASP uplift as well as a more competitive cost structure, which will drive improved profitability." --- (INTC, event transcript, 2024/04/02)
Supply chain dynamics affecting semiconductor production
Supply chain dynamics in the semiconductor market are influenced by technological advancements, customer behavior, and the need for resilience. Key players emphasize the importance of a strong supply chain to meet demand and navigate industry volatility, highlighting risks from vertical integration and cyclical fluctuations.
"In this environment, the winners will be the equipment companies that can accelerate the pace of technology advancement while at the same time deliver innovations that disrupt the rising cost and complexity of semiconductor fabrication." --- (LRCX, earning call, 2024/Q1)
"If revenues derived from these customers or licensees decrease or the timing of such revenues fluctuates, our business and results of operations could be negatively affected ” and “ Our business, particularly our semiconductor business, may suffer as a result of our customers vertically integrating (i.e., developing their own integrated circuit products)." --- (QCOM, sec filing, 2024/Q1)
"It was an honor to welcome @KGawkowski to @Intel headquarters to discuss the importance of building a resilient, more sustainable, and secure semiconductor supply chain." --- (INTC, Twitter, 2024/07/02)
""A strong and scalable supply chain is essential to accelerating innovation, overcoming challenges and enabling our customers to meet increasing demand for next-generation chips," said Karthik Rammohan, group vice president and head of global operations, Lam Research." --- (LRCX, press release, 2024/09/23)
"The semiconductor industry is highly cyclical, volatile, subject to downturns and characterized by constant and rapid technological change, price erosion, evolving technical standards, frequent new product introductions, short product life cycles and fluctuations in product supply and demand." --- (QCOM, sec filing, 2024/Q1)
Regulatory impacts on the AI semiconductor market
Regulatory impacts on the AI semiconductor market are significant, with companies facing heightened scrutiny over compliance and due diligence, particularly in conflict zones. Investments in manufacturing are seen as crucial for national security, while stringent regulations in sectors like automotive create barriers to entry and increase operational costs.
"We are not requesting 100% traceability or diversion prevention. Yet peers in the semiconductor and broader tech field have agreed to take necessary steps to address the risks raised by this proposal.As long term shareowners, we are asking the company to commission a 3rd party report to better assess the escalating legal, regulatory and reputational risks by conducting heightened human rights and know your customer due diligence processes in Russia and Ukraine and across conflict affected and high risk areas to assess if products are misused in violation of international law. We therefore urge the shareholders to vote for its passage. Thank you." --- (TXN, event transcript, 2024/04/25)
"In addition, defects, errors or security vulnerabilities in our products could result in failure to achieve market acceptance, a loss of design wins, a shifting of business to our competitors, and litigation or regulatory action against us, and could harm our reputation, our relationships with customers and partners and our ability to attract new customers, as well as the perceptions of our brand." --- (QCOM, sec filing, 2024/Q2)
""By investing in semiconductor manufacturing, we are helping secure this vulnerable supply chain, boosting our national security and global competitiveness, and creating new jobs for Texans," said U.S. Sen. John Cornyn." --- (TXN, press release, 2024/08/16)
"The misappropriation, theft, misuse, disclosure, loss or destruction of the technology, intellectual property, or the proprietary, confidential or personal information, of us or our employees, customers, licensees, suppliers or other third parties, could harm our competitive position, reduce the value of our investment in research and development and other strategic initiatives, cause us to lose business, damage our reputation, subject us to legal or regulatory proceedings, cause us to incur other loss or liability and otherwise adversely affect our business." --- (QCOM, sec filing, 2024/Q2)
"For example, the automotive industry is subject to long design-in time frames, long product life cycles and a high degree of regulatory and safety requirements, necessitating suppliers to the industry to comply with stringent qualification processes, very low defect rates and high reliability standards, all of which results in significant barriers to entry and increased costs." --- (QCOM, sec filing, 2024/Q2)
Key players shaping the AI semiconductor landscape
Key players like AMD, Qualcomm, Intel, and Nvidia are shaping the AI semiconductor landscape through innovative solutions and technologies. AMD focuses on AI integration, Qualcomm advances 4G/5G for AI applications, Intel innovates across the AI spectrum, and Nvidia powers robotics advancements across various sectors.
"Doctor. Xu's influence extends beyond AMD. She has been a key advocate for the integration of AI across industries, emphasizing its transformative power.Her commitment to innovation and collaboration is evident in her leadership style, which focuses on the development of cutting edge solutions, while fostering an inclusive and forward looking company culture." --- (AMD, event transcript, 2024/06/03)
""We are dedicated to pushing the boundaries of innovation and providing cutting-edge 4G/5G semiconductor solutions that meet the advancing needs of AI-powered Internet of Things applications." --- (QCOM, press release, 2024/08/23)
""The magic of silicon is once again enabling exponential advancements in computing that will push the boundaries of human potential and power the global economy for years to come." More: Intel at Computex 2024 (Press Kit) Gelsinger continued, "Intel is one of the only companies in the world innovating across the full spectrum of the AI market opportunity – from semiconductor manufacturing to PC, network, edge and data center systems." --- (INTC, press release, 2024/06/03)
"Revealed at #COMPUTEX2024, robotics players like BYD Electronics, Siemens, Teradyne, and Intrinsic (an Alphabet company), are leveraging @NVIDIARobotics to advance AI-powered robots, transforming sectors like manufacturing, healthcare, and transportation." --- (NVDA, Twitter post, 2024/06/06)
"#AI is a key step in the assembly line. @EigenInnovation CRO Jonathan Weiss discusses how his team is using an Intel-supported AI system to improve quality, efficiency, and profitability for manufacturers without replacing current employees." --- (INTC, Twitter post, 2024/06/20)
Future trends in AI semiconductor innovation
Future trends in AI semiconductor innovation are characterized by a rapid pace of innovation, a shift towards ubiquitous AI, and the necessity for advanced GPUs to support transformative generative AI workloads. Companies like AMD, Nvidia, Intel, and Marvell are leading this charge, emphasizing collaboration and infrastructure enhancements to meet growing demands.
"So we're very pleased to continue to excel in the area of innovation. Yes. You mentioned that it's early innings, right, with AI adoption, but I guess how do you see that trending into the future and how do you think about that trajectory?" --- (AMD, conference, 2024/06/12)
"And the reason for that is very clear is because we need to accelerate workloads so that we can continue to be sustainable, continue to drive down the cost of computing so that when we do more computing our -- we don't experience computing inflation.Second, we need GPUs for a new computing model called generative AI that we can all acknowledge is going to be quite transformative to the future of computing." --- (NVDA, earning call, 2025/Q2)
"For the first time in this industry, we can envision the future will be the era of ubiquitous AI." --- (INTC, conference, 2024/06/04)
"It's an incredible pace of innovation and I couldn't be more excited about all of the work that we're going to do together in high performance and AI computing as an industry. So a very, very special thank you to all of our partners who joined us today, Microsoft, HP, ASUS, Lenovo and Stability dotai and especially thank you for all of our partners here in Taiwan and around the world." --- (AMD, event transcript, 2024/06/03)
"Marvell Technology, Inc. (NASDAQ:MRVL), a leader in data infrastructure semiconductor solutions, recently expanded its connectivity portfolio with the launch of the new Alaska® P PCIe retimer product line built to scale data center compute fabrics inside accelerated servers, general-purpose servers, CXL systems and disaggregated infrastructure. The first two products, 8- and 16-lane PCIe Gen 6 retimers, connect AI." --- (MRVL, press release, 2024/06/05)
Challenges facing AI semiconductor growth
The AI semiconductor market faces significant challenges, including sluggish demand in mature nodes, rising infrastructure costs, and the difficulties CIOs encounter in modernizing data centers. Despite some demand improvement, these factors hinder robust growth and unit expansion in the sector.
"the growth. Secondly, in enterprise, we actually start to see some demand improvement because today, all the CIOs in enterprise, they are actually facing a couple of challenges." --- (AMD, conference, 2024/05/21)
"We continue to face cost challenges, inflation cost challenges, including electricity prices, et cetera." --- (TSM, earning call, 2024/Q2)
"The challenges CIOs face in modernizing data centers to accommodate AI projects are unparalleled, especially with the rising demands on infrastructure and budgets." --- (AMD, twitter, 2024/08/05)
"First, the mature node demand remains sluggish because of a site. As we just announced it, the whole semiconductor industry is gradually recovering, but not fast enough." --- (TSM, earning call, 2024/Q1)
"Unit growth, not yet, okay? Because we did not see kind of unit growth suddenly increased, but we expect this AI functionality was stimulated some of the demand to stimulate the replacement to be shorter." --- (TSM, earning call, 2024/Q2)