Top

AI Chip Start-Ups – Can Domain-Specific Chips Impact Nvidia’s Dominance?

Modern AI requires a massive amount of processing power, especially when training LLM models. Today, the billions of trillions of calculations required are performed primarily by GPUs, whose parallel processing is well-suited for the task. No company has benefited more from this AI boom than Nvidia. Big tech companies and enterprises alike are fighting for access to its chips, which are well-suited for training and running advanced AI models.

For more than 10 years, Nvidia has built an almost unassailable lead in developing silicon that can perform complex AI tasks such as image, facial and speech recognition, as well as generating text for AI chatbots such as ChatGPT. It has achieved this dominance by recognizing the AI trend early on, adapting its chip hardware to suit those AI tasks and investing in its CUDA software ecosystem.

Nvidia keeps raising the bar. To maintain its leading position, the company now offers customers access to its specialized GPU-based computers, computing services and other tools on a “as-a-Service” basis. To all intents and purposes, this has turned Nvidia from being a chip vendor into a one-stop shop for AI development. However, there are two crucial factors that motivate Nvidia’s rivals, both established chip vendors and start-ups, and that is high pricing and the fear of vendor lock-in by its customers. Clearly, no company wants to be beholden to a dominant vendor and so more competition seems inevitable. The intense demand for AI services and the desire to diversify reliance on a single company are driving the ambitions of rival big chip vendors as well as numerous start-ups.

In 2017, Google’s Tensor Processing Unit (TPU), a chip designed specifically for Deep Learning. demonstrated that it was possible for new players to build domain-specific chips with better performance, lower power consumption and cost compared to Nvidia’s general-purpose GPUs. Now, the emergence of generative AI with its unique and heavy computational requirements presents new opportunities for domain-specific ASICs vendors.

Many AI chip start-ups believe that their new silicon innovations exceed Nvidia GPUs in performance and have a significantly lower power consumption since they have been designed specifically for the training and processing of deep neural networks.  However, achieving commercial success has  proven to be much more challenging, particularly with the explosion in foundation models that followed the launch of OpenAI’s ChatGPT. As a result, many start-ups have recently had to re-engineer their designs to handle the massive number of parameters needed for LLMs. Others have changed their business models to become service providers rather than chip vendors.

Counterpoint Research’s recent report AI Chip Start-Ups – Can Domain-Specific Chips Impact Nvidia’s Dominance?provides an overview of the AI chip start-up market and highlights the opportunities and challenges facing new players entering the burgeoning AI chip market.

Table of Contents

Introduction

Nvidia – A One Stop Ship for AI

The Compute Challenge

Established AI Chips Start-Ups

  • Cerebras
  • Groq
  • SambaNova
  • Tenstorrent

Emerging AI Chip Start-Ups

  • Rivos, Enflame Technology, Rain AI, etc.

Key Challenges for Start-Ups

  • Technical complexity
  • Funding difficulties
  • The Nvidia effect
  • Open Standards
  • Big Tech

Analyst Viewpoint

Related Posts

Gareth has been a technology analyst for over 20 years and has compiled research reports and market share/forecast studies on a range of topics, including wireless technologies, AI & computing, automotive, smartphone hardware, sensors and semiconductors, digital broadcasting and satellite communications.

Term of Use and Privacy Policy

Counterpoint Technology Market Research Limited

Registration

In order to access Counterpoint Technology Market Research Limited (Company or We hereafter) Web sites, you may be asked to complete a registration form. You are required to provide contact information which is used to enhance the user experience and determine whether you are a paid subscriber or not.
Personal Information When you register on we ask you for personal information. We use this information to provide you with the best advice and highest-quality service as well as with offers that we think are relevant to you. We may also contact you regarding a Web site problem or other customer service-related issues. We do not sell, share or rent personal information about you collected on Company Web sites.

How to unsubscribe and Termination

You may request to terminate your account or unsubscribe to any email subscriptions or mailing lists at any time. In accessing and using this Website, User agrees to comply with all applicable laws and agrees not to take any action that would compromise the security or viability of this Website. The Company may terminate User’s access to this Website at any time for any reason. The terms hereunder regarding Accuracy of Information and Third Party Rights shall survive termination.

Website Content and Copyright

This Website is the property of Counterpoint and is protected by international copyright law and conventions. We grant users the right to access and use the Website, so long as such use is for internal information purposes, and User does not alter, copy, disseminate, redistribute or republish any content or feature of this Website. User acknowledges that access to and use of this Website is subject to these TERMS OF USE and any expanded access or use must be approved in writing by the Company.
– Passwords are for user’s individual use
– Passwords may not be shared with others
– Users may not store documents in shared folders.
– Users may not redistribute documents to non-users unless otherwise stated in their contract terms.

Changes or Updates to the Website

The Company reserves the right to change, update or discontinue any aspect of this Website at any time without notice. Your continued use of the Website after any such change constitutes your agreement to these TERMS OF USE, as modified.
Accuracy of Information: While the information contained on this Website has been obtained from sources believed to be reliable, We disclaims all warranties as to the accuracy, completeness or adequacy of such information. User assumes sole responsibility for the use it makes of this Website to achieve his/her intended results.

Third Party Links: This Website may contain links to other third party websites, which are provided as additional resources for the convenience of Users. We do not endorse, sponsor or accept any responsibility for these third party websites, User agrees to direct any concerns relating to these third party websites to the relevant website administrator.

Cookies and Tracking

We may monitor how you use our Web sites. It is used solely for purposes of enabling us to provide you with a personalized Web site experience.
This data may also be used in the aggregate, to identify appropriate product offerings and subscription plans.
Cookies may be set in order to identify you and determine your access privileges. Cookies are simply identifiers. You have the ability to delete cookie files from your hard disk drive.