
New AI Chip "Will Revolutionise ChatGPT", Claims Startup Founded By Harvard Dropouts
NDTV
'Sohu' claims to be 20 times faster in running transformers like ChatGPT than Nvidia's flagship- H100.
The reason why you are able to ask ChatGPT "how to eat a mango without spilling it" and much more is Nvidia's H100 and B200 Graphics Processing Units (GPUs). These magical chipsets that power AI chatbots have propelled Nvidia to become the frontrunners of the AI hardware industry, with market capitalization reaching the 3 trillion-dollar mark-more than Microsoft and Apple last month. Today we announced our $120M fundraise to bring Sohu to the world. Thanks @edludlow for hosting us! https://t.co/khzMPAofngpic.twitter.com/Q4SeuUjP2h
But now, a relatively young startup founded by two Harvard dropouts have set their eyes on their share of the AI hardware pie. Etched, the California based startup, is looking to disrupt the AI chipset market with their transformer ASIC (Application Specific Integrated Circuits) chip called Sohu.
Sohu claims to be 20 times faster in running transformers like ChatGPT than Nvidia's flagship- H100. The B200, which is the more powerful Nvidia offering than H100, is reportedly 10 times slower then Sohu, according to the claims made by the company based on emulation tests.
Sohu is taking an entirely different approach to providing high computational power to run billions of parameters (Variables that are used in training an AI Model) for transformer models. Unlike GPUs that can do multiple computationally heavy tasks (like rendering graphics in real time), Etched is choosing to create a specialised chip that caters to only transformer AI models - ones that run ChatGPT, Sora (OpenAI's text to video AI model) and Google's Gemini.