Nvidia killer?

Happy Hump Day! Don’t forget to check out our latest newsletter, Maker Stacks. Today, we’re interviewing productivity content creator Francesco D’Alessio on his stack. 

Here’s some news: 

🍎 Ever wanted to run MacOS on a Gameboy? Someone did it. 

🚚 Uber is launching a new, robot-operated delivery service in Japan.

🤖 Barely a week after the latest Gemini models, Google has dropped two new LLMs.

Another AI company is lighting up the headlines, and its name is Groq. Not to be confused with Grok (Elon’s sassy AI chatbot), Groq creates AI chips called Language Processing Units (LPUs) which are apparently so fast, they are giving Nvidia’s GPUs a run for their money.

Groq is an “interface engine,” not a chatbot, and is built to help the likes of ChatGPT and Gemini run incredibly fast. 

According to the CEO, Jonathan Ross, who also founded Google’s AI chip division, Groq accomplishes this by bypassing two bottlenecks that GPUs and CPUs get stuck on: compute density and memory bandwidth. 

How fast is it? In a recent demo posted on X (formerly Twitter), Groq, when given a prompt, outputs a factually correct answer, coupled with sources to back it up, in a split second. There’s no loading animation and no wait times. If you still have your suspicions, you can check out Groq’s site, where you can test multiple LLMs on Groq’s LPU to see for yourself.

How does it compare? According to tests, Groq produces 247 tokens/second compared to Microsoft’s 18. In plain English, that means that theoretically, ChatGPT could run up to 14 times faster if it was built on top of Groq. So yeah, pretty fast. 

Over the past week, AI chips have been getting a lot of attention. Nvidia leap-frogged Amazon and Alphabet in market value because of its own chip building efforts . It’s a lucrative business for future tech. To put a tag on it, SoftBank CEO Masayoshi Son is seeking $100B in funding for his own AI chip venture.

• Talently launched an AI assistant that helps you prepare for your next job interview.
• buywith is a shopping assistant that lets you engage with brands and assistants. 
• Fusion Copilot uses AI to give you detailed insights into your day-to-day activities.

• Swizzle lets you build apps in your browser with natural language. 
• Jet Admin is a visual tool to build and ship your next website faster. 
• ChatSimple helps your customers find the parts of your business they need.