Groq · Indexed content

BlogSearchPartnershipGroq Among the First to Bring NVIDIA Groq 3 LPX and Vera Rubin NVL72 to MarketAugust 24, 2026FundraisingGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudAugust 17, 2026PartnershipGroq Becomes an NVIDIA Cloud PartnerAugust 12, 2026FundraisingGroq Raises $650M to Scale Its AI Inference Cloud BusinessJune 22, 2026PlatformGroqCloud: Expanding to Meet Demand February 16, 2026PartnershipGroq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale December 24, 2025PartnershipGroq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure December 18, 2025CompanyGroq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceNovember 17, 2025PartnershipGroq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNovember 5, 2025PartnershipGroq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseOctober 28, 2025PartnershipGroq Partners with Aljammaz Technologies to Power AI Inference Across MENAOctober 17, 2025PartnershipMcLaren Racing announces Groq…

From siliconto cloudGroq delivers fast, reliable inference close to users around the world.More than five million developers and thousands of AI-native companies run trillions of tokens on Groq each week.Now we're building the premier neocloud for inference in one integrated stack anchored by bare-metal infrastructure, which powers production-ready inference, with robust enterprise governance and control.Hard-woninferenceexpertiseGroq’s leaders took the LPU from silicon to a global production cloud, bringing together inference operations, hyperscale infrastructure, and enterprise software.CEOAdam WinterAdam Winter is Chief Executive Officer of Groq, where he leads the company’s expansion as a global AI infrastructure business focused on inference at scale. Groq operates data centers across North America, Europe, the Middle East and Asia-Pacific. Over a 30-year career in technology, Adam has worked through two defining platform shifts: the rise of the internet and now artificial intelligence. He spent more than a decade at Cisco during the internet’s transformation of enterprise technology, before going on to build and scale businesses across cloud, cybersecurity and AI. Adam joined…

GroqPlatformBuild your perfect stack. GroqMetal provides infrastructure, GroqCore adds inference, and GroqAssured adds enterprise controls. Each includes the layers below.Start BuildingInfrastructureGroqMetalDedicated bare-metal infrastructure, tuned for speed and reliability, with full control in your hands.InferenceGroqCoreA tested inference stack that turns dedicated capacity into production-ready performance, no infrastructure expertise required.ControlGroqAssuredEnterprise-grade governance, auditability, and control layered on top, so scale never comes at the cost of trust.256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference computeLPXGroq operates fast, reliable inference at massive scale with fine-grained control.When released, each NVIDIA Groq 3 LPX rack connects 256 next-generation LPU accelerators to NVIDIA’s Vera Rubin to deliver low-latency, large-context in…

Termsand policiesTerms of Use>Privacy Policy>Cookie Policy>Security>Trademark Policy>Photography & Filming Policy>Recruitment Fraud Awareness>

Contact usPut AIto work

Every customer served.Every product sold.Every commit merged.Every agent task completed.That’s inference.Training creates the possibility.Inference creates the value.The more we ask of AI, the more inference it takes.And inference is becoming the bottleneck.Groq was built for this.We pioneered the LPU.Now, with LPX, it works alongside NVIDIA’s next-generation GPUs to deliver unparalleled inference capability, reliably, affordably, at scale.Fast or affordable is no longer a tradeoff.We’re building hundreds of megawatts of capacity, with many more on the way.Groq makes inference work at scale.premierneocloudforfastinferenceTerms and policiesPlatformCompanyBlogContactStart building

FundraisingAugust 17, 2026Groq Closes $350 million Series A, Building the World's Leading AI Inference CloudGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudNew capital values the company at $3.5 billion and accelerates the build-out of Groq's global inference footprintDisruptive led the round with planned participation from NVIDIA, as the companies continue their partnership to develop inference at scaleSan Francisco, CA, August 17, 2026 — Groq LLC (“Groq”) today announced a $350 million Series A fundraise and the round was led by Disruptive, with planned participation from NVIDIA. The fundraise values the company at $3.5 billion. This latest round, together with $650 million raised in June 2026, brings recent funding in the company to $1 billion.Groq today operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific. The company serves more than six million developers, Fortune 500 enterprises and thousands of AI-native companies. The injection of capital will support those seeking usage of medium and larger sized clusters of NVIDIA accelerated computing for training and inference. Groq expects to scale from 54 megawatts…

CompanyNovember 17, 2025Groq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceIn collaboration with Equinix, Groq brings low-latency, high-efficiency compute closer to customers in Australia.SYDNEY, Australia – November 17, 2025 – Groq, a global leader in AI inference, today announced its first AI infrastructure footprint in Asia-Pacific, through its deployment in Equinix's data center in Sydney, Australia. The development is part of its continued global data center network expansion, following launches in the U.S. and Europe. This extends Groq’s global footprint and brings fast, low-cost and scalable AI inference closer to organizations and the public sector across Australia.Under this partnership, Groq and Equinix will establish one of the largest high-speed AI inference infrastructure sites in the country with a 4.5MW Groq facility in Sydney, offering up to 5x faster and lower cost compute power than traditional GPUs and hyperscaler clouds. Leveraging Equinix Fabric®, a software-defined interconnection service, organizations in Asia-Pacific will benefit from secure, low-latency, high-speed interconnectivity, ensuring seamless access to …

ResearchMay 27, 2025From Speed to Scale: How Groq Is Optimized for MoE & Other Large ModelsGroqYou know Groq runs small models. But did you know we run large models including MoE uniquely well? Here’s why.The Evolution of Advanced Openly-Available LLMsThere’s no argument that Artificial intelligence (AI) has exploded, in part because of the advancements in large language models (LLMs). These models have shown some amazing capabilities when it comes to natural language processing, from text generation to complex reasoning. As LLMs become even more sophisticated, one of the biggest challenges is scaling them efficiently. That’s where Groq comes in, a company at the forefront of AI hardware innovation, addressing this challenge with its groundbreaking LPU.In the past few years, the AI community has seen a surge in open-source LLMs, including models like Llama, DeepSeek, and Qwen. These models have democratized AI – making it possible for researchers and developers to access cutting-edge AI technology without being limited by proprietary systems. As a result, we’ve seen the emergence of smaller, more efficient models, as well as larger, more powerful ones. While smaller models are idea…

PartnershipDecember 18, 2025Groq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure Mountain View, Calif. – December 18, 2025 – Groq, the leader in AI inference, and the U.S. Department of Energy (DOE) signed a memorandum of understanding (MOU) to facilitate potential collaboration in areas of mutual interest regarding artificial intelligence (AI) and advanced computing initiatives through the DOE’s Genesis Mission.This bold initiative reflects the shared interest in fostering American-led technological innovation, accelerating the deployment of next-generation AI capabilities, and strengthening domestic capacity in key areas such as compute infrastructure, data architecture, and responsible AI development. Importantly, the MOU establishes a framework for information sharing and cooperative exploration between Groq and DOE in support of these shared goals.Ian Andrews, Groq’s Chief Revenue Officer, today attended the Genesis Mission event, which was held at the White House, and offered an opportunity for industry leaders and Administration officials to discuss the upcoming program and its implications.“There isn't enough comp…

CompanyJuly 23, 2025Groq Applauds Trump’s AI Action Plan, Accelerates Global AI StackGroq supports national effort to ensure American AI technology is available worldwideWASHINGTON, D.C. July 23, 2025 — With today’s release of the Winning the AI Race: America’s AI Action Plan, the United States signals its intent to be the undisputed leader in the global race to define the AI future. Groq, the U.S. company behind the most efficient, high-performance, and secure AI inference systems, welcomes this bold plan as a vision that we share. “The President’s AI Action Plan recognizes that real AI leadership comes not just from innovation, but from action—deploying AI compute fast, securely, and at scale,” said Jonathan Ross, CEO and Founder of Groq. “Leading the AI race means building an ecosystem the world wants to use, and Groq is proud to power the compute layer of the American AI Stack. We’re making American inference technology radically more affordable, accessible, and faster, ensuring the global AI race reflects U.S. leadership.”As a core compute layer of the AI stack, Groq delivers real-time inference at unmatched scale. Our chips and systems, made in the U.S., are already powering …

PartnershipNovember 5, 2025Groq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNoida, India, and Mountain View, Calif. — November 5, 2025 — Groq, the leader in AI inference, today announced a partnership with Paytm, India’s leading digital payments and financial services distribution company in real-time AI inference, to bring fast, intelligent and low-cost AI to its platform, advancing India’s digital economy by making inference available to builders and businesses at national scale.Paytm has been deploying AI across areas such as risk modeling, fraud prevention, customer onboarding, and personalization. By integrating GroqCloud, powered by its purpose-built LPU, Paytm will deliver faster and more cost-efficient inference than traditional GPU systems. This partnership will support Paytm’s on-going work in building high-performance AI models that enhance transaction processing, risk assessment, fraud detection and customer engagement across its platform. With Groq, Paytm will enhance the performance, reliability, and responsiveness of its digital ecosystem, enabling real-time insights, faster transaction experiences, and smarter customer…

FundraisingJune 22, 2026Groq Raises $650M to Scale Its AI Inference Cloud BusinessGroq Raises $650M to Scale Its AI Inference Cloud BusinessCapital injection to accelerate expansion of Groq's global AI inference cloud and scale toward 200 MW by 2027Already operating 13 data centers across North America, Europe, the Middle East and APAC, serving more than five million developers and processing trillions of AI tokens each weekStrengthens leadership team with Alan Rice, Sinclair Schuller, and Rakesh Malhotra, combining world-class data center operations, enterprise software, and platform expertise to accelerate adoption of Groq's AI inference cloudSan Francisco, CA, June 22, 2026 – Groq today announced $650 million in new growth capital to accelerate the expansion of its AI inference cloud. The round was led by Disruptive and Infinitum, with participation from investors who elected to reinvest in the company.The company's current trajectory began in December 2025, when Groq entered into a non-exclusive licensing agreement with NVIDIA. At this year’s GTC, NVIDIA announced its next-generation LPX platform, incorporating Groq's inference technology. Following these milestones, Groq's boa…

PartnershipSeptember 26, 2025McLaren Racing announces Groq as an Official Partner of the McLaren Formula 1 TeamMountain View, Calif. & Woking, UK — September 26, 2025 — McLaren Racing has announced leading inference provider Groq as an Official Partner of the McLaren Formula 1 Team.Groq will support the McLaren F1 Team in continuing its long history of turning innovation into advantage, with the integration of Groq’s custom LPU chip – the technology used for AI inference – that has been purpose-built to deliver fast, cost-efficient intelligence.As part of the partnership, Groq technology will fuel decision-making, supporting the McLaren F1 Team with analysis, development and real-time insight, as well as supercharging the processing power McLaren needs to perform efficiently.Nick Martin, Co-Chief Commercial Officer, McLaren Racing, said:“Formula 1 is about performance under pressure, so we’re excited to begin working with Groq to help deliver inference at the speed we need to support us in our efforts to stay at the front of the grid.”Chelsey Susin Kantor, Chief Marketing Officer, Groq, said:“McLaren and Groq share the same foundations: speed, precision, and the efficiency needed t…

PartnershipOctober 28, 2025Groq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseGroq’s low latency inference enables HUMAIN to deliver natural, voice-driven computing at scale.Mountain View, CA — October 28, 2025 — Groq, the leader in AI inference, today announced that HUMAIN has selected Groq to power HUMAIN One, a new operating system built for the age of AI.HUMAIN One replaces traditional applications with a voice-based interface that understands intent and completes tasks through intelligent agents. Built to help teams across HR, finance, productivity, and procurement, it makes every day work feel more natural and connected.Running a platform that responds to spoken intent in real time requires inference that can coordinate hundreds of AI agents with consistent speed and precision. Groq’s inference architecture provides the low latency performance needed to power that experience.“What makes HUMAIN One possible is inference that keeps up with human thought,” said Jonathan Ross, Groq Founder and CEO. “Groq provides the real-time speed and predictability required to turn spoken intent into immediate, intelligent action.”Groq’s efficient, U.S.-built compute archite…

CompanyFebruary 10, 2025Saudi Arabia Announces $1.5 Billion Expansion to Fuel AI-powered Economy with AI Tech Leader GroqMountain View, California & Riyadh, Saudi Arabia – February 10, 2025 – Silicon Valley AI pioneer Groq has secured a $1.5 billion commitment from the Kingdom of Saudi Arabia (KSA) for expanded delivery of its advanced LPU-based AI inference infrastructure. Announced at LEAP 2025, this major agreement advances the Kingdom’s position as a global leader in AI computing infrastructure while meeting rapidly growing regional demand.This agreement follows the operational excellence Groq demonstrated in building the region’s largest inference cluster in December 2024. Brought online in just eight days, the rapid installation established a critical AI hub to serve surging compute demand globally.From its state-of-the-art data center in Dammam, Saudi Arabia, Groq is now delivering market-leading AI inference capabilities to customers worldwide through GroqCloud™. At LEAP 2025, Jonathan Ross, CEO and Founder of Groq, alongside Tareq Almin and Ahmad O. Al-Khowaiter, Chief Technology Officer of Saudi Aramco, demonstrated reasoning LLMs, a KSA-created model Allam, and text to s…

CompanyOctober 26, 2023Groq Showcases Fastest GenAI Inference for LLMs at SC23MOUNTAIN VIEW, CA, October 26, 2023 — Groq, an artificial intelligence (AI) solutions company, announced today that it will have a booth and multiple talks at the premier industry conference for high performance compute, SC23, from November 12-17 in Denver, CO. Groq and their team will be showcasing a demo of the world’s best low latency performance for Large Language Models (LLMs) running on a Language Processing Unit™ system, its next-gen AI accelerator. Subject matter experts from Groq will be presenting four sessions during the conference on a range of HPC, AI, and research-related topics.Jim Miller, VP of Engineering at Groq, and former engineering leader at Qualcomm, Broadcom, and Intel, shared, “The scale and performance of systems used for AI today is enormous, and will get larger if built with legacy technology. At Groq we are setting a new standard with our LPU™-based systems that improve performance, power, and scale when serving a large customer base. This is thanks to the hard work and innovative ideas of our dedicated team of engineers at Groq who are committed to solving truly novel problem…

ResearchFebruary 13, 2024Groq® LPU™ Inference Engine Leads in First Independent LLM BenchmarkArtificialAnalysis.ai Adjusts Chart Axes to Accommodate Groq Performance LevelsMOUNTAIN VIEW, CA, February 13, 2024 – Groq®, a generative AI solutions company, is the clear winner in the latest large language model (LLM) benchmark by ArtificialAnalysis.ai, besting eight participants in key performance indicators including Latency vs. Throughput, Throughput over Time, Total Response Time, and Throughput Variance. The Groq LPU™ Inference Engine performed so well with a leading open source LLM from Meta AI, Llama 2-70b, that axes had to be extended to plot Groq on the Latency vs. Throughput chart. Groq participated in its first public LLM benchmark in January 2024 with competition-crushing results.“ArtificialAnalysis.ai has independently benchmarked Groq’s Llama 2 Chat (70B) API as achieving throughput of 241 tokens per second, more than double the speed of other hosting providers,” said ArtificialAnalysis.ai Co-creator Micah Hill-Smith. “Groq represents a step change in available speed, enabling new use cases for large language models.”Source: ArtificialAnalysis.aiGroq has run several interna…

PartnershipMay 6, 2024Groq Powers NAIRR Pilot with Fastest AI Inference EngineReal-time Inference Leader Joins Elite Group Offering U.S.-based Researchers and Educators Access to Cutting-edge AI Technologies, Powering Responsible AI InnovationMOUNTAIN VIEW, Calif., May 6, 2024 – Groq®, the leader in real-time AI inference, announced its participation in the National Artificial Intelligence Research Resource (NAIRR) Pilot today. The Pilot, a U.S. National Science Foundation-led program, marks the first step towards creating a shared national research infrastructure to connect U.S. researchers and educators to responsible and trustworthy AI research resources. In collaboration with 13 federal agencies and 25 private sector, nonprofit, and philanthropic organizations, Groq is powering the next phase of responsible AI research, discovery, and innovation by providing access to its LPU™ Inference Engine – the only solution delivering real-time AI inference today – via GroqCloud™.“Groq was founded, in part, to end the ‘haves and have-nots’ in AI,” said Groq Public Sector President Aileen Black. “Lack of access to necessary resources should never prevent a researcher from succeeding at the…

PartnershipApril 22, 2024Groq® & Earth Wind Power Build Energy-Efficient AI Center in NorwayLeader in Real-time AI Inference on Track to Deliver 50% of the World’s Inference Compute Capacity via GroqCloud™ by End of 2025MOUNTAIN VIEW, Calif., April 22, 2024 – Groq, the only provider of real-time AI inference solutions for generative AI (GenAI), has signed a Letter of Intent with Earth Wind & Power to develop the first European vertically-integrated AI Compute Center, located in Norway. The second deal of its kind from Groq in the last two months, the deployment of the Groq LPU™ Inference Engine in Norway will provide Norwegians, European and NATO-allied countries with the lowest cost, most energy-efficient, scalable access to inference compute – the specific type of compute needed as the world shifts from training to powering GenAI applications . This AI Compute Center will also ignite the generative age economy in Norway and the EU by powering GenAI solutions and providing investors with an early opportunity to participate in the inference market.In accordance with the terms of the Letter of Intent, Groq has committed to deploy and operate 21,600 LPUs at Earth Wind & Power’s AI Co…

PartnershipMay 7, 2024Groq and Carahsoft Deliver Rapid AI Inference to U.S. AgenciesPartnership Ensures Direct Access to the Groq LPU™ Inference Engine for Critical Missions for Local, State and Federal GovernmentsMOUNTAIN VIEW, Calif., and RESTON, Va. – May 7, 2024 – Groq®, the leader in real-time AI inference, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, today announced a partnership to deliver fast and cost- and energy-efficient AI inference speed to Government agencies and Federal systems integrators throughout the United States. Under the distribution agreement, Carahsoft will serve as Public Sector distributor for Groq, making its innovative AI inference solutions available to the Public Sector through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V contracts.Accessed through GroqCloud™ via an API or a private cloud, the Groq LPU™ Inference Engine is a cutting-edge AI inference technology. It is revolutionizing Government use cases, including accelerated analyst velocity, continuous monitoring with visualized graph intelligence and GenAI-accelerated contract search, discussion, and bid proposal drafti…

PartnershipSeptember 12, 2024Aramco Digital and Groq Announce Progress in Building the World’s Largest Inferencing Data Center in Saudi Arabia Following LEAP MOU SigningMountain View, CA & Riyadh, Saudi Arabia – 12 September 2024 – Following the signing of a Memorandum of Understanding (MoU) during LEAP, Aramco Digital, the digital and technology subsidiary of Aramco, and Groq, a leader in AI inference and creator of the Language Processing Unit (LPU), announced their partnership to establish the world’s largest inferencing data center in the Kingdom of Saudi Arabia. This strategic collaboration marks a significant step forward in advancing the Kingdom’s digital transformation initiatives and solidifying its position as a global leader in AI and cloud computing.The inferencing data center will play a pivotal role in Aramco Digital’s vision to leverage advanced technologies that drive operational excellence and support the Kingdom’s program, Vision 2030. By combining cutting-edge AI and ML infrastructure from Groq with Aramco Digital’s strategic goals, this partnership aims to revolutionize data processing and analytics across various sectors. The facility will process billions of t…

CompanyMarch 1, 2025Thank You! 1 Million Developers Now On GroqCloud™Today, one year this week since we launched GroqCloud, we're celebrating the one million developers who are now on GroqCloud! In just a year this community of builders, makers, and innovators have shipped incredible apps, participated in and won hackathons, productized your innovations, and even launched companies. We've also continued to welcome thousands of paid customers in our Dev Tier and companies building their AI solutions with our LPU based systems.https://www.youtube.com/watch?v=Qfp6-OBZHA4The moment started when we went viral this time last year. In 48 hours we had received ~3,000 API access requests, there were ~1 million prompts submitted via GroqChat, and major industry influencers were vibing with us across YouTube and X, including Matt Shumer who made some incredible GroqChat demos ranging from an AI Answers Engine to novel writing in under two minutes. Groq was also featured on CNN with an interview of our CEO and founder, Jonathan Ross.We’ll see you even more in the coming year across the US, Middle East, South Asia, the EU, and online. This last year showed us many inspired builds so we can’t wa…

PartnershipApril 20, 2024Groq Launches Meta's Llama 3 Instruct AI Models on LPU™ Inference EngineLlama 3 Now Available to Developers via GroqChat and GroqCloud™Here’s what’s happened in the last 36 hours:April 18th, Noon: Meta releases versions of its latest Large Language Model (LLM), Llama 3.April 19th, Midnight: Groq releases Llama 3 8B (8k) and 70B (4k, 8k) running on its LPU™ Inference Engine, available to the developer community via groq.com and the GroqCloud™ Console.April 19th, 10am: ArtificialAnalysis.ai releases its first set of Llama 3 benchmarks.Artificial Analysis has independently benchmarked Groq as achieving a throughput of 877 tokens/s on Llama 3 8B and 284 tokens/s on Llama 3 70B, the highest of any provider by over 2X. Groq's offer is also cost competitive with both models priced at or below other providers. Combined with Llama 3's impressive quality, Groq's offer is compelling for a broad range of use-cases including emerging use-cases which demand a high number of interactions with LLMs such as AI agents.George Cameron, Co-Founder, ArtificialAnalysis.aiThroughputGroq offers 284 tokens per second for Llama 3 70B, over 3-11x faster than other providers.Throughput…

PartnershipMay 28, 2025Groq Becomes Exclusive Inference Provider for Bell AI NetworkNew data centers across North America expand Groq’s network, now serving over 20 million tokens per secondMOUNTAIN VIEW, Calif., May 28, 2025 — Groq, the pioneer in fast AI inference, today announced an exclusive partnership with Bell Canada to power Bell AI Fabric, the country’s largest sovereign AI infrastructure project.Bell AI Fabric will establish a national AI network across six sites, targeting 500MW of clean, hydro-powered compute. It begins with a 7MW Groq facility in Kamloops, British Columbia, coming online in June.“As AI moves into production, nations are rethinking where inference runs and who controls it,” said Jonathan Ross, CEO and Founder of Groq. “We’re building infrastructure that’s fast, affordable, and sovereign by design, already powering some of the largest inference deployments in the world.”This month, Groq also brought new data centers online in Houston (DataBank) and Dallas (Equinix), pushing total global network capacity to over 20 million tokens per second.The momentum reflects rising demand for Groq’s LPU-based systems—built for real-time inference with unmatched speed …