Groq · Indexed content

BlogSearchPartnershipGroq Among the First to Bring NVIDIA Groq 3 LPX and Vera Rubin NVL72 to MarketAugust 24, 2026FundraisingGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudAugust 17, 2026PartnershipGroq Becomes an NVIDIA Cloud PartnerAugust 12, 2026FundraisingGroq Raises $650M to Scale Its AI Inference Cloud BusinessJune 22, 2026PlatformGroqCloud: Expanding to Meet Demand February 16, 2026PartnershipGroq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale December 24, 2025PartnershipGroq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure December 18, 2025CompanyGroq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceNovember 17, 2025PartnershipGroq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNovember 5, 2025PartnershipGroq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseOctober 28, 2025PartnershipGroq Partners with Aljammaz Technologies to Power AI Inference Across MENAOctober 17, 2025PartnershipMcLaren Racing announces Groq…

Contact usPut AIto work

GroqPlatformBuild your perfect stack. GroqMetal provides infrastructure, GroqCore adds inference, and GroqAssured adds enterprise controls. Each includes the layers below.Start BuildingInfrastructureGroqMetalDedicated bare-metal infrastructure, tuned for speed and reliability, with full control in your hands.InferenceGroqCoreA tested inference stack that turns dedicated capacity into production-ready performance, no infrastructure expertise required.ControlGroqAssuredEnterprise-grade governance, auditability, and control layered on top, so scale never comes at the cost of trust.256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference computeLPXGroq operates fast, reliable inference at massive scale with fine-grained control.When released, each NVIDIA Groq 3 LPX rack connects 256 next-generation LPU accelerators to NVIDIA’s Vera Rubin to deliver low-latency, large-context in…

From siliconto cloudGroq delivers fast, reliable inference close to users around the world.More than five million developers and thousands of AI-native companies run trillions of tokens on Groq each week.Now we're building the premier neocloud for inference in one integrated stack anchored by bare-metal infrastructure, which powers production-ready inference, with robust enterprise governance and control.Hard-woninferenceexpertiseGroq’s leaders took the LPU from silicon to a global production cloud, bringing together inference operations, hyperscale infrastructure, and enterprise software.CEOAdam WinterAdam Winter is Chief Executive Officer of Groq, where he leads the company’s expansion as a global AI infrastructure business focused on inference at scale. Groq operates data centers across North America, Europe, the Middle East and Asia-Pacific. Over a 30-year career in technology, Adam has worked through two defining platform shifts: the rise of the internet and now artificial intelligence. He spent more than a decade at Cisco during the internet’s transformation of enterprise technology, before going on to build and scale businesses across cloud, cybersecurity and AI. Adam joined…

Termsand policiesTerms of Use>Privacy Policy>Cookie Policy>Security>Trademark Policy>Photography & Filming Policy>Recruitment Fraud Awareness>

Every customer served.Every product sold.Every commit merged.Every agent task completed.That’s inference.Training creates the possibility.Inference creates the value.The more we ask of AI, the more inference it takes.And inference is becoming the bottleneck.Groq was built for this.We pioneered the LPU.Now, with LPX, it works alongside NVIDIA’s next-generation GPUs to deliver unparalleled inference capability, reliably, affordably, at scale.Fast or affordable is no longer a tradeoff.We’re building hundreds of megawatts of capacity, with many more on the way.Groq makes inference work at scale.premierneocloudforfastinferenceTerms and policiesPlatformCompanyBlogContactStart building

FundraisingAugust 17, 2026Groq Closes $350 million Series A, Building the World's Leading AI Inference CloudGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudNew capital values the company at $3.5 billion and accelerates the build-out of Groq's global inference footprintDisruptive led the round with planned participation from NVIDIA, as the companies continue their partnership to develop inference at scaleSan Francisco, CA, August 17, 2026 — Groq LLC (“Groq”) today announced a $350 million Series A fundraise and the round was led by Disruptive, with planned participation from NVIDIA. The fundraise values the company at $3.5 billion. This latest round, together with $650 million raised in June 2026, brings recent funding in the company to $1 billion.Groq today operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific. The company serves more than six million developers, Fortune 500 enterprises and thousands of AI-native companies. The injection of capital will support those seeking usage of medium and larger sized clusters of NVIDIA accelerated computing for training and inference. Groq expects to scale from 54 megawatts…

CompanyNovember 17, 2025Groq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceIn collaboration with Equinix, Groq brings low-latency, high-efficiency compute closer to customers in Australia.SYDNEY, Australia – November 17, 2025 – Groq, a global leader in AI inference, today announced its first AI infrastructure footprint in Asia-Pacific, through its deployment in Equinix's data center in Sydney, Australia. The development is part of its continued global data center network expansion, following launches in the U.S. and Europe. This extends Groq’s global footprint and brings fast, low-cost and scalable AI inference closer to organizations and the public sector across Australia.Under this partnership, Groq and Equinix will establish one of the largest high-speed AI inference infrastructure sites in the country with a 4.5MW Groq facility in Sydney, offering up to 5x faster and lower cost compute power than traditional GPUs and hyperscaler clouds. Leveraging Equinix Fabric®, a software-defined interconnection service, organizations in Asia-Pacific will benefit from secure, low-latency, high-speed interconnectivity, ensuring seamless access to …

ResearchMay 27, 2025From Speed to Scale: How Groq Is Optimized for MoE & Other Large ModelsGroqYou know Groq runs small models. But did you know we run large models including MoE uniquely well? Here’s why.The Evolution of Advanced Openly-Available LLMsThere’s no argument that Artificial intelligence (AI) has exploded, in part because of the advancements in large language models (LLMs). These models have shown some amazing capabilities when it comes to natural language processing, from text generation to complex reasoning. As LLMs become even more sophisticated, one of the biggest challenges is scaling them efficiently. That’s where Groq comes in, a company at the forefront of AI hardware innovation, addressing this challenge with its groundbreaking LPU.In the past few years, the AI community has seen a surge in open-source LLMs, including models like Llama, DeepSeek, and Qwen. These models have democratized AI – making it possible for researchers and developers to access cutting-edge AI technology without being limited by proprietary systems. As a result, we’ve seen the emergence of smaller, more efficient models, as well as larger, more powerful ones. While smaller models are idea…

PartnershipDecember 18, 2025Groq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure Mountain View, Calif. – December 18, 2025 – Groq, the leader in AI inference, and the U.S. Department of Energy (DOE) signed a memorandum of understanding (MOU) to facilitate potential collaboration in areas of mutual interest regarding artificial intelligence (AI) and advanced computing initiatives through the DOE’s Genesis Mission.This bold initiative reflects the shared interest in fostering American-led technological innovation, accelerating the deployment of next-generation AI capabilities, and strengthening domestic capacity in key areas such as compute infrastructure, data architecture, and responsible AI development. Importantly, the MOU establishes a framework for information sharing and cooperative exploration between Groq and DOE in support of these shared goals.Ian Andrews, Groq’s Chief Revenue Officer, today attended the Genesis Mission event, which was held at the White House, and offered an opportunity for industry leaders and Administration officials to discuss the upcoming program and its implications.“There isn't enough comp…

CompanyJuly 23, 2025Groq Applauds Trump’s AI Action Plan, Accelerates Global AI StackGroq supports national effort to ensure American AI technology is available worldwideWASHINGTON, D.C. July 23, 2025 — With today’s release of the Winning the AI Race: America’s AI Action Plan, the United States signals its intent to be the undisputed leader in the global race to define the AI future. Groq, the U.S. company behind the most efficient, high-performance, and secure AI inference systems, welcomes this bold plan as a vision that we share. “The President’s AI Action Plan recognizes that real AI leadership comes not just from innovation, but from action—deploying AI compute fast, securely, and at scale,” said Jonathan Ross, CEO and Founder of Groq. “Leading the AI race means building an ecosystem the world wants to use, and Groq is proud to power the compute layer of the American AI Stack. We’re making American inference technology radically more affordable, accessible, and faster, ensuring the global AI race reflects U.S. leadership.”As a core compute layer of the AI stack, Groq delivers real-time inference at unmatched scale. Our chips and systems, made in the U.S., are already powering …

PartnershipNovember 5, 2025Groq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNoida, India, and Mountain View, Calif. — November 5, 2025 — Groq, the leader in AI inference, today announced a partnership with Paytm, India’s leading digital payments and financial services distribution company in real-time AI inference, to bring fast, intelligent and low-cost AI to its platform, advancing India’s digital economy by making inference available to builders and businesses at national scale.Paytm has been deploying AI across areas such as risk modeling, fraud prevention, customer onboarding, and personalization. By integrating GroqCloud, powered by its purpose-built LPU, Paytm will deliver faster and more cost-efficient inference than traditional GPU systems. This partnership will support Paytm’s on-going work in building high-performance AI models that enhance transaction processing, risk assessment, fraud detection and customer engagement across its platform. With Groq, Paytm will enhance the performance, reliability, and responsiveness of its digital ecosystem, enabling real-time insights, faster transaction experiences, and smarter customer…

FundraisingJune 22, 2026Groq Raises $650M to Scale Its AI Inference Cloud BusinessGroq Raises $650M to Scale Its AI Inference Cloud BusinessCapital injection to accelerate expansion of Groq's global AI inference cloud and scale toward 200 MW by 2027Already operating 13 data centers across North America, Europe, the Middle East and APAC, serving more than five million developers and processing trillions of AI tokens each weekStrengthens leadership team with Alan Rice, Sinclair Schuller, and Rakesh Malhotra, combining world-class data center operations, enterprise software, and platform expertise to accelerate adoption of Groq's AI inference cloudSan Francisco, CA, June 22, 2026 – Groq today announced $650 million in new growth capital to accelerate the expansion of its AI inference cloud. The round was led by Disruptive and Infinitum, with participation from investors who elected to reinvest in the company.The company's current trajectory began in December 2025, when Groq entered into a non-exclusive licensing agreement with NVIDIA. At this year’s GTC, NVIDIA announced its next-generation LPX platform, incorporating Groq's inference technology. Following these milestones, Groq's boa…

PartnershipSeptember 26, 2025McLaren Racing announces Groq as an Official Partner of the McLaren Formula 1 TeamMountain View, Calif. & Woking, UK — September 26, 2025 — McLaren Racing has announced leading inference provider Groq as an Official Partner of the McLaren Formula 1 Team.Groq will support the McLaren F1 Team in continuing its long history of turning innovation into advantage, with the integration of Groq’s custom LPU chip – the technology used for AI inference – that has been purpose-built to deliver fast, cost-efficient intelligence.As part of the partnership, Groq technology will fuel decision-making, supporting the McLaren F1 Team with analysis, development and real-time insight, as well as supercharging the processing power McLaren needs to perform efficiently.Nick Martin, Co-Chief Commercial Officer, McLaren Racing, said:“Formula 1 is about performance under pressure, so we’re excited to begin working with Groq to help deliver inference at the speed we need to support us in our efforts to stay at the front of the grid.”Chelsey Susin Kantor, Chief Marketing Officer, Groq, said:“McLaren and Groq share the same foundations: speed, precision, and the efficiency needed t…

PartnershipOctober 28, 2025Groq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseGroq’s low latency inference enables HUMAIN to deliver natural, voice-driven computing at scale.Mountain View, CA — October 28, 2025 — Groq, the leader in AI inference, today announced that HUMAIN has selected Groq to power HUMAIN One, a new operating system built for the age of AI.HUMAIN One replaces traditional applications with a voice-based interface that understands intent and completes tasks through intelligent agents. Built to help teams across HR, finance, productivity, and procurement, it makes every day work feel more natural and connected.Running a platform that responds to spoken intent in real time requires inference that can coordinate hundreds of AI agents with consistent speed and precision. Groq’s inference architecture provides the low latency performance needed to power that experience.“What makes HUMAIN One possible is inference that keeps up with human thought,” said Jonathan Ross, Groq Founder and CEO. “Groq provides the real-time speed and predictability required to turn spoken intent into immediate, intelligent action.”Groq’s efficient, U.S.-built compute archite…

CompanyFebruary 10, 2025Saudi Arabia Announces $1.5 Billion Expansion to Fuel AI-powered Economy with AI Tech Leader GroqMountain View, California & Riyadh, Saudi Arabia – February 10, 2025 – Silicon Valley AI pioneer Groq has secured a $1.5 billion commitment from the Kingdom of Saudi Arabia (KSA) for expanded delivery of its advanced LPU-based AI inference infrastructure. Announced at LEAP 2025, this major agreement advances the Kingdom’s position as a global leader in AI computing infrastructure while meeting rapidly growing regional demand.This agreement follows the operational excellence Groq demonstrated in building the region’s largest inference cluster in December 2024. Brought online in just eight days, the rapid installation established a critical AI hub to serve surging compute demand globally.From its state-of-the-art data center in Dammam, Saudi Arabia, Groq is now delivering market-leading AI inference capabilities to customers worldwide through GroqCloud™. At LEAP 2025, Jonathan Ross, CEO and Founder of Groq, alongside Tareq Almin and Ahmad O. Al-Khowaiter, Chief Technology Officer of Saudi Aramco, demonstrated reasoning LLMs, a KSA-created model Allam, and text to s…

PartnershipApril 22, 2024Groq® & Earth Wind Power Build Energy-Efficient AI Center in NorwayLeader in Real-time AI Inference on Track to Deliver 50% of the World’s Inference Compute Capacity via GroqCloud™ by End of 2025MOUNTAIN VIEW, Calif., April 22, 2024 – Groq, the only provider of real-time AI inference solutions for generative AI (GenAI), has signed a Letter of Intent with Earth Wind & Power to develop the first European vertically-integrated AI Compute Center, located in Norway. The second deal of its kind from Groq in the last two months, the deployment of the Groq LPU™ Inference Engine in Norway will provide Norwegians, European and NATO-allied countries with the lowest cost, most energy-efficient, scalable access to inference compute – the specific type of compute needed as the world shifts from training to powering GenAI applications . This AI Compute Center will also ignite the generative age economy in Norway and the EU by powering GenAI solutions and providing investors with an early opportunity to participate in the inference market.In accordance with the terms of the Letter of Intent, Groq has committed to deploy and operate 21,600 LPUs at Earth Wind & Power’s AI Co…

PartnershipApril 23, 2024Groq & Carahsoft Host GroqDay – Accelerating AI for GovernmentAlexis Bonnell, Karen Evans, and Jacqueline Tame Will Speak About Embracing AI Technology for Mission Efficiency and Will Explore Government Use CasesMOUNTAIN VIEW, Calif., April 23, 2024 – Groq®, a real-time AI inference company, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, are co-hosting the first Public Sector focused GroqDay at the Carahsoft Conference Center in Reston, VA, on Thursday, April 25, 2024.The in-person event will also be live-streamed and feature discussions on accelerated AI adoption by the US government, the changing landscape of information availability and decision-making in the face of AI, live demos of government use cases, and much more. Attendees are eligible to receive 1 Continuing Professional Education (CPE) credit. Government decision makers, including agency leaders, policy influencers, and federal systems integrators, are encouraged to register and attend.Aileen Black, Public Sector President at Groq, shared, “At GroqDay, industry experts and government leaders will discuss the AI economy powered by human agency. Key missions cannot…

CompanyMarch 1, 2025Thank You! 1 Million Developers Now On GroqCloud™Today, one year this week since we launched GroqCloud, we're celebrating the one million developers who are now on GroqCloud! In just a year this community of builders, makers, and innovators have shipped incredible apps, participated in and won hackathons, productized your innovations, and even launched companies. We've also continued to welcome thousands of paid customers in our Dev Tier and companies building their AI solutions with our LPU based systems.https://www.youtube.com/watch?v=Qfp6-OBZHA4The moment started when we went viral this time last year. In 48 hours we had received ~3,000 API access requests, there were ~1 million prompts submitted via GroqChat, and major industry influencers were vibing with us across YouTube and X, including Matt Shumer who made some incredible GroqChat demos ranging from an AI Answers Engine to novel writing in under two minutes. Groq was also featured on CNN with an interview of our CEO and founder, Jonathan Ross.We’ll see you even more in the coming year across the US, Middle East, South Asia, the EU, and online. This last year showed us many inspired builds so we can’t wa…

PlatformMarch 13, 2025Batch Processing with GroqCloud™ for AI Inference WorkloadsGroqCloud™ provides fast inference for complex AI solutions that require instant responsiveness. But what happens when your use cases expand and require features beyond speed? That’s where Batch Processing comes in –now you can use GroqCloud at scale to process massive workloads.Let’s say you have some large-scale datasets you want to analyze or summarize. Or you have a large set of images that need captioning. Or run validation and quality tests on a new AI program. The GroqCloud Batch Processing API, available to Developer and Enterprise Tier customers, the perfect solution for these use cases and more.Batch Processing allows users to batch together non-time sensitive requests or submit large scale workloads and get a response back within 24 hours. For bulk processing made easy, it’s perfect for tasks like large scale data classification, translations, document summaries, and image to text workloads. All at a 25% discount to normal on-demand pricing without taxing rate limits.Experience a broader range of batch processing models with newly added support for Llama 3.3 70B, DeepSeek-R1-Distill-Llama-70…

ResearchFebruary 8, 2024Groq LPU Tops Latency & Throughput in BenchmarkGroq Represents a “Step Change” in Inference Speed Performance According to ArtificialAnalysis.aiWe’re opening the second month of the year with our second LLM benchmark, this time by ArtificialAnalysis.ai. Spoiler: The Groq LPU™ Inference Engine performed so well that the chart axes had to be extended to plot Groq on the Latency vs. Throughput chart. But before we dive into the results, let's talk about the setup.This benchmark is an analysis of Meta AI’s Llama 2 Chat (70B) across metrics including quality, latency, throughput tokens per second, price, and others. Groq joined other API Host providers including Microsoft Azure, Amazon Bedrock, Perplexity, Together.ai, Anyscale, Deepinfra, Fireworks, and Lepton.Conducted independently, ArtifiicalAnalysis.ai benchmarks compare the hosting providers across key performance indicators including throughput versus price, latency versus throughput, throughput over time, total response time, and throughput variance. The benchmarks are 'live’ meaning they’re updated every three hours (eight times per day) and prompts are unique, around 100 tokens in length, and generate ~…

PartnershipApril 20, 2024Groq Launches Meta's Llama 3 Instruct AI Models on LPU™ Inference EngineLlama 3 Now Available to Developers via GroqChat and GroqCloud™Here’s what’s happened in the last 36 hours:April 18th, Noon: Meta releases versions of its latest Large Language Model (LLM), Llama 3.April 19th, Midnight: Groq releases Llama 3 8B (8k) and 70B (4k, 8k) running on its LPU™ Inference Engine, available to the developer community via groq.com and the GroqCloud™ Console.April 19th, 10am: ArtificialAnalysis.ai releases its first set of Llama 3 benchmarks.Artificial Analysis has independently benchmarked Groq as achieving a throughput of 877 tokens/s on Llama 3 8B and 284 tokens/s on Llama 3 70B, the highest of any provider by over 2X. Groq's offer is also cost competitive with both models priced at or below other providers. Combined with Llama 3's impressive quality, Groq's offer is compelling for a broad range of use-cases including emerging use-cases which demand a high number of interactions with LLMs such as AI agents.George Cameron, Co-Founder, ArtificialAnalysis.aiThroughputGroq offers 284 tokens per second for Llama 3 70B, over 3-11x faster than other providers.Throughput…

PartnershipMay 28, 2025Groq Becomes Exclusive Inference Provider for Bell AI NetworkNew data centers across North America expand Groq’s network, now serving over 20 million tokens per secondMOUNTAIN VIEW, Calif., May 28, 2025 — Groq, the pioneer in fast AI inference, today announced an exclusive partnership with Bell Canada to power Bell AI Fabric, the country’s largest sovereign AI infrastructure project.Bell AI Fabric will establish a national AI network across six sites, targeting 500MW of clean, hydro-powered compute. It begins with a 7MW Groq facility in Kamloops, British Columbia, coming online in June.“As AI moves into production, nations are rethinking where inference runs and who controls it,” said Jonathan Ross, CEO and Founder of Groq. “We’re building infrastructure that’s fast, affordable, and sovereign by design, already powering some of the largest inference deployments in the world.”This month, Groq also brought new data centers online in Houston (DataBank) and Dallas (Equinix), pushing total global network capacity to over 20 million tokens per second.The momentum reflects rising demand for Groq’s LPU-based systems—built for real-time inference with unmatched speed …

PartnershipApril 29, 2025Meta and Groq Collaborate to Deliver Fast Inference for the Official Llama APIIntroducing the fastest way to run the world’s most trusted openly available models with no tradeoffsMOUNTAIN VIEW, Calif., April 29, 2025 – Groq, a leader in AI inference, announced today its partnership with Meta to deliver fast inference for the official Llama API – giving developers the fastest, most cost-effective way to run the latest Llama models. Coming soon in preview, the Llama 4 API model accelerated by Groq will run on the Groq LPU, the world’s most efficient inference chip. That means developers can run Llama models with no tradeoffs: low cost, fast responses, predictable low latency, and reliable scaling for production workloads.“Teaming up with Meta for the official Llama API raises the bar for model performance,” said Jonathan Ross, CEO and Founder of Groq. “Groq delivers the speed, consistency, and cost efficiency that production AI demands, while giving developers the flexibility and control they need to build fast.”Unlike general-purpose GPU stacks, Groq is vertically integrated for one job: inference. Builders are increasingly switching to Groq because every la…

CompanyMay 27, 2025Groq Solidifies Status as Emerging Hyperscaler with New Global DeploymentDelivering unmatched price performance for AI inference across continents at scaleGroq has been named an official inference provider for HUMAIN, a newly launched AI company headquartered in Saudi Arabia and designed to operate across the full AI value chain. HUMAIN’s mission is to transform economies through large-scale AI capabilities, from infrastructure to state-of-the-art models, and Groq’s ultra-efficient inference technology will be central to that mission.“From global hyperscalers to sovereign AI initiatives, the teams running the most demanding AI workloads choose Groq,” said Jonathan Ross, CEO and Founder of Groq. “Our platform is purpose-built for inference, delivering consistently high performance at the lowest cost per token in the industry.”The announcement builds on Groq’s opening of a data center in Dammam, Saudi Arabia, which has been serving traffic since February. It’s part of a $1.5 billion commitment from the Kingdom to supercharge AI development in the region and expand Groq’s presence in global markets.Groq prioritizes U.S.-based development for its systems and has scal…