Groq · Indexed content

From siliconto cloudGroq delivers fast, reliable inference close to users around the world.More than five million developers and thousands of AI-native companies run trillions of tokens on Groq each week.Now we're building the premier neocloud for inference in one integrated stack anchored by bare-metal infrastructure, which powers production-ready inference, with robust enterprise governance and control.Hard-woninferenceexpertiseGroq’s leaders took the LPU from silicon to a global production cloud, bringing together inference operations, hyperscale infrastructure, and enterprise software.CEOAdam WinterAdam Winter is Chief Executive Officer of Groq, where he leads the company’s expansion as a global AI infrastructure business focused on inference at scale. Groq operates data centers across North America, Europe, the Middle East and Asia-Pacific. Over a 30-year career in technology, Adam has worked through two defining platform shifts: the rise of the internet and now artificial intelligence. He spent more than a decade at Cisco during the internet’s transformation of enterprise technology, before going on to build and scale businesses across cloud, cybersecurity and AI. Adam joined…

GroqPlatformBuild your perfect stack. GroqMetal provides infrastructure, GroqCore adds inference, and GroqAssured adds enterprise controls. Each includes the layers below.Start BuildingInfrastructureGroqMetalDedicated bare-metal infrastructure, tuned for speed and reliability, with full control in your hands.InferenceGroqCoreA tested inference stack that turns dedicated capacity into production-ready performance, no infrastructure expertise required.ControlGroqAssuredEnterprise-grade governance, auditability, and control layered on top, so scale never comes at the cost of trust.256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference computeLPXGroq operates fast, reliable inference at massive scale with fine-grained control.When released, each NVIDIA Groq 3 LPX rack connects 256 next-generation LPU accelerators to NVIDIA’s Vera Rubin to deliver low-latency, large-context in…

Contact usPut AIto work

BlogSearchPartnershipGroq Among the First to Bring NVIDIA Groq 3 LPX and Vera Rubin NVL72 to MarketAugust 24, 2026FundraisingGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudAugust 17, 2026PartnershipGroq Becomes an NVIDIA Cloud PartnerAugust 12, 2026FundraisingGroq Raises $650M to Scale Its AI Inference Cloud BusinessJune 22, 2026PlatformGroqCloud: Expanding to Meet Demand February 16, 2026PartnershipGroq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale December 24, 2025PartnershipGroq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure December 18, 2025CompanyGroq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceNovember 17, 2025PartnershipGroq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNovember 5, 2025PartnershipGroq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseOctober 28, 2025PartnershipGroq Partners with Aljammaz Technologies to Power AI Inference Across MENAOctober 17, 2025PartnershipMcLaren Racing announces Groq…

Termsand policiesTerms of Use>Privacy Policy>Cookie Policy>Security>Trademark Policy>Photography & Filming Policy>Recruitment Fraud Awareness>

Every customer served.Every product sold.Every commit merged.Every agent task completed.That’s inference.Training creates the possibility.Inference creates the value.The more we ask of AI, the more inference it takes.And inference is becoming the bottleneck.Groq was built for this.We pioneered the LPU.Now, with LPX, it works alongside NVIDIA’s next-generation GPUs to deliver unparalleled inference capability, reliably, affordably, at scale.Fast or affordable is no longer a tradeoff.We’re building hundreds of megawatts of capacity, with many more on the way.Groq makes inference work at scale.premierneocloudforfastinferenceTerms and policiesPlatformCompanyBlogContactStart building

FundraisingAugust 17, 2026Groq Closes $350 million Series A, Building the World's Leading AI Inference CloudGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudNew capital values the company at $3.5 billion and accelerates the build-out of Groq's global inference footprintDisruptive led the round with planned participation from NVIDIA, as the companies continue their partnership to develop inference at scaleSan Francisco, CA, August 17, 2026 — Groq LLC (“Groq”) today announced a $350 million Series A fundraise and the round was led by Disruptive, with planned participation from NVIDIA. The fundraise values the company at $3.5 billion. This latest round, together with $650 million raised in June 2026, brings recent funding in the company to $1 billion.Groq today operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific. The company serves more than six million developers, Fortune 500 enterprises and thousands of AI-native companies. The injection of capital will support those seeking usage of medium and larger sized clusters of NVIDIA accelerated computing for training and inference. Groq expects to scale from 54 megawatts…

PartnershipOctober 17, 2025Groq Partners with Aljammaz Technologies to Power AI Inference Across MENAAnnounced at GITEX Global 2025DUBAI, UAE – October 17, 2025 – Groq, the inference-first AI company, is proud to partner with Aljammaz Technologies, the region's leading value-added distributor, to bring Groq's high-performance LPU technology to enterprises, governments, and developers across the region.The partnership comes at a critical inflection point in AI adoption. As organizations move from experimentation to production deployment, inference speed, cost, and energy efficiency have emerged as defining constraints. Groq's LPU technology is purpose-built for AI inference rather than adapted from graphics processing and it enables a new class of real-time AI applications that were previously impractical with traditional GPU architectures.Under the collaboration, Aljammaz will distribute Groq’s full suite of AI inference solutions — including GroqCloud, Groq’s full-stack cloud platform, and GroqRack, its on-premises compute cluster — through its extensive network of system integrators and resellers. Together, the companies aim to enable real-time AI deployment at scale, reducing la…

ResearchOctober 22, 2019Why AI Requires a New Chip ArchitectureGroqArtificial intelligence (AI) is one of the most hyped buzzwords in technology today. But while everyone may be talking about AI, a much smaller number of people are successfully doing AI.According to a McKinsey report cited by Forbes, nearly three-quarters of over 2,000 organizations surveyed expect to increase investments in AI in the future, but just one in five respondents claimed they had already successfully rolled out AI in more than one process.In large part, this slow uptake of AI is due to the extreme difficulty of achieving and maintaining the high-performance processing that AI workloads require.Why is inference so hard?In part, the challenge of achieving high-performance compute processing involves managing rapidly increasing volumes of data. Data scientists estimate that the volume of data is doubling every two years, and will reach 44 zettabytes by 2020 – in other words, there will be more than 40 times more bytes of data than there are stars in the observable universe.In addition, to meet human-like inference performance with neural networks will require exponential increases in model complexity and c…

PartnershipMay 6, 2024Groq Powers NAIRR Pilot with Fastest AI Inference EngineReal-time Inference Leader Joins Elite Group Offering U.S.-based Researchers and Educators Access to Cutting-edge AI Technologies, Powering Responsible AI InnovationMOUNTAIN VIEW, Calif., May 6, 2024 – Groq®, the leader in real-time AI inference, announced its participation in the National Artificial Intelligence Research Resource (NAIRR) Pilot today. The Pilot, a U.S. National Science Foundation-led program, marks the first step towards creating a shared national research infrastructure to connect U.S. researchers and educators to responsible and trustworthy AI research resources. In collaboration with 13 federal agencies and 25 private sector, nonprofit, and philanthropic organizations, Groq is powering the next phase of responsible AI research, discovery, and innovation by providing access to its LPU™ Inference Engine – the only solution delivering real-time AI inference today – via GroqCloud™.“Groq was founded, in part, to end the ‘haves and have-nots’ in AI,” said Groq Public Sector President Aileen Black. “Lack of access to necessary resources should never prevent a researcher from succeeding at the…

PartnershipMay 7, 2024Groq and Carahsoft Deliver Rapid AI Inference to U.S. AgenciesPartnership Ensures Direct Access to the Groq LPU™ Inference Engine for Critical Missions for Local, State and Federal GovernmentsMOUNTAIN VIEW, Calif., and RESTON, Va. – May 7, 2024 – Groq®, the leader in real-time AI inference, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, today announced a partnership to deliver fast and cost- and energy-efficient AI inference speed to Government agencies and Federal systems integrators throughout the United States. Under the distribution agreement, Carahsoft will serve as Public Sector distributor for Groq, making its innovative AI inference solutions available to the Public Sector through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V contracts.Accessed through GroqCloud™ via an API or a private cloud, the Groq LPU™ Inference Engine is a cutting-edge AI inference technology. It is revolutionizing Government use cases, including accelerated analyst velocity, continuous monitoring with visualized graph intelligence and GenAI-accelerated contract search, discussion, and bid proposal drafti…

PartnershipApril 23, 2024Groq & Carahsoft Host GroqDay – Accelerating AI for GovernmentAlexis Bonnell, Karen Evans, and Jacqueline Tame Will Speak About Embracing AI Technology for Mission Efficiency and Will Explore Government Use CasesMOUNTAIN VIEW, Calif., April 23, 2024 – Groq®, a real-time AI inference company, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, are co-hosting the first Public Sector focused GroqDay at the Carahsoft Conference Center in Reston, VA, on Thursday, April 25, 2024.The in-person event will also be live-streamed and feature discussions on accelerated AI adoption by the US government, the changing landscape of information availability and decision-making in the face of AI, live demos of government use cases, and much more. Attendees are eligible to receive 1 Continuing Professional Education (CPE) credit. Government decision makers, including agency leaders, policy influencers, and federal systems integrators, are encouraged to register and attend.Aileen Black, Public Sector President at Groq, shared, “At GroqDay, industry experts and government leaders will discuss the AI economy powered by human agency. Key missions cannot…

PartnershipDecember 16, 2021Groq Accelerates COVID Drug Discovery by 333x for Argonne National LabIn early 2020, Argonne National Laboratory started collaborating with scientists from around the world to fight the SARS-CoV-2 virus with accelerated drug discovery. Using artificial intelligence (AI) initiatives, they created machine learning (ML) models of the virus and used them to screen a database including billions of candidate drug molecules. These simulations enabled them to identify high-potential lead compounds to be used in clinical therapy trials.Argonne has partnered with Groq over the last year to realize hardware acceleration possible by using GroqChip™ and the associated software suite, GroqWare™. Specifically, Groq’s solution delivers 333X better performance versus their existing GPU solution, reducing the time to solution for these algorithms from days to minutes.“Using the Groq platform at Argonne, we were able to accelerate our efforts to identify promising COVID-19 drug candidates from a vast number of small molecules,” said Argonne computational scientist Tom Brettin. “The system’s AI capabilities enabled us to achieve significantly more inferences a second, reduc…

CompanyApril 2, 2024Real-time AI Inference Demand Accelerates on GroqCloud70,000 Developers in the Playground on GroqCloud™ and 19,000 New Applications Running on the LPU™ Inference EngineMOUNTAIN VIEW, CA, April 2, 2024 – Groq®, a generative AI solutions company, announced today that more than 70,000 new developers are using GroqCloud™and more than 19,000 new applications are running on the LPU™ Inference Engine via the Groq API. The rapid migration to GroqCloud since its launch on March 1st indicates a clear demand for real-time inference as developers and companies seek lower latency and greater throughput for their generative and conversational AI applications.From AI influencers and startups to government agencies and large enterprises, the enthusiastic reception of GroqCloud from the developer community has been truly exciting. I'm not surprised by the unprecedented level of interest in GroqCloud. It's clear that developers are hungry for low-latency AI inference capabilities, and we're thrilled to see how it's being used to bring innovative ideas to life. Every few hours, a new app is launched or updated that uses our API.Sunny Madra, GroqCloud General ManagerThe total addre…

PartnershipSeptember 12, 2024Aramco Digital and Groq Announce Progress in Building the World’s Largest Inferencing Data Center in Saudi Arabia Following LEAP MOU SigningMountain View, CA & Riyadh, Saudi Arabia – 12 September 2024 – Following the signing of a Memorandum of Understanding (MoU) during LEAP, Aramco Digital, the digital and technology subsidiary of Aramco, and Groq, a leader in AI inference and creator of the Language Processing Unit (LPU), announced their partnership to establish the world’s largest inferencing data center in the Kingdom of Saudi Arabia. This strategic collaboration marks a significant step forward in advancing the Kingdom’s digital transformation initiatives and solidifying its position as a global leader in AI and cloud computing.The inferencing data center will play a pivotal role in Aramco Digital’s vision to leverage advanced technologies that drive operational excellence and support the Kingdom’s program, Vision 2030. By combining cutting-edge AI and ML infrastructure from Groq with Aramco Digital’s strategic goals, this partnership aims to revolutionize data processing and analytics across various sectors. The facility will process billions of t…

PartnershipSeptember 12, 2024Groq Partners with Aramco on World’s Largest AI Data CenterJonathan Ross, CEO and Founder of Groq, and Tareq Amin, CEO of Aramco Digital, a subsidiary of Saudi Aramco, proudly announced their partnership to build the largest AI inference data center in Saudi Arabia. The data center will leverage Groq® LPU™ AI inference technology, advanced AI processors designed specifically for massive-scale inference workloads and delivering speed and efficiency.Tareq Amin stated, “With the support of the Kingdom's leadership, we are proud to partner with Groq to develop a world-leading inferencing data center in Saudi Arabia. This initiative not only aims to create the largest facility of its kind but also ensures seamless access to advanced AI computing power for everyone, offered through our digital marketplace, nawat, in a flexible “as-a-Service” model. Our collaboration with Groq aligns directly with Vision 2030, promoting the localization of advanced technologies, driving innovation, enhancing sustainability, and reinforcing digital excellence within the Kingdom.”This strategic partnership will play a pivotal role in Aramco Digital’s vision to leverage advanced …

ResearchDecember 12, 2024What is AI Inference? ML Basics ExplainedThe rapidly evolving field of Artificial Intelligence (AI) has led to significant advancements in Machine Learning (ML), with "inference" emerging as a crucial concept. But what exactly is inference, and how does it work in a way that you can make most useful for your AI-based applications?First, Understanding Inference.In the context of ML, inference refers to the process of utilizing a trained model to make predictions, draw conclusions, or generate text about new, unseen data. This stage is the culmination of the ML pipeline, where the model is deployed to produce outputs based on the patterns, relationships, and insights it acquired during the training phase of AI. Don’t worry, we’ll explain more later in this post. Inference is a critical step, as it enables ML models to be applied in real-world scenarios, such as:Language translation: Translating text from one language to anotherText summarization: Condensing long pieces of text into concise summariesSentiment analysis: Determining the emotional tone or sentiment behind a piece of textImage classification: Identifying objects or patterns within imagesSpeech rec…

PlatformMarch 7, 2025What is a Language Processing Unit?OverviewGroq LPU™ AI Inference TechnologyGroq builds fast AI inference. Groq® LPU™ AI inference technology delivers exceptional AI compute speed, quality, and affordability at scale.Groq AI inference infrastructure, specifically GroqCloud™, is powered by the Language Processing Unit (LPU), a new category of processor. Groq created and built the LPU from the ground up to meet the unique needs of AI. LPUs run Large Language Models (LLMs) and other leading models at substantially faster speeds and, on an architectural level, up to 10x more efficiently from an energy perspective compared to GPUs.Below are the four core design principles of the Groq LPU and why its architecture delivers such exceptional performance.BackgroundFrom Moore’s Law to AI InferenceFor decades computer software was the beneficiary of Moore’s Law, Gordon Moore’s self-fulfilling 1965 prophecy that the processing power of a chip would double roughly every two years while keeping costs steady. The law held for several decades, aided by the growing use of multi-core processors (CPUs and GPUs).Each step of this hardware progression introduced more complexity into…

CompanyNovember 6, 2024The Five Future Stages of Generative AIThis blog is adapted from an original post by Groq CEO and Founder, Jonathan Ross.If Large Language Models (LLMs) are the printing press of the Generative AI age, then what’s next? What will be the AI equivalent of the telephone, the internet, the smartphone?Today, looking at the progression of LLMs, we can begin speculating about when we will achieve Artificial General Intelligence (AGI), whereby AI systems can understand, learn, think, and reason at a human-level. But that’s like expecting to build the likes of LinkedIn or Facebook on the back of a printing press. Every technological age has substages, each of which takes time to mature. For example, the first mobile devices – portable radios – came onto the market in the 1950s and cellular car phones were introduced in the 1980s, but smartphones didn’t come along until the 2000s and didn’t become ubiquitous for another decade after that.What are those equivalent stages for Gen AI, the five future stages that will eventually lead to AGI? Here’s what we think:Stage 1: LUI – Language User Interface (Today)Instead of using keyboards, clicks, and pointing devices like mice…

ResearchOctober 21, 2024Context Length in LLMs: Optimize Business AI PerformanceWhat is Context Length?As businesses look to leverage Large Language Models (LLMs) for conversational AI, generative AI, and analytics, a crucial factor often gets overlooked: context length, also known as context window. The length of input text that an LLM can process significantly affects not only its performance and quality, but also the types of solutions and user experiences it can support. In this post, we'll explore the importance of LLM context length and provide practical guidance on selecting the optimal context length for your business application, ensuring you get the most out of your AI investment.Context length refers to the maximum number of tokens (words, characters, or subwords) that an LLM can process in a single input. This limit is typically determined by the model's architecture, training data, and computational resources. For example, popular LLMs range in size from GPT-1 at 512 tokens, to the Llama models going from Llama 2 at 4,096 to Llama 3 at 8,192 all the way to 3.1 at 128,000.In an interview with Lex Friedman on the future of LLMs, Sam Altman, CEO of OpenAI commented, "If w…

PlatformMarch 13, 2025Batch Processing with GroqCloud™ for AI Inference WorkloadsGroqCloud™ provides fast inference for complex AI solutions that require instant responsiveness. But what happens when your use cases expand and require features beyond speed? That’s where Batch Processing comes in –now you can use GroqCloud at scale to process massive workloads.Let’s say you have some large-scale datasets you want to analyze or summarize. Or you have a large set of images that need captioning. Or run validation and quality tests on a new AI program. The GroqCloud Batch Processing API, available to Developer and Enterprise Tier customers, the perfect solution for these use cases and more.Batch Processing allows users to batch together non-time sensitive requests or submit large scale workloads and get a response back within 24 hours. For bulk processing made easy, it’s perfect for tasks like large scale data classification, translations, document summaries, and image to text workloads. All at a 25% discount to normal on-demand pricing without taxing rate limits.Experience a broader range of batch processing models with newly added support for Llama 3.3 70B, DeepSeek-R1-Distill-Llama-70…

ResearchFebruary 8, 2024Groq LPU Tops Latency & Throughput in BenchmarkGroq Represents a “Step Change” in Inference Speed Performance According to ArtificialAnalysis.aiWe’re opening the second month of the year with our second LLM benchmark, this time by ArtificialAnalysis.ai. Spoiler: The Groq LPU™ Inference Engine performed so well that the chart axes had to be extended to plot Groq on the Latency vs. Throughput chart. But before we dive into the results, let's talk about the setup.This benchmark is an analysis of Meta AI’s Llama 2 Chat (70B) across metrics including quality, latency, throughput tokens per second, price, and others. Groq joined other API Host providers including Microsoft Azure, Amazon Bedrock, Perplexity, Together.ai, Anyscale, Deepinfra, Fireworks, and Lepton.Conducted independently, ArtifiicalAnalysis.ai benchmarks compare the hosting providers across key performance indicators including throughput versus price, latency versus throughput, throughput over time, total response time, and throughput variance. The benchmarks are 'live’ meaning they’re updated every three hours (eight times per day) and prompts are unique, around 100 tokens in length, and generate ~…

CompanyJuly 6, 2025Groq Launches European Data Center Footprint in Helsinki, FinlandExpands its unmatched global capacity for AI inference, in collaboration with Equinix, to deliver the speed and low-cost customers count on to scale.MOUNTAIN VIEW, Calif., July 6, 2025 — Groq, a global pioneer in AI inference, today announced the continued expansion of its global data center network, establishing its first European data center footprint in Helsinki, Finland to meet the growing demands of European customers. Groq is a leading AI inference provider, delivering the capacity and low cost that production AI workloads demand, so customers can move fast and keep their advantage in the changing AI landscape.“As demand for AI inference continues at an ever-increasing pace, we know that those building fast need more – more capacity, more efficiency, and with a cost that scales,” said Jonathan Ross, CEO and Founder of Groq. “With our new European data center, customers get the lowest latency possible and infrastructure ready today. We’re unlocking developer ambition now, not months from now.”The new European footprint, established in collaboration with Equinix in Helsinki, Finland, brings AI i…

PartnershipDecember 24, 2025Groq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale Today, Groq announced that it has entered into a non-exclusive licensing agreement with Nvidia for Groq’s inference technology. The agreement reflects a shared focus on expanding access to high-performance, low cost inference.As part of this agreement, Jonathan Ross, Groq’s Founder, Sunny Madra, Groq’s President, and other members of the Groq team will join Nvidia to help advance and scale the licensed technology.Groq will continue to operate as an independent company with Simon Edwards stepping into the role of Chief Executive Officer.GroqCloud will continue to operate without interruption.

Trademark PolicyEffective Date: October 24, 2025See our previous Trademark Policy here. OverviewThis Trademark Policy (“Policy”) explains when and how third parties may reference or use the trademarks, logos, icons, names, and other brand features of Groq LLC (“Groq”) and its affiliates (“Groq Marks”).OwnershipGroq Marks, including GROQ, GroqCloud, GroqChat, GroqConsole, and other GROQ-formative marks, logos, icons, product names, and any brand features - are proprietary assets owned by Groq. GROQ is a trademark or registered trademark of Groq LLC in the U.S. and/or other countries. Nothing in this policy transfers ownership. If you are unsure whether a mark falls under Groq Marks, contact us at [email protected] Use Without PermissionExcept for limited “nominative fair use”, you must not use Groq Marks without prior written permission from Groq. Any permission granted is limited, non-exclusive, non-transferable, and revocable at will. We may change or terminate permissions at any time.Core Usage RulesReach out to Groq at [email protected] for a copy of its Brand Guidelines.Nominative Fair UseYou may refer to Groq or Groq products by name (e.g., product compatibilit…