Groq · Indexed content

Contact usPut AIto work

GroqPlatformBuild your perfect stack. GroqMetal provides infrastructure, GroqCore adds inference, and GroqAssured adds enterprise controls. Each includes the layers below.Start BuildingInfrastructureGroqMetalDedicated bare-metal infrastructure, tuned for speed and reliability, with full control in your hands.InferenceGroqCoreA tested inference stack that turns dedicated capacity into production-ready performance, no infrastructure expertise required.ControlGroqAssuredEnterprise-grade governance, auditability, and control layered on top, so scale never comes at the cost of trust.256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference compute256 LPUs per rack40 PB/s SRAM bandwidth1,000 tokens/sec/user128 GB of on-chip SRAM per rack315 PFLOPS of FP8 inference computeLPXGroq operates fast, reliable inference at massive scale with fine-grained control.When released, each NVIDIA Groq 3 LPX rack connects 256 next-generation LPU accelerators to NVIDIA’s Vera Rubin to deliver low-latency, large-context in…

BlogSearchPartnershipGroq Among the First to Bring NVIDIA Groq 3 LPX and Vera Rubin NVL72 to MarketAugust 24, 2026FundraisingGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudAugust 17, 2026PartnershipGroq Becomes an NVIDIA Cloud PartnerAugust 12, 2026FundraisingGroq Raises $650M to Scale Its AI Inference Cloud BusinessJune 22, 2026PlatformGroqCloud: Expanding to Meet Demand February 16, 2026PartnershipGroq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale December 24, 2025PartnershipGroq Partners with U.S. Department of Energy to Advance AI Inference and Next-Generation Computing Infrastructure December 18, 2025CompanyGroq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI InferenceNovember 17, 2025PartnershipGroq Partners with Paytm: Delivering Real-Time AI for Payments and Platform Intelligence in IndiaNovember 5, 2025PartnershipGroq Powers HUMAIN One, a Real-Time AI Operating System for EnterpriseOctober 28, 2025PartnershipGroq Partners with Aljammaz Technologies to Power AI Inference Across MENAOctober 17, 2025PartnershipMcLaren Racing announces Groq…

From siliconto cloudGroq delivers fast, reliable inference close to users around the world.More than five million developers and thousands of AI-native companies run trillions of tokens on Groq each week.Now we're building the premier neocloud for inference in one integrated stack anchored by bare-metal infrastructure, which powers production-ready inference, with robust enterprise governance and control.Hard-woninferenceexpertiseGroq’s leaders took the LPU from silicon to a global production cloud, bringing together inference operations, hyperscale infrastructure, and enterprise software.CEOAdam WinterAdam Winter is Chief Executive Officer of Groq, where he leads the company’s expansion as a global AI infrastructure business focused on inference at scale. Groq operates data centers across North America, Europe, the Middle East and Asia-Pacific. Over a 30-year career in technology, Adam has worked through two defining platform shifts: the rise of the internet and now artificial intelligence. He spent more than a decade at Cisco during the internet’s transformation of enterprise technology, before going on to build and scale businesses across cloud, cybersecurity and AI. Adam joined…

Termsand policiesTerms of Use>Privacy Policy>Cookie Policy>Security>Trademark Policy>Photography & Filming Policy>Recruitment Fraud Awareness>

Every customer served.Every product sold.Every commit merged.Every agent task completed.That’s inference.Training creates the possibility.Inference creates the value.The more we ask of AI, the more inference it takes.And inference is becoming the bottleneck.Groq was built for this.We pioneered the LPU.Now, with LPX, it works alongside NVIDIA’s next-generation GPUs to deliver unparalleled inference capability, reliably, affordably, at scale.Fast or affordable is no longer a tradeoff.We’re building hundreds of megawatts of capacity, with many more on the way.Groq makes inference work at scale.premierneocloudforfastinferenceTerms and policiesPlatformCompanyBlogContactStart building

FundraisingAugust 17, 2026Groq Closes $350 million Series A, Building the World's Leading AI Inference CloudGroq Closes $350 million Series A, Building the World's Leading AI Inference CloudNew capital values the company at $3.5 billion and accelerates the build-out of Groq's global inference footprintDisruptive led the round with planned participation from NVIDIA, as the companies continue their partnership to develop inference at scaleSan Francisco, CA, August 17, 2026 — Groq LLC (“Groq”) today announced a $350 million Series A fundraise and the round was led by Disruptive, with planned participation from NVIDIA. The fundraise values the company at $3.5 billion. This latest round, together with $650 million raised in June 2026, brings recent funding in the company to $1 billion.Groq today operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific. The company serves more than six million developers, Fortune 500 enterprises and thousands of AI-native companies. The injection of capital will support those seeking usage of medium and larger sized clusters of NVIDIA accelerated computing for training and inference. Groq expects to scale from 54 megawatts…

PartnershipOctober 17, 2025Groq Partners with Aljammaz Technologies to Power AI Inference Across MENAAnnounced at GITEX Global 2025DUBAI, UAE – October 17, 2025 – Groq, the inference-first AI company, is proud to partner with Aljammaz Technologies, the region's leading value-added distributor, to bring Groq's high-performance LPU technology to enterprises, governments, and developers across the region.The partnership comes at a critical inflection point in AI adoption. As organizations move from experimentation to production deployment, inference speed, cost, and energy efficiency have emerged as defining constraints. Groq's LPU technology is purpose-built for AI inference rather than adapted from graphics processing and it enables a new class of real-time AI applications that were previously impractical with traditional GPU architectures.Under the collaboration, Aljammaz will distribute Groq’s full suite of AI inference solutions — including GroqCloud, Groq’s full-stack cloud platform, and GroqRack, its on-premises compute cluster — through its extensive network of system integrators and resellers. Together, the companies aim to enable real-time AI deployment at scale, reducing la…

PartnershipSeptember 26, 2025McLaren Racing announces Groq as an Official Partner of the McLaren Formula 1 TeamMountain View, Calif. & Woking, UK — September 26, 2025 — McLaren Racing has announced leading inference provider Groq as an Official Partner of the McLaren Formula 1 Team.Groq will support the McLaren F1 Team in continuing its long history of turning innovation into advantage, with the integration of Groq’s custom LPU chip – the technology used for AI inference – that has been purpose-built to deliver fast, cost-efficient intelligence.As part of the partnership, Groq technology will fuel decision-making, supporting the McLaren F1 Team with analysis, development and real-time insight, as well as supercharging the processing power McLaren needs to perform efficiently.Nick Martin, Co-Chief Commercial Officer, McLaren Racing, said:“Formula 1 is about performance under pressure, so we’re excited to begin working with Groq to help deliver inference at the speed we need to support us in our efforts to stay at the front of the grid.”Chelsey Susin Kantor, Chief Marketing Officer, Groq, said:“McLaren and Groq share the same foundations: speed, precision, and the efficiency needed t…

ResearchOctober 22, 2019Why AI Requires a New Chip ArchitectureGroqArtificial intelligence (AI) is one of the most hyped buzzwords in technology today. But while everyone may be talking about AI, a much smaller number of people are successfully doing AI.According to a McKinsey report cited by Forbes, nearly three-quarters of over 2,000 organizations surveyed expect to increase investments in AI in the future, but just one in five respondents claimed they had already successfully rolled out AI in more than one process.In large part, this slow uptake of AI is due to the extreme difficulty of achieving and maintaining the high-performance processing that AI workloads require.Why is inference so hard?In part, the challenge of achieving high-performance compute processing involves managing rapidly increasing volumes of data. Data scientists estimate that the volume of data is doubling every two years, and will reach 44 zettabytes by 2020 – in other words, there will be more than 40 times more bytes of data than there are stars in the observable universe.In addition, to meet human-like inference performance with neural networks will require exponential increases in model complexity and c…

CompanyFebruary 10, 2025Saudi Arabia Announces $1.5 Billion Expansion to Fuel AI-powered Economy with AI Tech Leader GroqMountain View, California & Riyadh, Saudi Arabia – February 10, 2025 – Silicon Valley AI pioneer Groq has secured a $1.5 billion commitment from the Kingdom of Saudi Arabia (KSA) for expanded delivery of its advanced LPU-based AI inference infrastructure. Announced at LEAP 2025, this major agreement advances the Kingdom’s position as a global leader in AI computing infrastructure while meeting rapidly growing regional demand.This agreement follows the operational excellence Groq demonstrated in building the region’s largest inference cluster in December 2024. Brought online in just eight days, the rapid installation established a critical AI hub to serve surging compute demand globally.From its state-of-the-art data center in Dammam, Saudi Arabia, Groq is now delivering market-leading AI inference capabilities to customers worldwide through GroqCloud™. At LEAP 2025, Jonathan Ross, CEO and Founder of Groq, alongside Tareq Almin and Ahmad O. Al-Khowaiter, Chief Technology Officer of Saudi Aramco, demonstrated reasoning LLMs, a KSA-created model Allam, and text to s…

CompanyOctober 26, 2023Groq Showcases Fastest GenAI Inference for LLMs at SC23MOUNTAIN VIEW, CA, October 26, 2023 — Groq, an artificial intelligence (AI) solutions company, announced today that it will have a booth and multiple talks at the premier industry conference for high performance compute, SC23, from November 12-17 in Denver, CO. Groq and their team will be showcasing a demo of the world’s best low latency performance for Large Language Models (LLMs) running on a Language Processing Unit™ system, its next-gen AI accelerator. Subject matter experts from Groq will be presenting four sessions during the conference on a range of HPC, AI, and research-related topics.Jim Miller, VP of Engineering at Groq, and former engineering leader at Qualcomm, Broadcom, and Intel, shared, “The scale and performance of systems used for AI today is enormous, and will get larger if built with legacy technology. At Groq we are setting a new standard with our LPU™-based systems that improve performance, power, and scale when serving a large customer base. This is thanks to the hard work and innovative ideas of our dedicated team of engineers at Groq who are committed to solving truly novel problem…

ResearchFebruary 13, 2024Groq® LPU™ Inference Engine Leads in First Independent LLM BenchmarkArtificialAnalysis.ai Adjusts Chart Axes to Accommodate Groq Performance LevelsMOUNTAIN VIEW, CA, February 13, 2024 – Groq®, a generative AI solutions company, is the clear winner in the latest large language model (LLM) benchmark by ArtificialAnalysis.ai, besting eight participants in key performance indicators including Latency vs. Throughput, Throughput over Time, Total Response Time, and Throughput Variance. The Groq LPU™ Inference Engine performed so well with a leading open source LLM from Meta AI, Llama 2-70b, that axes had to be extended to plot Groq on the Latency vs. Throughput chart. Groq participated in its first public LLM benchmark in January 2024 with competition-crushing results.“ArtificialAnalysis.ai has independently benchmarked Groq’s Llama 2 Chat (70B) API as achieving throughput of 241 tokens per second, more than double the speed of other hosting providers,” said ArtificialAnalysis.ai Co-creator Micah Hill-Smith. “Groq represents a step change in available speed, enabling new use cases for large language models.”Source: ArtificialAnalysis.aiGroq has run several interna…

PartnershipMay 6, 2024Groq Powers NAIRR Pilot with Fastest AI Inference EngineReal-time Inference Leader Joins Elite Group Offering U.S.-based Researchers and Educators Access to Cutting-edge AI Technologies, Powering Responsible AI InnovationMOUNTAIN VIEW, Calif., May 6, 2024 – Groq®, the leader in real-time AI inference, announced its participation in the National Artificial Intelligence Research Resource (NAIRR) Pilot today. The Pilot, a U.S. National Science Foundation-led program, marks the first step towards creating a shared national research infrastructure to connect U.S. researchers and educators to responsible and trustworthy AI research resources. In collaboration with 13 federal agencies and 25 private sector, nonprofit, and philanthropic organizations, Groq is powering the next phase of responsible AI research, discovery, and innovation by providing access to its LPU™ Inference Engine – the only solution delivering real-time AI inference today – via GroqCloud™.“Groq was founded, in part, to end the ‘haves and have-nots’ in AI,” said Groq Public Sector President Aileen Black. “Lack of access to necessary resources should never prevent a researcher from succeeding at the…

PartnershipMay 7, 2024Groq and Carahsoft Deliver Rapid AI Inference to U.S. AgenciesPartnership Ensures Direct Access to the Groq LPU™ Inference Engine for Critical Missions for Local, State and Federal GovernmentsMOUNTAIN VIEW, Calif., and RESTON, Va. – May 7, 2024 – Groq®, the leader in real-time AI inference, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, today announced a partnership to deliver fast and cost- and energy-efficient AI inference speed to Government agencies and Federal systems integrators throughout the United States. Under the distribution agreement, Carahsoft will serve as Public Sector distributor for Groq, making its innovative AI inference solutions available to the Public Sector through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V contracts.Accessed through GroqCloud™ via an API or a private cloud, the Groq LPU™ Inference Engine is a cutting-edge AI inference technology. It is revolutionizing Government use cases, including accelerated analyst velocity, continuous monitoring with visualized graph intelligence and GenAI-accelerated contract search, discussion, and bid proposal drafti…

PartnershipDecember 16, 2021Groq Accelerates COVID Drug Discovery by 333x for Argonne National LabIn early 2020, Argonne National Laboratory started collaborating with scientists from around the world to fight the SARS-CoV-2 virus with accelerated drug discovery. Using artificial intelligence (AI) initiatives, they created machine learning (ML) models of the virus and used them to screen a database including billions of candidate drug molecules. These simulations enabled them to identify high-potential lead compounds to be used in clinical therapy trials.Argonne has partnered with Groq over the last year to realize hardware acceleration possible by using GroqChip™ and the associated software suite, GroqWare™. Specifically, Groq’s solution delivers 333X better performance versus their existing GPU solution, reducing the time to solution for these algorithms from days to minutes.“Using the Groq platform at Argonne, we were able to accelerate our efforts to identify promising COVID-19 drug candidates from a vast number of small molecules,” said Argonne computational scientist Tom Brettin. “The system’s AI capabilities enabled us to achieve significantly more inferences a second, reduc…

CompanyApril 2, 2024Real-time AI Inference Demand Accelerates on GroqCloud70,000 Developers in the Playground on GroqCloud™ and 19,000 New Applications Running on the LPU™ Inference EngineMOUNTAIN VIEW, CA, April 2, 2024 – Groq®, a generative AI solutions company, announced today that more than 70,000 new developers are using GroqCloud™and more than 19,000 new applications are running on the LPU™ Inference Engine via the Groq API. The rapid migration to GroqCloud since its launch on March 1st indicates a clear demand for real-time inference as developers and companies seek lower latency and greater throughput for their generative and conversational AI applications.From AI influencers and startups to government agencies and large enterprises, the enthusiastic reception of GroqCloud from the developer community has been truly exciting. I'm not surprised by the unprecedented level of interest in GroqCloud. It's clear that developers are hungry for low-latency AI inference capabilities, and we're thrilled to see how it's being used to bring innovative ideas to life. Every few hours, a new app is launched or updated that uses our API.Sunny Madra, GroqCloud General ManagerThe total addre…

PartnershipSeptember 12, 2024Aramco Digital and Groq Announce Progress in Building the World’s Largest Inferencing Data Center in Saudi Arabia Following LEAP MOU SigningMountain View, CA & Riyadh, Saudi Arabia – 12 September 2024 – Following the signing of a Memorandum of Understanding (MoU) during LEAP, Aramco Digital, the digital and technology subsidiary of Aramco, and Groq, a leader in AI inference and creator of the Language Processing Unit (LPU), announced their partnership to establish the world’s largest inferencing data center in the Kingdom of Saudi Arabia. This strategic collaboration marks a significant step forward in advancing the Kingdom’s digital transformation initiatives and solidifying its position as a global leader in AI and cloud computing.The inferencing data center will play a pivotal role in Aramco Digital’s vision to leverage advanced technologies that drive operational excellence and support the Kingdom’s program, Vision 2030. By combining cutting-edge AI and ML infrastructure from Groq with Aramco Digital’s strategic goals, this partnership aims to revolutionize data processing and analytics across various sectors. The facility will process billions of t…

PartnershipSeptember 12, 2024Groq Partners with Aramco on World’s Largest AI Data CenterJonathan Ross, CEO and Founder of Groq, and Tareq Amin, CEO of Aramco Digital, a subsidiary of Saudi Aramco, proudly announced their partnership to build the largest AI inference data center in Saudi Arabia. The data center will leverage Groq® LPU™ AI inference technology, advanced AI processors designed specifically for massive-scale inference workloads and delivering speed and efficiency.Tareq Amin stated, “With the support of the Kingdom's leadership, we are proud to partner with Groq to develop a world-leading inferencing data center in Saudi Arabia. This initiative not only aims to create the largest facility of its kind but also ensures seamless access to advanced AI computing power for everyone, offered through our digital marketplace, nawat, in a flexible “as-a-Service” model. Our collaboration with Groq aligns directly with Vision 2030, promoting the localization of advanced technologies, driving innovation, enhancing sustainability, and reinforcing digital excellence within the Kingdom.”This strategic partnership will play a pivotal role in Aramco Digital’s vision to leverage advanced …

ResearchDecember 12, 2024What is AI Inference? ML Basics ExplainedThe rapidly evolving field of Artificial Intelligence (AI) has led to significant advancements in Machine Learning (ML), with "inference" emerging as a crucial concept. But what exactly is inference, and how does it work in a way that you can make most useful for your AI-based applications?First, Understanding Inference.In the context of ML, inference refers to the process of utilizing a trained model to make predictions, draw conclusions, or generate text about new, unseen data. This stage is the culmination of the ML pipeline, where the model is deployed to produce outputs based on the patterns, relationships, and insights it acquired during the training phase of AI. Don’t worry, we’ll explain more later in this post. Inference is a critical step, as it enables ML models to be applied in real-world scenarios, such as:Language translation: Translating text from one language to anotherText summarization: Condensing long pieces of text into concise summariesSentiment analysis: Determining the emotional tone or sentiment behind a piece of textImage classification: Identifying objects or patterns within imagesSpeech rec…

PlatformMarch 7, 2025What is a Language Processing Unit?OverviewGroq LPU™ AI Inference TechnologyGroq builds fast AI inference. Groq® LPU™ AI inference technology delivers exceptional AI compute speed, quality, and affordability at scale.Groq AI inference infrastructure, specifically GroqCloud™, is powered by the Language Processing Unit (LPU), a new category of processor. Groq created and built the LPU from the ground up to meet the unique needs of AI. LPUs run Large Language Models (LLMs) and other leading models at substantially faster speeds and, on an architectural level, up to 10x more efficiently from an energy perspective compared to GPUs.Below are the four core design principles of the Groq LPU and why its architecture delivers such exceptional performance.BackgroundFrom Moore’s Law to AI InferenceFor decades computer software was the beneficiary of Moore’s Law, Gordon Moore’s self-fulfilling 1965 prophecy that the processing power of a chip would double roughly every two years while keeping costs steady. The law held for several decades, aided by the growing use of multi-core processors (CPUs and GPUs).Each step of this hardware progression introduced more complexity into…

CompanyNovember 6, 2024The Five Future Stages of Generative AIThis blog is adapted from an original post by Groq CEO and Founder, Jonathan Ross.If Large Language Models (LLMs) are the printing press of the Generative AI age, then what’s next? What will be the AI equivalent of the telephone, the internet, the smartphone?Today, looking at the progression of LLMs, we can begin speculating about when we will achieve Artificial General Intelligence (AGI), whereby AI systems can understand, learn, think, and reason at a human-level. But that’s like expecting to build the likes of LinkedIn or Facebook on the back of a printing press. Every technological age has substages, each of which takes time to mature. For example, the first mobile devices – portable radios – came onto the market in the 1950s and cellular car phones were introduced in the 1980s, but smartphones didn’t come along until the 2000s and didn’t become ubiquitous for another decade after that.What are those equivalent stages for Gen AI, the five future stages that will eventually lead to AGI? Here’s what we think:Stage 1: LUI – Language User Interface (Today)Instead of using keyboards, clicks, and pointing devices like mice…

ResearchOctober 21, 2024Context Length in LLMs: Optimize Business AI PerformanceWhat is Context Length?As businesses look to leverage Large Language Models (LLMs) for conversational AI, generative AI, and analytics, a crucial factor often gets overlooked: context length, also known as context window. The length of input text that an LLM can process significantly affects not only its performance and quality, but also the types of solutions and user experiences it can support. In this post, we'll explore the importance of LLM context length and provide practical guidance on selecting the optimal context length for your business application, ensuring you get the most out of your AI investment.Context length refers to the maximum number of tokens (words, characters, or subwords) that an LLM can process in a single input. This limit is typically determined by the model's architecture, training data, and computational resources. For example, popular LLMs range in size from GPT-1 at 512 tokens, to the Llama models going from Llama 2 at 4,096 to Llama 3 at 8,192 all the way to 3.1 at 128,000.In an interview with Lex Friedman on the future of LLMs, Sam Altman, CEO of OpenAI commented, "If w…

CompanyJuly 6, 2025Groq Launches European Data Center Footprint in Helsinki, FinlandExpands its unmatched global capacity for AI inference, in collaboration with Equinix, to deliver the speed and low-cost customers count on to scale.MOUNTAIN VIEW, Calif., July 6, 2025 — Groq, a global pioneer in AI inference, today announced the continued expansion of its global data center network, establishing its first European data center footprint in Helsinki, Finland to meet the growing demands of European customers. Groq is a leading AI inference provider, delivering the capacity and low cost that production AI workloads demand, so customers can move fast and keep their advantage in the changing AI landscape.“As demand for AI inference continues at an ever-increasing pace, we know that those building fast need more – more capacity, more efficiency, and with a cost that scales,” said Jonathan Ross, CEO and Founder of Groq. “With our new European data center, customers get the lowest latency possible and infrastructure ready today. We’re unlocking developer ambition now, not months from now.”The new European footprint, established in collaboration with Equinix in Helsinki, Finland, brings AI i…

PartnershipDecember 24, 2025Groq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale Today, Groq announced that it has entered into a non-exclusive licensing agreement with Nvidia for Groq’s inference technology. The agreement reflects a shared focus on expanding access to high-performance, low cost inference.As part of this agreement, Jonathan Ross, Groq’s Founder, Sunny Madra, Groq’s President, and other members of the Groq team will join Nvidia to help advance and scale the licensed technology.Groq will continue to operate as an independent company with Simon Edwards stepping into the role of Chief Executive Officer.GroqCloud will continue to operate without interruption.