{domain:"www.qualitydigest.com",server:"169.47.211.87"} Skip to main content

        
User account menu
Main navigation
  • Topics
    • Customer Care
    • Regulated Industries
    • Research & Tech
    • Quality Improvement Tools
    • People Management
    • Metrology
    • Manufacturing
    • Roadshow
    • QMS & Standards
    • Statistical Methods
    • Resource Management
  • Videos/Webinars
    • All videos
    • Product Demos
    • Webinars
  • Advertise
    • Advertise
    • Submit B2B Press Release
    • Write for us
  • Metrology Hub
  • Training
  • Subscribe
  • Log in
Mobile Menu
  • Home
  • Topics
    • Customer Care
    • Regulated Industries
    • Research & Tech
    • Quality Improvement Tools
    • People Management
    • Metrology
    • Manufacturing
    • Roadshow
    • QMS & Standards
    • Statistical Methods
    • Supply Chain
    • Resource Management
  • Login / Subscribe
  • More...
    • All Features
    • All News
    • All Videos
    • Training

Language Lessons: How LLMs Are Transforming Research

Stanford GSB faculty are using AI to analyze text at unprecedented speed and scale

Saiman Chow

It has become routine for researchers to interpret documents containing billions of words.

Dave Gilson
Bio

Stanford Graduate School of Business

Wed, 08/26/2026 - 12:01
  • Comment
  • RSS

Social Sharing block

  • Print
Body

When President Donald Trump announced a wave of tariffs in early 2025, he launched a war of words. Threats and counterthreats flew across the Atlantic and Pacific in a swirl of escalation, retaliation, and reprieve. Economists were hard-pressed to get a clear picture of what was happening beyond the headlines. Solid numbers would not be available for weeks or months, and when they arrived they would capture only part of the story.

ADVERTISEMENT

“As economists, we would like to track how all this geoeconomic pressure gets applied,” says Antonio Coppola, an assistant professor of finance at Stanford Graduate School of Business and a faculty fellow at the Stanford Institute for Economic Policy Research (SIEPR). “But a lot of it is not going to show up in the standard tabular data sets.”

‘‘It’s really exciting that AI tools designed to analyze language can be easily adapted to solve very different problems across the sciences.’
—Susan Athey

Specifically, Coppola and his colleagues at the Global Capital Allocation Project, based at Stanford GSB, wanted to know how businesses in the U.S. and around the world were responding to the shakeup. Are they changing their prices? Are they adjusting their supply chains? Are they undertaking new R&D to develop products that fall short of export control criteria?

The answers were out there. Yet they were embedded in a sprawling, messy source: tens of millions of words written and spoken by executives and analysts.

Teaming up with Matteo Maggiori, a professor of finance at Stanford GSB and senior fellow at SIEPR, and two colleagues at Yale and Columbia, Coppola assembled a tranche of earnings call transcripts and analyst reports—more than 780,000 documents from more than 21,000 companies spanning more than a decade. They then fed this text into large language models (LLMs) running on Stanford’s high-performance computing clusters.

The LLMs cut through the fog of the trade war to find rich evidence of spiking concerns and shifts in strategy in the weeks following Trump’s “Liberation Day” announcement in April 2025. More than 30% of all earnings calls mentioned negative impacts from tariffs, and more than 60% of calls from U.S. firms reported negative effects.

In the not-so-distant past, research like this would have involved sending out surveys, searching for keywords, or recruiting an army of grad students. The work would be laborious and expensive, and the results might be superficial and outdated. By tapping into the power of pretrained language models, Coppola, Maggiori, and their colleagues were able to generate findings that were expansive, granular—and fast.

“We can extract this detailed information at a high frequency—and in almost real time,” Coppola says. (The latest data are available in an online dashboard.) Their study was further evidence that when it comes to scale, speed, and sophistication, AI-driven language analysis is leaving traditional research methods in the dust.

The search for meaning

From its earliest days, the development of artificial intelligence has been inseparable from the goal of getting computers to understand the complexities of human language. What most people now know as AI—chatbots that display dazzling linguistic fluency and can be instructed without code—is the most dramatic milestone in this quest.

‘‘They just allow you to comb through a scale of content that no human coder could conceivably do.’
—Douglas Guilbeault

“When ChatGPT was released in November 2022 and exploded into the public consciousness, that was the culmination of a long process of developments in computational methods that can be traced back to the ’90s,” says Amir Goldberg, a professor of organizational behavior at Stanford GSB. A key breakthrough came in 2017 with the introduction of the transformer, a neural network architecture designed to learn linguistic patterns from massive quantities of text. Combined with advances in machine learning and an explosion of computing power, this made today’s generative AI systems possible and opened opportunities for research with unprecedented scope.

During the past decade, it has become routine for researchers to use these quickly evolving tools to interpret bodies of text, or corpora, that may contain millions of documents or billions of words. “They just allow you to comb through a scale of content that no human coder could conceivably do,” says Douglas Guilbeault, an assistant professor of organizational behavior at Stanford GSB. And their abilities go beyond digesting text. LLMs in particular “have changed the game in terms of our ability to incorporate a wide range of information into statistical models,” says Susan Athey, Ph.D., a professor of economics at Stanford GSB and a senior fellow at SIEPR.

Beyond digesting text at scale, language models can aggregate what might seem like a jumble of disconnected ideas into something coherent and quantifiable. This has made them a powerful tool for making sense of the unstructured data that, by some estimates, account for at least four-fifths of all new information being produced.

Goldberg, a sociologist and co-director of Stanford’s Computational Culture Lab, sees the “digital traces” of modern life—emails, chats, social media posts—as an informational treasure trove. “Culture is about the social processes by which meanings are negotiated and agreed upon,” he says. “The most prominent medium through which this negotiation happens is through linguistic exchange. Suddenly, this linguistic exchange became data that we could use to measure things that had been out of reach.”

In a recent study, Goldberg analyzed 14.7 million emails to measure the overlap between employees’ self-identity and their collective workplace identity. As more records are digitized, LLMs have also opened a portal into the past. When studying the origins of unconventional ideas that make their way into the mainstream, Goldberg examined 4.9 million congressional speeches and 4.2 million court decisions.

“Suddenly, we have an instrument that allows us to go back in time,” Goldberg says. “I can’t go back and ask people in the ’60s what they think. But the people in the ’60s left a lot of documents behind that I can analyze.”

More than words

While the architecture of LLMs is loosely inspired by the wiring of human brains, their approach to language is fundamentally different. “From the perspective of the neural network, it’s just a sequence of numbers,” Goldberg says. “That these numbers represent text is immaterial.” Despite this purely mathematical approach to language, the models are remarkably sensitive to context clues and semantic subtleties. For example, in Coppola and Maggiori’s study, the LLM could tell when executives or analysts were discussing the effects of geoeconomic pressure even if they didn’t use the words “tariffs,” “sanctions,” or “export controls.”

‘‘Suddenly, we have an instrument that allows us to go back in time.’
—Amir Goldberg

This ability to read between the lines has enabled researchers to glean more meaning from data, says Ada Aka, an assistant professor of marketing at Stanford GSB. In a traditional study, a volunteer might be asked to rate a product on a numeric scale, generating a single data point. Yet if they are asked for verbal feedback, their response can be processed by an LLM that might discern not only stated preferences but also the emotions and reasons behind them.

“In just the same amount of time, maybe a few seconds more, what you get is quite rich, contextual, person-specific information,” Aka says. “With this context, we can almost quantify someone’s thoughts. Language data is so rich for learning everything from what people value to their expectations, their concerns, and their uncertainties.”

Language models can also pick up on connections and patterns that aren’t obvious to people. In a study on the memorability of real brand slogans, Aka used OpenAI’s GPT model to characterize the semantic relationships of 929 slogans from more than 1,500 dimensions. Without using human data, the model demonstrated how marketers might use similar predictive tools to select catchier slogans.

Another feature of LLMs is their consistent and detached approach to analysis. “It’s not simply that no human would have the bandwidth to go through it all,” Guilbeault says. “There’s also an intrinsic cognitive limitation.” People bring their own individual sense of meaning into the equation, which affects how they interpret what they read. While language models are far from unbiased—Guilbeault has documented the gender and age stereotypes they pick up from their training material—he notes that they “can provide a bit more of an agnostic analysis.”

LLMs have also proven surprisingly useful for tackling problems that seem unrelated to language. In an upcoming Stanford GSB Quick Study video, Athey, the founding director of the Golub Capital Social Impact Lab, describes a recent study in which she deployed an LLM to answer a question that has long challenged economists: predicting people’s career paths. “My team and I wondered… could the same architecture used to create breakthroughs like ChatGPT be adapted to predict your future occupation?”

With minimal coding, Athey and her colleagues used tens of thousands of resumes to fine-tune a publicly available LLM. By analyzing job titles and patterns in work histories, this approach (dubbed LABOR-LLM, or language-based occupational representations with large language models) predicted job transitions more accurately than specialized models trained on much larger datasets. “To an LLM,” Athey says, “a sequence of jobs is a sequence of words.”

Just as LLMs have introduced the public to the potential of artificial intelligence, they have opened new possibilities for research that would have been unimaginable just a few years ago. “It’s really exciting that AI tools designed to analyze language can be easily adapted to solve very different problems across the sciences, including those that people had never thought of as text problems,” Athey says. “And this is just the beginning.”

Published May 11, 2026, by Stanford Graduate School of Business.

Add new comment

The content of this field is kept private and will not be shown publicly.
About text formats
Image CAPTCHA
Enter the characters shown in the image.

© 2026 Quality Digest. Copyright on content held by Quality Digest or by individual authors. Contact Quality Digest for reprint information.
“Quality Digest" is a trademark owned by Quality Circle Institute Inc.

footer
  • Home
  • Print QD: 1995-2008
  • Print QD: 2008-2009
  • Videos
  • Privacy Policy
  • Write for us
footer second menu
  • Subscribe to Quality Digest
  • About Us