Please ensure Javascript is enabled for purposes of website accessibility

Trump-Backed Tax-Cut and Spending Bill Passes US Senate

4 hours ago

Israeli Officials to Hold Ceasefire Talks in Washington Amid Military Escalation in Gaza

6 hours ago

Trump Escalates Feud With Musk, Threatens Tesla, SpaceX Support

6 hours ago

Musk Vows to Punish Lawmakers Who Back Trump’s Spending Bill

22 hours ago

Fresno Man Sentenced to Nearly 6 Years for $4.2 Million Tech Startup Fraud

22 hours ago

Suspect Identified in Ambush Shooting That Killed 2 Idaho Firefighters

24 hours ago

Will Valadao Spoil Trump’s Plan for July 4th ‘Big Beautiful Bill’ Signing?

1 day ago

Shaver Lake and Reedley 4th of July Shows Are Wednesday. Who Else Is Celebrating?

1 day ago
The Polls Have Shifted Toward Harris. Is It Real, or Something Else?
d8a347b41db1ddee634e2d67d08798c102ef09ac
By The New York Times
Published 11 months ago on
August 16, 2024

Political signs supporting Joe Biden and Donald Trump on a lawn in Dickson City, Pa., on Sept. 25, 2020. Last week’s New York Times/Siena College polls showing Vice President Kamala Harris leading in three swing states led some Republicans and Democrats to ask the same question: Is this real? (Mark Makela/The New York Times)

Share

Getting your Trinity Audio player ready...

Last week’s New York Times/Siena College polls showing Vice President Kamala Harris leading in three swing states led some Republicans and Democrats to ask the same question: Is this real?

Did the Polls Have It Right?

At the center of this question is whether the Times/Siena polls have surveyed enough voters who supported Donald Trump in 2020. The Trump campaign released a memo arguing those polls would have actually showed a Trump lead if the results had been weighted properly.

The Trump campaign’s critique focused on something pollsters refer to as “recalled vote.” In the polls of Pennsylvania, Michigan and Wisconsin, respondents recalled backing President Joe Biden over Trump by 6 percentage points, 52% to 46%, even though Biden actually won these three states by an average of about 1.5 points. The Trump campaign used this data point to say Trump would have led if the poll had the “right” number of Trump 2020 supporters.

This isn’t an absurd argument. In recent years, many pollsters have embraced recalled vote in exactly the way the Trump campaign describes: as an accurate measure of how people voted in the last election, which can then be used to evaluate the partisan balance of the sample. As an idea, it makes logical sense.

But over the longer run, recalled vote hasn’t usually been very reliable. Back in 2004, it was George W. Bush who led the polls, and it was the Democrats trying to prove that the polls were skewed. Among other things, they argued the polls had too many Bush ’00 voters, based on recalled vote.

Polls Found Bush and Kerry Tied

A CBS News/Times poll at the time, for instance, found Bush and John Kerry tied, but Bush ’00 voters outnumbered Al Gore ’00 voters by 6 points. Gore won the popular vote in 2000; if the poll had the “right” number of Gore supporters, Democrats thought, Kerry would have led — perhaps by a lot. Plausible, right?

Needless to say, the polls leading up to Bush’s 2004 reelection were not badly underestimating Kerry, as the recalled vote implied. This is not an isolated occurrence: Asking how people voted in the last election has been unreliable dating all the way to the earliest polls.

There are at least three factors at play: A surprising number of people don’t seem to remember how they voted; people seem likelier to remember voting for the winner (Biden in 2020; Bush in 2000); and they seem likelier to report voting when they did not.

Despite this history, more pollsters have been using recalled vote in recent years. For some pollsters with lower-quality samples, recall vote is a blunt instrument that can hammer even the worst poll into the ballpark. Indeed, if you take the last year of Times/Siena poll respondents from Manhattan — which Biden won by 74 points — you can produce an entirely plausible Trump plus-3 result for a national poll by weighting it to the 2020 result nationwide.

Even serious pollsters have used recalled vote in recent years. Some believe that the measure has become more accurate during our polarized era, which certainly seems plausible. It’s also possible that it’s more accurate for some new survey methodologies, such as panels (which attract highly engaged voters) or even just online polls in general.

But the Times/Siena data doesn’t support the idea that recalled vote has become much more useful. This year, about half of respondents without a record of voting in the 2020 election said they actually did vote. Only about 92% of those who did vote would say whom they supported — and there’s no way to be sure that the 92% were telling the truth, either.

While some pollsters — even good pollsters — say weighting on recalled vote would have made their polls more accurate in prior elections, the same cannot be said here: Times/Siena polls in 2020 and 2022 would have been less accurate if they had been weighted by recalled vote to match the election result.

It’s especially striking that recalled vote wouldn’t have helped Times/Siena polls in 2020, a year when they (along with virtually all other surveys) fairly significantly underestimated support for Trump. In fact, the Times/Siena polls would have underestimated Trump by even more if they had been weighted by recalled vote to match the actual results of the 2016 presidential election. That’s because the Times/Siena polls had “too many” Trump ’16 voters, a surprising finding but one consistent with the long history of people who voted for the losing candidate but who often later say they supported someone else.

This cycle, Times/Siena polls yet again show “too many” respondents saying they supported the winner of the last election: Biden. On average, Times/Siena respondents have recalled voting for Biden by about 3 points more than the actual results of the last election.

Is it possible that Times/Siena polls have been underestimating Trump all along? Absolutely. They certainly did in 2020, after all. Nonetheless, the Times/Siena polls so far this cycle routinely provided very positive results for Trump, even when there seemed to be “too many” Biden ’20 voters. Arguably their best result for Trump this cycle — a February poll showing him ahead by 6 points among registered voters — also found Biden with a 12-point edge on recalled vote, compared with his actual 4.5-point victory.

Despite this history, there’s still no guarantee that the Times/Siena data is correct. Even an unequivocally bad methodological decision — say, calling only landlines — can still occasionally yield a more “accurate” result if it cancels out a different kind of bias in another direction (say, Trump’s supporters being less likely to respond to a poll). Weighting on recalled vote is clearly far more debatable, but even if it is every bit as problematic it could still yield accurate results this cycle for the same reason. No one ever knows which polls — or which polling methodologies — will appear “right” or “wrong” until the election results begin to arrive.

This article originally appeared in The New York Times.

By Nate Cohn/Mark Makela
c. 2024 The New York Times Company

RELATED TOPICS:

DON'T MISS

What Are Fresno Real Estate Experts Predicting for 2025 and Beyond?

DON'T MISS

First California EV Mandates Hit Automakers This Year. Most Are Not Even Close

DON'T MISS

Clovis Police Seek Public’s Help in Finding Missing 82-Year-Old Woman

DON'T MISS

Fresno Woman Killed in Head-On Collision, CHP Investigating

DON'T MISS

Musk Vows to Punish Lawmakers Who Back Trump’s Spending Bill

DON'T MISS

Fresno Man Sentenced to Nearly 6 Years for $4.2 Million Tech Startup Fraud

DON'T MISS

Bryan Kohberger Pleads Guilty in Murders of Four Idaho Students, ABC News Reports

DON'T MISS

Wildfire Near Lake Madera Country Estates Burns 12 Acres, Now 100% Contained

DON'T MISS

Fresno County CHP Arrest Two in Interstate 5 Drug, Gun, and Counterfeit Money Bust

DON'T MISS

California Seizes Over 600,000 Pounds of Illegal Fireworks. Newsom Calls for Safe Celebrations

DON'T MISS

Where Trade Talks Stand With Major US Partners Ahead of Tariffs-Hike Deadline

DON'T MISS

Labor Icon Huerta Breaks Ground on Fresno Park Bearing Her Name

UP NEXT

Fresno Woman Killed in Head-On Collision, CHP Investigating

UP NEXT

Musk Vows to Punish Lawmakers Who Back Trump’s Spending Bill

UP NEXT

Fresno Man Sentenced to Nearly 6 Years for $4.2 Million Tech Startup Fraud

UP NEXT

Bryan Kohberger Pleads Guilty in Murders of Four Idaho Students, ABC News Reports

UP NEXT

Wildfire Near Lake Madera Country Estates Burns 12 Acres, Now 100% Contained

UP NEXT

Fresno County CHP Arrest Two in Interstate 5 Drug, Gun, and Counterfeit Money Bust

UP NEXT

California Seizes Over 600,000 Pounds of Illegal Fireworks. Newsom Calls for Safe Celebrations

UP NEXT

Where Trade Talks Stand With Major US Partners Ahead of Tariffs-Hike Deadline

UP NEXT

Labor Icon Huerta Breaks Ground on Fresno Park Bearing Her Name

UP NEXT

DOJ Announces Arrest, Indictments in North Korean IT Worker Scheme

Fresno Police Arrest Intoxicated Employee Following Morning Disturbance

2 hours ago

US Senate Strikes AI Regulation Ban From Trump Megabill

2 hours ago

Fresno Police, CHP Crack Down on Impaired Driving for July 4th

2 hours ago

Despite Last-Minute Changes, Senate Bill Deals Big Blow to Renewable Energy

3 hours ago

Zohran Mamdani Officially Wins Democratic Primary for New York City Mayor

3 hours ago

Valley Crime Stoppers’ Most Wanted Person of the Day: Amaury Fernandez

4 hours ago

CA Rolls Back Its Landmark Environmental Law to Speed Housing Construction

4 hours ago

Visalia Police Investigate Deadly Shooting Near Bethlehem Center

4 hours ago

Trump-Backed Tax-Cut and Spending Bill Passes US Senate

4 hours ago

Homeland Security Secretary Noem Says CNN May Be Prosecuted Over Report on Migration App

5 hours ago

The Chainsmokers to Headline Dog Daze Festival at Chukchansi Park

The Chainsmokers will headline the Dog Daze music festival at Chukchansi Park on Sept. 6, according to social media. The American electronic...

3 minutes ago

The Chainsmokers will headline the 18+ Dog Daze music festival at Chukchansi Park on Sept. 6, with additional performances by Iann Dior, San Pacho, P-Lo, Sage the Gemini, and more. (Shutterstock)
3 minutes ago

The Chainsmokers to Headline Dog Daze Festival at Chukchansi Park

1 hour ago

Sex Abuse Scandal Forces Fresno’s Catholic Diocese to Declare Bankruptcy

2 hours ago

California Republicans Send Message to Trump: Deport Criminals, Not Our Vital Workers

Fresno police arrested a suspect on suspicion of DUI Tuesday, July 1, 2025, morning after they showed up intoxicated to work, caused a disturbance, and struck another vehicle before arriving. (GV Wire/Anthony W. Haddad)
2 hours ago

Fresno Police Arrest Intoxicated Employee Following Morning Disturbance

The U.S Capitol and an office are reflected in a window inside the Hart Senate Office Building as Republican lawmakers struggle to pass U.S. President Donald Trump's sweeping spending and tax bill, on Capitol Hill in Washington, D.C., U.S., July 1, 2025. (Reuters/Nathan Howard)
2 hours ago

US Senate Strikes AI Regulation Ban From Trump Megabill

2 hours ago

Fresno Police, CHP Crack Down on Impaired Driving for July 4th

U.S. Senate Minority Leader Chuck Schumer (D-NY) speaks during a press conference after the Senate passes U.S. President Donald Trump’s sweeping spending and tax bill, on Capitol Hill in Washington, D.C., U.S., July 1, 2025. (Reuters/Annabelle Gordon)
3 hours ago

Despite Last-Minute Changes, Senate Bill Deals Big Blow to Renewable Energy

Zohran Mamdani addresses supporters on primary night, in New York, June 24, 2025. Mamdani, the democratic socialist whose blend of populist ideas and personal magnetism catapulted his upstart candidacy, has won the Democratic primary for mayor of New York City, according to The Associated Press. (Shuran Huang/The New York Times)
3 hours ago

Zohran Mamdani Officially Wins Democratic Primary for New York City Mayor

Help continue the work that gets you the news that matters most.

Search

Send this to a friend