NORTON META TAG

Showing posts with label Nate Silver. Show all posts
Showing posts with label Nate Silver. Show all posts

05 November 2016

FiveThirtyEight’s Prediction Model Is Failing in the Clinton-Trump Race -- That's According to Its Guru, Nate Silver 5NOV16


HERE's is another look at +FiveThirtyEight polls and predictions for the 2016 elections from +AlterNet . NO matter what the polls show GET OUT AND VOTE BECAUSE DEMOCRACY IS NOT A SPECTATOR SPORT AND IF YOU DO NOT VOTE DRUMPF/TRUMP-PENCE WIN.
Trump's path is precarious and not one other professional election handicapper records the seismic shift in Trump’s chances that FiveThirtyEight does.
Donald Trump - This BIG! Donald John Trump, Sr., aka Donald Trump, is a celebrity business man and media personality. He is a candidate for president in the 2016 Republican primary. This image of Donald Trump was adapted from Creative Commons licensed images from Gage Skidmore's flickr photostream.
Photo Credit: DonkeyHotey/Flickr CC
Telling political junkies to stop checking fivethirtyeight.com obsessively is likely to be met by the same hollow-eyed stare from a lab rat that spends its day clicking a lever for bumps of cocaine.
The internet venerates the website’s founder, Nate Silver, as “America’s Chief Wizard” after his statistical polling model correctly predicted the results of the 2012 presidential contest in every state and the District of Columbia. But Silver’s fans are freaking out as Trump’s chance of winning has tripled in two weeks.
However, the wild swings toward Trump are more a sign that an orange-furred monkey wrench has jammed FiveThirtyEight’s soothsaying machine than a candidate who is detested by nearly 60 percent of voters is suddenly floating to the top of the 2016 shitshow. Trump can win and possible hacking of the electoral process increase unpredictability, but his path is still precarious and not one other professional election handicapper records the seismic shift in Trump’s chances that FiveThirtyEight does.
To Silver’s credit, he’s cast doubts on his poll-based forecasting this year. He mentions the lag time in how polls react to dramatic news such as the FBI’s email bombshell. He highlighted a survey showing little movement in voter preferences since January 2016. FiveThirtyEight also notes, “Trump supporters are more likely than Clinton voters to make it through the likely voter screens, indicating they are more vocal and enthusiastic in their support.” In other words, it’s likely Comey’s ill-advised letter about Clinton’s emails has depressed pro-Clinton respondents in polling more than it will at the voting booth. On the flip side, after Clinton’s average lead stretched to 7.1 percent in mid-October, this was likely affected by Trump supporters shunning pollsters, particularly after Trump’s rants about a rigged media, rigged polls, and a rigged election.
If you’re hell-bent on checking FiveThirtyEight constantly (as I still do), then it’s worth keeping in mind reasons why a Clinton victory is likelier than Silver’s model predicts.
The main issue is FiveThirtyEight works best when electoral coalitions are well-defined and change slowly as they have been since Bill Clinton was in office. Trump has scrambled all that, however, and analyzing polls cannot account for rapid demographic shifts. Trump’s bastion of working-class white men includes significant numbers of Democrats who’ve crossed over since 2012. But he’s alienated typically Republican college-educated whites and spurred Latinos, Asians, and Muslims to mobilize in record numbers to defeat him. And the gender gap is wider than ever, with women favoring Clinton over Trump by an average of 16 points in October polls. The focus on Trump’s working-class support also misses one crucial aspect: a majority of the white working class is female, and they began rejecting Trump after the Access Hollywood tape scandal. This overlaps with a remarkable geographic shift in which Democrats are quickly gaining ground in Sunbelt states that were a redoubt of Reagan conservatism, while traditional Democratic strongholds are crumbling in Midwest regions that are older, white and working class.
These groups are huge at a national scale, but fine-grained detail disappears in polls of a thousand respondents. FiveThirtyEight apparently doesn’t include polls that could clarify the picture by zeroing in on groups such as Latino voters, who favor Clinton by an astonishing 48-point gap. Most public polls are marked by shoddier methodology that amplify small swings as opposed to internal campaign polling that show more stability.
Two other significant reasons why FiveThirtyEight overestimates Trump’s chances is early voting and get out the vote. More than 35 million Americans have already voted, which is 28 percent of the total vote in 2012. In nearly every battleground state early voting is outpacing last election, meaning Clinton banked millions of votes when her numbers were peaking. One poll of early voters indicates Clinton is ahead by enough 5 points, which is enough to tack on a 1.3 percent advantage in the final election results.
Many of these factors are evident in Nevada. FiveThirtyEight shows Trump neck and neck with Clinton, but Silver says early voting shows a six-point gap favoring Democratic voters. This discrepancy is consistent with FiveThirtyEight’s failure to predict Harry Reid’s 2010 Senate re-election and its underestimate of Obama’s 2012 victory margin. Six years ago Reid edged out Tea Party kook, Sharron Angle, thanks to an extraordinary turnout machine he’s built after more than 30 years in public office. Nevada also has its own election oracle in reporter John Ralston, who correctly called the two races Silver flubbed. Ralston’s dive into 622,000 votes already cast, which already accounts for 61 percent of 2012 totals, bears grim tidings for Trump even in best-case scenarios.
If Trump loses Nevada, Silver says he wins in only 9 percent of scenarios. That’s a far cry from the 35 percent mark Trump just touched. Trump’s campaign looks to be treating Nevada as a lost cause as he eyes richer electoral prizes like Michigan and Wisconsin that are even further out of his grasp. Even if Trump wins Ohio, Florida, Iowa, Arizona, North Carolina, and New Hampshire, he still loses the election. So he needs to wrestle a Midwestern state away from Clinton.
That’s unlikely as Trump is paying the price for outsourcing get-out-the-vote operations. GOTV is warfare through electoral means and requires a command staff, hundreds of offices, tens of thousands of paid staff and volunteers, and coordination both strategic and minute with the campaign. Trump has none of that. A month before the election, FiveThirtyEight counted 2.5 Clinton field offices for every one of Trump’s. His campaign is also plagued by chaotic websites and offices listed in demolished buildings. Field offices can’t be thrown up like lawn signs, and in battleground states a ground game could add as much as three to five points.
Clinton’s GOTV is robust enough to target strongly Democratic but low-propensity voters. Silver points out polls can’t factor this in. For example, one organization in Florida has dispatched 500 paid canvassers to the field for months to activate a pool of 384,000 Latino voters. Trump is also outmuscled by unions spending hundreds of millions of dollars and deploying thousands of full-time canvassers for Democrats. These efforts are yielding dividends among Latinos in Arizona and Asian-Americans in Nevada. And Michigan’s Arab-American and Muslim-American firewall will easily keep Trump at bay there.
Democrats are hand-wringing over declining African-American turnout, and this has put North Carolina and Ohio in peril, but the surge from women, college-educated, and racial minorities from Virginia to Nevada will offset this deficit. Republicans are already embroiled in civil war, which is damaging Trump in Wisconsin and Utah. Democrats are united and feature a stellar array of surrogates on the hustings, such as the Obamas, Bill Clinton, Joe Biden, Tim Kaine, Bernie Sanders, Elizabeth Warren, and an A-list of celebrities. Donald Trump has the Pharma Bro, an underwear model, a disgraced baseball star, and a felonious “Real Housewife.”
There is also no evidence of “shy” Trump voters that polls allegedly fail to register. And Trump’s attempts to activate whites who normally don’t vote looks to be a dud as well. An analysis of newly registered and “missing” voters favoring Clinton. Even if there is a hidden upsurge for Trump, it’s unlikely to overcome all these obstacles.
Silver cautions as well that the history of presidential elections and scientific polling is so scanty in terms of data that it’s dicey to draw any broad-based conclusions. For instance, conventional wisdom says as goes Ohio, so goes the nation. But Trump looks set to win Ohio and lose the general election, a first in 14 straight presidential races.
FiveThirtyEight’s model worked fantastically well when the sailing was smooth, but it is foundering in the violent seas of 2016. The Cook Political Report, the brainchild of  the dean of election forecasting, Charles Cook, observes that despite Clinton’s eleventh-hour woes, “The race has tightened to its ‘natural resting place’ with a 2-4 point lead for Clinton,” while Trump’s “path to 270 electoral votes remains decidedly and almost impossibly narrow.”
The best prediction of how the 2016 campaign ends is likelier to be a metaphor than math: Hillary Clinton’s near-collapse at the September 11 memorial where her entire team mobilized to shield her and carry her over the finish line. And no statistical model can predict a moment like that.
Arun Gupta is a graduate of the French Culinary Institute in New York and has written for dozens of publications including the Washington Post, the Nation, The Progressive, Telesur English, and the Guardian. He is the author of the upcoming Bacon as a Weapon of Mass Destruction: A Junk-Food-Loving Chef’s Inquiry into Taste (The New Press).

28 March 2014

NATE SILVER ON THE DAILY SHOW WITH JON STEWART & FiveThirtyEight Senate Forecast: GOP Is Slight Favorite in Race for Senate Control 27&23MAR14

NATE SILVER on The Daily Show, click the link
http://thedailyshow.cc.com/full-episodes/on9wec/march-27--2014---nate-silver 
THE show is funny, but the article about the possible outcome of the 2014 midterm US Senate elections isn't. The Democrats have a lot of work to do, starting with convincing the electorate the Democratic candidates aren't DINOs and organizing a massive GOTV / Get Out The Vote campaign nationwide. From Nate Silver's new 538.com.....
When FiveThirtyEight last issued a U.S. Senate forecast — way back in July — we concluded the race for Senate control was a toss-up. That was a little ahead of the conventional wisdom at the time, which characterized the Democrats as vulnerable but more likely than not to retain the chamber.
Our new forecast goes a half-step further: We think the Republicans are now slight favorites to win at least six seats and capture the chamber. The Democrats’ position has deteriorated somewhat since last summer, with President Obama’s approval ratings down to 42 or 43 percent from an average of about 45 percent before. Furthermore, as compared with 2010 or 2012, the GOP has done a better job of recruiting credible candidates, with some exceptions.
As always, we encourage you to read this analysis with some caution. Republicans have great opportunities in a number of states, but only in West Virginia, South Dakota, Montana and Arkansas do we rate the races as clearly leaning their way. Republicans will also have to win at least two toss-up races, perhaps in Alaska, North Carolina or Michigan, or to convert states such as New Hampshire into that category. And they’ll have to avoid taking losses of their own in Georgia and Kentucky, where the fundamentals favor them but recent polls show extremely competitive races.
Since a number of you may be new to FiveThirtyEight, I’m going to go into slightly more detail than usual in explaining how we make these forecasts. You’re welcome to skip past this next section if you’re more interested in the forecasts than in how we came to them.
An overview of our methodology
In contrast to the forecasts we’ll begin issuing sometime this summer, which are strictly algorithmic based on our senate forecast model, these are done by hand. However, they’re based on an assessment of the same basic factors our algorithm uses:
The national environment. The single best measure of the national political environment, in our view, is the generic congressional ballot. Right now, it shows a rough tie between Democrats and Republicans. That stalemate likely reflects voters’ dislike for both Obama and the Republican Party.
A tie on the generic ballot might not sound so bad for Democrats. But it’s a misleading signal, for two reasons. First, most of the generic ballot polls were conducted among registered voters. Those do not reflect the turnout advantage the GOP is likely to have in November. Especially in recent years, Democrats have come to rely on groups such as racial minorities and young voters that turn out much more reliably in presidential years than for the midterms. In 2010, the Republican turnout advantage amounted to the equivalent of 6 percentage points, meaning a tie on the generic ballot among registered voters translated into a six-point Republican lead among likely voters. The GOP’s edge hadn’t been quite that large in past years. But if the “enthusiasm gap” is as large this year as it was in 2010, Democrats will have a difficult time keeping the Senate.
Democrats’ other problem is one of basic constitutional mathematics. Senators are elected in six-year cycles, so the seats in play this year were last contested in 2008,1 an extraordinarily strong year for Democrats. Even a strictly neutral political environment, or one that slightly favored Democrats, would produce a drop-off relative to that baseline. And Democrats’ losses will grow this year if voters go from modestly favoring Republicans to strongly favoring them.
Incidentally, we prefer to look at aggregate measures of the national environment, like the generic ballot and Obama’s approval ratings, instead of piecemeal ones such as voters’ views of Obamacare. Certainly the unpopularity of the Affordable Care Act — and its clumsy roll-out late last year — contributes to Democrats’ problems. But it’s hard to tell where Obamacare’s unpopularity ends and President Obama’s overall unpopularity begins. Voters’ views of the economy also have ambiguous effects in midterm years, especially when control of government is already divided.
Candidate quality. The notion of “candidate quality” might sound awfully subjective, but there are sound statistical ways to assess it. Fundraising totals, especially individual contributions, are a good indication of a candidate’s organizational strength. Various systems rate a candidate’s ideology on a left-right scale, based on her voting record or public issue statements, and we can compare those ratings against those of voters in her state. And candidates who have previously held elected office tend to outperform inexperienced ones, controlling for other factors.
State partisanship. As Dan Hopkins wrote at FiveThirtyEight last week, races of all kinds have become more and more correlated with presidential results in recent years. So the Partisan Voting Index (PVI), which compares how a state voted in the past two presidential years against the national popular vote, is also a useful tool for congressional races. At this early point in the cycle, there’s reason to be skeptical of races where the polls are out of step with how the state usually votes; states often revert to their partisan mean once more voters engage with the campaign.
Incumbency. Incumbents may be unpopular in the abstract, but they still win the overwhelming majority of races. Incumbency still represents an advantage in most cases, and sometimes a significant one. We can spot the potential exceptions by looking at an incumbent’s approval or favorability ratings.
Head-to-head polls. Head-to-head polls at this point in the cycle have some predictive power if evaluated carefully. That means taking care to see whether the poll was conducted among registered or likely voters, and putting less emphasis on polls when one or both candidates lack widespread name recognition. However, as my colleague Harry Enten has lamented, many of the more important Senate races have rarely been polled this year. Furthermore, much of the polling comes from firms such as Rasmussen Reports and Public Policy Polling, which have poor track records, employ dubious methodologies, or both. So the most appropriate use of polls at this stage is to see whether they roughly match our assessment of the race based on the fundamentals. Where there is a mismatch, it could indicate that the polls are missing something, that our view of the fundamentals is incorrect, or some of both — and it means there is more uncertainty in the outlook for the state.
Overall forecast
In consideration of these factors, we assess the probability of the Democratic or Republican candidate winning each seat. Where the choice of candidates is uncertain — for instance, in a race where a Democrat will face either a moderate, six-term incumbent U.S. representative or a poorly-financed tea party upstart, depending on the outcome of the Republican primary — the probabilities are meant to reflect a weighted combination of the plausible match-ups. Our assessment of the 36 races2 up for grabs this November is as follows:
silver-senate-3
One advantage of looking at the races on a probabilistic basis is that we can simply sum the probabilities to come up with a projection of how the new Senate will look. That method projects that Republicans will finish with 51 seats,3 a net gain of six from Democrats, and exactly as many as they need to win control of the chamber. (Democrats will hold the Senate in the event of a 50-50 split because of the tiebreaking vote of Vice President Joe Biden.)
That represents an edge for Republicans, but not much of one — and there are any number of paths by which they might get to 51 seats, or fail to do so. It might help to break the 36 races down into six categories, based on the party which holds the seat now and its likelihood of flipping to the other party.
Democrat-held seats likely to be picked up by Republicans (4): West Virginia, South Dakota, Montana, Arkansas
You’ll find that our characterization of the 36 races in most cases is very close to that issued by such forecasters as the Cook Political Report and Rothenberg Political Report. We’re looking at the same sort of information they are, and they have strong track records, so it’s natural there should be similarities.
One point of difference is that we’re much more pessimistic about the Democrats’ chances in West Virginia, South Dakota and Montana. These races have a lot in common, taking place in three red states where longtime Democratic incumbents have retired.
We’re bullish on Republican chances in these states for simple reasons. First, they’re red states. Second, we think the national political environment modestly favors Republicans. Third, we think the Republicans are poised to nominate equal or superior candidates in each state. Fourth, our research suggests there is little or no carry-over effect from incumbency once the incumbent himself retires. In West Virginia, for instance, the retirement of Democrat Jay Rockefeller provides little information about how the race will turn out in November.
We give Republicans a 90 percent chance of winning West Virginia, in fact. The state’s politics are a little more complicated than might be apparent from presidential voting — Obama is extraordinarily unpopular there, but a slim majority of the state’s voters are still registered as Democrats, and Democrats hold the governorship and both branches of the state legislature. But Republicans are poised to nominate an excellent candidate in Rep. Shelley Moore Capito, and she has held leads of 6 to 17 percentage points in polls against the likely Democratic nominee, Secretary of State Natalie Tennant.
We also give Republicans a 90 percent chance of winning South Dakota. It’s a more straightforward case, except that the presumptive Republican nominee, Gov. Mike Rounds, has been caught up in a controversy over the state’s participation in the EB-5 immigration visa program. To have much of a chance, Democrats will either need Rounds to lose the Republican primary or be significantly damaged by it.
Montana is slightly different in that Democrats technically do have an incumbent, John E. Walsh, running for re-election there. However, Walsh was appointed, not elected (he replaced Max Baucus in February when Baucus was named United States Ambassador to China). Appointed senators have a poor historical track record; from a predictive standpoint, it’s best to think of their races as open seats, rather than incumbent defenses. Walsh trails the likely Republican nominee, Rep. Steve Daines, by double digits in polling so far. The race is likely to tighten; Montana is somewhere between a purple state and a red one, and Walsh, who was elected as Montana’s lieutenant governor in 2012, is a credible candidate. Still, we give Republicans an 80 percent chance of flipping it.
The final race in this category is Arkansas, where Democrats have a true incumbent, Sen. Mark Pryor, running. Pryor was once so popular that he won without Republican opposition in 2008. But Arkansas has become redder and redder, and Democratic Sen. Blanche Lincoln’s 21-point loss to Republican John Boozman in 2010 demonstrates that past popularity is no guarantee of future success for a Democrat there. Furthermore, Republicans have a strong candidate in Rep. Tom Cotton, who is ahead by an average of about five points in recent polls. Pryor will be able to fight for his seat — he had $4.2 million in cash on hand as of Dec. 31, compared to $2.2 million for Cotton. The polling has returned inconsistent answers about Pryor’s approval and favorability ratings, so it’s hard to say how deep a reservoir of personal goodwill he will have to draw from. But the evidence points toward him being the underdog.
Democrat-held seats that are toss-ups (4): Louisiana, North Carolina, Alaska, Michigan
For Republicans, the path of least resistance to a Senate majority is winning West Virginia, South Dakota, Montana and Arkansas, and then two of the four states in this category.
Louisiana, where the Democratic incumbent Mary Landrieu is running, may be the easiest opportunity. Landrieu’s fundamentals are similar in most respects to Pryor’s: Her fundraising has been fine, but otherwise she’s running against the tide in what has become a very red state, and her moderate overall voting record may be undermined by her role in passing the Affordable Care Act in 2010. The difference is that Landrieu’s most likely opponent, Rep. Bill Cassidy, has yet to pull ahead in the polls, which instead show a race that’s roughly tied.
In North Carolina, Democrat Kay Hagan is an example of a candidate who could go in and out with the political tides. She was elected in 2008 over Elizabeth Dole as the Obama campaign turned out African Americans and college students throughout the state. But those are precisely the voters who don’t always show up for midterms. Still, Hagan could get a reprieve depending on Republicans’ choice of nominee. Republicans have eight declared candidates for their May 6 primary who range from Thom Tills, the speaker of the state House, to a variety of activists and political amateurs.
Alaska might be the hardest race to forecast. The polling there is often erratic. The state has voted Republican for president every year since 1968, but its independent streak sometimes translates differently in other races. The Democratic incumbent, Mark Begich, might face an establishment candidate in Daniel S. Sullivan, the former attorney general, or Mead Treadwell, the lieutenant governor — or he could face Joe Miller, the former judge and tea party activist who is unpopular beyond the Republican base.
The race in Michigan differs from the others in this group: It’s somewhere between purple and blue instead of red, and there’s no incumbent, as Democratic Sen. Carl Levin is retiring. But Republicans will have an excellent candidate in Terri Lynn Land, the former secretary of state. She comes from the old guard of moderate Michigan Republicans, instead of the tea party wing that might have preferred a candidate like Rep. Justin Amash. The likely Democratic nominee, Rep. Gary Peters, should win his primary without serious opposition, and he’s kept pace with Land in fundraising. But we take the polls that show the race as a toss-up at face value. The question is whether Michigan’s modest blue lean is enough to overcome a modestly Republican-leaning national climate.
Democrat-held seats that lean Democratic but with a plausible GOP pick-up (3): Colorado, Iowa, New Hampshire
Republicans have some backup options if they fail to win states such as North Carolina and Michigan.
The best one is Colorado. The GOP got the candidate of its choice in Rep. Cory Gardner, who declared for the race last month. That will prevent them from again nominating Ken Buck, the tea party candidate who lost a winnable race in 2010. (Buck has withdrawn from this year’s Senate race and decided to run for the U.S. House instead.) By our measures, Gardner is a decent candidate rather than a great one. He’ll start at a fundraising deficit to the Democratic incumbent, Mark Udall, who had $4.7 million in cash on hand as of Dec. 31, and he comes from a conservative district and has amassed a conservative voting record that may or may not translate well in the Denver suburbs. But Udall’s approval ratings only break even, and we give Republicans a 40 percent chance of winning his seat.
The other big recruiting news is in New Hampshire, where Scott Brown, the former Massachusetts senator, has announced he’ll seek the Republican nomination. But as Harry Enten noted, Brown isn’t terribly popular in New Hampshire, which has long had a love-hate relationship with Massachusetts. Just as important, Jeanne Shaheen, the Democratic incumbent, has enjoyed approval ratings that would be good enough to get her re-elected. The political winds in New Hampshire can shift quickly, which is why we’re not ruling out a Republican win. But we don’t think Brown improves the GOP’s chances much as compared with another credible candidate.
Iowa is also a political bellwether. Sen. Tom Harkin, the Democrat, is retiring, which might seem to give Republicans even or better odds in a Republican-leaning national environment. But Democrats have a substantial edge in candidate quality. Rep. Bruce Braley, the presumptive nominee, has a fairly moderate voting record and $2.6 million in cash on hand. Meanwhile, Republicans have yet to coalesce around one of several inexperienced candidates. Perhaps like the one in New Hampshire, therefore, this race could swing Republican if the Democrats’ national position deteriorates further; Braley would hold the seat for them in an election held today.
Democrat-held seats likely or almost certain to be retained by Democrats (10): Minnesota, Oregon, New Jersey, Virginia, Hawaii (special election), Massachusetts, Illinois, New Mexico, Delaware, Rhode Island
Minnesota might seem vulnerable for Democrats. Sen. Al Franken won his seat only after a months-long recount in 2008, and he’s amassed the liberal voting record you’d expect of him. But Franken’s approval ratings are pretty good and he raises plenty of money from liberals around the country. So far, he has deterred a credible Republican challenger from entering the race.
In Oregon, Democratic incumbent Jeff Merkley has middling approval ratings. But the state has become quite blue, and the Republican roster there is weak; in 2010, the GOP nominated inexperienced candidates in both the Senate and gubernatorial races. It doesn’t look like they’ll nominate a strong candidate this year, either. Their chances of victory depend on the electoral climate becoming catastrophic for Democrats.
The other eight races on this list are likely to hold for Democrats even in worst-case scenarios. Republicans have sometimes talked up their opportunity in Virginia, where the former chairman of the Republican National Committee, Ed Gillespie, is running. Ordinarily, we’d snark about party hacks overrating the chances of one of their brethren winning office, but Virginia just elected Terry McAuliffe as its governor. However, Democratic incumbent Mark Warner maintains high approval ratings, and he’d likely hold the seat even against a strong opponent.
Republican-held seats that lean Republican but where Democratic pick-up is possible (2): Georgia, Kentucky
Republican paths to take over the Senate are complicated slightly by their need to defend two seats of their own.
The higher-profile problem is in Kentucky, where Sen. Mitch McConnell, the Republican minority leader, has poor approval ratings, and Democrats will nominate a charismatic candidate in Alison Lundergan Grimes, the secretary of state.4 Grimes has run about even with McConnell in polls since she declared her candidacy in July. But McConnell will have all the financial resources he could want — he had $10.9 million as of Dec. 31 — along with Obama’s unpopularity in Kentucky to undermine Grimes. His path to survival could resemble that of the Democratic leader, Harry Reid, who prevailed in Nevada in 2010 with similarly poor approval ratings after a brutal campaign. We give McConnell a 75 percent chance of holding the seat. I’ll concede that I’m curious to see what our algorithmic forecasts do with this race once they’re up and running.
Georgia might be the slightly better opportunity for Democrats. The Republican primary, to be held May 20, has been a mess in the polling, with any of five different GOP candidates near the top of the race depending on the survey. Their prospects range from Secretary of State Karen Handel, who might be the strongest general-election nominee, to Reps. Phil Gingrey and Paul Broun, who have amassed conservative enough voting records that they might turn off swing voters even in red Georgia. Democrats are almost certain to nominate Michelle Nunn, the daughter of former U.S. Sen. Sam Nunn, who has run even with or slightly ahead of the Republicans in scant polling so far. Ordinarily, we are skeptical of candidates who lack previous experience in elected office, but those from famous political families don’t have the same name-recognition deficit to overcome and can sometimes tap into their families’ networks to raise funds and staff their campaigns.
Republican-held seats likely or almost certain to be retained by Republicans (13): Maine, Mississippi, South Carolina (regular election), Nebraska, South Carolina (special election), Texas, Tennessee, Oklahoma (special election), Kansas, Oklahoma (regular election), Wyoming, Alabama, Idaho
Thirteen other Republican-held seats will be contested in November, but none looks like a viable opportunity for Democrats. The moonshot for Democrats might be in Mississippi, where the Republican incumbent, Thad Cochran, is vulnerable to a primary challenge and Democrats have a good prospective nominee in former Rep. Travis Childers. Still, as Harry Enten explained, it’s hard for any Democrat to get to 50 percent of the vote in Mississippi.
A wide range of outcomes
We’ve sometimes seen people take our race ratings and run Monte Carlo simulations based upon them, which assume that the outcome of each race is independent from the others. But that’s a dubious assumption, especially so far out from the election. Instead, the full-fledged version of our ratings assumes that the error in the forecasts is somewhat correlated from state to state.
In plain language: sometimes one party wins most or all of the competitive races. If we had conducted this exercise at this point in the 2006, 2008 or 2012 campaigns, that party would have been the Democrats. In 2010, it would have been the Republicans. There are still more than seven months for news events to intervene and affect the national climate.
There are 10 races that each party has at least a 25 percent chance of winning, according to our ratings. If Republicans were to win all of them, they would gain a net of 11 seats from Democrats, which would give them a 56-44 majority in the new Senate. If Democrats were to sweep, they would lose a net of just one seat and hold a 54-46 majority.
So our forecast might be thought of as a Republican gain of six seats — plus or minus five. The balance has shifted slightly toward the GOP. But it wouldn’t take much for it to revert to the Democrats, nor for this year to develop into a Republican rout along the lines of 2010.

Footnotes

http://fivethirtyeight.com/features/fivethirtyeight-senate-forecast/ 

08 November 2012

Election Night Replay & As Nation and Parties Change, Republicans Are at an Electoral College Disadvantage from FIVE THIRTY EIGHT 8NOV12

ANALYSIS of election night 6NOV12 from Five Thirty Eight. Well done Nate Silver!
The excitement of election night is fading. Although ballots are still being counted, President Obama appears to have carried Florida, the last undecided state, and Republicans are confronting a challenging electoral map.
But for one more dose of election night excitement, here are Nate Silver’s appearances on TimesCast, where he discussed results as they came in with The Times’s Megan Liberman.

Share This Video

Nate Silver on Election Results

Discussing Obama's Presidential Victory

Nate Silver on Obama and Ohio

Focusing on a Swing State and Sandy

Nate Silver on Election Day

Picking a Presidential Winner

As Nation and Parties Change, Republicans Are at an Electoral College Disadvantage

Two more presidential elections, 2016 and 2020, will be contested under the current Electoral College configuration, which gave Barack Obama a second term on Tuesday. This year’s results suggest that this could put Republicans at a structural disadvantage.
Based on a preliminary analysis of the returns, Mitt Romney may have had to win the national popular vote by three percentage points on Tuesday to be assured of winning the Electoral College. The last Republican to accomplish that was George H.W. Bush, in 1988. In the table below, I have arranged the 50 states and the District of Columbia from the most Democratic to the most Republican, based on their preliminary results from Tuesday. Along the way, I have counted up the number of electoral votes for the Democratic candidate, starting at zero and going up to 538 as he wins progressively more difficult states.
This process resembles how the FiveThirtyEight tipping-point analysis was calculated. In the simulations we ran each day, we accounted for the range of possible outcomes in each state and then saw which states provided Mr. Obama with his easiest route to 270 electoral votes, the minimum winning number. The state that put Mr. Obama over the top to 270 electoral votes was the tipping-point state in that simulation.
Now that the actual returns are in, we don’t need the simulations or the forecast model. It turned out, in fact, that although the FiveThirtyEight model had a very strong night over all on Tuesday, it was wrong about the identity of the tipping-point state. Based on the polls, it appeared that Ohio was the state most likely to win Mr. Obama his 270th electoral vote. Instead, it was Colorado that provided him with his win – the same state that did so in 2008.
The worry for Republicans is that Mr. Obama won Colorado by nearly five percentage points (4.7 points was his margin there, to the decimal place). In contrast, Mr. Obama’s margin in the national popular vote, as of this writing, is 2.4 percentage points. We estimate that it will grow to 2.5 percentage points once some remaining returns from states like Washington are accounted for, or perhaps slightly higher once provisional ballots in other states are counted. But it seems clear that Mr. Obama had some margin to spare in the Electoral College.
Had the popular vote been a tie – assuming that the margin in each state shifted uniformly – he would still have won re-election with 285 electoral votes, carrying Colorado and Virginia, although losing Florida and Ohio.
In fact, had Mr. Romney won the popular vote by two percentage points, Mr. Obama would still have won the Electoral College, losing Virginia but holding onto Colorado.
Of course, the relative order of the states can shift a bit from election to election: in 2000, after all, it was Democrats who lost the Electoral College despite winning the popular vote.
Ohio might be one of the Republicans’ lesser worries. Mr. Obama did win the state, but his margin is 1.9 percentage points based on the ballots in so far, slightly less than his margin of victory nationally, and he may have benefited there from the auto bailout, a one-off event.
But Mr. Obama did not need Ohio to carry the Electoral College, it turned out. Instead, states where there have been demographic shifts, like Colorado, gave him enough of a cushion.
Nor was Ohio the only formerly Republican-leaning state to move closer to the Electoral College tipping point. Mr. Obama’s margins in Virginia, Florida and North Carolina also held up well as compared to 2008.
Virginia, in fact, was incrementally more Democratic-leaning than the country as a whole this year, voting for Mr. Obama by three percentage points.
In Florida, Democrats now seem to have a real advantage with Hispanic voters. Non-Cuban Hispanics there voted for Mr. Obama by roughly the same two-to-one margins that they did in other states, and the Cuban-American vote, long considered Republican-leaning, is now divided about equally between the parties.
Mr. Obama lost North Carolina on Tuesday, but he did so by only about two percentage points. By contrast, in 2000 Al Gore lost North Carolina by 13 points despite winning the national popular vote.
If these states are becoming more Democratic-leaning, which ones are shifting toward Republicans?
Missouri, once a tossup, is now solidly Republican. And West Virginia, which was once Democratic-leaning enough that Michael Dukakis carried it in 1988, voted for Mr. Romney by 27 points on Tuesday.
The problem for Republicans is that in states like these, and others like Tennessee, Kentucky and Arkansas, they are now winning by such large margins there that their vote is distributed inefficiently in terms of the Electoral College.
By contrast, a large number of electorally critical states – both traditional swing states like Iowa and Pennsylvania and newer ones like Colorado and Nevada – have been Democratic-leaning in the past two elections. If Democrats lose the election in a blowout, they would probably lose these states as well. But in a close election, they are favored in them.
The Republican Party will have four years to adapt to the new reality. Republican gains among Hispanic voters could push Colorado and Nevada back toward the tipping point, for example.
States like Wisconsin, New Hampshire and Iowa are overwhelmingly white – but also highly educated, with fairly progressive views on social policy. If Republicans moderated their tone on social issues, they might be more competitive in these states, while regaining ground in Northern Virginia and in the Philadelphia suburbs.
Finally, some of the Democrats’ apparent advantage in the swing states may reflect Mr. Obama’s voter targeting and turnout operations – which were superior, by most accounts, to John McCain’s in 2008 and Mr. Romney’s in 2012.
It is not my job to give advice, but the next Republican nominee might be well served to remember that the party won the Electoral College despite losing the popular vote in 2000, when George W. Bush and Karl Rove put more emphasis on the “ground game.” But the Republicans seemed to be at a disadvantage in the last two years when their candidates put less of an investment into it.
If the parties continue down the same paths, however, this won’t be the last election when most of the swing states turn blue.
http://fivethirtyeight.blogs.nytimes.com/2012/11/08/as-nation-and-parties-change-republicans-are-at-an-electoral-college-disadvantage/ 


02 November 2012

7 Prognosticators With Good News for Nervous Obama Fans 1NOV12

THIS is reassuring but I still can't wait to hear the fat lady sing OBAMA WINS! on 6NOV12. From Mother Jones....
Freaking out about the supertight presidential race and the near-daily barrage of polls suggesting that Obama—no, wait, Romney—could, maybe, possibly, eke out a narrow victory? Sick of empty punditry and craving data-driven electoral analysis? Are you unafraid of mysterious nerdy things like math?
If you answered yes to any of the above, check out these seven guys who crunch mountains of polling data so you don't have to. They don't have crystal balls, but they might just have the next best thing.
1. Nate Silver
(Referring to this.)  ; quickmeme.com(Referring to this.) Nate Silver; quickmeme.comThe New York Times' statistics big shot has established himself as the gold standard for electoral prognostication. Romney fans are very upset with him for saying Obama has a strong chance of winning (and for being a sissy-man or something). Nail-biting Obama supporters hit his site for daily (or hourly) doses of reassurance. Both sides tend to ignore that Silver's model doesn't write off possibility of a Romney win.
Track record: Silver has built his reputation on the accuracy of his "Political Calculus": In 2008, his model correctly predicted the electoral outcome in 49 of 50 states, and during the 2010 midterms, his prediction was dead-on in forecasting a Republican sweep.
Current prediction: Silver's FiveThirtyEight gives the president a 77.4 percent chance of winning, with a estimated total of 299 electoral votes.

2. Sam Wang
Wang runs the Meta-Analysis model for the Princeton Election Consortium. Wang, who made a name for himself in neuroscience and biophysics, took the statistical analyses he'd applied in those fields and transposed them to the mess of electoral politics. He developed the model in 2004 initially to help predict the most strategic way to allocate of campaign donations. The model, based on a slew of state polls, calculates each candidate's probability of winning in the Electoral College if the election were held today.
siteElection.Princeton.eduTrack record: The group behind Meta-Analysis stakes out their election prediction street cred like so: "In 2004, the median decided-voter calculation captured the exact final outcome. In 2008, the final-week decided-voter calculation was within 1 electoral vote."
Current prediction: As of October 30, Wang gives Barack Obama a generous 92 to 98 percent chance of reelection, and an estimated 303 electoral votes.

3. Drew Linzer
VotamaticVotamatic.org
Linzer, an assistant professor of political science at Emory University, runs the polling analysis and forecast site Votamatic.org. It tracks public opinion trends for the two presidential candidates in each state, and also "forecasts ahead to Election Day" using a unified model.
Track record: This is Linzer's model's first real election, but he vouches for its reliability. "I validated the model with state-level pre-election polls from the 2008 presidential campaign, using the benefit of hindsight to evaluate model performance," he writes. "In a simulated run-through of the campaign from May to November, the model was able to steadily improve the accuracy of its forecasts, ultimately mispredicting the winner of only a single state. By Election Day, the average difference between the model forecasts and the actual state election outcomes was just 1.4%, with more than half of states projected to within 1%."
Current prediction: As of October 30, Votamatic is predicting an Obama victory, with 332 electoral votes.

4. Andrew S. Tanenbaum

Electoral-Vote.comElectoral-Vote.comSince 2004, this noted computer scientist and professor at Amsterdam's Vrije Universiteit has run Electoral-Vote.com, which analyzes US federal elections. Also, the site has the option of watching the election with "Rasmussen-free maps."
Track record: Click here for a self-evaluation and breakdown of the website's commendable track record since the 2004 election. Initially anonymous, Tanenbaum revealed his identity after rampant speculation that he was, among other things, "a Clinton administration official, [or] a bored retired statistician." Tanenbaum describes himself as "a libertarian [who leans] towards the Democrats."
Current prediction: With a week to go, Tanenbaum's analysis has Obama up with at least 280 electoral votes.

5. Josh Putnam
FHQFHQPutnam, a visiting assistant professor of poli sci at Davidson College in North Carolina, runs the Frontloading HQ blog on state polls.
Track record: Putnam was an ace at delegate math during this year's particularly messy Republican primaries. (He teamed up with The New Yorker's Ryan Lizza to count delegates).
Current prediction: Putnam's model has Obama leading with 332 electoral votes.
6. Scott Elliott
Elliott (who goes by the nickname "The Blogging Caesar") runs the Republican-leaning ElectionProjection.com, a site featuring his electoral vote formula and his own edition of "unskewing" the polls. He is a conservative political junkie who views "Jesus [as] my life and my purpose."
ElectionProjection.comElectionProjection.com
Track record: His track record and methods have been pretty solid—even winning him an endorsement across the aisle from Prof. Tanenbaum at Electoral-Vote.com: For instance, in 2008, his formula projected an easy Obama win, but was off by two states (Indiana and North Carolina). In 2004, his model predicted Bush netting 289 electoral votes (he ended up with 286). 
Current prediction: His math shows a substantial lead for Obama, clocking in at 290 electoral votes, but with 48.9 percent of the popular vote versus Romney's 49.6 percent.

7. Thomas Holbrook
.eduResearch.UVU.edu
Holbrook, a professor of government at the University of Wisconsin-Milwaukee, runs the Politics by the Numbers forecast.
Track record: He took his models out for their first spin during the 2008 election, estimating a big Obama win with 349 electoral votes, to McCain's 189 (Obama snagged 365, McCain 173).
Current prediction: Holbrook gives the president an 86.69 percent chance of winning reelection, with 281 electoral votes to Romney's 257.
http://www.motherjones.com/mojo/2012/11/election-predictors-obama-romney 

01 November 2012

Oct. 31: Obama’s Electoral College ‘Firewall’ Holding in Polls 31OKT12

NATE SILVER always has some fascinating insights on the election predictions and he doesn't disappoint here....
On Oct. 11, this blog posed the question of whether President Obama’s “firewall” in battleground states was all that it was cracked up to be.
At that point, Mr. Obama still technically held the lead in the FiveThirtyEight forecast in enough states to give him 270 electoral votes. But Colorado, Florida and Virginia had turned red in our map, meaning that our forecast suggested that Mitt Romney had better-than-even odds of winning them. Iowa was just on the verge of doing so. And Mr. Obama’s lead was down to just a percentage point or so in Ohio, which would have collapsed his firewall at its foundation.
Theories that the decline in Mr. Obama’s polls that followed the first presidential debate in Denver would somehow skip the swing states were not looking good — as dubious as the idea that tornadoes “skip” houses.
Instead, at that point, Mr. Obama’s position in the FiveThirtyEight forecast had declined for seven consecutive days. If he stopped the bleeding there, he might still be the Electoral College favorite, albeit a narrow one. But it wasn’t clear where the bottom was.
It turned out, however, that the worst was almost over for him. Mr. Obama had one more terrible day in the polls, on Friday, Oct. 12, when Mr. Romney’s chances of winning the Electoral College rose to almost 40 percent in the forecast. But that was when Mr. Romney’s momentum stopped.
Since then, Mr. Obama’s standing has rebounded slightly. His position in the national polls has stabilized; although the national polls continue to tell a different story about the race than the state polls do; it can no longer be said that they have Mr. Obama behind. (More about that in a moment.)
Meanwhile, Mr. Obama continues to hold the lead in the vast majority of polls in Iowa, Nevada, Ohio and Wisconsin, the states that represent his path of least resistance toward winning the Electoral College. This was particularly apparent on Wednesday, a day when there were a remarkable number of polls, 27, released in the battleground states.
There were 12 polls published on Wednesday among Iowa, Nevada, Ohio and Wisconsin. Mr. Obama held the lead in 11 of the 12 surveys; the exception was a survey by the University of Iowa, which had Mr. Obama down by about one point there, but also had a very small sample size (about 300 likely voters). On average, Mr. Obama led in the polls of these states by 3.9 percentage points.
None of this ought to have been surprising, exactly, if you have been attentive to the polls rather than the pundits. It was a pretty good day of surveys for Mr. Obama but not a great one: for the most part, the polls were coming in close to FiveThirtyEight forecasts in each state, give or take a modest outlier here and there.
Rather, the polls in these states confirmed what we already knew: that Mr. Obama remains the favorite in the Electoral College.
Mr. Obama is not a sure thing, by any means. It is a close race. His chances of holding onto his Electoral College lead and converting it into another term are equivalent to the chances of an N.F.L. team winning when it leads by a field goal with three minutes left to play in the fourth quarter. There are plenty of things that could go wrong, and sometimes they will.
But it turns out that an N.F.L. team that leads by a field goal with three minutes left to go winds up winning the game 79 percent of the time. Those were Mr. Obama’s chances in the FiveThirtyEight forecast as of Wednesday: 79 percent.
Not coincidentally, these are also about Mr. Obama’s chances of winning Ohio, according to the forecast.
Regular readers will have seen the chart below once or twice before. It sorts the competitive states in order of Mr. Obama’s current projected margin of victory or defeat in each one, keeping a running tally of the number of electoral votes that Mr. Obama is accumulating.
Ohio remains the tipping-point state in the forecast, the one that puts him over the top to 270 electoral votes. There, Mr. Obama leads by 2.6 percentage points, which should convert to a victory about 80 percent of the time given the historical accuracy of polls at this late stage of the race.
Mr. Romney’s chances of winning the Electoral College without Ohio — a prospect we had defended as being plausible before — are looking more tenuous based on the most recent polling.
If Mr. Obama wins Ohio, and all the states above it on the chart, he’d have 281 electoral votes, meaning that he has 11 to spare. That means he could shed New Hampshire from his list, along with either Iowa or Nevada (although not both).
Of these two states, Nevada appears to be the slightly safer one for Mr. Obama; there, Mr. Obama leads by 3.5 percentage points in the forecast, as opposed to 2.9 percentage points in Iowa. The polling has also been somewhat more consistent in Nevada than in Iowa, another factor that the forecast considers in evaluating the probability of an upset.
One fortunate aspect of these two particular states, from Mr. Obama’s view, is that they are not very similar to one another demographically.
Iowa is quite rural. Nevada occupies a huge geographical territory, but its population is very urban, mostly living in Las Vegas and its suburbs.
Iowa is overwhelmingly white, and has a lot of moderate and middle-income, but highly educated, voters. Nevada certainly has an independent streak, but winning there usually depends more upon building a 50 percent coalition among diverse groups and then turning it out to vote. Iowa has a pretty good economy, all things considered; Nevada’s is still terrible.
Since Mr. Obama only needs to carry one of these states, it helps him that they form a diverse portfolio. If Mr. Obama’s turnout operation is strong, then Nevada should be one of the states where he benefits the most. If, instead, Mr. Obama has little “ground game” advantage, but he holds his own among independent and undecided voters, perhaps persuading them that the economy has improved enough to merit his re-election, Iowa may fall for him.
Mr. Romney could also circumvent his need to win Ohio by carrying Wisconsin, but that is looking tough for him. In Ohio, Mr. Romney is behind by two or three percentage points, on average, in the polls. In Wisconsin, Mr. Romney’s better polls have him down by two or three points, while his worst ones have him six to eight points instead. There’s still enough upside to winning Wisconsin that Mr. Romney should not give up on it, in my view, but his chances are down to 12 percent in the forecast, and most of those cases involve outcomes where he has already won Ohio anyway.
The more debatable cases are Pennsylvania, Michigan and Minnesota. Mr. Romney is the clear underdog in each one. But his campaign has so much money that it probably doesn’t hurt Mr. Romney much to spend a little bit of it there to maximize whatever residual chances he might have in case the polls are wrong. (Arguably, it was a poor strategic decision for Mr. Romney to make a half-hearted effort to compete in these states.)
Still, for Mr. Romney to win Michigan, Minnesota, or Pennsylvania, the polls would have to be much further off than they are in Ohio.
It doesn’t help Mr. Romney, either, that all of these states are in the same part of the country as Iowa, Ohio, and Wisconsin, meaning that they are unlikely to leapfrog them and become the tipping-point state on Tuesday. If, hypothetically, Mr. Romney’s polling were a bit better in culturally and geographically disparate states, like Oregon, New Jersey or New Mexico, they might represent better targets.
If Mr. Obama were to lose Ohio (but hold the other states), the tipping-point would then become Colorado. There, Mr. Obama holds a much more tenuous lead, about one percentage point in our forecast, which converts to about a 60 percent chance of winning. But at least it’s a lead rather than a deficit, whereas Mr. Romney’s non-Ohio paths would require him to win states where he is now three or four percentage points behind.
Mr. Obama also remains about a 60 percent favorite in Virginia. Another option would be Florida, although it is a resource-intensive state and we give him about a 40 percent chance of winning there.
While state polls dominated the news on Wednesday, there were also a handful of national polls out, even as others have been suspended in the wake of Hurricane Sandy.
On average, Mr. Obama led by just over one percentage point in these national polls, although it is an odd distribution, with two polls showing him up by four or five points, several showing a tied race, and one (the Rasmussen Reports tracking poll) putting him two points down.
The FiveThirtyEight model calculates a national poll average, using a more sophisticated method than the simple average I’ve taken in the chart. (The model doesn’t “forget” about the Gallup poll, for example, just because it has been suspended for a couple of days.)
We don’t usually print this number, because it would sow confusion: our estimate of the national popular vote, which we do publish, instead represents a combination of national polls and the implied standing of the candidates based on state polls.
But, for what it’s worth, our national poll average shows Mr. Obama up by about half a percentage point right now. This is within the range of other Web sites: Real Clear Politics has an exactly tied race in its national poll average; HuffPost Pollster has Mr. Obama down by three-tenths of a point; Talking Points Memo has Mr. Obama ahead by about one percentage point.
Again: we don’t take the average of the national polls to be tantamount to a forecast of the national popular vote, since state polls, if considered carefully, can provide considerable information about the national race as well.
Suppose, however, that Mr. Obama were to tie Mr. Romney in the popular vote on Tuesday. The way that the forecast model works, this would require subtracting some from Mr. Obama in each state in order for the arithmetic to add up.
Even under these conditions, Mr. Obama would still be a favorite in the forecast. In fact, he’d be about a 70 percent favorite to win the Electoral College conditional upon the national popular vote being tied, according to our simulations.
A tie in the national popular vote is a tolerable condition for Mr. Obama, in other words. His position is robust enough in states like Ohio that he has some slack. With a lead of about 2.5 percentage points in the tipping-point states, Mr. Obama could underperform his state polls by a point or two and still win.
Conversely, Mr. Romney has few chances to win unless the state polls are systematically wrong.
I don’t mean for this to sound dismissive; the polling error could quite easily be correlated across the different states, and the national polls are one reason to be suspicious of the state polls.
But we’re at the point now where Mr. Obama may be a modest favorite even if the national polls are right. Two weeks ago, when Mr. Obama appeared to trail Mr. Romney by a point or so in the national polls, that would not have been the case.
Is it possible that Mr. Obama has benefited, politically, from his handling of Hurricane Sandy? He has gotten high marks for it so far, according to the tracking poll run by The Washington Post and ABC News.
Our database contains roughly a dozen polls that conducted the bulk of their interviews on Tuesday or Wednesday, after Hurricane Sandy became the dominant news story. Most of these are state polls, and most were conducted in states that were isolated from the major effects of the storm.
Our analysis of the trend lines in the polls suggest that they have been a somewhat above-average group for Mr. Obama, perhaps suggesting a percentage point or so of improvement for him.
The model is not yet pricing in very much of this into its forecast, as trends like that can occur fairly easily because of statistical noise. But if the storm has a discernible effect in the polls, it seems more likely to help Mr. Obama than to hurt him based on what we’ve seen so far.
This is something to monitor as more national polls come back online. I think describing the race as a “toss-up” reflects an uninformed interpretation of the evidence, but there is surely room to debate how much of a favorite Mr. Obama is. However, Mr. Romney is not in a position to tolerate any movement in Mr. Obama’s favor given how close we are to the finish line.
http://fivethirtyeight.blogs.nytimes.com/2012/11/01/oct-31-obamas-electoral-college-firewall-holding-in-polls/