General Election Prediction

Current Prediction: Labour short 27 of majority

Party2017 Votes2017 SeatsPred VotesPred Seats
CON 43.5%318 39.5%272
LAB 41.0%262 42.6%299
LIB 7.6%12 7.4%12
UKIP 1.9%0 3.7%0
Green 1.7%1 2.0%1
SNP 3.1%35 3.4%45
PlaidC 0.5%4 0.5%3
Minor 0.7%0 0.8%0
N.Ire 18 18

Prediction based on opinion polls from 26 Sep 2017 to 24 Oct 2017, sampling 8,841 people.

Probability of possible outcomes

Labour majority
41%
Conservative majority
34%
Lab/Nat coalition
6%
Lab choice of Lib/Nat
5%
Con/Nat coalition
5%
Nat choice of Con/Lab
4%
Con choice of Lib/Nat
4%
No overall control
2%

The future is never certain. But using our advanced modelling techniques, we can estimate the probability of the various possible outcomes at the next general election. ('Nat' means SNP+PlaidC)

Brexit

Brexit Choices and Public Opinion

Brexit Poll Question on EU Immigration vs Free Trade, ORB 3-5 Nov 2017

Neither the country not the cabinet are united on what they want from Brexit.

John Joseph Boylan looks at the possible options, along with insights on public opinion from recent polling.

Outcomes range from No Deal to No Brexit, via Good Deals, Bad Deals and sub-optimal deals.

The final outcome will be a balance between what the EU wants and what the UK wants, if the UK can agree what that is. But the public don't expect the Prime Minister to get the right deal.

Read the full article here.

Posted 13 November 2017

House of Lords

Burns Report of House of Lords Reform

Poll on House of Lords Reform 2017

The recent report on House of Lords reform, led by Lord Burns, is well-judged and suggests useful incremental reform within its prescribed limits.

The report lays out a 15-year path to linking the composition of the Lords to general election results, as well as shrinking its size to 600 members and introducing 15-year fixed terms for its members.

The report shies away from full-scale reform of the Lords by making it elected, like other second chambers in democracies around the world. The obstacle for change is that almost no-one in Westminster wants that, although a clear majority of the public does.

Read the full analysis to discover how to break the impasse and make Britain properly democratic.

Posted 9 November 2017

Evidence-driven policy

T-Charge ignores the evidence and hurts Londoners

Today marks the start of London's new T-Charge which penalises old diesel and petrol vehicles, to discourage them from entering London. London has significant problems with air quality, a large part of which is attributed to diesel engines. But the design of the scheme ignores the real scientific evidence and may even make things worse.

A BBC investigation by Tom de Castella, using the results of real-world driving experiments, shows that the T-Charge has got it all wrong. The BBC used experiments conducted by Emissions Analytics which use real-world driving conditions to measure the emissions of dangerous NOx particles from car exhausts. These tests are a much better guide to actual vehicle emissions than the standardised official tests which have been comprehensively "gamed" by the car industry.

The graph shows the shocking truth. The legal maximum for new cars, both diesel and petrol, is 80 milligrams of NOx per kilometer driven. And all new cars "pass" the official test. But the reality very different. Although 92% of petrol and hybrid engined cars pass the real-world test, only 14% of diesel engines are good enough. So a staggering 86% of new diesel-engined models emit more than the legal maximum. And they are not just a little bit above. The average diesel emissions level is a massive 399 mg/km, or five times as much as the official limit. Some models emit much more than that, such as the Nissan Qashqai with a lung-busting 1460 mg/km which is eighteen times the limit.

NOx Real-world emissions by car type

The BBC also tested an older Skoda from 2009. Although it was well above the legal limit, it was better than the average new diesel car.

The evidence is clear. Transport for London have got it wrong by making their distinction between old and new cars. The real distinction is between petrol and diesel engines. The T-Charge should apply to diesel engines old and new, until new diesel engines are actually as good as they are falsely claimed to be.

Posted 23 October 2017

New Boundaries 2018

Revised Proposals - Full Analysis

The Boundary Commissions for England, Scotland and Wales published revised proposals for the new constituency boundaries on 17 October 2017. Electoral Calculus has unique analysis of the proposals, including:

The graph below show the impact of the new boundaries for various outcomes of the next election. Based on current opinion polls (showing a 3pc Labour lead), it considers a range of swings from Conservative to Labour running from −5pc (strong Conservative gain) to +5pc (strong Labour gain). The blue line shows the extra seats which the Conservatives would win from Labour due to the new boundaries. The background shading indicates the likely outcome of the general election under the old boundaries.

New Boundaries: impact on seats

The graphic shows that the Conservatives gain about ten seats from Labour due to the new boundaries at current opinion poll levels, or even if Labour increase their lead. But if the Conservatives do better in the polls, then paradoxically they gain less from the new boundaries. If the Conservatives were on course to win the general election, then the "boost" from new boundaries would be only about five seats.

These relatively modest impacts may diminish the political motivation for pushing through these changes.

See the full analysis of New Boundaries 2018.

Posted 20 October 2017

Psephology

New Polling Technology

The last election was another bad one for pollsters. The overall poll error in the Conservative lead was over 4pc, which incorrectly suggested that the Conservatives would win a sizeable majority. That was the second time in a row that the polls got the election result wrong.

Predicted Seats during 2017 Campaign

But there was one notable exception. Late in the campaign, YouGov pioneered a new method of analysing polls which gave a very different result. The new method gave a final campaign prediction of 304 seats for the Conservatives. This was pretty close to the actual result of 318 seats, and correctly predicted that the Conservatives would not have a majority. YouGov called their method "multi-level regression and post-stratification", which baffled many people.

But what actually is this method? And does it really work, or were the YouGov results just accidentally right by lucky chance? The answers are that this method is similar to those successfully employed in other contexts and that it is very suitable to analysing polling data as well. It works pretty well in practice, not just for the most recent election but also for earlier British elections. Here are the details.

Read the full article on New Polling Technology or test it out in practice by challenging it to Guess My Vote.

Posted 12 September 2017

New Boundaries 2018

New Boundaries now Doubtful

Press reports in early September 2017 (see Times or Guardian) suggest that the government is unlikely to push forward with the reduction in seats to 600. It is suggested that the Boundary Commissions will be asked to repeat their reviews but keeping the total number of seats at 650.

That will require primary legislation, since the 600 seats are set down in the Parliamentary Voting System and Constituencies Act 2011. If new legislation is brought forward it could usefully also change the electorate tolerances from 5pc to 10pc, as this would make seats more homogeneous and reduce the need to cross traditional boundaries.

A repeat of the reviews could not be done very quickly, since all the proposed boundaries would have to be redrawn and the consultation processes re-run on the new boundaries.

Taken together, this greatly increases the chances that the next general election will be run under the existing boundaries.

See the full analysis of New Boundaries 2018.

Posted 11 September 2017

Election History

Electoral Timeline Map

Election Result 1955
Election Result 1955

The new and improved Electoral Timeline map gives an interactive journey through all British elections from 1955 onwards.

The map shows how each area of the country voted along with political commentary about the election including its context, the campaigns and key statistics such as seats won and swing.

You can choose either to start your journey back in 1955 and work forwards, or begin in 2017 and step backwards election-by-election.

Repeated themes include new Prime Ministers trying to secure mandates, oppositions re-inventing themselves as fresh modernisers, sterling crises, miners' strikes, economic problems, and questions about Europe.

Posted 16 August 2017

Political Geography

Data Map updated for 2017 election result

London wards in 2015 and 2017
London Wards: Party winner in 2015 and 2017

The new "Data Map" is a fully browsable map which can display a dozen indicators from the Electoral Calculus geographical database. The key indicators include:

Uniquely these indicators are available at four geographic levels:

The map allows you to explore the political and demographic make-up of the entire country, regions or individual localities, and opens up a whole new way to see political data.

The Data Map is available here now.

Posted 25 May 2017, Revised 26 June 2017

Election Analysis

Demographic Regression

Swing 2015-2017 against Leave share
Swing from Lab to Con against 'Leave' share, by seat

In a new analysis, we look at the swing voters who decided the last election. Using regression techniques, the swing voters who chose the Conservatives are revealed to be 'Leave'-supporting, nationalist, older and working class, whilst voters who swung to Labour were 'Remain'-supporting, internationalist, younger and middle class.

Siginficantly, economic issues did not seem to be a key priority for many of these voters. This was definitely the "Brexit" election, where other issues were pushed to the side.

See the full analysis here.


Posted 26 June 2017

Election Analysis

Election Prediction 2017 Post-Mortem

The traditional Electoral Calculus review of the 2017 prediction is now available. The prediction was overall of poor quality, over-predicting the Conservatives by forty seats.

Post-election analysis shows that the largest cause of this was polling error in the pre-election campaign polls, but other factors were also at play including strong tactical voting and idiosyncratic local factors.

See the full analysis here.

Posted 22 June 2017

New Boundaries 2018

New Boundaries deal fresh blow to Conservatives

Last week's surprise election result was bad news for the Conservatives as they lost their parliamentary majority and now have to rely on the support of the Democratic Unionists. But many Conservatives thought that their position would be improved by the new consituency boundaries. Originally proposed in 2010, the new seats are scheduled to come into effect in 2018. And using the 2015 voting patterns, the changes would have increased the Conservative majority by about 26 seats.

But the situation is very different now. Using the new 2017 general election results, Electoral Calculus has re-run the new boundary calculations to calculate the implied 2017 result using the initial new boundary proposals from the Boundary Commissions.

These calculations are based on the actual 2017 general election result, plus recent local election results up to 2015, census demographic data, and the initial proposals from the Boundary Commissions. They are not dependent on opinion poll data, and are not subject to opinion poll error. They are provisional estimates, and subject to change as the Boundary Commissions publish revised recommendations, and to using more recent local election data.

But these results will bring little cheer to the Conservatives.

With the new implied results the Conservatives are still short of a majority. They change from being eight seats short to being three seats short, winning 298 out of the new 600 seats. Their DUP partners themselves drop two seats down to seven, so the combined Conservative/DUP grouping increases its Commons majority very slightly from six to ten seats.

Actual general
election result 2017
Implied result at 2017
under new boundaries
Change
CON318298−20
LAB262245−17
LIB127−5
UKIP000
Green10−1
SNP3532−3
Plaid41−3
DUP107−3
SF792
MIN110
Total650600−50

Although many Labour seats in Wales and the North disappear, the Conservatives lose several now-marginal seats in London and eastern England. Their recent gains in Scotland also leave them vulnerable to the decreasing number of Scottish seats.

The Boundary Review is not going to play the role of the seventh cavalry in rescuing the Conservatives from their electoral problems.

Full details on the 2018 Boundaries page, or as a browsable map.

Posted 12 June 2017

Election Result

"Voters astonish pollsters"

This headline in the Economist seems to sum up what happened on Thursday. For yet another time, the pre-election campaign polls contained considerable error. The final average of the campaign polls showed an average Conservative lead over Labour of 6.8pc, whereas the actual difference in vote share was only 2.5pc.

That gives a poll error of over 4pc, which is only partially better than the poll error in 2015 of around 6pc. Though this error over-stated the Conservatives rather than under-stating them.

And, as most people know, if you put the wrong inputs into the prediction model, then the prediction will not be accurate. So the Electoral Calculus model predicted the Conservatives would win 358 seats, based on the incorrect poll data. In the end that was forty seats too high, and the Conservatives ended up with 318 seats and will be a minority government.

The polling data also seems to have confused the attempts to quantify the effect of the EU referendum. The data suggested that Remain voters would stick with their 2015 party, but the pattern of seat results suggest that seats in Remain areas saw significant defections away from the Conservatives.

Allowing for both of these problems, the basic model, given the correct inputs would have predicted the result to within about ten seats. (See the prediction.) This is similar model error to that seen in previous years.

In the final post on election day, the issue of polling error was flagged up and confidence bounds were given on the Electoral Calculus prediction. The actual result was contained within these bounds, with the exception of the Liberal Democrats who managed to gain four seats even while losing national vote share.

In the updated Electoral Battleground, it was shown that if the "low-lead" pollsters were correct (and they were closest to the right answer) then a Conservative minority government was a definite possibility with around a one-third chance of happening.

The main advance warning of the shock result came from YouGov's new methodology which uses models and demographics to predict voter behaviour. Electoral Calculus wrote approvingly of this methodology at the time (see below, 31 May 2017) and said that it could be the path of the future for market research. Congratulations to YouGov for getting it so right.

For the conventional polls, the winner of the most accurate pollster goes to Survation, who had three separate polls all showing a Conservative lead of just 1pc.

And the Exit Poll conducted for the TV broadcasters was, as usual, the most accurate. The Exit Poll is not only conducted on a fairly large sample, but it avoids the two main problems of the campaign polls which are uniform sampling and turnout. If someone has just come out of a polling station, then you know they have turned out.

It may be that this year's polling error was the mirror image of 2015. Last time, the pollsters asked respondents whether or not they intended to vote, and many young people over-confidently predicted that they would vote. To compensate, pollsters started disregarding what people said and used their own models to work out whether someone would vote. But the younger voters seem to have been so enthused by Jeremy Corbyn's Labour party that they voted in larger numbers than predicted. Truly "voters astonish pollsters". And us.

Posted 10 June 2017

Prediction Accuracy

How accurate are these predictions?

it's worth remembering that all the predictions on Electoral Calculus are subject to error. The actual results will be different from the estimated predictions.

The two main sources of error are polling error and model error. The first of these happens when the opinion polls conducted by the polling organisations are inaccurate. This happened particularly in 2015 when the Conservative lead over Labour was mis-estimated by more than 6pc. The polls are a key input to the Electoral Calculus model, so if the polls are wrong then the output predictions will also be wrong.

The other error is model error. The model has been refined to be as accurate as possible, but it is still an approximation to behaviour of millions of individual voters across 632 seats in Britain. Even if the polls are completely correct, there will still be some mis-predictions due to model error. To give an idea of scale, the model error in 2015 was less than 10 seats.

This election campaign has been notable for the strong divergence in polling numbers from some of the major pollsters. At one stage, there was a large gap of more than 7pc between YouGov/Ipsos-MORI and ICM/ComRes in their estimates of the Conservative lead over Labour. This has narrowed with the final campaign polls, as both YouGov and Ipsos-MORI are reporting leads closer to the average.

The Electoral Calculus estimate of polling error is 3.5pc standard deviation for the major parties. This corresponds to a 90% significance level for the 2015 error amount. Model error is estimated at a further 0.5pc. Feeding these uncertainties into the Electoral Calculus model gives these ranges for the possible number of seats won at the election:

PartyLow SeatsPred SeatsHigh Seats
CON314358418
LAB166218269
LIB038
UKIP000
Green011
SNP344955
PC033
N Ire181818

Overall there is a 88pc chance of a Conservative victory, but the majority can range from wafer-thin up to 186 seats. The Labour party might lose seats, but also has a chance of gaining some. The Liberal Democrats are unlikely to gain any seats and look set to lose some of their current eight seats (or just possibly all). In Scotland there are a lot of closely-fought seats, so the SNP's range of seats running from 34 to 55 is relatively wide. In any event they should still be the largest party in Scotland.

Though the actual results will fall where they will.

Posted 8 June 2017

Polling Methodology

YouGov predicts Conservatives short a majority

In an eye-catching Times story on 31 May, YouGov revealed a new model which predicts the Conservatives will only get 310 seats, leaving them short of a majority.

Not only is this prediction notably different from the predictions from Electoral Calculus and others, but the methodology used is very different from normal polls. Traditional polls simply aim to calculate the fraction of the overall population which supports each of the major parties. And they do this with the standard market research techniques of asking questions and adding up how many people gave each answer.

YouGov have tried something much more ambitious and modern. Using what they describe as multilevel regression and post-stratification analysis (which is reminiscent of the machine learning techniques of the big tech companies), they are trying to model how each individual voter in the country thinks. They need a big poll to do this (with a sample size of 50,000) plus regression against census demographics and British Election Study data.

This approach looks similar to that used by Electoral Calculus to calculate EU Referendum voting at the locality and ward level, as well as the other political measures as described in our Thirty Extreme Places in Britain article.

So Electoral Calculus salutes YouGov for their modern approach of combining polls and models to get richer and more insightful predictions. We will know next week whether their approach has got it exactly right this time. If it's right, then they will be justly celebrated. But even if it isn't, it is still the right thing to do and the method can be refined in future years to be more accurate. One day, maybe all polling will be like this.

Nonetheless, and for the record, the Electoral Calculus prediction is still that the Conservatives will get a sizeable majority.

Posted 31 May 2017