Tag Archives: Election 2016

Democratic Primaries in Arizona, Utah, and Idaho: Sanders is still in the race

This post was written in two parts, pre-primary and post-primary. To see the result and a discussion of what they mean, skip down to the last part of the post, where I’ll discuss why Tuesday’s results may mean that Sanders could win the primary.

Pre-Primary


As already discussed, Clinton is likely to win the Democratic nomination. Sanders is too far behind to catch up without extraordinary results, as outlined here. However, it is also true that Sanders is likely to win a majority of contests from here on out, while at the same time, Clinton is likely to win many (if not most?) of the actual delegates.

Here, I’ll review what my recently upgraded predictive model indicates for today’s primaries in Arizona, Idaho, and Utah. Also I’ll provide a list of states and delegate counts for the upcoming primaries (including today’s) that would have to be realized for Sanders to catch up to Clinton. At the end of the post, you’ll find results of today’s primaries, and some discussion, when available.

First, the expected outcome of today’s primaries based on this model:

Screen Shot 2016-03-22 at 9.59.26 AM

Clinton is expected to win big in Arizona, while Sanders is expected to squeak by in Idaho and win handily in Utah. The total delegate count for the day would be 82:49, Clinton:Sanders, so if this model is accurate, Clinton will win the day. As I’ve noted before, this model tends to under-predict Sanders’ wins when he does win, so the delegate count could be closer.

Or, this could be totally wrong and Sanders does much better, which would require me to go back to the drawing board. Which, of course, I’ll do.

In order for Sanders to catch up to Clinton, he’ll have to do much better than he’s done, even given the fact that he is favored in a lot of upcoming states. If we take all the upcoming states together and simply give Sanders even wins across the states sufficient to tie Clinton on the last day of contests, then he’ll need to win Arizona 44:31, Idaho 14:9, and Utah 19:14.

Here’s a chart of the outcomes across all states for Sanders and Clinton to finish the primary season in a tie.

Screen Shot 2016-03-22 at 10.03.27 AM

This is, of course, totally unrealistic. Sanders would likely do much better in some places, and just OK in others. But this chart serves as a basis of comparison for future races.

Every primary or caucus is a test of a hypothesis. The hypothesis that Clinton will do what I suggested she will do here is being tested by today’s contests. If Clinton gets somewhere around 75 to 89 delegates, the hypothesis is not rejected. If Sanders manages to perform much better than 49 delegates, say, over 62 or so, then the hypothesis has to be rejected (I’m not being formal here with rejection levels) and the possibility of him catching up has to be re-evaluated. If, of course, Sanders gets fewer than 40 or so delegates today, than he will have an even steeper uphill battle for the rest of the primary season.

I’ll add more information and commentary below after we get results!

Post-Primary

OK, it is early the next morning and we have results, but the results are not entirely complete. Because of oddness in the way delegates are assigned, it is often the case that the votes are counted, the primary results published, but the delegate allocation incomplete. Texas took forever, it seems, to post its actual delegate count, for example. All three states that had contests yesterday have incomplete delegate counts, even though we know how people voted. Proportional representation applies in all three states but things are not so simple.

For example, in Arizona, a certain number of delegates are eventually (in April) selected at the congressional district level, a certain number are at large, a certain number are linked to party officialdom, and a certain number are linked to constitutional office. Delegates are selected at different times (most at the convention in April). There is a right of review (by the candidates) of some of these delegates. Some delegates are committed to vote a certain way on the first ballot at the national convention, some are uncommitted. There are threshold effects whereby certain delegates may not be assigned if the threshold is not met in the preference ballot (I think … this part confuses me). A delegate is both a number (i.e., 10 delegates for Mary and 10 Delegates for Sam) and a person (Joe Bleaugh will go the National Convention as a delegate). There are lists of delegates (as in number as well as personage) and the exact number of “delegates” that might be on that list depends on … all of the above.

And that is the simple version of it. The rules are 18 pages long. Arizona is not unusual. Anyway, Arizona has 75 pledged delegates, of which 63 are counted as pledged (though they don’t exist yet as people) now, but the rest will be eventually. In the end, the allocation will be close to proportional, but because of the precinct and district level math, and other things, the exact number for each candidate probably can’t be known at this time.

So, given all that, I’m going to go out on a limb and say that in Arizona, Clinton will have 44 pledged delegates, and Sanders will have 31. This is not the same number you will see reported, because several delegates are listed as “available” for reasons cited above.

Using the same method, Idaho will award 5 delegates to Clinton and a whopping 18 delegates to Sanders. This is close to the reported amount, but off by one. I’ll attribute that to the Washington Post’s rounding error.

Meanwhile, Utah has reported delegates nice and clean like, straight shooters that they are, and we have 18 assigned to Sanders and 5 assigned to clinton.

My model predicted that Sanders would win Utah and Idaho, and he did. My model predicted (along with everyone else in the country) that Clinton would win Arizona.

However, the numbers are different than expected. Sanders did much better than my model suggested and better than mainstream media expected.

My model had predicted that Clinton would walk away from yesterday’s contests with 82 delegates to Sanders’ 49 delegates. Instead, depending on rounding and other factors, Clinton will have 54 and Sanders 67.

This means that Sanders is walking away from Tuesday’s contests with more delegates than Clinton instead of the other way around.

I’ve stated several times that Sanders has to average 60% of the take for the rest of the contest in order to tie clinton. He didn’t do that this time, he only got 55%. But that is 55% on a day when the largest contest, Arizona, was expected to go very favorably towards Clinton. In other words, because of the variation across primaries noted above in the discussion of “what Sanders needs to do to tie Clinton,” Sanders may have actually done what he needs to do this week.

You see, Sanders is expected to get about 48% of the votes here on in, with Clinton at about 52%. He needs to achieve a seemingly unlikely 60%. Last night, he got 55%. My model suggested that last night he’d get less than the overall expected, by a tiny a mount (46.7%) but he got much more.

Sanders is expected to win many of the upcoming states. Hawaii and Alaska are next, and I have no idea what will happen in Hawaii. But he will likely win Alaska, then Washington, then Wisconsin, then Wyoming and, I think, New York. My current prediction is that he’ll take about 57% of the delegates trough that period, but if he performs better during that time than expected at the same level as yesterday, he could easily exceed the required 60% return and move significantly toward catching up to Clinton.

All I can say is that I like both candidates a lot and will be happy with either one. If you are supporting either of these candidates, I hope you keep in mind that it is still possible that the other candidate, the one you don’t support, whoever that is, may win. Vote blue no matter who!

Sanders Vs. Clinton Vs. Obama Vs. Clinton: The 2016 primary in context

UPDATED: The graphic above is updated from the original post to show the delegate counts this year through the New York Primary. I’ve also added the projected delegate counts based on my model, as dashed lines, through the end of the primary.

A while back I posted an item comparing the current, 2016, Democratic primary process with the 2008 primary that mainly involved Hillary Clinton and Barack Obama. I posted the following graphic comparing the Real Clear Politics polling data summary over the course of the primary cycle. That was at a point in time when Bernie Sanders was gaining on Hillary Clinton and it started to look like he could catch up and surpass her, much as now President Obama did in 2008.

Screen-Shot-2016-01-16-at-2.28.11-PM

Now that the primary process has gone along a bit father, it is possible to make a more meaningful comparison between the races. In so doing, note that the schedule for the primaries was very different in 2008. The primary season stated at a different time and the order in which the states voted or caucuses was different.

Now, I’d like to compare the relationship between Obama and Clinton in 2008 vs. the relationship between Sanders and Clinton in 2016, but the timing of everything does not allow a calendar calibrated comparison. So, instead, I’m using cumulative delegates awarded over time as a way of lining up the data.

The graph at the top of the post shows the entire primary cycle in 2016, in lighter and thinner lines, showing how far apart the two candidates were the entire time, and where Barack Obama’s line (number of delegates) passed Hillary Clinton’s line, as well as a point later on where the lines almost recrossed again.

The thicker lines show only the first half of the primary season, because that is all that has happened so far, indicating the difference in delegate count between Bernie Sanders (red thick line) and Hillary Clinton (blue thick line).

The earlier graph comparing 2008 and 2016 would have given hope to the Sanders campaign that 2016 might be a repeat of 2016. The current perspective, using actual delegate counts, and much farther along in the process, does not. In 2008, Obama passed Clinton when only about 25% of the delegates had been assigned, though Clinton stayed close behind and almost caught up later. In 2016, once the first few contests were over, Clinton has stayed ahead of Sanders the entire time, with the gap widening.

As I’ve noted elsewhere, the gap will narrow over the remainder of the primary season, but unless voters start doing something really different, Sanders’ delegate count will not likely exceed Clinton’s delegate count.

Clinton Likely To Win Democratic Party Nomination

Almost exactly 50% of the votes have been cast in the Democratic Party primary and caucus process. I’ve been updating a model to predict primary and caucus results all along, and the model has done fairly well. The most recent update, however, was a bit off. That update involved separating states into two groups, southern vs northern, then calculating different sets of likely voting patterns by ethnicity for those two groups, and integrating that with estimates of ethnic distribution (“white, black, hispanic”) among Democratic voters by state.

What I did not do in those models was to incorporate the effect of whether or not a primary or caucus is open, closed, or somewhere in between.

Now that we have had quite a few primaries and caucuses, it is possible to move to a somewhat more sophisticated model, because there is (probably) enough data.

I ran a multi-variable regression analysis that coded primary openness (0=closed, 1=semi open, 2=open) and whether or not a state is southern or not southern, then included the percent of each ethnic group by state.

The result indicated that the percent of a voting group (by state) that is hispanic did not influence the result. In doing the analysis I looked only at states, and excluded Vermont and New Hampshire because of the strong favorite son effect. The resulting model, naturally, predicts the number of delegates that have already been awarded to each candidate, in total, precisely, for the simple reason that the model is based on that number. Within the data set, the R-squared value is 0.83, which is pretty good. This means, roughly, that 83% of the variation in voting (by percent who voted for each candidate) is explained by those variables. The following table shows the actual delegates won vs. the delegates predicted by the model.

Screen Shot 2016-03-16 at 11.07.20 AM

Also indicated is the spread between the two candidates in percent. The spread starts off a bit wonky because there are only a few contests, but then settles in to about 20% and remains at that level. Not shown is an analysis of the degree to which Sanders performed relative to expectations. If that number changed a lot, showing a trend, this would be important for predicting the future. The first half of the contests show Sanders under performing, according to this model, by 2%, and the last half have him over performing by 2%. So there may be a very low level “surge,” but not enough to make any real difference in the outcome.

So, what does the future look like? There are several states coming up where Sanders is likely to do well. But is it enough to make it likely for him to overtake Clinton? With a 20% spread and half the votes counted, Sanders would have to take an average of 60% of the delegates from here on. That is very unlikely.

The following table shows the primary and caucus outcomes through the present, followed by the predicted delegate commitments for the rest of the primary season. The percent spread between the candidates is indicated, and it does indeed drop over time, though slowly, reaching a minimum of 8% for the last few races.

Screen Shot 2016-03-16 at 11.49.30 AM

The total number of delegates required to lock the nomination is 2,383. There are 717 uncommitted delegates (aka “Super Delegates”). If we assume that all of those uncommitted delegates will simply vote for the majority candidate, then the number of delegates required to have a likely lock on the nomination is 1669. This is not a fully supportable assumption because some of the uncommitted delegates may chose a different path, but it is a reasonable approximation.

The part of the table above marked in yellow indicates the approximate point in time when the leading candidate, Clinton, will get somewhere around 1669 delegates. So, if this model is reasonably accurate, Clinton will achieve a lock about mid May.

The next set of primaries, next week, are Arizona, Idaho, and Utah. In my view, these are somewhat hard to predict. Polls suggest a weak Sanders win in Idaho and a weak Clinton win in Utah. My model predicts a strong Clinton win in Arizona, and Sanders victories in Idaho and Utah. The total number of delegates at stake next week is small (131 in total). In order for Sanders to signal that he can overtake Clinton, he would have to win about 79 delegates in total. If he falls short of that, the rest of the road is more uphill. If he does better than that, then he may be seriously in the running.

Sanders is also expected to do well in the next several races (Alaska, Hawaii, Washington, Wisconsin, and Wyoming) according to my model. However, I don’t actually expect my model to work at all in Hawaii. My model suggests that he may well achieve over 55% of the vote in those primaries, but again, he will have to have already achieved 60% (unlikely) on the 22nd for this to start to accumulate to a catch-up number.

Following Wyoming is New York State followed by Super Tuesday III, six states with 631 delegates. My model suggests he will get less than half of these delegates, though he will do well in Pennsylvania and lose by not much in New York. I’m also predicting that he will win in California, in June, but not by much.

Between now and the end of the race, there are 1946 uncommitted delegates to fight for. Of these, the top five states account for a whopping 1138 delegates. These states are Washington, New York, Pennsylvania, California, and New Jersey. I predict he will come close to even with Clinton or win most of these states (but Clinton will do very well in New Jersey), but in order for Sanders to overtake Clinton by focusing on these states, he’ll have to do VERY well in all or most of them.

This model uses everything that happened before (mostly) to predict everything that will happen in the future. The first half of this series of events is over (in terms of delegate counts) and there is no evidence of any dynamic change occurring at the moment. This model does an excellent job at retrodicting the prior races, but it might slightly underestimate Sanders performance, since for the last half of the retrodicted contests Sanders outperforms the model by an average of 2%. However, in order for him to catch up to Clinton, he has to outperform the model by 10%.

The graphic at the top of the post is the predicted delegate counts for the entire primary season. The already-held contests are represented as predictions instead of actual because the final number (today’s delegate count) is the same for both predicted and actual. There is a slight narrowing of the gap (see table above) but not enough to change the outcome of Clinton achieving a lock on the Democratic Party nomination in May.

March 15th Democratic Primary Results: What does it mean?

I’m starting this post before any primary results are in, and I’ll add the outcome of the primaries below, where I will also compare the results to my predictions and discuss what I think this means for the overall process of the Democratic primaries. But first, I wanted to get some thoughts down to contextualize my thinking on this. I’ll publish this post now, at mid-day Tuesday, so look for an update late Tuesday night, or early Wednesday.

I like Hillary Clinton, and I often think that her presidency would be better than a Sanders presidency, with an inaugural in 2017. This is based on Hillary Clinton’s qualifications, as well as the real politick we face right now. I appreciate her life long service to liberal causes, and recognize that long before Obamacare, there was Hillarycare, and I appreciate her work on education, racial equality, family issues, and choice. I think she can beat Trump or any other Republican that is nominated, and I think she would serve well in office. I want her to be POTUS.

I like Bernie Sanders, and I often get very excited about the prospect of Sanders closing the gap and moving ahead. I think he would face bigger challenges integrating his intentions with the current political situation, but who cares about that? We need a strong progressive in the White House, and Sanders is clearly the best choice for that. I appreciate the fact that Sanders has been a hard line lefty for his entire career, and he is the candidate I want to sit down and have a beer with … to talk about the revolution. I think he can beat Trump or any other Republican that is nominated, and I think he would serve well in office. I want him to be POTUS.

I am annoyed by the Clinton campaign whenever Hillary tosses a bone to the centrists, partly because it is tossing a bone to the centrists and partly because it is ingenuous vis-a-vis her historical commitment to liberal causes. I am annoyed by Clinton supporters who rail on Sanders’ electability, especially remarks about the “Democratic Socialist” thing.

I am annoyed by the Sanders supporters who have bought hook line and sinker the GOP anti-Clinton talking points that the Republicans have been developing for decades, and those who claim “Sanders or bust.” I am annoyed at the Sanders campaign for not doing enough to keep the conversation on task (beating the Republicans), allowing this subset of supporters to do the campaign’s bidding in a way the campaign would not do itself.

People who argue against Clinton by comparing the records of the two candidates habitually make a critical error (other than buying the GOP poison as noted). Bernie Sanders is the Senator from Vermont. Vermont is the state of Maple Sugar and Good Ice Cream. People in Vermont live in underground houses and yerts. If you are a hard core progressive, and you represent Vermont, you rarely have to also represent issues or people or companies or industries or communities that are not in line with progressive thinking. In the few areas where Sanders has gone off the Progressive track, it has been because he also represents a few interests — because they are in his state — that are not progressive, such as with respect to gun ownership or dealing with toxic waste, etc. A Bernie Sanders clone, with the same values and all that, representing a larger, more diverse, more complicated state would have a voting and legislative record that is very different from the one he has. Clinton, on the other hand, was the first lady to a president that moved hard to the center. She was the Secretary of State for a president who developed an effective, but not entirely progressive, foreign policy that overlapped a lot with an energy policy that was brilliant in every way except one: It did not keep the Carbon in the ground. (Very important.) This makes the comparison internally very biased before any careful analysis can happen, and that bias is rarely considered.

People who argue against Sanders on the ground that he is not going to get anything done, or because of a political label with a version of the word “socialist” in it, underestimate the degree to which many Americans are fed up with the current wealth-concentrating and unfair system of economy, politics, and government. They fail to recognize that the framework for the American political conversation has been pushed to the right at almost every turn since Gingrich and the Contract on America, and the one recent time it got pushed to the left, with the election of a non-white President, special circumstances applied and the fascists and racists came out of the woodwork. Many of the same individuals argue that it is good that Sanders’ candidacy has had so much support, even if he is not nominated, because it brings those progressive issues to the table. That is true. But the same argument suggests that a Sanders presidency would move that framework back from the right and towards the left even if Sanders has a non-Democratic Congress for his entire time in office. He won’t play Obama-style multi-dimensional chess, a strategy that has not gotten much done with a Republican controlled Congress. Rather, he’ll spend four or eight years yelling at the Republicans and also not getting much done, but with a potentially stronger effect. He’d move the political center to the left.

A while back I started making regular predictions of what would happen in the upcoming primaries and caucuses. Let me tell you why I did that.

I’ve been expecting, since the beginning of the primary season, for one or another thing to happen. You will recall that I repeatedly posted a graphic comparing the Clinton-Sanders popular standing in national polls with the same graph for Obama-Clinton in 2008. The idea was to show the flip between the heir apparent, Clinton, and the other guy. In the case of 2008, that happened early in the primary process. The point of showing that graphic was to remind everyone, back then, that even though Clinton was ahead in all the polls, Sanders could easily overtake Clinton and not look back, as Obama did. So, all along, one of the things I’ve been expecting is for that to happen. But, so far, it has not happened.

The other thing I’ve been expecting to happen is for Clinton to move ahead at a steady, and eventually increasing, rate, to leave Sanders in the dust. That would, of course, produce the exact opposite result, with a Clinton nomination what could have been clearly foreseen months in advance. But, so far, it has not happened.

Obviously, only one of these two things could happen, at most. I will note that those who supported one candidate or the other early on in the primary process have been pretty sure all along that the change … the Sanders surge or the Clinton juggernaut … was already happening and was about to really happen, all along. Those supporters, of either candidate, have been wrong all along. Neither has happened.

Anyway, the reason I started to develop a model of what would happen across the entire primary process has been to identify when the Clinton juggernaut, or the Sanders surge, was afoot. At which time, probably, I would declare that this thing was happening, throw my support behind the surging or juggernauting candidate, and get to work on that campaign.

With each group of primaries and caucuses, I did my best to use unbiased reasonably good empirical evidence to predict the primaries, with the idea that if a strong trend was evidence, of possibly for a given set of primaries, I’m wrong in my predictions, significantly, one way OR the other, then surging or juggernauting has commenced. But that has never happened. Clinton has been ahead the entire time, but not far, and the gap has closed. But the gap has not closed (prior to today) enough to convince me there is a surge. This is like one of those horse races where the favorite is in first place until the last furlong. Then, the second place horse runs ahead of the first place horse and wins. Or, the second place horse stays in second place and does not win. We can’t tell. There is no evidence to suggest one outcome or another at this time.

So that is why I’ve been making these predictions, to help decide what to do, as a signal to fish or cut bait. And, I continue with this effort because the outcome of every single set of primaries or caucuses has been the same: Clinton has outperformed herself and done really well where she’s won, and Sanders has outperformed himself and kept right behind Clinton where he’s won.

Make no mistake. My current empirical analysis, which has been very effective at predicting primaries and causes, still shows and has always shown an eventual Clinton nomination. But the difference between the two candidates has not been large enough to suggest that a Clinton nomination is inevitable. I’ll also add that this projection is actually what my earliest projections showed … a long and steady race with Clinton just ahead of Sanders the entire time. But, the whole idea of the Sanders candidacy is the surge, the upward swing, the crowds of revolutionary voters showing up and tipping over the cart, at some point in time. The fact that it has not happened to date does not mean it won’t happen. Also, the most recent set of primaries did in fact move Sanders closer to Clinton by a good amount, so the size of the cart that needs to be tipped is smaller, attainable.

I will note that I find myself at the moment more annoyed with that special subset of Sanders supporters who are rude and unthinking than I am with any subset of Clinton supporters with whom I regularly interact. So far, many people have taken me for a Clinton supporter or a Sanders supporter, or have been annoyed at me for not explicitly supporting their candidate (either one). But across all of this interaction, the number of Clinton supporters who gave me crap for not getting on board with Clinton is exactly one, from a trusted friend and political activist, and it was subtle, polite, and done with humor. I simply don’t find real evidence for Clinton supporters being jerks to Sanders supporters in my own personal interaction sphere, though there is plenty of that out there on-line among the Titterati and Facebookois. In contrast, I am faced with Sanders supporters who mistakingly think I’m going for Clinton, who get fairly nasty at times (again, this is that special subset of Sanderati, I hope a small percent). These special snowflakes are more likely to a) assume incorrectly whom I support, b) make incorrect assumptions about what I know and what my experience in politics may be (I once received a virtual questionnaire from a Sanders supporter demanding my background in political activism!), 3) get nasty about it, and 4) declare that if Sanders is not nominated they will do something really dumb like vote for Trump, write in Sanders, etc. So, while the level of support, depth of feeling, rational argument, etc. for each candidate within me and coming from me are even, there is this imbalance, and I find it disturbing and I don’t like it at all.

So, what will happen tonight when five sets of primary results come in? I’ve made my predictions here, but what will be the meaning of a particular outcome?

I have to check my numbers (so this paragraph might get fixed), but my estimate is that at present Clinton is ahead of Sanders in committed delegates by about 20%, but that by the end of the night according to my predictions, that gap will close to about 10%. So …

<li>- if the gap widens or closes by only a couple of percentage points, that will point to a very very likely Clinton victory, because all the different kinds of states have been sampled, half the delegates will have been assigned, and even a surge can't bring Sanders into first place.</li>


<li>- if the 10% gap (plus or minus 2%) is the result of today's contests, Sanders is still following Clinton closely enough that a true surge could cause him to overtake her, but it would have to be a big surge, and is quite possible but not that likely. Ten percent is actually a very large number if half the votes, as it were, were counted. But if this happens, I will be then in exactly the same place I am now, continuing to support both candidates, not choosing one, not sure what will ultimately happen.</li>


<li>- if the gap closes to much more than 10%, or, certainly, reverses, then the Sanders Surge some expect to see in the larger, reasonably but not very diverse, industrial, etc. etc. states is in evidence. In that case it is time to simply get behind Sanders, but NOT vilifying Clinton of course, and push for a Sanders win.</li>

I am truly excited about the prospect that, in today’s primaries, Hillary Clinton pulls ahead numerically and this becomes a one person race. I’m truly excited about the prospect that, in today’s primaries, Bernie Sanders does so well that he has an excellent chance of winning the nomination. The bias I mention above leans me slightly towards being more excited about a Clinton pull-ahead, because that would leave those special snowflake bernie bots, whom I find annoying, behind. But they are not the ones running for office, so that bias is small. But I admit it; I don’t like my support being extorted with claims that so many Sanders supporters will throw the country under the bus if they don’t get their way. I just hope that is truly a small number of individuals.

So. What happened Tuesday night?

…. to be filled in later …

And so, here is what we have…

Clinton did very well tonight. My model had predicted that Sanders would do well enough to close the gap from 20% to 10% difference, keeping him in the race. What happened instead is that the gap between the candidates, with half the votes counted, remained at 20%. In other words, this happened:

  • – if the gap widens or closes by only a couple of percentage points, that will point to a very very likely Clinton victory, because all the different kinds of states have been sampled, half the delegates will have been assigned, and even a surge can’t bring Sanders into first place.
  • My revised model attempted to account for recent Sanders northern state victories by calculating the expected outcome with an appropriate adjustment. However, the Sanders campaign did not perform, and my predictions were relatively inaccurate. Which is sad for my model, and for Sanders.

    The voting is still happening and delegates are not all assigned, and delegate counting is strange in Ohio, so my original predictions of delegate counts can’t be compared to the data we have right now, tonight. So I converted my delegates counts to percentages, and then converted the reported percentages adjusted to make Clinton and Sanders sum to 100% (because my percentages do this as well). This is what I get:

    Screen Shot 2016-03-15 at 9.49.00 PM

    I predicted a close race in Florida. What actually happened was a Clinton landslide.

    I predicted a close race in Illinois. This is correct. Clinton will likely win Illinois and pick up a few more delegates there than Sanders.

    I predicted a close race in Missouri. We have a close race in Missouri. I had predicted that Sanders would win by a little, and it looks like he is going to win by a little.

    I predicted a rout in North Carolina. We are getting a rout in North Carolina. Clinton will win, but not by quite as much as I had predicted.

    I predicted a close race in Ohio. Clinton is doing very well there and will beat Sanders decisively. Some people will call it a landslide, some will not.

    So, while I predicted three races very accurately, my model was way off for two big ones, and Sanders will end up with far fewer delegates today than expected.

    Here is a histogram showing change over time, roughly divided into weeks of primary activity, in the percent difference between the candidates.

    Screen Shot 2016-03-15 at 9.48.41 PM

    With about half the committed delegates counted and a solid 20% gap, Sanders would have to perform at 60:40 on average from now on to catch up.

    Using the actual data through today (today’s delegates estimated in some cases) and the model’s prediction for the future (which still performs overall fairly well, but giving Sanders, apparently, more delegates than he is likely to get) here is what the future of this primary season looks like:

    Screen Shot 2016-03-15 at 10.01.11 PM

    Sanders is likely to win a large number of the upcoming primaries, but probably only by a small amount, and he will continue to lose some of them by a large margin. I think it is very unlikely that he is going to achieve a 60:40 win, on average, for the rest of the race.

    At this point in time, it is a near certainty that Clinton will be the nominee for the Democratic Party for President.

    How Will Clinton And Sanders Do On Tuesday? (Updated)

    Most polls and FiveThirtyEight predict a Clinton blow-out on Tuesday, with her winning all five states, in some cases by a large margin. My model, however, predicts that each candidate will win a subset of these states, but with Clinton still win the day.

    I’ve been working on a model to predict primary outcomes for the Democratic selection process, and generally, the model has proved very effective. After each set of primaries I’ve adjusted the model to try to do a better job of predicting the upcoming contests. The most important adjustment is the one that affects the current model.

    The model assumes that we can predict voting behavior by ethnicity. Given this assumption, the distribution of potential Democratic participants by ethnic group then gives the final likely division among primary voters or caucus goers across the two candidates, then this translates directly into the division of committed delegates for that state. The estimates of within-group voting are made from exit polls.

    The most recent revision divides states into “Southern” (meaning deep south) and “Not Southern,” and uses different sets of numbers for each of the two kinds of states.

    To date, about 32% of the committed delegates have been assigned, with 769 for Clinton and 502 for Sanders. Next Tuesday, March 15th, an additional 691 delegates will be committed to the two candidates. So, almost exactly 50% of all the delegates for the entire process will be committed. (None of this counts uncommitted delegates, sometimes called “Super Delegates.”)

    If Clinton and Sanders each do about as well as they have done in the past, this will leave Sanders with a significant gap to close, and he probably can’t win the nomination. If Clinton does better, that closes the door to Sanders even more firmly. But, if Sanders does well, that may help close the gap and considering Sanders as a possible nominee is reasonable.

    The current model, which has the interesting dual property of giving Sanders more delegates than the polls currently predict, but also, according to my own evaluation of my own model, probably underestimates Sanders’ performance, suggests that Clinton will earn more delegates than Sanders, but not by too much. So, if the underperformance of the model is strong enough, they could come close to a tie. At present, here are my predictions for the outcome of Tuesday’s set of primaries:

    Florida: Clinton will win but by less than expected. The outcome will be so close that I can’t rule out a Sanders win here.
    Illinois: Sanders will win, but this may be close to a tie.
    Missouri: Sanders may win by a small margin. However, keep in mind that it is very difficult to classify Missouri as a “Southern” vs. “not-Southern” state. I picked “Not-Southern” for this prediction. But we’ll see. If Missouri goes all “Southern” then Clinton wins there.
    North Carolina: Clinton will win by a very large margin (70-something to 30-something delegates).
    Ohio: Sanders will win by a small margin.


    UPDATED

    Here is the output of the model indicating the expected number of committed delegates to be awarded on Tuesday to the two Democratic candidates:
    Screen Shot 2016-03-14 at 2.34.04 PM

    If these numbers are close to what happens, or if Sanders does better, then Sanders is still in the race, though with a tough road ahead of him. If, in contrast, the polls turn out to be right, it would indicate that Sanders’ over performance in earlier contests may have been temporary, and the chance of him winning the primary is very small. At present the polls show Clinton way ahead in Florida, Clinton barely ahead in Illinois, a near tie in Missouri, Clinton way ahead in North Carolina, and Clinton a little ahead in Ohio. In other words, I’m suggesting that Sanders will win three out of the five races, while the polls suggest he will one or may be two.


    Let’s look at the FiveThirtyEight predictions to see how they compare.

    FiveThirtyEight gives Florida to clinton (nearly 100% chance of wining). They predict a strong Clinton finish in the state, about 2:1.

    For Illinois, FiveThirtyEight says about the same, a better than 2:1 projected result, with Clinton carrying away a lot of the delegates.

    For Missouri, FiveThirtyEight has Clinton probably winning, but not by too much, so only a small pickup for her.

    For North Carolina, FiveThirtyEight has Clinton winning just shy of 2:1 over sanders.

    For Ohio, FiveThirtyEight predicts a Clinton win, and a fairly strong one.

    So we can see that there is a huge difference between FiveThirtyEight’s prediction and mine, and the two methods are very different. Both of the methods used by FiveThirtyEight rely on some combination of opinion or support-related information, while my method uses none of that. For this reason it is not surprising that the two methods produce very different results.

    The point of going over the FiveThirtyEight predictions is that they do a very good job of representing the polling data, which overall strongly suggest that Clinton will run away with the nomination. The problem is, these data have been suggesting this since Iowa, and generally speaking, Sanders has far outperformed those estimates.

    The final outcome in terms of delegates from all five races will be approximately:

    Clinton: ca 364 delegates

    Sanders: ca 326 delegates

    This will mean that, at the end of the day Tuesday, Hillary Clinton will have about 56% of the committed delegates, to Sanders’ 44%, with about 50% of the committed delegates assigned.

    Who Will Win The Democratic Primary? (Updated model)

    I have been presenting various versions of a model to predict the outcome of upcoming Democratic primaries. The earlier version of the model worked like this: Make some assumptions about the ratio of voting preference (for Sanders vs. Clinton) among the different major ethnic groups, and using the known distribution of said ethnic groups, predict the future.

    I started out with the assumption that among whites, the ratio would be 50:50, based on one datum, the outcome from Iowa, which is essentially a white state. I used a bias for African Americans and Hispanic voters favoring Clinton. That worked well to predict several primaries, with the caveat that what happens in Vermont and New Hampshire would be biased by favorite son effects.

    The second part of the model is to update the within-ethnic group biases with further information as it became available, using primarily exit polling. At no point did polling for future races come into play except to demonstrate in advance that the model might work (by comparing polling for some Super Tuesday state polls with the model predictions).

    Again, the model predicted Super Tuesday’s outcome pretty well, but there were some surprises especially in order of magnitude where Sanders won. In those states I had predicted either something close to a tie or a modest Sanders win, and he did better.

    Now that there have been several other races (Louisiana, Nebraska, Kansas, Maine, Mississippi and Michigan), with more exit polling and some more surprises (that, again, I predicted in polarity but not magnitude) I can see that the model works very well in predicting states where Clinton ultimately won, but under-estimates Sanders’ delegate take in states where he won. And, the states where the latter happens are those that are not part of the “deep south.” This indicated that both “black” and “white” voters (and maybe “hispanic” voters) are doing different things in those different states, and that ethnic mix alone is insufficient. I also considered that whether or not a primary is “open” or not may be a factor (or a primary vs. a caucus) and I’m sure this has an effect. However, the simple characterizations of “open” vs “closed” or even “caucus” vs. “primary” come nowhere close to actually capturing the real variation among these kinds of states. Plus, sadly, there is a general lack of exit polling information for some of the odder states, so the two factors (a different ethnic pattern vs. the effect of the kind of contest) can’t be compared in relation to each other.

    So now I have a new model. This is exactly the same as the first model, but uses different ethnic patterns (how each ethnic group is likely to vote) for states that are “southern” (deep south, not the southwest) vs. states that are not “southern”. This could have been done by looking at the proportion of African Americans in each state to produce an adjustment, and I may well do that eventually, but for now a simple binary distinction seems appropriate. I calculated, using exit polls, ethnic patterns for these two kinds of states.

    I have data for eight southern states indicating that the ratio of Clinton to Sanders support for White, Black and Hispanic should be 60-40, 88-12, and 71-29. In contrast, for non-southern states, for which I have data from six states, the ratios are 45-55, 69-31, and 46-54. Note, however, that this “black” ratio is based on only four data points, and the hispanic ratio for both types of states is based on one state each.

    In other words, Black voters always favor Clinton but much more so in southern states, white voters favor Sanders in non-southern states but the reverse is true in southern states. Hispanic voters strongly favor Clinton in southern states, and mildly favor sanders in non-southern states.

    Applying this model to the past, it does less well than earlier versions of the model did on the first few primaries, and better on later primaries. This may mean that there is a change in voting behavior, or simply differences in the states that happen to go earlier or later. Indeed, the current model still somewhat underestimates Sanders performance where he does well, and if the smaller number of later states (i.e, excluding Iowa, New Hampshire and Nevada) is used to estimate these ratios, the White ratio is unchanged but the Black ratio works a bit less against Sanders. But at this point we have broken the data down into too-small units and are nitpicking. (By the way, if I recalculate the ratios weighing for state population size, which might be better because larger states may be better samples, there is no significant difference. More likely, a weighted average that ranks the quality of the exit polling data would be more logical and useful, but I do not have any such quality measures.)

    When retrodicting previous contests with the new model, to see how well it works, the outcome isn’t too bad. It fails to predict Iowa, Nevada, Colorado, and Massachusetts, but is close. The new model predicts a 65-65 split in Michigan, which actually had a 61-69 split, so that’s wrong (but a tie is better than the wrong win.)

    I could easily adjust the Sanders numbers to make the model predict the outcomes better in those states where he won, and that might be reasonable because of the status-quo part of the status-quo-ethnic model. But it would be an arbitrary adjustment with respect to the ethnic part of the model, so it is better not to.

    This model retrodicts that Clinton takes 785 committed delegates and Sanders takes 536 committed delegates to date. By my count (which may vary from other counts because sometimes the delegates are counted funny) Clinton has actually won 769 and Sanders has won 502. That’s not bad, I’ll take it.

    So, if this model is any good, I should be able to tell you now who will win the various races in the all-important upcoming Son of Super Tuesday, next week.

    Clinton will win Florida, barely. The model projects a tiny lead for Sanders in Illinois, so that may be a tie. Clinton handily wins Missouri and North Carolina. Sanders barely wins Ohio. At the end of the day (aside, again, from delegate awarding oddities) Clinton will have added 376 committed delegates to Sanders’ 314. A Clinton win, but not a big one, is expected for next Tuesday.

    Finally, according to this latest version of the status quo ethnic mix model, Clnton will win the nomination. The following graph shows the cumulative delegate count for each candidate, with the first several dates (up to yesterday’s primaries in Mississippi and Michigan) using actual committed delegate counts, and the rest using the projections from the model.

    Democratic_Primary_Predictions_2016

    It is very important to note that this model probably underestimates Sanders’ performance in a subset of states. In other words, Sanders actual delegate count will be somewhere between the two lines shown here for a few weeks. The question then remains, can he get his line to cross Hillary’s line?

    Note that in this scenario, Sanders wins both New York and California, but just by a little. If there is a handful of big states where my “just by a little” actually turns out to be “by a surprising amount” there could be a different outcome. Indeed, Sanders is expected to outperform Clinton from New York onward in many primaries, and if he does “a surprising amount” (which by then won’t seem like a surprising amount anymore) wherever possible, he could pull ahead.

    Sanders can win the nomination: New Analysis

    I developed a predictive model for the Democratic primaries that was designed to have the following features:

    1) It does not rely on polling;

    2) It does use exit polling and other information to set certain parameters;

    3) It mainly uses prior primary or caucus results to predict the future, and thus assumes that the status quo is the best indicator.

    4) It calculates likely voting patterns based on ethnicity (White, African American, Hispanic), and using likely Democratic party distribution among these groups to predict each contest’s outcome.

    That method outperformed most other predictions for Super Tuesday and accurately predicted who would win in the four contests held over the last weekend. However, in states that Sanders won last weekend, and in at least two of the Super Tuesday results, the method underestimated how well Sanders would do. Notably, the numbers used to predict those primaries accurately predicted how Clinton would do in Louisiana, and generally.

    In other words, mostly, where Clinton won, the model was accurate, but where Sanders won, Sanders did better than expected, not counting “favorite son” states where he did even better.

    The most likely reason for the difference between prediction and reality over last weekend, since this is a status quo poll, is a change in voting patterns. In other words, it is possible that Sanders is picking up some momentum. That does not explain why the largest of the primaries, Louisiana, fit the predicted pattern while the others do not.

    A second possibility is that Sanders outperforms expectations in caucus states. That seems almost certainly a factor, which I can not explain.

    A third possibility is crossover voting or independents favoring Sanders in some, but not all, states. If Republicans are voting in the Democratic contest, or independents are showing up at the Democratic events, specifically because they want to vote for Sanders, that could explain a localized Sanders surge. This does not do well explaining last weekend’s results, because Sanders won in closed caucuses. But, it could explain some earlier results, such as Massachusetts and Minnesota. I know for a fact that some Republicans and a lot of “independents” (as in, “I never did this before, see how independent I am”) voters showed up in the Minnesota caucus. The question remains, of course, where were these voters in Louisiana?

    One explanation for this may be that the indies and centrists in more conservative southern states, which also happen to have a lot of pro-Clinton African American voters, are mostly registered Republicans or chose to participate in the Republican rather than Democratic process, while similar voters in less conservative or liberal states were already more likely to be Democrats or to at least participate this year in the Democratic primaries or caucuses. Differences in voter turnout across states seem to conform to this pattern.

    Last weekend barely added enough data to consider revising the model. Assuming that the status quo method still works, but with somewhat adjusted numbers to match Sanders wins so far, and combining projections into the future with primary results so far, this model now puts Sanders on top at the very end of the primary process, like this:

    Screen Shot 2016-03-07 at 9.57.31 AM

    I quickly add that I don’t have a lot more confidence in this projection than the previously developed projection that has Clinton winning. But this new projection is important because it accounts for what might be recent changes in how people are voting.

    Michigan’s primary, to be held tomorrow, is important. Michigan is relatively diverse, and is northern (less conservative, etc.). The modified model predicts that Sanders will swamp Clinton in Michigan, picking up over 70 delegates to Clinton’s low-fifties. In contrast, the previous iteration of the model predicts that Clinton will win with about 66 delegates and Sanders will pick up a healthy 60 or so.

    Michigan’s contest is a primary, not a caucus, but it is open, so cross-party activity is possible.

    Michigan will be a test between the two models, the older one that ultimately favored Clinton, and the revised (but far less certain) one that suggests that Sanders could eek out a victory.

    Michigan plus last weekend’s contests combined will give me enough data to produce The Model of Models which will accurately predict the outcome of primaries coming up in Florida, Illinois, Missouri, North Carolina and Ohio. Or not. We’ll see. It is possible that I’ll add an element to the model, using one set of assumptions for red states, another set for blue states.

    One week after Michigan, Son of Super Tuesday happens. If either one of the candidates is very strong on that day, that may finish off the other candidate. The actual number of committed delegates is not too different between the two candidates, and the so-called “Super Delegates” will probably be obligated to go with whoever enters the Convention with the most delegates.

    Democratic Primary Results: Predicted vs actual (Updated with Maine)

    Yesterday, the Democrats held three contests, in Louisiana, Nebraska and Kansas. I had predicted a Sanders win in Nebraska and Kansas, and a Clinton win in Louisiana, using my ever-evolving ethnicity-based projection model. Those predictions came to fruition. Like this:

    Predicted on top, Actual on bottom.

    Democratic_Primary_Saturday_March_5_2016

    Clinton did a bit better than projected in Louisiana, and Sanders did a bit better in Nebraska, but much better in Kansas than predicted.

    I had projected the final delegate count to be 60:49 (Clinton:Sanders) for that day, and it turned out to be 55:49 (Clinton:Sanders). The difference is primarily in the number of actual delegates awarded to the candidate between what my model assumed and what the states (Louisiana) actually did. Overall, I’d say that the model, which currently predicts Clinton reaching lock-in on delegate count in mid or late April, is accurate, but with enough of a difference to allow for Sanders to close the gap somewhat. At this point, though, Sanders will have to start performing better in order to catch up.

    Lately we’ve seen a discussion that runs something like this. Clinton is winning in states where a Democrat is unlikely to lose, and Sanders is doing well in states where a Democrat is likely to lose. Therefor, Clinton would lose the general election, and Sanders would win it.

    This proposition fails to take into account that for the most part the two candidates are interchangeable at the level of the general election. All those people who preferred one candidate in the primary will prefer the other candidate in the general, should that other candidate win the nomination. The only way for Sanders to beat Clinton is to start winning more delegates than the model projects, and soon.

    Sanders’ better than predicted performance yesterday is not enough for him to overtake Clinton, but perhaps it is a sign that he is increasing his performance. Every primary or caucus is a test of the running hypothesis of status quo, and at the moment, status quo gives Clinton the nomination. Sanders will have to start falsifying that hypothesis very soon. There is no reason to say that will happen, or not happen, at this time.

    By the way, a similar model (using the status quo as the determining factor in making predictions, but with no ethnic adjustment) for the Republican party predicts that Trump will lock in the nomination late enough in the process that he could actually fail to do so if his performance falters. The possibility of a brokered Republican convention is very real.

    That is not the case, probably, for the Democratic convention, as the uncommitted delegates (called Super Delegates) will likely vote for the winner at the end of the process, to lock in that candidate.

    UPDATE: Today, Sanders won in Maine. I had predicted a Sanders win, though Bernie got more delegates than my model had suggested.


    Predicted on top, Actual on bottom.

    Screen Shot 2016-03-06 at 10.05.06 PM

    The Delegate total for this weekend is now 72:62 Clinton Sanders predicted, 62:64 Clinton Sanders actualized.

    I will assume that the extra strong showing by Sanders in Maine is partly a result of the Favorite Son effect, and not adjust the model. Mississippi and Michigan, in just a couple of days, together with this weekend’s contests, should provide excellent calibration in preparation for primaries if Florida, Illinois, Missouri, North Carolina and Ohio.

    The Sanders Hypothesis: This Weekend’s Primaries

    This weekend there are Democratic Party primaries or caucuses in Kansas, Louisiana, Nebraska, Maine and Puerto Rico. The model I developed for predicting primary and caucus outcomes indicates the following results as most likely:

    Screen Shot 2016-03-05 at 8.43.16 AM

    Sanders is losing the primaries, so far, and Clinton is on the path to victory. However, Sanders has a fair amount of time to catch up. Perhaps he just needs his strategy to take hold. The idea was to have a revolution, which in this case, means a lot of people show up. A lot of people did show up, but not enough. Sanders needs to get the rest of them to show up in these states! (My model only addresses states, sorry Puerto Rico, and yes, you should be a state).

    So, in a way, this weekend’s events are individual tests for the hypothesis that Sanders can pull his nuts out of the fire and catch up to Clinton. (Unlike Republicans, we speak not of genitalia here, but rather, chestnuts. Roasting. In the open fire of politics. You’ve heard the expression, right?)

    This could be a good weekend for Sanders in terms of victories. I’m predicting he takes Nebraska, possibly Kansas, and certainly Maine. Three wins all at once will invigorate his campaign.

    However, note that these numbers are from a model that predicts a Clinton lock on the nomination by mid April. A sign that Sanders is doing better than that projection would be doing less badly in Louisiana, and significantly better in Nebraska and Kansas. I don’t think doing better than projected in Maine will mean much, because there is a probably favorite son effect there.

    Super Tuesday: What does it mean for the Democratic Primary?

    As you know, I developed a simple model for projecting future primary outcomes in the Democratic party. This model is based on the ethnic mix in each state, among Democratic Party voters. The model attributes a likely voting choice to theoretical primary goers or causers based on previous behavior by ethnicity. Originally I made two models, one using numbers that the Clinton campaign was banking on, and one using numbers that the Sanders campaign was banking on.

    The results of the Super Tuesday primaries demonstrated that the Sanders-favoring model does not predict primary outcomes. Those same results showed that the Clinton-favoring model worked better. But the numbers also indicated that the Clinton favoring model estimates Clinton’s ultimate delegate take somewhat inaccurately.

    I adjusted the model parameter so the model now matches reality for a subset of the primaries that have already happened to within five percent. The model still slightly favors Clinton, but not by much. The subset of primaries includes only the US states (not territories, where I don’t expect the ethnic mix approach to work at all) and excludes states with a strong favorite son effect. This therefore excludes New Hampshire and Vermont. Due to oddities in the Texas delegate system, the adjustment was also made by excluding Texas, though the model results for Texas match very well proportionately.

    (Note: Using only the subset of states, the model predicts previously held primaries and caucuses to within less than two tenths of a percent).

    The new model now only has one version, which as noted matches primaries so far very well. While there is a somewhat southern bias in the set of primaries that have been carried out so far, that bias is probably not important. I have a fairly high level of confidence in the model.

    The result is best seen in this graphic, which shows the cumulative delegate count of committed delegates in US states. So this excludes non-committed delegates (known as “Super Delegates”) and it excludes territories and other non-states (but it does include DC, because DC is like a state).

    Democratic_Primaries_2016_Projections_After_Super_Tuesday

    Assuming a large proportion of the Democratic Party’s uncommitted delegates support Clinton, Clinton will probably achieve the necessary number of delegates to lock the nomination either on the 19th of April with the New York primary, or on the 26th of April, with the Maryland, Connecticut, Delaware, Pennsylvania and Rhode Island primaries.

    There are two phases of primaries coming up. First we have a series of weeks with only one or two primaries happening at once, with a total of 300 committed delegates (130 from Michigan). Then we have what is effectively Return of Super Tuesday, with 691 committed delegates, including Florida with 214. For Sanders to regain traction, he has to do well in some of these big states. In particular, Sanders has to outperform the model in Michigan, Florida, Illinois and possibly North Carolina and Ohio.

    When we look at many of these states, the model seems to fit very well with the available polling data, except in cases where the polls suggest a stronger outcome for Clinton. The following table compares the model projections with estimates of the delegate split based on polls. All delegates are assumed to be awarded (among the committed delegates only) and the polling data is not very dense and in some cases not too recent, so this is a very rough estimate.

    Democratic_Primary_After_Super_Tuesday_Projections_Polls

    Prior to Super Tuesday, the then-current version of this model projected results that conformed closely with polls. For most states, the outcome of the actual voting matched the projections and the polls pretty well, except in a couple of places. Now, the refined model matches polling data even more closely, but the polling data is not necessarily to be trusted because there has not been enough polling. (I avoided comparisons with really old polls which are entirely useless).

    Clinton’s path to the nomination is clear. Sanders’ path to the nomination requires something to change, and to change dramatically and quickly.

    Republican Donors Might Run A Third Party Candidate

    They even have a short list of candidates. Unfortunately, the only available copy of the secret internal report on running a third party candidate has the list blacked out (see above).

    According to Scott Bland at Politico:

    Conservative donors have engaged a major GOP consulting firm in Florida to research the feasibility of mounting a late, independent run for president amid growing fears that Donald Trump could win the Republican nomination.

    “All this research has to happen before March 16, when inevitably Trump is the nominee, so that we have a plan in place,” a source familiar with the discussions said. March 16 is the day after the GOP primary in Florida…

    The document, stamped “confidential,” was authored by staff at Data Targeting, a Republican firm based in Gainesville, Fla. The memo notes that “it is possible to mount an independent candidacy but [it] will require immediate action on the part of this core of key funding and strategic players.”

    This, of course, would guarantee that both the Republican candidate, probably Trump, and the independent candidate, would lose. So, it is a kind of apoptosis.

    Here’s the thing. Why would they do this? Why would the Republican Party build up a power base linked to a philosophy, then, when the ultimate candidate emerges, who represents that philosophy of hate and fascism comes to fore, bail?

    One possibility is that the importance of corporate control of the President is the central guiding force for strategy. After all, we are talking about unspecified “donors.” Those donors are not concerned with the political philosophy of the candidate, just that the candidate be controlled.

    It is interesting to compare this effect across the two parties. One could say that Clinton is more the corporate candidate and Sanders is not. But, Democrats are not actually (despite pernicious rumors the contrary) destroying sanders or planning to put him down. A lot of Democrats, including many in power, like Sanders. But when an insurgency candidate (which, it seems, is defined as not, or less, bought and paid for) comes along in the Republican party, the Programmed Party Death Button is seriously considered. The parties really are not the same.

    I wouldn’t expect anything to come to this if it is a real effort to get a particular candidate to win. But if this really is an effort by the Republicans to put themselves down, then the chances of a third party run may be much higher, because it doesn’t have to work. It just has to break everything.

    Whom Should I Vote For: Clinton or Sanders?

    You may be asking yourself the same question, especially if, like me, you vote on Tuesday, March 1st.

    For some of us, a related question is which of the two is likely to win the nomination.

    If one of the two is highly likely to win the nomination, then it may be smart to vote for that candidate in order to add to the momentum effect and, frankly, to end the internecine fighting and eating of young within the party sooner. If, however, one of the two is only somewhat likely to win the nomination, and your preference is for the one slightly more likely to lose, then you better vote for the projected loser so they become the winner!

    National polls of who is ahead have been unreliable, and also, relying on those polls obviates the democratic process, so they should be considered but not used to drive one’s choice. However, a number of primaries have already happened, so there is some information from those contests to help estimate what might happen in the future. On the other hand, there have been only a few primaries so far. Making a choice based wholly or in part on who is likely to win is better left until after Super Tuesday, when there will be more data. But, circling back to the original question, that does not help those of us voting in two days, does it?

    Let’s look at the primaries so far.

    Overall, Sanders has done better than polls might have suggested weeks before the primaries started. This tell us that his insurgency is valid and should be paid attention to.

    There has been a lot of talk about which candidate is electable vs. not, and about theoretical match-ups with Trump or other GOP candidates. If you look at ALL the match-ups, instead one cherry picked match-up the supporter of one or the other candidate might pick, both candidates do OK against the GOP. Also, such early theoretical match-ups are probably very unreliable. So, best to ignore them.

    Iowa told us that the two candidates are roughly matched.

    New Hampshire confirmed that the two candidates are roughly matched, given that Sanders has a partial “favorite son” effect going in the Granite State.

    Nevada confirmed, again, that the two candidates are roughly matched, because the difference wasn’t great between the two.

    So far, given those three races, in combination with exit polls, we can surmise that among White voters, the two candidates are roughly matched, but with Sanders doing better with younger voters, and Clinton doing better with older voters.

    The good news for Sanders about younger voters is that he is bringing people into the process, which means more voters, and that is good. The bad news is two part: 1) Younger voters are unreliable. They were supposed to elect Kerry, but never showed up, for example; and 2) Some (a small number, I hope) of Sanders’ younger voters claim that they will abandon the race, or the Democrats, if their candidate does not win, write in Sanders, vote for Trump, or some other idiotic thing. So, if Clinton ends up being the nominee, thanks Bernie, but really, no thanks.

    Then came South Carolina. Before South Carolina, we knew that there were two likely outcomes down the road starting with this first southern state. One is that expectations surrounding Clinton’s campaign would be confirmed, and she would do about 70-30 among African American voters, which in the end would give her a likely win in the primary. The other possibility is that Sanders would close this ethnic gap, which, given his support among men and white voters, could allow him to win the primary.

    What happened in South Carolina is that Clinton did way better than even those optimistic predictions suggested. This is not good for Sanders.

    Some have claimed that South Carolina was an aberration. But, that claim is being made only by Sanders supporters, and only after the fact. Also, the claim is largely bogus because it suggests that somehow Democratic and especially African American Democratic voters are somehow conservative southern yahoos, and that is why they voted so heavily in favor of Clinton. But really, there is no reason to suggest that Democratic African American voters aren’t reasonably well represented by South Carolina.

    In addition to that, polling for other southern states conforms pretty closely to expectations based on the actual results for South Carolina.

    I developed an ethnic-based model for the Democratic primary (see this for an earlier version). The idea of the model is simple. Most of the variation we will ultimately observe among the states in voting patterns for the two candidates will be explained by the ethnic mix in each state. This is certainly an oversimplification, but has a good chance of working given that before breaking out voters by ethnicity, we are subsetting them by party affiliation. So this is not how White, Black and Hispanic people will vote across the states, but rather, how White, Black and Hispanic Democrats will vote across the state. I’m pretty confident that this is a useful model.

    My model has two versions (chosen by me, there could be many other versions), one giving Sanders’ strategy a nod by having him do 10% better among white voters, but only 60-40 among non-white voters. The Clinton-favored strategy gives Clinton 50-50 among white voters, and a strong advantage among African American voters, based on South Carolina’s results and polling, of 86-14%. Clinton also has a small advantage among Hispanic voters (based mainly on polls) with a 57:43% mix.

    These are the numbers I’ve settled on today, after South Carolina. But, I will adjust these numbers after Super Tuesday, and at that point, I’ll have some real confidence in the model. But, at the moment, the model seems to be potentially useful, and I’ll be happy to tell you why.

    First, let us dispose of some of the circular logic. Given both polls and South Carolina’s results, the model, based partly on South Carolina, predicts South Carolina pretty well using the Clinton-favored version (not the Sanders-favored version), with a predicted cf. actual outcome of 34:19% cf 39:14% This is obviously not an independent prediction, but rather a calibration. The Sanders-favored model predicts an even outcome of 27:26%.

    The following table shows the likely results for the Clinton-favored and Sanders-favored model in each state having a primary on Tuesday.
    Screen Shot 2016-02-28 at 12.50.21 PM
    The two columns on the right are estimates from polling where available. This is highly variable in quality and should be used cautiously. I highlighted the Clinton- or Sanders-favored model that most closely matches the polling. The matches are generally very close. This strongly suggests that the Clinton-favored version of the model essentially works, even given the limited information, and simplicity of the model.

    Please note that in both the Clinton- and Sanders-favored model, Clinton wins the day on Tuesday, but only barely for the Sanders-favored model (note that territories are not considered here).

    I applied the same model over the entire primary season (states only) to produce two graphs, shown below.

    The Clinton-favored model has Clinton pulling ahead in committed delegate (I ignore Super Delegates, who are not committed) on Tuesday, then widens her lead over time, winning handily. The Sanders-favored model projects a horserace, where the two candidates are ridiculously close for the entire election.

    Who_will_win_democratic_primaries_Clinton
    Who_Will_Win_Democratic_Primaries_Maybe_Sanders_Probably_Clinton

    So, who am I going to voter for?

    I like both candidates. The current model suggests I should vote for Clinton because she is going to pull ahead, and it is better to vote for the likely winner, since I like them both, so that person gets more momentum (a tiny fraction of momentum, given one vote, but still…). On the other hand, a Sanders insurgency would be revolutionary and change the world in interesting ways, and for that to happen, Sanders needs as many votes on Tuesday as possible.

    It is quite possible, then, that I’ll vote for Sanders, then work hard for Hillary if Super Tuesday confirms the Clinton favored model. That is how I am leaning now, having made that decision while typing the first few words of this very paragraph.

    Or I could change my mind.

    Either way, I want to see people stop being so mean to the candidate they are not supporting. That is only going to hurt, and be a regretful decision, if your candidate is not the chosen one. Also, you are annoying the heck out of everyone else. So just stop, OK?

    Who Will Win The Next Several Primaries: Clinton or Sanders?

    I recently developed a model of how the primary race will play out between Democratic presidential hopefuls Hillary Clinton and Bernie Sanders.

    That model made certain assumptions, and allowed me to produce two projections (well, many, but I picked two) depending on how each candidate actually fairs with different ethnic groups (White, Back, Hispanic, since those are the groupings typically used).

    The two different versions of this model were designed to favor each candidate differently. The Clinton-favored model started with the basic assumption that among white Democratic Party voters, both candidates are similar, and that Clinton has a strong lead among Hispanic voters and an even stronger lead among African American voters. The Sanders-favored model assumes that Sanders has a stronger position among White voters and less of a disadvantage among non-White voters.

    The logic behind the equivalence among White voters is that this his how the two candidates did in Iowa, which is a representative of the United States White vote, unadulterated by a favorite son effect in New Hampshire. Nevada failed to indicate that this assumption should be changed.

    The favoring of Clinton among non-White voters is based on national polling with respect to ethnic effects. The logic behind the Sanders-favored version is that Sanders’ strategy, to win, has to involve a large young, white, male turnout (evidenced in the polls) and a narrowing of the gap among African American and Hispanic voters.

    In that model, presented here, I used statewide demographic data to establish the ethnic term. However, that is incorrect, because one’s chances of engaging in the Republican vs. Democratic process in one’s state is tied to ethnicity. More Whites are Republicans, more Blacks are Democrats. I knew that at the time I worked out the model, but sloth and laziness, combined with lack of time, caused me to simplify.

    The newer version of the model adjusts for likely Democratic Party membership. The results are the same but less dramatic, with a much longer slog to the finish line and the two candidates doing about the same as each other for the entire primary season.

    The outcome of my modeling (reflected in the non-adjusted and adjusted versions, each with a Clinton- and Sanders-favored version) is different from the expectations of either campaign, as far as I can tell. Clinton boosters are claiming that the Democratic Party is mainly behind her, and these first primaries are aberrant. Sanders boosters are claiming the Sanders strategy of having a surge of support will carry him to victory. Both of these characterizations require that each candidate surge ahead pretty soon, and don’t look back. The opportunity to surge ahead is, certainly, Super Tuesday (March 1st).

    The models I produced, with the assumptions listed above, show a close race all along, so either the campaigns are wrong or I am wrong.

    The graphic at the top of the post represents how far ahead each candidate will be across the primary season, for each of their respective favored strategies.

    So for Clinton, the ethnic gap is maintained as wide, and the blue line shows that she will surge nearly 40 committed delegates ahead of Sanders (a modest surge) and continue to develop a wider and wider gap past mid-March, and thereafter, maintain but not increase that gap, of about 80 committed delegates, until the end.

    For Sanders, the orange line, the initial gap formed on Super Tuesday, does not start out very large, but his gap steadily increases until the end of the primary season, ending with a gap of over 120 committed delegates.

    So, that is the new model. But, it is a bogus model.

    I’m trying to stick with empirical data that do not rely on polling. Why? Because everybody else is relying on polling, and this is an election season where the polling is not doing a good job of predicting outcomes. Also, my modeling gives credit to each campaign’s claims, which is at least interesting, if not valid, as a way of approaching this problem. If Clinton is right, she wins this way. If Sanders is right, he wins that way.

    However, the data are insufficient to have much faith in this model. Super Tuesday will provide a lot more information, and with that information I can rework the model and have some confidence in it.

    Who will win the South Carolina Primary, Clinton or Sanders?

    While working this out, I naturally came up with predictions for what will happen in all of the future primaries. So let’s look at some of that.

    In South Carolina, according to my model, if Clinton’s strategy holds, she will win 29 delegates, and Sanders will win 24 delegates. If the Sanders strategy pertains, they will tie, or possibly, Clinton will win one more delegate than Sanders.

    Who will win the Super Tuesday primaries?

    The following table shows the results predicted by this model, for both the Clinton-favored and Sanders-favored versions, for all the Super Tuesday state primaries or caucuses.

    Super_Tuesday_Democratic_Party_Predictions_2016_Laden

    The Clinton-favored model suggests that Clinton will win six out of 11 primaries, and take the majority of uncommitted delegates. The Sanders-favored model suggests that Sanders will take 9 out of 11 primaries, and win the majority of uncommitted delegates.

    Notice that I put Vermont in Italics, because Sanders is likely to win big in Vermont no matter what happens. This underscores the nature of this model in an important way. I’m not using any data from the actual states, other than the ethnic mix from census data, with an adjustment applied to produce an estimate of Democratic Party membership across ethnic groups. That estimate is based on national data as well as data specifically form Virginia, to provide some empirical basis.

    I suspect most people will have two responses to this table. First, they will say that a model that incorporates Clinton’s strategic expectations should have her winning more. Second, they will say that all the numbers, for all states and all models, are too close.

    These are both legitimate complaints about my model, and will explain why it will turn out to be totally wrong. Or, they are suppositions people are making that are totally wrong, and when my model turns out to be uncannily accurate, those suppositions will have to be put aside for the rest of the primary season. (Or, some other outcome happens.)

    I will restate this: I’m looking for Super Tuesday to provide the best empirical data to make this model work for the rest of the primary season. But, in the meantime, this seemed like an interesting result to let you know about.