On the Referendum #5: reports of an anti-EU advertising campaign; Greece, the euro, and predictions

The Sunday Telegraph reports that a group of businessmen, including Arron Banks (the UKIP donor), plan a £20 million advertising campaign in September as part of an effort to win the referendum on the EU.

Brief thoughts…

Contrary to some phone calls I’ve had, this is not an example of ‘Eurosceptic infighting’.

Now, there are no spending limits as the Bill has not gone through Parliament. If a group of rich businessmen want to use this period to spend money persuading people of the problems of the EU and how Britain can do better, good luck to them. The important question is: does their campaign have the right messages so it is persuasive?

The Exploratory Committee that was announced last week is not the NO campaign. As I explained on Friday (here), it is a vehicle to coordinate discussions, raise money etc so that a professional NO campaign can exist. I am talking to people about how this can best be done, raising money, and trying to persuade appropriate people to leave their jobs to do this campaign.

As I have said hundreds of times over the past few weeks and will say thousands of times in the next few months, in order to win the referendum many people with very different views will have to find ways to cooperate. Libertarians, socialists and others have to find common ground. Also, all sorts of people and groups will, quite reasonably, want to do their own thing.

It is understandable that in the absence of an official NO campaign, motivated businesspeople are looking to do useful things. My concern is building the foundations of an official NO campaign in the right way such that it can grow into what will be an unprecedented organisational network over the next year. Scale and complexity require organisational innovations.

Greece, the euro, prediction, accountability

On a different subject, Greece and the euro is much in the news… When I was working on the campaign against Britain joining the euro, we did many debates/events/TV shows etc with people like Adair Turner, Ken Clarke, Heseltine, Peter Mandelson, Chris Patten et al.

Our businessmen, such as Stanley Kalms and Simon Wolfson, argued that the euro had been badly constructed and would cause problems for the existing members particularly Greece and Ireland. Turner, Clarke et al breezily wafted away such fears and said we would be proved wrong.

Almost the only extended conversation I have had with Ed Llewellyn, David Cameron’s ‘chief of staff’, was in a restaurant around 2002 when, I think, he was working for Ashdown. He of course said that the euro was a great idea, would work out brilliantly, and we would inevitably join. He is leading the No.10 renegotiation team.

As people who follow this blog know, one of the themes I have explored a lot is the issue of predictions in politics. Physics is so successful because it has an architecture for correcting errors of prediction. Politics has lacked this. Tetlock’s Good Judgement Project (with IARPA) is the most interesting project I know of to inject rigour into the issue of political prediction in order to improve performance radically.

Now that a referendum is coming, Clarke, Heseltine and others are all over the BBC making predictions about the ‘chaos’ and ‘loss of jobs’ that would come from leaving the EU. Because politics does not operate on the basis of being held accountable for predictions, they are almost never asked anything like – ‘but given your false predictions on the euro, why should we have confidence in your predictions on the EU, perhaps you simply have an emotional attachment to the EU that is not susceptible to evidence?’ In politics, ‘Bayesian updating’ is not fashionable particularly when moral signalling is so strong. Many in the BBC see the EU debate, as they saw the euro debate, simply as ‘internationalists v racists’ which makes them even less inclined to challenge people like Ken Clarke who is routinely allowed to make factually wrong assertions without challenge on the Today programme. I blogged about this in an earlier blog in this series HERE.

In comments below, please leave the best examples of quotes from the likes of Clarke, Turner, Mandelson etc along the lines of ‘don’t worry about Greece and Ireland, the euro will be great for them’. 

 

Complexity, ‘fog and moonlight’, prediction, and politics III – von Neumann and economics as a science

The two previous blogs in this series were:

Part I HERE.

Part II HERE.

All page references unless otherwise stated are to my essay, HERE.

Since the financial crisis, there has been a great deal of media and Westminster discussion about why so few people predicted it and what the problems are with economics and financial theory.

Absent from most of this discussion is the history of the subject and its intellectual origins. Economics is clearly a vital area of prediction for people in politics. I therefore will explore some intellectual history to provide context for contemporary discussions about ‘what is wrong with economics and what should be done about it’.

*

It has often been argued that the ‘complexity’ of human behaviour renders precise mathematical treatment of economics impossible, or that the undoubted errors of modern economics in applying the tools of mathematical physics are evidence of the irredeemable hopelessness of the goal.

For example, Kant wrote in Critique of Judgement:

‘For it is quite certain that in terms of merely mechanical principles of nature we cannot even adequately become familiar with, much less explain, organized beings and how they are internally possible. So certain is this that we may boldly state that it is absurd for human beings even to attempt it, or to hope that perhaps some day another Newton might arise who would explain to us, in terms of natural laws unordered by any intention, how even a mere blade of grass is produced. Rather, we must absolutely deny that human beings have such insight.’

In the middle of the 20th Century, one of the great minds of the century turned to this question. John Von Neumann was one of the leading mathematicians of the 20th Century. He was also a major contributor to the mathematisation of quantum mechanics, created the field of ‘quantum logic’ (1936), worked as a consultant to the Manhattan Project and other wartime technological projects, and was one of the two most important creators of modern computer science and artificial intelligence (with Turing) which he developed partly for immediate problems he was working on (e.g. the hydrogen bomb and ICBMs) and partly to probe the general field of understanding complex nonlinear systems.  In an Endnote of my essay I discuss some of these things.

Von Neumann was regarded as an extraordinary phenomenon even by  the cleverest people in the world. The Nobel-winning physicist and mathematician Wigner said of von Neumann:

‘I have known a great many intelligent people in my life. I knew Planck, von Laue and Heisenberg. Paul Dirac was my brother in law; Leo Szilard and Edward Teller have been among my closest friends; and Albert Einstein was a good friend, too. But none of them had a mind as quick and acute as Jansci von Neumann. I have often remarked this in the presence of those men and no one ever disputed me… Perhaps the consciousness of animals is more shadowy than ours and perhaps their perceptions are always dreamlike. On the opposite side, whenever I talked with the sharpest intellect whom I have known – with von Neumann – I always had the impression that only he was fully awake, that I was halfway in a dream.’

Von Neumann also had a big impact on economics. During breaks from pressing wartime business, he wrote ‘Theory of Games and Economic Behaviour’ (TGEB) with Morgenstern. This practically created the field of ‘game theory’ which one sees so many references to now. TGEB was one of the most influential books ever written on economics. (The movie The Beautiful Mind gave a false impression of Nash’s contribution.) In the Introduction, his explanation of some foundational issues concerning economics, mathematics, and prediction is clearer for non-specialists than any other thing I have seen on the subject and cuts through a vast amount of contemporary discussion which fogs the issues.

This documentary on von Neumann is also interesting:

*

There are some snippets from pre-20th Century figures explaining concepts in terms recognisable through the prism of Game Theory. For example, Ampère wrote ‘Considerations sur la théorie mathématique du jeu’ in 1802 and credited Buffon’s 1777 essay on ‘moral arithmetic’ (Buffon figured out many elements that Darwin would later harmonise in his theory of evolution). Cournot discussed what would later be described as a specific example of a ‘Nash equilibrium’ viz duopoly in 1838.  The French mathematician Emile Borel also made contributions to early ideas.

However, Game Theory really was born with von Neumann. In December 1926, he presented the paper ‘Zur Theorie der Gesellschaftsspiele’ (On the Theory of Parlour Games, published in 1928, translated version here) while working on the Hilbert Programme [cf. Endnote on Computing] and quantum mechanics. The connection between the Hilbert Programme and the intellectual origins of Game Theory can perhaps first be traced in a 1912 lecture by one of the world’s leading mathematicians and founders of modern set theory, Zermelo, titled ‘On the Application of Set Theory to Chess’ which stated of its purpose:

‘… it is not dealing with the practical method for games, but rather is simply giving an answer to the following question: can the value of a particular feasible position in a game for one of the players be mathematically and objectively decided, or can it at least be defined without resorting to more subjective psychological concepts?’

He presented a theorem that chess is strictly determined: that is, either (i) white can force a win, or (ii) black can force a win, or (iii) both sides can force at least a draw. Which of these is the actual solution to chess remains unknown. (Cf. ‘Zermelo and the Early History of Game Theory’, by Schwalbe & Walker (1997), which argues that modern scholarship is full of errors about this paper. According to Leonard (2006), Zermelo’s paper was part of a general interest in the game of chess among intellectuals in the first third of the 20th century. Lasker (world chess champion 1897–1921) knew Zermelo and both were taught by Hilbert.)

Von Neumman later wrote:

‘[I]f the theory of Chess were really fully known there would be nothing left to play.  The theory would show which of the three possibilities … actually holds, and accordingly the play would be decided before it starts…  But our proof, which guarantees the validity of one (and only one) of these three alternatives, gives no practically usable method to determine the true one. This relative, human difficulty necessitates the use of those incomplete, heuristic methods of playing, which constitute ‘good’ Chess; and without it there would be no element of ‘struggle’ and ‘surprise’ in that game.’ (p.125)

Elsewhere, he said:

‘Chess is not a game. Chess is a well-defined computation. You may not be able to work out the answers, but in theory there must be a solution, a right procedure in any position. Now, real games are not like that at all. Real life is not like that. Real life consists of bluffing, of little tactics of deception, of asking yourself what is the other man going to think I mean to do. And that is what games are about in my theory.’

Von Neumman’s 1928 paper proved that there is a rational solution to every two-person zero-sum game. That is, in a rigorously defined game with precise payoffs, there is a mathematically rational strategy for both sides – an outcome which both parties cannot hope to improve upon. This introduced the concept of the minimax: choose a strategy that minimises the possible maximum loss.

Zero-sum games are those where the payoffs ‘sum’ to zero. For example, chess or Go are zero-sum games because the gain (+1) and the loss (-1) sum to zero; one person’s win is another’s loss. The famous Prisoners’ Dilemma is a non-zero-sum game because the payoffs do not sum to zero: it is possible for both players to make gains. In some games the payoffs to the players are symmetrical (e.g. Prisoners’ Dilemma); in others, the payoffs are asymmetrical (e.g. the Dictator or Ultimatum games). Sometimes the strategies can be completely stated without the need for probabilities (‘pure’ strategies); sometimes, probabilities have to be assigned for particular actions (‘mixed’ strategies).

While the optimal minimax strategy might be a ‘pure’ strategy, von Neumann showed it would often have to be a ‘mixed strategy’ and this means a spontaneous return of probability, even if the game itself does not involve probability.

‘Although … chance was eliminated from the games of strategy under consideration (by introducing expected values and eliminating ‘draws’), it has now made a spontaneous reappearance. Even if the rules of the game do not contain any elements of ‘hazard’ … in specifying the rules of behaviour for the players it becomes imperative to reconsider the element of ‘hazard’. The dependence on chance (the ‘statistical’ element) is such an intrinsic part of the game itself (if not of the world) that there is no need to introduce it artificially by way of the rules of the game itself: even if the formal rules contain no trace of it, it still will assert itself.’

In 1932, he gave a lecture titled ‘On Certain Equations of Economics and A Generalization of Brouwer’s Fixed-Point Theorem’. It was published in German in 1938 but not in English until 1945 when it was published as ‘A Model of General Economic Equilibrium’. This paper developed what is sometimes called von Neumann’s Expanding Economic Model and has been described as the most influential article in mathematical economics. It introduced the use of ‘fixed-point theorems’. (Brouwer’s ‘fixed point theorem’ in topology proved that, in crude terms, if you lay a map of the US on the ground anywhere in the US, one point on the map will lie precisely over the point it represents on the ground beneath.)

‘The mathematical proof is possible only by means of a generalisation of Brouwer’s Fix-Point Theorem, i.e. by the use of very fundamental topological facts… The connection with topology may be very surprising at first, but the author thinks that it is natural in problems of this kind. The immediate reason for this is the occurrence of a certain ‘minimum-maximum’ problem… It is closely related to another problem occurring in the theory of games.’

Von Neumann’s application of this topological proof to economics was very influential in post-war mathematical economics and in particular was used by Arrow and Debreu in their seminal 1954 paper on general equilibrium, perhaps the central paper in modern traditional economics.

*

In the late 1930’s, von Neumann, based at the IAS in Princeton to which Gödel and Einstein also fled to escape the Nazis, met up with the economist Oskar Morgenstern who was deeply dissatisfied with the state of economics. In 1940, von Neumann began his collaboration on games with Morgenstern, while working on war business including the Manhattan Project and computers, that became The Theory of Games and Economic Behavior (TGEB). By December 1942, he had finished his work on this though it was not published until 1944.

In the Introduction of TGEB, von Neumann explained the real problems in applying mathematics to economics and why Kant was wrong.

‘It is not that there exists any fundamental reason why mathematics should not be used in economics.  The arguments often heard that because of the human element, of the psychological factors etc., or because there is – allegedly – no measurement of important factors, mathematics will find no application, can all be dismissed as utterly mistaken.  Almost all these objections have been made, or might have been made, many centuries ago in fields where mathematics is now the chief instrument of analysis [e.g. physics in the 16th Century or chemistry and biology in the 18th]…

‘As to the lack of measurement of the most important factors, the example of the theory of heat is most instructive; before the development of the mathematical theory the possibilities of quantitative measurements were less favorable there than they are now in economics.  The precise measurements of the quantity and quality of heat (energy and temperature) were the outcome and not the antecedents of the mathematical theory…

‘The reason why mathematics has not been more successful in economics must be found elsewhere… To begin with, the economic problems were not formulated clearly and are often stated in such vague terms as to make mathematical treatment a priori appear hopeless because it is quite uncertain what the problems really are. There is no point using exact methods where there is no clarity in the concepts and issues to which they are applied. [Emphasis added] Consequently the initial task is to clarify the knowledge of the matter by further careful descriptive work. But even in those parts of economics where the descriptive problem has been handled more satisfactorily, mathematical tools have seldom been used appropriately. They were either inadequately handled … or they led to mere translations from a literary form of expression into symbols…

‘Next, the empirical background of economic science is definitely inadequate. Our knowledge of the relevant facts of economics is incomparably smaller than that commanded in physics at the time when mathematization of that subject was achieved.  Indeed, the decisive break which came in physics in the seventeenth century … was possible only because of previous developments in astronomy. It was backed by several millennia of systematic, scientific, astronomical observation, culminating in an observer of unparalleled calibre, Tycho de Brahe. Nothing of this sort has occurred in economics. It would have been absurd in physics to expect Kepler and Newton without Tycho – and there is no reason to hope for an easier development in economics…

‘Very frequently the proofs [in economics] are lacking because a mathematical treatment has been attempted in fields which are so vast and so complicated that for a long time to come – until much more empirical knowledge is acquired – there is hardly any reason at all to expect progress more mathematico. The fact that these fields have been attacked in this way … indicates how much the attendant difficulties are being underestimated. They are enormous and we are now in no way equipped for them.

‘[We will need] changes in mathematical technique – in fact, in mathematics itself…  It must not be forgotten that these changes may be very considerable. The decisive phase of the application of mathematics to physics – Newton’s creation of a rational discipline of mechanics – brought about, and can hardly be separated from, the discovery of the infinitesimal calculus…

‘The importance of the social phenomena, the wealth and multiplicity of their manifestations, and the complexity of their structure, are at least equal to those in physics.  It is therefore to be expected – or feared – that mathematical discoveries of a stature comparable to that of calculus will be needed in order to produce decisive success in this field… A fortiori, it is unlikely that a mere repetition of the tricks which served us so well in physics will do for the social phenomena too.  The probability is very slim indeed, since … we encounter in our discussions some mathematical problems which are quite different from those which occur in physical science.’

Von Neumann therefore exhorted economists to humility and the task of ‘careful, patient description’, a ‘task of vast proportions’. He stressed that economics could not attack the ‘big’ questions – much more modesty is needed to establish an exact theory for very simple problems, and build on those foundations.

‘The everyday work of the research physicist is … concerned with special problems which are “mature”… Unifications of fields which were formerly divided and far apart may alternate with this type of work. However, such fortunate occurrences are rare and happen only after each field has been thoroughly explored. Considering the fact that economics is much more difficult, much less understood, and undoubtedly in a much earlier stage of its evolution as a science than physics, one should clearly not expect more than a development of the above type in economics either…

‘The great progress in every science came when, in the study of problems which were modest as compared with ultimate aims, methods were developed which could be extended further and further. The free fall is a very trivial physical example, but it was the study of this exceedingly simple fact and its comparison with astronomical material which brought forth mechanics. It seems to us that the same standard of modesty should be applied in economics… The sound procedure is to obtain first utmost precision and mastery in a limited field, and then to proceed to another, somewhat wider one, and so on.’

Von Neumann therefore aims in TGEB at ‘the behavior of the individual and the simplest forms of exchange’ with the hope that this can be extended to more complex situations.

‘Economists frequently point to much larger, more ‘burning’ questions…  The experience of … physics indicates that this impatience merely delays progress, including that of the treatment of the ‘burning’ questions. There is no reason to assume the existence of shortcuts…

‘It is a well-known phenomenon in many branches of the exact and physical sciences that very great numbers are often easier to handle than those of medium size. An almost exact theory of a gas, containing about 1025 freely moving particles, is incomparably easier than that of the solar system, made up of 9 major bodies… This is … due to the excellent possibility of applying the laws of statistics and probabilities in the first case.

‘This analogy, however, is far from perfect for our problem. The theory of mechanics for 2,3,4,… bodies is well known, and in its general theoretical …. form is the foundation of the statistical theory for great numbers. For the social exchange economy – i.e. for the equivalent ‘games of strategy’ – the theory of 2,3,4… participants was heretofore lacking. It is this need that … our subsequent investigations will endeavor to satisfy. In other words, only after the theory for moderate numbers of participants has been satisfactorily developed will it be possible to decide whether extremely great numbers of participants simplify the situation.’

[This last bit has changed slightly as I forgot to include a few things.]

While some of von Neumann’s ideas were extremely influential on economics, his general warning here about the right approach to the use of mathematics was not widely heeded.

Most economists initially ignored von Neumann’s ideas.  Martin Shubik, a Princeton mathematician, recounted the scene he found:

‘The contrast of attitudes between the economics department and mathematics department was stamped on my mind… The former projected an atmosphere of dull-business-as-usual conservatism… The latter was electric with ideas… When von Neumann gave his seminar on his growth model, with a few exceptions, the serried ranks of Princeton economists could scarce forebear to yawn.’

However, a small but influential number, including mathematicians at the RAND Corporation (the first recognisable modern ‘think tank’) led by John Williams, applied it to nuclear strategy as well as economics. For example, Albert Wohlstetter published his Selection and Use of Strategic Air Bases (RAND, R-266, sometimes referred to as The Basing Study) in 1954. Williams persuaded the RAND Board and the infamous SAC General Curtis LeMay to develop a social science division at RAND that could include economists and psychologists to explore the practical potential of Game Theory further. He also hired von Neumann as a consultant; when the latter said he was too busy, Williams told him he only wanted the time it took von Neumann to shave in the morning. (Kubrick’s Dr Strangelove satirised RAND’s use of game theory.)

In the 1990’s, the movie A Beautiful Mind brought John Nash into pop culture, giving the misleading impression that he was the principle developer of Game Theory. Nash’s fame rests principally on work he did in 1950-1 that became known as ‘the Nash Equilibrium’. In Non-Cooperative Games (1950), he wrote:

‘[TGEB] contains a theory of n-person games of a type which we would call cooperative. This theory is based on an analysis of the interrelationships of the various coalitions which can be formed by the players of the game. Our theory, in contradistinction, is based on the absence of coalitions in that it is assumed each participant acts independently, without collaboration or communication with any of the others… [I have proved] that a finite non-cooperative game always has at least one equilibrium point.’

Von Neumann remarked of Nash’s results, ‘That’s trivial you know. It’s just a fixed point theorem.’ Nash himself said that von Neumann was a ‘European gentleman’ but was not impressed by his results.

In 1949-50, Merrill Flood, another RAND researcher, began experimenting with staff at RAND (and his own children) playing various games. Nash’s results prompted Flood to create what became known as the ‘Prisoners’ Dilemma’ game, the most famous and studied game in Game Theory. It was initially known as ‘a non-cooperative pair’ and the name ‘Prisoners’ Dilemma’ was given it by Tucker later in 1950 when he had to think of a way of explaining the concept to his psychology class at Stanford and hit on an anecdote putting the payoff matrix in the form of two prisoners in separate cells considering the pros and cons of ratting on each other.

The game was discussed and played at RAND without publishing. Flood wrote up the results in 1952 as an internal RAND memo accompanied by the real-time comments of the players. In 1958, Flood published the results formally (Some Experimental Games). Flood concluded that ‘there was no tendency to seek as the final solution … the Nash equilibrium point.’ Prisoners’ Dilemma has been called ‘the E. coli of social psychology’ by Axelrod, so popular has it become in so many different fields. Many studies of Iterated Prisoners’ Dilemma games have shown that generally neither human nor evolved genetic algorithm players converge on the Nash equilibrium but choose to cooperate far more than Nash’s theory predicts.

Section 7 of my essay discusses some recent breakthroughs, particularly the paper by Press & Dyson. This is also a good example of how mathematicians can invade fields. Dyson’s professional fields are maths and physics. He was persuaded to look at the Prisoners’ Dilemma. He very quickly saw that there was a previously unseen class of strategies that has opened up a whole new field for exploration. This article HERE is a good summary of recent developments.

Von Neumann’s brief forays into economics were very much a minor sideline for him but there is no doubt of his influence. Despite von Neumann’s reservations about neoclassical economics, Paul Samuelson admitted that, ‘He darted briefly into our domain, and it has never been the same since.’

In 1987, the Santa Fe Institute, founded by Gell Mann and others, organised a ten day meeting to discuss economics. On one side, they invited leading economists such as Kenneth Arrow and Larry Summers; on the other side, they invited physicists, biologists, and computer scientists, such as Nobel-winning Philip Anderson and John Holland (inventor of genetic algorithms). When the economists explained their assumptions, Phil Anderson said to them, ‘You guys really believe that?

One physicist later described the meeting as like visiting Cuba – the cars are all from the 1950’s so on one hand you admire them for keeping them going, but on the other hand they are old technology; similarly the economists were ingeniously using 19th Century maths and physics on very out-of-date models. The physicists were shocked at how the economists were content with simplifying assumptions that were obviously contradicted by reality, and they were surprised at the way the economists seemed unconcerned about how poor their predictions were.

Twenty-seven years later, this problem is more acute. Some economists are listening to the physicists about fundamental problems with the field. Some are angrily rejecting the physicists’ incursions into their field.

Von Neumann explained the scientifically accurate approach to economics and mathematics. [Inserted later. I mean – the first part of his comments above that discusses maths, prediction, models, and economics and physics. As far as I know, nobody seriously disputes these comments – i.e. that Kant and the general argument that ‘maths cannot make inroads into economics’ are wrong. The later comments about building up economic theories from theories of 2, 3, 4 agents etc is a separate topic. See comments.] In other blogs in this series I will explore some of the history of economic thinking as part of a description of the problem for politicians and other decision-makers who need to make predictions.

Please leave corrections and comments below.

 

Complexity, ‘fog and moonlight’, prediction, and politics II: controlled skids and immune systems (UPDATED)

‘Politics is a job that can really only be compared with navigation in uncharted waters. One has no idea how the weather or the currents will be or what storms one is in for. In politics, there is the added fact that one is largely dependent on the decisions of others, decisions on which one was counting and which then do not materialise; one’s actions are never completely one’s own. And if the friends on whose support one is relying change their minds, which is something that one cannot vouch for, the whole plan miscarries… One’s enemies one can count on – but one’s friends!’ Otto von Bismarck.

‘Everything in war is very simple, but the simplest thing is difficult. The difficulties accumulate and end by producing a kind of friction that is inconceivable unless one has experienced war… Countless minor incidents – the kind you can never really foresee – combine to lower the general level of performance, so that one always falls short of the intended goal.  Iron will-power can overcome this friction … but of course it wears down the machine as well… Friction is the only concept that … corresponds to the factors that distinguish real war from war on paper.  The … army and everything else related to it is basically very simple and therefore seems easy to manage. But … each part is composed of individuals, every one of whom retains his potential of friction… This tremendous friction … is everywhere in contact with chance, and brings about effects that cannot be measured… Friction … is the force that makes the apparently easy so difficult… Finally … all action takes place … in a kind of twilight, which like fog or moonlight, often tends to make things seem grotesque and larger than they really are.  Whatever is hidden from full view in this feeble light has to be guessed at by talent, or simply left to chance.’ Clausewitz.

*

In July, I wrote a blog on complexity and prediction which you can read HERE.

I will summarise briefly its main propositions and add some others. All page references are to my essay, HERE. (Section 1 explores some of the maths and science issues below in more detail.)

Some people asked me after Part I – why is such abstract stuff important to practical politics? That is a big question but in a nutshell…

If you want to avoid the usual fate in politics of failure, you need to understand some basic principles about why people make mistakes and how some people, institutions, and systems cope with mistakes and thereby perform much better than most. The reason why Whitehall is full of people failing in predictable ways on an hourly basis is because, first, there is general system-wide failure and, second, everybody keeps their heads down focused on the particular and they ignore the system. Officials who speak out see their careers blow up. MPs are so cowed by the institutions and the scale of official failure that they generally just muddle along tinkering and hope to stay a step ahead of the media. Some understand the epic scale of institutional failure but they know that the real internal wiring of the system in the Cabinet Office has such a tight grip that significant improvement will be very hard without a combination of a) a personnel purge and b) a fundamental rewiring of power at the apex of the state. Many people in Westminster are now considering how this might happen. Such thoughts must, I think, be based on some general principles otherwise they are likely to miss the real causes of system failure and what to do.

In future blogs in this series, I will explore some aspects of markets and science that throw light on the question: how can humans and their institutions cope with these problems of complexity, uncertainty, and prediction in order to limit failures?

Separately, The Hollow Men II will focus on specifics of how Whitehall and Westminster work, including Number Ten and some examples from the Department for Education.

Considering the more general questions of complexity and prediction sheds light on why government is failing so badly and how it could be improved.

*

Complexity, nonlinearity, uncertainty, and prediction

Even the simplest practical problems are often very complex. If a Prime Minister wants to line up 70 colleagues in Downing Street to blame them for his woes, there are 70! ways of lining them up and 70! [70! = 70 x 69 x 68 … x 2 x 1] is roughly 10100 (a ‘googol’), which is roughly ten billion times the estimated number of atoms in the universe (1090). [See comments.]

Even the simplest practical problems, therefore, can be so complicated that searching through the vast landscape of all possible solutions is not practical.

After Newton, many hoped that perfect prediction would be possible:

‘An intellect which at a certain moment would know all the forces that animate nature, and all positions of the beings that compose it, if this intellect were vast enough to submit the data to analysis, would condense in a single formula the movements of the greatest bodies of the universe and those of the tiniest atom; for such an intellect nothing would be uncertain and the future just like the past would be present before its eyes’ (Laplace).

However, most of the most interesting systems in the world – such as brains, cultures, and conflicts – are nonlinear. That is, a small change in input has an arbitrarily large affect on output. Have you ever driven through a controlled skid then lost it? A nonlinear system is one in which you can shift from ‘it feels great on the edge’ to ‘I’m steering into the skid but I’ve lost it and might die in a few seconds’ because of one tiny input change, like your tyre catches a cat’s eye in the wet. This causes further problems for prediction. Not only is the search space so vast it cannot be searched exhaustively, however fast our computers, but in nonlinear systems one has the added problem that a tiny input change can lead to huge output changes.

Some nonlinear systems are such that no possible accuracy of measurement of the current state can eliminate this problem – there is unavoidable uncertainty about the future state. As Poincaré wrote, ‘it may happen that small differences in the initial conditions produce very great ones in the final phenomena. A small error in the former will produce an enormous error in the latter. Prediction becomes impossible, and we have the fortuitous phenomenon.’ It does not matter that the measurement error is in the 20th decimal place – the prediction will still quickly collapse.

Weather systems are like this which is why, despite the enormous progress made with predictions, we remain limited to ~10-14 days at best. To push the horizon forward by just one day requires exponential increases in the resources required. Political systems are also nonlinear. If Cohen-Blind’s aim had been very slightly different in May 1866 when he fired five bullets at Bismarck, the German states would certainly have evolved in a different way and perhaps there would have been no fearsome German army led by a General Staff into World War I, no Lenin and Hitler, and so on.  Bismarck himself appreciated this very well. ‘We are poised on the tip of a lightning conductor, and if we lose the balance I have been at pains to create we shall find ourselves on the ground,’ he wrote to his wife during the 1871 peace negotiations in Versailles. Social systems are also nonlinear. Online experiments have explored how complex social networks cannot be predicted because of initial randomness combining with the interdependence of decisions.

In short, although we understand some systems well enough to make precise or statistical predictions, most interesting systems – whether physical, mental, cultural, or virtual – are complex, nonlinear, and have properties that emerge from feedback between many interactions. Exhaustive searches of all possibilities are impossible. Unfathomable and unintended consequences dominate. Problems cascade. Complex systems are hard to understand, predict and control.

Humans evolved in this complex environment amid the sometimes violent, sometimes cooperative sexual politics of small in-groups competing with usually hostile out-groups. We evolved to sense information, process it, and act. We had to make predictions amid uncertainty and update these predictions in response to feedback from our environment – we had to adapt because we have necessarily imperfect data and at best approximate models of reality. It is no coincidence that in one of the most famous speeches in history, Pericles singled out the Athenian quality of adaptation (literally ‘well-turning’) as central to its extraordinary cultural, political and economic success.

How do we make these predictions, how do we adapt? Much of how we operate depends on relatively crude evolved heuristics (rules of thumb) such as ‘sense movement >> run/freeze’. These heuristics can help. Further, our evolved nature gives us amazing pattern recognition and problem-solving abilities. However, some heuristics lead to errors, illusions, self-deception, groupthink and so on – problems that often swamp our reasoning and lead to failure.

I will look briefly at a) the success of science and mathematical models, b) the success of decentralised coordination in nature and markets, and c) the failures of political prediction and decision-making.

*

The success of science and mathematical models

Our brains evolved to solve social and practical problems, not to solve mathematical problems. This is why translating mathematical and logical problems into social problems makes them easier for people to solve (cf. Nielsen.) Nevertheless, a byproduct of our evolution was the ability to develop maths and science. Maths gives us an abstract structure of certain knowledge that we can use to build models of the world. ‘[S]ciences do not try to explain, they hardly even try to interpret, they mainly make models. By a model is meant a mathematical construct which, with the addition of certain verbal interpretations, describes observed phenomena. The justification of such a mathematical construct is solely and precisely that it is expected … correctly to describe phenomena from a reasonably wide area’ (von Neumann).

Because the universe operates according to principles that can be approximated by these models, we can understand it approximately. ‘Why’ is a mystery. Why should ‘imaginary numbers’ based on the square root of minus 1, conceived five hundred years ago and living for hundreds of years without practical application, suddenly turn out to be necessary in the 1920s to calculate how subatomic particles behave? How could it be that in a serendipitous meeting in the IAS cafeteria in 1972, Dyson and Montgomery should realise that an equation describing the distribution of prime numbers should also describe the energy level of particles? We can see that the universe displays a lot of symmetry but we do not know why there is some connection between the universe’s operating principles and our evolved brains’ abilities to do abstract mathematics. Einstein asked, ‘How is it possible that mathematics, a product of human thought that is independent of experience, fits so excellently the objects of physical reality?’ Wigner replied to Einstein in a famous paper, ‘The Unreasonable Effectiveness of Mathematics in the Natural Sciences’ (1960) but we do not know the answer. (See ‘Is mathematics invented or discovered?’, Tim Gowers, 2011.)

The accuracy of many of our models gets better and better. In some areas such as quantum physics, the equations have been checked so delicately that, as Feynman said, ‘If you were to measure the distance from Los Angeles to New York to this accuracy, it would be exact to the thickness of a human hair’. In other areas, we have to be satisfied with statistical models. For example, many natural phenomenon, such as height and intelligence, can be modelled using ‘normal distributions’. Other phenomena, such as the network structure of cells, the web, or banks in an economy, can be modelled using ‘power laws’. [* See End] Why do statistical models work? Because ‘chance phenomena, considered collectively and on a grand scale, create a non-random regularity’ (Kolmogorov). [** See End]

Science has also built an architecture for its processes, involving meta-rules, that help correct errors and normal human failings. For example, after Newton the system of open publishing and peer review developed. This encouraged scientists to make their knowledge public, confident that they would get credit (instead of hiding things in code like Newton). Experiments must be replicated and scientists are expected to provide their data honestly so that others can test their claims, however famous, prestigious, or powerful they are. Feynman described the process in physics as involving, at its best, ‘a kind of utter honesty … [Y]ou should report everything that you think might make [your experiment or idea] invalid… [Y]ou must also put down all the facts which disagree with it, as well as those that agree with it… The easiest way to explain this idea is to contrast it … with advertising.’

The architecture of the scientific process is not perfect. Example 1. Evaluation of contributions is hard. The physicist who invented the arXiv was sacked soon afterwards because his university’s tick box evaluation system did not have a way to value his enormous contribution. Example 2. Supposedly ‘scientific’ advice to politicians can also be very overconfident. E.g. A meta-study of 63 studies of the costs of various energy technologies reveals: ‘The discrepancies between equally authoritative, peer-reviewed studies span many orders of magnitude, and the overlapping uncertainty ranges can support almost any ranking order of technologies, justifying almost any policy decision as science based’ (Stirling, Nature, 12/2010).

This architecture and its meta-rules are now going through profound changes, brilliantly described by the author of the seminal textbook on quantum computers, Michael Nielsen, in his book Reinventing Discovery – a book that has many lessons for the future of politics too. But overall the system clearly has great advantages.

The success of decentralised information processing in solving complex problems

Complex systems and emergent properties

Many of our most interesting problems can be considered as networks. Individual nodes (atoms, molecules, genes, cells, neurons, minds, organisms, organisations, computer agents) and links (biochemical signals, synapses, internet routers, trade routes) form physical, mental, and cultural networks (molecules, cells, organisms, immune systems, minds, organisations, internet, biosphere, ‘econosphere’, cultures) at different scales.

The most interesting networks involve interdependencies (feedback and feedforward) – such as chemical signals, a price collapse, neuronal firing, an infected person gets on a plane, or an assassination – and are nonlinear. Complex networks have emergent properties including self-organisation. For example, the relative strength of a knight in the centre of the chessboard is not specified in the rules but emerges from the nodes of the network (or ‘agents’) operating according to the rules.

Even in physics, ‘The behavior of large and complex aggregates of elementary particles … is not to be understood in terms of a simple extrapolation of the properties of a few particles. Instead, at each level of complexity entirely new properties appear’ (Anderson). This is more obvious in biological and social networks.

Ant colonies and immune systems: how decentralised information processing solves complex problems

Ant colonies and the immune system are good examples of complex nonlinear systems with ‘emergent properties’ and self-organisation.

The body cannot ‘know’ in advance all the threats it will face so the immune system cannot be perfectly ‘pre-designed’. How does it solve this problem?

There is a large diverse population of individual white blood cells (millions produced per day) that sense threats. If certain cells detect that a threat has passed a threshold, then they produce large numbers of daughter cells, with mutations, that are tested on captured ‘enemy’ cells. Unsuccessful daughter cells die while successful ones are despatched to fight. These daughter cells repeat the process so a rapid evolutionary process selects and reproduces the best defenders and continually improves performance. Other specialist cells roam around looking for invaders that have been tagged by antibodies. Some of the cells remain in the bloodstream, storing information about the attack, to guard against future attacks (immunity).

There is a constant evolutionary arms race against bacteria and other invaders. Bacteria take over cells’ machinery and communications. They reprogram cells to take them over or trigger self-destruction. They disable immune cells and ‘ride’ them back into lymph nodes (Trojan horse style) where they attack. They shape-change fast so that immune cells cannot recognise them. They reprogram immune cells to commit suicide. They reduce competition by tricking immune cells into destroying other bacteria that help the body fight infection (e.g. by causing diarrhoea to flush out competition).

NB. there is no ‘plan’ and no ‘central coordination’. The system experiments probabilistically, reinforces success, and discards failure. It is messy. Such a system cannot be based on trying to ‘eliminate failure’. It is based on accepting a certain amount of failure but keeping it within certain tolerances via learning.

Looking at an individual ant, it would be hard to know that an ant colony is capable of farming, slavery, and war.

‘The activity of an ant colony is totally defined by the activities and interactions of its constituent ants. Yet the colony exhibits a flexibility that goes far beyond the capabilities of its individual constituents. It is aware of and reacts to food, enemies, floods, and many other phenomena, over a large area; it reaches out over long distances to modify its surroundings in ways that benefit the colony; and it has a life-span orders of magnitude longer than that of its constituents… To understand the ant, we must understand how this persistent, adaptive organization emerges from the interactions of its numerous constituents.’ (Hofstadter)

Ant colonies face a similar problem to the immune system: they have to forage for food in an unknown environment with an effectively infinite number of possible ways to search for a solution. They send out agents looking for food; those that succeed return to the colony leaving a pheromone trail which is picked up by others and this trail strengthens. Decentralised decisions via interchange of chemical signals drive job-allocation (the division of labour) in the colony. Individual ants respond to the rate of what others are doing: if an ant finds a lot of foragers, it is more likely to start foraging.

Similarities between the immune system and ant colonies in solving complex problems

Individual white blood cells cannot access the whole picture; they sample their environment via their receptors. Individual ants cannot cannot access the whole picture; they sample their environment via their chemical processors. The molecular shape of immune cells and the chemical processing abilities of ants are affected by random mutations; the way individual cells or ants respond has a random element. The individual elements (cells / ants) are programmed to respond probabilistically to new information based on the strength of signals they receive.

Environmental exploration by many individual agents coordinated via feedback signals allows a system to probe many different probabilities, reinforce success, ‘learn’ from failure (e.g withdraw resources from unproductive strategies), and keep innovating (e.g novel cells are produced even amid a battle and ants continue to look for better options even after striking gold). ‘Redundancy’ allows local failures without breaking the system. There is a balance between exploring the immediate environment for information and exploiting that information to adapt.

In such complex networks with emergent properties, unintended consequences dominate. Effects cascade: ‘they come not single spies but in battalions’. Systems defined as ‘tightly coupled‘ – that is, they have strong interdependencies so that the behaviour of one element is closely connected to another – are not resilient in the face of nonlinear events (picture a gust of wind knocking over one domino in a chain).

Network topology

We are learning how network topology affects these dynamics. Many networks (including cells, brains, the internet, the economy) have a topology such that nodes are distributed according to a power law (not a bell curve), which means that the network looks like a set of  hubs and spokes with a few spokes connecting hubs. This network topology makes them resilient to random failure but vulnerable to the failure of critical hubs that can cause destructive cascades (such as financial crises) – an example of the problems that come with nonlinearity.

Similar topology and dynamics can be seen in networks operating at very different scales ranging from cellular networks, the brain, the financial system, the economy in general, and the internet. Disease networks often shows the same topology, with certain patients, such as those who get on a plane from West Africa to Europe with Ebola, playing the role of critical hubs connecting different parts of the network. Terrorist networks also show the same topology. All of these complex systems with emergent properties have the same network topology and are vulnerable to the failure of critical hubs.

Many networks evolve modularity. A modular system is one in which specific modules perform specific tasks, with links between them allowing broader coordination. This provides greater effectiveness and resilience to shocks. For example, Chongqing in China saw the evolution of a new ecosystem for designing and building motorbikes in which ‘assembler’ companies assemble modular parts built by competing companies, instead of relying on high quality vertically integrated companies like Yamaha. This rapidly decimated Japanese competition. Connections between network topology, power laws and fractals can be seen in work by physicist Geoffrey West both on biology and cities, for it is clear that just as statistical tools like the Central Limit Theorem demonstrate similar structure in completely different systems and scales, so similar processes occur in biology and social systems. [See Endnote.]

Markets: how decentralised information processing solves complex problems

[Coming imminently]

A summary of the progress brought by science and markets

The combination of reasoning, reliable accumulated knowledge, and a reliable institutional architecture brings steady progress, and occasional huge breakthroughs and wrong turns, in maths and science. The combination of the power of decentralised information processing to find solutions to complex problems and an institutional architecture brings steady progress, and occasional huge breakthroughs and wrong turns, in various fields that operate via markets.

Fundamental to the institutional architecture of markets and science is mechanisms that enable adaptation to errors. The self-delusion and groupthink that is normal for humans – being a side-effect of our nature as evolved beings – is partly countered by tried and tested mechanisms. These mechanisms are not based on an assumption that we can ‘eliminate failure’ (as so many in politics absurdly claim they will do). Instead, the assumption is that failure is a persistent phenomenon in a complex nonlinear world and it must be learned from and adapted to as quickly as possible. Entrepreneurs and scientists can be vain, go mad, or be prone to psychopathy – like public servants – but we usually catch it quicker and it causes less trouble. Catching errors, we inch forward ‘standing on the shoulders of giants’ as Newton put it.

Science has enabled humans to make transitions from numerology to mathematics, from astrology to astronomy, from alchemy to chemistry, from witchcraft to neuroscience, from tallies to quantum computation. Markets have been central to a partial transition in a growing fraction of the world from a) small, relatively simple, hierarchical, primitive, zero-sum hunter-gatherer tribes based on superstition (almost total ignorance of complex systems), shared aims, personal exchange and widespread violence, to b) large, relatively complex, decentralised, technological, nonzero-sum market-based cultures based on science (increasingly accurate predictions and control in some fields), diverse aims, impersonal exchange, trade, private property, and (roughly) equal protection under the law.

*

The failures of politics: wrong predictions, no reliable mechanisms for fixing obvious errors

 ‘No official estimates even mentioned that the collapse of Communism was a distinct possibility until the coup of 1989.’ National Security Agency, ‘Dealing With the Future’, declassified report. 

However, the vast progress made in so many fields is clearly not matched in standards of government. In particular, it is very rare for individuals or institutions to make reliable predictions.

The failure of prediction in politics

Those in leading positions in politics and public service have to make all sorts of predictions. Faced with such complexity, politicians and others have operated mostly on heuristics (‘political philosophy’), guesswork, willpower and tactical adaptation. My own heuristics for working in politics are: focus, ‘know yourself’ (don’t fool yourself), think operationally, work extremely hard, don’t stick to the rules, and ask yourself ‘to be or to do?’.

Partly because politics is a competitive enterprise in which explicit and implicit predictions elicit countermeasures, predictions are particularly hard. This JASON report (PDF) on the prediction of rare events explains some of the technical arguments about predicting complex nonlinear systems such as disasters. Unsurprisingly, so-called ‘political experts’ are not only bad at predictions but are far worse than they realise. There are many prominent examples. Before the 2000 election, the American Political Science Association’s members unanimously predicted a Gore victory. Beyond such examples, we have reliable general data on this problem thanks to a remarkable study by Philip Tetlock. He charted political predictions made by supposed ‘experts’ (e.g will the Soviet Union collapse, will the euro collapse) for fifteen years from 1987 and published them in 2005 (‘Expert Political Judgement’). He found that overall, ‘expert’ predictions were about as accurate as monkeys throwing darts at a board. Experts were very overconfident: ~15 percent of events that experts claimed had no chance of occurring did happen, and ~25 percent of those that they said they were sure would happen did not happen. Further, the more media interviews an expert did, the less likely they were to be right. Specific expertise in a particular field was generally of no value; experts on Canada were about as accurate on the Soviet Union as experts on the Soviet Union were.

However, some did better than others. He identified two broad categories of predictor. The first he called ‘hedgehogs’ – fans of Big Ideas like Marxism, less likely to admit errors. The second he called ‘foxes’ – not fans of Big Ideas, more likely to admit errors and change predictions because of new evidence. (‘The fox knows many little things, but the hedgehog knows one big thing,’ Archilochus.) Foxes tended to make better predictions. They are more self-critical, adaptable, cautious, empirical, and multidisciplinary. Hedgehogs get worse as they acquire more credentials while foxes get better with experience. The former distort facts to suit their theories; the latter adjust theories to account for new facts.

Tetlock believes that the media values characteristics (such as Big Ideas, aggressive confidence, tenacity in combat and so on) that are the opposite of those prized in science (updating in response to new data, admitting errors, tenacity in pursuing the truth and so on). This means that ‘hedgehog’ qualities are more in demand than ‘fox’ qualities, so the political/media market encourages qualities that make duff predictions more likely. ‘There are some academics who are quite content to be relatively anonymous. But there are other people who aspire to be public intellectuals, to be pretty bold and to attach non-negligible probabilities to fairly dramatic change. That’s much more likely to bring you attention’ (Tetlock).

Tetlock’s book ought to be much-studied in Westminster particularly given 1) he has found reliable ways of identifying a small number of people who are very good forecasters and 2)  IARPA (the intelligence community’s DARPA twin) is working with Tetlock to develop training programmes to improve forecasting skills. [See Section 6.] Tetolock says, ‘We now have a significant amount of evidence on this, and the evidence is that people can learn to become better. It’s a slow process. It requires a lot of hard work, but some of our forecasters have really risen to the challenge in a remarkable way and are generating forecasts that are far more accurate than I would have ever supposed possible from past research in this area.’ (This is part of IARPA’s ACE programme to develop aggregated forecast systems and crowdsourced prediction software. IARPA also has the SHARP programme to find ways to improve problem-solving skills for high-performing adults.)

His main advice? ‘If I had to bet on the best long-term predictor of good judgement among the observers in this book, it would be their commitment – their soul-searching Socratic commitment – to thinking about how they think’ (Tetlock). His new training programmes help people develop this ‘Socratic commitment’ and correct their mistakes in quite reliable ways.

NB. The extremely low quality of political forecasting is what allowed an outsider like Nate Silver to transform the field simply by applying some well-known basic maths.

The failure of prediction in economics

‘… the evidence from more than fifty years of research is conclusive: for a large majority of fund managers, the selection of stocks is more like rolling dice than like playing poker. Typically at least two out of every three mutual funds underperform the overall market in any given year. More important, the year-to-year correlation between the outcomes of mutual funds is very small, barely higher than zero. The successful funds in any given year are mostly lucky; they have a good roll the dice.’ Daniel Kahneman, winner of the economics ‘Nobel’ (not the same as the Nobel for physical sciences).

‘I importune students to read narrowly within economics, but widely in science…The economic literature is not the best place to find new inspiration beyond these traditional technical methods of modelling’ Vernon Smith, winner of the economics ‘Nobel’. 

I will give a few examples of problems with economic forecasting.

In the 1961 edition of his famous standard textbook used by millions of students, one of the 20th Century’s most respected economists, Paul Samuelson, predicted that respective growth rates in America and the Soviet Union meant the latter would overtake the USA between 1984-1997. By 1980, he had delayed the date to be in 2002-2012. Even in 1989, he wrote, ‘The Soviet economy is proof that, contrary to what many skeptics had earlier believed, a socialist command economy can function and even thrive.’

Chart: Samuelson’s prediction for the Soviet economy 

samuelson

The recent financial crisis also demonstrated many failed predictions. Various people, including physicists Steve Hsu and Eric Weinstein, published clear explanations of the extreme dangers in the financial markets and parallels with previous crashes such as Japan’s. However, they were almost totally ignored by politicians, officials, central banks and so on. Many of those involved were delusional. Perhaps most famously, Joe Cassano of AIG Financial said in a conference call (8/2007): ‘It’s hard for us – without being flippant – to even see a scenario within any kind of realm of reason that would see us losing one dollar in any of those transactions… We see no issues at all emerging.’

Nate Silver recently summarised some of the arguments over the crash and its aftermath. In December 2007, economists in the Wall Street Journal forecasting panel predicted only a 38 percent chance of recession in 2008. The Survey of Professional Forecasters is a survey of economists’ predictions done by the Federal Reserve Bank that includes uncertainty measurements. In November 2007, the Survey showed a net prediction by economists that the economy would grow by 2.4% in 2008, with a less than 3% chance of any recession and a 1-in-500 chance of it shrinking by more than 2%.

Chart: the 90% ‘prediction intervals’ for the Survey of Professional Forecasters net forecast of GDP growth 1993-2010

Prediction econ

If the economists’ predictions were accurate, the 90% prediction interval should be right nine years out of ten, and 18 out of 20. Instead, the actual growth was outside the 90% prediction interval six times out of 18, often by a lot. (The record back to 1968 is worse.) The data would later reveal that the economy was already in recession in the last quarter of 2007 and, of course, the ‘1-in-500’ event of the economy shrinking by more than 2% is exactly what happened.**

Although the total volume of home sales in 2007 was only ~$2 trillion, Wall Street’s total volume of trades in mortgage-backed securities was ~$80 trillion because of the creation of ‘derivative’ financial instruments. Most people did not understand 1) how likely a house price fall was, 2) how risky mortgage-backed securities were, 3) how widespread leverage could turn a US housing crash into a major financial crash, and 4) how deep the effects of a major financial crash were likely to be.  ‘The actual default rates for CDOs were more than two hundred times higher than S&P had predicted’ (Silver). In the name of ‘transparency’, S&P provided the issuers with copies of their ratings software allowing CDO issuers to experiment on how much junk they could add without losing a AAA rating. S&P even modelled a potential housing crash of 20% in 2005 and concluded its highly rated securities could ‘weather a housing downturn without suffering a credit rating downgrade.’

Unsurprisingly, Government unemployment forecasts were also wrong. Historically, the uncertainty in an unemployment rate forecast made during a recession had been about plus or minus 2 percent but Obama’s team, and economists in general, ignored this record and made much more specific predictions. In January 2009, Obama’s team argued for a large stimulus and said that, without it, unemployment, which had been 7.3% in December 2008, would peak at ~9% in early 2010, but with the stimulus it would never rise above 8% and would fall from summer 2009. However, the unemployment numbers after the stimulus was passed proved to be even worse than the ‘no stimulus’ prediction. Similarly, the UK Treasury’s forecasts about growth, debt, and unemployment from 2007 were horribly wrong but that has not stopped it making the same sort of forecasts.

Paul Krugman concluded from this episode: the stimulus was too small. Others concluded it had been a waste of money. Academic studies vary widely in predicting the ‘return’ from each $1 of stimulus. Since economists cannot even accurately predict a recession when the economy is already in recession, it seems unlikely that there will be academic consensus soon on such issues. Economics often seems like a sort of voodoo for those in power – spurious precision and delusions that there are sound mathematical foundations for the subject without a proper understanding of the conditions under which mathematics can help (cf. Von Neumann on maths and prediction in economics HERE).

Fields which do better at prediction

Daniel Kahneman, who has published some of the most important research about why humans make bad predictions, summarises the fundamental issues about when you can trust expert predictions:

‘To know whether you can trust a particular intuitive judgment, there are two questions you should ask: Is the environment in which the judgment is made sufficiently regular to enable predictions from the available evidence? The answer is yes for diagnosticians, no for stock pickers. Do the professionals have an adequate opportunity to learn the cues and the regularities? The answer here depends on the professionals’ experience and on the quality and speed with which they discover their mistakes. Anesthesiologists have a better chance to develop intuitions than radiologists do. Many of the professionals we encounter easily pass both tests, and their off-the-cuff judgments deserve to be taken seriously. In general, however, you should not take assertive and confident people at their own evaluation unless you have independent reason to believe that they know what they are talking about.’ (Emphasis added.)

It is obvious that politics fulfils neither of his two criteria – it does not even have hard data and clear criteria for success, like stock picking.

I will explore some of the fields that do well at prediction in a future blog.

*

The consequences of the failure of politicians and other senior decision-makers and their institutions

‘When superior intellect and a psychopathic temperament coalesce …, we have the best possible conditions for the kind of effective genius that gets into the biographical dictionaries’ (William James). 

‘We’re lucky [the Unabomber] was a mathematician, not a molecular biologist’ (Bill Joy, Silicon Valley legend, author of ‘Why the future doesn’t need us’).

While our ancestor chiefs understood bows, horses, and agriculture, our contemporary chiefs (and those in the media responsible for scrutiny of decisions) generally do not understand their equivalents, and are often less experienced in managing complex organisations than their predecessors.

The consequences are increasingly dangerous as markets, science and technology disrupt all existing institutions and traditions, and enhance the dangerous potential of our evolved nature to inflict huge physical destruction and to manipulate the feelings and ideas of many people (including, sometimes particularly, the best educated) through ‘information operations’. Our fragile civilisation is vulnerable to large shocks and a continuation of traditional human politics as it was during 6 million years of hominid evolution – an attempt to secure in-group cohesion, prosperity and strength in order to dominate or destroy nearby out-groups in competition for scarce resources – could kill billions. We need big changes to schools, universities, and political and other institutions for their own sake and to help us limit harm done by those who pursue dreams of military glory, ‘that attractive rainbow that rises in showers of blood’ (Lincoln).

The global population of people with an IQ four standard deviations above the average (i.e. >160) is ~250k. About 1% of the population are psychopaths so there are perhaps ~2-3,000 with IQ ≈ Nobel/Fields winner. The psychopathic +3SD IQ (>145; average science PhD ~130) population is 30 times bigger. A subset will also be practically competent. Some of them may think, ‘Flectere si nequeo superos, / Acheronta movebo’ (‘If Heav’n thou can’st not bend, Hell thou shalt move’, the Aeneid). Board et al (2005) showed that high-level business executives are more likely than inmates of Broadmoor to have one of three personality disorders (PDs): histrionic PD, narcissistic PD, and obsessive-compulsive PD. Mullins-Sweatt et al (2010) showed that successful psychopaths are more conscientious than the unsuccessful.

A brilliant essay (here) by one of the 20th Century’s best mathematicians, John von Neumann, describes these issues connecting science, technology, and how institutions make decisions.

*

Some conclusions

When we consider why institutions are failing and how to improve them, we should consider the general issues discussed above. How to adapt quickly to new information? Does the institution’s structure incentivise effective adaptation or does it incentivise ‘fooling oneself’ and others? Is it possible to enable distributed information processing to find a ‘good enough’ solution in a vast search space? If your problem is similar to that of the immune system or ant colony, why are you trying to solve it with a centralised bureaucracy?

Further, some other obvious conclusions suggest themselves.

We could change our society profoundly by dropping the assumption that less than a tenth of the population is suitable to be taught basic concepts in maths and physics that have very wide application to our culture, such as normal distributions and conditional probability. This requires improving basic maths 5-16 and it also requires new courses in schools.

One of the things that we did in the DfE to do this was work with Fields Medallist Tim Gowers on a sort of ‘Maths for Presidents’ course. Professor Gowers wrote a fascinating blog on this course which you can read HERE. The DfE funded MEI to develop the blog into a real course. This has happened and the course is now being developed in schools. Physics for Future Presidents already exists and is often voted the most popular course at UC Berkeley (Cf. HERE). School-age pupils, arts graduates, MPs, and many Whitehall decision-makers would greatly benefit from these two courses.

We also need new inter-disciplinary courses in universities. For example, Oxford could atone for PPE by offering Ancient and Modern History, Physics for Future Presidents, and How to Run a Start Up. Such courses should connect to the work of Tetlock on The Good Judgement Project, as described above (I will return to this subject).

Other countries have innovated successfully in elite education. For example, after the shock of the Yom Kippur War, Israel established the ‘Talpiot’ programme which  ‘aims to provide the IDF and the defense establishment with exceptional practitioners of research and development who have a combined understanding in the fields of security, the military, science, and technology. Its participants are taught to be mission-oriented problem-solvers. Each year, 50 qualified individuals are selected to participate in the program out of a pool of over 7,000 candidates. Criteria for acceptance include excellence in physical science and mathematics as well as an outstanding demonstration of leadership and character. The program’s training lasts three years, which count towards the soldiers’ three mandatory years of service. The educational period combines rigorous academic study in physics, computer science, and mathematics alongside intensive military training… During the breaks in the academic calendar, cadets undergo advanced military training… In addition to the three years of training, Talpiot cadets are required to serve an additional six years as a professional soldier. Throughout this period, they are placed in assorted elite technological units throughout the defense establishment and serve in central roles in the fields of research and development’ (IDF, 2012). The programme has also helped the Israeli hi-tech economy.****

If politicians had some basic training in mathematical reasoning, they could make better decisions amid complexity. If politicians had more exposure to the skills of a Bill Gates or Peter Thiel, they would be much better able to get things done.

I will explore the issue of training for politicians in a future blog.

Please leave corrections and comments below.


* It is very important to realise when the system one is examining is well approximated by a normal distribution and when by a power law. For example… When David Viniar (Goldman Sachs CFO) said of the 2008 financial crisis, ‘We were seeing things that were 25-standard-deviation events, several days in a row,’ he was discussing financial prices as if they can be accurately modelled by a normal distribution, and implying that events that should happen once every 10135 years (the Universe is only ~1.4×1010 years old) were occurring ‘several days in a row’. He was either ignorant of basic statistics (unlikely) or taking advantage of the statistical ignorance of his audience. Actually, we have known for a long time that financial prices are not well modelled using normal distributions because they greatly underestimate the likelihood of bubbles and crashes. If politicians don’t know what ‘standard deviation’ means, it is obviously impossible for them to contribute much to detailed ideas on how to improve bank regulation. It is not hard to understand standard deviation and there is no excuse for this situation to continue for another generation.

** However, there is also a danger in the use of statistical models based on ‘big data’ analysis – ‘overfitting’ models and wrongly inferring a ‘signal’ from what is actually ‘noise’. We usually a) have a noisy data set and b) an inadequate theoretical understanding of the system, so we do not know how accurately the data represents some underlying structure (if there is such a structure). We have to infer a structure despite these two problems. It is easy in these circumstances to ‘overfit’ a model – to make it twist and turn to fit more of the data than we should, but then we are fitting it not to the signal but to the noise. ‘Overfit’ models can seem to explain more of the variance in the data – but they do this by fitting noise rather than signal (Silver, op. cit).

This error is seen repeatedly in forecasting, and can afflict even famous scientists. For example, Freeman Dyson tells a short tale about how, in 1953, he trekked to Chicago to show Fermi the results of a new physics model for the strong nuclear force. Fermi dismissed his idea immediately as having neither ‘a clear physical picture of the process that you are calculating’ nor ‘a precise and self-consistent mathematical formalism’. When Dyson pointed to the success of his model, Fermi quoted von Neumann,  ‘With four parameters I can fit an elephant, and with five I can make him wiggle his trunk’, thus saving Dyson from wasting years on a wrong theory (A meeting with Enrico Fermi, by Freeman Dyson). Imagine how often people who think they have a useful model in areas not nearly as well-understood as nuclear physics lack a Fermi to examine it carefully.

There have been eleven recessions since 1945 but people track millions of statistics. Inevitably, people will ‘overfit’ many of these statistics to model historical recessions then ‘predict’ future ones.  A famous example is the Superbowl factor. For 28 years out of 31, the winner of the Superbowl correctly ‘predicted’ whether the stock exchange rose or fell. A standard statistical test ‘would have implied that there was only about a 1-in-4,700,000 possibility that the relationship had emerged from chance alone.’ Just as someone will win the lottery, some arbitrary statistics will correlate with the thing you are trying to predict just by chance (Silver)

*** Many of these wrong forecasts were because the events were ‘out of sample’. What does this mean? Imagine you’ve taken thousands of car journeys and never had a crash. You want to make a prediction about your next journey. However, in the past you have never driven drunk. This time you are drunk. Your prediction is therefore out of sample. Predictions of US housing data were based on past data but there was no example of such huge leveraged price rises in the historical data. Forecasters who looked at Japan’s experience in the 1980’s better realised the danger. (Silver)

**** The old Technical Faculty of the KGB Higher School (rebaptised after 1991) ran similar courses; one of its alumni is Yevgeny Kaspersky, whose company first publicly warned of the cyberweapons Stuxnet and Flame (and who still works closely with his old colleagues). It would be interesting to collect information on elite intelligence and special forces training programmes. E.g. Post-9/11, US special forces (acknowledged and covert) have greatly altered including adding intelligence roles that were previously others’ responsibility or regarded as illegal for DOD employees. How does what is regarded as ‘core training’ for such teams vary, how is it changing, and why are some better than others at decisions under pressure and surviving disaster?

Wargame predictions from 2010 – how well did the Cameroons do?

Going through papers and emails today from my time in the DfE to write The Hollow Men Part II (hopefully tomorrow), I found this doc, link below. It’s only one page.

In autumn 2010, James Frayne organised a wargame in Westminster to consider the likely dynamics of the next five years. I was one of about 20-30 participants.

At the end, I jotted down a summary of conclusions that came out of it.

I thought it may be of interest to some of those who took part in it but I can’t remember who most of them were, so here it is… Pass it on if you were there.

Do leave comments or a scoreboard below.

Of the 17, how many did the Cameroons come out ahead on?

The PDF is HERE.