Tim Harford The Undercover Economist
  • THE UNDERCOVER ECONOMIST STRIKES BACK
    “Every Tim Harford book is cause for celebration. He makes the ‘dismal science’ seem like an awful lot of fun.”
    – Malcolm Gladwell, author of “The Tipping Point”
  • Adapt – Why Success Always Starts with Failure


    “A highly readable argument... Very impressive”
    – Nassim N Taleb, author of “The Black Swan”
  • Dear Undercover Economist
    “Harford has a knack for explaining economic principles and problems in plain language and, even better, for making them fun”
    – The New York Times
  • The Logic of Life
    “Highly readable, funny and daringly contentious... a whopping good time.”
    – The San Francisco Chronicle
  • The Undercover Economist
    “Required reading”
    – Stephen J. Dubner, co-author of “Freakonomics”
Marginalia

Undercover Friday 2 – Resolutions and Recommendations

 

A resolution

My resolution this year is “more social, less social media”. I’m sure I’m not the only one. As we all know, social media can work wonders but it can also be addictive. And of course the comments can be toxic: it only takes one mean tweet to ruin anyone’s day. (Many people suffer far more than the occasional mean tweet, alas.) On the other hand, I continue to find email perfectly functional: when people email me to comment on what I’ve written or said, I don’t always agree but I usually learn something. And I do manage to read and respond to my email, which is quite impossible on Twitter or Facebook. I stopped trying a long time ago, realising that I would never write another book if I spent my time reading the mentions on Twitter.

If you’re trying to spend less time on social media too, the “Note to Self” podcast has had some good advice recently – particularly the episodes with Marina Abramovic. I believe in shaping your environment to help you. So: I don’t take my phone to bed with me, I don’t have Facebook on my phone, I’m logged out of Facebook on my computer so I don’t click over as a reflex, and I don’t have a “mentions” stream active on Tweetdeck. Every little helps. Meanwhile I’ll be trying to spend more time with my friends – in person, on the phone, even by letter.

On the other hand, if you’re loving your social media use, good for you. I’m on Facebook and Twitter – but email me if you actually want to get in touch.

 

Some recommendations

Debatable” was a life-changingly good episode of RadioLab. Please listen to it if you haven’t already – and then check out this interview with the journalist who reported the story, Abigail Keel.

My favourite gift from Father Christmas was the absolutely brilliant graphic novel Vision: Little Worse Than a Man (UK) (US). It’s about struggle of a superhuman artificial intelligence to live a normal suburban family life. Remarkable.

Check out Brad DeLong’s essay on secular stagnation if you want to become smarter.

I’ve been enjoying Frank Trentmann’s Empire of Things (UK) (US) – a magisterial history of shopping and consumerism – and found myself going back yet again to Marc Levinson’s excellent The Box (UK) (US), a history of the shipping container. All part of the research for 50 Things That Made the Modern Economy.

 

And a review

I think most authors look at their reviews with trepidation; I certainly do. But occasionally the fear turns to joy. Writing in The Age, Peter Martin opines: “The best pop songs start by giving you what you want, and then build up to so much more… Now there’s Messy, a book that presents itself as an impossibly simple account of the virtues of a messy workspace, then builds to something extraordinary.”

What delighted me so much about the review was that Mr Martin saw exactly what I was hoping to do – but like any self-critical author I was always afraid that I hadn’t succeeded.

Enough self-promotion – have a good weekend.

13th of January, 2017MarginaliaComments off
Undercover Economist

Embrace the digital pile-up

One of my resolutions this year is to get more done. I seem to make the same vow every year and I suspect that many discerning readers of the Financial Times have a similar perennial yearning. But thanks to the research I did for my latest book, Messy, and a fascinating new book from Ofer Bergman and Steve Whittaker, I now feel I have a better sense of why some tactics work and others fail.

Their book, The Science of Managing Our Digital Stuff (US), is an academic tome addressing a deeply practical pair of questions: how do we all cope with the ever-increasing influx of emails, documents, photographs and bookmarks? And how can we do better?

Two strategies suggest themselves: organise and label everything meticulously (the “filer” approach), or organise nothing at all and search when you need something. We could call this latter tactic the “search everything” approach — or “hoarding”.

Both strategies can work in certain circumstances but both also turn out to have serious weaknesses. Filers struggle because getting so carefully organised takes too much time, and filer strategies often break down as users become busier and busier. But, more importantly, filers often suffer from “premature filing”, as they try to categorise incoming messages they don’t yet have the context to understand fully. Folder structures that make sense at the time are often incomprehensible later. And far too much low-value stuff is filed when it should have been deleted, becoming digital chaff that obscures the target.

Meanwhile, hoarders risk drowning in a sea of email: it’s impossible to make sense of an inbox with 14,284 emails. Yes, one can use email search — in 2011 Whittaker and four colleagues showed that when you’re trying to find an email needle in your archive haystack, search works at least as well as navigating through a folder structure. But Bergman has shown why we tend to resist searching: it feels like hard work. It’s more cognitively taxing than clicking through folder trees, a process that uses visual memory without much effort. We like folders because they feel natural in a way that search does not. And most important: search only works if you remember what you’re searching for.

When coping with paper documents, there’s a handy intermediate strategy between filing and hoarding: “piling”. Pilers let documents accumulate on their desk, sometimes informally grouped by topic or project. The piles are self-organising because recently handled documents end up going back on top. Whittaker and Julia Hirschberg have shown that pilers tend to keep smaller archives. The stuff in their piles is well used, unlike the redundant folders of the tidy filers. Piling looks messy but it works.

But email poses a particular challenge — is there a strategy that imitates the informal accessibility of the desktop piles, yet works in a fast-moving inbox? I think there is.

Here are the principles of “email piling”. First, email piling should be simple — crude enough that it’s quick and misfiling is almost impossible. Second, it should be organised around taking action. Ultimately, you’re not building a library, you’re keeping track of stuff that you need to do. Therefore, third: it should be visible. Your piles are reminders to take action, so they shouldn’t be hidden away.

So: crude, visible and built around taking action. The corollary of all this is that if you have an email that doesn’t require your action, you can archive it, safe in the knowledge that the search box will produce it again if needed. As a result, your email pile will be a jumble but a small one — just like the paper piles that Whittaker and Hirschberg studied.

That’s the theory, then. And in practice? I use Gmail’s “multiple inbox” function to sort my emails into three categories: yellow star for stuff to do, blue star for stuff to read and red star for stuff that’s waiting for someone else. (Assigning the star requires just a click or two.) Unlike normal folders, all three of these categories are in plain sight whenever I open Gmail itself: three simultaneous colour-coded inboxes.

***

I find this digital piling works remarkably well, at least for me. Most emails don’t fit in any of the categories — a sign that it should be replied to and/or archived immediately. The “to do” inbox is small enough that I don’t feel anxious that things will be lost. And, as an added benefit, if I check email on my phone and see that it requires a proper reply from a proper keyboard, I can dump it in my “to do” inbox and it vanishes from the phone to reappear on the computer, where it can be properly handled. When the email disappears, so does the compulsive anxiety to tap out a response with one thumb.

I have a few other folders but only for very well-defined bits of information I know I need to keep.

This isn’t a system that tries to organise emails once and for all, or tidy them away out of sight. The aim is to manage them as they come through. Rudimentary and unsophisticated might not be the ideal approach to life in general. It works very well for email.

Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Free email updates

(You can unsubscribe at any time)

 

Marginalia

Undercover Friday

I’m planning to post some semi-regular jottings on Friday afternoons. Enjoy!

Fifty Things that made the Modern Economy hits number one… To my delight, my new BBC radio series was the number one podcast in the UK at Christmas, according to iTunes. If you’ve not encountered it, please have a listen – they’re short stories about the inventions and ideas that surround us every day, and the lessons that they can teach us. Everything from concrete to the iPhone, the bar code to the elevator. If you do subscribe then please pop over to iTunes or wherever and review it – it’ll help other people to find the podcast.

Book of the Week: I’ve been reading the new edition of John Kay’s “The Long and the Short of It” (UK) (US). It’s an outstanding and practical guide to how financial markets work and how to invest in them without getting ripped off. Kay sets out several key principles – think about your portfolio as a whole, take the efficient markets hypothesis seriously but not literally, reducing charges is the simplest way to make money – but he also explains the economics behind these principles and produces copious suggestions for putting them into play. Kay knows an enormous amount about this and his writing is clear and sharp – if sometimes demanding. Strongly recommended.

Thomas Schelling.  Just before Christmas, Thomas Schelling died at the age of 95. I was fascinated by the range of his contributions to economics and to US strategic thought – and given that he was one of the fathers of nuclear arms control, it’s a particularly poignant moment. I interviewed Tom Schelling for the FT shortly after he was awarded the Nobel memorial prize, made a video about his famous “chessboard” model of segregation, and told a TED-style story about him for BBC radio. Perhaps my favourite Schelling book is Micromotives and Macrobehavior (UK) (US) – but they’re all good.

How disaster planning can help with New Year’s Resolutions: A few years ago, I discussed whether Schelling’s idea of a “commitment strategy” can help us keep New Year’s Resolutions. I suspect, however, that psychologist Gary Klein’s idea of the pre-mortem is particularly useful. Basically: after drawing up your resolution (or any other goal or project) spend some time imagining that it doesn’t work out, and exploring why that might have been. Very often, you’ll think of obvious stumbling blocks and figure out ways to avoid them.

Resource of the Week – The World Wealth and Income Database. The great Tony Atkinson died on New Year’s Day. (Here’s the FT obituary of Tony Atkinson.) Here’s the excellent resource that he helped to create, the World Wealth and Income Database – the first stop for people trying to understand in-country inequality.

Shameless plug. My new book “Messy” is available online in the US and UK or in good bookshops everywhere.

Free email updates

(You can unsubscribe at any time)

6th of January, 2017MarginaliaComments off
Other Writing

The Undoing Project – Book Review

Michael Lewis could spin gold out of any topic he chose but his best work has shone a spotlight into corners of the world that weren’t getting enough attention until Lewis came along. Liar’s Poker described bond trader Lewis Ranieri and the way securitisation revolutionised Wall Street in the 1980s. Moneyball covered baseball manager Billy Beane and anticipated the “quants” taking over the world. And The Big Short depicted Steve Eisman and Michael Burry, the men who spotted the financial crisis coming and bet vast sums on it.

The Undoing Project, then, is a departure, because it’s a biography of two well-established figures: Daniel Kahneman and Amos Tversky, the Israeli psychologists whose partnership produced the foundations of what we now call behavioural economics. Despite an introduction by Lewis declaring that he hadn’t heard of them until 2003, neither man remotely counts as an unknown.

When Tversky died young, in 1996, he was on the secret shortlist for a Nobel memorial prize in economics, and received a detailed obituary in The New York Times. Kahneman won the Nobel economics prize in 2002 and published his own bestselling book, Thinking, Fast and Slow, in 2011. Their ideas are everywhere; it’s almost impossible to find a book in the “smart thinking” section of a bookshop that doesn’t cite Kahneman and Tversky: an irony, since their work highlights many of the ways in which our thinking isn’t smart at all.

For example, they identified the “representativeness heuristic” — our tendency to make judgments by comparing an example to some mental model. When we meet a nervous, geeky-looking gentleman we note that he matches our stereotype of a programmer and, therefore, probably is a programmer. We forget that most of the people we meet are not, in fact, programmers, no matter how much they might resemble them.

This matters, because when judging probabilities we often skip over the real question, “Is this likely?”, in favour of a representativeness question: “Does this match my preconceptions?”. “Is the lump likely to be a malignant tumour?” becomes “Does the lump match my idea of what a malignant tumour looks like?”. It’s a reasonable rule of thumb that can lead us seriously astray.

All this is well known to anyone who has read Kahneman himself or popularisations of his work, so what does Lewis add? He’s a far better writer than most, meaning that even the familiar is fresh. And there is a great deal here that feels new. Lewis has done his homework; he has evidently talked to the right people — with the inevitable omission of the much-missed Tversky — and he knows how to tell a story simply, powerfully and with an eye for the telling detail.

Yet The Undoing Project gets off to a shaky start with a chapter discussing the selection of basketball players and the way in which basketball scouts commit various cognitive errors. Perhaps the success of Moneyball encouraged Lewis and his editor to think this was wise but it adds very little to our appreciation of the main characters, and much of the chapter is baffling unless one happens to be a fan of American sports.

All is forgiven in chapter two, when we meet the young Danny Kahneman, a Paris-raised Jew whose family spend the war dodging the Nazis and their sympathisers. No matter how many accounts one reads of such horrors, the reader is filled with sadness and a kind of awe at the survivors. At the age of seven, Danny was caught on the streets after curfew by an SS soldier. The man didn’t notice the yellow star under his sweater; instead, he hugged little Danny and, full of emotion, showed him a photograph of another young boy. Then he gave Danny some money and sent him on his way. “People were endlessly complicated and interesting,” Kahneman recalled.

Tversky is no less deftly portrayed: as a child, he was so bullish that he was willing to leap from a high diving board despite being unable to swim — he simply arranged for a bigger boy to be on hand to drag him to safety. As a soldier, Tversky saw a comrade pull the pin on a grenade-like explosive, then faint. As his commanding officer yelled orders to stay put, Tversky dashed forward, dragged the stricken man a few yards away, then dived to cover him, taking the shrapnel into his own body. Yet he berated his own men for carelessly taking risks. “If a bullet is going to kill me, it has my name on it anyway,” they would say. Tversky, a quick wit, reminded them that many bullets were addressed “To Whom It May Concern”.

Today, Kahneman and Tversky’s view of human psychology is widely accepted, and thanks to his longevity and his Nobel Prize, Kahneman is a more famous figure than Tversky. But Lewis takes us back in time, conjuring up the 1970s, when their ideas were new and controversial, they were operating in the backwater of Israeli academia, and when it was the mesmerising Amos rather than the quiet Danny who won all the attention.

Behavioural economics itself is not a major part of the book. Richard Thaler, the most important intellectual conduit between Kahneman and Tversky and economics, does not appear in the story until the closing chapters. While Tversky loved to have an intellectual foe to slay, it would diminish his work with Kahneman to define it merely as a takedown of textbook economics. By writing less about behavioural economics Lewis gives Kahneman and Tversky’s ideas room to breathe.

Lewis admires his subjects and believes they are right about everything important. He has no time for rational economic man, and brutally dismisses one noted critic of Kahneman, the psychologist Gerd Gigerenzer. But this isn’t a hagiography. Tversky is depicted as intellectually aggressive, contemptuous of many academics and perversely compelled to needle the vulnerable Kahneman. Meanwhile, a new side to Kahneman emerges. In my limited personal experience, Kahneman seems wise, kindly and stoic in the face of his advancing years. But Lewis describes the younger Kahneman as depressed, envious of his celebrated partner and desperately needy.

Nevertheless, it is clear that Lewis is cheering our heroes on, and the reader cannot help but join him. The story he tells of their intellectual love affair, and its painful disintegration, is vivid, original and hard to forget.
Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Free email updates

(You can unsubscribe at any time)

23rd of December, 2016Other WritingComments off
Undercover Economist

Why family traditions make for happy holidays

The Japanese have a particularly engaging ritual at this time of year: Kurisumasu ni wa kentakkii, which may sound like great wisdom but in fact refers to “Kentucky for Christmas”, the national habit of eating Kentucky Fried Chicken as their Christmas feast.

It began as an inspired bit of marketing. In the 1970s, KFC noticed that western expatriates in Japan were turning to fried chicken because they couldn’t get hold of turkey. Now it has become a ritual with enough selling power that there are queues around the block, and customers will order their chicken in November or even October. What’s particularly impressive is that Christmas isn’t even a holiday in Japan.

Kurisumasu ni wa kentakkii is an audacious piece of commercialisation, but it’s not the first time Christmas has been boldly hijacked to sell something; indeed, Christmas itself piggybacked on earlier midwinter festivals. Many Christmas traditions are fairly recent — in the UK, Christmas cards, turkey, crackers and trees are all 19th-century innovations. On the other hand, Christmas consumerism, which we tend to think of as a modern vice, is also a 19th-century habit. Joel Waldfogel’s book Scroogenomics shows that the boom in December spending can be traced back many decades. (In 1867 in New York, Macy’s decided it was worth keeping its doors open until midnight on Christmas Eve.)

So I don’t begrudge the Japanese their southern-fried Christmas ritual. In fact, I have been intrigued by Christmas rituals in general; some are good and some less so. As I pointed out last week (and last year), the ritual of giving gifts at Christmas is extremely wasteful, channelling valuable resources into ill-fitting clothes and tacky golf memorabilia that nobody would choose if they were buying for themselves.

Over the past decade or so, we’ve seen a new combination of two older traditions: giving gifts, and donating to charity. With much the same cheek as Kentucky Fried Chicken in Japan, Oxfam has been pushing the idea that you can “give twice” by donating to Oxfam on someone else’s behalf. In effect, you’re “giving” a dozen chicks, or a vegetable garden, or, notoriously, a goat. “A unique, symbolic gift,” says Oxfam, although a moment’s reflection will reveal it not to be unique at all.

And what does it symbolise? For some, it represents wit, anti-consumerism and the true spirit of Christmas. For others, it represents smug self-obsession. After all, if I give you an Oxfam goat, what have I really done? I’ve made a donation to charity, marinated in my own sense of superiority, and then mailed you the receipt. To add injury to this insult, I’ve also not bothered to buy you a gift. We can only hope that Oxfam, at least, is able to find someone who actually needs the goat.

Three researchers, Lisa Cavanaugh, Francesca Gino and Gavan Fitzsimons, recently published research into this sort of “socially responsible” gift. They found evidence that people systematically overestimate how welcome such gifts will be, particularly when they are given to people they don’t know terribly well. As I described last week, Gino has contributed to other research on gift-giving, discovering that recipients are often happier with gifts chosen from a wishlist or otherwise explicitly requested, even though that does seem to lose some of the charm. Combining the two insights suggests that if you want to make a donation to charity on someone’s behalf, it might be wise to ask for their blessing first.

***

What of the Christmas rituals we share as a group? Different families will have their own rituals — perhaps the gifts are to be opened at a particular time or in a particular order. Perhaps the Queen’s Speech must be watched, respectfully. My wife’s family, religiously minded, would delay opening gifts until after a Christmas Day service. My own family were more secular but fond of delayed gratification — many gifts had to wait until after Christmas lunch. For some families, there’s a particular film to be watched; for others, a board game to be played.

Ovul Sezer, Michael Norton, Francesca Gino (again) and Kathleen Vohs have been examining the effect of rituals on the way we experience Christmas and New Year’s Eve. The researchers find a correlation between these rituals — sacred or secular — and various positive experiences of the holiday season, including feeling more curious, paying closer attention, liking the family more, enjoying the seasonal holiday, and life satisfaction in general. Of course, causation may run the other way — it may be that disliking your family causes you to avoid sharing Christmas rituals with them rather than the other way round.

Still, Sezer and her colleagues seem to be on to something. Life is full of social rituals but their details often do not seem to matter much: the wake, the prom night, the baby shower, even Kurisumasu ni wa kentakkii — we form our social habits and we stick to them. And the research suggests we’re absolutely right to do so. The rituals seem to make our lives richer and more enjoyable.

And without going into too much detail, there is one Christmas tradition that’s unlikely to disappear any time soon: the number of children conceived peaks over the Christmas holidays, leading to a bump in birth rates in September. That’s certainly one way to bring a family closer together.

Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Free email updates

(You can unsubscribe at any time)

Undercover Economist

The economist’s guide to gift-giving

“There are worlds of money wasted, at this time of year, in getting things that nobody wants, and nobody cares for after they are got.” That was Harriet Beecher Stowe in 1850, reminding us that concerns over Christmas consumerism aren’t new.

 Also not new is Joel Waldfogel’s notorious research paper, The Deadweight Loss of Christmas, published 23 years ago in American Economic Review, a respected journal. Waldfogel, now a professor of economics at the University of Minnesota, expanded on his ideas in 2009 in a brief and witty book, Scroogenomics. He showed that gifts typically destroy value, in the sense that the giver had to pay more to buy the gift than the recipient would ever have been willing to spend on it. The total deadweight loss of Christmas in the US alone was $12bn.

Alas, what sounds like wisdom from Stowe tends to be mocked when published in an academic journal. But the problem that Waldfogel quantifies is quite real. If you give someone a jumper that doesn’t fit, a book they’ve already read or a box of chocolates when they’re on a diet, this is a waste of valuable resources. Fossil fuels have been burnt, tedious hours have been worked, trees have been felled, all to produce products that were unwanted. The same resources could have been devoted, instead, to goods that people actually do value.

Still, one cannot simply spit “Bah! Humbug!” and have done with Christmas gifts; people have their expectations. Nor can one simply dole out cash — at least, not to grown-ups. So, then, what to do? I asked Waldfogel himself, and several other social scientists, how they resolve the tension between the fact that Christmas gifts are a shameful waste and the fact that they are socially obligatory.

It’s not easy. Andrew Haldane, chief economist at the Bank of England, tells me: “I start out with the best of intentions — some small, inexpensive but deeply meaningful gifts that will stir the soul of the recipient — and then, at the last minute, end up panic-buying rather thoughtless, often expensive and largely unwanted stuff.” It is good to know that the Bank is in touch with how the rest of us act.

Dan Ariely, a psychologist at Duke University and author of behavioural economics books including Payoff, might encourage Haldane to forgive himself. Ariely rejects the basic Waldfogel premise. Economists, he told me, just don’t get it. They are seduced by their own training to be selfish and narrowly focused on efficiency. Giving gifts, says Ariely, is “inefficient economically but efficient socially”.

Well, perhaps. Certainly, if I give you a bruise-blue cardigan that you detest, we can all agree that this is no tragedy because it’s the thought that counts. But we can also agree that it would have been better if I had chosen a nicer cardigan.

One approach, independently advocated by Kimberley Scharf of the University of Warwick and Francesca Gino of Harvard Business School, is to buy only what has been explicitly requested.

This idea has some science behind it. Gino, the author of Sidetracked, has published research (with Stanford’s Frank Flynn) into how people feel about wishlists.

“Gift recipients prefer to receive items they’ve asked for, and they think givers who fulfil this ideal are more thoughtful,” says Gino. “Yet when we’re the one who is doing the giving, we fail to realise that people tend to prefer receiving what they told us they want.”

Basically, when we’re the giver, we scorn the wishlist and get creative, imagining that we’re smarter choosers than we really are; when we’re the receiver, we would simply be delighted to receive exactly what we asked for.

Gino herself looks for a wishlist whenever possible, and can recall several occasions when she was on the brink of buying an expensive and entirely inappropriate gift, only to be saved by having an honest conversation with the target of her generosity.

But what of poor Waldfogel himself? When the subtitle of your book is Why You Shouldn’t Buy Presents for the Holidays, you’re setting yourself up for a lifetime of giftless ostracism. But, says Waldfogel, he does still receive gifts, often “coffee, chocolate, or cognac . . . things I am known, by my friends and family, to use.”

He adds: “Honestly, how bad can any of these things turn out to be?”

Well, quite. Although my wife wouldn’t touch any of the three items — a reminder that there is no such thing as the all-purpose gift.

Waldfogel argues that it’s possible to do even better than the wishlist. The ideal, he says, is to find a gift that transcends what a person would be able to buy for themselves. And his answer is the gift of permission. “If I want something that’s a little extravagant, then I run it past my wife, who gives me permission to buy it.”

This does make a strange kind of sense. Last Christmas I bought my wife an expensive piece of camera kit — after carefully quizzing her to make sure I had exactly the right thing. We have a joint bank account, so what was I really giving her? Not money, and not effort. I was giving her my blessing.

Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Other Writing

Thomas C. Schelling, 1921 – 2016

Thomas C. Schelling, who died on December 13 at the age of 95, was a self-described “errant economist” who worked as a Cold War strategist and won the most prestigious prize of his profession.

Schelling was a popular winner of the Nobel memorial prize for economics. Journalists found his lively prose and counterintuitive ideas easier to describe than the complex equations of his fellow laureate Robert Aumann.

But the Californian-born economist was an unlikely laureate. His ideas were rich and influential — and easily expressed in plain English. He highlighted weaknesses in standard economic approaches, deploying vivid thought experiments more suited to moral philosophy than to economics, and rarely cited other academics.

Instead, Schelling used academia as a vantage point from which to advise the administrations of Presidents Kennedy, Johnson and Nixon. He was at Harvard University for 31 years, and said of one role there that it had given him a decade of “freedom to write and to consult, and I spent much of my time, especially during the summer, doing advisory work for the government.”

That advisory work drew on one discipline in particular.

Game theory had been dreamt up by the mathematician John von Neumann, as an attempt to model in mathematical terms human interactions from poker through to strikes or cartels.

The Hungarian-born von Neumann was a hawk (“If you say why not bomb [the Soviets] tomorrow, I say why not today?”) but Schelling took game theory in a new direction. He emphasised that even the most implacable foes could find areas of common interest — most obviously, during the Cold War, the necessity of avoiding mutual annihilation.

To this end, in the late 1950s and the 1960s, Schelling’s advisory work and his publications focused on issues of effective deterrence, communication, and the strategic limitation of arms. He was a consultant for Stanley Kubrick’s 1964 film Dr Strangelove, a nuclear annihilation comedy which introduces a “doomsday device”. The device is the ultimate deterrent: it will be triggered automatically in the case of war. Alas, it’s a secret, which limits the deterrent effect.

The doomsday device was the perfect illustration of some of Schelling’s favourite themes: strategic commitment, miscommunication, and unintended consequences. It is no coincidence that it was Schelling who insisted that Washington and Moscow establish a secure hotline and work out protocols for ensuring it was tamper-proof. This attention to details that others overlook was a spark for his best academic work. It is also is one reason why nuclear weapons have not been used since 1945.

Schelling ended his advisory work with a letter opposing the 1970 US military campaign in Cambodia. He later worked on the problem of addiction, developing models of self-control that were precursors to what is today known as behavioural economics. This research was partly motivated by his own long and eventually successful struggle to stop smoking. And in 1980, at the request of President Carter, he became one of the first economists to work on the problem of human-induced climate change.

He also anticipated the use of complexity science in economics with a celebrated “chessboard” model of segregation. This showed how two racial groups could completely segregate from each other in a chain reaction despite being quite comfortable in a mixed neighbourhood.

These days such modelling is done on a computer, but Schelling originally explored the idea in a notebook doodle on a long flight. “It was hard to do with pencil and paper,” he told the FT in a 2005 interview. “You had to do a lot of erasing.”

Thomas Crombie Schelling was born in Oakland, California, on 14 April 1921. His father was in the US Navy, but despite Thomas Schelling’s crew cut, square jaw and family history, he did not fight in the war. For medical reasons, the military would not accept him. Instead he studied economics at the University of California, Berkeley and earned his PhD at Harvard. After a spell working on the Marshall Plan, he taught at Yale, Harvard and finally the University of Maryland.

Schelling married Corinne Saposs in 1947. After that four-decade marriage ended in divorce, he married Alice Coleman, who survives him, as do four sons, two stepsons and his younger sister, Nancy.

Written for and first published in the Financial Times.

17th of December, 2016Other WritingComments off
Undercover Economist

Game changers: the importance of the puzzle

Looking forward to a few family board games at Christmas? Good, good. Steer clear of Monopoly — a dreadful, grinding game. Settlers of Catan is the game that Monopoly wishes it was although, for committed players, Puerto Rico is even better. (Agricola is the best game. But you knew that already.)

 Games are a serious business in the Harford household these days but they, along with puzzles and other fripperies, have long been important elsewhere.

Consider the puzzle of the bridges of Königsberg — 18th-century Königsberg had seven bridges connecting two sides of a river and two large islands. The puzzle was: is there a walking route through the city that crosses each bridge only once? When the great mathematician Leonhard Euler heard about the problem, he found it “banal” but was intrigued by the fact that, despite its apparent simplicity, “neither geometry nor algebra nor even the art of counting” could solve it. And so Euler invented an entirely new branch of mathematics, graph theory.

“That was the beginning of all network analysis,” says Alex Bellos, the author of Can You Solve My Problems?, a new book celebrating the joys and history of puzzles. Euler’s graph theory has been enormously fruitful in chemistry, physics, sociology and, of course, computer science. The internet relies on Euler’s analysis. And it all started with a brain-teaser.

Perhaps it’s no surprise that a puzzle might lead to a mathematical breakthrough: after all, puzzles are designed to be intellectual challenges. But other pastimes have also spurred fresh ideas — for example, gambling. Perhaps the first gambler to draw inspiration from this vice was the Renaissance mathematician Girolamo Cardano, who produced the foundations of probability theory.

Three-and-a-half centuries after Cardano died, the smartest man in the world decided to use mathematics to work out how best to play poker. John von Neumann was one of the driving forces behind the development of both the atomic bomb and the computer, and he wanted to apply mathematics to social sciences — for example, analysing the success or failure of negotiations, or the formation of alliances. His contention was that a mathematical theory that could explain life should start by explaining poker: “Real life consists of bluffing, of little tactics of deception, of asking yourself what is the other man going to think I mean to do, and that is what games are about in my theory.”

The result of von Neumann’s musings — first alone, and then with the economist Oskar Morgenstern — was “game theory”, one of the building blocks of modern economics and an important tool in evolutionary biology.

This is an impressive list of ways in which games have inspired us — and we haven’t even touched on the way that computer scientists have used chess as a testing ground for their machines.

But it would do games a disservice to treat them merely as a source of intellectual inspiration. They have inspired us in other ways too. In his new book, Wonderland, Steven Johnson makes a convincing case for the transformative power of play and delight — for example, the Victorian designer of paleo-computers, Charles Babbage, was inspired by a captivating mechanical toy dancer.

This wasn’t the last time that pure fun changed the world of computers. The first video game that mattered, Spacewar!, was designed in the early 1960s by enthusiastic students at the Massachusetts Institute of Technology who wanted to demonstrate just what the latest computers could do. And what they could do went way beyond the technical: they could hijack our attention, trigger Pavlovian responses, even addict us, by providing a compelling and engaging challenge.

Silicon Valley visionary Stewart Brand wrote about Spacewar! in Rolling Stone magazine in 1972. He saw what the game represented: computers that ordinary people would come to love. “I saw them having some kind of out-of-body experience,” he said recently of Spacewar!’s players. “Their brains and their fingers were fully engaged.” That curious compulsion felt by every PlayStation junkie or Instagram addict was felt first by the players of this early game.

Now, researchers at DeepMind, Google’s artificial intelligence outfit, are turning to computer games to train artificial intelligences. The AI is shown the game screen, given access to the score and a controller, and then — with no further information — figures out how to master the game. At first, DeepMind started with simple games such as Atari’s Breakout but it has recently moved on to Starcraft II, a game that requires tactics, military strategy, surprise and economic planning. Like von Neumann’s poker, learning to play Starcraft II is good training for the rigours of reality.

One of Alex Bellos’s puzzling heroes is Hubert Phillips — the man who coined the word “mezzobrow” to refer to “people of the highest intelligence who enjoy such things as crosswords, chess problems, inferential puzzles and parlour games”. Even as a child I knew about Phillips, the author of a veritable bible of card games. Phillips also wrote 200 detective stories, compiled crosswords and championed a number of classic puzzles — including the “logic grid” problems that are such a staple of the genre.

But that is not how Hubert Phillips began his career. He was a noted economist, adviser to the Liberals in the 1920s and the head of Bristol University’s department of economics. All very respectable, but thank goodness he turned to the far more important practice of having fun.

Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Marginalia

A Christmas reading list

A few books that I’ve been enjoying recently…

Lyonesse (US) (UK) by Jack Vance – I recently re-read this in preparation for a forthcoming discussion on the Fictoplasm podcast. It really is magnificent – the finest fantasy trilogy out there. Vance is witty, he’s inventive, and joyful. His bad guys are truly wicked, his heroes and heroines are compelling, and his fairies are utterly mysterious. The dialogue is as distinctive and enjoyable as anything in Tarantino.

The Undoing Project (US) (UK) by Michael Lewis. I have a review coming soon of this book in the Financial Times. It’s a biography of the great psychologists Daniel Kahneman and Amos Tversky, and it’s nearly perfect – an odd and unnecessary opening chapter, but just start at chapter two and you’ll love it. Kahneman and Tversky are fascinating characters; Kahneman won a Nobel memorial prize and wrote the excellent Thinking Fast and Slow (US) (UK). I thought I knew a fair bit about their collaboration but Lewis’s story is full of surprises and no small degree of tragedy.

Newly crossed my desk, Jonathan Portes’s 50 Ideas You Really Need To Know About Capitalism (US) (UK) is presented, as you might expect, in bite-sized chunks. No spellbinding narrative here but that was not the aim. Portes is knowledgeable and the chapters are sharp and clear and full of interesting nuggets.

And, I’ve mentioned it before but Steven Johnson’s Wonderland (US) (UK) is on form – a playful and surprising guide to how play, puzzles and delight have shaped innovation.

Einstein’s Greatest Mistake (US) (UK) by David Bodanis is a great short biography with some super storytelling.

And finally, it would be perverse of me to omit my own book, Messy. Happy reading!

Free email updates

(You can unsubscribe at any time)

6th of December, 2016MarginaliaComments off
Undercover Economist

Why forecasters failed to predict Trump’s victory

British Remainers watched the US presidential campaign with an uneasy sense that they had seen it all before: brazen lies from a populist movement, experts lining up to attest that all sensible people agree on what should be done … Those of us who saw the EU referendum campaign up close have been well prepared for the possibility of a Trump victory. US Democrats had less of a visceral warning and so were more surprised.

The truth is that once Trump had secured the nomination, a Trump presidency was always a strong possibility. The betting markets seemed to recognise this, offering odds of three-to-one a week or so before the poll. Three-to-one shots happen all the time — or at least, about a quarter of the time. A defeat for Hillary Clinton may be far more consequential than a defeat for Manchester City and, therefore, far more shocking but it shouldn’t be any more surprising. Favourites do not always win.

Forecasting is a tough job but we make it harder than it has to be by committing some familiar cognitive errors. So what are the lessons that we should learn?

First, wishful thinking has struck again. After the Brexit vote, I described the research of the economist Guy Mayraz. At Oxford university’s Centre for Experimental Social Science, Mayraz ran experiments in which participants were told that they were either “farmers”, who would be paid more if wheat prices were high, or “bakers”, who would be paid more if wheat prices were low. They were then shown a graph, purportedly tracking the wheat price, and invited to forecast the future price, with a cash reward for accurate forecasts. Despite the fact that they were being paid for accuracy, the farmer-participants systematically forecast higher wheat prices than the bakers. Everyone predicted what they hoped would happen. Does that sound familiar?

The second lesson is that — as a large experiment conducted by the Good Judgment Project has shown — self-critical, open-minded forecasters do a better job than narrow-minded, overconfident ones. Of course that is obvious — except that open-mindedness is a quality in short supply. Dwelling on our own fallibility is like dwelling on our own mortality: most people find it uncomfortable, so we don’t do it.

Whether you’re sinking a beer with friends or prognosticating on cable news, the social pressure is to make an interesting, confident statement rather than hum and haw about all the ways in which you might be wrong. Confident, eye-catching forecasts are the snack food of analysis and commentary: everybody knows they’re doing us no good but we can’t seem to resist.

It was interesting to see the self-critical dynamic in action at Nate Silver’s political forecasting website FiveThirtyEight. I interviewed Silver at a public event when he was riding high after successful forecasts in 2012. The audience questions were fawning but I was impressed at how Silver kept emphasising that he’d been lucky and future forecasts would be harder.

This time round, FiveThirtyEight botched the analysis of the Republican nomination: the polls said Trump was clearly ahead but nobody could quite believe that. Yet the early failure provoked some introspection. FiveThirtyEight learnt a lesson. While other forecasters were writing off Trump in the presidential race, FiveThirtyEight kept looking at the polls, and continued to declare that it was close.

A third lesson is that we have to keep an open mind that more than one outcome is possible. Too many people equated “Clinton is the favourite” with “Clinton will win”. That’s an obvious error, but it’s common. Even expert forecasters often treat a strong possibility as though it is a certainty. This tendency is one reason that dart-throwing chimps give the experts a run for their money. The chimps make lots of forecasting errors too, but at least they don’t systematically overrate their chances.

Perhaps the best way to keep more than one outcome in mind is to develop scenarios. I’ve written before about the scenario-planning method: scenarios are persuasive, coherent stories about the future, and like all good stories they have a tendency to stick with the listener. A scenario-planner will create at least two contradictory stories — this helps people to keep an open mind, and to prepare for more than one outcome.

FiveThirtyEight does not quite embrace scenario-planning but it did produce a clear account of the kind of polling error that would be necessary to deliver a Trump win — along with a reminder that such polling errors are ubiquitous. Clinton was the favourite even for FiveThirtyEight, but the site presented its readers with a very clear description of how the less-likely prospect of a Trump win would unfold, if it were to happen.

Scenario-thinking is not really intended to produce better forecasts — although I think it does no harm. What it should deliver is preparedness. Trump’s victory has caught a lot of people napping; that’s strange. We take precautionary measures against far less likely events than the victory of a presidential underdog.

Amid many depressing features of the politics of 2016 has been our failure to prepare for perfectly foreseeable possibilities. If there is a silver lining, it’s this: the uncertainties are not going away, so it’s not too late to learn.

Written for and first published in the Financial Times.

My new book “Messy” is now out and available online in the US and UK or in good bookshops everywhere.

Free email updates

(You can unsubscribe at any time)

Previous Next

Elsewhere

  • 1 Twitter
  • 2 Flickr
  • 3 RSS
  • 4 YouTube
  • 5 Podcasts
  • 6 Facebook

Books

  • Messy
  • The Undercover Economist Strikes Back
  • Adapt
  • Dear Undercover Economist
  • The Logic of Life
  • The Undercover Economist

About Tim

Tim Harford is an author, columnist for the Financial Times and presenter of Radio 4's "More or Less".
Learn More ›

Tim’s Tweets

Free Email Updates

Enter your email address to receive notifications of new articles by email (you can unsubscribe at any time).

Join 3,928 other subscribers

Do NOT follow this link or you will be banned from the site!