Cautionary Tales Ep 8 – You Have Reached Your Destination

More than two and a half thousand years ago – so the story goes – King Croesus of Lydia consulted the oracle at Delphi. And the oracle assured him that if he went to war against Persia he would destroy a mighty empire. Reassured, Croesus launched his war, and was defeated. The oracle had been correct, but the mighty empire that Croesus destroyed was his own.

Our modern oracles are predictive algorithms. And perhaps the strange old tale of King Croesus has a great deal to teach us about how to interact with these silicon prophets.

Featuring: Archie Panjabi, Toby Stephens, Rufus Wright, Melanie Gutteridge, Mircea Monroe and Ed Gaughan.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading and listening

Both stories about the oracle at Delphi are in Herodotus: The Histories.

Tom Knudson did the original reporting on “Death by GPS” for the Sacramento Bee. Reuters covered the Carpi / Capri confusion. Both stories – and others – are discussed in Greg Milner’s  excellent book Pinpoint.

Gretchen Morgenson covered AIG’s woes for the New York Times in “Behind Insurer’s Crisis, Blind Eye to a Web of Risk” 27 Sep 2008.

Esther Eidinow discusses what we can learn from how the Greeks consulted their oracles in “Oracles and Models” at The Conversation.

The Pierre Wack quote about forecasts is in “Scenarios: Uncharted Waters Ahead” Harvard Business Review Sep/Oct 1985.

The original study of the illusion of explanatory depth is Rozenblit, Leonid, and Frank Keil. “The misunderstood limits of folk science: an illusion of explanatory depth.” Cognitive science vol. 26,5 (2002): 521-562. doi:10.1207/s15516709cog2605_1

The study of how forecasting tournaments nurture humility is Barbara Mellers, Philip Tetlock, Hal R. Arkes, Forecasting tournaments, epistemic humility and attitude depolarization, Cognition, Volume 188, 2019, Pages 19-26

The study of a 1980s diagnostic aid is Wyatt J., Spiegelhalter D. (1991) Evaluating Medical Expert Systems: What To Test, And How ?. In: Talmon J.L., Fox J. (eds) Knowledge Based Systems in Medicine: Methods, Applications and Evaluation. Lecture Notes in Medical Informatics, vol 47. Springer, Berlin, Heidelberg

The study of navigating around Kashiwa with or without GPS is Toru Ishikawa, Hiromichi Fujiwara, Osamu Imai, Atsuyuki Okabe, “Wayfinding with a GPS-based mobile navigation system: A comparison with maps and direct experience” Journal of Environmental Psychology, Volume 28, Issue 1, 2008, https://doi.org/10.1016/j.jenvp.2007.09.002.

Cautionary Tales Ep 7 – Bowie, jazz, and the unplayable piano

He’d played with Miles Davis and Art Blakey and this was to be the biggest solo concert of Keith Jarrett’s career – but the Virtuoso pianist was in for a shock when he entered Cologne’s opera house. The only piano at the venue was a wreck. His musical contemporaries David Bowie and Brian Eno proved through their collaboration that staying in your comfort zone isn’t always the best option and that disruption can feed creativity. But Jarrett was famed for liking things just so…. would he risk humiliation in Cologne and play the broken piano or would he walk away?

Featuring: Archie Panjabi, Ed Gaughan, Rufus Wright, and Mircea Monroe.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading and listening

I urge you to listen to Keith Jarrett’s Koln Concert, David Bowie’s “Heroes”, and Brian Eno’s Music for Airports. But you should also listen to a superb oral history, “For One Night Only: the Koln Concert” produced by the BBC.

For a fuller exploration of the ideas in this episode I tentatively suggest my own book, Messy. Paul Trynka’s biography of David Bowie is Starman. Sasha Frere-Jones has a fine profile of Brian Eno in the New Yorker, but my main source is my own discussions with Brian.

The font study is : Diemand-Yauman, C., et al. “Fortune favors the bold (and the italicized): Effects of disfluency on educational outcomes.” Cognition (2010), DOI: 10.1016/j.cognition.2010.09.012

The murder mystery study is: Katherine W. Philips, Katie A. Liljenquist and Margaret A. Neale “Is the Pain Worth the Gain? The Advantages and Liabilities of Agreeing With Socially Distinct Newcomers.” Personality and Social Psychology Bulletin Vol 35 No 3 March 2009 p. 336-350

The tube-strike study is: Shaun Larcom, Ferdinand Rauch, Tim Willems, The Benefits of Forced Experimentation: Striking Evidence from the London Underground Network, The Quarterly Journal of Economics, Volume 132, Issue 4, November 2017, Pages 2019–2055, https://doi.org/10.1093/qje/qjx020

Cautionary Tales Ep 6 – How Britain Invented, Then Ignored, Blitzkrieg

Blitzkrieg means “lightning war”, but despite the German name it was not a German invention. Back in 1917 a brilliant English officer developed a revolutionary way to use the latest development in military technology – the tank. The British army squandered the idea but two decades later later Hitler’s tanks thundered across Europe, achieving the kind of rapid victories that had been predicted back in 1917.

This is a common story: Sony invented the digital Walkman, Xerox the personal computer, and Kodak the digital camera. In each case they failed to capitalise on the idea. Why?

Featuring: Toby Stephens, Ed Gaughan and Rufus Wright.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

Mark Urban’s book The Generals has an excellent chapter on J.F.C. Fuller. Other sources on Fuller include Brian Holden Reid’s J.F.C. Fuller: Military Thinker and Harold Winton’s To Change An Army. 

Other sources on the development of the tank include Macksey and Batchelor’s Tank, Norman Dixon’s classic On The Psychology of Military Incompetence and Basil Liddell Hart’s The Tanks.

On modern corporate innovation try Gillian Tett’s excellent The Silo Effect, “Creation Myth” by Malcolm Gladwell, Clay Christensen’s Innovator’s Dilemma and The Disruption Dilemma by Joshua Gans.

The original paper on architectural innovation is:

Henderson, Rebecca M., and Kim B. Clark. “Architectural Innovation: The Reconfiguration of Existing Product Technologies and The Failure of Established Firms.” Administrative Science Quarterly 35, no. 1 (March 1990): 9–30

Cautionary Tales Ep 5 – Buried by the Wall Street crash

Two of the greatest economists who ever lived, Irving Fisher and John Maynard Keynes, thought they could predict the future and make a killing on the stock market. Both of them failed to see the Wall Street crash, the greatest financial disaster of the age – and arguably, of any age. Yet having made the same forecasting error, Fisher and Keynes went on to meet very different fates. What does it take to see into the future? And when you fail, what does it take to bounce back from ruin?

Featuring: Alan Cumming, Russell Tovey, Mircea Monroe, Rufus Wright, Ed Gaughan, and Melanie Gutteridge.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

Walter Friedman’s The Fortune Tellers is a key source on Fisher. It’s a history of all economic forecasting in the US. I loved it.

Sylvia Nasar’s excellent Grand Pursuit has much more on both Keynes and Fisher.

There are several fine journalist accounts of Keynes’s participation in the Degas auction. Try the BBC, the Wall Street Journal, or History Today.

On Keynes, the central source on his investment performances is David Chambers and Elroy Dimson. 2013. “Retrospectives: John Maynard Keynes, Investment Innovator.” Journal of Economic Perspectives, 27 (3): 213-28.DOI: 10.1257/jep.27.3.213. There’s more biographical detail in the more informal Keynes’s Way To Wealth by John Wasik.

Philip Tetlock’s original study is detailed in his subtle, scholarly and ground-breaking Expert Political Judgment. His more recent book with Dan Gardner, Superforecasting is more journalistic and covers his recent discoveries. Both books are very good, but quite different in style.

The case of Dorothy Martin and the UFO cult is told first hand by Festinger and his colleagues in When Prophecy Fails. There’s further discussion in Mistakes Were Made (But Not By Me), an excellent guide to all the ways in which we can fail to notice we’re wrong, by Carol Tavris and Elliot Aronson.

Cautionary Tales Ep 4 – The Deadly Airship Race

A British Lord wanted to build the best airship in the world – and so he had two rival design teams battle it out to win the juicy government contract. Competition is supposed to bring the best out of people, but run in the wrong way it can cause people (and the things they make) to fall apart in the most horrifying ways.

Featuring: Alan Cumming, Russell Tovey, Rufus Wright, Melanie Gutteridge, Enzo Cilenti and Ed Gaughan.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

Two recent and comprehensive books are Bill Hammack’s Fatal Flight (about the R101) and John Anderson’s Airship on a Shoestring. 

An excellent – but one-sided – account of the airship race is Nevil Shute Norway’s Slide Rule, while the case for Lord Thomson’s defence is put in Peter Masefield’s To Ride The Storm.  Alfred Roubaille’s description of the crash is from Nigel Blundell’s The World’s Greatest Mistakes.

The BBC made a documentary about R101, including eye-witness accounts. So did the History Channel.

The academic studies:

Dan Ariely, Uri Gneezy, George Loewenstein, Nina Mazar, “Large Stakes and Big Mistakes” The Review of Economic Studies, Volume 76, Issue 2, April 2009, Pages 451–469, https://doi.org/10.1111/j.1467-937X.2009.00534.x

Robert Drago and Gerald T Garvey “Incentives for Helping on the Job: Theory and Evidence”
Journal of Labor Economics, 1998, vol. 16, issue 1, 1-25 http://dx.doi.org/10.1086/209880 

Cautionary Tales Ep 3 – LaLa Land: Galileo’s Warning

Galileo tried to teach us that when we add more and more layers to a system intended to avert disaster, those layers of complexity may eventually be what causes the catastrophe. His basic lesson has been ignored in nuclear power plants, financial markets and at the Oscars…all resulting in chaos.

Featuring: Archie Panjabi, Mircea Monroe, Enzo Cilenti, Ed Gaughan and Rufus Wright

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

Among many, many journalistic accounts of the LaLa Land / Moonlight mix-up, try the Hollywood Reporter’s oral history and the BBC’s Truth Behind Envelopgate.

Benjamin Bannister on typography at the Oscars.

Galileo’s Dialogues Concerning Two New Sciences.

Charles Perrow’s Normal Accidents introduces the idea of complex, tightly-coupled systems and has good accounts both of the Three Mile Island and the Fermi reactor accidents. Just after we’d recorded the episode, I heard the sad news that Charles had died on November 12th. He’ll be missed.

The official report of the commission investigating Three Mile Island, chaired by John Kemeny.

Meltdown by Chris Clearfield and Andras Tilcik first drew the link between Perrow’s work and the La La Land fiasco. It’s a great book; check it out.

Dowell and Hendershott’s classic article about backfiring safety systems is No Good Deed Goes Unpunished: Case Studies of Incidents and Potential Incidents Caused by Protective Systems.

Don Norman’s The Design of Everyday Things discusses confusing instrumentation.

My previous article What Banks Should Learn From A Nuclear Reactor uses Charles Perrow’s ideas to draw parallels between banking and nuclear accidents.

Andrew Ross Sorkin’s Too Big Too Fail has the scoop on what happened when Bob Willumstad met Tim Geithner.

The new three-envelope system was described in Vanity Fair.

Cautionary Tales Ep 2 – The Rogue Dressed as a Captain

One crisp Berlin morning, in 1906, a small group of soldiers were led on an extraordinary heist by a man they believed to be a captain. So how did an ageing nobody in a fake uniform trick them into taking part in the crime of the century? Some say we humans will obey orders from anyone who dresses the part… but the real reason why we fall for tricksters time and again is far more interesting. Fraudsters and charlatans reel us in slowly by using psychology against us.

Featuring: Alan Cumming, Russell Tovey, Rufus Wright, Melanie Gutteridge and Ed Gaughan.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

The best English-language account I could find of the Kopenick story is by Benjamin Carter Hett. “The ‘Captain of Köpenick’ and the Transformation of German Criminal Justice, 1891-1914,” Central European History 36 (1), 2003.

I first read about the story in Nigel Blundell’s The World’s Greatest Mistakes. Other accounts are at Strange History  and The Rags of Time. Koepenickia offers various contemporary German newspaper accounts. There are many small differences in the accounts but the overall story remains just as remarkable.

The definitive account of Stanley Milgram’s experiments is Gina Perry’s Behind the Shock Machine and Alex Haslam was interviewed by Radiolab in a great episode about the same topic.

An overview of the evidence on tall presidents is Gert Stulp, Abraham P. Buunk, Simon Verhulst, Thomas V. Pollet, “Tall claims? Sense and nonsense about the importance of height of US presidents” The Leadership Quarterly  Volume 24, Issue 1, 2013.

The study of gubernatorial elections is Daniel J Benjamin & Jesse M Shapiro, 2009. “Thin-Slice Forecasts of Gubernatorial Elections” The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 523-536, 02.

Daniel Hamermesh’s Beauty Pays looks at the overall evidence that appearances matter – including in politics.

Cautionary Tales Ep 1 – DANGER: Rocks Ahead!

Torrey Canyon was one of the biggest and best ships in the world – nevertheless its captain and crew needlessly steered it towards a deadly reef known as The Seven Stones. This risky manoeuvre seems like utter madness, but the thinking behind it is something we are all prone to do when we fixate on a goal and a plan to get us there.

Featuring: Enzo Cilenti, Ed Gaughan, Rufus Wright and Melanie Gutteridge.

Producers: Ryan Dilley and Marilyn Rust. Sound design/mix/musical composition: Pascal Wyse. Fact checking: Joseph Fridman. Editor: Julia Barton. Recording: Wardour Studios, London. GSI Studios, New York. PR: Christine Ragasa.

Thanks to the team at Pushkin Industries, Heather Fain, Mia Lobel, Carly Migliori, Jacob Weisberg, and of course, the mighty Malcolm Gladwell.

[Apple] [Spotify] [Stitcher]

Further reading

Two authoritative books were written about Torrey Canyon shortly after the events described in the podcast, and I’ve relied on both of them.

One is Oil and Water by Edward Cowan, and the other is The Black Tide by Richard Petrow. Both excellent, both long out of print.

For a more contemporary discussion of plan continuation bias I strongly recommend Meltdown by Chris Clearfield and Andras Tilcik.

This book also contains a good description of Marlys Christianson’s study of plan continuation bias in emergency rooms, “More and less effective updating” in Administrative Science Quarterly 2018.

The study of landings at Hartsfield-Jackson airport is Chris A. West’s “The Barn Door Effect“.

The dark tale of Sir Cloudesley Shovell is told in Dava Sobel’s hugely enjoyable book Longitude, although I am sceptical Sir Cloudesley actually survived long enough for anyone to murder him.

Cautionary Tales…

Exciting news – I have a new podcast series ready to burst out upon an unsuspecting world. It’s called Cautionary Tales – true stories of catastrophe and fiasco, sparkling with top acting talent, with the aim of making you wiser with every word. I’m writing and presenting the series and will be adding a soupcon of social science to the narrative. [Apple] [Spotify] [Stitcher]

While you wait for the first episodes to drop on November 15th, I thought I’d share a few of my favourite books about making mistakes.

I received Nigel Blundell’s The World’s Greatest Mistakes as a Christmas gift when I was a child – a strange and compelling array of catastrophes, from famous air crashes and military blunders to amusing vignettes such as the bride who accidentally married the best man. The stories seemed well researched (although no list of references) and were briskly told. That book is long out of print, but I suspect that Blundell’s new book A Century of Man-Made Disasters will have similar qualities.

Levy and Salvadori’s modern classic Why Buildings Fall Down is a skilfully illustrated and fascinating way to learn about structural engineering by studying what happens when it all goes wrong.

For books about human error you could take a look at my list of my favourite behavioural economics books but try also Kathryn Schulz’s beautiful meditation on error, Being Wrong, and Tavris and Aronson’s excellent Mistakes Were Made (But Not By Me) James Reason’s more technical quasi-textbook Human Error.  

And for the all-important intersection of the maths-comedy-error Venn diagram, Matt Parker’s delightful Humble Pi.