Episode 41 · 27 minutes

How Big Things Get Done

by Bent Flyvbjerg and Dan Gardner, 2023

How Big Things Get Done argues that nearly every big project runs over because the planning was rushed, and that the fix is slow, cheap, iterative planning followed by short, fast delivery, estimated from what similar projects took. Nora reports the published exchanges over access to the megaproject database and over Hirschman's Hiding Hand, each as both sides put it. For neurodivergent leaders: Nora argues that a long, exploratory lead-in followed by a short, intense finish is a working pattern many neurodivergent people already have, and an estimate taken from comparable projects means nobody has to trust their own sense of how long things take.

Transcript

The whole episode in text, 108 lines. Miles and Nora are synthetic voices reading a script approved by Logan Williamson, LPC.

Read the full transcript

Miles: A couple in Brooklyn decide to redo their kitchen. One small room in a townhouse. They hire an architect, who draws them something plain and details it carefully before anyone lifts a hammer.

Miles: Then, with the walls open, an idea arrives. The house is a building site already, so why not do the jobs they'd been saving for later while the dust is up anyway? One job pulls in the next, and before long the whole place is torn apart.

Miles: It finishes eight times later than planned and nearly four hundred percent over budget. Two determined people, a detailed plan, one small room.

Miles: Today: How Big Things Get Done, by Bent Flyvbjerg and Dan Gardner. In two sentences: nearly every big project runs over, and most of the damage is done before anyone breaks ground, in a planning stage that got rushed so the digging could start. Plan slowly, deliver quickly, and later Nora's going to argue that plenty of neurodivergent people have worked that way all along, whenever somebody let them.

Miles: Sixty Books. Presented by Stoar Consulting and Coaching.

Miles: Book forty one. You're listening to Sixty Books, and I'm Miles. One management title an episode, sixty drawn from the best of the last hundred years, and each one put to a pair of tests: what it gives leaders and teams who think differently, and what still stands once AI sits in on the work. Nora has the research, and this one arrives with sixteen thousand projects behind it.

Miles: Nora, we closed Noise on the idea that a scattered estimate becomes a scattered budget. You owe me a bill.

Nora: I do, and the bill corrects us slightly. If cost estimates were only scattered, they'd miss high about as often as they miss low. Across this database they don't. They miss in one direction, toward too cheap, project after project. So in last episode's vocabulary, this book is mostly about bias.

Miles: Then where did the scatter go?

Nora: Out to the far end. Most projects overrun by a modest amount, and a handful overrun by sums nobody's range of guesses would ever have reached. That's chapter six.

Miles: And a returning name on the cover.

Nora: Dan Gardner, who wrote Superforecasting with Tetlock and comes back here beside an Oxford economist. Same writer, and this time a database instead of a tournament.

Miles: Give me the story the argument leans on.

Nora: Sydney, January of nineteen fifty seven. A Danish architect, Jørn Utzon, thirty eight years old, wins an international competition to design an opera house. The estimate is seven million Australian dollars, with the doors opening in January of nineteen sixty three.

Miles: And it opened when?

Nora: Nineteen seventy three. Ten years late, at a hundred and two million. In Flyvbjerg's data that's fourteen hundred percent over budget, and Guinness lists it as the largest proportional cost increase on record for a building.

Miles: How does a building get that far away from its plan?

Nora: By starting before there was a plan. The state government pushed for work to begin early, worried that funding or public opinion might turn against it, so construction began in nineteen fifty nine, before Utzon had finished the final designs. The podium went in first, and its columns turned out to be too weak to carry the roof, so they had to be rebuilt. Utzon left the project in February of nineteen sixty six, partway through, and never went back to Australia to see it finished.

Miles: And yet it's on every postcard.

Nora: Which the book concedes. Flyvbjerg's point is that the bill landed elsewhere, and he's written that the overrun and the row that followed it destroyed Utzon's career. Then the book sets it beside a museum in Bilbao, by Frank Gehry, finished on schedule and a little under budget. The difference, on the book's account, is where the thinking happened.

Miles: So the kitchen and the opera house tell one story.

Nora: One story at two sizes. Though, in fairness to the couple in Brooklyn, nobody had to dynamite any part of their kitchen.

Miles: A low bar.

Nora: Yeah. A low bar, and the opera house didn't clear it. The authors write that part of what was built in Sydney had to be blown up and done again.

Miles: The authors.

Nora: Bent Flyvbjerg is a Danish economic geographer, with a doctorate in urban geography and planning. He was a professor of planning at Aalborg, then the first BT Professor at Oxford's business school and the first to hold its chair in major programme management, a post he retired from in twenty twenty one. He now holds a professorship in Copenhagen, at the city's university for information technology, and the publisher notes a knighthood from the Queen of Denmark and advisory work on more than a hundred projects of a billion dollars or more.

Miles: And the database.

Nora: Started small. In two thousand two he and two colleagues published a study of two hundred and fifty eight transport projects, worth about ninety billion dollars, in the Journal of the American Planning Association. They concluded that the estimates used to decide whether to build were systematically misleading, and that error couldn't explain the gap. That collection has grown to more than sixteen thousand projects, in a hundred and thirty six countries.

Miles: And Gardner's part?

Nora: A former newspaper columnist and investigative journalist, now an honorary senior fellow at the University of Ottawa's public policy school. The book came out from Currency in February of twenty twenty three. An introduction, nine chapters, a coda of eleven rules of thumb, and an appendix that's nothing but base rates for cost risk, sorted by type of project.

Miles: Walk the chapters with me, in order.

Nora: The introduction is called California Dreamin', after the state's high speed rail line, which the publisher describes going from thirty three billion dollars to a hundred billion without reaching all the places it promised. Then the headline numbers, from the database. Just under forty eight percent of big projects finish on budget. Eight and a half percent finish on budget and on time. And on budget, on time and delivering the benefits promised: half of one percent.

Miles: One in two hundred.

Nora: Yeah. One in two hundred. Flyvbjerg calls it the iron law of megaprojects: over budget, over time, over and over again.

Miles: Chapter one is the title phrase.

Nora: Think slow, act fast, a deliberate turn on Kahneman's Thinking, Fast and Slow. Planning is cheap: you can try something, scrap it and try again for the price of a few hours. Delivery is expensive, and every day of it is another day for something nobody planned for to go wrong. So stretch the cheap part and squeeze the dear part. The failure mode, in the authors' image: a project that begins as an excited sprint turns into a long, desperate slog.

Miles: Then why does anyone sprint?

Nora: Chapter two, the commitment fallacy. People commit to a project before they understand it, and once delivery starts, they're locked in. The book also takes on why first numbers come in low, and it calls one cause strategic misrepresentation, a budget pitched to win approval. It quotes a former mayor of San Francisco, who wrote in a newspaper column in twenty thirteen that for civic projects the first budget is really just a down payment.

Miles: In print.

Nora: In print, under his own name. Chapter three turns the direction of planning around. Think from right to left: start at the far end, with the result you want and why you want it, and work back toward the means. That's the kitchen's lesson. The authors argue that asking what the project was for, at the very start, would have surfaced the couple's goals before the walls came down.

Miles: And Pixar gets a chapter.

Nora: Pixar Planning. A film there goes through outlines, scripts and storyboards, again and again, with screenings and notes in between, and the book says the average film is storyboarded about eight times before the expensive animation starts. Gehry does the same thing for buildings with detailed digital models, so the arguments happen on a screen instead of on a site. Iterate where mistakes cost little.

Miles: Chapter five.

Nora: Experience, which the book thinks gets badly undervalued. The Empire State Building is its showcase. Construction began in March of nineteen thirty and the building opened on the first of May, nineteen thirty one, about four hundred and ten days. It came in at just under forty one million dollars against a fifty million budget. The authors credit seasoned builders, proven designs and technology that had already done the job elsewhere.

Miles: And chapter six is your far end.

Nora: It is. So You Think Your Project Is Unique? The answer's no. Your project is one of those, a member of a class, and the class has a record. That's reference class forecasting, an idea from Kahneman and Tversky that Flyvbjerg turned into a method. Instead of building your estimate up from your own plan, you start with the recorded outcomes of comparable projects and adjust from there.

Miles: Why would my own plan be worse than strangers' results?

Nora: Because of a study I'd show anyone who manages a calendar. Buehler, Griffin and Ross, Journal of Personality and Social Psychology, nineteen ninety four. Thirty seven psychology honours students estimated when they'd finish their theses. On average they said about thirty four days. It took about fifty five, and only about three in ten finished by their own date. They were also asked for a date if everything went as badly as it possibly could. That averaged about forty nine days.

Miles: So even the worst case was too hopeful.

Nora: By about a week, on average.

Miles: Huh.

Nora: And then the far end, which is the noise from our callback. The book argues that many kinds of project don't overrun on a bell curve, they overrun on a fat tail. Flyvbjerg and colleagues, Journal of Management Information Systems, twenty twenty two, looked at five thousand three hundred and ninety two information technology projects and found the overruns followed a power law: lots of small misses and a long tail of enormous ones. A review in the Wall Street Journal gives the book's figure as eighteen percent of those projects running more than fifty percent over.

Miles: So the average hides the disaster.

Nora: It hides the ones that sink you. Chapter seven asks whether ignorance can be your friend, and I'm saving it for the evidence. Chapter eight is the team: Heathrow's Terminal Five, which the authors say came in on budget and on time because contracts didn't reward blaming the other firm, the workers were listened to, and people could speak up. And chapter nine is the one I'd hand a manager first. What's your Lego?

Miles: Meaning?

Nora: Modularity. Find the small unit you can repeat, and build by repeating it, so the project learns as it goes. The base rates in the appendix make the case on their own. Average cost overrun for solar power, about one percent. Transmission lines, eight. Wind, thirteen. Fossil fuel plants, sixteen. Hydroelectric dams, seventy five. Nuclear power, a hundred and twenty. The more a project is made of one repeatable piece, the less it tends to run over.

Miles: And the eleven rules?

Nora: Hire a masterbuilder, ask why, build with Lego, say no and walk away, among others. And the hardest of its principles to hear: your biggest risk is you.

Miles: Now the evidence check, and you've got two arguments for me.

Nora: Two exchanges, both in journals, and I'll give each side's reading of the record and stop there. The first is about the database itself. In twenty eighteen, Peter Love and Dominic Ahiaga-Dagbui published a critique of that two thousand two paper in Transportation Research Part A. They argued that framing underestimation as either error or lie is a false choice that doesn't fit how infrastructure is bought, and, as the reply to them quotes it, that ideally the data should be made publicly available so the results can be evaluated and reproduced.

Miles: And the reply?

Nora: Later that year, in the same journal: Flyvbjerg and thirteen co-authors, a paper called Five Things You Should Know About Cost Overrun. They argued their critics had measured from the wrong starting point. If you're studying contractors, you measure from the contract. If you're studying decisions, you measure from the budget at the moment of deciding to build, which is what they'd done. They also argued that overrun is fat tailed and rooted in behavioural bias. On the data, they wrote that in practice sources often insist on non disclosure agreements as a condition of letting researchers study their projects.

Miles: So it can't be opened.

Nora: Not all of it, on their account. There was a second round in twenty nineteen: a further critique from Love, Ika and Ahiaga-Dagbui, and a reply from Flyvbjerg's group arguing that the critique contained serious statistical errors. And in twenty twenty four an economist, Timo Valila, in the Journal of Benefit-Cost Analysis, called it the most extensive database of its kind and not openly accessible, and argued that large forecast errors in it don't necessarily mean a project lost society money.

Miles: Where does that leave the base rates?

Nora: Published, in peer reviewed papers by Flyvbjerg's teams, with their methods described. Not yet rerun by outsiders on the same projects, because outsiders can't get all of them. Both of those are true, and neither is a charge against anyone.

Miles: And the second exchange.

Nora: That's chapter seven. In nineteen sixty seven the economist Albert Hirschman proposed the Hiding Hand: we take on hard projects because we underestimate the difficulty, and then human ingenuity rises to meet the problems, so ignorance turns out to be a friend. He drew it from a study of eleven development projects. In twenty sixteen, in World Development, Flyvbjerg tested it on two thousand and sixty two projects and found the Hiding Hand's pattern in about one in five, and the opposite pattern, the planning fallacy, about four times as common. He and Cass Sunstein, from last episode's book, also wrote a paper naming the reverse case, the Malevolent Hiding Hand.

Miles: And who pushed back?

Nora: Lavagnon Ika, same journal, twenty eighteen. He called the test a straw man, argued that a project can fail on budget and still succeed overall, and in a hundred and sixty one World Bank projects found the Hiding Hand more common. Flyvbjerg replied in the same volume that Ika's data were supervisors' recalled ratings on a seven point scale rather than measured costs and benefits, and that his cut point leaned toward finding success. The book takes Flyvbjerg's side. A reader should know a published dissent exists.

Miles: Anything from outside that supports him?

Nora: On the method, yes. Batselier and Vanhoucke, Project Management Journal, twenty sixteen, two researchers outside Flyvbjerg's group, compared reference class forecasting with Monte Carlo simulation and with earned value methods on real project data, and it gave the best forecasts of both cost and time.

Miles: Tier statement.

Nora: How Big Things Get Done is practitioner literature, a book for general readers rather than peer reviewed research. Underneath it sits a larger body of peer reviewed work than most books on this shelf can point to, much of it by the lead author, built on a database outsiders can't fully inspect. Trust the direction, that projects lean toward over and that a few blow up enormously, and treat the precise percentages as the best published estimates rather than settled counts. None of that is a verdict on the people on either side of the argument.

Miles: Our half.

Nora: And here's the claim, which is an argument rather than a finding. Think slow, act fast describes how a lot of neurodivergent people already work, when the setting allows it. A long lead-in that can look from outside like nothing's happening, then a short, intense stretch where most of it gets done. Workplaces usually ask for the reverse: start at once, show steady progress, and keep that up for months. That's the excited sprint into the slog.

Miles: Evidence for the intense stretch?

Nora: Some. Hupfeld, Abagis and Shah, in a journal on attention deficit and hyperactivity disorders, twenty nineteen. A questionnaire built for the study, a preregistered hypothesis, a pilot sample of two hundred and fifty one adults and a replication sample of three hundred and seventy two, with and without ADHD. People with more ADHD symptoms reported more hyperfocus, long stretches of highly concentrated attention, across schoolwork, hobbies and screens. Self report, and a symptom scale rather than diagnoses.

Miles: And autism?

Nora: Two interview studies, so these are accounts, not measurements. Rapaport and colleagues, Autism in Adulthood, twenty twenty four, spoke with twenty four autistic adults about starting and stopping tasks. Their accounts of being immersed matched what researchers call flow and hyperfocus, and they described how hard it could be to balance that absorption with the rest of life. Russell and colleagues, in the same journal in twenty nineteen, ran twenty eight interviews with autistic adults, and hyperfocus was among the strengths they described most often. Their participants were clear that the same trait helped or hurt depending on the setting.

Miles: Which is where your point about being allowed comes in.

Nora: It is. A deep focus with no runway to start it and no clear moment to stop is a liability. Given a long, cheap period to explore and then a short, bounded window to deliver, it starts to look like the book's best practice.

Miles: And the slow half?

Nora: That's where the outside view comes in, and I'd call it an accommodation nobody labels as one. Marx and colleagues, Journal of the American Academy of Child and Adolescent Psychiatry, twenty twenty one, pooled fifty five studies of timing tasks and found people with ADHD less accurate and more variable at judging durations. Those are lab tasks of milliseconds to seconds, not months, so the stretch to project estimates is mine. But a reference class takes the estimate out of anyone's head and puts it on a table of what happened last time. A base rate lets you plan without trusting your own feel for duration.

Miles: Cautions.

Nora: Two. First, nobody has tested Flyvbjerg's method with neurodivergent planners or teams as the outcome. I've joined a book about megaprojects to studies of attention, mostly self report and interviews, and the join is mine.

Miles: And the second.

Nora: Slow in this book doesn't mean waiting. It means active, cheap iteration, the Pixar loop, with drafts and feedback. A long runway with nothing on it is just a delay, and Rapaport's interviews came out of a study of autistic inertia, difficulty starting and stopping tasks. So the slow phase needs visible small loops, and the fast phase needs a fixed edge, an end date, so an intense stretch doesn't run on until it costs the person doing it.

Miles: Fair enough.

Miles: Sixty seconds, read our way. How Big Things Get Done says nearly every big project runs over, that the overruns lean one way and sometimes run to catastrophe, and that the cure is slow, cheap planning followed by short, fast delivery. For anybody leading a mind that works on its own timetable, or working inside one, here's Monday. Before anyone commits, write down why the project exists and what finished looks like, and plan backwards from there. Make the planning a loop of rough drafts and feedback rather than one long document. Estimate from what comparable projects took, not from how long the work feels like it'll take. Then compress delivery into a bounded window with a date at the end of it. And if somebody on your team does their thinking slowly and their finishing fast, judge them on what landed, not on how busy the first weeks looked.

Miles: Now the tools.

Nora: The standing caution on these tools comes at the very end, unchanged, so this time goes to what Flyvbjerg's book suggests.

Miles: Go on.

Nora: The book's whole logic is that planning should be cheap enough to repeat. These tools make a rough draft nearly free, so use them for the loop. Ask for three different versions of the plan, then a critique of each, and run that several times before anyone signs anything. That's the Pixar process on a smaller budget.

Miles: And right to left?

Nora: Have it question you before it writes anything. What's this for, who benefits, what would make it a success a year out. Then draft the announcement of the finished result, and plan back from that page. For the reference class, ask it to list comparable projects and what happened to them, and then check every one against a source you can open, because a base rate nobody can trace is a guess with a decimal point. And for Lego, ask it to break the delivery into the smallest unit you could repeat.

Miles: And the line to close on.

Nora: Spend the machine on the slow half. Every loop it makes cheaper is a loop you can afford before the digging starts, and the book's argument is that this is where projects are won or lost.

Miles: That's How Big Things Get Done.

Miles: Next time: Cal Newport's Deep Work, from twenty sixteen. Six books on deciding when you can't know, and every one of them assumes you've got the attention to do the planning. So we turn to the attention itself, and to who gets to have it.

Nora: Which is the resource this whole stretch spent without counting.

Miles: You brought the receipts on this one, Nora. Thank you.

Nora: Worth every minute.

Miles: On to the next.

Miles: This has been Sixty Books, a production of Stoar Consulting and Coaching. Logan Williamson is a Licensed Professional Counselor in Texas and Louisiana. You heard one book read for the people who run teams and the people who work on them. It wasn't coaching, it wasn't counseling, and it wasn't a word about you.

Nora: The sources behind every claim, and the transcript, are on the episode page. The next book is two days out.

Miles: Two things before you go. The pair of voices you heard are synthetic: there's no Miles and no Nora, neither holds a licence, and nothing said here was about whoever's listening. Scripts are drafted with AI assistance and then edited and approved by Logan Williamson, a Licensed Professional Counselor in Texas and Louisiana, at Stoar Consulting and Coaching.

Nora: And one note about the AI segment. The evidence that these tools help neurodivergent people at work is early. There are controlled trials now, but they measure things like conversation skill rather than how a job actually goes, and for work itself most of what exists is individual providers reporting success. So take it as promising and not proven. The tools also get rebuilt every few months, so whatever you set up today is built on something that moves.

Sources

Every claim in the episode, in the order it comes up, with where it comes from. 30 claims. Studies in psychology and medicine were checked on PubMed; everything else against the publisher, the paper or the original record.

See the sources
  1. Title, subtitle, authors, publisher, date and structure.

    Flyvbjerg, B., & Gardner, D. (2023). How Big Things Get Done: The Surprising Factors That Determine the Fate of Every Project, from Home Renovations to Space Exploration and Everything In Between. New York: Currency (Penguin Random House). ISBN 9780593239513 (hardcover). On sale 7 February 2023.

    Publisher's page, Penguin Random House, https://www.penguinrandomhouse.com/books/672118/how-big-things-get-done-by-bent-flyvbjerg-and-dan-gardner/ , giving the subtitle with this capitalization ("Everything In Between"), the on-sale date of 7 February 2023 and the imprint.

    Library catalogue records (Harrison Public Library, https://catalog.harrisonpl.org/Record/5268808 ; CLEVNET, https://search.clevnet.org/GroupedWork/b226df78-967e-6e58-ed6a-7b528c9a930e-eng/Home ; Waubonsee Community College, https://link.library.waubonsee.edu/resource/ow9d8jUWsHk ) giving Currency, New York, first edition, xvi + 284 pages, and the table of contents: Introduction: California Dreamin'; 1 Think Slow, Act Fast; 2 The Commitment Fallacy; 3 Think from Right to Left; 4 Pixar Planning; 5 Are You Experienced?; 6 So You Think Your Project Is Unique?; 7 Can Ignorance Be Your Friend?; 8 A Single, Determined Organism; 9 What's Your Lego?; Coda: Eleven Heuristics for Better Project Leadership; Appendix A: Base Rates for Cost Risk; Appendix B: Further Readings by Bent Flyvbjerg.

  2. A couple in Brooklyn renovating a small kitchen in their townhouse hired an architect who produced a plain design with carefully detailed plans; once work began they decided to do future jobs at the same time, the project grew until the whole home was torn up, and it took eight times longer than planned and ran almost 400 percent over budget.

    Flyvbjerg, B., & Gardner, D. (2023, 16 February). "'What's my Lego?': what the world's most successful big projects have in common." Pan Macmillan, https://www.panmacmillan.com/blogs/general/the-worlds-most-successful-big-projects . The authors' own article: David and Deborah, owners of a Brooklyn townhouse, renovating a small kitchen; an architect who produced a plain design with carefully detailed plans; the project took "eight times longer to finish than it was supposed to" and went "almost 400% over budget."

    Flyvbjerg, B., & Gardner, D. (2023, 23 March). "How Big Things Get Done" (Book Bite, five key insights). Next Big Idea Club, https://nextbigideaclub.com/magazine/big-things-get-done-surprising-factors-determine-fate-every-project-home-renovations-space-exploration-everything-bookbite/40952/ . The authors' own summary: "When David and Deborah decided they wanted to renovate their kitchen, they knew projects could go wrong"; they "then thought if the project is already disrupting their lives, why not do that future work now?"; the job grew until the whole apartment was torn up.

  3. The book's two-sentence gist: nearly every big project runs over, the damage is mostly done in a rushed planning stage, and the rule is plan slowly and deliver quickly.

    Jody W. Lipford, review of How Big Things Get Done, The Independent Review, 28(2), Fall 2023, https://independent.org/publications/tir/article.asp?a=1900 , summarizing that projects usually go bad because of poor planning, not during delivery, and that the summary rule is "think slow, act fast."

  4. The database holds more than sixteen thousand projects.

    Lipford (2023), item 2: "more than 16,000 big projects." Gearino, D. (2023, 2 February), "What Lego - Yes, Lego - Can Teach Us About Avoiding Energy Project Boondoggles," Inside Climate News, https://insideclimatenews.org/news/02022023/inside-clean-energy-lego-building/ : "Flyvbjerg's database of about 16,000 projects in 136 countries over several decades."

  5. Cost estimates in the database miss mostly in one direction, too low, so overrun is a matter of bias more than scatter; most projects overrun modestly and a few overrun enormously (fat tails).

    Flyvbjerg, B. (2014). "What You Should Know About Megaprojects and Why: An Overview." Project Management Journal, 45(2), 6-19. DOI: 10.1002/pmj.21409. arXiv: 1409.0003. States the "iron law of megaprojects": "Over budget, over time, over and over again."

    Flyvbjerg, B., Ansar, A., Budzier, A., et al. (2018). "Five things you should know about cost overrun." Transportation Research Part A, 118, 174-190. DOI: 10.1016/j.tra.2018.07.013. Argues overrun is systematically biased and fat-tailed rather than the product of random error (see items 26 and 27).

    Flyvbjerg, B., Holm, M. K. S., & Buhl, S. L. (2002), item 9, for the original finding that cost estimates were "highly and systematically misleading."

  6. Jørn Utzon, a Danish architect aged 38, won the international competition for the Sydney Opera House, announced in January 1957. The 1957 estimate was 7 million Australian dollars (3.5 million pounds), with completion on 26 January 1963. It was completed in 1973 at a cost of 102 million dollars.

    Sydney Opera House, Wikipedia, https://en.wikipedia.org/wiki/Sydney_Opera_House : winner "announced in Sydney on 29 January 1957"; "The original cost and scheduling estimates in 1957 projected a cost of £3,500,000 ($7 million)" with completion on 26 January 1963; "formally completed in 1973, having cost $102 million."

    Flyvbjerg (2014), item 4: "Utzon was 38 when he won the competition for the Opera House."

  7. In Flyvbjerg's data the Sydney Opera House ran 1,400 percent over budget; Guinness World Records lists it as the largest proportional cost increase for a building project.

    Flyvbjerg (2014), item 4: "The Sydney Opera House, 1,400 percent," and Table 2.

    Guinness World Records, "Largest proportional increase in cost for a building project," https://www.guinnessworldrecords.com/world-records/382062-largest-proportional-increase-in-cost-for-a-building-project : initial estimate AUS $7 million, final cost AUS $102 million, "more than 14 times the first estimate."

  8. Flyvbjerg has written that the overrun and the controversy that followed destroyed Utzon's career; the book sets Sydney beside the Guggenheim Bilbao by Frank Gehry, completed on schedule and a little under budget.

    Flyvbjerg (2014), item 4: "Because the overrun on the Opera House and the following controversy destroyed Utzon's career," and "This is the real regret - and real cost - of the Sydney Opera House." Also that "Australians do not regret the Sydney Opera House" (the concession; that sentence was cut for runtime).

    Will Larson, "Notes on How Big Things Get Done," https://lethain.com/notes-on-how-big-things-get-done/ , reading notes recording that the "think slow, act fast" chapter contrasts the Sydney Opera House, which changed plans often and suffered massive delays, with Bilbao, delivered early and under budget.

  9. Bent Flyvbjerg is a Danish economic geographer with a doctorate in urban geography and planning; he was a professor of planning at Aalborg University; he was the first BT Professor and inaugural chair of major programme management at Oxford's Saïd Business School, retiring from the post in 2021; he holds a professorship at the IT University of Copenhagen.

    Bent Flyvbjerg, Wikipedia, https://en.wikipedia.org/wiki/Bent_Flyvbjerg : PhD in urban geography and planning, Aarhus University (parts done at UCLA); professor of planning at Aalborg; first BT Professor and inaugural chair of major programme management at the University of Oxford's Saïd Business School, retired from the post in 2021; Villum Kann Rasmussen Professor and chair of major program management at the IT University of Copenhagen.

  10. In 2002 Flyvbjerg and two colleagues published a study of 258 transport infrastructure projects worth about 90 billion dollars in the Journal of the American Planning Association, concluding that the cost estimates used to decide whether to build were systematically misleading and that error could not explain the underestimation.

    Flyvbjerg, B., Holm, M. K. S., & Buhl, S. L. (2002). "Underestimating Costs in Public Works Projects: Error or Lie?" Journal of the American Planning Association, 68(3), 279-295. DOI: 10.1080/01944360208976273. arXiv: 1303.6604.

  11. Of the big projects in the database, 47.9 percent finish on budget, 8.5 percent on budget and on time, and 0.5 percent on budget, on time and with the expected benefits (one in two hundred).

    Lipford (2023), item 2, and Marc Levinson, "'How Big Things Get Done' Review: Staying on Track," The Wall Street Journal, 6 February 2023 (print 7 February), https://marclevinson.net/HowBigThingsGetDone020723.pdf : "Only one in 200" completed on time, on budget and with promised benefits.

  12. Flyvbjerg calls this the iron law of megaprojects: over budget, over time, over and over again.

    Flyvbjerg (2014), item 4, abstract and text: "the 'iron law of megaprojects': Over budget, over time, over and over again."

  13. "Think slow, act fast" adapts the title of Kahneman's Thinking, Fast and Slow; planning is cheap and allows iteration, delivery is expensive and every moment of it is exposure to things going wrong.

    Hole, J., & Flyvbjerg, B. (2023, 8 June). "Think slow to ensure your project succeeds." Sydney Business Insights, University of Sydney Business School, https://sbi.sydney.edu.au/think-slow-to-ensure-your-project-succeeds/ : Flyvbjerg adapts the title of Kahneman's Thinking, Fast and Slow; a fast production schedule "closes the window during which things can go wrong."

  14. Chapter two, the commitment fallacy: committing before understanding, and lock-in once delivery starts. The book names strategic misrepresentation, a budget pitched to win approval, as one cause of low first estimates.

    Lipford (2023), item 2: "strategic misrepresentation" described as submitting politically acceptable budgets rather than realistic ones.

  15. The book quotes a former mayor of San Francisco who wrote, in a 2013 newspaper column, that in the world of civic projects the first budget is really just a down payment.

    "A Bay Bridge Fit for Willie Brown," Next City, https://nextcity.org/urbanist-news/a-bay-bridge-fit-for-willie-brown , confirming the sentence appeared in Willie Brown's San Francisco Chronicle column in July 2013, written after news that the Transbay Terminal was about $300 million over budget.

  16. Chapter five, experience: the Empire State Building. Construction began 17 March 1930 and the building opened 1 May 1931, about 410 days; it cost about 41 million dollars ($40,948,900) against a 50 million dollar budget. The authors credit experienced people and firms, proven designs and technology that had already done the job.

    Empire State Building, Wikipedia, https://en.wikipedia.org/wiki/Empire_State_Building : construction began March 17, 1930; officially opened May 1, 1931; 410 days; cost $40,948,900 against a planned budget of $50 million.

  17. Chapter six: your project is "one of those"; reference class forecasting, an idea from Kahneman and Tversky that Flyvbjerg developed into a practical method, starts from the recorded outcomes of comparable projects.

    Flyvbjerg, B. (2006). "From Nobel Prize to Project Management: Getting Risks Right." Project Management Journal, 37(3), 5-15. arXiv: 1302.3642. Sets out reference class forecasting as a practical method derived from Kahneman and Tversky's work on the planning fallacy and the outside view.

    Reference class forecasting, Wikipedia, https://en.wikipedia.org/wiki/Reference_class_forecasting : the theory developed by Kahneman and Tversky; Flyvbjerg and COWI (2004) turned it into a practical method.

    Buehler, R., Griffin, D., & Ross, M. (1994). "Exploring the 'planning fallacy': Why people underestimate their task completion times." Journal of Personality and Social Psychology, 67(3), 366-381. DOI: 10.1037/0022-3514.67.3.366. Full text consulted at https://bear.warrington.ufl.edu/brenner/mar7588/Papers/buehler-et-al-1994.pdf . Not indexed in PubMed (searched 2026-10-07).

  18. Many kinds of project overrun on a fat tail rather than a bell curve; Flyvbjerg and colleagues (2022) found that cost overruns across 5,392 IT projects follow a power law, with many small overruns and a fat tail of extreme ones; the book's figure, as reported by the Wall Street Journal's reviewer, is that 18 percent of IT projects run more than 50 percent over.

    Flyvbjerg, B., Budzier, A., Lee, J. S., Keil, M., Lunn, D., & Bester, D. W. (2022). "The Empirical Reality of IT Project Cost Overruns: Discovering a Power-Law Distribution." Journal of Management Information Systems, 39(3), 607-639. arXiv: 2210.01573. Journal page: https://jmis-web.org/articles/1579 . An analysis of 5,392 IT projects finding that cost overruns follow a power-law distribution, with interdependence among components tested by simulation as a possible cause.

  19. Chapter nine, What's your Lego?: modularity. Mean cost overruns from the database: solar about 1 percent, transmission lines about 8, wind about 13, fossil fuel plants about 16, hydroelectric dams about 75, nuclear power about 120.

    Gearino (2023), item 3: average cost overruns for completed projects of nuclear about 120 percent, hydroelectric dams about 75, fossil fuel plants about 16, wind about 13, transmission lines about 8, solar about 1, from Flyvbjerg's database; Flyvbjerg uses Lego as the analogy for modularity.

    Lipford (2023), item 2: solar and wind farms highly modular and low-risk; nuclear plants and the Olympic Games least modular and highest-risk.

  20. The coda's eleven heuristics include hire a masterbuilder, ask "why?", build with Lego, and say no and walk away; among the book's principles is "your biggest risk is you."

    Kiron Bondale, "Applying the heuristics of How Big Things Get Done to adaptive delivery," ProjectManagement.com, 8 May 2023, https://www.projectmanagement.com/blog-post/74654/ , naming six of the eleven: hire a masterbuilder; get your team right; ask "why?"; build with Lego; think slow, act fast; say no and walk away.

  21. In 2018 Peter Love and Dominic Ahiaga-Dagbui published a critique of Flyvbjerg, Holm and Buhl (2002) in Transportation Research Part A, arguing that framing underestimation as error or lie is a false dichotomy that does not reflect how infrastructure is procured, and (as quoted in the reply) that ideally data should be made publicly available to allow evaluation and reproduction of the results.

    Love, P. E. D., & Ahiaga-Dagbui, D. D. (2018). "Debunking fake news in a post-truth era: The plausible untruths of cost underestimation in transport infrastructure projects." Transportation Research Part A: Policy and Practice, 113, 357-368. DOI: 10.1016/j.tra.2018.04.019. Abstract via IDEAS/RePEc, https://ideas.repec.org/a/eee/transa/v113y2018icp357-368.html , and Deakin University repository.

  22. A second round in 2019: Love, Ika and Ahiaga-Dagbui published a further critique, and Flyvbjerg's group replied that it contained serious statistical errors.

    Love, P. E. D., Ika, L. A., & Ahiaga-Dagbui, D. D. (2019). "On de-bunking 'fake news' in a post truth era: Why does the Planning Fallacy explanation for cost overruns fall short?" Transportation Research Part A, 126, 397-408. DOI: 10.1016/j.tra.2019.06.013.

  23. In 2024 Timo Välilä, in the Journal of Benefit-Cost Analysis, described the Flyvbjerg database as the most extensive of its kind but not openly accessible, and found that its large forecast errors do not necessarily imply welfare losses.

    Välilä, T. (2024). "Forecast Errors and Welfare Conclusions Based on the Flyvbjerg Database." Journal of Benefit-Cost Analysis, 15(3), 440-455. DOI: 10.1017/bca.2024.29. https://www.cambridge.org/core/journals/journal-of-benefit-cost-analysis/article/forecast-errors-and-welfare-conclusions-based-on-the-flyvbjerg-database/CD5C908A759C39C9B2A3F7CA30FDD24E

  24. Albert Hirschman proposed the Hiding Hand in 1967 (Development Projects Observed and "The Principle of the Hiding Hand"), drawing on eleven development projects: underestimating difficulty leads people to take on projects, and unforeseen creativity then rescues them.

    Hiding hand principle, Wikipedia, https://en.wikipedia.org/wiki/Hiding_hand_principle : Hirschman coined the term in Development Projects Observed (Brookings, 1967) and "The Principle of the Hiding Hand" (The Public Interest, Winter 1967).

    Flyvbjerg, B., & Sunstein, C. R. (2016). "The Principle of the Malevolent Hiding Hand; or, the Planning Fallacy Writ Large." Social Research, 83, 979 (start page as recorded by Harvard Law School; issue and end page not confirmed). arXiv: 1509.01526. Harvard Law School bibliography record: 83 Soc. Res. 979 (2016). Abstract: Hirschman argued optimistic planners benefit from unforeseen ingenuity; the authors' larger sample than "Hirschman's eleven projects" finds the malevolent pattern common and the benevolent one rare.

  25. Flyvbjerg (2016), World Development: a test of the Hiding Hand on 2,062 projects found it in about one in five; the planning fallacy was about four times as prevalent.

    Flyvbjerg, B. (2016). "The Fallacy of Beneficial Ignorance: A Test of Hirschman's Hiding Hand." World Development, 84, 176-189. DOI: 10.1016/j.worlddev.2016.03.012. Abstract via IDEAS: the Hiding Hand is rejected at p<0.0001; projects on average show both cost overruns and benefit shortfalls.

    Flyvbjerg, B. (2018). "Planning Fallacy or Hiding Hand: Which Is the Better Explanation?" World Development, 103, 383-386. arXiv: 1802.09999. Gives the 2016 sample as 2,062 projects, the Hiding Hand in about one fifth of projects, and the planning fallacy about four times more prevalent.

  26. Lavagnon Ika (2018), World Development, called the test a straw man, argued the Hiding Hand applies to projects that fail on management terms but succeed overall, and in 161 World Bank projects found the Hiding Hand prevailing. Flyvbjerg replied in the same volume that Ika's data were supervisors' recalled ratings on a seven-point scale rather than measured costs and benefits, and that splitting the scale at 1-3 failure, 4-7 success biased the results toward success.

    Ika, L. A. (2018). "Beneficial or Detrimental Ignorance: The Straw Man Fallacy of Flyvbjerg's Test of Hirschman's Hiding Hand." World Development, 103, 369-382. DOI: 10.1016/j.worlddev.2017.10.016.

    Flyvbjerg (2018), item 39.

  27. Batselier and Vanhoucke (2016), Project Management Journal, compared reference class forecasting with Monte Carlo simulation and earned value management methods on real-life project data and found it performed best for both cost and time forecasting.

    Batselier, J., & Vanhoucke, M. (2016). "Practical Application and Empirical Evaluation of Reference Class Forecasting for Project Management." Project Management Journal, 47(5), 36-51. PMI library record, https://www.pmi.org/learning/library/practical-application-empirical-evaluation-rcf-10277 ; Vlerick repository, https://repository.vlerick.com/handle/20.500.12127/5710 .

  28. Hupfeld, Abagis and Shah (2019): a new Adult Hyperfocus Questionnaire and a preregistered hypothesis, tested in a pilot sample of 251 and a replication sample of 372 adults with or without ADHD; those with higher ADHD symptomology reported more hyperfocus overall and across school, hobbies and screen time.

    Hupfeld, K. E., Abagis, T. R., & Shah, P. (2019). "Living 'in the zone': hyperfocus in adult ADHD." Attention Deficit and Hyperactivity Disorders, 11(2), 191-208. PMID: 30267329. DOI: 10.1007/s12402-018-0272-y. (Published online September 2018; issue 2019.)

  29. Rapaport et al. (2024): semi-structured interviews with 24 autistic adults about starting and stopping tasks, within a broader study of autistic inertia; accounts of task immersion matched flow, hyperfocus and monotropism; participants described difficulty finding the balance between immersion and the rest of life.

    Rapaport, H., Clapham, H., Adams, J., Lawson, W., Porayska-Pomsta, K., & Pellicano, E. (2024). "'In a State of Flow': A Qualitative Examination of Autistic Adults' Phenomenological Experiences of Task Immersion." Autism in Adulthood, 6(3), 362-373. PMID: 39371355. PMC: PMC11447391. DOI: 10.1089/aut.2023.0032.

  30. Russell et al. (2019): 28 semi-structured interviews with autistic adults; the ability to hyperfocus was among the most frequently described strengths; traits were experienced as advantageous or disadvantageous depending on context.

    Russell, G., Kapp, S. K., Elliott, D., Elphick, C., Gwernan-Jones, R., & Owens, C. (2019). "Mapping the Autistic Advantage from the Accounts of Adults Diagnosed with Autism: A Qualitative Study." Autism in Adulthood, 1(2), 124-133. PMID: 31058260. PMC: PMC6493410. DOI: 10.1089/aut.2018.0035.

All Sixty Books episodes · Subscribe by RSS