The AI Reader.
When AI Breaks

Zillow writes down the houses its model told it to buy

Its iBuying arm, Zillow Offers, paid an automated model's price for thousands of houses, then shut down in November 2021 once those houses were worth less than Zillow had paid.

Why this matters

A public company decided to buy thousands of real houses at prices a computer model produced, one at a time, with its own money. Then, in the space of a single announcement, it stopped, wrote the houses down by hundreds of millions of dollars, and let go about a quarter of its people. Stated plainly, the decision is hard to defend, and that is what makes it worth understanding. Zillow's model was good enough to launch a real business on. It lost money anyway, once it was the thing doing the buying. This lesson works through why: what an automated model actually promised, how the houses came to be worth less than Zillow paid, and why the loss stayed invisible until it arrived all at once. The same weakness sits inside any system that sets a price today and collects the money later, which by now is most of them.

Background optional reading
01
Move a tumor detector to a new hospital and it loses twenty-three points — what happens when a model trained on one distribution is run on another.
02
Byrne Hobart, "Book Value and Mark-to-Market" — why an asset's value on the books and its value in the market are two different numbers.

The bet inside every offer

Zillow Offers was a trader in houses. It ran an iBuying business, meaning it bought homes directly from sellers at a price the company itself set, made light repairs, and resold them.1 It set that price with an automated valuation model, software that estimates what a house is worth from its features and recent nearby sales. The model did not only estimate today's value. It forecast what the house would sell for months later, after Zillow had bought and fixed it, and Zillow offered a number below that forecast so the resale would clear a margin.

Every offer was therefore a bet. Zillow quoted a price, bought the asset, and tried to sell it higher. A seller reads that offer as a price. It was a position: Zillow now owned a house it believed was worth more than it had paid, and the belief would be settled only when a buyer turned up. On November 2, 2021, Zillow said the bet had gone wrong and it was closing the business, cutting its workforce by about 25%.1 The chief executive, Rich Barton, gave a one-sentence reason: "the unpredictability in forecasting home prices far exceeds what we anticipated."1

The homes were worth less than Zillow paid

The model priced homes above what they would later sell for. Zillow said so directly: it had been "purchasing homes at higher prices than our current estimates of future selling prices."2 In the third quarter of 2021 it wrote down the value of the homes it still owned by $304 million.1 A write-down is an admission on the books that an asset is worth less than its recorded cost. Zillow ended that quarter holding 9,790 houses in inventory and another 8,172 under contract to buy, roughly eighteen thousand homes it was on the hook for.2

This was not a rounding error against the quarter. The Homes segment lost $421.6 million before taxes in the three months,1 and the whole company, profitable in its other segments, still posted a $339 million net loss.3 The clearest picture of the model going wrong is in the per-home economics: the profit Zillow expected on a typical home swung about 1,200 basis points, twelve percentage points, from a gain in the second quarter to an expected loss of 500 to 700 basis points by the fourth.2

The losses kept coming as the book unwound. Zillow guided to a further $240 million to $265 million of losses in the fourth quarter, on homes it had already agreed to buy.1 By the time the program was fully wound down, the Homes segment had lost $881 million before taxes for 2021, and the company overall lost about $528 million.4 Those are three different numbers, and coverage often blurs them. The $304 million was the third-quarter write-down. The $240-to-265 million was the next quarter's expected loss. The $881 million is the full-year segment loss, a broader figure that includes operating costs, not only the markdown.

The market repriced Zillow the same day. Its shares fell about 11.5% on November 2 and another 6.4% after hours, by press accounts.5 Zillow itself disclosed only the "approximately 25%" workforce cut; outside estimates of the headcount ranged from about 1,600 to 2,000 people, depending on which base the outlet used.5

The loss stayed hidden until the marking

A house on Zillow's books had two values. One was what Zillow paid for it, the number recorded at purchase. The other was what a buyer would actually pay, which nobody knew until the house sold. While a home sat in inventory it was carried at cost, so a house Zillow had overpaid for looked, on the balance sheet, exactly like a good buy. The loss existed the moment the model overpaid. It simply was not visible yet.

It became visible when Zillow marked the homes to what they would fetch, writing inventory down to the "lower of cost and net realizable value," the accounting rule that forces an asset held for sale down to its expected sale price.3 That is why $304 million landed at once rather than trickling in over the sales. And the position was large and slow to exit. Zillow's home inventory on the balance sheet had grown to $3.76 billion by the end of September 2021, up from $491 million a year earlier.3 A trader holding a mispriced stock can sell it in seconds. Zillow held billions of dollars of mispriced houses, each of which had to be listed, shown, and closed one at a time, over months. The size of the book set the size of the loss, and the illiquidity of houses set how long it would take to climb out.

The forecast could not keep pace

The model was fit to one stretch of the housing market and run into a different one. A forecast learned from how prices had moved through 2020 and early 2021 was used to price homes as the market's pace changed underneath it. That gap between the world a model learned and the world it runs in is distribution shift, the same failure a tumor detector shows when it is moved to a hospital it never trained on. Barton described it without the term: the unpredictability of prices "far exceeds what we anticipated."1 The model's error was not a bug. It computed exactly what it was built to compute; the prices it had learned from stopped describing the prices it now faced.

Two things made the gap worse. The first is that the model was imperfect even in calm conditions. Zillow's own Zestimate, the public valuation behind its offers, carried a median error of 7.26% on off-market homes, the kind Zillow was buying, against 2.65% for homes already listed.6 On a typical American home, 7.26% is tens of thousands of dollars in either direction, before the market moves at all. Zillow's own annual filing called Zillow Offers "an unproven business model that relies on our ability to accurately value homes and manage inventory."6

The second is the choice to win volume. Zillow did not only misread the market; it raised its offers to buy more houses. The independent real-estate analyst Mike DelPrete found that Zillow's buy-to-list premium went negative, meaning it was paying more to acquire homes than it later listed them for, while its competitor Opendoor, buying through the same cooling market, kept that premium positive.7 Opendoor priced through the same forces without the same losses, which shows the failure was Zillow's pricing, not iBuying as a category. As DelPrete put it, Zillow "didn't see those brake lights" as the market slowed.7

There is a deeper reason a valuation model overpays as it scales. Economists writing up work at Stanford point to adverse selection. When Zillow bid at or above its model's estimate for ordinary homes, the sellers most willing to accept were the ones whose houses were worth less than the model thought, the lemons the model could not see. "There are a lot of features and attributes of a home that the model doesn't capture," the Stanford account notes, and Zillow "started bidding more for cookie-cutter homes than what their algorithmic model predicted," then moved into harder-to-value homes "hoping their algorithmic valuation model was accurate."8 The write-downs they tally come to about $569 million, consistent with Zillow's own $304 million plus the guided fourth quarter.8

The trade did not end with houses

The same trade runs anywhere a model sets a price and the world it is pricing keeps moving. Automated valuation and dynamic-pricing systems now set apartment rents, insurance premiums, advertising bids, and credit limits. Each is a forecast fit to the recent past and deployed into a present that can shift. When it shifts faster than the model expects, the prices go wrong the way Zillow's did.

One further risk is worth naming precisely, because the record around Zillow does not support the loose version of it. When a system is big enough to set prices, its own prices can begin to move the market it is trying to read. That is a feedback loop, and automated pricing at scale carries the risk in general. It was not the documented cause of Zillow's losses. The one academic study of a Zillow feedback loop examined the consumer-facing Zestimate rather than the iBuying business, found the effect short-lived and self-correcting, and drew no connection to Zillow Offers' losses.9 So the feedback loop belongs on the watch list for any price-setting model, kept separate from what actually sank Zillow: a forecast that could not keep pace, and a book too large and too slow to unwind once it was wrong.

The takeaway

Zillow's model did exactly what it was built to do. It forecast home prices from the recent past and priced offers off that forecast. The forecast was fit to one market and run into a faster one, so the offers came in too high. That is distribution shift. The error was expensive because a house is not a stock. A mispriced share can be sold in a second; a mispriced house is billions of dollars of inventory that has to be sold one closing at a time, over quarters, which is why the loss was both large and slow. Any model big enough to set prices carries a further risk to watch, that its own prices begin to move the market it is reading, though that is not what sank Zillow. Put those together and the lesson carries to the next case. When a model prices an asset today and the bill comes due later, ask two things: how far can the world move before the price is wrong, and how long would it take to get out if it were. Those questions are live wherever a model sets a number and someone pays it later, from rents and insurance premiums to ad bids and credit limits.

Go deeper optional reading
01
Matt Levine, "Money Stuff: Zillow Is Done Trading Houses" — the same event read as a market-maker's trade gone wrong.
02
GeekWire, "Zillow Group will sell 2K homes to investment firm" — the aftermath, and who bought the houses Zillow could not.

Sources

  1. Zillow Group / SEC · Q3 2021 results and plan to wind down Zillow Offers (8-K Exhibit 99.1)
  2. Zillow Group / SEC · Q3 2021 Shareholder Letter (8-K Exhibit 99.3)
  3. Zillow Group / SEC · Form 10-Q, quarter ended Sept. 30, 2021
  4. Zillow Group · Q4 and Full-Year 2021 Financial Results (PR Newswire)
  5. CBS News / MoneyWatch · Zillow to lay off 25% of its workforce and shutter house-flipping service
  6. Zillow Group / SEC · Form 10-K, fiscal year 2021
  7. Mike DelPrete · Opendoor vs. Zillow: A Tale of Two Pricing Models
  8. Stanford GSB · Flip Flop: Why Zillow's Algorithmic Home Buying Venture Imploded
  9. Fu, Jin & Liu (NBER Working Paper 29880) · Does Human-algorithm Feedback Loop Lead to Error Propagation? Evidence from Zillow's Zestimate