Black Friday, 5:30 AM
Black Friday morning, 5:30 AM. I pulled up our bedding category on the website to do one last check before the rush hit, and my stomach dropped.
The items were on double sale.
Instead of the "up to 40% off" promotion we'd planned, the bedding was 40% off plus a 40% price decrease that shouldn't have been there. Shoppers were thrilled — they'd stumbled into a double promotion. Margin was leaving the site click by click.
I'd spent months preparing for this day. Countless meetings with buyers, business analysts, and the pricing team I was on. Every promotion proofed. Every price reviewed. Everything should have been perfect.
I opened an emergency support ticket to get the site updated. Making pricing changes on a live site during Black Friday is not something looked upon favorably — to put it mildly. Changing prices is also technically hard. Multiple systems hold the price, promotional messaging has to stay in sync, and different parts of the site cache differently — so updates land at different times for different customers. Live updates are a mess.
To make it worse, the buyer in charge of bedding had also opened a support ticket. Two tickets for the same fire confused the support team, and we had to jump on a call to clarify what needed to change, which wasted more time. By the time the fix went in and I sat back down, I was running on adrenaline and coffee. The dollar damage wouldn't be clear until tomorrow when the reporting came in. I could only hope we'd caught it fast enough.
Pricing mistakes hit fast. Tens of thousands — sometimes hundreds of thousands — of margin can walk out the door in seconds. And the damage doesn't stop at the P&L. Hard decisions land immediately. Do you cancel the orders that already went through? Can you even fulfill the ones you don't cancel?
Cancel the orders and you have furious customers who thought they got a deal. Honor them and you take a real financial hit, blow through inventory you can't replenish, and slam your distribution centers with orders. There's no clean answer, only the least-bad one.
The postmortem traced it back to a trade-off every pricing team lives with. Real-time updates are common — it's how you stay responsive when inventory shifts or a competitor moves. But responsiveness creates surface area. During the chaos of Black Friday, the same sale was entered into the promotional system and the pricing system instead of just one. Either system could have correctly run the sale on its own, so when the change went through review, it looked right in isolation. The last-minute update slipped past the checks that normally would have caught it.
This was over ten years ago and I'm still thinking about it. That's the job of an ecommerce professional — to live in a world of chaos, but always try to make it better. That's why I'm building Margin Owl.