INDEX // mb Ideas on Publishing Books in Canada (and other attempts to write good)

Against Forecasting: A Case for More Agility in Book Publishing

For the past 60 years book publishers have thought of themselves and behaved like packaged goods businesses. It has been sufficient for publishers to adopt, often at a lag of up to 15 years,  best practices (like inventory turns, just in time delivery, and sales forecasting) from traditional businesses even when those ideas haven’t served publishers or readers very well. Going forward the publisher-as-goods-packager model will break. It is now required we not lag but leap ahead of other industries by 15 years. Can publishing survive the time crunch? Agility rather than stability will be the new paradigm. Looking to the software industry might help.

It is widely understood that the book publishers and book retailers are behind the times. We have been in catch-up mode for say, the last 40 years. The reasoning goes that if only we adopt best practices from other ‘best-in-class’ companies then the sky will open and the industry can be saved.

Bupkis.

Inventory Turns Are For Accountants

Ten years ago I sat on a conference call where a participant preached measuring inventory turns as the salvation for the publishing supply chain. We had the same conversation every week for two years and never managed to get our inventory at an average turn rate much higher than two. Inventory turns are a common metric in dry-goods retail. The participant was from dry-goods retail. Using turns to manage book retail is useless. Let me explain why.

Photo by Smudie

Photo by Smudie

Inventory turns are a financial metric –  total dollars received versus total dollars sold. To be useful to a bookstore manager, at the very least, turns need to be measured at a unit level not the dollar level AND the isbn level not the store level. And even if it was measured per sku per store you would need to allow for returns and reorders (not to mention stock outs). If you did all that you would be tracking the sales of the book so closely, you might as well track the sales of the book itself and forget the turns altogether. At that, what would it teach you? Are you going to manage Dan Brown any differently once you learn the Lost Symbol turned 675 times? I don’t think so. Oh look here comes the trade paper. You better return all of Jane Austen to get your turns in line. Using inventory turns to manage your business is not only misleading, it is dangerous.

Title Forecasting is Catnip for MBAs

A similar dogma exists with sales forecasting. The reasoning goes like this: 1) our industry is mature. 2) in mature industries you control costs 3) stricter forecasting is a great way to control costs. 4) book publishing needs more sophisticated forecasting algorithms to help control costs.

Nope.

Sales forecasting in the book trade is useless. Let me explain why.

Forecasting is only effective when the model is stable, when a sales history is well established, and the time lines are short. As Nassim Nicholas Taleb so forcefully points out in his book The Black Swan forecasting models don’t allow for new information. They filter out randomness. They deny the existence of black swan events. Forecasts, by definition, are self-fulfilling. At worst they are frauds.

By necessity books are almost exclusively forecasted with no past sales information. Book sales almost entirely rely on happy accidents (aka black swans events). Not only is forecasting sales a waste of time for most books most of the time, it too can be dangerous. The models I have encountered deal with volatility in one of two ways: the book sales are modeled as if they were on rails (no new information allowed) or the volatility (aka potential demand) is zeroed out as forecast noise. In both cases the ‘forecast’ is suppressing reorders. It is done to protect against the downside risk of too much inventory. No book forecasting model I know of is engineered to capitalize on potential upside.

/Polemic

No forecasting? Be afraid of random events? I am not saying you should lock yourself in your stock room and never make a decision again. You have to submit a purchase order with some number on it. So what is the alternative?

Book publishers and book retailers should focus on agility not accuracy. Being smarter is a delusion. Get faster.

Zara, the Spanish clothiers, do not forecast their inventory. Imagine if book publishing worked like fast fashion? Write it. Print it. Jump on it if it works. That is impossible you say. No it’s not.

I am amazed at how many Canadian book publishers under deliver on orders. A bookstore will order 100 copies and the publisher will deliver 50. Come on.  Yes the book publisher owns the risk. Yes the book publisher has to endure baroque negotiations with their US head office but it would be a lot easier if the publisher and retailer did some collaborative planning. Shrink the supply chain. Get faster.

In the Black Swan, Taleb offers the more extreme ‘dumbbell’ solution. Spend a small amount of your time and attention on managing the safe bets in your publishing portfolio. Spend the rest of your time preparing to pounce and then pouncing on the riskier bets with the largest potential. Leave all other titles to fend for themselves. Or better yet, don’t publish them at all.

The End of Inventory Management

I have spent the last six months learning about agile methods for software development and that has prompted thoughts not only of a leaner, faster book supply chain but a future where the supply chain shrinks to nothing. In a world where publishers sell directly and instantly to readers, it makes a lot of sense to have a rapid response task-force (author, editor, marketer, designer) to not only respond to sales demand ex post facto but modify and create new content in response to readers’ needs.

If a CEO of a major publishing house familiarized themselves and then adopted a ‘go-agile’ philosophy, I think that would constitute an almost bullet-proof strategy for dealing with the forthcoming wave of digital change. The question is what would be lost in such a transition?

related: Mark Leslie’s thoughts on PubFight, the forecasting simulation game from BookNetCanada

related: Chris Dixon, in a great post on commoditized forecasting algorithms points out that studies have shown that naive bayes is as good or better than fancy algorithms in a surprising number of real world cases.  He says “it’s relatively easy to build systems that are right 80% of the time, but very hard to go beyond that.” This post is well worth your time.


8 Comments

Nice post, Mark.

The “agile” angle (say that 5 times fast) is the noteworthy one here. I recall that Brian O’Leary was saying something similar at last year’s BNC Tech Forum — in the context of XML and ebook publishing. It is, of course, a lot harder to be agile with offset-printed books, because distribution and retailing cannot be sped up enough.

But the very idea of BNC Sales Data is to make printing decisions more “agile,” right? And digital, short-run printing may make it possible to get to where you’re talking about (witness Amazon’s sizable investments in this technology as a means of getting out of inventory hell).

So is the agile approach an alternative business methodology to the bluckbuster/manufacturing one? I have a hard time seeing how the model that produces Lost Symbols and vampire books could be agile, being reliant on big economies of scale to create big profits.

Posted by John Maxwell on 5 October 2009 @ 1pm

Well done, Mark! Great piece.

This takes me back to my days as a buyer for Virgin Books back when they had a spot in the Megastore in downtown Vancouver.

As the buyer I had near complete control over inventory choices, merchandising, placement, advertising decisions and etc…

During my time there that store was posting sales at +36% year over last increases with weekly increases posting at near double the previous year’s totals. In a non Harry Potter year and just before Virgin sold the retail space to HMV which cut books from their retail strategy but later brought them back.

When I look at the reasons for this success it has everything to do with agility, improvisation and out and out knowledge of who the customers are, what they’re interested in and how to introduce them to books that they didn’t know that they were interested in purchasing.

It was about knowing the business, paying attention to what’s happening in the industry and with the customers and pouncing on opportunity.

(Ask our friends at HB Fenn how they enjoyed my daily phone calls when Vice Magazine’s Do’s and Don’ts book came out – and they didn’t have rights in Canada.

The conversation essentially went a little like this.. “I am ordering 300 copies of this book for my store from Ingram US. I expect that will last about 2 weeks and I also expect that when I need to reorder this book, I will be able to get it from a Canadian supplier.”

The reason that I mention it is that… the entire company Fenn/Warner Canada had no idea what a gold mine they had in that book and not just for the Virgin store.

it showed that they were smart enough to publish it but too out of touch to know what to do with it.

Also, Vice Magazine is a Canadian entity… and as such I expected that a knowledgable publisher would want to capitalize on that national connection.)

And, yes… I forecasted books for the management team a few times a year and I followed inventory turns and in both instances I found the data to be nearly useless and incomplete.

A book marketing executive with whom I had worked closely during my time at Virgin and whose books did extremely well in that environment once asked me what inventory systems I used to maximize the sell through and successfully maintain vigorous inventory levels.

I think that my answer may have surprised him, I said, “Well, I go into the book store on Monday mornings and I look around.”

It was the truth.

All of the mathematical formulas and sophisticated forecasting systems that you can create will not replace knowing what you have, knowing what you need and knowing how to respond to new information.

That doesn’t mean that the algorithms are useless. In fact they’re a huge help and good tools.

Thanks for the great article, Mark.

Posted by Sean Cranbury on 5 October 2009 @ 1pm

@John — even though I am advocating an agile business re-design for publishers in the above post I do concede better collaborative planning with retailers is really all that is needed until digital takes off. If a publisher acted iteratively — did shorter print runs (without better integration with retail) then pulled the trigger on a larger offset run once a title took off — they would lose margin and likely anger readers from stockouts. No one wants that.

I included the link to Mark’s thoughts on Pubfight because there is clearly a flipside to my position and I wanted to acknowledge that. I haven’t played it but apparently it is quite fun and worthwhile. It gets people thinking about questions that they wouldn’t otherwise. My question: is there other better training that publishers should be doing instead?

Posted by mb on 5 October 2009 @ 3pm

@Sean — I saw Andrew Keen speak earlier this week. He characterized the cultural shift we are experiencing these days as one “against centralization.” I have a rant that I will post another day about centralized decision making in forecast and replenishment. The short version is I think it sucks. Thanks for the comment.

Posted by mb on 5 October 2009 @ 3pm

Good post Mark.

Agile is good…it is really all about communication. One of the reasons Agile works in software development (and other things) is that usually it involves small teams in almost constant communication, and even when it is a big team there is still really a lot of communication going on between team members and stakeholders. It is about a constant feedback loop…from your clients, your co-workers or whomever has a vested interest. Does that constant feedback loop translate too the print/bricks-n-mortar world? A little? It could be better.

Even if you are not using a computer based algorithm to do your forecasting, and you are a book buyer, you are still forecasting. You have to take a position on the title and if you are a good book buyer (know your customers) then hopefully you can make a somewhat informed forecast and place your order. This is the ‘ART of Book Buying’. You can likely inform your forecast by looking at data of like authors, like titles, like subject areas etc…, or you can talk to someone else – a customer, a sales-rep, another book buyer, and make a ‘better’ forecast. Art+data+collaboration=better forecast, I think.

The ‘Art’ is the art…you can get better at it, but it won’t be perfected. Whether you do it with the aid of a computer, or all in your head.
Data can be more agile and more complete.
Collaboration/Communication can be better.

eBooks, eDistribution and other digital-print hybrids obviously change things. There is no ‘buying’ in the conventional manner…there is marketing, partnerships…etc… It’s a different game and one we all continue to talk about.

Posted by Noah Genner on 6 October 2009 @ 5am

Hey mb — interesting post. I’m gonna take you to task a bit, but it’s meant with love ;-)

I think publishers and retailers are generally more agile than you give them credit for. Most publishing houses are a pretty accurate reflection of Taleb’s dumbell model. They spend a little time doing pretty solid analysis on safe bets, the predictable backlist and midlist that pay the bills. The same goes for predictable blockbusters — a new Patricia Cornwell or James Patterson is going to perform a whole lot like the last one. (All of which, btw, tend to have a pretty significant collection of historical data.)

At the same time, they spend a lot of their time dealing with outlier performance — the surprises and break-outs. I would argue that publishers, more than most other businesses, are Black Swan farmers.

I’d push a bit on your point that most book sales rely on happy accidents. The first Harry Potter is a happy accident. (Maybe even the second.) But the third through seventh aren’t. Twilight was a happy accident, a blue moon, a two-headed calf. New Moon was a space shuttle launch, complete with scientists, slide rules and specially trained inventory analysts in matching jump suits. For the first of either of these, you’re absolutely right — success relies on the publisher being able to see that they have a winner and being prepared to double-down with all haste in that brief period that the market allows. But after that, you tend to bring forecasting to bear as best you can, because you’re managing a brand that behaves with a certain degree of predictability. Those are the titles that _really_ pay the bills and generate a significant amount of revenue. Oddly, I think the “all money in publishing comes from surprises” is a result of another of the tendencies Taleb beats on — the tendency to turn high-profile, isolated successes into false norms.

PubFight is good for this. After a season or two, you know your bankable bestsellers that will keep you in the black and the auction market becomes pretty efficient in assigning them accurate value based on historical performance. Which gives you time for the fun stuff — placing a spread of bets on titles with uncertain futures that could blow the doors off, or could barely earn out the advance you paid. If PubFight does one thing, it’s school people on the combination of predictability and extreme variability that makes up the market, and give you a chance to try and roll with that reality. You get a chance to deal with Black Swan events *and* their less-glamorous (and very forecastable) counterparts like the Guinness Book of World Records, Kathy Reichs, and Maeve Binchy.

I could go on and on about stock turns in retail, but in the interest of time, I’ll say this — there are lots of ways to use stock turn analysis badly, including the ones you describe. But there are ways to use it incredibly well. BookNet is doing some wicked work there — using stock turns to find hidden gems in backlist that deserve more stock than they’re getting, or finding categories that deserve more space, stock or attention than they have. It’s definitely item-level analysis, and often item/store-level, but it’s also scalable and replicable. It doesn’t replace being a good bookseller or knowing your customer. But where it can really help is in places where you just don’t have time, or you’re trying to manage a lot of shelves with a few people. And since every retailer, indy to national chain, is trying to do more with fewer people, turns can be your friend. Just not your only friend. (There are some retailers that are doing fantastic work in this field, and they’re right to be quiet about it — it’s part of their secret sauce. They don’t just have Jane Eyre on the shelf, they have _just enough_ Jane Eyre all the time.)

PS — Zara’s not a great example because there is no “backlist” for Zara. Every product has a fixed 6-8 week shelf life, and when it’s gone, it’s gone. They never fire up the looms for another production run. That’s how they keep the stores fresh and keep people coming back. You could try to run a publishing house or a retailer that way, I guess… ;-)

PPS — Why Markus Dohle?

Posted by Michael Tamblyn on 6 October 2009 @ 5am

@Noah — Thanks for your comment sir. Better communication, collaboration, and feedback would be a fantastic improvement for offline retail. BNC has done some heavy lifting in this area and we are all better off for it, but as you say things could be better. I am wishful for continuous improvement between retailer and publisher.

Your comment about the art of book buying gave me pause. It is hard to promote an artistic culture in book retail, especially on a large scale. Call it the 20% gap — the value added by a knowledgeable buyer. A company can manage around the gap (the Zara model), a company can manage into the gap (most small bookstores) or a company can mislabel and mishandle the problem (most companies I have worked for). It would be my preference to see the latter companies do something/anything other than what they are doing now.

Posted by mb on 6 October 2009 @ 10am

@Michael — what can I say? A little knowledge is a dangerous thing.

Your point about book publishers as experienced Black Swan farmers is well taken. Your point about the inherent sales predictability of new titles is neither her nor there. Ultimately I don’t think publishers are reactive as they could be. It is debatable if that is a good or bad thing. Regarding Pubfight: I shouldn’t take a position on the merit of Pubfight as I haven’t played it, but your point makes sense — Pubfight helps normalize expectations within the industry. Taleb critizes simulations like that for perpetuating the “ludic fallacy” or the false belief that real life is like a game. That is a problem that is endemic to Western civilazation so arguments one way or the other are probably wasted in this space. The stock turn question is where I balk. I don’t doubt companies are practicing effective inventory management but I do doubt that has anything to do with measuring turns. I think measuring sales is just as effective as turns, but let’s take up that debate some other day.

If I were to distil my post to one idea it would be this: the industry needs to shift from predictive to reactive. Up until now we have been looking sideways and backwards for better ways to understand the business. That is useful to a point but as filtering and aggregation functions move from publisher to customer our systems and our processes will begin to break. I cite Zara and Agile development, not because they are great analogs, but because they are reactive and iterative. The original draft of this post included lots of babble about lean manufacturing and how a manufacturing wiz like Markus Dohle could adopt those principles for publishing. I dropped it, but I stand behind the idea that a strategy at c-level — based on a simple transformative idea — is required to effect change.

P.S. — I think you know a former Nasa employee that could pass on the specs for fethcing jump suits. If you ever get those measurements, pass them on. :-)

Posted by mb on 6 October 2009 @ 11am

Leave a Comment