IDPF into W3C: What We Learned At DBW

On January 18, 2017, the IDPF (International Digital Publishers Forum) held an open meeting at the Digital Book World conference to discuss the impending merger of IDPF into W3C.
It was, to say the least, an engaging session. If by "engaging" you mean "confrontational."
W3C has been circling the waters of digital publishing for nearly 5 years. In 2012, they formed the Digital Publication Community Group, looking at issues such as accessibility, markup, metadata and more. That group closed in 2013, and the Digital Publishing Interest Group formed in its stead. This group examined issues relating to the W3C Open Web Platform, layout and pagination, annotations, metadata, accessibility and CSS.
It became apparent that the IDPF's EPUB standard stood at risk of "forking" as the W3C got more involved. And as W3C already managed the HTML and CSS standards, it seemed logical that they should house the EPUB standard as well.
Or so 88% of the IDPF voters thought.
Not so Steve Potash, who has been CEO of Overdrive for 23 years, and who founded the Open eBook Forum in the late 1990s. The Open eBook Forum would go on to become the IDPF, which Potash served as President for many years.
Potash forcefully accused the current Executive Director of personal profiteering, and accused the W3C of commandeering the standard only to ignore it in favor of other standards. He also accused both parties of steering the EPUB standard out of the book industry.
This was all refuted handily by both the Executive Director and the representatives of W3C, as well as by the IDPF board itself. The Web standards group cares deeply about EPUB and digital publishing - within the book industry and beyond.
It was a difficult moment for IDPF and W3C, and was handled gracefully. Suffice it to say that it is a good move for the EPUB standard, because now it can take advantage of proximity to other standards, cross-pollinate committee meetings, and develop the standard to be flexible and accommodating to the many different constituencies that use it.
It is also a sign that indeed, the Web has come for books. That books are important to Web developers - as rich mines of content that can be presented in a variety of ways. Surely, as we know, the print book will continue to offer the same reliable experience it always has - but with digital publishing being embraced by the W3C, it will be exciting to see what other applications besides digital facsimiles of print await.

Lists, Damned Lists, and Statistics

In 1986, I came to New York for the first time (since visiting as a five-year-old), where I interned at Rolling Stone. I sublet a room on the Lower East Side, lived on lentil/rice concoctions, and learned about coffee carts, subway routes, homelessness, and the last shreds of the punk scene (my apartment was right over the Pyramid Club, and the East Village was full of mohawks, piercings, and tattoos at that time).

One of my tasks at Rolling Stone was to create the charts. This was done by calling up about 20 record stores all over the country, which someone had designated as key indicators, and checking on their sales rankings. I collated the data and submitted it to the managing editor, who might make some tweaks to it before running it in the next issue. And I learned some things about bestseller charts. Mostly that this type of data-gathering was less than scientific.

This method was replaced in 1991 by Nielsen's SoundScan service, which tallied sales from cash registers in thousands of stores. It was marginally more scientific - results were based on raw numbers rather than phoning around randomly and having the results edited to suit someone's tastes. Ten years later, Nielsen expanded its service to bookstores - BookScan was born.

Again, BookScan wasn't perfect. It can only track print book sales - because it relies on bar-code scanning technology. And it doesn't track non-traditional sales such as to libraries, or direct sales, or sales by online retailers.

And then...there's the New York Times Bestseller List. Today they announced that they are consolidating the lists, merging some print and digital charts, and dropping a few lists. The compilation of the NYT lists is secret even from the NYT Book Review staff - it's done by the news staff. But they have mentioned that it's done in similar fashion to what I used to do at Rolling Stone - communicating with bookstores around the country and tabulating sales by what they report in. My understanding is that this process now spans thousands of stores, as well as wholesalers who distribute to non-traditional book outlets. It scales more broadly than my efforts did in 1986, but the principle is still the same - self-reporting by stores, plus some kind of editorial "secret sauce".

Of course, the best source of sales (post-returns) is the publishers, who don't share this knowledge with anyone. So, just as we don't have a fully complete and authoritative repository of all publishing metadata, we don't have such a repository of all book sales data.

Basically, these lists come down to what you count, what you DON'T count, and what you CAN'T count. They are signposts, some more artfully created than others.

In Which We Are 1

Numerical Gurus, LLC, has just turned a year old! We're celebrating by...buckling down and working harder than ever, basically. We've got loads in store for 2017 - new webinar programs, new writing, and lots more educational sessions at conferences throughout the year.

In the meantime, we are still here for your metadata optimization needs. From help with keywords, to standardization and normalization, to troubleshooting your EPUB issues, we provide back-end support for publishers of all types - scholarly, academic, Christian, association, trade, independent, small, self-, and specialty. As you can see from our portfolio, we cover the gamut of publishing needs.

Things to watch for:

1/17/17 - Laura is giving a "master class" in identifiers at Digital Book World. Come for the ISBN, stay for the ORCID! Learn things you never knew you wanted to know.

1/23/17 - A new column in Publishers Weekly!

2/2/17 - A new round of Metadata Boot Camp! New content, new concepts! So many exclamation marks!!!

BNC To Retire ONIX Converters

Booknet Canada is announcing the retirement of two of its ONIX converters - the Bronze Template Excel-to-ONIX converter, and the ONIX 2.1-3.0 converter.

Their reasoning is below:

Creating ONIX files from the Bronze Template is no longer a sufficient solution for today's metadata needs. It doesn't provide support for full and complete book data (for example, spreadsheets can't be used to manage images), and the industry as a whole should be entirely reliant on ONIX. The spreadsheet template and converter just aren't cutting it anymore. It's time to invest in a database – either in-house or through a third party.

And while ONIX 2.1 continues to be widely used in North America, support for it has ceased and use of the ONIX 2.1 to 3.0 converter has been declining steadily. It is also no longer required for our ONIX education program. ONIX 3.0 is the way to go!

See their announcement here. The takeaway here is that we're moving to an ONIX 3.0 world, and reliance on 2.1 (or 2.0!) is probably not wise.