OpenDocument

Sorry Shish, you're wrong about ODF 1.2 Try ODF 1.5 or ODF 2.0, maybe. The metadata requirements for ODF 1.2 actually did include two way lossless translation capability. Unfortunately these features did not survive the final cut, and were not included in the April 2007 submission. You might also want to check the February 23, 2007 metadata proposal from Florian Reuter. That also would have delivered the goods and perhaps put ODF that grand convergence category of usefulness across desktops, servers, devices and web systems currently the exclusive domains of MS-OOXML and CDF+. Florian had devised a means of using metadata to describe the presentation aspects of content and structural objects. Very revolutionary. And based on the simple notion that bold, font, margins etc. are simply metadata about content and style objects. Where the train came off the track had to do with the concept of an XML ID means of linking metadata to content. Not that there was anything wrong with this mechanism. It's actually quite clever. What went wrong was that Sun insisted that only those elements approved and supported by OpenOffice would be allowed to make use of XML ID metadata. For independent developers, this is a serious constraint. Because of this constraint, the metatdata sub committee started off with six elements supported by OOo that metadata could be appied to. IBM then came in and asked for eleven more elements having to do with charts and graphs. The OpenOffice crew decided they could support this, so in they went. Then an interesting question was posed, "How are independent developers supposed to submit elements for metadata consideration?"

Over the next three months, Microsoft will be releasing new and updated translators designed to aid  customers who want interoperability between Microsoft’s Office Open XML (OOXML) and other document formats, including Open Document Format (ODF). On December 4, Microsoft began rolling out three new translators that it plans to make available this month: A 1.1 update of its translator for Word; an Open XML spreadsheet translator and a presentation translator. Additionally, in February 2008, Microsoft will deliver the final version of its translator designed to provide interoperability between the Chinese-government backed Uniform Office Format (UOF) file format and OOXML. Microsoft announced the creation of the SourceForge-hosted Open Translation Project in July 2006. At that time, the Softies said the translator-focused initiatve was started “in response to government requests for interoperability with ODF because they work with constituent groups that use that format.” Vijay Rajagopalan, a Microsoft Principal Architect, provided the update on the OOXML-ODF translation work during the XML 2007 conference on Decmeber 4. During the XML 2007 interoperability panel — sponsored by Microsoft and of which Rajagopalan was a part — the ongoing battles that have raged for the past couple of years between Microsoft and the backers of ODF were a mere sidenote.

Open Document Format: The sad truth David Berlind has posted a massive chronicle of who said what to whom about the supposed emergence of CDF as an alternative to Open Document Format (ODF) and OOXML. I played a minor role in this saga when I spoke with Gary Edwards for Opening Move, back in April. This was before Edwards proposed CDF in place of ODF. If you haven't listened to our conversation, please do so, because the concerns Edwards raised about ODF (and OOXML) remain just as valid today. While I'm sad to see Edwards' more recent direction and assertions debunked in the press and the blogosphere, the greater tragedy is of two competing document standards -- ODF and OOXML -- now on seemingly irreversible paths to immortality, meaning we'll have translation issues between them around for several lifetimes to come.

ODF was dead-on-arrival not because it's a better or worse choice than OOXML (I have no idea which is better, really) but because the nature of those with UNIX DNA never allows these kinds of "open" agreements to succeed. They all just splinter. Every time.

In other words, I would like to lay out my printable documents in a way that’s familiar to me, for which I have tools that can support this and that can easily be changed without having to do a search and replace through a hundred distance instances of a paragraph. In short, I want CSS, acting on XHTML, generating my printed pages as readily as it displays that content to the screen. A previous blog from Michael Day about PrinceXML reminded me that I hadn’t had a chance to play with it. My previous experiences with XHTML to PDF conversion were, to put it bluntly, terrifying, and so, as I was downloading the JAR file I wasn’t expecting a lot. When I tried it, I wasn’t disappointed … I was stunned. I had taken an article that I’d recently written for XML.com and run it through Prince. It digested the ten page article and cranked out a PDF in under a second, and the quality was better than anything I’d been able to get with a straight DocBook/FO/PDF rendering. I looked up the documentation, and found that it supported the CSS 3.0 page rendering set, as well as support for columns (including columnar rules), it could be used to print SVG content embedded or linked to the main XHTML document, and it included a nice set of extension properties for handling headers and footers, internal links, rounded borders, and the full panoply of CSS selectors including nth-child (which seemingly no one supports), content search and the whole gamut of pseudo-classes.

The point being -- it doesn't matter if the folks backing ODF are right. It doesn't matter that ODF is a more-credible, streamlined, logical and transparent spec than OOXML. What matters is that Microsoft is giving corporate developers what they want -- an XML-paved road directly into the Microsoft Office suite found on 90 percent of corporate desktops. And what's more, the company is upping the ante, with Visual Studio Tools for Office, new Office Business Applications and innovations like the Office 2007 Fluent UI. So the challenge for ODF proponents is a steep one. Even if they win the battle, and somehow deny Microsoft ISO approval, they can still lose the war. Because in the end, it doesn't really matter who is right. What matters is who can deliver the most compelling value to IT organizations married to the Microsoft Office suite.

An intriguing idea is whether we can have it both ways. Suppose you are in an ODF editor and you have a "Save for archiving..." option that would save your ODF document as normal, but also generate a PDF version of it and store it in the zip archive along with ODF's XML streams. Then digitally sign the archive along with a time stamp to make it tamper-proof. You would need to define some additional access conventions, but you could end up with a single document that could be loaded in an ODF editor (in read-only mode) to allow examination of the details of spreadsheet formulas, etc., as well as loaded in a PDF reader to show exactly how it was formated.

The OpenDocument Foundation was formed in 2005, with the mission "to provide a conduit for funding and support for individual contributors to participate in ODF development" at the standards body OASIS. So, at a time when backing for the ODF format seems to be gaining in strength around the world, eyebrows were naturally raised when Sam Hiser, the Foundation's Vice President and Director of Business Affairs, wrote on October 16 that it was no longer supporting ODF:

A while back the OpenDocument Foundation folded up, withdrawing its support for the ODF in favor of CDF. The reason for the switch is buried in the details of ODF community’s denial to be fully interoperable with Microsoft Office, which might have helped in migrating to ODF without affecting the processes. So, there was something bigger here playing it up. Matt Assay notes that Microsoft Sharepoint might kill ODF more than anything else. It is the process stupid! People want to move to ODF, but without having to re-engineer their business processes.

One prominent ODF backer, the unrelated Open Document Foundation, said in late October that it would stop backing ODF in favor of a more viable universal format called the Compound Document Format (CDF). Marcich said that "won't have any effect on the alliance or on ODF" adoption. Moreover, CDF, which is a World Wide Web Consortium format, differs greatly in features and goals than ODF. "We're talking about apples and oranges here," he said.

But standards don't rule the computing world. Today, ninety-two per cent of desktops and seventy per cent of servers run the proprietary and non-standardized Microsoft Windows OS.

Did the OpenDocument Foundation recently shutter its doors for good because it was unable to convince Oasis to support its converter, known as Da Vinci? Or was it because OpenDocument Format was simply not designed for the conversion of Microsoft Office documents, applications, and processes?

Quick! Do you use the Compound Document Format?! You, know, CDF … surely you use CDF, right? Chances are pretty good that you have no idea about what I’m talking about. Everyone knows Microsoft’s word document format and Adobe’s PDF, chances are pretty good that if you’re reading this on XML.com you’ve heard of ODF and OOXML, especially after the fairly rancorous discussions about ISO status for these two formats. Yet CDF, hmmmm … that’s a rough one. Didn’t it belong to Corel, once upon a time?

CDF was in the news recently with the implosion of the Open Document Foundation, originally established to endorse ODF, though in its death throes it briefly highlighted the CDF format as perhaps a better format for documents than either OOXML or ODF. This is admittedly one of those areas where it may be justified in looking at XHTML especially and going “huh”? How can that be a full document format - it’s used for web pages, after all - you wouldn’t want to use it to mark up a full book, would you? Document formats are a lot like religions - people are ready to defend them to the death if need be, yet at the same time it becomes easy to dismiss certain religions that don’t even seem to be religions at all (such as my personal favorite, the rather philosophical Tao). Could you mock up a brochure in XHTML and CSS? Actually, it turns out that its surprisingly easy to do just that - especially if you throw a little SVG into the mix and allow the possibility of embedding XHTML within SVG (for all those odd little bits of rotation and other special effects).

Standards often are made by insiders, established players, vendors with something to sell and so something to lose. Web standards bodies organized as pay-to-play consortia thus leave out developers and users, although vendors of course claim to represent everyone fully and fairly. I've worked within such bodies and continue to try to make progress in them, but I've come to the conclusion that open standards need radically open standardization processes. They don't need too many cooks, of course; they need some great chefs who work well together as a small group. Beyond this, open standards need transparency. Transparency helps developers and other categories of "users" see what is going on, give corrective feedback early and often, and if necessary try errant vendors in the court of public opinion.

“By migrating from Microsoft Office to OpenOffice.org we had to take our productivity environment to a higher level, so that the migration would not be perceived as a mere replacement but as a genuine improvement. The OpenOffice.org user doesn’t need to leave the OpenOffice.org application or start another application. This effectively eliminates the borders between template management and document collaboration for teams, projects and departments. We are focused on the user and on the usability of the applications we use. With O3Spaces Workplace we’ve found a fully integrated document management, collaboration environment that till now couldn’t be found on the market”, says Hiemstra.

Sorry Shish, you're wrong about ODF 1.2 Try ODF 1.5 or ODF 2.0, maybe. The metadata requirements for ODF 1.2 actually did include two way lossless translation capability. Unfortunately these features did not survive the final cut, and were not included in the April 2007 submission. You might also want to check the February 23, 2007 metadata proposal from Florian Reuter. That also would have delivered the goods and perhaps put ODF that grand convergence category of usefulness across desktops, servers, devices and web systems currently the exclusive domains of MS-OOXML and CDF+. Florian had devised a means of using metadata to describe the presentation aspects of content and structural objects. Very revolutionary. And based on the simple notion that bold, font, margins etc. are simply metadata about content and style objects. Where the train came off the track had to do with the concept of an XML ID means of linking metadata to content. Not that there was anything wrong with this mechanism. It's actually quite clever. What went wrong was that Sun insisted that only those elements approved and supported by OpenOffice would be allowed to make use of XML ID metadata. For independent developers, this is a serious constraint. Because of this constraint, the metatdata sub committee started off with six elements supported by OOo that metadata could be appied to. IBM then came in and asked for eleven more elements having to do with charts and graphs. The OpenOffice crew decided they could support this, so in they went. Then an interesting question was posed, "How are independent developers supposed to submit elements for metadata consideration?"

Standardization by Corporation Maybe i spoke to soon. This just came in from ISO, the resignation letter of the SC34WG1 Chairman who has completed his three year term. There is a fascinating statement at the end of the Martin Bryan letter. "The disparity of rules for PAS, Fast-Track and ISO committee generated standards is fast making ISO a laughing stock in IT circles. The days of open standards development are fast disappearing. Instead we are getting “standardization by corporation”, something I have been fighting against for the 20 years I have served on ISO committees. I am glad to be retiring before the situation becomes impossible..." When corporations join open standards or open source efforts, they arrive with substantial but most welcome financial and expert resources. They also bring marketshare and presence. And, they bring business objectives. They have a plan. As long as the corporate plan is aligned with the open standards - open source community work, all is fine. In fact it's great. For sure though there will come a time when the corporate plan asserts it's direction, and there is possible conflict. At this point, the very same wealth of resources that were cause for celebration can become cause for disappointment and disaster. One of the more troubling things i've noticed is that corporations treat everything as a corporate asset to be traded, bartered and dealt for shareholder advantage and value. This includes patents and interoperability issues which not surprisingly are wrapped into open standards and open source efforts. Rather than embrace the humanitarian – community of shared interest drivers of open standards and open source, corporations naturally plot to get maximum value out of the resources they commit. A primary example of this is Sun's use of OpenOffice, ODF, and an anti trust settlement disaster that left them at the mercy of Microsoft.

Open Means Open For a document format to be considered "open," it should be fully implemented by many different vendors, interoperable, fully published, and available royalty free without intellectual property restrictions. Microsoft's OOXML continues to fail this test. For example, the comments from the British Standards Institute pointed out that "there was no other proven implementation of OOXML apart from Office 2007." Unless and until there is another proven implementation, any government beginning to use OOXML would be faced with only one option. This is contrary to the objective of government open standards policies. Open standards policies are proliferating as governments seek to create IT architectures that rely on open standards to allow multiple vendors to compete directly based on the features and performance of their products. What governments obviously need are open standards that enable technology solutions that are portable and that can be removed and replaced with that of another vendor with minimal effort and without major interruption.

Filtering vs. Standards Corel's policy is to focus on what its customers want rather than get overly involved in any one document format, Larock explained. WordPerfect uses Corel's proprietary document format but makes that code available. "We have filters built in to translate into more than 65 different file formats, including OOXML and ODF," he said. "That list included some legacy WordPerfect, AMIPro, PDF, multiple MS Word earlier formats and numerous graphic file formats." Maintaining filters for legacy document formats is important. People have lots of older files in archive that they still want to access, said Larock. Up for Grabs The evolution of text on the Internet along with the use of Web 2.0 applications is starting to have an impact. It is becoming a contest between a desktop presence and a Web-based format, according to Larock. He compared the situation to the transition from analog to digital formats in the telephone industry.

Despite some efforts by the two camps, ODF and OOXML are, for the most part, not interoperable, meaning documents that are created in one format cannot be successfully read by applications based on the other format. According to Novell's vice president of developer platforms, Miguel de Icaza, the situation won't change in the foreseeable future.

"Neither group is willing to make the big changes required for real compatibility," de Icaza added.