Group items tagged

A fatal flaw in your analysis By Marbux Posted Saturday 21st April 2007 08:15 GMT Your analysis contains a fatal flaw, Martin. That is your belief that adequate Microsoft XML <> OpenDocument translators will be available. In fact, all of the translators suck mightily and there is no prospect at all of them being perfected. The major problems are: (i) that Microsoft's XML formats seem deliberately designed to thwart their parsing with XPath, which is essential to XML transformations; (ii) that Microsoft's "XML" file formats include binary blobs, bitmasks, and multiple Windows and Microsoft dependendencies, all of which defy XML transformations; and (iii) OpenDocument assumes a richer page layout engine than Microsoft Word provides, so while DOCX can be completely mapped to ODT it is impossible to fully map in the other direction without declaring an MS Office interoperability subset of OpenDocument and ODF applications implementing a compatibility mode with reduced features. (That is more than somewhat ironic, given Microsoft's spin that it couldn't implement all of its features in OpenDocument. In fact, the exact opposite is true.) In fact, Steve Ballmer is on record as saying that the developers of the Novell-Microsoft-Clever Age plug-ins will not even attempt to achieve full fidelity file translations between the two formats. http://www.eweek.com/article2/0,1895,2050848,00.asp?kc=EWEWEMNL103006EP17A Those translators achieve at best far less conversion fidelity than existing file conversion filters between OpenDocument and Microsoft binary file formats such as the OpenOffice.org conversion filters, which achieve only about 80 per cent fidelity. The file format cognescenti know this. See e.g., the paper by Gary Edwards and Sam Hiser included in this edition of the European Journal for the Informatics Professional. http://www.upgrade-cepis.org/issues/2006/6/up7-6Hiser.pdf (PDF). (Note that I contributed to that paper.) And as also detailed in that paper, what works well enough for some of us does not necessarily work well enough for all. Anything less than full fidelity data conversions is absolutely unacceptable in the context of wholly automated business processes and is in fact illegal in various contexts, including government records. So your thesis doesn't fly. In fact, I'd go so far as to bet that you have been suckered by the Microsoft spin doctors. Another indication is your depiction of the file format wars as being waged primarily between IBM and Microsoft, a recent theme of Microsoft's public relations machine. While it is seductive to believe that the controversy is just another chapter in the war between major competitors, the pro-ODF camp is far broader than IBM. For example, nearly 20 governments recently opposed fast track processing of Microsoft's draft standard at ISO. Do you believe they were all carrying water for IBM? Government bodies in more than 50 nations have chosen to adopt ODF. http://opendocumentfellowship.org/government/precedent And dozens of developers now support the OpenDocument standard in their applications. http://opendocumentfellowship.org/applications While IBM has had a noteworthy role in proliferating the OpenDocument formats, there is a movement without a recognizable leader in the industry. When it comes to vendor influence on things relevant to ODF, Sun Microsystem's far outshines IBM. But in fact, a core group of open standards and free and open source developers and advocates -- inside and outside government -- have played a far larger role. This is a customer-driven phenomenon, not a vendor-driven effort as you portray. So I will respectfully suggest that you reexamine your position on these issues. Reasonable minds can differ, but not on the grounds you advocate.

The recent bomb in the ODF world from Gary Edward’s claims that Sun successfully blocked the addition of features to ODF that would be needed for full interchange with Office are explosive not only because they demonstrate how ODF was (properly, in my view) developed to cope with the particular features of the participants, not really as a universal format, but also because the prop up Microsoft’s position that Open XML is required because it exposes particular features that ISO ODF is not capable of exposing. Both because ODF is still in progress and because sometimes the features are simply incompatible in the details.

Actually, ODF is about to get a new manifest along with the new metadata stuff. Because we base that on RDF, the manifest will also be RDF-based. It gives us the extensibility we want to provide (extension developers, for example, can add extra metadata they may need), without having to worry about breaking compatibility. The primary addition we've made is a mechanism to bind a stable URI to in-document content node ids and files. This is conceptually not all that different than what I see in OPC; it's just that the unique IDs are in fact URIs. Among other things, in the RDF context that allows further statements to be bound to those URIs. Bruce D'Arcus | July 29, 2007 01:02 PM

Welty gave a rapid-fire look at the realities of open source in government. "The doors have been blown open in California," he said. "In 2004 when Governor Schwarzenegger signed the California Performance Review a section called State Operations #10 specifically authorized the use of open source." Operations #10 says: "Departments should take an inventory of software purchases and software renewals in the Fiscal Year 2004-2005 and implement open source alternatives where feasible."

Microsoft was invited, and did join the OASIS Open Office XML File Format TC as a founding member with observer status. Although the name of the TC was changed in September of 2004 (at the request of the EU) to "OpenDocument", Microsoft remains a member with observer status. All that need be done to convert their status from observer to voting member is to notify the TC Chairman of your intentions, show up for two consecutive phone conferences, and you are a voting member. It's that simple.

As far as I can tell in the Massachusetts poster-child case, ODF has simply come to mean whatever OpenOffice.org does

By Marbux posted Jun 19, 2007 - 3:16 PM Asellus sez: "I will not say OOXML is easy to implement, but saying ODF is easier to implement just by looking at the ISO specification is a fallacy." I shouldn't respond to trolls, but I will this time. Asellus is simply wrong. Large hunks of Ecma 376 are simply undocumented. And what's more, absolutely no vendor has a featureful app that writes to that format. Not even Microsoft. There's a myth that Ecma 376 is the same as the Office Open XML used by Microsoft. It is not. I've spend a few hundred hours comparing the Ecma 376 specification (the version of OOXML being considered at ISO) to the information about the undocumented APIs used by MS Office 2007 that recently sprung loose in litigation. See http://www.groklaw.net/p...Rpt_Andrew_Schulman.pdf Each of those APIs *should* have corresponding metadata in the formats, but are not in the Ecma 376 specification.

An intriguing idea is whether we can have it both ways. Suppose you are in an ODF editor and you have a "Save for archiving..." option that would save your ODF document as normal, but also generate a PDF version of it and store it in the zip archive along with ODF's XML streams. Then digitally sign the archive along with a time stamp to make it tamper-proof. You would need to define some additional access conventions, but you could end up with a single document that could be loaded in an ODF editor (in read-only mode) to allow examination of the details of spreadsheet formulas, etc., as well as loaded in a PDF reader to show exactly how it was formated.

The first time I heard about OpenDocument Foundation people not happy with ODF is from Stephen McGibbon post about Gary Edwards disagreement with Sun. Then comes Rob Weir’s that OpenDocument Foundation had moved away from OpenDocumentFormat. With Rob Weir post I sense some crack in OpenDocument Foundation over ODF. While Weir’s post continues its tradition of building up evidence to support his argument, he is known to be a very passionate guy about ODF and is not shy about attacking opposition, any opposition to ODF. Hence, in this respect, I believe I have to exercise a certain amount of caution when Weir start attacking someone new. Today, I came across Jason Matusow’s happy rambling about how OpenDocument Foundation is unhappy about ODF and appears to be supporting a single document format. Matusow view it as an argument that the “one document format” theory does not work. More on this later. Hmmm… Did OpenDocument Foundation change direction away from ODF? and what is this Compound Document Format (CDF) thing that seems to be the new love of OpenDocument Foundation.

Standardization by Corporation Maybe i spoke to soon. This just came in from ISO, the resignation letter of the SC34WG1 Chairman who has completed his three year term. There is a fascinating statement at the end of the Martin Bryan letter. "The disparity of rules for PAS, Fast-Track and ISO committee generated standards is fast making ISO a laughing stock in IT circles. The days of open standards development are fast disappearing. Instead we are getting “standardization by corporation”, something I have been fighting against for the 20 years I have served on ISO committees. I am glad to be retiring before the situation becomes impossible..." When corporations join open standards or open source efforts, they arrive with substantial but most welcome financial and expert resources. They also bring marketshare and presence. And, they bring business objectives. They have a plan. As long as the corporate plan is aligned with the open standards - open source community work, all is fine. In fact it's great. For sure though there will come a time when the corporate plan asserts it's direction, and there is possible conflict. At this point, the very same wealth of resources that were cause for celebration can become cause for disappointment and disaster. One of the more troubling things i've noticed is that corporations treat everything as a corporate asset to be traded, bartered and dealt for shareholder advantage and value. This includes patents and interoperability issues which not surprisingly are wrapped into open standards and open source efforts. Rather than embrace the humanitarian – community of shared interest drivers of open standards and open source, corporations naturally plot to get maximum value out of the resources they commit. A primary example of this is Sun's use of OpenOffice, ODF, and an anti trust settlement disaster that left them at the mercy of Microsoft.

The reasons for the move to CDF was improved compatibility with Microsoft’s OOXML format the foundation claimed at the time. Cris Lilley from W3C contradicted. CDF is not an office format, and thus not an alternative to the Open Document Format. This turn-down is likely the reason for the abrupt ditching of the foundation.

Sorry Shish, you're wrong about ODF 1.2 Try ODF 1.5 or ODF 2.0, maybe. The metadata requirements for ODF 1.2 actually did include two way lossless translation capability. Unfortunately these features did not survive the final cut, and were not included in the April 2007 submission. You might also want to check the February 23, 2007 metadata proposal from Florian Reuter. That also would have delivered the goods and perhaps put ODF that grand convergence category of usefulness across desktops, servers, devices and web systems currently the exclusive domains of MS-OOXML and CDF+. Florian had devised a means of using metadata to describe the presentation aspects of content and structural objects. Very revolutionary. And based on the simple notion that bold, font, margins etc. are simply metadata about content and style objects. Where the train came off the track had to do with the concept of an XML ID means of linking metadata to content. Not that there was anything wrong with this mechanism. It's actually quite clever. What went wrong was that Sun insisted that only those elements approved and supported by OpenOffice would be allowed to make use of XML ID metadata. For independent developers, this is a serious constraint. Because of this constraint, the metatdata sub committee started off with six elements supported by OOo that metadata could be appied to. IBM then came in and asked for eleven more elements having to do with charts and graphs. The OpenOffice crew decided they could support this, so in they went. Then an interesting question was posed, "How are independent developers supposed to submit elements for metadata consideration?"

Sorry Shish, you're wrong about ODF 1.2 Try ODF 1.5 or ODF 2.0, maybe. The metadata requirements for ODF 1.2 actually did include two way lossless translation capability. Unfortunately these features did not survive the final cut, and were not included in the April 2007 submission. You might also want to check the February 23, 2007 metadata proposal from Florian Reuter. That also would have delivered the goods and perhaps put ODF that grand convergence category of usefulness across desktops, servers, devices and web systems currently the exclusive domains of MS-OOXML and CDF+. Florian had devised a means of using metadata to describe the presentation aspects of content and structural objects. Very revolutionary. And based on the simple notion that bold, font, margins etc. are simply metadata about content and style objects. Where the train came off the track had to do with the concept of an XML ID means of linking metadata to content. Not that there was anything wrong with this mechanism. It's actually quite clever. What went wrong was that Sun insisted that only those elements approved and supported by OpenOffice would be allowed to make use of XML ID metadata. For independent developers, this is a serious constraint. Because of this constraint, the metatdata sub committee started off with six elements supported by OOo that metadata could be appied to. IBM then came in and asked for eleven more elements having to do with charts and graphs. The OpenOffice crew decided they could support this, so in they went. Then an interesting question was posed, "How are independent developers supposed to submit elements for metadata consideration?"

As you know the so-called OpenDocument Foundation has been telling the world that CDF is a better approach than ODF. Updegrove met with W3C's Chris Lilley, the "go-to guy guy at W3C to learn what W3C's CDF standard is all about." Lilley says CDF can't replace ODF. It's not suitable for use as an office format, and he's mystified by the pronouncements of the Foundation. Here's what Updegrove reports: To find out the facts, I interviewed Chris Lilley, the W3C lead for the CDF project, and his answer couldn't have been more clear: "The one thing I'd really want your readers to know is that CDF was not created to be, and isn't suitable for use as, an office format." In fact, it isn't even an format at all - although it has been matched for export purposes with another W3C specification, called WICD - but WICD is a non-editable format intended for viewing only. Moreover, no one from the Foundation has joined W3C, nor explained to W3C what the Foundation's founders have in mind. It is highly unfortunate that the founders of a tax exempt organization that solicited donations, "To support the community of volunteers in promoting, improving and providing user assistance for ODF and software designed to operate on data in this format," should publicly announce that it believes that ODF will fail. By endorsing a standard that has no rational relationship to office formats at all, they can only serve to confuse the marketplace and undermine the efforts of the global community they claimed to serve. So, there you have it, straight from the horse's mouth. CDF can't replace ODF, according to Lilley. It wasn't designed to be used as an office format. It's good for other things. So, was all this media push really about ODF? Or about damaging it with FUD and giving support to Microsoft's assertion that the world craves more than one office format standard so we can all struggle with interoperability complexity for the rest of our born days? And is it a coincidence it all happened on the eve of the next vote in February on Microsoft's competing MSOOXML? Was Microsoft behind this? Or did they just get lucky? Microsoft representatives, like Jason Matusow, certainly gave support to what the 3-man crew was saying, so much so that ZDNet's Mary Jo Foley wrote that, "the ODF camp might unravel before Microsoft’s rival Office Open XML (OOXML) comes up for final international standardization vote early next year." Dream on. ODF is doing fine. It's the OpenDocument Foundation that is shutting down. But here's my question: did the Microsoft reps not understand the tech, that CDF can't replace ODF? How trust-inspiring do you find that? Or did they think that *we'd* never figure it out? Whatever the story might be, unfortunately for Microsoft, people aren't as dumb as Microsoft needs them to be. FUD has a very limited shelf life in the Internet age. There is always somebody who knows better. And they'll tell the world.

Open Document Format The panel discussion will focus on a single question: what should the user community do, what actions should they take in light of competing Open Document Formats? Each of our industry experts will be asked to present their practical response.

XML 2007 Conference XML 2007 is the world’s largest and longest-running conference devoted to XML and other open data and document technologies. Our theme for 2007 is XML in Practice, focusing on the lessons learned from implementing XML in production-grade systems. When? Monday 3 December–Wednesday 5 December 2007 Where? Marriott Copley Place, Boston, MA  

The OpenDocument Foundation has announced its plans to sever itself from participation in or further advocacy of its namesake office document format in favor of the World Wide Web Consortium's XHTML (Extensible HTML)-based Compound Document Format. Although the OpenDocument Foundation is a fairly small organization, the group sports a certain cachet that stems from the ODF-to-MS Office plug-in that the group announced--but did not release publicly--about a year and a half ago. At the heart of the rift between the Foundation and the rest of the ODF backers--led by Sun and IBM--lies a dispute over the proper strategy for achieving round-trip document fidelity between Microsoft Office and ODF-consuming applications, such as Sun's OpenOffice.org or IBM's Lotus Symphony.

Nobody has invested more to defeat Microsoft Corp.'s Open XML document format than IBM Corp. So why is IBM supporting Open XML in a handful of its products? According to technical documentation on IBM's own Web sites, Big Blue already supports Open XML, the native file format of Microsoft Office 2007, in at least four of its software. However, Microsoft Office users interested in testing or switching to Lotus Symphony, IBM's upcoming challenger to Office, may be disheartened by signs that IBM won't budge from its stance that it will only support documents created in Office 2003 and prior versions.

Instead of dialing 411 on your phone and paying the service fee, dial 800-GOOG-411

Send the name of the business and the city or the ZIP code to GOOGLE. (Type GOOGLE into the address or number field, like you would if you were using a phone number.) Google will text you back with the address and phone number.

If the OOXML format in its current form cannot get made into a true ISO standard, it could lock Microsoft out of any future plays in what could be the biggest IT revolution to date. Here are the pieces of the puzzle that fit together for me:

"Amazon SimpleDB is a web service for running queries on structured data in real time."

"Structured data." And what's a good way to contain such data? In well-built structured data file format of course. Like, for instance, the Open Document Format (ODF). And who has a vested interest in ODF? IBM certainly does. And so does Sun. And these two companies, along with Google, Microsoft, and I'm sure many others, realize that if cloud computing does indeed take off, then it will be the file format that makes the whole thing work. Which is why Microsoft feels it must get their format standardized. Even with tactics that ironically have started to attract the attention of the EU again. How else can they get a piece of the cloud pie?

David continues his deep dive into the curious case of the OpenDocument Format and the OpenDocument Foundation.