Group items tagged

# re: Office Open XML final draft!!! @ Wednesday, October 11, 2006 1:46 PM The past incarnations of DrawingML have been chaotic. It would be interesting, out of curiosity, to get an accurate history of what changed over time, perhaps to better understand what is supported in what. Here is my take, I am pretty sure I got at least 50% of it wrong :-) - pre-Windows 95 era, Word, Excel and Powerpoint use their own vector drawing layer used to draw shapes, pictures, diagrams, art and charts. Powerpoint, acquired by Microsoft in 1987, has by far the advanced drawing layer (bi-linear gradients, opacity, ...), codenamed Escher (in reference of the famous mathematician). - In Office 95, it is decided to reuse the Powerpoint vector graphics layer in Word and Excel. Migration begins. - Migration ends with Office 97 where both Word, Excel and Powerpoint use the same vector graphics layer, publicly known as MSO (mso97.dll) - In Office 2000, it's all craze about internet and Word tries to export WYSIWYG html. For that end, mark up extensions must be added to account for the MSO drawing layer. Hence the VML (Vector Markup language). Excel and Powerpoint don't support it. Internet Explorer natively supports VML (Internet Explorer's Direct animation vector drawing layer dismissed for performance reasons). - In Office XP, VML migration ends and both Word, Excel and Powerpoint support VML whenever a document is saved as a "Single web page archive" (.mhtml extension). - In Office 2003, nothing changes. - In Office 12, MSO gets rewritten with backwards compatibility in mind. The vector drawing layer uses more sophisticated drawing functionalities which makes it easier to draw themed, 3D realistic  objects. Technically, the differences are akin to the differences between GDI and GDI+. This new shared library is known as E2O and the corresponding mark up language is known as Drawing ML (Ecma TC45 specs). - In Office 14, ??? perhaps the drawing layer is rewritten, again, to 1) use WPF 2) to allow plugins, hence enabling much more sophisticated do-it-yourself scenarios. Use cases : custom charts ; BI analysis tools. Stephane Rodriguez

Opponents to OOXML, which include IBM (Quote) and the Open Document Foundation, have argued that Microsoft's specifications are unwieldy and that the standard application is redundant with the Open Document Format (ODF), which already exists. Microsoft has countered that the OOXML format is valuable because it is closer to Office 2007 and is backwards-compatible with older versions of Office. "Although both ODF and Open XML are document formats, they are designed to address different needs in the marketplace," the company wrote in an open letter published earlier this month.

"ECMA 376" is a set of file formats subject to ECMA and now to ISO. "Office 2007" is a set of file formats which extend "ECMA 376" file formats. Office 2007 file formats are undocumented per se. ECMA 376 are. ECMA 376 file formats are documented but only at a syntactic level. To realize the true meaning of every single attribute is to realize that the documentation is more like 600,000 pages, not 6,000. Of particular difficulty is to keep some kind of control over the virtually infinite combinations of such attributes. Quick analysis of the underlying schemas reveals that simple concepts such as text formatting is expressed in no less than 6 different and incompatible ways. This leads to thinking that the file formats were only designed to comply with existing legacy formats that themselves are the result of 15 years of inside/outside library aggregation (some of the libraries were bought from non-Microsoft vendors). In fact, the truth is, ask any reverse engineer third-party who worked with legacy formats, they'll tell you Microsoft essentially added angle brackets around the binary serialization in legacy formats. This makes for a very cool XML-based file format, not an international standard.

To be fair, Microsoft seeks to solve real world problems with respect to helping customers glean more value from their information. But the approach depends on enterprises adopting an end-to-end Microsoft stack—vertically from desktop to server and horizontally across desktop and server products. The development glue is .NET Framework, while the informational glue is OOXML.

Microsoft seeks to create sales pull along the vertical stack between the desktop and server.

Microsoft's major XML-based format development priority was backward compatibility with its proprietary Office binary file formats.

Fortunately for Microsoft, the DaVinci plugin is coming, which will enable Microsoft office applications to comply with ISO 26300. We all understand the financial issues that prompted the push to make OOXML a standard (see Tim's comment above and http://lnxwalt.wordpress.com/2007/01/21/whose-finances-are-on-the-line/ for more on this) and ensure continued vendor lock-in. However, OOXML is not the answer.

ODF can handle everything and anything Microsoft Office can throw at it. Including the legacy billions of binary documents, years of MSOffice bound business processes, and even tricky low level reaching add-ons represented by assistive technologies.

"We feel that the best standards are open standards," technology industry commentator Colin Jackson, a member of the Technical Advisory committee convened by StandardsNZ to consider OOXML, said at the event. "In that respect Microsoft is to be applauded, as previously this was a secret binary format." Microsoft's opponents suggest, among a host of other concerns, that making Open XML an ISO standard would lock the world's document future to Microsoft. They argue that a standard should only be necessary when there is a "market requirement" for it. IBM spokesperson Paul Robinson thus describes OOXML as a "redundant replacement for other standards". Quoting from the ISO guide, Robinson said that a standard "is a document by a recognised body established by consensus which is aimed at achieving an optimum degree of order and aimed at the promotion of optimum community benefits". It can be argued that rather than provide community benefit, supporting multiple standards actually comes at an economic cost to the user community. "We do not believe OOXML meets these objectives of an international standard," Robinson said.

First, what if Microsoft really is doing the right thing? Second, how can we avoid having two incompatible file formats? [Update: There’s been a lot of reaction to this piece, and I addressed some of those points here.]

On the technology side, the two formats are really more alike than they are different. But, there are differences: O12X’s design center, Microsoft has said repeatedly, is capturing the exact semantics of the billions of existing Microsoft Office documents. ODF’s design center is general-purpose reusability, and leveraging existing standards like SVG and MathML and so on.

The capabilities of ODF and O12X are essentially identical for all this basic stuff. So why in the flaming hell does the world need two incompatible formats to express it? The answer, obviously, is, “it doesn’t”.

This fight is a distraction. Recognize both formats as legacy defacto standards and move on. This is actually a very common precursor in a standards process. CDF provides an opportunity to do the job right. People should not be translating OOXML into ODF, there simply isn't the value there. It is much more likely that OOXML will be a live format in twenty years time than ODF. We have a common standards based document language today - HTML. OK so I have a bias here but there is much more HTML than anything else. HTML is just a document format and it is somewhat presentation oriented but modern XHTML is changing those problems.

The problem for "you" is that Microsoft is the one who has 400 million or so installs of the dominant de facto office suite in the planet. "You" can either try to get them to play nice with you by applying pressure intelligently, or you can organize an exciting jihad to stick it to them. In a make-believe world where companies choose technology based on, well, technical merits and openness, the second approach will usually work. In the real world though, the former option would have been a better idea. But when you have well-paid shills like Rob Weir (courtesy of IBM) and his co-religionists who rarely take a break from hating Microsoft (except for lame attempts at making fun [robweir.com] of Microsoft) it's difficult to get away from the join-us-or-die approach. It just feels so right, I guess. I'm going OT here but seriously, Weir is just the cat's meow. Every single time Microsoft has challenged his hyperbolic rants and outright lies he's essentially ignored them or just penned some more. He thinks the OpenDocument Foundation is an irrelevant fly-by-night fanboy club (which I guess is possible), but he has no problem quoting obscure African groups [robweir.com] and his groupie bloggers to prop up his "Microsoft is evil and Office sucks and remember, IBM had nothing to do with this post" arguments. If the man spent 1/10th as much time writing some code or documentation as he does bitching about the Office toolbar buttons, ODF would have conquered the world by now. With people like that at the helm it's not difficult to see why a document format controlled by a single company and an elite group of testy technorati has gotten to where it is now. Not that I think OOXML is a particularly good idea, but at least there's someone out there with the balls to point out that the emperor is buck naked. I guess they better get ready for the DoS attacks, hate mail and death threats.

Blame Sun for this. Sounds like a populist position, or maybe troll flamebait. I'll be generous and assume the former, despite the fact your post seems like a digest from an anti-ODF briefing paper. Disclosure: My job [sun.com] includes the task of receiving complaints about Sun and trying to get Sun to fix whatever causes the problem. If you have proof of any of your accusations, let me know. I may have some of my facts wrong below as I'm working from memory; I'd welcome correction. With a few small additions, ODF could have supported Office formats as well, but Sun would not allow this. That is indeed the constant assertion that the three guys who comprise the Foundation make. However, I have personally asked members of the ODF working group at OASIS and they tell me its not so. The Foundation guys wanted to add structures to ODF to preserve untranslateable tags in translated documents so they could be regenerated on the reverse translation. Sounds OK at first glance, but in practice it results in very brittle software solutions that work well in demos but not in real life. The proposal was thus rejected by the whole working group (not just the Sun employees). Rejected, that is, in conversation. A complete solution was never proposed for voting. To say Sun would not allow it ignores the actual dynamic of the working group (see below). Their policy is that ODF will support what is needed for StarOffice, and nothing more. Naturally every member of a standards group in the traditional standards process is looking out for the code base where they implement a standard, and will have serious questions of any feature that they regard as unimplementable. The features actually put to a vote by the guys from the Foundation would have resulted in very brittle implementations, highly dependent on the version of MS Office with which they were coupled. It may have been possible to come up with a solution that reduced this problem, but the discussion was not sustained. The assertion you make is not true in the general case.They control the ODF technical committee Untrue. The ODF TC [oasis-open.org] can have no more than three members from any one organisation and is not under the control of any organisation. The Foundation guys actually flaunted that rule at one point and sent many, many more representatives - OASIS had to step in to fix it. That intervention is one of the issues they have with OASIS, in fact. Sun happens to employ the people who act as Chair and Secretary to the TC but the voting remains democratic.and their patent license allows them to stop the ODF TC if the ODF TC goes in a direction Sun does not like. I've heard that interpretation of the patent non-assert covenant [oasis-open.org] that Sun has made regarding ODF, but it's untrue. Sun covenants not to enforce any patents against ODF implementations based on any spec it participates in. To the extent that versions of the spec after Sun's departure are based on version in which Sun was involved, that covenant remains in effect even in the unlikely event of Sun leaving the TC. Sun can't stop the TC from continuing its work. Are you relaying this all as hearsay, or do you actually have data to back up your accusations? If you have, I'd like to see it (genuinely).

A fatal flaw in your analysis By Marbux Posted Saturday 21st April 2007 08:15 GMT Your analysis contains a fatal flaw, Martin. That is your belief that adequate Microsoft XML <> OpenDocument translators will be available. In fact, all of the translators suck mightily and there is no prospect at all of them being perfected. The major problems are: (i) that Microsoft's XML formats seem deliberately designed to thwart their parsing with XPath, which is essential to XML transformations; (ii) that Microsoft's "XML" file formats include binary blobs, bitmasks, and multiple Windows and Microsoft dependendencies, all of which defy XML transformations; and (iii) OpenDocument assumes a richer page layout engine than Microsoft Word provides, so while DOCX can be completely mapped to ODT it is impossible to fully map in the other direction without declaring an MS Office interoperability subset of OpenDocument and ODF applications implementing a compatibility mode with reduced features. (That is more than somewhat ironic, given Microsoft's spin that it couldn't implement all of its features in OpenDocument. In fact, the exact opposite is true.) In fact, Steve Ballmer is on record as saying that the developers of the Novell-Microsoft-Clever Age plug-ins will not even attempt to achieve full fidelity file translations between the two formats. http://www.eweek.com/article2/0,1895,2050848,00.asp?kc=EWEWEMNL103006EP17A Those translators achieve at best far less conversion fidelity than existing file conversion filters between OpenDocument and Microsoft binary file formats such as the OpenOffice.org conversion filters, which achieve only about 80 per cent fidelity. The file format cognescenti know this. See e.g., the paper by Gary Edwards and Sam Hiser included in this edition of the European Journal for the Informatics Professional. http://www.upgrade-cepis.org/issues/2006/6/up7-6Hiser.pdf (PDF). (Note that I contributed to that paper.) And as also detailed in that paper, what works well enough for some of us does not necessarily work well enough for all. Anything less than full fidelity data conversions is absolutely unacceptable in the context of wholly automated business processes and is in fact illegal in various contexts, including government records. So your thesis doesn't fly. In fact, I'd go so far as to bet that you have been suckered by the Microsoft spin doctors. Another indication is your depiction of the file format wars as being waged primarily between IBM and Microsoft, a recent theme of Microsoft's public relations machine. While it is seductive to believe that the controversy is just another chapter in the war between major competitors, the pro-ODF camp is far broader than IBM. For example, nearly 20 governments recently opposed fast track processing of Microsoft's draft standard at ISO. Do you believe they were all carrying water for IBM? Government bodies in more than 50 nations have chosen to adopt ODF. http://opendocumentfellowship.org/government/precedent And dozens of developers now support the OpenDocument standard in their applications. http://opendocumentfellowship.org/applications While IBM has had a noteworthy role in proliferating the OpenDocument formats, there is a movement without a recognizable leader in the industry. When it comes to vendor influence on things relevant to ODF, Sun Microsystem's far outshines IBM. But in fact, a core group of open standards and free and open source developers and advocates -- inside and outside government -- have played a far larger role. This is a customer-driven phenomenon, not a vendor-driven effort as you portray. So I will respectfully suggest that you reexamine your position on these issues. Reasonable minds can differ, but not on the grounds you advocate.

CDF is one of the very many useful projects that W3C has been laboring on, but not one that you would have been likely to have heard much about. Until recently, that is, when Gary Edwards, Sam Hiser and Marbux, the management (and perhaps sole remaining members) of the OpenDocument Foundation decided that CDF was the answer to all of the problems that ODF was designed to address. This announcement gave rise to a flurry of press attention that Sam Hiser has collected here. As others (such as Rob Weir) have already documented, these articles gave the OpenDocument Foundation’s position far more attention than it deserved. The most astonishing piece was written by ZDNet’s Mary Jo Foley. Early on in her article she stated that, “the ODF camp might unravel before Microsoft’s rival Office Open XML (OOXML) comes up for final international standardization vote early next year.” All because Gary, Sam and Marbux have decided that ODF does not meet their needs. Astonishing indeed, given that there is no available evidence to support such a prediction.

By Marbux posted Jun 19, 2007 - 3:16 PM Asellus sez: "I will not say OOXML is easy to implement, but saying ODF is easier to implement just by looking at the ISO specification is a fallacy." I shouldn't respond to trolls, but I will this time. Asellus is simply wrong. Large hunks of Ecma 376 are simply undocumented. And what's more, absolutely no vendor has a featureful app that writes to that format. Not even Microsoft. There's a myth that Ecma 376 is the same as the Office Open XML used by Microsoft. It is not. I've spend a few hundred hours comparing the Ecma 376 specification (the version of OOXML being considered at ISO) to the information about the undocumented APIs used by MS Office 2007 that recently sprung loose in litigation. See http://www.groklaw.net/p...Rpt_Andrew_Schulman.pdf Each of those APIs *should* have corresponding metadata in the formats, but are not in the Ecma 376 specification.

The reasons for the move to CDF was improved compatibility with Microsoft’s OOXML format the foundation claimed at the time. Cris Lilley from W3C contradicted. CDF is not an office format, and thus not an alternative to the Open Document Format. This turn-down is likely the reason for the abrupt ditching of the foundation.

The decision to go with CDF has left some industry commentators scratching their heads, with arstechnica.com’s Ryan Paul noting that the decision is curious as CDF doesn't support “the full range of functionality required for office compatibility”. Paul does add, however, that the formats broad use of formats such as XHTML and SVG does give it a compelling edge.

From our perspective it would be better to aim for doing the job in ODF 1.2, even if that requires delay. We will oppose ODF 1.2 at ISO unless the interoperability warts are cleaned up. What the market requires is no longer in doubt. See the slides linked above and further presentations linked from this page, < http://ec.europa.eu/idabc/en/document/6474/5935>. Substantial progress toward those goals would seem to be mandatory to maintain Europe's preference for a harmonized set of file formats that uses ODF to provide the common functionality. Delaying commencement of such work enhances the likelihood that governments will tire of waiting for ODF to become interoperable with MS Office and simply go with MOOXML. We may not be able to force Microsoft to participate in the harmonization work, but we will be in a far better position if we have done everything we can in aid of that interoperability without Microsoft's assistance. As the situation stands, we have what is known in the U.S. as a "Mexican stand-off," where neither side has taken a solitary step toward what Europe has requested. We have decided to do that work via a fork of ODF; it is up to this TC whether it wishes to cooperate in that effort.

In a proposal submitted to the European Commission two weeks ago, Microsoft spelled out a range of promises related to Office, its desktop and server software, and other products to address antitrust concerns first expressed by officials in January 2008.

Beginning with the release of Office [2010], end users that purchase Microsoft's Primary PC Productivity Applications in the EEA [European Economic Area] in both the OEM and retail channel will be prompted in an unbiased way to select default file format (from options that include ODF) for those applications upon the first boot of any one of them," Microsoft said in its proposal [download Word document]

the fact is that Redmond could own this new space if it wanted to. All it would need to do is push interoperability and integration between lightweight Web versions of Office applications and its desktop fatware. Advanced features would be absent from the lightweight versions, but the company could ensure any Office doc would load on the Web -- whatever new desktop service packs and upgrades might appear -- and online document management could be integrated with Windows for offline access.