Effective XML

James Edward Gray II writes "I'm not an XML junkie and I thought this was a very good book, so I'm betting that XML aficionados will love it. Effective XML covers 50 best practices that all developers should know and use. This amounts to a book of distilled wisdom that will push you a good distance up the chart of XML mastery." Read on for the rest of Gray's review.

Before I tell you what's inside though, let me tell you what you won't find in these pages. Primarily you need to know that this book does not teach XML. I know a lot of books say that, yet still include an introduction or appendix that covers the basics, but this isn't one of them. You're expected to know XML from page one. Even syntax is only covered from a proper usage angle. Personally, I appreciated this. It always bothers me when an obvious non-beginner's book starts off by wasting a chapter on things I should already know. You just need to be aware when you buy that you won't learn XML here. Knowledge of namespaces, DTDs, the W3C's Schema Language, XSLT, and more aren't strictly required to get something out of this book, but they certainly would help you get a lot more out of it.

What you will get here is coverage of fifty miscellaneous topics spread across four sections on "Syntax", "Structure", "Semantics", and "Implementation". In "Syntax", ten topics delve into the details of things like DTDs, entity references and the XML declaration itself. It may sound silly to dig deep into a single line of XML that simply declares the format, but I doubt you will think so after reading that topic. There's a lot going on in that line and you want to be in control of those decisions instead of just copying and pasting. Entity references are an even smaller chunk of XML output, but they too get illuminated by a rare insight on how and when they should be used, and for what. Did you know that it is possible to write a namespace savvy DTD? I do now and I learned that in this section as well.

The second section of the book covers "Structure", and to me it was the best part. This collection of seventeen topics is loaded with good advice about how to build an XML document that will be ideal for anyone who needs to work with it. Here you see how metadata should be stored in XML, get tips on embedding binary content, learn which schema language is better for which tasks, and finally understand rare XML constructs like processing instructions and exactly what they are for. Additionally, there's a lot of general advice on the right way to mark up content that's really worth its weight in gold. Just one example of what I learned here is that I under appreciate mixed content for great constructs like <name><given>John</given> <family>Doe</family>, <title>Ph.D.</title></name>. If you like that, you'll enjoy this whole section.

Section three, "Semantics", deals primarily with parsers and their APIs. Again, you won't learn any APIs here. What's covered is their strengths and weaknesses and why you should choose a given API for a given task. SAX and DOM are the main focus of these ten topics, but there are other details sprinkled in, like XPath.

The fourth and final section is all about "Implementation". The thirteen topics here address client-side XML styling, server-side transformations, signatures, encryption, compression, and more. My favorite topic here was a terrific coverage of Unicode and how it affects XML. All developers should know at least as much about Unicode as what's printed here and this is a fine source to learn it from.

One thing that really stands out in the whole text is that the author isn't afraid to cover the dark side of XML. He will tell you where the design process was less than perfect, which tools have little practical value, and some of the problems with where XML technologies are headed. This isn't complaining though. All of this is targeted at how it affects XML developers today. You learn what you can safely skip and what should be outright avoided. The author even tells you what XML is bad at and gives you advice about when you shouldn't use it. That's the mark of a man who knows his subject, if you ask me.

All told, I think the author failed to completely convince me his way is perfect on only 2 topics. That means I learned 48 expert XML tricks. Surely that's worth the cost of the book in time and money. This isn't the first XML book you need, but I think it is the second XML book everyone should read.

---

You can purchase Effective XML from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.

Binding

[2.7182 (819680)]

I love the book, but once it encountered a humid day the binding fell apart. Anyone else have this experiance ?

Re:Binding

[elid (672471)]

I'm wondering why so many bulky computer books are softcover...

Re:Binding

[Monkelectric (546685)]

I once tried to "dry" a book that was rain soaked in the oven at very low temp ... my father turned the oven up to preheat some food ... physics book al larange

Re:Binding

[xaqar (112761)]

physics book al larange

Surely you mean physics book a lagrange ...

Hey, come on...

[Anonymous Coward]

XML is all about loosely bound interfaces.

Get with the program.

hmmm

[elid (672471)]

All told, I think the author failed to completely convince me his way is perfect on only 2 topics.

Any ideas what those 2 are?

Re:hmmm

[johannesg (664142)]

All told, I think the author failed to completely convince me his way is perfect on only 2 topics.

Any ideas what those 2 are?

1. XML is a good idea.

2. XML is an efficient format for wire protocols, internal program messages, and databases.

Actually I'm just kidding; there are definitely places where it has a purpose. Although I will probably never get why a closing tag requires a repeat of the file opening tag name...

Re:hmmm

[elharo (2815)]

Ever try to debug deeply nested LISP in a plain vanilla text editor? Ever try to find exactly which closing parenthesis is missing where? That's why end-tags have names. It's pure human factors. Computers don't care about this. People do.

SGML (XML's precursor) did have minimized end-tags like . Experience proved this caused more pain than it alleviated. Hence the lack of minimized end-tags in XML.

I believe you meant...

[game kid (805301)]

...</> but yeah, you're right. Helps do away with the (ugh!) parenthesis matching crap in LISP, so actual people can edit it too, verbose as it may seem.

The Problem With XML

[osewa77 (603622)]

Is that it's not a very machine-friendly language (more wordy than it ought to be; parsing of tags is not very efficient) and it's not a very human-friendly language (the human style is free-style, really). I don't think it's a very good universal data description language. sorry that I had to go on a bit of a tangent...

Re:The Problem With XML

[elid (672471)]

What is inefficient about machine-parsing of XML (not a troll, I'm really curious)? It seems to me to be a logical structure for information.

Re:The Problem With XML

[redhog (15207)]

Because you need to _parse_ it in any way at all. Simply holerith/runlength-encoding the data would be much better.

Take XPath as an example. How do you extract the fragment pointed to by the expression

foo/bar/fie[@naja='hehe']

? You read the document, counting opening and closing tags, until you read in a foo-tag at topp-level then you continue, counting as before, until you, before a foo-ending tag at topp level, reaches a bar-tag at second level, and then until you reach a fie-tag with the attribute naj

Re:The Problem With XML

[GeckoX (259575)]

...it is inefficient machine wise because it's parsing bytes one bit at a time which is an extremely slow and computationally expensive operation.

Try writing an XML parser in binary (no compiler) and see how difficult it is.

Seriously, your arguments are not sound in this context.

Re:The Problem With XML

[EddWo (180780)]

Sounds like you've been reading Joel.
http://www.joelonsoftware.com/articles/fog00000003 19.html [joelonsoftware.com]

Re:The Problem With XML

[Proc6 (518858)]

This is like comment #492 that XML is slow and a poor format to use for databasing.

People are trying to use XML for something other than for which it was intended then complaining at the sub-standard results. Surprise? XML is a common format to make it possible to move data between different, I'll use the word "domains" (as in division not URL), it should be used for "just" that.

In other words, XML should be a "transport" mechanism. It's so I'm not writing a new parser by hand everytime some wanker like you sends me a file in yet another made-up-on-the-spot type. Your example is relatively clean but in the real world as the data gets harder to describe, humans start to make more ignorant made-up-on-the-spot rules like "Well ok if theres a sub record the line will start with a -, well ok it could be a + too, if the subrecord can only contain numbers... no you know what lets make it -n if the sub records can contain numbers only..". No matter how ingenious your "format" is, the problem isn't your format, its that your format isn't my other customers format.

XML should be used in scenarios where the time spent being able to use all the readily available XML parsing and validating tools you don't have to re-invent the wheel writing is more than the milliseconds saved parsing a longer document "once".

Don't use XML as your main, permanent, datastore for a gigantic database and complain. It's not for that. Its for when I need a copy of your data and I don't want to pay for a copy of "JackoffDb version 5" that you run, or hire a team of programmers to write a translator just to read your files. Gimme XML, I can take that and understand its contents and schema with ease, then Ill import it into my own system here.

Re:The Problem With XML

[sapgau (413511)]

Yes, that's implementation.

But the question was if it is a universal data description language. Sending binary will kill your data the first time you try to comunicate to a macitosh or Unix system (big endian, little endian).

The common lowest denominator is just text, so to describe any structure we have trees in XML.

Probably the confusion is the influence of Object Oriented design with Entity Relationship schemas in databases. The way that one-many relationships are described in both areas makes sparks

Re:The Problem With XML

[cluckshot (658931)]

To be specific having spent the last 3 years working on XML I can suggest that there are numerous problems with XML.

XML Tagging is tedious and stupidly top heavy in overhead. Contrary to being human friendly it isn't. XML Tagging should be shortened to a simple set of defined tag names and then type definitions. After that each name would be addressed by an index. Typing of data should be contained in a process to extract that is associated with either the tagging index or an over the top wrapper which

Re:The Problem With XML

[eap (91469)]

Of course someone else might find a good way to tell me why I should use 40 characters to transmit what should have taken 10 characters and how it should have been faster or more efficient some way to use it. The whole concept was definitely good for a lot of programmer payroll time.

I would not be so quick to dismiss XML because of traditional arguments. Having worked with several different ways of storing and transmitting structured information, I can say without question XML comes out easiest in the end.

If you're only transmitting 10 characters, then yes XML is not for you. However, if you're describing dynamically changing, complex data, even in large amounts, XML is very handy.

There are turnkey parsers for XML that are well tested and which allow the client to see an abstracted view of the data as an object, at any level of detail desired.

Platform independence is built in.

It's easy to syntactically validate XML, as it's done automatically. It's also easy to isolate logical validation into discrete units since XML couples easily to object oriented designs.

Very large XML messages can be processed quickly using a pull parser. Pull parsing is faster than SAX and has the intuitive benefit of being client driven, not event driven.

Re:The Problem With XML

[dustmite (667870)]

In my experience the main reason our clients want their data in XML is that most of them are afraid of single-vendor lock-in to proprietary formats, especially to smaller vendors they perceive could more easily go under - in other words, they want data longevity and a format they can easily process their data if they need to. And this trumps the inefficiency. Especially as people mostly transfer such documents across high-speed LANs and store them on modern 120+ GB hard disks and open them on machines with

Re:The Problem With XML

[Procyon101 (61366)]

I think that I shall never smell
A standard worse than XML.
A standard I am loath to use
Though offered parsers to abuse;
The designers couldn't pass a class,
CS201 can kiss their ass;
A structure no one can traverse
pre and post order routes are cursed;
What are it's types you cannot tell;
Though it promised self referential.
Standards are assigned by committee,
But any fool can make a tree.

Re:The Problem With XML

[Rei (128717)]

Yes, it is human-friendly. But what % of xml files are written or read by humans? As far as machines are concerned, xml is awkward and bulky, and they're the ones who deal with the xml the most.

Re:The Problem With XML

[Further82 (720625)]

They are supposed to be written so people can make programs to read the data without spending hours reading huge cryptic implementation manuals. You forget that computers do not program themselves yet. People still need to do that and XML is easier for people to read and thus easier for them to make programs to read. When machines can program themselves...we wouldnt be having this conversation.

Re:The Problem With XML

[arkanes (521690)]

In fairness, this is only true if there's been an effort made by the XML schema designer to make it so. It's perfectly possible, and even easy, to make perfectly valid and well-formed XML which is inscrutable.

Join the Dark Side

[TripMaster Monkey (862126)]

One thing that really stands out in the whole text is that the author isn't afraid to cover the dark side of XML.

[Obligatory Star Wars joke]

Re:Join the Dark Side

[TripMaster Monkey (862126)]

XML: You killled my father!

HTML: No, XML....I am your father!

XML: That's impossible!

HTML: Grep your code...you know it to be true.

XML: NOOOOOOOOOOOOOOOOOO!

Re:Join the Dark Side

[p0rnking (255997)]

I know that this was an attempt at being funny, but I'm curious, did you say this because the author mentioned "darkside" in his review, or because html came before xml, or a combination of both?
The reason why I ask, is because I thought "XML" is older than HTML, and is a simpler version of SGML (?), which HTML is also derived from ... no?

damn

[pyrrho (167252)]

I want to say something funny about XML, but there is nothing.

Re:damn

[Ivan Todoroski (132826)]

<metoo> <subject>I</subject> <adverb>completely</adverb> <verb>agree</verb> <preposition>with</preposition> <object>you</object> <punctuation>.</punctuation> </metoo>

n00b - help!

[dsginter (104154)]

After seeing what can be done with simple javascript and XML [apple.com], I'm wanting to get into this. Can someone point me to the best OSS way to do this (I can hear the groans now). I like Postgres but I don't see much in the way of getting it to spit out XML. I like documentation... MySQL? Am I missing something?

Re:n00b - help!

[aldoman (670791)]

XML is totally overhyped, which sadly makes people think it is a lot more complex than it is.

Think of it more like CSV than mySQL. It's just a format for representing structured data. It also happens to be that it's quite easily read by humans.

Yes, you can do incredibly advanced things with XML, but there is nothing you can do in XML compared to your own propietary data storing language.

The reason people use XML instead of writing their own data storing format is simple:- there is a lot of tools for parsing it, which you'd have to write yourself if you had your own format.

As for the javascript and XML example, it's impressive, but it's far more javascript than XML.

Re:n00b - help!

[Piquan (49943)]

The coolness of XML is not in the format (which sucks); it's in the technologies around it.

RelaxNG, for instance, lets you verify that your XML file is built correctly for your app: you write a RelaxNG spec for your XML file format, and then it verifies that all the mandatory fields are there, in whatever order is necessary, with the correct datatypes, etc, etc. RelaxNG processors are part of most major XML libraries now, so if you're writing Perl you can just tell your Perl library to validate your file and it's done. If you're editing in Emacs (with nxml-mode), you can point Emacs at your RelaxNG file, and have tab completion, error highlighting, etc, etc-- all customized for your file format.

XSLT lets you take an XML file and perform transformations on it into another (possibly XML) file format. Need to convert XML into SQL INSERTS? Piece of cake. I use it to extract particular parts of an XML file and convert them into a significantly differently-ordered Lisp structure.

Most modern web browsers are becoming CSS engines rather than HTML engines. So you can stick a CSS stylesheet reference at the top of your XML file, and have the CSS generate something that looks like what you want the user to see. The data file looks good to the app, and looks good to the user. You can also (with some browsers) use more powerful transformations using something like DSSSL or XSLT.

DOM for a standard data manipulation API, so each program you write doesn't have a different data access language. XPath as a language to perform more complex queries. XML Namespaces to let users or apps tag their data with extensions. XInclude for data sharing. All of these are things you get for free with XML.

All of these are general technologies, not specific apps. So they should be usable in most major libraries in most languages. (If you're using Perl, I'd recommend XML::LibXML.)

Don't think of XML as just a file format, because that part sucks. Think of it as a buffet table of technologies. When you write a program, 10% is to do the program's processing; the other 90% is to handle I/O, data management, and other housekeeping. Using XML lets you get a lot of that for free.

PS: I'm not an XML fanatic. A year ago, I was told to use XML for one particular project and was disgusted at the idea. I still think that XML gets a lot wrong, but I've come to recognize what benefits XML provides.

Re:n00b - help!

[Doctor Faustus (127273)]

XSLT lets you take an XML file and perform transformations on it into another (possibly XML) file format. Need to convert XML into SQL INSERTS? Piece of cake. I use it to extract particular parts of an XML file and convert them into a significantly differently-ordered Lisp structure.

I really like XSLT for code generators, with the meta-data in XML. I do, however, miss the sheer perversity of using Access VBA to generate Java.

Re:n00b - help!

[DarkHelmet (120004)]

Why don't you have your xml file really be PHP that exports XML.. Then you can do something like:

<?
// skip mysql init stuff:

$dom = new DomDocument();
$root = $dom->createElement("root");
$dom->appendChild($r oot);

$items = $dom->createElement("items");
$root->appendChild( $root);

$sql = "select * from items order by Id asc";
$qu = mysql_query($sql);

while ($s = mysql_fetch_array($qu, MYSQL_ASSOC))
{
$item = $dom->createElement("item");
$items->appendChild($item);

foreach ($s as $k =

Dear XML-Junkies,

[Letter (634816)]

<letter>
<salutation>Dear XML-Junkies</salutation>
<body>
I type all my business letters in <link href="http://www.google.com/?q=XML>XML</link>. Sometimes it can be a bit <link href="http://dictionary.reference.com/search?q=ver bose">verbose</link>.
</body>
<signature>
<name ><nickname>Letter</nickname></name>
</signature>
</letter>

Re:Dear XML-Junkies,

[refactored (260886)]

nsgmls:letter.xml:1:0:E: no document type declaration; will parse without validation
nsgmls:letter.xml:4:78:W: character "" is the first character of a delimiter but occurred as data
nsgmls:letter.xml:4:78: open elements: letter body
nsgmls:letter.xml:4:114:W: character "" is the first character of a delimiter but occurred as data
nsgmls:letter.xml:4:114: open elements: letter body
nsgmls:letter.xml:4:132:E: net-enabling start-tag not immediately followed by null end-tag
nsgmls:letter.xml:4:132: open elements: le

XML Seems Cool

[Aknaton (528294)]

XML seems cool to me. I like the thought of being able to design a schema to suit my personal needs. But when it comes time to make use of that schema and actually keep data in it, it seems to be useless, as least as far as an end user (non programmer) is concerned.

Do I have the wrong impression?

Re:XML Seems Cool

[gizmofan (862506)]

XML is a way of decorating data with meaning but it's not the most efficient or effective way of doing it. From a software point of view it's expensive to parse - incredibly so when heavily nested/structured and just in terms of size it can be huge in terms of the raw data that it's actually transmitting. The main problem I have with the way XML is often used is the fact that's it's the worst of both worlds. It documents the data that it encapsulates badly from a human point of view (it's difficult to read

Re:XML Seems Cool

[Creosote (33182)]

XML isn't really "useless", but keeping data in XML files is probably a bad idea. What if you mistype one character in one tag for instance? What does your document mean now?

This is sort of like saying that programming in C is a bad idea, because what happens if you mistype a function name, and your program refuses to run? That's what debuggers are for. Likewise, the XML world is full of open-source or low-cost schema-aware editors and validators. Minimally you should use an editor that knows which elemen

Yes, it's a great book ... so far

[page275 (862917)]

I just bought a book a couple days ago. Great one so far, even it does not teach you XML, but for anyone who have even small experience with XML, the book is still great. Just like me, you will pick up really fast.

FYI

[Anonymous Coward]

Bookpool has it for $28.50 [bookpool.com]. Don't click the bn sponsored link (where it's a whopping $44.95).

PS, I don't work for Bookpool, I hate it when /. gets a kickback from doing something dumb like clicking the link to overpriced merchandise.

Try the other "Effective" books, too

[Eric Giguere (42863)]

If you like this book, don't forget to check out Scott Meyers' Effective C++ or Joshua Bloch's Effective Java. Both are great. I devoured Meyers' book when it first came out, and I was happy to see Bloch's book was similarly useful. There is also an Effective Perl book out, but I don't know how good it is -- it follows the same general format, but hasn't been updated since 1997. (Neither has the C++ book, but C++ hasn't changed that much since then.)

Eric
See your HTTP headers here [ericgiguere.com]

Just because you CAN...

[IGnatius T Foobar (4328)]

Sometimes, the most effective use of XML is to simply not use XML at all. XML is a wonderfully useful tool when applied correctly. It's architecture-independent and is a great way to communicate unstructured and/or hierarchial data.

Sometimes, though, your data can be simple enough that XML is overkill. Software developers need to make themselves aware of situations when they might be better served by a simple "flat file" of delimited data. In situations like this, using XML can amount to what I like to call "gratuitous complexity."

Always use the right tool for the job.

A perfect eXaMpLe of a good use for XML

[swrider (854292)]

There are valid uses for XML. Just look at http://www.x-cp.org/ [x-cp.org]

Delicious irony

[dubbayu_d_40 (622643)]

ridiculing the verbosity of xml, on a web page.

Re:Delicious irony

[owlstead (636356)]

Yeah, but this is slashdot HTML, as far away from XML as it can be.

so do we love or hate Mozilla and FireFox today?

[roman_mir (125474)]

After all XUL and RDF together with js, css and resource files - that's what makes FireFox tick.

What's so bad about XML?

[rikkus-x (526844)]

I give customers a specification showing how I would like data sent to me. They can use the specification to tell them how to store their data, because they can read it. They can check that their data matches the specification, because their machine can read it.

When I receive their data, I can check that it matches the specification, because my machine can read it. If there is something wrong with their data, I can point out where it's broken, because it's human-readable.

Writing specifications is easy. Writing generators and parsers is easy. The tools are ubiquitous. Generation and parsing are usually fast 'enough'. The standards are freely available. Complex data structures may be described. Data may be transformed using a common language based on XML itself.

Yes, I'd like it to be easier to write XML parsing tools. Yes, I'd like it to be easier to write tools which handle XML more efficiently. No, the two points above don't make XML the devil's data encapsulation.

Rik

Importance vastly overstated

[s88 (255181)]

The review almost sold me on the fact that I could actually learn something from this book. Looking at the sample chapters here [cafeconleche.org] told me the truth

Re:Bah

[Anonymous Coward]

The essence of XML is this: the problem it solves is not hard, and it does not solve the problem well. - Phil Wadler

XML is not the end of our problems, it is the beginning of our problems. - ditto

Shortly after the release of XML, some folks, including some very important folks in W3C and its members, who had been big supporters of XML, actually got around to reading the spec, and discovered to their horror that they had an XML which included entities, DTDs, PIs, and assorted other baggage. - Tim Bray

When XMI came out, I had just been studying up on UML, and I thought "Cool! I'll print out the DTD so that I can look it over on the subway ride home!" When I saw how big the XMI DTD was, I decided not to print it out--I prefer not to spend that much time in the subway. - Robert DuCharme

XML was monocase until quite late in its design, when we ran across this ugliness. I had a Java-language processor called Lark - the world's first - and when XML went case-sensitive, I got a factor of three performance improvement, it was all being spent in toLowerCase().- Tim Bray

XML-based technologies seem particularly susceptible to the "if we standardize it, everyone will use it" fallacy. - Simon St. Laurent

Re:Really?

[sosume (680416)]

I'm more interested in using XML as a means for language independent object persistence (not just cheesy .NET XmlSerializer class stuff either). How much coverage of such things is there in the book? Ie; creating an object in Java on one machine, persisting it and it's state to an XML file, and recreating it on some other machine in C++ or C#. I'm tired of writing my own "protocols" to migrate running code from one app to another.

You have obviously never looked into soap [w3.org], which seems to be able to addr