[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

How many unit tests should I create for my XML application?

• From: "Costello, Roger L." <costello@mitre.org>
• To: "xml-dev@lists.xml.org" <xml-dev@lists.xml.org>
• Date: Sat, 24 Nov 2012 18:29:27 +0000

Hi Folks,

I am building an XML application. That is, my application consumes XML documents and then performs processing. The XML documents conform to an XML Schema.

How many unit tests should I write for my XML application?

To answer this question I looked at one other XML application. Specifically I looked at XML Schema validators.

An XML Schema validator is an XML application -- an XML Schema validator consumes XML Schema documents (and XML instance documents) and then performs processing. The XML Schemas must conform to a schema-for-schemas.

I downloaded the XML Schema Test Suite to see how many tests it contains and I discovered that it contains 14,285 unit tests.

The schema-for-schemas is 2,374 lines. So there are 6 unit tests for each line of schema code. Is that a reasonable benchmark -- 6 units tests for each line of XML Schema? 

Thus, if my XML application consumes XML documents which conform to an XML Schema that is 100 lines long, then I should create 600 unit tests. Does that sound about right?

/Roger

• Follow-Ups:
  • Re: How many unit tests should I create for my XMLapplication?
    • From: Liam R E Quin <liam@w3.org>
  • Re: How many unit tests should I create for my XML application?
    • From: Michael Sokolov <sokolov@ifactory.com>
  • Re: How many unit tests should I create for my XMLapplication?
    • From: Amelia A Lewis <amyzing@talsever.com>
  • Re: How many unit tests should I create for my XML application?
    • From: Michael Kay <mike@saxonica.com>
  • Re: How many unit tests should I create for my XML application?
    • From: Timothy Cook <timothywayne.cook@gmail.com>