XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
search
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Home » Boards » Stylus Studio Developer Network » Stylus Studio Technical Forum » XML->EDI: inconsistent treatment of white space
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
- Stylus Studio Technical Forum (14621)
-> - More flexible generated Java c... (1)
-> + Generic Schemas for representi... (2)
-> + Stylus Studio Professional rep... (2)
-> + XML XML Help (2)
-> + xsd help (2)
-> + XML data element friendly name... (2)
-> + HTML Tidy adapter is missing? (3)
-> + New Guy Here... (2)
-> + How to combine two similar fil... (2)
-> + Berkeley XML DB (4)
-> + What is the context node in th... (3)
-> + Multi element List (4)
-> + Cannot preview XSL transformat... (9)
-> + Why is this variable not showi... (7)
-> + Customising Schema Prefix (3)
-> + Please help!! XML AND XSL Tra... (6)
-> + XML to Excel in Home Edition (2)
-> + how to copy elements from an x... (2)
-> + Setting Saxon parameters in pi... (2)
-> + Trying to move SS license (3)
-> + Does SS PRO Support CSS (2)
-> + Selected values are not showin... (3)
-> + Copy Xpath To Clipboard Option... (2)
-> + Upgrading to SS 2006 3 - Activ... (3)
-> + XSL Efficiency tips (4)
-> - Report page Size and table hea... (1)
-> + Endless loop with xquery (8)
-> - Xpress XML (1)
-> + Extracting XML data into SQL s... (2)
-> + Crashes when I save (2)
-> + XSL cannot save: I/O error...b... (8)
-> + Diagram view has disappeared f... (5)
-> + Convert from http://www.w3.org... (2)
-> + Round-trip Converting; CSV-XML... (2)
-> + XSL error function call PHP (8)
-> + WYSIWYG XSLT Designer (5)
-> + generate xhtml+css from xml re... (2)
-> + generate xhtml+css from xml re... (3)
-> + generate xhtml+css from xml re... (2)
-> - Help using xsd xs:redefine nee... (1)
-> + Data loss opening External sch... (2)
-> + Install Apache FOP Plugin with... (8)
-> + Generating a Publisher Canvas ... (2)
-> + Stylus Studio comment block no... (3)
-> + Report Designer Screen Repaint... (5)
-> + validating on values (5)
-> + reuse of xslt (2)
-> + The evaluation period for the ... (2)
-> + export to documentation (3)
-> + Validating XML files using sev... (2)
-> + Missing 'Command' Tab in Custo... (3)
-> + Do I have to download new vers... (6)
-> + Can SS validate tags used in a... (5)
-> + validating schemas (2)
-> + Off-Topic Question - Looking f... (4)
-> + cannot see anything in mapper ... (2)
-> + Validating XSD schema sets (7)
-> + Standard Validation Engines (3)
-> + Style Sheet amendment to inclu... (2)
-> + Documentation - prevent import... (3)
-> + Debugging breakpoints with Sax... (17)
-> + Conversion (3)
-> + New and I am sure this is an e... (7)
-> + Saxon 8 with multiple xml inpu... (3)
-> + Compilation error (5)
-> + webservice call failing - pls ... (3)
-> + C# from Java Binding Classes (3)
-> + Java binding class generation (5)
-> + Validation of deeply-nested sc... (5)
-> + How to make Drag and drop in X... (2)
-> + Malformed XPATH expression par... (5)
-> + Toolbars and missing options (4)
-> + Converting Text File (2)
-> + Java Heap Issue (2)
-> + Formatting SOAP messages (6)
-> + Attribute Entity Expansion on ... (2)
-> + Text File to xml conversion wi... (9)
-> + Different XPath results when u... (7)
-> + Where is my XSLT mapper module (3)
-> + Where is my XSLT WYSIWYG Edito... (2)
-> + Regarding Stylus support of IA... (2)
-> + Debugging Problem with Enterpr... (5)
-> + various report designer prob;e... (12)
-> - will it EVER get fixed ?? Stru... (1)
-> - Migrate from wysiwyg xslt edit... (1)
-> + Entity Resolver in UI? (4)
-> + Visual Studio and Stylus Studi... (2)
-> + how to get rid of parameter in... (8)
-> + XQuery file (2)
-> + 505 error calling a WS from SS... (2)
-> + Configure Subversion with Styl... (2)
-> + XSLT Mapping of xsi:nil and xs... (2)
-> + Printing values in a table or ... (2)
-> + query on using stylus API for ... (12)
-> + WSDL retruns no response (2)
-> + SS XSL Processor Bug: Count() (6)
-> + Stylus Studio crashes after re... (2)
-> + Custom Converter in IBM JVM is... (10)
-> + Malformed XPATH epressions on ... (4)
-> - XML Report table borders when ... (1)
-- Previous [1501-1520] [1521-1540] [1541-1560] Next
+ Website Feedback (249)
+ XSLT Help and Discussion (7625)
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 03 May 2007 03:07 PM
Originally Posted: 03 May 2007 03:02 PM
EDIT: Sorry, this message board appears to trim white space, which in this case is not very helpful. In my XML and EDI samples I have replacedall space characters with a ·, so please interpret that character as a space (Hex 20).

hi,

I am using a trial version of stylus studio to convert XML to EDI. The java code I am using to do so is almost identical to that in the StylusStudio examples. An excerpt follows, where 'in' is the file path of the input xml and 'out' is the file path of the output edi:

Converter fromXML = ConverterFactory.newInstance().newConvertFromXML("adapter:EDI");
fromXML.convert(new StreamSource(in), new StreamResult(out));

Some places StylusStudio is good about preserving white space. For instance, I have an ISA segment which begins as follows in my XML:

<ISA>
<ISA01>00</ISA01>
<ISA02>··········</ISA02>
<ISA03>01</ISA03>
...
</ISA>

When StylusStudio converts this message the white spaces is preserved: ISA*00*··········*01...~

The elipsis indicates omitted data; it is not in my XML or in the EDI that StylusStudio produces.

In another case I have a segment in which my white space is being removed. For example, the XML for an NM1 segment is as follows:

<NM1>
<NM101>IL</NM101>
<NM102>1</NM102>
<NM103>SMITH</NM103>
<NM104>ROBERT</NM104>
<NM105>B</NM105>
<NM108>ZZ</NM108>
<NM109>··</NM109>
</NM1>

When StylusStudio converts this to an EDI message I end up with the following:

NM1*IL*1*SMITH*ROBERT*B***ZZ*~

When I am expecting the following:

NM1*IL*1*SMITH*ROBERT*B***ZZ*··~

Is this correct behavior? Why is it inconsistant between the ISA segment and the NM1?
Postnext
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 03 May 2007 04:58 PM
There is no inconsistency.

In the ISA segment, the elements are defined as having fixed widths,
so they must be padded out.

But for every other element, the following rule kicks in. (This is
the one for strings; numbers have a similar rule.)

3.5.1.4 String
A string data element is a sequence of any characters from the basic
or extended character sets and contains at least one non-space
character. The significant characters shall be left justified. Leading
spaces, when they occur, are presumed to be significant characters. In
the actual data stream trailing spaces should be suppressed. The
representation for this data element type is AN.

So notice that trailing spaces are to be suppressed.
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 03 May 2007 05:03 PM
>In the ISA segment, the
>elements are defined as having
>fixed widths,
>so they must be padded out.

Correct. But according to the specs I am using (which can be found at the HIPAA Electronic Reading Room: http://www.ihs.gov/AdminMngrResources/HIPAA/docs/x092.pdf), the NM109 has a minimum length of 2. So shouldn't that be padded out also?

Postnext
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 04 May 2007 10:30 AM
Yes, but that only applies to mandatory (M) elements.
Since NM109 is not mandatory, the proper way to show
that the value is not present is to omit it, not to
pad it out.

The reason the ISA segment is special is because some
of the special control symbols are in the line at certain
positions. So EDI parsers expect always to find:
- the data element separator at position 3,
- the data repetition character at position 82 (00402 and higher only),
- the component data element separator at 104, and
- the segment terminator character at 105.

If the elements in that first ISA record were not fixed,
the parser wouldn't know where to find those symbols.
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 04 May 2007 12:05 PM
>Yes, but that only applies to
>mandatory (M) elements.
>Since NM109 is not mandatory,
>the proper way to show
>that the value is not present
>is to omit it, not to
>pad it out.

OK, this is starting to make sense. Now, while NM109 is not mandatory (M), it's not optional (O) either. It's requirement designator is X, and according to the syntax notes, "if either NM108 or NM109 is present, then the other is required."

I do have a NM108 present, so shouldn't that cause NM109 to be required?
Postnext
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 04 May 2007 01:04 PM
Yes but no. ;)

Where possible, truncating spaces still trumps all but the
actual (M)andatory attribute.
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 04 May 2007 01:30 PM
Well then, I am presented with a problem. The EDI that StylusStudio is generating from my XML is not valid. Either I have an NM108 but no NM109, or I have an NM109 that doesn't satisfy the minimum length requirements.

Is there an option in the StylusStudio converter to prevent the truncating of white space? Or is there some attribute I can add to XML element to prevent truncating white space on that particular element?
Postnext
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 04 May 2007 02:05 PM
That's an interesting question, and frankly one that's not come up.
We'll do some research and let you know shortly.
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 15 May 2007 04:55 PM
Did you manage to find anything in your research?
Postnext
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 17 May 2007 03:50 PM
I have two different strategies.

1) Redefining the element to be mandatory so that it doesn't
trim the space,

2) Allowing support of an extra attribute, like xml:space, to
be recognized.

Do you have a sample EDI file we can use to make sure we've got
your scenario covered? You can post it here as an attachment or
email it to stylus-field-report@progress.com.
Postnext
Edward ScottSubject: XML->EDI: inconsistent treatment of white space
Author: Edward Scott
Date: 17 May 2007 04:10 PM
I have recently spoken with the people we are sending the EDI messages to. The appropriate thing for me to do here is to actually leave out both the NM108 and the NM109 if the NM109 is blank.

In fact, nowhere beyond the ISA segment will I need to include a field consisting entirely of spaces. So stylus studio's behavior will work just fine.

Thank you for looking into this, and thank you for being patient. I am new to EDI, so I appreciate your explanations.
Postnext
Alex GuarneriSubject: XML->EDI: inconsistent treatment of white space
Author: Alex Guarneri
Date: 12 Sep 2007 06:13 AM
Tony,
We are facing a similar problem.

When a this tag is processed from XML to EDI
<IMD0304 xml:space="preserve">Attivitą e virtł. Anima e corpo in </IMD0304>
the trailing space after "in" is truncated.
Putting the xml:space attribute doesn't seem to work either.

Any suggestions?

Thankl you.

Alessandro
Posttop
Tony LavinioSubject: XML->EDI: inconsistent treatment of white space
Author: Tony Lavinio
Date: 12 Sep 2007 09:38 AM
In your case, we are doing the correct thing.
According to the EDIFACT standard at
http://www.unece.org/trade/untdid/texts/d422_d.htm,
it says regarding white space:

7. COMPRESSING

In data elements for which the Data Elements Directory specifies
variable length and there are no other restrictions, insignificant
character positions shall be suppressed. In the case of insignificant
characters, leading zeroes and trailing spaces shall be suppressed.
   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.