XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
search
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Home » Boards » Stylus Studio Developer Network » Stylus Studio Technical Forum » Line Delimitted File Conversion
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
- Stylus Studio Technical Forum (14621)
-> + Grouping (2)
-> + Best Practice for Pipeline err... (2)
-> + pdf generation (4)
-> + Problems excuting a Pipeline w... (2)
-> + XML serializer (3)
-> + Supported EDIFACT versions (5)
-> - Anyone know XActimate ESX file... (1)
-> + Stylus Studio with OpenJDK (2)
-> - Encoding error when importing ... (1)
-> - SEO Service in Delhi, India (1)
-> - HP Printer Support (1)
-> + Stylus Studio X16 Professional... (5)
-> + Stylus Studio X16 Enterprise -... (4)
-> - Overly complicated formatting ... (1)
-> + java apparently running, canno... (2)
-> + Stylus on Citrix - unable to v... (6)
-> + XSLT and XPath Questions (New ... (13)
-> + EDIFACT D96A CONTRL XML schema (2)
-> + JDK dropdown box empty and Jav... (2)
-> + Replacing XSD files in Report (4)
-> + Cannot locate WYSIWIG tab on X... (3)
-> + EDI X12 xml schema with segmen... (2)
-> + Error Message (4)
-> + jvm disabled message keeps pop... (2)
-> + XTSE0620: An xsl:param element... (3)
-> + Fail in installing “Apache FOP... (5)
-> - Jenkins: about the path of bui... (1)
-> + problem with Stylus X15 XML RE... (2)
-> + Cannot remove a row into a tab... (6)
-> + prevent the meta data from bei... (3)
-> + Unable to auto detect JRE in X... (2)
-> - Unable to auto detect JRE in X... (1)
-> - where to find information (1)
-> + X16 - XPath 3.0, XQuery 3.0, X... (2)
-> - Test (1)
-> + XSLT debugger shows [symbol u... (3)
-> - How do i use *.conv to process... (1)
-> - How do i use *.conv to process... (1)
-> + Not able to configure JVM in ... (5)
-> + Converting Cobol flat file to ... (2)
-> + Problem with uninstall - Windo... (2)
-> + Function current() is not reco... (6)
-> + API or web version (2)
-> + How to use Saxon for X16 on WI... (9)
-> + Error in SS X14 syntax highlig... (2)
-> + Option not available (2)
-> + XML Diff functionality and sor... (3)
-> + Convert Oagis XML file to TXT (4)
-> + DataDirect xqresultsequence is... (2)
-> - xfile Legacy file format suppo... (1)
-> + TPFDF (3)
-> + Help needed with SLSRPT - EDIF... (2)
-> - keeps crashing after I try and... (1)
-> + Can SS do this? (14)
-> - CargoImp support (1)
-> + No Preview Displayed - File is... (3)
-> - Stylus Studio X16 build 1974l ... (1)
-> + Help! Help!Help! Regading form... (2)
-> + FileNotFoundException generati... (6)
-> + FO External Graphic Producing ... (2)
-> + Use of Java methodes (4)
-> + get generated XQuery output on... (2)
-> - right construct for involving ... (1)
-> + SS JRE Version has "Stylus Stu... (3)
-> + Trying to validate an XSD: co... (3)
-> + Disable "Output" windows (4)
-> + Stylus Studio V16 X64 update d... (2)
-> + Could not load the Java Virtua... (2)
-> + .NET XslCompileTransform strip... (6)
-> + XML Report Preview and Save Ev... (8)
-> + X16 Enterprise 32bit crash on ... (5)
-> - MSXML6.0 SAX Parser, "Index re... (1)
-> + MSXML6.0 DOM Parser stops afte... (4)
-> + How to disable checking for up... (2)
-> + XML Publisher requires duplica... (4)
-> + Modifying Field Name in XML (4)
-> + Java Runtime Environmnet Libra... (2)
-> + Passing Parameters and Multipl... (4)
-> + Total Newbie Question... where... (3)
-> + XML Pipeline (2)
-> + Encoding problem in text previ... (5)
-> + New Installation on windows 20... (4)
-> - Exception while calling Java m... (1)
-> + Jars to be included for callin... (2)
-> + SXXP0003: Error reported by XM... (2)
-> + Validation error (5)
-> + Windows 10, latest Java, new t... (2)
-> + using help crashes stylus stud... (3)
-> + Web Service Call error (5)
-> + javax.xml.xquery.XQException: ... (2)
-> + Trang translator is not availa... (2)
-> + Replacement for flat2xml (2)
-> + CONV CSV Display Problem (3)
-> + StylusValidator.exe Command Li... (3)
-> + Cannot run Java built in valid... (2)
-> + Windows 10??? (3)
-> + Stylus Custom XML Conversion (... (8)
-> + X14 enterprise and saxon 9.4.0... (3)
-> + Open an XML document in the XM... (3)
-> + How to generate mapping report... (4)
-- [1-20] [21-40] [41-60] Next
+ Website Feedback (249)
+ XSLT Help and Discussion (7625)
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Richard EggintonSubject: Line Delimitted File Conversion
Author: Richard Egginton
Date: 05 Jul 2013 03:54 AM
Hi All

I have a bit of a strange problem here and I hope someone can help me.

We have been using Stylus Studio for a number of years for converting various flat file formats into XML, but recently have come up against a new format that I have no idea how to deal with.

The basic file structure is as follows:

header_field_1
header_field_2
<empty row>
record_1_field_1
record_1_field_2
record_1_field_3
record_1_field_4
record_1_field_5
<empty row>
record_1_field_6
record_1_field_7
record_1_field_8
<empty row>
<empty row>
record_2_field_1
record_2_field_2
record_2_field_3
record_2_field_4
record_2_field_5
<empty row>
record_2_field_6
record_2_field_7
record_2_field_8
<empty row>
<empty row>

... and so on. So, basically the file is delimitted by CR/LF and each record contains 8 fields.

What I want to do is use Stylus Studio to create an XML Converter to transpose this into an XML format like:

<file>
<record_1>
<field_1></field_1>
<field_2></field_2>
<field_3></field_3>
<field_4></field_4>
<field_5></field_5>
<field_6></field_6>
<field_7></field_7>
<field_8></field_8>
</record_1>
<record_2>
<field_1></field_1>
<field_2></field_2>
<field_3></field_3>
<field_4></field_4>
<field_5></field_5>
<field_6></field_6>
<field_7></field_7>
<field_8></field_8>
</record_2>
</file>

I've tried various things without much success and am really looking for some pointers on how I might be able to achieve this.

Thanks in advance.

Richard
Postnext
Ivan PedruzziSubject: Line Delimitted File Conversion
Author: Ivan Pedruzzi
Date: 05 Jul 2013 12:43 PM

Hi Richard,

Is there any prefix in the row or it's the raw field data?
Is the header only present once in the first 2 lines of the file?
How large are these files in Kilobytes?
Is the double empty line the record separator?
Do you need to run the conversion as batch outside Stylus Studio?


Ivan Pedruzzi
Stylus Studio Team
Postnext
Richard EggintonSubject: Line Delimitted File Conversion
Author: Richard Egginton
Date: 11 Jul 2013 03:29 AM
Originally Posted: 11 Jul 2013 03:28 AM
Hi Ivan

Many thanks for your reply.

>Is there any prefix in the row or it's the raw field data?
Basically, it's the raw data. The first field is a row Id, so we can say that that would always be an integer value.

>Is the header only present once in the first 2 lines of the file?
Yes, the header is only present once at the top of the file

>How large are these files in Kilobytes?
These are averaging 100-500KB in size

>Is the double empty line the record separator?
We get files of this format from a number of different sources and the double space seems to vary. I guess at best we can say that we know that each record contains 5 fields. The double space is not consistent

>Do you need to run the conversion as batch outside Stylus Studio?
Conventionally, we are using Stylus Studio to define a converter and an XSLT to transpose the resulting XML into the format we need. We have an application that we have writted which uses the API to apply the converter and then the XSLT to files that we receive.

Thanks again

Richard

Posttop
Ivan PedruzziSubject: Line Delimitted File Conversion
Author: Ivan Pedruzzi
Date: 15 Jul 2013 04:05 PM
Hi Richard,

The following solution assumes the following:
- There is only one header (2 lines) at the the beginning of the file.
- The file is not huge.
- All empty lines are filtered out.
- The remaining fields are group by 8 for each record.
- The input document is loaded using the built-in CSV converter
For example converter:CSV:root=root?file:///c:/test/data.txt

Does it help?

Ivan Pedruzzi
Stylus Studio Team


//////////////////////////////////////////////
XSLT

<?xml version="1.0"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output indent="yes"/>
<xsl:variable name="flatList">
<xsl:for-each select="root/row[position() &gt; 2]/column.0[string-length(.) &gt; 0]">
<xsl:copy-of select="."/>
</xsl:for-each>
</xsl:variable>
<xsl:template match="/">
<root>
<xsl:for-each select="$flatList/*">
<xsl:if test="position() mod 8 = 0">
<xsl:element name="{concat('record_',position() div 8)}">
<field_1><xsl:value-of select="preceding-sibling::*[7]"/></field_1>
<field_2><xsl:value-of select="preceding-sibling::*[6]"/></field_2>
<field_3><xsl:value-of select="preceding-sibling::*[5]"/></field_3>
<field_4><xsl:value-of select="preceding-sibling::*[4]"/></field_4>
<field_5><xsl:value-of select="preceding-sibling::*[3]"/></field_5>
<field_6><xsl:value-of select="preceding-sibling::*[2]"/></field_6>
<field_7><xsl:value-of select="preceding-sibling::*[1]"/></field_7>
<field_8><xsl:value-of select="."/></field_8>
</xsl:element>
</xsl:if>
</xsl:for-each>
</root>
</xsl:template>
</xsl:stylesheet>


//////////////////////////////////////////////
Result

<?xml version='1.0' ?>
<root>
<record_1>
<field_1>record_1_field_1</field_1>
<field_2>record_1_field_2</field_2>
<field_3>record_1_field_3</field_3>
<field_4>record_1_field_4</field_4>
<field_5>record_1_field_5</field_5>
<field_6>record_1_field_6</field_6>
<field_7>record_1_field_7</field_7>
<field_8>record_1_field_8</field_8>
</record_1>
<record_2>
<field_1>record_2_field_1</field_1>
<field_2>record_2_field_2</field_2>
<field_3>record_2_field_3</field_3>
<field_4>record_2_field_4</field_4>
<field_5>record_2_field_5</field_5>
<field_6>record_2_field_6</field_6>
<field_7>record_2_field_7</field_7>
<field_8>record_2_field_8</field_8>
</record_2>
</root>
   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.