XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
search
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Home » Boards » Stylus Studio Developer Network » Stylus Studio Technical Forum » Line Delimitted File Conversion
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
- Stylus Studio Technical Forum (14621)
-> + Unresponsive - Custom XML Conv... (2)
-> - Need Help defining Flat File w... (1)
-> + XML to Database (6)
-> + XSD path when associating to a... (3)
-> - Auto EDI File Translation (1)
-> + Need help parsing EDI and crea... (2)
-> + Bug in generating Xml from Dtd (7)
-> + Stylus Studio 15, install erro... (4)
-> + How to create UML from XSD (2)
-> + Java configuration (4)
-> + embedding/starting X15 dircet ... (2)
-> + Stylus X15 R2 environment crip... (5)
-> + Output Method TEXT does not wo... (6)
-> + CONV loses its format on re-op... (5)
-> - Trouble Converting 846 EDI Fil... (1)
-> + XML Catalog support - DITA (2)
-> + non-persistent VDI, App-V Lice... (2)
-> + Can we READ XLS file and Conve... (8)
-> + Mapping XML to XML (3)
-> + SS X15 - Getting Error with 45... (2)
-> + Optimal for DB to XML? (2)
-> + Issues exporting SQL Server ->... (2)
-> + need additinal field in XML (2)
-> + blinking (3)
-> + HELP ANYONE PLEASE (3)
-> + xi:include including include s... (2)
-> + Validating an XML file against... (2)
-> + XML to EDI Telco D.0 field len... (2)
-> + Converting EDIFACT to XML in c... (3)
-> + XSLT Transformation fails with... (4)
-> + StylusStudio X15 R2 java Auto ... (6)
-> + StylusStudio X15 Review - firs... (2)
-> + Stylus Studio X15 stuck on pro... (11)
-> + Error handling in Coverter fil... (2)
-> + RESTful Web Services in Stylus... (3)
-> + How to produce a human-readabl... (3)
-> + EDI 945 to AX (2)
-> + Help x15 failing install (5)
-> + XSD 1.0/1.1 schema validation ... (3)
-> + Java Runtime Environment 8.0 (3)
-> + Web Service Call to Oracle OSM... (2)
-> + Telco EDI to XML output on opt... (12)
-> + Authentication failed (2)
-> + no declaration found for eleme... (2)
-> + Component installation failed (5)
-> - Component installation failed (1)
-> - AUP to expire (1)
-> + Disable Automatic Updates in S... (2)
-> + Windows 7 64 bit compatibility (2)
-> + EDI 8.1 to 10.6 (2)
-> - Conerting EDI 8.1 to EDI 10.6 ... (1)
-> + Debugging with Java built-in p... (3)
-> + Moving Stylus Studio (2)
-> + When using an xsl:import file,... (3)
-> + Generate XSD file from XML fil... (2)
-> + Custom XML Conversion (2)
-> + Create XML from XSD schema fil... (4)
-> + Slimed by Microsoft Word 2010 (6)
-> + XML to EDI (Telco D.0) convers... (3)
-> + XML Pipeline Troubleshooting (10)
-> + Allow negative values in Telco... (7)
-> + Unable to add new arguments to... (2)
-> + Validating XML Document (4)
-> + Debugging with X15 and MSXML p... (2)
-> + Parameter values (5)
-> + Limit on size of schema/instan... (4)
-> + Enterprise 12r1-The decompress... (5)
-> + Lost my copy - how do I renew? (2)
-> + Add Arguments to JVM does not ... (10)
-> + Page-position='last' not inple... (3)
-> + Decode the base 64 encrypted f... (2)
-> + XALAN Processor (4)
-> + How to create an XSD for flat ... (4)
-> + xslt saxon processor failure (3)
-> + Variables window Context path ... (4)
-> + XLS Formatting Objects Preview... (7)
-> + German DTA File (2)
-> + EDI to XML and LX segment (2)
-> - The element with name "F0101Z2... (1)
-> + How to insert the current date... (3)
-> + XSD - XML Sample (4)
-> + XSD to XML (3)
-> + Java extension functions, Xala... (2)
-> + XML with XSD to PDF (7)
-> + mapped network drives not show... (5)
-> + WCF Message size (2)
-> + Re-imaged desktop/laptop lost ... (4)
-> + Relative path in Stylus Studio (2)
-> + & and & in web service cal... (8)
-> + Which JRE do I need now? (3)
-> - Line Delimitted File Conversio... (4)
-> ->Line Delimitted File Conv...
-> ->Line Delimitted File Conv...
-> ->Line Delimitted File Conv...
-> + Generating EDI Data from XML w... (2)
-> + Generating an XML file using C... (2)
-> - Generating an XML file from (1)
-> + output document cannot be pars... (10)
-> + convert RELAX NG to xsd (2)
-> + Intended Use of a .sef File (3)
-> + Skipping invalid records on SQ... (5)
-> + EDI XML Converters Inserting "... (2)
-> + Trying to use EDI to XSD docum... (5)
-- Previous [121-140] [141-160] [161-180] Next
+ Website Feedback (249)
+ XSLT Help and Discussion (7625)
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Richard EggintonSubject: Line Delimitted File Conversion
Author: Richard Egginton
Date: 05 Jul 2013 03:54 AM
Hi All

I have a bit of a strange problem here and I hope someone can help me.

We have been using Stylus Studio for a number of years for converting various flat file formats into XML, but recently have come up against a new format that I have no idea how to deal with.

The basic file structure is as follows:

header_field_1
header_field_2
<empty row>
record_1_field_1
record_1_field_2
record_1_field_3
record_1_field_4
record_1_field_5
<empty row>
record_1_field_6
record_1_field_7
record_1_field_8
<empty row>
<empty row>
record_2_field_1
record_2_field_2
record_2_field_3
record_2_field_4
record_2_field_5
<empty row>
record_2_field_6
record_2_field_7
record_2_field_8
<empty row>
<empty row>

... and so on. So, basically the file is delimitted by CR/LF and each record contains 8 fields.

What I want to do is use Stylus Studio to create an XML Converter to transpose this into an XML format like:

<file>
<record_1>
<field_1></field_1>
<field_2></field_2>
<field_3></field_3>
<field_4></field_4>
<field_5></field_5>
<field_6></field_6>
<field_7></field_7>
<field_8></field_8>
</record_1>
<record_2>
<field_1></field_1>
<field_2></field_2>
<field_3></field_3>
<field_4></field_4>
<field_5></field_5>
<field_6></field_6>
<field_7></field_7>
<field_8></field_8>
</record_2>
</file>

I've tried various things without much success and am really looking for some pointers on how I might be able to achieve this.

Thanks in advance.

Richard
Postnext
Ivan PedruzziSubject: Line Delimitted File Conversion
Author: Ivan Pedruzzi
Date: 05 Jul 2013 12:43 PM

Hi Richard,

Is there any prefix in the row or it's the raw field data?
Is the header only present once in the first 2 lines of the file?
How large are these files in Kilobytes?
Is the double empty line the record separator?
Do you need to run the conversion as batch outside Stylus Studio?


Ivan Pedruzzi
Stylus Studio Team
Postnext
Richard EggintonSubject: Line Delimitted File Conversion
Author: Richard Egginton
Date: 11 Jul 2013 03:29 AM
Originally Posted: 11 Jul 2013 03:28 AM
Hi Ivan

Many thanks for your reply.

>Is there any prefix in the row or it's the raw field data?
Basically, it's the raw data. The first field is a row Id, so we can say that that would always be an integer value.

>Is the header only present once in the first 2 lines of the file?
Yes, the header is only present once at the top of the file

>How large are these files in Kilobytes?
These are averaging 100-500KB in size

>Is the double empty line the record separator?
We get files of this format from a number of different sources and the double space seems to vary. I guess at best we can say that we know that each record contains 5 fields. The double space is not consistent

>Do you need to run the conversion as batch outside Stylus Studio?
Conventionally, we are using Stylus Studio to define a converter and an XSLT to transpose the resulting XML into the format we need. We have an application that we have writted which uses the API to apply the converter and then the XSLT to files that we receive.

Thanks again

Richard

Posttop
Ivan PedruzziSubject: Line Delimitted File Conversion
Author: Ivan Pedruzzi
Date: 15 Jul 2013 04:05 PM
Hi Richard,

The following solution assumes the following:
- There is only one header (2 lines) at the the beginning of the file.
- The file is not huge.
- All empty lines are filtered out.
- The remaining fields are group by 8 for each record.
- The input document is loaded using the built-in CSV converter
For example converter:CSV:root=root?file:///c:/test/data.txt

Does it help?

Ivan Pedruzzi
Stylus Studio Team


//////////////////////////////////////////////
XSLT

<?xml version="1.0"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output indent="yes"/>
<xsl:variable name="flatList">
<xsl:for-each select="root/row[position() &gt; 2]/column.0[string-length(.) &gt; 0]">
<xsl:copy-of select="."/>
</xsl:for-each>
</xsl:variable>
<xsl:template match="/">
<root>
<xsl:for-each select="$flatList/*">
<xsl:if test="position() mod 8 = 0">
<xsl:element name="{concat('record_',position() div 8)}">
<field_1><xsl:value-of select="preceding-sibling::*[7]"/></field_1>
<field_2><xsl:value-of select="preceding-sibling::*[6]"/></field_2>
<field_3><xsl:value-of select="preceding-sibling::*[5]"/></field_3>
<field_4><xsl:value-of select="preceding-sibling::*[4]"/></field_4>
<field_5><xsl:value-of select="preceding-sibling::*[3]"/></field_5>
<field_6><xsl:value-of select="preceding-sibling::*[2]"/></field_6>
<field_7><xsl:value-of select="preceding-sibling::*[1]"/></field_7>
<field_8><xsl:value-of select="."/></field_8>
</xsl:element>
</xsl:if>
</xsl:for-each>
</root>
</xsl:template>
</xsl:stylesheet>


//////////////////////////////////////////////
Result

<?xml version='1.0' ?>
<root>
<record_1>
<field_1>record_1_field_1</field_1>
<field_2>record_1_field_2</field_2>
<field_3>record_1_field_3</field_3>
<field_4>record_1_field_4</field_4>
<field_5>record_1_field_5</field_5>
<field_6>record_1_field_6</field_6>
<field_7>record_1_field_7</field_7>
<field_8>record_1_field_8</field_8>
</record_1>
<record_2>
<field_1>record_2_field_1</field_1>
<field_2>record_2_field_2</field_2>
<field_3>record_2_field_3</field_3>
<field_4>record_2_field_4</field_4>
<field_5>record_2_field_5</field_5>
<field_6>record_2_field_6</field_6>
<field_7>record_2_field_7</field_7>
<field_8>record_2_field_8</field_8>
</record_2>
</root>
   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.