XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
search
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Home » Boards » Stylus Studio Developer Network » Stylus Studio Technical Forum » EDI built-in adapter - problem with UTF-8 characters
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
- Stylus Studio Technical Forum (14621)
-> + Specifying EDI Delimiters (2)
-> + Defining 'connection string' f... (9)
-> + Help Programatically Convertin... (2)
-> + Using adapter URL in pipeline. (7)
-> + How to enable EDI functionalit... (2)
-> + Unable to open file with '%2F'... (2)
-> + How to create a dependency gra... (2)
-> + If block (2)
-> + Mapping multiple files within ... (7)
-> + StylusStudio vs Altova vs BizT... (4)
-> + Command line execution (7)
-> + CSS and Styling in X15 (2)
-> + Ignores debug breakpoints in X... (5)
-> + Cursor dissapearing in Text vi... (5)
-> + compile error xquery java styl... (3)
-> + Stylus Studio Setup: Applicati... (10)
-> + Stylus StudioX15 Crashing whe... (4)
-> + Upgrade Stylus 14 to 15 (2)
-> + ACE Broker Download v2.5 (2)
-> + Help creating custom convertor (7)
-> + Problem saving Documentation (5)
-> + Registry keys for Stylus x15 (8)
-> + How to add a value when conver... (10)
-> + Stylus Studio Pro & Ent X15r1 ... (2)
-> + You need to install Java 2 SDK... (4)
-> - How to disable automatic and m... (1)
-> + Does Stylus Studio / DataDirec... (4)
-> + Stylus Studio fails with 'The ... (12)
-> + Struzzo.exe side by side confi... (7)
-> + unable to use converter (5)
-> + How to enable XSD 1.1 for Saxo... (3)
-> + XSD v.1.1 validation and Xerce... (8)
-> + FATAL ERROR: unsupported XML v... (2)
-> + Java Runtime Environment boot ... (2)
-> + Associate XML with Schema (3)
-> + JVM not found in stylus studio... (2)
-> + Change newline to Linux (on Wi... (4)
-> + Indent XML Tags only partially... (2)
-> + dealing with invalid character... (2)
-> + Unable to call Webservice thro... (2)
-> + XML to CSV Video create csv te... (5)
-> + Try to test this product, (2)
-> + How to migrate license? (3)
-> - kepp your settings on X15 upda... (1)
-> + No Topic (2)
-> + XSD validation scalability iss... (2)
-> + Installing documentation in ai... (4)
-> + Stylus Studio is currently una... (2)
-> + Change from SS Pro 2011 to SS ... (2)
-> + Problem with pipeline function... (2)
-> + Min and Max Occurs for Choices... (2)
-> + XSLT without Preview window ou... (3)
-> + How to achieve this transforma... (2)
-> + Licence Authentication Failed (2)
-> - using Oracle V2 for validation... (1)
-> + Steps needed to execute standa... (2)
-> + xsi:noNamespaceSchemaLocation ... (8)
-> + Using Saxon 9.4 and integrated... (4)
-> + "net XML Parser (5)
-> + How to undo in Stylus Studio X... (2)
-> + .RENAME section not loaded cor... (3)
-> + Stylus StudioŽ X14 Release 2 X... (2)
-> + The JVM initialization failed ... (2)
-> + XML schema to XML does not wor... (4)
-> + missing ExtraLines (3)
-> + EDI validation tool (2)
-> + Registering Custom Tool from c... (5)
-> + Setting Default XML Validation... (2)
-> + Project Directory in Custom Do... (3)
-> + Problem with Saxon 9.4.0.4 AVT... (5)
-> + XML To HL7 (3)
-> + Siblings not repeating when mi... (7)
-> + Nesting of records from fixed ... (5)
-> + Licensing (3)
-> + CSV set up to support predefin... (10)
-> + Scripting conversion (2)
-> + Edi/Euritmo automatic conversi... (4)
-> + Have new stylesheet automatica... (3)
-> + Text file to CSV to xml (9)
-> + EDIFACT to XML (4)
-> + About Stylus Studio... dialog ... (5)
-> + Set Stylus as default editor f... (3)
-> + CSV to XML (11)
-> + Indent XML tags no longer work... (9)
-> + XSL code completion moe like o... (3)
-> + xsl:fo - unable to use any fon... (5)
-> + Bug when calling a ms script f... (13)
-> - url schema (1)
-> + Quickbooks invoice to XML (4)
-> + X14 locks up, Unresponsive (4)
-> + Fields missing from middle of ... (2)
-> + Cannot install trial (2)
-> + Text File with Page breaks - H... (8)
-> + Complex transactional CSV mapp... (2)
-> + XML Report (2)
-> - Create an XML feed for videos (1)
-> + word doc (2)
-> + Saving to a UNC path (7)
-> + sharing violation (3)
-> + Convert XML to XML (6)
-- Previous [181-200] [201-220] [221-240] Next
+ Website Feedback (249)
+ XSLT Help and Discussion (7625)
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Jan ZarubaSubject: EDI built-in adapter - problem with UTF-8 characters
Author: Jan Zaruba
Date: 10 Nov 2005 08:45 AM
Hi folks,
I'd like to use EDI built-in adapter. I've got input EDI file which is in UTF-8 encoding. The conversion to XML format is almost fine except the special czech characters.
Any thoughts how to fix it? Where to setup encoding of input and output files?
This problem might also concern to other built-in adapters like CSV and others.

Thanks in advance,

Jan
Postnext
Minollo I.Subject: EDI built-in adapter - problem with UTF-8 characters
Author: Minollo I.
Date: 10 Nov 2005 08:46 PM
EDI messages use their own peculiar ways to specify their character set. I tried creating a simple EDIFACT message specifying the UNOY character set (http://www.stylusstudio.com/edifact/40000/0001.htm), and cyrillic UTF-8 characters were properly encoded in the resulting XML.

Can you attach (or email) a sample of the specific on which you are having problems?

Thanks,
Minollo

Postnext
Jan ZarubaSubject: EDI built-in adapter - problem with UTF-8 characters
Author: Jan Zaruba
Date: 11 Nov 2005 04:15 AM
Hi,
thanks for your reply. Please see my comments below:

>EDI messages use their own
>peculiar ways to specify their
>character set. I tried
>creating a simple EDIFACT
>message specifying the UNOY
>character set
>(http://www.stylusstudio.com/e
>difact/40000/0001.htm), and
>cyrillic UTF-8 characters were
>properly encoded in the
>resulting XML.
Of course you're right. Sorry, I was wrong I didn't try UTF-8 but ISO8859-2, so it means UNOD in EDI format

>
>Can you attach (or email) a
>sample of the specific on
>which you are having problems?
>
>Thanks,
>Minollo

I'm attaching both EDI and CSV examples.
In Order96A_iso8859-2.edi look for "czech chars:" string. In onecze_utf8.csv is UTF-8 characters on last line.

Regards,
Jan

Postnext
Jan ZarubaSubject: EDI built-in adapter - problem with UTF-8 characters
Author: Jan Zaruba
Date: 11 Nov 2005 04:20 AM
Here is the attachment


Unknownedi_and_csv_incorrect_output_encoding.zip
Postnext
Minollo I.Subject: EDI built-in adapter - problem with UTF-8 characters
Author: Minollo I.
Date: 11 Nov 2005 09:58 AM
Thanks for the testcase.

#1, the EDI file:
I believe that the EDI file you have attached is NOT using ISO-8895-2, but instead it's using windows-1250, which is in contradiction with the UNOD setting. I've fixed the character encoding in the EDI file you sent us to be ISO-8895-2, and the EDI converter is now generating what I guess is the expected output. I'm attaching both the fixed original EDI and XML converted version

#2, the CSV file:
In version 6 release 3 the CSV converter always assumes the input file is encoded as ISO-8895-1. Stylus Studio 2006 allows you to override the encoding setting for tab and comma separated flat file to XML converters. In version 6 release 3 you could easily create a convert-to-XML definition in Stylus Studio (File > New > Convert to XML) and set encoding and other custom information there

Thanks,
Minollo


DocumentOrder96A_iso8859-2-fixed.edi
fixed EDI

UnknownOrder96A_iso8859-2-fixed.xml
converted EDI
Postnext
Jan ZarubaSubject: EDI built-in adapter - problem with UTF-8 characters
Author: Jan Zaruba
Date: 14 Nov 2005 03:50 AM
Hi Minollo,
thanks for your support. It seems you're right with the encoding of the EDI file. Unfortunately I missed this fact :).
I'm still playing little bit with the product; Let me describe what I did:
1. I took Order96A_iso8859-2-fixed.edi
2. I opened it with Stylus using built-in EDI adapter. Up to now czech chars are ok in XML file.
3. I added more czech chars to the xml and saved it to the file Order96A_iso8859-2-fixed2.edi. I used again EDI adapter to convert XML ---> edi format
4. I did steps 1 and 2 with Order96A_iso8859-2-fixed2.edi. Czech chars in the XML was incorrect.


Thanks,
Jan


UnknownOrder96A_iso8859-2_fixed2.edi
Posttop
Minollo I.Subject: EDI built-in adapter - problem with UTF-8 characters
Author: Minollo I.
Date: 14 Nov 2005 09:51 AM
Jan,
you are right; Stylus Studio is currently forcing the generated EDI to use UTF-8 rather than the encoding that is forced by the UNOD code.

We'll address the issue in the next Stylus Studio update; unfortunately it's too late to include the fix in Stylus Studio 2006 BL501d that is going public today, but we'll make sure the problem is solved in BL501e, available likely in 2-3 weeks from now.

Thanks,
Minollo
   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.