XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Show tree view Topic
Go to previous topicPrev TopicGo to next topicNext Topic
Postnext
Michael ReitsmaSubject: Using Saxon with XQuery to insert into relational Oracle database
Author: Michael Reitsma
Date: 12 Nov 2010 10:56 AM
Hi,

I need to get a 6Gb xml file into a Oracle database.
It is a pretty simple one with just one level extra of childs.
It translates into 3 tables when processed.
Using SS i can create the XQuery which i will later on adapt and use in the db somewhere. Thats why i thought of using XQuery and SS .

Creating a xquery document with a sample file of 3Mb using DataDirects processor works just fine and inserts records in the Oracle database.
When i change the processor to Saxons it complains that the ddtek prefix isn't recognized.

So question 1:
Is saxon xquery processing inserting to a relational database supported and if so what do i need to do then ?

When i changed the file in the run-scenario to the one of 6Gb the application stalls for a while(perhaps because the file is still on a network drive) and then i am able to start it.
(It also stalls when i create another scenario and specify the big file.)
After starting it keeps on running and running , or so the indicator looks that way, but doesn't insert a single row in the database.

So question 2:
Is there anything i can do here to have it process differently ? It looks like it is creating a dom although it doesn't eat memory.

When i open the big-xml file it barfs with a out-of-memory error.
But in the sales email i got it says that 2011 can now handle multi-Gb files.
So question 3:
What do i do in order to process big xml files ?

Any help is appreciated here, as i advised my boss here to purchase 7 licenses but face a stalling Stylus Studio client...

Postnext
Ivan PedruzziSubject: Using Saxon with XQuery to insert into relational Oracle database
Author: Ivan Pedruzzi
Date: 12 Nov 2010 11:47 PM

DataDirect XQuery is specifically designed to work with relational data sources, Saxon is not.

If you query can be executed in streaming fashion, DataDirect XQuery will process any XML document size.

Having said that, i would suggest generating the Java code to execute the XQuery when dealing with such large documents.

Hope this helps
Ivan

Postnext
Michael ReitsmaSubject: Using Saxon with XQuery to insert into relational Oracle database
Author: Michael Reitsma
Date: 19 Nov 2010 05:51 AM
Thx for the update.

The question of the big-file handling still stands: opening the big file in the client causes the client to error with an out of memory error.
I find that strange since the salesemail tells me that the new SS can now handle files with sizes in excess of 1Gb.

How can i determine if the qry will load the file in streaming mode ?

Posttop
Ivan PedruzziSubject: Using Saxon with XQuery to insert into relational Oracle database
Author: Ivan Pedruzzi
Date: 26 Nov 2010 02:44 AM

Look at "Using DataDirect XQuery Execution Plan" in the on-line help

Hope this helps
Ivan

 
Go to previous topicPrev TopicGo to next topicNext Topic
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.