Subject:Using Saxon with XQuery to insert into relational Oracle database Author:Michael Reitsma Date:12 Nov 2010 10:56 AM
Hi,
I need to get a 6Gb xml file into a Oracle database.
It is a pretty simple one with just one level extra of childs.
It translates into 3 tables when processed.
Using SS i can create the XQuery which i will later on adapt and use in the db somewhere. Thats why i thought of using XQuery and SS .
Creating a xquery document with a sample file of 3Mb using DataDirects processor works just fine and inserts records in the Oracle database.
When i change the processor to Saxons it complains that the ddtek prefix isn't recognized.
So question 1:
Is saxon xquery processing inserting to a relational database supported and if so what do i need to do then ?
When i changed the file in the run-scenario to the one of 6Gb the application stalls for a while(perhaps because the file is still on a network drive) and then i am able to start it.
(It also stalls when i create another scenario and specify the big file.)
After starting it keeps on running and running , or so the indicator looks that way, but doesn't insert a single row in the database.
So question 2:
Is there anything i can do here to have it process differently ? It looks like it is creating a dom although it doesn't eat memory.
When i open the big-xml file it barfs with a out-of-memory error.
But in the sales email i got it says that 2011 can now handle multi-Gb files.
So question 3:
What do i do in order to process big xml files ?
Any help is appreciated here, as i advised my boss here to purchase 7 licenses but face a stalling Stylus Studio client...
Subject:Using Saxon with XQuery to insert into relational Oracle database Author:Michael Reitsma Date:19 Nov 2010 05:51 AM
Thx for the update.
The question of the big-file handling still stands: opening the big file in the client causes the client to error with an out of memory error.
I find that strange since the salesemail tells me that the new SS can now handle files with sizes in excess of 1Gb.
How can i determine if the qry will load the file in streaming mode ?