XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
- Stylus Studio Technical Forum (14621)
-> + XXX maps to XXX system (3)
-> + Help with extracting bookmarks... (2)
-> + Stylus Studio crashes when sou... (2)
-> + WSDL not Displaying properly (5)
-> + How to use fonts other than ba... (5)
-> + Saxon XSLT2 and FOP for XSL:FO... (3)
-> + Converting from XML to EDIFACT (5)
-> + Looping more than one time thr... (2)
-> - Need help with using XQuery in... (1)
-> + Looping - Taking the comma out (3)
-> + xslt mapper is only processing... (4)
-> - Newbie: using Saxon 9.1 with F... (1)
-> + Editing ![CDATA[]]> in the Gr... (2)
-> + Convertic EDI files into XML (7)
-> + Type2 Authentication missing D... (6)
-> + Please help in a simple conver... (5)
-> + Doc/Literal Wrapped (4)
-> + Error starting Stylus Studio (9)
-> + WYSIWYG Menu Bar and Tab Missi... (2)
-> + XML file size limits (2)
-> + XML Publisher (2)
-> + cant get namespace declaration... (5)
-> + Fixed Width to XML (3)
-> - file to xml conversion (1)
-> + Create Multiple Page (3)
-> + Flat file conversion with colu... (3)
-> + New Line character problem in ... (2)
-> + need help - stylus doesn't sta... (2)
-> + command line StylusValidator ... (3)
-> + Help unistalling (2)
-> + recurse problem analysis (3)
-> - Newbie: WSAD and file paths (1)
-> - Stylus StudioŽ 2009 XML Enterp... (1)
-> + Help with XSL to transform two... (4)
-> + connect to xhive (2)
-> - element id and name attributes... (1)
-> - http://www.w3.org/2001/XMLSche... (1)
-> + Error message when converting ... (2)
-> + XML id and anyuri datatype (2)
-> - import xml into an ms acces... (1)
-> + Change version (6)
-> + Translate two files into one (3)
-> + invalid relative uri with data... (7)
-> + My table crashes java Runtime (5)
-> + inx to pdf (3)
-> + XSD - multiple similar namespa... (7)
-> + validating many xml files (4)
-> + Stylesheet Parameters (3)
-> + create web service using Stylu... (2)
-> + connect with sql server (4)
-> + License could not be validated... (2)
-> + How to open (or decompress) a ... (3)
-> + Stylus Studio 2009 Home & Java (4)
-> + Connect to Informix DB 7.31.FD... (2)
-> + Unable to download stylus stud... (5)
-> + conversion CSV to XML (2)
-> + Please help to create a XSL to... (2)
-> + Stylus Studio 2009 unresponsiv... (3)
-> + Stylus Studio 2009 and IBM Jav... (2)
-> + separate one record to two lin... (3)
-> + error when running xquery comm... (6)
-> + Convert ebcdic-cp-us to utf-8 (8)
-> - hi urgent plz (1)
-> + Java compile problem (7)
-> + How to set pattern match on th... (3)
-> + Adobe Illustrator CS4 xml not ... (3)
-> + validating XSD with W3c stand... (2)
-> + Count function with condition ... (2)
-> + [Context] variable (4)
-> + Batch process HTML to XML docu... (2)
-> + Need help with adding logiic ... (2)
-> - BUG when editing File Types (1)
-> + Is Stylus Studio XML authoring... (2)
-> + Missing Xpath Query Editor (8)
-> + Error Connecting to DB2 9.5 (3)
-> - Tony (1)
-> + Problem trying to use your sof... (2)
-> + cannot save or associate a sch... (2)
-> + xsd to dtd (2)
-> + Can we use Stylus for our proj... (4)
-> + printing a parent node value i... (2)
-> + How to tell StylusDiff.exe to ... (4)
-> + Pipeline Messages not Consiten... (2)
-> + Custom XML conversion (2)
-> + Format date fields (3)
-> + Can't Connect to iSeries via I... (11)
-> + "application failed to start" ... (5)
-> - Can't connect to an Access DB ... (1)
-> + Unable to attach external JVM (3)
-> + Adding Numbers using XSLT (2)
-> + copy all elements and hardcode... (2)
-> + A bit confused on where to sta... (2)
-> + Application Menu Problem (14)
-> + API to retrieve 'Adapter URL' ... (2)
-> + How do I move my Stylus Studio... (6)
-> + API to retrieve 'Adapter URL' ... (2)
-> + InterPage Linking Problem in .... (2)
-> + xsl - header only once in fore... (7)
-> - StylusDiff.exe crashes when co... (5)
-> ->StylusDiff.exe crashes wh...
-> ->StylusDiff.exe crashes wh...
-> ->StylusDiff.exe crashes wh...
-> ->StylusDiff.exe crashes wh...
-> + Validation against schemas wan... (5)
-- Previous [781-800] [801-820] [821-840] Next
+ Website Feedback (249)
+ XSLT Help and Discussion (7625)
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Ramez GhazzaouiSubject: StylusDiff.exe crashes when comparing two huge XML files
Author: Ramez Ghazzaoui
Date: 22 Dec 2008 05:01 PM
Hi,
I am comparing two XML files of size 276 Mb each. (Actually, for my initial test, I am comparing the same file to itself). The program runs for a couple of minutes on the Windows Command Line then it gives me the error:

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

If I load it into the MS .Net debugger it says:

'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\StylusDiff.exe'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\ntdll.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\kernel32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\wxvault.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\psapi.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\mpr.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\advapi32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\rpcrt4.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\secur32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\user32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\gdi32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\version.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\shlwapi.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\msvcrt.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\detoured.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\shell32.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\StCmn.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\shfolder.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\icuuc40.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\icudt40.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\WINDOWS\WinSxS\x86_Microsoft.VC80.CRT_1fc8b3b9a1e18e3b_8.0.50727.1433_x-ww_5cf844d2\msvcr80.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\wininet.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\crypt32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\msasn1.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\oleaut32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\ole32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\iphlpapi.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\ws2_32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\ws2help.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\xmlengine.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\WinSxS\x86_Microsoft.VC80.MFC_1fc8b3b9a1e18e3b_8.0.50727.762_x-ww_3bf8fa05\mfc80u.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\comctl32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\WinSxS\x86_Microsoft.VC80.CRT_1fc8b3b9a1e18e3b_8.0.50727.1433_x-ww_5cf844d2\msvcp80.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\RWUXThemeSU80.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\sfl500asu.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\ot1100asu.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\vc8-re200l.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\imm32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\lpk.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\usp10.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\comctl32.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\WinSxS\x86_Microsoft.VC80.MFCLOC_1fc8b3b9a1e18e3b_8.0.50727.762_x-ww_91481303\mfc80ENU.dll', Binary was not built with debug information.
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\Plugins\XMLDiff.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\StXmlCmn.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\StylusHlp.dll'
'StylusDiff.exe': Loaded 'C:\Program Files\Stylus Studio 2009 XML Enterprise Suite\bin\SmartEdit2.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\msctf.dll'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\msctfime.ime'
'StylusDiff.exe': Loaded 'C:\WINDOWS\system32\apphelp.dll'
The thread 'Win32 Thread' (0xf10) has exited with code 0 (0x0).
The program '[5524] StylusDiff.exe: Native' has exited with code 3 (0x3).


Is this a scalability limitation in the program? My next test was going to involve XML files 544 Mg large...

-Ramez

Postnext
Tony LavinioSubject: StylusDiff.exe crashes when comparing two huge XML files
Author: Tony Lavinio
Date: 23 Dec 2008 03:11 AM
You're probably straining the limits of a 32bit address space now.
You could try the -fast option to see if you can eke out a little
bit more.

Remember that comparing two 250meg+ files means 1/2gig of RAM just
to load the raw text; building the list of pointers for cross-referencing
them also takes space.

Why do you need to diff files? Is there something specific you are
looking for?

Postnext
Ramez GhazzaouiSubject: StylusDiff.exe crashes when comparing two huge XML files
Author: Ramez Ghazzaoui
Date: 23 Dec 2008 01:47 PM
Thank you for the response.

The question as to why I need to compare such large XML files is one that I cannot answer. That's the size of the files I am given for comparing. I wish I could split them, but that would assume that there is a clean middle-point where I know the top halves compare to each other and the bottom halves compare to each other. In reality, the need for a tree-based comparison arises from the fact that the XML elements aren't ordered in the same fashion across the two files.

About stretching the limits of memory, I really throught that since Windows 2000 there has been no limit to memory because Windows allocates all the swap file virtual memory that it needs, with no limit other than the size of your hard disk (or the swap file file size, if such size is specified in Control Panel).

Should I conclude from your answer that there is no solution to my problem?

-Ramez

Postnext
Tony LavinioSubject: StylusDiff.exe crashes when comparing two huge XML files
Author: Tony Lavinio
Date: 23 Dec 2008 02:34 PM
Windows 2000 is a 32bit operating system. That means that the memory
for any given process must be addressable by a 32bit number. The
operating system takes 1/2 for itself, leaving 2gig at most for
applications (there are ways to trick some versions of Windows to give
3gb, but that's out of scope for this discussion).

Other programs running, and operating system utilities, take up some
of that space also, and of course Stylus Studio needs some.

And XML files, when they are rendered in memory, have some overhead.

There are a few XML diff products which use different architectures to
get around some of these limitations; you might try DeltaXML.

Assuming you're not comparing two randomly-selected XML files, there
are usually ways to determine what sorts of changes you are looking
for, and then strategies for diffing them can be made. But for general
diffing, that's a hard problem.

Posttop
Ramez GhazzaouiSubject: StylusDiff.exe crashes when comparing two huge XML files
Author: Ramez Ghazzaoui
Date: 23 Dec 2008 02:46 PM
Yes, I guess there is no way around the memory address spage limit. I wonder how long before the need for more than 64 bits arises...

The XML files that I am comparing aren't random, in fact for my test here I am comparing one file to itself. But my actual need is for comparing two XML files that are supposed to have the same elements except their order is mixed.

I'll try -fast but at tis point in time I am discouraged. I wish it were possible to lead the trees level by level, pass by pass. I'm not sure how such an algorithm would work but it might be worth considering.

Cheers, and happy [your favorite holiday].

-Ramez

   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.