Stitcher.exe crashin / comand line is too long

Post Reply
o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Mon Jun 10, 2013 12:31 pm

Hi,

i am getting errors running stitcher exe,

first it was this error
---------------------------------
>[10/June/2013 21:20:16] - Executing script... (Press ESC to abort)
>[10/June/2013 21:20:16] - The command line is too long.
>[10/June/2013 21:20:16] - Done...
--------------------------------


running this script
alembic_stitcher_shot03.rar

i thought maybe is all the subdirectories i have, so i made it shorter, by moving the abc files, but i got same error. command line too long.

so then i renamed a bunch of files to a shorter file name as per this script:
alembic_stitcher_shot03_c.rar
the 'too long ' error was gone but now i get this other one.

-------------------------
>[10/June/2013 21:15:39] - , name = 'T:/FREELANCE/TOYBOX/MACQUARIE_TOOLS/shots/Sh03_008_stitch_*.abc', tent_flags = 13
>[10/June/2013 21:15:39] - major: File accessability
>[10/June/2013 21:15:39] - minor: Unable to open file
>[10/June/2013 21:15:39] - #002: ..\..\..\src\H5FD.c line 1086 in H5FD_open(): open failed
>[10/June/2013 21:15:39] - major: Virtual File Layer
>[10/June/2013 21:15:39] - minor: Unable to initialize object
-----------------------


so is there a limit on the number of character a mesh sequence can have for stitcher to work? is it because is a command line thing. like old school 8 characters max?

and i guess, the second error looks more serious..i got 215 mesh files at a combined 8.9 Gb..

any ideas?

i am trying to get extra data to a client on a mesh, and want to test alembic to get velocity/vorticity and any other channels i can get.

thanks in advance
You do not have the required permissions to view the files attached to this post.

User avatar
enrique
Site Admin
Posts: 42
Joined: Fri Jun 17, 2011 9:44 am

Re: Stitcher.exe crashin / comand line is too long

Post by enrique » Mon Jun 10, 2013 3:51 pm

Hi Octavio

You are right, the command line has a limit of characters in most shells. However the stitcher utility is associative:

stitch(a, stitch(b, c) ) = stitch(stitch(a, b), c) )

This means that if you have, let's say 100 files to stitch (chances are the command line will be too long), you will be able to stitch the first 50 files into a temporary file, then stitch the second 50 files into another temporary file, and then stitch these two temporary files into the last one. This is just a workaround to overcome this command line limitation.

The second error looks more serious indeed, Would you please double check that the path is correct? It looks like RF is trying to open a non-existent file.

When you say you got a "combined 8.9Gb", do you mean that you are able to stitch those files? or is it just the sum of all the sizes of the files?
Enrique Turegano
RealFlow | Cinema4D developer

o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Re: Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Tue Jun 11, 2013 3:37 am

oh wow, talk about undocumented :lol:

i wll triple check my file path...

8.9GB is size of all the abc files combined, not stitched.

o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Re: Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Tue Jun 11, 2013 4:21 am

so if i keep my file paths shorter can i have more files processed?

o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Re: Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Tue Jun 11, 2013 4:41 am

i moved 20 files to a floder...boom! crash!
so what it does, stitcher crashes..this is the crash info on stitcher

Problem signature:
Problem Event Name: APPCRASH
Application Name: stitcher.exe
Application Version: 0.0.0.0
Application Timestamp: 519d6a51
Fault Module Name: MSVCR90.dll
Fault Module Version: 9.0.30729.6161
Fault Module Timestamp: 4dace4e7
Exception Code: 40000015
Exception Offset: 0000000000042686
OS Version: 6.1.7601.2.1.0.256.48
Locale ID: 3081
Additional Information 1: ba59
Additional Information 2: ba59170a2f9c178e7231c83dde883a6b
Additional Information 3: c37e
Additional Information 4: c37e809afe6db55f4355aa8128429842

Read our privacy statement online:
http://go.microsoft.com/fwlink/?linkid= ... cid=0x0409

If the online privacy statement is not available, please read our privacy statement offline:
C:\Windows\system32\en-US\erofflps.txt




then i get this


>[11/June/2013 13:33:17] - #########################

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00000.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00001.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00002.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00003.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00004.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00005.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00006.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00007.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00008.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00009.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00010.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00011.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00012.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00013.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00014.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00015.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00016.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00017.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00018.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00019.abc

>[11/June/2013 13:33:17] - T:/FREELANCE/abc/a\HYMesh_Sh03_008__00020.abc

>[11/June/2013 13:33:17] -

>[11/June/2013 13:33:17] - This application has requested the Runtime to terminate it in an unusual way.

>[11/June/2013 13:33:17] - Please contact the application's support team for more information.

>[11/June/2013 13:33:17] - #########################

>[11/June/2013 13:33:17] - HDF5-DIAG: Error detected in HDF5 (1.8.7) thread 0:

>[11/June/2013 13:33:17] - #000: ..\..\..\src\H5F.c line 1440 in H5Fcreate(): unable to create file

>[11/June/2013 13:33:17] - major: File accessability

>[11/June/2013 13:33:17] - minor: Unable to open file

>[11/June/2013 13:33:17] - #001: ..\..\..\src\H5F.c line 1222 in H5F_open(): unable to open file: time = Tue Jun 11 13:33:05 2013

>[11/June/2013 13:33:17] - , name = 'T:/FREELANCE/abc/out/Sh03_008_stitch_A*.abc', tent_flags = 13

>[11/June/2013 13:33:17] - major: File accessability

>[11/June/2013 13:33:17] - minor: Unable to open file

>[11/June/2013 13:33:17] - #002: ..\..\..\src\H5FD.c line 1086 in H5FD_open(): open failed

>[11/June/2013 13:33:17] - major: Virtual File Layer

>[11/June/2013 13:33:17] - minor: Unable to initialize object

>[11/June/2013 13:33:17] - #003: ..\..\..\src\H5FDwindows.c line 360 in H5FD_windows_open(): unable to open file, errno = 22, error message = 'Invalid argument'

>[11/June/2013 13:33:17] - major: File accessability

>[11/June/2013 13:33:17] - minor: Unable to open file

>[11/June/2013 13:33:17] - Done...



from this scipt
alembic_stitcher_shot03_d.rar
and my file paths are:
input:
T:\FREELANCE\abc\a
output:
T:\FREELANCE\abc\out


could it be it likes UNC? will try moving the files to my c: drive....



:? :? :? :? :?
You do not have the required permissions to view the files attached to this post.

User avatar
enrique
Site Admin
Posts: 42
Joined: Fri Jun 17, 2011 9:44 am

Re: Stitcher.exe crashin / comand line is too long

Post by enrique » Tue Jun 11, 2013 9:21 am

It could be a memory problem, maybe the stitcher is trying to allocate too much memory. Could you try to stitch just a couple of files? It should work, if it does not it might be an error with directory access. Can you access the directory where the output file using the command line?

If everything fails, could you send me a couple of those alembic meshes to see if it is an error with the stitcher?

Thanks
Enrique Turegano
RealFlow | Cinema4D developer

o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Re: Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Wed Jun 12, 2013 3:29 am

I copied a few of the frames to my c: drive and i get the same result, crash.

also i tried stitching 3 files, no luck....

aaalso i excluded frame 0, which is empty and i thught maybe this is the issue, but no luck...

i uploaded 5 frames here for you to try to stitch

https://dl.dropboxusercontent.com/u/564 ... meshes.rar

let me know how it goes please!

User avatar
enrique
Site Admin
Posts: 42
Joined: Fri Jun 17, 2011 9:44 am

Re: Stitcher.exe crashin / comand line is too long

Post by enrique » Wed Jun 12, 2013 12:49 pm

Hi, I was able to stitch them but I had to avoid the very first frame ("HYMesh_Sh03_008__00000.abc"). It looks like it comes from another simulation because the data it contains is slightly different than the rest.
In the first frame you are exporting:
- uv
- Velocity
- Vorticity

but in the rest you are exporting:
- uv
- Velocity
- Curvature

RealFlow should have printed a message informing about that situation, but it didn't. I still have to fix that.

Please let me know if you can stitch them now (avoiding the first frame, or re-exporting all again with the same parameters)
Enrique Turegano
RealFlow | Cinema4D developer

User avatar
enrique
Site Admin
Posts: 42
Joined: Fri Jun 17, 2011 9:44 am

Re: Stitcher.exe crashin / comand line is too long

Post by enrique » Wed Jun 12, 2013 12:58 pm

Oh God, I just realized you're trying to write to a file called "Sh03_008_stitch_*.abc" in your last script!
While is correct to use an asterisk as input, you can't use it in the output file name.

Try this instead:

Code: Select all

import glob, subprocess

# prepare command line
args = ['C:/Program Files/Next Limit/RealFlow 2013/stitcher.exe', '--in']

#get files

for files in glob.glob("T:/FREELANCE/TOYBOX/MACQUARIE_TOOLS/shots/shot_03/abc_008/sh03_008_*.abc"):
   args.append(files)

# rest of the commandline
args.append('--out')
args.append("T:/FREELANCE/TOYBOX/MACQUARIE_TOOLS/shots/final_file_stitched.abc")

# stitch them
p = subprocess.Popen(args, shell=True, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)

# print stitch output
for line in p.stdout.readlines():
    scene.message(line),
retval = p.wait()

Last edited by enrique on Wed Jun 12, 2013 2:53 pm, edited 1 time in total.
Enrique Turegano
RealFlow | Cinema4D developer

o.delellis@gmail.com
Posts: 63
Joined: Thu Aug 02, 2012 7:22 am

Re: Stitcher.exe crashin / comand line is too long

Post by o.delellis@gmail.com » Wed Jun 12, 2013 1:52 pm

i SUCK!!!!! :lol: :lol: :lol: :lol: :oops:

i need more naps...

it works,BUT it made a 8.45Kb file.....too space efficient!!! considering it was stitching 800Mb (20frames)

tried a few times with less files and same result..

THEN......(suspense)

i deleted frame 0 on which there is no mesh (5Kb file) and IT WORKS!!!!!

ayayyyy....i will try stitching all 200 frames in one go tomorrow morning.

Post Reply