Processing size limit ?

I am not sure whether this is a bug, but it seems that CD Archiver (the last version, 5.9.3537.21785) does not properly process files larger than approx. 100 MB (i.e. the content of the archives is not scanned and catalogued or the md5 hash code of non-archive files is not calculated).

Is there any way to remove this limit within the program settings? I couldn't find a way to do that so far (maybe I am overlooking something).

Thanks for your answer in advance.

Also, thanks again for this unique program.


Cheers,

Bob

Hi, it's a bug. I reviewed the code to handle compressed files and made several changes. Try the latest build (5.9.3542) and let me know.

Thanks, I'm downloading it right now.

Still doesn't work I'm afraid.

I tried with one of my film-clips compilation disks and even some mpg clips with about 70 MB of size were not processed (no md5 hash code). Smaller clips were processed correctly.

I'll try later this evening with another disk which contains some archive files and report back.

Version 5.9.3542.29773 definitely doesn't work too - archives with more than 100 MB in size were not processed.

Just to mention that I haven't tried a "clean install" of the new version - I installed it over the previous one.

I might try with a 'clean install' tomorrow...


Cheers,

Bob

Do you have the MD5 plugin enabled? By default CD Archiver doesn't do md5 hashes (and compressed file hashes are only available on some formats).

About compressed files, some files error out when processing and unfortunately there is not much I can do because the error is raised on 7zip.dll and not by CD Archiver itself so it's not something I can fix.

Yes, as i said for some files (smaller than 100 MB) md5 was calculated correctly, for others, on the same disk, it wasn't.

I don't think it's related to 7zip.dll (archive plugin) because in all cases only "bigger" files were ruled out (and all 'bigger' files, not only archives).

Now to clarify what I've been talking about:

When I made a test with a disk which had archive files exclusively, those bigger than approx. 100 MB were omitted (they were not processed). For any of these (bigger) files CD Archiver obtained only information about name, modified date, type and location - nothing else, not even the file's md5 code, let alone archive contents. For all other (smaller) files, everything was OK.

When I made another test with a disk made as a film-clip compilation (meaning with video files only, and also some srt subtitles etc. - but no archives), the situation was exactly the same.
All the smaller files were processed correctly, the bigger ones were not (note: for this test I turned off those "amazon", "imdb" and similar internet features within the program settings).

I could also send some screenshots to you (I wouldn't like to post them publicly), let me know about that.

I'll also try to make some additional tests later.



Cheers,

Bob

Allright, I tried a clean-install of the soft on another platform - Vista SP1 (all my previous tests were made on WinXP SP3).

This time I activated both hash plugins (md5 and sha512), disabled IFilter plugin and also disabled all internet services (Amazon, Google, SeekLyrics, FreeDB, IMDb, Wikipedia).

All new tests produced the same results as previous - of course, this time CD Archiver calculated both hash values of these files that were processed - but the files that weren't processed earlier, were omitted this time as well (archives and non-archives).

Note: by "archives" I mean '.rar', '.zip' and .'7z' archive types. TAR-Gzip ('.tar.gz') archives were never processed, but I understand that it's a limit of 7zip.dll plugin.


Cheers,

Bob

Hi can you please send me the file C:\Documents and Settings\%username%\Local Settings\Application Data\Pmcc\CD Archiver\CD Archiver.xml and any relevant screenshots to my personal email: pmccREMOVEME@pmcchp.com.

I'll do that ASAP, possibly later this evening...


Cheers,

Bob

....But before I do that, I'd like to make (or finish) some additional tests...

It might after all turn out that the problem is not related to the file size per se !!


Cheers,

Bob

After some code review I found the culprint:

I had added the code to prevent CD Archiver from hanging when processing files. I have now increased the time limit to 60 seconds wich should be enough to process most files.

Download the latest build, 5.9.3546, to get the fix.

Thanks a lot !!


Cheers,

Bob

I haven't got enough time to test the new, modified version until today, and unfortunately, the 60-seconds limit turned out to be too "strict", especially for some larger video files - films (i.e. between 1.5 and 2 Gigs).

Could you make this 'hanging prevention' function optional, I mean to allow users to disable it either within the program options window or by editing xml settings file manually ?

Thanks.


Cheers,

Bob

I'll add an option to configure it on next build.