B11 Lockup after unRAR

[Stuart264]

Quade

Another one for the fix it list I am afraid, B11 keeps stopping completely after it UnRar's some archives, strangely it only seems to affect some (not all) archives that contain pictures and with the recent changes you made to thumbnail generation having thumbnails turned on or off doesn't seem to make any difference..

Is there anything you can do to give the Dbworker / DBupdate run any faster, its really slow in this build and looking at the timing in the logs it looks like its the interaction with the autodownload filtering thats taking the time.

[Quade]

PM me the subject of one. I'm having no issues.

[Quade]

I downloaded a 1 G RAR set with 917 images. I had the thumbnail tab closed (in debug mode no less). When it was done I had 917 new images in the file list. I watched task manager and there was a small blip but no other indication there was much processing. It really acted no differently than a set with only a couple files in t.

[Stuart264]

Quade

Sent you a PM with one that was causing problems yesterday.

[Quade]

I tried your sample set and there was just a blip at the end. My files list was empty when I started. 1390 files when I was done. I'm thinking it might be:

1 - Many files already in the files list.
2 - Security software getting blasted with many new files to process.
3 - PC performance?

I'm assuming that your results cause Newsbin to stutter but not actually fail.

I'm going to try a couple more. Maybe see if there's some issue when I have a couple back to back.

[Stuart264]

Your right about many files in the software list, I think I had about 700 backed up in the download list behind that one file. Security Software I am running F-Secure with it set to ignore all the directories Newsbin uses. PC performance, possibly, I keep resisting swapping my system drive to SSD though I have a pretty high end processor and 16gb of ram thats pretty much good enough for just about everything.

[Quade]

It's not clear to me whether you're reporting a stutter or something more problematic. To me a "Lockup" means it's dead and there's no recovery. Not responding to the mouse or keyboard for a few seconds might be considered a stall or stutter depending on how long it lasts.

Is Newsbin dying or just stalling?

[Stuart264]

Stalling the download list and only restarting after I close the program and restart it.

[Quade]

I downloaded 10 gigs worth of these sets this morning. Then I put them on my test server and downloaded them again at 800 Mbps. No stalling at all.

I think you need to looks outside of Newsbin to figure out what's going on.

In the options, I'd select "Open Data Folder" then exit Newsbin and delete the "Downloaded.db3" then restart. This will wipe the files list but won't change any files on disk.

Then see what happens.

[Stuart264]

Quade

Makes no difference, the download list is still stalling after an archive extraction.

[Quade]

Well, I'd uninstall any security software (other then the MS stuff) reboot and try again. You can alway reinstall after the experiment. Does the actual unrar'd set line go away? What does the cache show at the bottom on the Status bar?

Might be time to wipe some of the other DB3 files in that folder too. DownloadsV2, AutoPAR2, Downloaded. Not sure about "DownloadMarker". I might move that to a different folder and see if it makes a difference and if it doesn't move it back.

Re-install might be in order too if that doesn't work.

There's nothing special about your setup? internal drive for download and unrar folders?

[Stuart264]

Quade

1. Security Software uninstalled - No Difference.
2. Wiping DB3 Files - No Difference
3. Cache the only thing I am noticing is that the cache is consistently nearly full i.e 923/1000, 945/1000, 926/1000
4. I tried to turn off pre-allocation in Performance as a test. It turns itself back on.....are you aware that it does this?

Right now the download list is totally stalled, but the number of files in the download list is increasing incredibly slowly, I cant see anything being written to the logfile in the last 15 minutes but the file size of the DownloadsV2.db3-journal file is increasing slowly. I will leave it running for an hour or two and see what happens as I am getting incredibly frustrated with this and its not helped by me trying to quit smoking again.

[itimpi]

3. Cache the only thing I am noticing is that the cache is consistently nearly full i.e 923/1000, 945/1000, 926/1000

You mean nearly empty! The first figure is the blocks free, and the second the blocks allocated to the cache. It is when the first figure gets to 0 that the cache is full.

[Quade]

Right now the download list is totally stalled, but the number of files in the download list is increasing incredibly slowly, I cant see anything being written to the logfile in the last 15 minutes but the file size of the DownloadsV2.db3-journal file is increasing slowly. I will leave it running for an hour or two and see what happens as I am getting incredibly frustrated with this and its not helped by me trying to quit smoking again.

Why would it be increasing? I'm assuming you're testing with a static list of files. If it's stalling while you're feeding a bunch of files, it makes me think the download list is just busy.

You really need to test with a fairly static setup and the move forward as each test passes or fails. If sounds like you have too much going on at once. Just my guess but it sounds like the download list DB is being fully tasked meaning there's no way for the download list to actually get serviced.

Where are the new files coming from? Search, Headers or NZB's?