Newsbin Beta 6.90B10 - build 5368

[Quade]

http://downloads.newsbin.com/downloads/ ... 0-5368.exe

Relatively small detail changes. Beta seems pretty close to release

- Base: “Some/Word” as GOG is being saved as “Some\Word” after path expansion. Fixed - New test added. Uses underscore now.

- Display: Header import seems to interrupt large header loading. So while “show all” is happening, a new header block will interrupt it
- Display: Post list - the control for showing filter/full counts needs more space.
- Display: New data structure for post list. Seems faster when loading large groups

- AutoPAR: Repaired files that don’t unrar are left in both the source and dest folder.
- AutoPAR: Logging callback wasn’t being initialized when loading the PAR dll.
- AutoPAR: Encrypted File passwords from Filename part.
- AutoPAR: Encrypted File passwords from Par file renamed Filename part?

- Download: Re-compact every set that goes through the resolver so we use the latest compaction.
- Download: Header DB’s can now contain passwords but there’s no mechanism to add the password to the resolved downloads.
- Download: Ctrl-R mode download ignores “body only” download mode in order to try to show headers. This change assumes any server can deliver “articles” which might or might not be a good assumption.
- Download: Ctrl-R speed improvements.

Reports of pathing problems in B9 made me look extra hard at pathing verification.

- Download from Headers using default pathing
- Download from Headers using GOG and Group pathing override.
- NZB Download from Drag and Drop
- NZB Download from Autoload with pathing override
- NZB Download from Autoload without pathing override.

[jcthorne]

I think I have a bug in this beta. I have my download folder for files from NZB set to D:\$(NZBFILE)\ and newsbin is no longer placing the files in a folder named for the nzb, its just dropping many of them in the root folder. Worse, its not properly naming the files from the NZV but giving them names like abc.xyz.007a0b30c58d97.mkv When it does this, sonarr and radarr do not find the files for import and fail the download. Its not all but many and B9 was not doing this.

[Quade]

What's the main unrar folder and the unrar folder in the remote NZB options set to?

The download path doesn't really matter, it's the unrar path that determines where the unrared files end up.

If it's not set, I'd try setting the unrar folder in the remote NZB Options.

I'll check it out too. Thanks.

[jcthorne]

Thanks. Set a folder for the UnRAR and will try that as suggested. It was set to the root folder before

[pgrayson]

It appears that I have the same issue (but different naming). I have unrar directory set to d:\$(FILENAME). When the fie(s) are un-rared they only go to the un-rar directory. A sub directory is not created and the directories from the RAR are not re-created.

[Quade]

A sub directory is not created and the directories from the RAR are not re-created.

If you're using NZB files, you probably want $(NZBFILE) or $(RAWNZBFILE) in the unrar path. $(FILENAME) tries to extract the filename from the subject if it can't find it, it's blank.

I'll try $(FILENAME) it's one of the lesser used options. As for the subdirectories inside the rar set, are you sure there are any? Not all rar sets have built in folders. In fact I'd say a majority of RAR sets don't have internal folders.

[kenr]

Watch topics are all being put in {root}/Watch_topics instead of the specified folder set by the topic

(as usual under wine but I doubt that is the cause this time)

[Quade]

I'm not seeing this. Two of my watch list item, one for images that uses headers, one that searches for other things and is an internet based watch.

In both cases both the Download and UnRAR path are set in the watch.

The images are set to download to "Y:\AllImages\$(YEAR)-$(MONTH)-$(DAYS)\"

The other to "Y:\Something Else\"

In both cases these seem to be being used for download.

First, I'd suggest is make sure both the download and unrar path are set to where you want them to go.
Second if you want to PM me more details about your watch item, I'll try to set it up here and see what happens.

I test under Linux these days to a certain extent. I've never seen Newsbin do anything different under Linux than Windows. There are some cosmetic issues and some controls simply don't work, like trying to click the Plus icon to expand something. Wine still doesn't seem to implement the hit testing stuff that lets a program know a label has been clicked.

I have a feeling that what people are reporting as changed is that Newsbin is no longer defaulting the unrar path to be the same as the specific download path for the item. Instead it's defaulting to the main unrar path.

[mednzb]

5368 doesn't respect the asthmatic download of nzb it will just start downloading even when disabled.

[Quade]

I'm not sure I'm following. I know you probably mean "automatic" but I'm not understanding the context for this.

[jcthorne]

Ok, tried the suggestions and Newsbin is not following the settings. I have unRAR folder in NZB Interface set to D:\$(NZBFILE)\ and it is saving files to the root directory D:\ which is the setting for the main download folder. Download folder for NZB files is also set to D:\$(NZBFILE)\ and it too is being ignored.

These are items sent via api from radarr

This worked correctly in B9

[mednzb]

I'm not sure I'm following. I know you probably mean "automatic" but I'm not understanding the context for this.

Yes I mean automatic sorry. The download loaded nzb setting is not working it will start a a download even when it's unchecked.

[kenr]

Still not putting mp3's into the GOG set folder, but under {root}/$GOG

Will send you some samples from my watch's

I don't have anything set in UNRAR folders. it has always defaulted to the $GOG folder before. The watches are set to disable unrar

I also have 3 sets of folders only one of which contains any files from mp3's.

[rbaer]

Installed 6.90B10-5368 yesterday and everything seemed to work well.

Today on header download I got thousands of Corrupt XOVER Data errors from both Usenetserver and Supernews

[05/25 06:56:49] ERROR Server:UseNetServer XOVER Data Corrupt: 234591 etc...

Have not seen this error before so I don't know if it's just coincidence. Will watch for it tomorrow.

[Quade]

Modern obscured NZB's need to be sent to the download list to work properly. You can still load the NZB to display with "load nzb" from inside Newsbin.

[Quade]

Today on header download I got thousands of Corrupt XOVER Data errors from both Usenetserver and Supernews

I changed if just now to not log that as an error but to make it log in debug mode. It's not that unusual with all the obscured posting.

I'm in the midst of testing the Sonarr thing.

[lmcmann]

Is anyone else having incredibly high memory usage on these builds? When I simply open this version up, it takes 7.5gigs of ram. Never had this issue before with any version but b9 and b10. I started with b9, so I'm not sure how the previous ones work. I can try them if you'd like. b10 takes more than b9. B9 only went to about 7gigs under use.

682-5142 on opening takes 33,142 commit memory; 450,228 once I download something.
690-5368 on opening takes 7,567,024. 7,989,624 once I download something. And it grows, the more I download.

[lmcmann]

After pulling 250gigs through 682-5142 it had stabilized at 2 gigs of ram used. Totally fine. After pulling 30gigs through b10, it had grown to 8.9gigs of ram.

[Quade]

I noticed a memory usage problem yesterday. I just added a note to figure out what it is. It's seem to be related to header downloads and/or Image downloads.

It doesn't seem to happen all the time which is why I thought I'd already solved it.

[kirm]

Hi Quade,

Not sure if this is relevant, the other day dl album of flac files, all songs listed individually, the par files were located in a folder. Just ticked the entire set. Newsbin downloaded all the par files that were located in that folder.

Is it not suppose to only dl the required par files for repair? The files were complete and did not require any repair. Seems to me the behavior has changed as previously did it not just dl first par and then only dl necessary pars if required.

[Quade]

The problem is that if they aren't grouped it doesn't know if it needs them or not or if the last file has downloaded or not. One goal isn't to trigger a repair if any files for the set are still downloading. In cases where you have split up files and a separate group of PARS, it's best to move the files above the pars. In that way, it'll see the downloaded files and from that determine how many pars it needs.

If you just add a group of PARS by themselves, it'll download them all.

The logic for downloading only the pars it needs, if any works best when the pars and files are all grouped together because then Newsbin has a good idea when the final file of the set has downloaded so, it can repair any missing files back into existence.

[theBooda]

Hello,

The menu option to "Download to Folder named for Subject" is not working for me with this beta. It downloads the selected files to the Main Data Folder.
I looked to see if this was a known issue but didn't see it.
I reinstalled the previous release and it worked as usual.
I then reinstalled the beta and it still was not creating a folder. It loads the selected files into the "Main Data Folder".

Hope this helps or I need to improve my reading skills!

Thanks guys!

Craig

[kirm]

The problem is that if they aren't grouped it doesn't know if it needs them or not or if the last file has downloaded or not. One goal isn't to trigger a repair if any files for the set are still downloading. In cases where you have split up files and a separate group of PARS, it's best to move the files above the pars. In that way, it'll see the downloaded files and from that determine how many pars it needs.

Thanks Quade. Think I will proceed down the road if same situation, open the folder and grab the first par to verify complete files. Incomplete files are very rare these days, especially with small flac files.

Perhaps it is my aging memory, thought at one time the pars were delayed till all the files from that group were dl and proceed from that point if any required. Could very well be mistaken. Senior years, yeah!

Appreciate your time and effort, the 6.90 series is working good after the path issues were corrected for my simple usage of newsbin. Must be close to final.

Regards,

[Quade]

I

The menu option to "Download to Folder named for Subject" is not working for me with this beta. It downloads the selected files to the Main Data Folder.

I'll check it out. Thanks.

[DareDevil ©]

The menu option to "Download to Folder named for Subject" is not working for me with this beta. It downloads the selected files to the Main Data Folder.

This. It doesn't matter if it's a Download to New Folder or a Download to Existing Folder. The download will take place in the specified folder, but the unrar will happen in the default group folder of wherever the post originated. Changing the Unrar Folder makes no difference. I re-installed Beta 9 and the problem immediately went away.

[spamsilly]

Don't know if it's just my setup, but I cannot seem to set min or max file sizes past 2.82 gig in the watchlist.

The options are available (up to 20 GB), but after saving and reloading the max size rolls back to 2.82 GB. (30+ GB available on all drives NB uses)

Has anyone else found this?

[Quade]

I think I demonstrated that if a group is in a GOG AND that GOG is referenced by an existing Watch Topic - you are unable to manually pull headers for that individual group in the traditional manner.

I'll give it a try. Thanks.

[astrax]

I just installed the recent version over the last one and I get this error message right after starting:

Code: Select all

[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
... about a hundred lines or so...
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/07 17:49:32]  ERROR Sqlite Error : Reports Unrecoverable error 21


I can close it, but the error reappears every time I load an NZB for example.

[Quade]

Sounds like a corrupt DB3 file. Just not sure which one. If you don't have anything in the download list. You might "open data folder" from the options, exit Newsbin and then delete "Downloads_v2.db3. This will erase the download, failed, wish and downloaded lists.

Are you loading the NZB into the download list or displaying it in a post listing?

[astrax]

Are you loading the NZB into the download list or displaying it in a post listing?

Directly loading it from my harddrive, either double clicking it or through "file open...". I'll try deleting the .db file when it's empty - I just switched back to the previous version, since I had to d/l something. Will report back.

[Quade]

When you display an NZB on the post list view, it gets saved to a database. When you feed it directly to the download list, it only gets added to Downloads_V2. So, I'm trying to narrow down which database is giving you the error.

SQLITE_CORRUPT 11 /* The database disk image is malformed */

Yeah a corrupt DB for sure now.

[astrax]

I renamed the db3 file, installed the new version and now I get

Code: Select all

[06/08 09:14:48]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/08 09:14:48]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/08 09:14:48]  ERROR Sqlite Error : Reports Unrecoverable error 11


when NB started. Even when the new db3 file is just 8kb... And as soon as I open an NZB, I get the "unrecoverable error 11" again. Downloads seems to go fine, but with error messages.
Same happens when I feed it to a watch folder.

On another note: I still have the problem of items not being marked downloaded, or old. Or not even changing their status, when they've just been downloaded.

[Quade]

I added the filename to the error message so, when you update to B11, you'll know what file it is for sure.

On another note: I still have the problem of items not being marked downloaded, or old. Or not even changing their status, when they've just been downloaded.

This probably tells us that the corrupted DB is "DownloadMarker.db3". I'd probably exit Newsbin and delete it.

[astrax]

Now I've deleted both .db3 files, but still get the same error as above.

Code: Select all

[06/08 23:27:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/08 23:27:32]  ERROR Sqlite Error : Reports Unrecoverable error 11
[06/08 23:27:32]  ERROR Sqlite Error : Reports Unrecoverable error 11


[astrax]

A sub directory is not created and the directories from the RAR are not re-created.

If you're using NZB files, you probably want $(NZBFILE) or $(RAWNZBFILE) in the unrar path. $(FILENAME) tries to extract the filename from the subject if it can't find it, it's blank.

Similar issues for me with the download folder for NZBs: they should be going into n:\Newsbin2020\$(GROUP)\$(RAWNZBFILE)\ ($(NZBFILE)\ doesn't work either)
Instead they go into the main download folder: n:\Newsbin2020\$(GROUP)\
UnRAR folder is on a different drive and is used correctly.

[Quade]

Are you feeding them directly to the download list?

[astrax]

Are you feeding them directly to the download list?

Usually yes, same procedure as above. I rarely load NZBs from a download/group window.
If there are separate files in it, I open it via file -> load NZB. When it's just one I double cklick it. I occasionally drop them into a watch folder, when I know I'm going to load a bunch of different, single NZBs in a row.

The "unrecoverable error 11" is gone, btw. After removing both .db3 files again.

[FrizzleFry]

So what is going on with unraring sets downloaded with NZBs?

They used to just unrar to the download folder but now they are unrared to a folder based on the main download folder.

I saw something in a previous post about setting an unrar folder in the Remote NZB Interface. I did that and the folder does get created but no files go there. Also, AutoPar seems to get disabled.

Another issue is that Newsbin is downloading double-clicked and drag-and-dropped NZBs even though I have them set to load.

[astrax]

Are you feeding them directly to the download list?

I tried this again recently and it looks like downloads from an NZB, put in a watch folder, will be downloaded into a directory of the group name. For double clicked NZB a sub dir by the name of the NZB will be created (as shown in the 'download path' part of the download list).
Both get unrared into a dir and sub dir of the group name and the NZB name.

[Quade]

I tried this again recently and it looks like downloads from an NZB, put in a watch folder, will be downloaded into a directory of the group name.

I'm not following what this is or how you do this.

I saw something in a previous post about setting an unrar folder in the Remote NZB Interface. I did that and the folder does get created but no files go there. Also, AutoPar seems to get disabled.

This is only for Sonarr/Radarr. It's unrelated to normal NZB downloads. The NZB's fed directly to the download list, get a download path assigned based on the main NZB download path setting in the options. Autoload NZBs will either use the main pathing or any special pathing set in the NZB Autoload options

[astrax]

I tried this again recently and it looks like downloads from an NZB, put in a watch folder, will be downloaded into a directory of the group name.

I'm not following what this is or how you do this.

Downloading an NZB from a search engine like NZBindex. But saving them to an autoload/watch folder (as specified in the NZB-settings) and not opening them by loading them directly into NB or double clicking them later.

As to why this way and not another? It's probably because way back then, I could better keep track of already loaded/finished NZBs (and maybe use them again, if somehing went wrong), since they were put into a "loaded" folder.
I also used to download NZBs on a different computer, which had the watch folder synchronized on the computer NB was running.

[Quade]

Downloading an NZB from a search engine like NZBindex. But saving them to an autoload/watch folder (as specified in the NZB-settings) and not opening them by loading them directly into NB or double clicking them later.

When you load an NZB to a post list and then save it to a watch list, you're detaching the fact it came from an NZB from the watch list. What I mean is the NZB filename doesn't follow the data into the watch list. So I'm not surprised that it downloads to the watch specific path instead of the NZB path.

Automatically loaded NZB's get sent to the "Nzbs" folder in the data folder. They'll stay there for 2 days then get purged. So if you D&D an NZb to the download list, the NZB gets copied over.

[astrax]

When you load an NZB to a post list and then save it to a watch list, you're detaching the fact it came from an NZB from the watch list.

But that's not what I'm doing. Or at least, I don't think I am.
I'm not saving it from a "post list", but saving it through my browser, from an indexer like NZBindex, Binsearch etc. Saved to a watch folder on my harddrive, specified through your "NZB Options" in the settings. I've done it this way thousands of times and usually the NZB name was retained in the download path.

[Quade]

I get you now.

So do you have path settings in the NZB Autoload options? Each autoload folder can have it's own download and unrar path settings.

If you don't, maybe you want to set some so it downloads and unrars into the folder format you want.

[astrax]

So do you have path settings in the NZB Autoload options? Each autoload folder can have it's own download and unrar path settings.

No, did not have any setting in there (ever) - but now I'll change that acordingly. Wasn't even aware of that option Thanks!