Page 1 of 2

Newsbin Beta 6.90B12 - build 5396

PostPosted: Wed Jun 23, 2021 10:08 pm
by Quade
http://downloads.newsbin.com/downloads/ ... 2-5396.exe

- Posting: Doesn’t work - Been unable to test because my server doesn’t allow posting. Tested with Tweaknews. Works now.
- Display: PosterLockout working
- AutoPAR: Newest format NZB’s with embedded invisible PARS now working properly.
- AutoPAR: Fix for very rare 16K hash collisions in certain par sets.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jun 24, 2021 5:54 am
by kenr
I am trying to get rid of the spam messages in some of the groups.
I have a poster regex of "\w{9,}.+\w{3}" with a sample of "bZCAoBR6bmpMh7@lUn3X.MT7" as the poster.
Regex101 says it works, but NB passes it as OK.
What am I doing wrong?

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jun 24, 2021 2:13 pm
by itimpi
kenr wrote:I am trying to get rid of the spam messages in some of the groups.
I have a poster regex of "\w{9,}.+\w{3}" with a sample of "bZCAoBR6bmpMh7@lUn3X.MT7" as the poster.
Regex101 says it works, but NB passes it as OK.
What am I doing wrong?

I think the ’@‘ character is not part of the characters matched by \w.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jun 24, 2021 5:33 pm
by kstan12
thanks for the invisible par fix quade. no more dupes and my automation is working again.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jun 25, 2021 5:11 am
by kenr
Quade wrote:http://downloads.newsbin.com/downloads/beta/nb690B12-5396.exe
- Display: PosterLockout working

Thanks.
BUT, it only works for the session you are in. I.e. it removes their posts, but close & reload and download some more headers and they are back with new posts.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jun 25, 2021 5:13 am
by kenr
itimpi wrote:
kenr wrote:I am trying to get rid of the spam messages in some of the groups.
I think the ’@‘ character is not part of the characters matched by \w.

As I said the checker at regex101 passes it
Match 1 0-24 bZCAoBR6bmpMh7@lUn3X.MT7

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jun 25, 2021 8:22 am
by Quade
BUT, it only works for the session you are in. I.e. it removes their posts, but close & reload and download some more headers and they are back with new posts.


If I toggle the filters on and off and it "takes" again meaning the mechanism works and the lockouts are stored.

I agree it should apply on initial load though.

I'll check it out. Thanks.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jun 25, 2021 11:58 pm
by DogSnake
I am still unable to post from the latest build. 6.82 works fine. It is a small thing so I will use the 6.82 build. Thanks

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jun 27, 2021 2:49 pm
by Lee Thompson
I've tested the additional download header options with more groups, old and new.

  • WORKS: Download latest
  • WORKS: Download All headers
  • DOES NOT WORK: Download 50,000 Older Posts
  • DOES NOT WORK: Download 100,000 Older Posts
  • DOES NOT WORK: Download 500,000 Older Posts
  • DOES NOT WORK: Download 5,000,000 Older Posts
  • DOES NOT WORK: Download 10,000,000 Older Posts


By DOES NOT WORK, it shows up in the Downloading Files as Download Headers: Server - GROUP but stays at 0/0 until you delete it. I've waited up to an hour. The debug log shows two entries, repeatedly, all exactly the same. I think it's perhaps not requested the desired range or something so it just spins it's wheels.

(While you're at it, Download Special should have a "Download Custom Older Posts" where a modal asks for a count so you could specify "75000" etc.)

(EDIT: Formatting fixes, a heat wave makes for bad typing.)

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jun 27, 2021 10:30 pm
by Quade
DOES NOT WORK: Download 50,000 Older Posts
DOES NOT WORK: Download 100,000 Older Posts
DOES NOT WORK: Download 500,000 Older Posts
DOES NOT WORK: Download 5,000,000 Older Posts
DOES NOT WORK: Download 10,000,000 Older Posts


These only work at specific times and specific states of the group. I'll give it a look. For example of you already have all the headers according to range.db3, they won't do anything.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jun 27, 2021 11:24 pm
by Lee Thompson
Quade wrote:
DOES NOT WORK: Download 50,000 Older Posts
DOES NOT WORK: Download 100,000 Older Posts
DOES NOT WORK: Download 500,000 Older Posts
DOES NOT WORK: Download 5,000,000 Older Posts
DOES NOT WORK: Download 10,000,000 Older Posts


These only work at specific times and specific states of the group. I'll give it a look. For example of you already have all the headers according to range.db3, they won't do anything.


Yeah but normally that behavior is it just quickly starts and then the download queue is empty. Now it just hangs around at 0/0 until you delete it.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Mon Jun 28, 2021 5:39 am
by kenr
Filters.
I seem to remember that entering a filter into the box at the bottom, without adding, would allow testing. Now it seems you have to add it to test it.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 01, 2021 1:54 am
by Lee Thompson
I got a weird error tonight, newsbin was doing it's periodic header updates when:

Code: Select all
[06/30 20:33:40]  ERROR ReadFullDatabase: No filename or the NZB Data is missing


spammed in the log for 2 seconds.

No NZBs had been given to it. Just reading headers (I don't even have NZB folders defined, I use sabnzbd for large downloads).

They seemed to occur, rather randomly, during the header downloads. I don't think it's associated with any specific groups as it occurred just during the one time. (it's updated headers since without those errors).

I have logging always on full debug, unfortunately whatever happened, the cause doesn't seem to be logged.


@Devs, I know newsbin is multithreaded, is the sqlite you're using thread safe? Just guessing what might be doing weird things.


LATER NOTE: Nothing appears to be malfunctioning, just was odd seeing those errors for no apparent reason.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 01, 2021 4:17 pm
by Bismark
When I use the move command the file moves, but does not update the location in the file list tab. So when I want to look at the file via the file tab it shows,butI get a message that the file is not found. When I look at the target folder, indeed the file has been moved, but I really need to be able to find all files from the files tab. Also, when i do a a compact group, it works, but I do not see what the new size is. The good news is when a compact group is running, I can us the app for other stuff.

I have this version loaded and in the few days I have been using it, all else seems work.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 01, 2021 11:12 pm
by Quade
NZB data is just a keyword for the data needed to do the actual download.

You might get that if you have an empty group in the list of groups you're loading. I'm not sure why you'd get that just loading and displaying headers. I'll have to take a look.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 01, 2021 11:15 pm
by Quade
I'll look at the move thing.

I'll thinking about the compact group thing. Not sure I can pop up a summary when it's done or not.

Compacting will only reduce the size if you do a bunch of "shift-delete" or "delete all posts byposter". Marking old with delete won't shrink it because nothing is deleted.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 03, 2021 6:51 am
by bertm
My spam filters seem to be only partially effective. I notice most SPAM is incomplete and are between 500kB and 1M. Do you think a status filter (for incomplete) would be worthwhile?

The two filters I use are: [0-9a-z]{20} and ^[a-z\d]{17}

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 03, 2021 12:39 pm
by Quade
It could be it's setting the incomplete status before it checks the filter. Let me look at that.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 10:05 am
by wiggins09
Agree about the issue of 'incomplete' junk posts.
Of 3085 headers on a group update today, only 206 were actually complete & not junk.
It did make me wonder about the number of 'complete' junk headers being filtered out, how many data farms is this stuff actually filling up...? :shock:

& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 2:01 pm
by Stuart264
Two other users must have been reading my mind. I was going to ask for the "filter incompletes" function to be brought back, probably in the properties page of a GOG as groups like a.b.ebook and a.b-e-book are coming up with thousands of incomplete posts with random strings as the subject and poster, and its a pain in the ass going through them.

Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list.

Apologies for not raising it sooner, but been swamped literally by a flood from apartment upstairs that fried just about everything electrical and the cable line which has only just been repaired......last 2 weeks have not been good :cry: , anyone got any junior chewable morphine? (Thats a Simpsons & true historical reference :) )

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 3:57 pm
by Quade
Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list


I'm probably going to sit Win11 out for awhile. Wait for it to stabilize. No point chasing problems that might be inherent to the OS. Typically you just have to pause Newsbin then delete the arrant downloads.

It's always possible to add filter incompletes but, I'm going to suggest that you look in the actual group where the incompletes appear and see if there's any meaningful content left. Some productive groups are now "garbage only" and need to be removed from the groups list. I've been pruning out my GOGS. I also added a header download filter which removes much of the spam before it hits the DBs.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 3:58 pm
by Quade
& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?


As far as I know nothing has changed with the forum. It had been targeted from time to time with DOS attacks.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 4:28 pm
by Stuart264
I would, 1 day with 11 was enough for me. I have no idea why it forced the upgrade as according to Microsoft upgrade utility this PC isn't capable of running Windows 11 and god help anyone that needs either a VPN or private server connection for work, what they have done with the Networking is dire and the version I had your unable to turn IPv6 off. Got a ticket filed with Microsoft about it, still waiting on a response.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 4:56 pm
by Quade
I would, 1 day with 11 was enough for me.


If it wasn't for my gaming and programming, I'd be 100% Linux. I could probably do my programming on Linux. It just wouldn't be as convenient. I might never go Win11. Win10 already left a bad taste in my mouth. The fact they took away my ability to control my own PC was the last straw.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 10, 2021 8:18 pm
by TripleDad
Stuart264 wrote:Two other users must have been reading my mind. I was going to ask for the "filter incompletes" function to be brought back, probably in the properties page of a GOG as groups like a.b.ebook and a.b-e-book are coming up with thousands of incomplete posts with random strings as the subject and poster, and its a pain in the ass going through them.

Secondly I caught some very odd behaviour by Newsbin connected to Windows 11, I am signed up on the Insider "Beta" Program, Microsoft did something wrong in the preview rollout and pushed my PC onto Windows 11, moment I fired up Newsbin it started downloading everything based on the filter settings even though automatic download wasnt enabled and cause a right mess before I was able to CAD Newsbin and delete the download database, its fine now I pushed my laptop back to Windows 10 but you may want to add it to your long term "todo" list.

Apologies for not raising it sooner, but been swamped literally by a flood from apartment upstairs that fried just about everything electrical and the cable line which has only just been repaired......last 2 weeks have not been good :cry: , anyone got any junior chewable morphine? (Thats a Simpsons & true historical reference :) )


Wow...I am popping in as a lurker and had the exact same question - Couldn't find the filter or how to deal with thousands of incompletes in the various book groups. Quade, I can confirm that the groups are still populating valid (but small) binaries posts - the *.mobi/epub/azw etcs...

Much thanks.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jul 11, 2021 5:55 am
by kenr
OT but
Quade wrote:If it wasn't for my gaming and programming, I'd be 100% Linux. I could probably do my programming on Linux. It just wouldn't be as convenient. I might never go Win11. Win10 already left a bad taste in my mouth. The fact they took away my ability to control my own PC was the last straw.

Same with me, although I haven't really done any programming for several years now.
It was Vista that did me in, a new printer and scanner (separates) didn't have drivers so couldn't be used. Switched to Linux and used them for many years.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jul 11, 2021 10:01 am
by wiggins09
Quade wrote:
& as an FYI I got You exceeded the maximum allowed number of login attempts. In addition to your username and password you now also have to solve the CAPTCHA below on my very first click on <login> today.
Weird or new anti-spammer policy?


As far as I know nothing has changed with the forum. It had been targeted from time to time with DOS attacks.



Got me again today on first try then I posted a reply with quote, bounced me out as a login is req'd for a quote (!?), 3 tries later I'm back & my post content is deleted.... :roll:
but thanks for the reply Quade :wink:

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jul 11, 2021 3:38 pm
by Quade
I'll ask Dex about it.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Mon Jul 12, 2021 6:37 pm
by kirm
I'll ask Dex about it


Had the same happen. Dex got back to me to use captcha, but did not work. By the time I got his reply the next day, tried again and it went through. Been working fine since as I use keep logged in and it has been holding ever since.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Wed Jul 14, 2021 8:30 pm
by indobson
Double clicking a nzb causes it to download automatically. Auto download box is unchecked. File only shows only in the downloading files window. Using the add nzb button creates a tab of a paused nzb in the group lists window. Tried in win 7 and win10

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 15, 2021 12:14 am
by DogSnake
My work around for the login issue is to enable "log me in every time I visit". Now it bypasses my entering name and all.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 15, 2021 2:05 am
by chimmyjim
Just switched from 6.82 and 'Show Posts' takes about twice as long, and 10+ seconds for nearly empty groups where it was instant in 6.82.
Neither purge nor compact appear to work.
About half the time 'Mark All Old' displays an error message "ERROR Thread Died:"

Jim

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Thu Jul 15, 2021 2:18 pm
by Quade
Double clicking a nzb causes it to download automatically. Auto download box is unchecked. File only shows only in the downloading files window. Using the add nzb button creates a tab of a paused nzb in the group lists window. Tried in win 7 and win10


Obscured NZB's need to be fed directly to the download list if you want them to download properly. You can still load NZBs into a post list from the file menu.

Neither purge nor compact appear to work.


Compact and purge both happen in the background now. There's no popup windows anymore. I've not really noticed a slowdown here. I'll have to try back to back testing. Do you have many entries in your PosterLockout file?

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jul 16, 2021 12:42 pm
by chimmyjim
Quade wrote:Do you have many entries in your PosterLockout file?


Yes, it looks like several of them have been corrupted though. I'll clean it up and retry.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jul 16, 2021 3:31 pm
by Quade
The more posters you have in the list, the slower the load will be.

I don't use poster lockouts anymore. The random post subjects are too random. I have added some poster filters to my filter profiles where a single RE can filter out a bunch of them.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jul 16, 2021 3:43 pm
by chimmyjim
Have a suggestion on a quick way to delete all of the poster filters, and reset the filter profiles to default?

I've been building them up for over a decade at this point and probably best to start anew.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jul 16, 2021 4:17 pm
by Quade
Filters are in Filters.db3 Poster Lockouts are in "PosterLockout.txt". Both are in the data folder.

I'd suggest "Open Data Folder" for inside Newsbins option, then exit Newsbin. Move these files out of the data folder. Restart and see if things speed up. Doing it this way, you can always copy them back if they don't make much difference.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Fri Jul 16, 2021 4:34 pm
by chimmyjim
Perfect, thanks for help!

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 17, 2021 11:11 am
by 12gauge
Please advise, Is there a 32 bit binary for this build, as the posted binary won't install properly to Crossover ChromeOS (Wine 32 bit)

Thanks

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sat Jul 17, 2021 11:56 am
by Quade
There's no 32 bit version. Sorry. I'll probably make one for the release.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jul 18, 2021 9:49 pm
by Bismark
For the second time, many, more than half the files, in my files list just disappeared. It happened while files were being downloaded. Is there some variable that is set that does this? If so, how do I change it. I want the files to stay in there until I remove them. Please help.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Sun Jul 18, 2021 10:53 pm
by Quade
The files list has always self purged when it get > I think 10,000 records in it. It'll delete 100 at a time. Still, I've seen this once but I wasn't sure if it was because I was debugging.

How much do you have files, failed, download and Wish list? I wonder if it's taking so long to save it doesn't finish saving before Newsbin exits.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Mon Jul 19, 2021 3:23 am
by Bismark
As to files being deleted. I only had about 3,500 files and more than half of them just disappeared. I do have a big wish list, but had not added anything in the past month. This did not happen when Newsbin was exiting, but rather when it was downloading a number of files. I'm going to reload a backup to restore the Files list.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Mon Jul 19, 2021 12:43 pm
by NewsKid222
Just switched from 6.82 and am having massive "Not Responding" hangs in Beta 6.90B12. No other hardware or software changes. Just switching focus to NB window for resizing window or clicking speed limit button has a long hang. Ideas?

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Tue Jul 20, 2021 4:08 pm
by luezuve
I'm having a couple of problems that started after I "upgraded" to this beta..

1. My download settings won't work:
\Newsbin Download\$(GROUP)\$(NZBFILE)\
It downloads to \$(NZBFILE) but unrars in \$(GROUP)

2. I can't add passwords either manually or embedded in tge nzb.
I've been having to edit the RarPasswords.txt file to get passwords to show up.

Using latest windows 10 pro release build.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Tue Jul 20, 2021 11:47 pm
by Quade
Just switched from 6.82 and am having massive "Not Responding" hangs in Beta 6.90B12. No other hardware or software changes. Just switching focus to NB window for resizing window or clicking speed limit button has a long hang. Ideas?


Tell me more about your setup. I have fixed some hanging like that for RC1 (upcoming version). There's a part of repair that could stall the GUI.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Tue Jul 20, 2021 11:51 pm
by Quade
2. I can't add passwords either manually or embedded in tge nzb.
I've been having to edit the RarPasswords.txt file to get passwords to show up.


Passwords that are embedded in the NZB or in the NZB filename won't show up on the password list. They're stored with the actual download. The password list is now the "passwords of last resort". They're only checked if there's no embedded password in the NZB or NZB Filename.

The reason for the change is the password list will get slower and slower as you add entries so, being able to have per-download passwords stored in the download means there's no performance hit.

1. My download settings won't work:
\Newsbin Download\$(GROUP)\$(NZBFILE)\
It downloads to \$(NZBFILE) but unrars in \$(GROUP)


How are you feeding the NZBs?. Do you have an unrar path set? If you're using NZB Autoload (Newsbin monitoring a folder), you should add pathing to the autoload options in the NZB options section of the options.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Wed Jul 21, 2021 12:03 am
by efgh
Nothing big, doesn't look like it has been reported. On the taskbar for this beta, the right pointing arrow play symbol is always on. Previously this only appeared when I was actually downloading.
Just thought I mention it.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Wed Jul 21, 2021 1:19 am
by Quade
Thanks. I'll check it out.

Re: Newsbin Beta 6.90B12 - build 5396

PostPosted: Wed Jul 21, 2021 9:08 am
by Bismark
Relative to the number of files in the files tab,is there a parameter somewhere to set that number. It just reduced the number of files below 1,000. Can you tell me the name of the parameter and in what file that parameter is? Thanks.