Issue with newsgroups containing more than 4 billion posts..

This is the place to help test and discuss Version 6 Beta releases.

Issue with newsgroups containing more than 4 billion posts..

Postby John » Fri Feb 04, 2011 8:57 pm

Has Issue with newsgroups containing more than 4 billion posts... been incorporated in V6, since it gives problems with Boneless header updates.
Q9650 with Windows XP 64bit
John
Occasional Contributor
Occasional Contributor
 
Posts: 30
Joined: Thu Apr 30, 2009 6:56 am
Location: Netherlands

Registered Newsbin User since: 10/19/04

Re: Issue with newsgroups containing more than 4 billion pos

Postby Quade » Fri Feb 04, 2011 9:10 pm

Yes.

I download headers from boneless multiple times a day with no issue. From giganews and Astra. I'm not sure if all servers are fixed though.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Issue with newsgroups containing more than 4 billion pos

Postby John » Fri Feb 04, 2011 9:23 pm

I use ssl.astraweb.com and it really gives a problem. It evertime starts with 0/2,200,032,032 and downloads a few milions and stops etc... Will try eu server.
Q9650 with Windows XP 64bit
John
Occasional Contributor
Occasional Contributor
 
Posts: 30
Joined: Thu Apr 30, 2009 6:56 am
Location: Netherlands

Registered Newsbin User since: 10/19/04

Re: Issue with newsgroups containing more than 4 billion pos

Postby Quade » Fri Feb 04, 2011 9:34 pm

What version are using? Set the "Download age" to 3, then delete the "Range.db3" and any other "Range.*" files in the boneless group (spool_v1 or spool_v6 depending on version). Then try downloading headers. Maybe range.db3 is damaged.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Issue with newsgroups containing more than 4 billion pos

Postby John » Sat Feb 05, 2011 5:02 pm

I deleted the range files and that worked, thanks Quade.
Q9650 with Windows XP 64bit
John
Occasional Contributor
Occasional Contributor
 
Posts: 30
Joined: Thu Apr 30, 2009 6:56 am
Location: Netherlands

Registered Newsbin User since: 10/19/04

Re: Issue with newsgroups containing more than 4 billion pos

Postby DaveXVI » Tue Mar 15, 2011 7:20 am

Let me know if you would prefer I start a new thread on this, but I am having a problem with boneless.

It's the first time I ever used it, so I just added it as a group today, so the range.db3 file was brand new.

Using newsbin's internet search, I found a file I wanted in boneless that was 174 days old. But Binsearch didn't have it, so I figured I'd just download enough headers from boneless to get it. I set my download age to 175 and then did a "download latest." The indicator in the download window said was downloading x of about 265,000,000 headers, and when the group window started showing posts, the oldest file was only about 55 days old.

I killed the download, and then tried a "download all" just to see if the number would change, and it didn't. It still said 265M.

That was with my usual version 5.59. I thought I remembered reading something about huge groups working better in V6, so I downloaded beta 5 of that and tried it. Same result.

I'm on Win7-64, 8 GB memory, my data folder has 75 GB free and my download folder has 700GB free, so it shouldn't be a space or memory issue. My server is Astraweb, and I've tried both SSl and regular.

After I tried all the above, I got the bright idea of looking for the file on nzbindex, and there it was. So I'm downloading it now, which proves that Astraweb has files six months old from boneless (their website claims 940 days for all groups, so they should!) but I can't download headers older than a couple months. It's sometimes helpful to do this, because you can see comments from people if the file you want has a virus or something, and they aren't included in the nzbs.

Any suggestions?
DaveXVI
Seasoned User
Seasoned User
 
Posts: 233
Joined: Sun Oct 16, 2005 4:47 pm

Registered Newsbin User since: 04/23/04

Re: Issue with newsgroups containing more than 4 billion pos

Postby Quade » Tue Mar 15, 2011 10:34 am

[09:32:00] HIGH ssl.astraweb.com - MODE READER
[09:32:01] HIGH ssl.astraweb.com - 200 news.astraweb.com NNRP Service Ready (posting ok) (yEnc enabled).
[09:32:01] HIGH ssl.astraweb.com - XFEATURE COMPRESS GZIP
[09:32:01] HIGH ssl.astraweb.com - 290 feature enabled
[09:32:01] HIGH ssl.astraweb.com - GROUP alt.binaries.boneless
[09:32:01] HIGH ssl.astraweb.com - 211 266723044 4538236928 4804959971 alt.binaries.boneless
[09:32:01] HIGH ssl.astraweb.com - XOVER 4538544133-4538844133
[09:32:01] HIGH ssl.astraweb.com - 224 data follows [COMPRESS=GZIP]


266 Million headers is what they can deliver.

It's not that unusual to have 2 billion posts but, only deliver a part of that as headers.You can still download with search or NZB's but, you can't from headers.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Issue with newsgroups containing more than 4 billion pos

Postby richy99 » Tue Mar 15, 2011 10:40 am

boneless has less than 600 days retention with astraweb is using headers

i just set my download age to 175 and did a download latest and it wanted to download 846million headers

are you using the eu or us servers?
User avatar
richy99
Elite NewsBin User
Elite NewsBin User
 
Posts: 6353
Joined: Fri Nov 21, 2003 8:04 pm
Location: Wales

Registered Newsbin User since: 12/31/03

Re: Issue with newsgroups containing more than 4 billion pos

Postby Quade » Tue Mar 15, 2011 12:57 pm

ssl.astraweb.com
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Issue with newsgroups containing more than 4 billion pos

Postby DaveXVI » Tue Mar 15, 2011 3:45 pm

Aha. Isn't that interesting?

When I switched to the Euro server and did "download all headers" for boneless, it tried to download 2.5 billion headers -- the oldest was 670 days, over ten times as old as on the US server.

Very good to know. Thanks both of you for the responses.
DaveXVI
Seasoned User
Seasoned User
 
Posts: 233
Joined: Sun Oct 16, 2005 4:47 pm

Registered Newsbin User since: 04/23/04

Re: Issue with newsgroups containing more than 4 billion pos

Postby richy99 » Tue Mar 15, 2011 6:45 pm

the eu and us servers should have the same posts but i have come across discrepancies
User avatar
richy99
Elite NewsBin User
Elite NewsBin User
 
Posts: 6353
Joined: Fri Nov 21, 2003 8:04 pm
Location: Wales

Registered Newsbin User since: 12/31/03


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: No registered users and 2 guests