doesnt handle partial file downloads well

Technical support and discussion of Newsbin Version 6 series.

doesnt handle partial file downloads well

Postby spotter » Tue Jan 24, 2012 12:51 pm

If newsbin is quit with partial downloads (either due to failures or because a file is still in process), when one restarts newsbin the entire file has to be redownloaded. why isn't the data written to disk? (I think back in the day this wasnt a problem).

I'm seeing it now due to trying to experiment with astraweb and their known issue of having many 430s.
spotter
Seasoned User
Seasoned User
 
Posts: 172
Joined: Tue Feb 12, 2002 12:00 pm

Registered Newsbin User since: 05/05/06

Re: doesnt handle partial file downloads well

Postby Quade » Tue Jan 24, 2012 1:38 pm

What version are you using? I was just testing this yesterday and 6.3 is definitely saving between runs. It might also depend on whether you have a memcache limit set in the configuration file.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44906
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: doesnt handle partial file downloads well

Postby spotter » Tue Jan 24, 2012 2:00 pm

6.30b2 and I'm definitely using mem cache (as generally files dont get written till totally downloaded), just unsure where its defined.
spotter
Seasoned User
Seasoned User
 
Posts: 172
Joined: Tue Feb 12, 2002 12:00 pm

Registered Newsbin User since: 05/05/06

Re: doesnt handle partial file downloads well

Postby spotter » Tue Jan 24, 2012 2:45 pm

I have a memcache limit of 100 (which makes sense why my files aren't being written) but I'd expect them to be written at some point.
spotter
Seasoned User
Seasoned User
 
Posts: 172
Joined: Tue Feb 12, 2002 12:00 pm

Registered Newsbin User since: 05/05/06

Re: doesnt handle partial file downloads well

Postby Quade » Tue Jan 24, 2012 3:21 pm

That's probably why they're not getting saved between runs. It's the downside of using the memcache. There's currently no mechanism for storing partial downloads.

I'll add an item to my todo list to look at this again.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44906
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to V6 Technical Support

Who is online

Users browsing this forum: Google [Bot] and 2 guests