6.72 - New high speed record set.

Technical support and discussion of Newsbin Version 6 series.

6.72 - New high speed record set.

Postby Quade » Sat Aug 27, 2016 6:09 pm

While working with a user with gigabit internet access, he was having problems getting much over 500 Mbps/ 62 MBp/s. He was downloading to an SSD and had the data folder on a different SSD or so we thought. Turns out they were both on the same drive. He switched the data folder to the other drive, then downloaded to a second SSD and was able to achieve a peak of:

126 MBp/s/1008Mbp/s with an average of 122ish/ 976 Mbps.

This was with Autopar enabled.

While testing, I was able to get 750ish Mbps from a local server to my data and download folder. Both are spinning disks. I was pretty impressed with that. Still, it doesn't come close to the speed this user is getting.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 42302
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.72 - New high speed record set.

Postby Fisherking » Sun Aug 28, 2016 2:24 pm

Quade wrote:While working with a user with gigabit internet access, he was having problems getting much over 500 Mbps/ 62 MBp/s. He was downloading to an SSD and had the data folder on a different SSD or so we thought. Turns out they were both on the same drive. He switched the data folder to the other drive, then downloaded to a second SSD and was able to achieve a peak of:

126 MBp/s/1008Mbp/s with an average of 122ish/ 976 Mbps.

This was with Autopar enabled.

While testing, I was able to get 750ish Mbps from a local server to my data and download folder. Both are spinning disks. I was pretty impressed with that. Still, it doesn't come close to the speed this user is getting.


I wonder with this extreme speed/dl amount to SSDs, what their lifetime will be after TBs of writes. If this user let us know about that, it will be a good reference point for the endurance of the SSDs including their brands of course

Best Regards
Fisherking
Active Participant
Active Participant
 
Posts: 57
Joined: Tue Oct 24, 2006 3:34 pm

Registered Newsbin User since: 10/24/06

Re: 6.72 - New high speed record set.

Postby Quade » Sun Aug 28, 2016 10:04 pm

http://techreport.com/review/24841/intr ... experiment

It's a couple years old but I consider this to be the bible for SSD reliability.

All six of our subjects, including the 840 Pro and Samsung's TLC-based 840 Series, wrote hundreds of terabytes without issue. The 840 Pro has written over 1.1 petabytes to date, and it's still going strong.


The Samsung 850 Pro's come with a 10 year warranty too.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 42302
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.72 - New high speed record set.

Postby Fisherking » Mon Aug 29, 2016 8:55 am

I'm still discomfortable/anxious about my SanDisk Extreme Pro even it comes with 10 years warranty
Fisherking
Active Participant
Active Participant
 
Posts: 57
Joined: Tue Oct 24, 2006 3:34 pm

Registered Newsbin User since: 10/24/06

Re: 6.72 - New high speed record set.

Postby Quade » Mon Aug 29, 2016 10:08 am

I'd look at the comparison test and check your smart variables. I tend to swap out SSD's every couple years. I just switched my work disk to a 1TB which cost less than the 512's I bought last time.

Since I've tested spinning disks up to 750 Mbps. I'm not sure an SSD is necessary unless you're really downloading faster than that.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 42302
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.72 - New high speed record set.

Postby Beemer2 » Sat Oct 08, 2016 3:27 am

Quade wrote:While working with a user with gigabit internet access, he was having problems getting much over 500 Mbps/ 62 MBp/s. He was downloading to an SSD and had the data folder on a different SSD or so we thought. Turns out they were both on the same drive. He switched the data folder to the other drive, then downloaded to a second SSD and was able to achieve a peak of:

126 MBp/s/1008Mbp/s with an average of 122ish/ 976 Mbps.

This was with Autopar enabled.

While testing, I was able to get 750ish Mbps from a local server to my data and download folder. Both are spinning disks. I was pretty impressed with that. Still, it doesn't come close to the speed this user is getting.


I'm using a Samsung 950Pro m.2 on an Asus x99 Deluxe II with Intel 6800K and 32GB memory. Broadband is 200MB/s. However download storage is to a 3TB 7200rpm drive. What is the bottleneck for speed download is it the 950Pro or the harddrive?

Ian
Beemer2
Active Participant
Active Participant
 
Posts: 81
Joined: Wed May 05, 2010 8:51 am

Registered Newsbin User since: 05/05/10

Re: 6.72 - New high speed record set.

Postby Quade » Sat Oct 08, 2016 9:25 am

How fast is it going?

You could be bottlenecked at the server end too. What news server are you using?
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 42302
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.72 - New high speed record set.

Postby Mascot » Thu Nov 24, 2016 1:05 pm

Quade wrote:Since I've tested spinning disks up to 750 Mbps. I'm not sure an SSD is necessary unless you're really downloading faster than that.


I had to move the data folder to an SSD to consistently max out my 500Mbit connection. I could hear the spinning drive churning like crazy whenever the speed dropped off. My guess was that some posters use smaller individual messages, causing the HDD to get into trouble updating one of the database files with info about each one, but it could also have been some other program that decided to do something with that drive I suppose.

I have noticed NB maxes out the first core while downloading now (i7-4790K), so I'm not sure I'd be able to get more speed if I went gigabit. Several other programs seem to be CPU bound when downloading, NB is pretty much the only way to max out my bandwidth.
Mascot
Seasoned User
Seasoned User
 
Posts: 142
Joined: Sat Sep 23, 2006 8:17 pm
Location: Norway

Registered Newsbin User since: 09/25/06

Re: 6.72 - New high speed record set.

Postby Quade » Thu Nov 24, 2016 5:59 pm

I have noticed NB maxes out the first core while downloading now (i7-4790K),


There's one thread that does asssembly and unrar. Repair uses multiple cores internally.

At these speeds you want to watch your logging level. Running debug logging can slow the download because the logging tab gets flooded.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 42302
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.72 - New high speed record set.

Postby Mascot » Thu Nov 24, 2016 6:25 pm

Logging is set to normal. Logging tab is typically blank. I think I just need more powah, Scotty.
Mascot
Seasoned User
Seasoned User
 
Posts: 142
Joined: Sat Sep 23, 2006 8:17 pm
Location: Norway

Registered Newsbin User since: 09/25/06

Re: 6.72 - New high speed record set.

Postby RayMark » Wed May 10, 2017 10:47 pm

Good to know :)

I myself have seen speeds up to 460 Mbps only - downloading directly to cheap and slow external drives. But the average speed is closer to 300.
If I want to keep my downloads, I still would have to move the downloaded files to an external drive. So the question is - which is faster in the end.
RayMark
Seasoned User
Seasoned User
 
Posts: 409
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: 6.72 - New high speed record set.

Postby Sandman » Sun Jul 23, 2017 12:42 pm

I have a Gbps connection and have reached almost 900Mbps download. However, most of the time, I get 300-600Mbps. I have 7200RPM HDDs, which should be able to handle Gigabit easy. I have transferred files at 200 MBps plus, which is more than enough: 1600Mbps vs a max of 945Mbps-ish for the line. I think the bottleneck, in my case, is my Usenet provider. All of this was on v6.6. I have upgraded to v6.73 to see if there is a difference.

Also, you aren't going to do more than 945Mbps due to overhead.
Sandman
Seasoned User
Seasoned User
 
Posts: 197
Joined: Sun May 11, 2008 10:18 pm

Registered Newsbin User since: 05/07/08


Return to V6 Technical Support

Who is online

Users browsing this forum: No registered users and 2 guests