Page 1 of 1

Duplicate detecter reason for failing different files

PostPosted: Tue Dec 01, 2015 4:53 pm
by johnisme
The reason I'm getting a lot of duplicate detection with different files is that there are shows which have the exact same intro for the first minute,it never happens with shows that have different intros,any way to change the detection so it doesn't scan the first part of the files?This happens on all the 6.62 builds up to the latest version as of today.

Re: Duplicate detecter reason for failing different files

PostPosted: Tue Dec 01, 2015 6:53 pm
by Quade
Makes sense. It's just checking the first 26K of the file. I could change it to make it check the first 200k or more but that would invalidate all signature up to this point.

If you're mostly downloading large files, I'd probably just disable the dup detector.

Re: Duplicate detecter reason for failing different files

PostPosted: Tue Dec 01, 2015 10:01 pm
by johnisme
The files are usually 700-2000MB so it would take around 14-40 mB to check the files so i'll keep an eye on the files,it's better for me just to check the dupes to see if i have the file rather than d/l real duplicates again.

Re: Duplicate detecter reason for failing different files

PostPosted: Tue Dec 01, 2015 10:39 pm
by Quade
For large files like that the dup detector is only marginally useful. The issue is that only a 100% identical repost will be dup checked out. A file for the same...thing but a different release will still download because they're not binary identical even though the content might be the same. Things like codec and res will change the binary signature.