renaming of obfuscated posts only partially working

This is the place to help test and discuss Version 6 Beta releases.

renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 5:02 am

6.80 beta 12 is supposed to rename obfuscated posts.

Well, it renames some, but leaves unrenamed others.
It is difficult to catch the differences, especially, that if I try to download the same post again, its intermediate files for some reason are placed to a different folder than when downloading for the first time.
But it does not affect the outcome of renaming, it seems.
Anyway, I see the same multi-level obfuscation: post names are obfuscated, then they are renamed by par2 to rars with a different obfuscated name , and finally, inside the rar is mkv with yet another obfuscated name.
So, in some cases mkv files are renamed, in other cases - not renamed.

It seems that posts that are extracted to more traditional folders (such as a.b.teevee) are renamed, but to some more obscure folders (but also to boneless) - not.
Again, I might be wrong. Perhaps they are renamed if I have these groups in a group folder, but if a separate group - then not.
Perhaps I could provide nzb files as examples of both cases. But if the result of renaming depends on groups being inside folders of groups, then it may not be reproduced even with the same nzb files.

It is also interesting to see if beta 8 compacts files inside nzb files that previously were not compacted (quite often)- and with not compacted files it takes forever to download if par2 files are also put into the download list - because NewsBin creates multiple rar parts from par2s in repairing process rather than simply downloading them.
So far so good, but I only tried beta 12 for a very short time.
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby Quade » Sun Dec 03, 2017 9:44 am

PM me the filenames of some of the ones that don't rename. Currently it's very specific about what kind of file it renames. If I had to guess, I'd guess that the ones that don't rename don't follow the naming spec I'm looking for.

It is also interesting to see if beta 8 compacts files inside nzb files that previously were not compacted (quite often)- and with not compacted files it takes forever to download if par2 files are also put into the download list - because NewsBin creates multiple rar parts from par2s in repairing process rather than simply downloading them.


This might suggest that all the files aren't downloading to the same folder. You might want to make sure your download path doesn't spread the files around.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 12:57 pm

OK, nzb files sent.

In my very limited experience with Sonarr + NewsBin, all obfuscated files are renamed.
Perhaps you could use some ideas from that thing.
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 1:09 pm

Quade wrote:
This might suggest that all the files aren't downloading to the same folder. You might want to make sure your download path doesn't spread the files around.


No, the files are downloaded all to the same folder. It goes like this:
rars are downloaded but not all, when it is enough pars to re-create the remaining rars, the download stops and repairing begins. After the remaining rars are created, the file is extracted from rars and rars are deleted.
And then, the remaining rars finally are downloaded to the same folder.
So I have left with the extracted file and with dupes of the generated rars. Those dupes perhaps could be avoided - not sure - I think I often use "Download - Bypass Filters".
But repairing cannot be avoided.

It is an old problem, not only with nzbs. When a post is not collapsed into a single line, repairing begins before all the available rar parts are downloaded. And repairing is much much slower than downloading.
The problem is probably with not collapsing - already there is some problem preventing recognizing that it is the same post.

If I want to download such post quickly, I do not add any par2 blocks to the download list. When there are no blocks to repair, all the rar parts are downloaded and the file is extracted - very fast.
I add some par2 blocks only if it turns out they are needed.
But this approach is very manual, one post at a time.

I read that beta 12 better recognizes and collects together parts of the same post, so perhaps the issue is already fixed.
I should be able to test it if I could recall some not collapsed posts or nzb files. Especially in nzb files such cases were very frequent
Last edited by RayMark on Sun Dec 03, 2017 1:22 pm, edited 1 time in total.
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby Quade » Sun Dec 03, 2017 1:14 pm

And then, the remaining rars finally are downloaded to the same folder.


Yeah, it's sort of the nature of the obscured beast. You could probably fix this by moving the pars below the rars. If files aren't compacted, cleanup after repair is problematic.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 1:28 pm

Sorry, added more text to the post above :)

I am trying to remember some nzbs with non-collapsed posts, I should be able to test beta 12 if it still is the case, because the version history says:
"Changes to better group certain posting styles into files"
And then:
"Fixed issue with certain posting styles where feeding an NZB into a post list from double-click wouldn't compact but it would compact when loading it into the files list."
Not sure if it is related to this.
With versions at least prior to beta 12, if I click on .nzb, it shows up in a separate tab, and its content is either collapsed or not.
I will try to test if non-collapsed content is now collapsed in beta 12.
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 1:33 pm

Yes!!!
Thank you!!!
Sorry for not staying on topic :)

I just tested with one nzb file - now its content is collapsed into a single line.
Then I quit beta 12 and started beta 11 to make sure - the same nzb is shown not collapsed in beta 11 - 27 lines of rars and pars
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby mkrubsack » Sun Dec 03, 2017 4:09 pm

Is there a switch to turn this on? For example, in A.B.Sounds.FLAC, nothing gets renamed for me. I download new headers, and they are all obfuscated.
mkrubsack
Active Participant
Active Participant
 
Posts: 61
Joined: Sat Aug 25, 2012 5:39 pm
Location: California

Registered Newsbin User since: 08/25/12

Re: renaming of obfuscated posts only partially working

Postby itimpi » Sun Dec 03, 2017 4:32 pm

mkrubsack wrote:Is there a switch to turn this on? For example, in A.B.Sounds.FLAC, nothing gets renamed for me. I download new headers, and they are all obfuscated.

The renaming only works if using NZB files. The feature relies on the NZB file having a sensible name that Newsbin uses in the rename process.
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12604
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: renaming of obfuscated posts only partially working

Postby mkrubsack » Sun Dec 03, 2017 4:57 pm

itimpi wrote:
mkrubsack wrote:Is there a switch to turn this on? For example, in A.B.Sounds.FLAC, nothing gets renamed for me. I download new headers, and they are all obfuscated.

The renaming only works if using NZB files. The feature relies on the NZB file having a sensible name that Newsbin uses in the rename process.

OK. Got it.
mkrubsack
Active Participant
Active Participant
 
Posts: 61
Joined: Sat Aug 25, 2012 5:39 pm
Location: California

Registered Newsbin User since: 08/25/12

Re: renaming of obfuscated posts only partially working

Postby RayMark » Sun Dec 03, 2017 5:20 pm

Quade,

I have sent you some more not renamed files.
I will stop sending more for now - possibly the issue is everywhere the same.
If you make them to get renamed, I will send more not renamed then :)
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby RayMark » Mon Dec 04, 2017 4:01 am

BTW, what are .jig files. They began to appear recently (I think) in nzb files, always red and not downloaded but indicated as available in properties.
They do not seem to affect anything, downloading or renaming. But why they are always red if available?
Is it the Newsbin fault or problems with them on all the servers?
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby RayMark » Mon Dec 04, 2017 7:52 pm

Continuing off-topic:

Now I have the first example of not fully grouped / collapsed.
Still 91 lines: All the parts with numbers below 100 are separately.
Numbers begin from 10, so .10 - .99 - separately.
But 100 and above + all pars - grouped together and collapsed. Perhaps it is enough information to fix.
If not, I can give the name or upload the .nzb

BTW, NewsBin, Easynews and 15 nzb sites I tried cannot find the post by its real name - but some can.
However, in this case NewsBin's own Internet search is able to find the post by its obfuscated subject.
And here comes the interesting part: in this case, only pars are grouped / collapsed. Even parts with numbers 100 and above are on separate lines.
When handling .nzb - more grouped than when handling the Internet search results. But perhaps the grouping was improved for nzbs only?
In both cases all the parts are shows in the same group: boneless.
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby Quade » Tue Dec 05, 2017 2:14 pm

I reproduced the no rename thing. It's what I expected. It's obscured in a different way. I need to figure out how to decide obscured/not obscured in a more general way.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: renaming of obfuscated posts only partially working

Postby RayMark » Tue Dec 05, 2017 11:54 pm

Interesting that it happens with some posts seemingly in a series of posts by the same poster to the same group

I also can give you an example where not all parts are grouped together (but some are) - and for some reason differently in a nzb than in the search results
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby Quade » Wed Dec 06, 2017 11:01 am

I have to take back what I said, the code was handling at least two of the NZB's you sent so, I'm not sure why it's not working for you yet.

We'll see in the next beta.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: renaming of obfuscated posts only partially working

Postby RayMark » Wed Dec 06, 2017 2:30 pm

I have sent you also the renamed ones for comparison.
You have to look inside the PMs which ones were not renamed.
I hope I marked the not renamed ones correctly.
Let me check again.

Yes, I think I listed correctly the ones that were not renamed.

The 1st bunch (G02):
not renamed ones: 02-03, 05, 07

The 2nd bunch (BS01):
not renamed ones: 02-08
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: renaming of obfuscated posts only partially working

Postby Quade » Wed Dec 06, 2017 5:04 pm

Ok, I'll re-read
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44867
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: Google [Bot], Streetwolf and 3 guests