Tuning for german PayTV w/o logo

To discuss the tuning of comskip and for posting your ini files
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Tuning for german PayTV w/o logo

Post by sascha »

Hi Erik,

i have tested your tool. It is very nice and worked very well. I tuned it for german tv.

Often I record from the germany pay tv "Premiere World". It is without any commercial in the show, only before and after.

On programms like SciFi or DisneyChannel your tools worked good, because on this programms is a logo. But on the programms "Premiere 1 - 7" is no logo in the films. Some logos are between the films, even when showing preview of coming films.
Every film begins with the same Intro.

So I think, how does comskip work when inverting the detection? Mean, detect blocks with logo and cuts it out.

How can I tune comskip to detect the films on "Premiere 1-7" w/o logo?

Many thanks
Sascha from germany
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

I used to have such an "inverted logo" approach but had to dump it because of incorrect results.

If there is too little logo then the logo score should be automatically disabled, as you can see in the log file.

Would it be possible for you to follow this procedure for one or more shows where Comskip is doing a bad job?
http://mk.kaashoek.com/comskip/viewtopic.php?t=34
so I can look into it a little better?
I am certainly interrested in finding a solution.
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

Here U can find some outputs. All with same ini. Hope this can help U. If interested I will give U more.

Normally I start recording 5 minutes before and stop 5 minutes after the film.

These are OK:
http://www.lyonware.de/comskip/German_Traumschiff.zip (perfect cut)
http://www.lyonware.de/comskip/German_Terminal.zip (ok, cuts trailer before+after, but perfect)

These are not OK:
http://www.lyonware.de/comskip/German_GrosseHaie.zip
http://www.lyonware.de/comskip/German_FinalCall.zip
http://www.lyonware.de/comskip/German_Der_Wixxer.zip



Thanks
Sascha
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

Sacha,

First observation is that your
max_avg_brightness=15
is too low, it should be something like
max_avg_brightness=18 or 20

Could you try this?

Second observation is that this will be a challenge to get it right!
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

I set max_avg_brightness lower than 18 to get better results at Star Trek Vojager.
In Yojager many scene are in space, mean black, only see a star or planet. Comskip cuts this scene.

Now I tested the film with 20 max_avg

http://www.lyonware.de/comskip/German_D ... avgb20.zip (no differnce)

http://www.lyonware.de/comskip/German_F ... avgb20.zip (found the end of the film, but adds a commercial to the end, the beginning is also too late)

http://www.lyonware.de/comskip/German_T ... avgb20.zip (no difference)

http://www.lyonware.de/comskip/German_G ... xavg20.zip (no difference)

Will test the rest later.

Is it possible to cut the middle of the film out and test only the beginning and the end, it would me much faster to test. Or does this affect the testresults?
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

Only when changing the max_avg_brightness setting you have to rerun on the mpeg, otherwise you can rerun on the .csv only.

When looking at the punish value's they seem a good indication of where the commercials are.

This requires a completely different approach of using the modifiers.
You will have to set them all to 1.0 to effectively disable them, and then only use the punish modifier.

May I also suggest not to use the silence? So set detect_method=47
As far as I can see silence generated mostly wrong cutpoints.
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

Sorry, what do you mean with "set them all to 1.0", please tell me what values do U mean.

I set
detect_method=47
min_show_segment_length=360
punish_threshold=0
punish_modifier=2

For "Der Wixxer" i set punish to 255 to catch the film, the first and the last scence is missing.

For "FinalCall" i set also punish to 255 and catched the film, the binning is missing, but the last commercial is killed.

For "GrosseHaie" the above values don't work, with value 255 the film is cut into 4 pieces, i have to set punish to 0 to catch the film. Also the first block is a commercial.
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

There are a number of modifiers as explained in the tuning guide such as (maybe spelling errors) ar_wrong_modifier, excessive_length_modifier, logo_present_modifier, etc.
If you set these all to 1.0 they will no longer influence the scoring.
Then you can set
punish=255
causing the brightness, volume, silence, uniformity, etc to be included in the scrorin.

If you look at the graphs in the Comskip debug window you will notice the wthite lines turing red where the punish value exceeeds the thresholds so these blocks will get scored towards commercial.
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

I have tested many setting and found one setting for "Premiere World" (w/o logo) and one for german tv with commercial and logo.

Comskip finds the films and cuts very good.

1.Now there is an other problem on Priemere recorded films. Sometimes I get a Block before or after the film scored as show

(like com, long show, com, short show, com).

Don't know how to kill by scoring. My idea is to set a switch to kill all show smaller then the biggest connected block.

2. Sometimes before or after a film is a trailer from the creator. Comskip regcognize it as a block, but don't score it to show, because it is only 5-20 seconds.
Is it possible to set a switch to connect the next directly commercials shorter von X seconds to the show.

3.Previews of films have often a logo. ComSkip scored a block by founding a logo in it. I saw in debug mode that U callculated the percence amount of the logo in a block.
Is it possible to score this percence with a modifier. I know that U do this by yourself, but i think it would be great for tunning.

How do you think about it?

Thanks Sascha
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

Sascha,

You are realy deep into tuning!
I have considered to change the internal fixed rules to a completely user definable set of rules.
This however is a big effort which for the moment is not possible.

However, If you could send me examples of recordings that comskip fails upon it would realy help me to better understand what comskip is expected to do. This allows me to make, where possible, small improvement steps.

You do not have to send the mpeg file, just the .csv and the .ref file
How to do this is described in the post "how to ask for help"
http://mk.kaashoek.com/comskip/viewtopic.php?t=34

Do include a small text file describing why you want comskip to have some exceptional behaviour (like with the previews) The other two examples just should not happen in a perfect world.....
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

Erik,

thanks for your help.

At the moment I have created four different settings and test this settings with my films (the films are with and w/o commercials). I want to find the best setting.
I will post he results and the csv in the next days. So I hope you will have enought examples.

If it would be too complicated to cut blocks before and after or connects directly blocks I can build a tool that works on the outputfiles from comskip.

Is there an block file output?

Do you have an special test tool for the csv files? How do you test it?

Sascha
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

Sascha,

Make sure you include the .ref files showing where the cuts are supposed to be!!!!!!
Otherwise its too much effort for me.

You can use comskip on the csv files

Comskip -w filename.csv
Simplest is to put a shortcut on the desktop with
comskip -w
as a target
then drag and drop the csv file on top of it.

This will open the debugwindow and show the results of the comskip processing without having to rerun comskip on the mpeg file.

In the debugwindow you can step through the .csv file with zooming/unzooming.
This is described in the documentation of Comskip

If I remember well (not sure!) there is a switch that can tell Comskip to output the block list in a csv format.
Set
output_training=1
in the ini file
I don't know anymore the name of the generated file (comskip.csv?) or where it is generated (current directory)
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

Erik,

sorry, output_training doesn't work. I don't find it in the scource, too.

Sascha
erik
Site Admin
Posts: 3368
Joined: Sun Aug 21, 2005 3:49 pm

Post by erik »

Will have a look tomorrow
sascha
Posts: 17
Joined: Sun May 28, 2006 8:16 pm

Post by sascha »

Perfect, how do u test the csv-files?
Post Reply