Comskip and 4K

Here you can ask your questions on how to use Comskip for the detection of commercials. Also questions on how to remove commercials are welcome
Post Reply
AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Comskip and 4K

Post by AlphaZulu » Fri Jun 14, 2019 11:09 pm

Should the donor version of Comskip be able to handle a 4K show?

Here is the video details.
Format : MPEG-TS
File size : 3.29 GiB
Duration : 26 min 25 s
Overall bit rate mode : Variable
Overall bit rate : 17.8 Mb/s

Video
ID : 256 (0x100)
Menu ID : 1 (0x1)
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5.1@Main
Codec ID : 36
Duration : 26 min 25 s
Width : 3 840 pixels
Height : 2 160 pixels
Display aspect ratio : 16:9
Frame rate : 59.940 (60000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits

Audio
ID : 257 (0x101)
Menu ID : 1 (0x1)
Format : AAC LC
Format/Info : Advanced Audio Codec Low Complexity
Format version : Version 2
Muxing mode : ADTS
Codec ID : 15-2
Duration : 26 min 25 s
Bit rate mode : Variable
Channel(s) : 2 channels
Channel layout : L R
Sampling rate : 48.0 kHz
Frame rate : 46.875 FPS (1024 SPF)
Compression mode : Lossy
Delay relative to video : -918 ms
Language : English

Menu
ID : 4096 (0x1000)
Menu ID : 1 (0x1)
Duration : 26 min 25 s
List : 256 (0x100) (HEVC) / 257 (0x101) (AAC, English)
Language : / English
Service name : Service01
Service provider : FFmpeg
Service type : digital television

erik
Site Admin
Posts: 3302
Joined: Sun Aug 21, 2005 3:49 pm

Re: Comskip and 4K

Post by erik » Sat Jun 15, 2019 8:02 am

Internal video buffers are limited to 1920x1080 so: no

erik
Site Admin
Posts: 3302
Joined: Sun Aug 21, 2005 3:49 pm

Re: Comskip and 4K

Post by erik » Sat Jun 15, 2019 8:04 am

However, if libavcodec can do lowres decoding on 4k it may work.
Can you test with lowres=10

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Sat Jun 15, 2019 2:32 pm

erik wrote:However, if libavcodec can do lowres decoding on 4k it may work.
Can you test with lowres=10
Thanks, I tired and the failure is the same. Any chance in increasing the video buffers. :-)

erik
Site Admin
Posts: 3302
Joined: Sun Aug 21, 2005 3:49 pm

Re: Comskip and 4K

Post by erik » Sat Jun 15, 2019 6:42 pm

Yes. Next build

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Sat Jun 15, 2019 7:27 pm

erik wrote:Yes. Next build
That is fantastic news. Thanks Erik.

erik
Site Admin
Posts: 3302
Joined: Sun Aug 21, 2005 3:49 pm

Re: Comskip and 4K

Post by erik » Tue Jun 18, 2019 8:15 pm

Build 009 is release with video size up to 4000*2400 (although I can not test as I do not have such recordings)
Can you test?

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Thu Jun 20, 2019 12:03 am

erik wrote:Build 009 is release with video size up to 4000*2400 (although I can not test as I do not have such recordings)
Can you test?
Tested and Failed with the same error as previous build.

Here is a OneDrive Link to the video file. https://1drv.ms/u/s!Au3gzKAQDK0wga5FE_85LilyMEMzfw
################################################################
Generated using donator Comskip 0.82.009
Time at start of run:
Wed Jun 19 18:49:31 2019
################################################################
Mpeg: C:\Users\AZ\Desktop\Comskip Testing\2019FIFAWomensWorldCup-EnglandvsArgentina-17903519-0.ts
Exe C:\Users\AZ\Desktop\Comskip Testing\comskip.exe
Logo: C:\Users\AZ\Desktop\Comskip Testing\2019FIFAWomensWorldCup-EnglandvsArgentina-17903519-0.logo.txt
Ini: C:\Users\AZ\Desktop\Comskip Testing\comskip.ini

Detection Methods to be used:
1) Black Frame
2) Logo - Give up after 2000 seconds
3) Scene Change
4) Resolution Change
5) Aspect Ratio


ComSkip throttles back from -0001 to -0001.
The time is now 1849 so it's full speed ahead!

Settings
--------
[Main Settings]
;the sum of the values for which kind of frames comskip will consider as possible cutpoints: 1=uniform (black or any other color) frame, 2=logo, 4=scene change, 8=resolution change, 16=closed captions, 32=aspect ration, 64=silence, 255=all.
detect_method=47
;Set to 10 to show a lot of extra info, level 5 is also OK, set to 0 to disable
verbose=10
;Frame not black if any of the pixels of the frame has a brightness greater than this (scale 0 to 255)
max_brightness=60
maxbright=1
;Frame not pure black if a small number of the pixels of the frame has a brightness greater than this. To decide if the frame is truly black, comskip will also check average brightness (scale 0 to 255)
test_brightness=40
;
max_avg_brightness=20
;
max_commercialbreak=600
;
min_commercialbreak=25
;
max_commercial_size=200
;
min_commercial_size=30
;
min_show_segment_length=125
;
max_volume=500
;
max_silence=100
;
non_uniformity=250
[Detailed Settings]
min_silence=12
remove_silent_segments=0
noise_level=5
brightness_jump=200
fps=25
validate_silence=1
validate_uniform=1
validate_scenechange=1
global_threshold=1.05
disable_heuristics=4
cut_on_ac_change=1
[CPU Load Reduction]
thread_count=5
hardware_decode=0
play_nice_start=-1
play_nice_end=-1
play_nice_sleep=10
[Input Correction]
max_repair_size=200
ms_audio_delay=5
volume_slip=40
lowres=0
skip_b_frames=0
[Aspect Ratio]
ar_delta=0.08
cut_on_ar_change=1
[Global Removes]
padding=0
remove_before=0
remove_after=0
added_recording=1
delete_show_after_last_commercial=0
delete_show_before_first_commercial=0
delete_show_before_or_after_current=0
delete_block_after_commercial=0
min_commercial_break_at_start_or_end=39
always_keep_first_seconds=0
always_keep_last_seconds=0
[USA Specific]
intelligent_brightness=1
black_percentile=0.0076
uniform_percentile=0.003
score_percentile=0.71
[Main Scoring]
length_strict_modifier=3
length_nonstrict_modifier=1.5
combined_length_strict_modifier=2
combined_length_nonstrict_modifier=1.25
ar_wrong_modifier=2
ac_wrong_modifier=1
excessive_length_modifier=0.01
dark_block_modifier=0.3
min_schange_modifier=0.5
max_schange_modifier=2
logo_present_modifier=0.01
punish_no_logo=1
[Detailed Scoring]
punish=0
reward=0
punish_threshold=1.3
punish_modifier=2
reward_modifier=0.5
[Logo Finding]
border=10
give_up_logo_search=2000
delay_logo_search=0
logo_max_percentage_of_screen=0.1
ticker_tape=0
ticker_tape_percentage=0
top_ticker_tape=0
top_ticker_tape_percentage=0
ignore_side=0
ignore_left_side=0
ignore_right_side=0
subtitles=0
logo_at_bottom=0
logo_threshold=0.75
logo_percentage_threshold=0.25
logo_filter=0
aggressive_logo_rejection=0
edge_level_threshold=5
edge_radius=2
edge_weight=10
edge_step=1
num_logo_buffers=50
use_existing_logo_file=1
two_pass_logo=1
[Logo Interpretation]
connect_blocks_with_logo=1
logo_percentile=0.92
logo_fraction=0.4
shrink_logo=5
shrink_logo_tail=0
before_logo=0
after_logo=0
where_logo=0
min_black_frames_for_break=1
[Closed Captioning]
ccCheck=0
cc_commercial_type_modifier=4
cc_wrong_type_modifier=2
cc_correct_type_modifier=0.75
[Live TV]
live_tv=0
live_tv_retries=4
require_div5=0
div5_tolerance=-1
incommercial_frames=1000
[Output Control]
output_default=1
output_chapters=0
output_plist_cutlist=0
output_zoomplayer_cutlist=0
output_zoomplayer_chapter=0
output_scf=0
output_vcf=0
output_vdr=0
output_projectx=0
output_avisynth=0
output_videoredo=1
output_videoredo3=1
videoredo_offset=2
output_btv=0
output_edl=1
output_live=0
edl_offset=0
timeline_repair=1
edl_skip_field=0
output_edlp=0
output_bsplayer=0
output_edlx=0
output_cuttermaran=0
output_mpeg2schnitt=0
output_womble=0
output_mls=0
output_mpgtx=0
output_dvrmstb=0
output_dvrcut=0
output_ipodchap=0
output_framearray=1
output_debugwindow=1
output_tuning=0
output_training=0
output_false=0
output_aspect=0
output_demux=0
output_data=0
output_srt=0
output_smi=0
output_timing=0
output_incommercial=0
output_ffmeta=0
output_ffsplit=0
delete_logo_file=0
output_mkvtoolnix=0
cutscene_frame=0
cutscene_threshold=10
windowtitle="Comskip - %s"
cuttermaran_options="cut=\"true\" unattended=\"true\" muxResult=\"false\" snapToCutPoints=\"true\" closeApp=\"true\""
mpeg2schnitt_options="mpeg2schnitt.exe /S /E /R25 /Z %2 %1"
avisynth_options="LoadPlugin(\"MPEG2Dec3.dll\") \nMPEG2Source(\"%s\")\n"
dvrcut_options="dvrcut \"%s.dvr-ms\" \"%s_clean.dvr-ms\" "
[Sage Workarounds]
sage_framenumber_bug=0
sage_minute_bug=0
enable_mencoder_pts=0

Input #0, mpegts, from 'C:\Users\AZ\Desktop\Comskip Testing\2019FIFAWomensWorldCup-EnglandvsArgentina-17903519-0.ts':
Duration: 00:26:26.24, start: 0.021333, bitrate: 17794 kb/s
Program 1
Metadata:
service_name : Service01
service_provider: FFmpeg
Stream #0:0[0x100]: Video: hevc (Main 10) ([36][0][0][0] / 0x0024), yuv420p10le(tv), 3840x2160 [SAR 1:1 DAR 16:9], Closed Captions, 59.94 fps, 59.94 tbr, 90k tbn, 59.94 tbc
Stream #0:1[0x101](eng): Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp, 115 kb/s
Frame Rate set to 59.940 f/s

Initial audio pts = 0.000
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.
[hevc @ 0d3ae040] First slice in a frame missing.
[hevc @ 0d3ae040] First slice in a frame missing.
[hevc @ 0d3ae040] First slice in a frame missing.
[hevc @ 0d3ae400] First slice in a frame missing.
[hevc @ 0d3ae400] First slice in a frame missing.
[hevc @ 0d3ae400] First slice in a frame missing.
[hevc @ 0cfd82c0] First slice in a frame missing.
[hevc @ 0cfd82c0] First slice in a frame missing.
[hevc @ 0cfd82c0] First slice in a frame missing.
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d480] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.
[hevc @ 0d75d880] First slice in a frame missing.

Initial video pts = 0.017

Initial video pts = 0.033

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Sat Jun 29, 2019 7:32 pm

Just a bump in case you missed it Erik

erik
Site Admin
Posts: 3302
Joined: Sun Aug 21, 2005 3:49 pm

Re: Comskip and 4K

Post by erik » Sat Jun 29, 2019 8:50 pm

Thanks for the video
Same results here
Now I need a bit of time

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Sun Jun 30, 2019 11:41 am

Sounds good,

Thanks for your help.

AlphaZulu
Posts: 30
Joined: Wed Feb 02, 2011 3:33 am

Re: Comskip and 4K

Post by AlphaZulu » Mon Sep 30, 2019 11:18 am

erik wrote:Thanks for the video
Same results here
Now I need a bit of time
Any progress on 4K?

Post Reply