Page 1 of 1

Avs saving utf8

Posted: Fri Oct 06, 2017 11:23 am
by Dimsok
Comskip make avs in utf8 (65001), which unsupport by avisynth. I have to manually change encoding to ansi 1251 to run it. Is there a way to make it auto?

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 11:25 am
by erik
Is that the filename?

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 11:56 am
by Dimsok
It's Cyrillic name. For example, Первый канал.TS.

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 12:14 pm
by erik
I was already happy to get it working for utf8, not sure I want to change it.....

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 12:26 pm
by Dimsok
I did try on file 22.ts, and avs was made in 1251. so it started normally. Why to use utf8 on cyrillic, if it can be in ansi (without any umlauts. accent-graves, kanji, chinese characters etc).

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 12:27 pm
by erik
Can you send me a very short recording with filename in ANSI 1251?

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 12:57 pm
by Dimsok
Sent to pm.

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 2:25 pm
by Jagad
erik wrote:I was already happy to get it working for utf8, not sure I want to change it.....
It does not make any sense changing back to old outdated encoding. I hope you not even contemplating it. This is not a comskip problem, but user have to solve it by himself if he wants to use ancient software. VRD will finally support Unicode (utf-8) fully in next version (v6 release in a few months).
Dimsok wrote:Comskip make avs in utf8 (65001), which unsupport by avisynth. I have to manually change encoding to ansi 1251 to run it. Is there a way to make it auto?
You will have to use a conversion script like the rest of us if you want to go from Unicode (utf-8) to ANSI automatically. Google it and you will find lots of em.

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 3:00 pm
by erik
Indeed I will not change as I simply don't know how to make this work for all test files I have.

Re: Avs saving utf8

Posted: Fri Oct 06, 2017 3:18 pm
by Jagad
Puh, thanks erik :D I have waited 6 long years on this VRD unicodification and im very eager to strip away all my conversionscripts from my automated commercialstipping file-editing system...going pure Unicode. Was shoaking on my coffee there for a while, but im relaxed again :) :lol:

Re: Avs saving utf8

Posted: Sun Apr 01, 2018 2:42 pm
by popy
Hey.

Also have an issue with recordings from DVBV which have UTF8 chars in it.
Comskip says: could not open file.

Here is a link to an issue i have created: https://github.com/erikkaashoek/Comskip/issues/101

Is there anything i am missing :D

thx
pOpY

Re: Avs saving utf8

Posted: Sun Apr 01, 2018 2:53 pm
by erik
What file extension?

Re: Avs saving utf8

Posted: Sun Apr 01, 2018 2:58 pm
by popy
Here is the filename which fails:

2018-03-31_22-00-00_ProSieben MAXX_60 Days In – Undercover im Knast - Schlangennest.ts

And one which works:

2018-03-30_00-05-00_RTL NITRO_MythBusters The Search - Der Fast & Furious -Schleudersitz.ts

Can you see the larger – sign in the first file name, when i'll remove this, the issue is gone.
It's an UTF8 char (EN DASH) 0xE2 0x80 0x93 (e28093)

I have made progress here, when ill open a cmd window, set the font to Lucida console and executing "chcp 65001" i am able to specify the filename to comskip and it works.
Now an recording is running in DVBV with an unicode sign in filename and after that my post_recording.bat (which calls comskip) will be executed.

Hope this works.

Or do you have an guide for DVBV + UTF8 chars + comskip?

thx
pOpY

Re: Avs saving utf8

Posted: Sun Apr 01, 2018 6:58 pm
by popy
Update:

It work now with an batch file!
In the batch i had:

comskip.exe "%1" -t

but it should be:

comskip.exe %1 -t

Also when you copy the filename of an file from explorer which has UTF8 chars in it into an CMD window the UTF8 chars will be converted to ASCII from windows and comskip does'nt find it.
So my issue is solved.

pOpY

Re: Avs saving utf8

Posted: Sun Apr 01, 2018 7:16 pm
by erik
Happy to hear