Author Topic: Console text encoding issues during mod installation  (Read 1189 times)

Offline Argent77

  • Planewalker
  • *****
  • Posts: 187
Console text encoding issues during mod installation
« on: May 13, 2017, 04:44:51 PM »
I found a strange encoding issue for text displayed during installation in the text console. WeiDU appears to switch character encoding from OEM 850 to Windows-1252.

A test mod to demonstrate: TestEncoding.zip (Screenshot)

The test mod includes a single traified line that contains the special character 'Æ' in both OEM 850 and Windows-1252 encoding.

Text in component name is initially displayed in OEM 850 (expected), but subsequent copies of the same line are displayed in Windows-1252 encoding if you install the component (unexpected). Encoding stays in OEM 850 if you choose not to install the component.

(Tested on Windows 7 with western regional settings.)

Offline Wisp

  • Moderator
  • Planewalker
  • *****
  • Posts: 1176
Re: Console text encoding issues during mod installation
« Reply #1 on: May 13, 2017, 05:34:24 PM »
This is not WeiDU, it's Windows. Install the mod from the command line and redirect (>) the command output to some file. No strings are changed.

Offline AL|EN

  • Planewalker
  • *****
  • Posts: 391
  • Gender: Male
Re: Console text encoding issues during mod installation
« Reply #2 on: May 14, 2017, 04:28:36 AM »

@Argent77
I face similar issue but testing using Windows 10 1507 show no issue: http://image.prntscr.com/image/5fabf504d9ff4162b18c72fee391520a.png


Adding UTF-8 into Windows Console (CMD) is not an easy task because:
Quote
As Chip said, UTF-16 is rather baked into the stuff we do. The console host does use UTF-16 somewhere in there. :P We just have the matter of dealing with code pages throughout the history of computing existence that causes us heartburn every time we think about how to fix this. :( It’s definitely something that we would like to look into on our backlog.
« Last Edit: June 05, 2017, 02:16:33 PM by AL|EN »
Project Infinity public BETA - mod manager for Infinity Engine games
Modder's Guide to Github - you cannot have progress without committing changes

 

With Quick-Reply you can write a post when viewing a topic without loading a new page. You can still use bulletin board code and smileys as you would in a normal post.

Warning: this topic has not been posted in for at least 120 days.
Unless you're sure you want to reply, please consider starting a new topic.

Name: Email:
Verification:
Type the letters shown in the picture
Listen to the letters / Request another image
Type the letters shown in the picture:
What color is grass?:
What is the seventh word in this sentence?:
What is five minus two (use the full word)?: