Author Topic: Weidu for BG:EE  (Read 19420 times)

Offline the bigg

  • The Avatar of Fighter / Thieves
  • Moderator
  • Planewalker
  • *****
  • Posts: 3804
  • Gender: Male
Re: Weidu for BG:EE
« Reply #25 on: December 17, 2012, 05:31:13 PM »
This is my BG2 TBD list (includes both WeiDU stuff and other mods). Hopefully that's useful.

There's no reasonable way to support ASCII, UTF-8 and whatnot, no matter the language and libraries used (not when you're dealing with disciplined people who know enough to use a proper text editor and save all their files in the same encoding, much less when people use a cracked copy of MS Word 2003 as their editor of choice). If anything, I'd embed an ad-hoc C++ utility and use it to overwrite local .tra files (doing ASCII -> UTF-8 for mods coded under Tutu and installed under BGEE, and viceversa).
« Last Edit: December 17, 2012, 05:34:29 PM by the bigg »
Author or Co-Author: WeiDU (http://j.mp/bLtjOn) - Widescreen (http://j.mp/aKAiqG) - Generalized Biffing (http://j.mp/aVgw3U) - Refinements (http://j.mp/bLHoCc) - TB#Tweaks (http://j.mp/ba02Eg) - IWD2Tweaks (http://j.mp/98OFYY) - TB#Characters (http://j.mp/ak8J55) - Traify Tool (http://j.mp/g1Ry9A) - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics (http://j.mp/9UeIwB) - Nalia Mod (http://j.mp/dng9l0) - Nvidia Fix (http://j.mp/aRWjjg)
Code dumps: Detect custom secondary types (http://j.mp/hVzzXG) - Stutter Investigator (http://j.mp/gdtBn8)

If possible, send diffs, translations and other contributions using Git (http://j.mp/aBZFrq).

Offline Avenger_teambg

  • Planewalker
  • *****
  • Posts: 399
Re: Weidu for BG:EE
« Reply #26 on: December 18, 2012, 02:56:47 AM »
Filetypes
What are the new file types? I've only got the numbers and they don't tell me much, I am afraid. (And if there was schooling to be had on the subject, I slept through the class.) Aside from being made recognisable types, is there anything else to be done?
0x400 .fnt     font format (bitmap? didn't care)   
0x403 .sql    text format (semi script/some parts are csv), replace_textually is enuff for now
0x402 .gui    text format (semi script), replace_textually is enuff for now
0x401 .wbm standard movie format
0x404 .pvrz   compressed binary format (textures)

Of these, only .sql and .gui are something i would touch with weidu (but all should be known as resource type).

Btw, i was self taught in the subject, there is not school for this.

Offline GeN1e

  • Planewalker
  • *****
  • Posts: 267
  • Gender: Male
Re: Weidu for BG:EE
« Reply #27 on: December 18, 2012, 10:14:48 AM »
Anyway,
what's on people's wishlist for 232?
We may need a tp2 macro to patch DLGs. The existing .D syntax is just not enough when you want to match and compare the script string line by line before applying a patch. Gonna be quite complex, however, if it were to be any useful.

Offline CamDawg

  • Infidel
  • Planewalker
  • *****
  • Posts: 859
  • Dreaming of a red Xmas
    • The Gibberlings Three
Re: Weidu for BG:EE
« Reply #28 on: December 18, 2012, 12:03:07 PM »
much less when people use a cracked copy of MS Word 2003 as their editor of choice
Shows what you know. Mine's a cracked coy of WordPerfect, so there!

We may need a tp2 macro to patch DLGs. The existing .D syntax is just not enough when you want to match and compare the script string line by line before applying a patch. Gonna be quite complex, however, if it were to be any useful.
Can you give an example? I've found the current .d syntax incredibly powerful for making changes.
The Gibberlings Three - Home of IE Mods

The BG2 Fixpack - All the fixes of Baldurdash, plus a few hundred more. Now available, with more fixes being added in every release.

Offline GeN1e

  • Planewalker
  • *****
  • Posts: 267
  • Gender: Male
Re: Weidu for BG:EE
« Reply #29 on: December 18, 2012, 02:44:03 PM »
Can you give an example? I've found the current .d syntax incredibly powerful for making changes.
ALTER_TRANSing in a state that may have been top- or bottom- appended with new transitions, i.e. when you may want to check what the trigger/action/text/etc. is before altering it blindly.
Also when you need to patch rather than overwrite the trigger/action - REPLACE_TRANS_ACTION/TRIGGER are quite good, but I recall lacking in freedom with it somewhere.

Basically, it's a compatibility thing. I mostly need it for the eventual Quest Revisions.

Offline Wisp

  • Moderator
  • Planewalker
  • *****
  • Posts: 1176
Re: Weidu for BG:EE
« Reply #30 on: December 18, 2012, 04:01:36 PM »
Okay, I built a new beta. Link.
Among other tricks, 231.06 can cope with Beamhauled biffs, unbiff the new file types and recognise BGEE for purposes of (GAME|ENGINE)_IS.

I didn't have time to go over the standard library, I'm afraid (and probably won't have until Thursday).

Offline Kaeloree

  • Planewalker
  • *****
  • Posts: 109
Re: Weidu for BG:EE
« Reply #31 on: December 18, 2012, 05:44:20 PM »
Small suggestion: if the game is BGEE and no override folder exists, create one?

Also, TLK location is still an issue.

Confirming that dialogue tokens now work with the new beta, thanks Wisp!

Offline Avenger_teambg

  • Planewalker
  • *****
  • Posts: 399
Re: Weidu for BG:EE
« Reply #32 on: December 19, 2012, 02:58:34 AM »
Okay, I built a new beta. Link.
Among other tricks, 231.06 can cope with Beamhauled biffs, unbiff the new file types and recognise BGEE for purposes of (GAME|ENGINE)_IS.

I didn't have time to go over the standard library, I'm afraid (and probably won't have until Thursday).

Thank you, Wisp. I will be testing it.

Offline Wisp

  • Moderator
  • Planewalker
  • *****
  • Posts: 1176
Re: Weidu for BG:EE
« Reply #33 on: December 20, 2012, 02:49:32 PM »
This is my BG2 TBD list (includes both WeiDU stuff and other mods). Hopefully that's useful.
Thank you.

Small suggestion: if the game is BGEE and no override folder exists, create one?
Yes, I should put that in.

Also, TLK location is still an issue.
Yeah, and it will likely remain a problem for a while longer (but in the mean time, hardlinking the file is easy). Aside from adjusting the code to deal with multiple output TLKs without breaking existing functionality, there is also the matter of which TLK strings should be sourced from (for, e.g., the German who wants to decompile a DLG and get German text), the matter of the character encoding and possibly a few other issues that need to be, or should be, sorted out at the same time. All in all, it's a fair bit of work.

Offline cmorgan

  • Planewalker
  • *****
  • Posts: 1424
  • Gender: Male
  • Searcher of Bugs
Re: Weidu for BG:EE
« Reply #34 on: May 03, 2013, 02:04:54 PM »
Hey, is there any reason *not* to distribute (.d|.baf|.tp2|.tpa) files for weidu for all target i.e. games using UTF=8 encoding, rather than ANSI? i know you are working on coversion, but if a modder throws down in UTF-8 it should be good for BG/Tutu/BG:EE/BG2/ToB/BG2:EE/IWD1|IWD2/PST, right?

Offline Ascension64

  • Planewalker
  • *****
  • Posts: 472
Re: Weidu for BG:EE
« Reply #35 on: May 03, 2013, 06:40:52 PM »
The issue is languages. x86 Windows systems still use local code pages for display of text. While you can use UTF-8 for Mac/Linux stuff, it special characters will display funny in Windows.

Offline cmorgan

  • Planewalker
  • *****
  • Posts: 1424
  • Gender: Male
  • Searcher of Bugs
Re: Weidu for BG:EE
« Reply #36 on: May 03, 2013, 10:53:14 PM »
Oh bother.

OK, so ANSI for encoding, and let weidu do the conversion.

asdfasldkf

  • Guest
Re: Weidu for BG:EE
« Reply #37 on: July 11, 2013, 06:19:17 AM »
The issue is languages. x86 Windows systems still use local code pages for display of text. While you can use UTF-8 for Mac/Linux stuff, it special characters will display funny in Windows.

I may be on the wrong page here - but is the issue how UTF-8 is displayed (or not) in some editing programs?

Because if that's the issue, Notepad++ handles UTF-8 - and it's free.  I use it for all my scripting/coding and have done for probably decades.

Would telling folks to use Notepad++ help with this issue?

Offline Isaya

  • Planewalker
  • *****
  • Posts: 47
Re: Weidu for BG:EE
« Reply #38 on: July 11, 2013, 04:56:10 PM »
Would telling folks to use Notepad++ help with this issue?
Unfortunately, the point is not the editor people would use to write the tra files but the way the games handle character sets. And the fact that WeiDU shall operate with both older games and BGEE.

In older games, they only want ANSI, so UTF-8 characters wil become garbage in the games. Besides a few Eastern Europe languages use ANSI codes from Windows code pages (equivalent to their ISO-8859-X counterparts) to get their special characters displayed. So there is not a single ANSI encoding, but several. So conversion from ANSI to UTF-8 or from UTF-8 to ANSI is not a simple thing either, as it depends on the language.

For more on this topic, you may read this thread regarding a proposal to handle this with WeiDU and that topic explaining the issue with ANSI characters in BGEE.

 

With Quick-Reply you can write a post when viewing a topic without loading a new page. You can still use bulletin board code and smileys as you would in a normal post.

Warning: this topic has not been posted in for at least 120 days.
Unless you're sure you want to reply, please consider starting a new topic.

Name: Email:
Verification:
Type the letters shown in the picture
Listen to the letters / Request another image
Type the letters shown in the picture:
What color is grass?:
What is the seventh word in this sentence?:
What is five minus two (use the full word)?: