Folders/Files with International Characters Crashing FS-UAE [Resolved]

[DisasterIncarna]

I currently use directory hard drives for my emulation setups, usually ncie and fast, and in my previous installs of pretty much everything i always skipped/didnt install foreign languages, however rather than go through all that installation stuff (as some bad installers copy over new libraries/etc with old ones) i tend to manually install a lot of things.

So recently i have done just that, got what i wanted, changed the icon visuals to what i want then copy the programs over to my system, this however is where i have noticed an issue, i found when i did this, FS-UAE would simply crash/exit, no warnings/messages, just instant quit, and i narrowed down the issue to attempting to read/write/copy files and foldres with international characters in them.

to test this with 2 recent programs i downloaded (same happens on anything, but i wanna keep my example short) i manually did a "List" on folders in these 2 test programs and found the issue was the catalogs folders, and thats when i saw it was only the folders with international characters in them that resulted in a crash, to make sure i seperated these folders into a test folder, leaving plain english characters and trying to access/list these folders, and indeed only the folders/files with international characters have this result.

My test was using YAM and Jabberwocky, simply because i was updating these as the ones i had were out of date, i copied their folders that had international characters into a separate "TEST" folder (via windows, otherwise the emulator obv crashes) and did my tests on the 2 clean folders and the new TEST folder that always crashes the emulator. (originally thought this could be an issue with OS3.2 as its new, but my old 3.1 rom+install does the same thing).

This is FS-UAE 3.0.5 Running on Windows 10 x64, Emulating a1200/020/fpu, same result on OS3.2 and 3.1.

(Directory List Via Windows Dir Command - As Emulator obviously crashes when trying to dump to a text file...)

E:\CrashCheck\Jabberwocky-Catalogs
E:\CrashCheck\YAM-Catalogs
E:\CrashCheck\Test

Jabberwocky catalog folder with international files/folders moved to Test directory.
E:\CrashCheck\Jabberwocky-Catalogs\blank.ct
E:\CrashCheck\Jabberwocky-Catalogs\deutsch
E:\CrashCheck\Jabberwocky-Catalogs\italiano
E:\CrashCheck\Jabberwocky-Catalogs\Jabberwocky.cd
E:\CrashCheck\Jabberwocky-Catalogs\magyar
E:\CrashCheck\Jabberwocky-Catalogs\nederlands
E:\CrashCheck\Jabberwocky-Catalogs\polski
E:\CrashCheck\Jabberwocky-Catalogs\russian
E:\CrashCheck\Jabberwocky-Catalogs\srpski
E:\CrashCheck\Jabberwocky-Catalogs\svenska
E:\CrashCheck\Jabberwocky-Catalogs\deutsch\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\italiano\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\magyar\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\nederlands\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\polski\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\russian\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\srpski\Jabberwocky.catalog
E:\CrashCheck\Jabberwocky-Catalogs\svenska\Jabberwocky.catalog

YAM catalog folder with international files/folders moved to Test directory.
E:\CrashCheck\YAM-Catalogs\bosanski
E:\CrashCheck\YAM-Catalogs\czech
E:\CrashCheck\YAM-Catalogs\dansk
E:\CrashCheck\YAM-Catalogs\deutsch
E:\CrashCheck\YAM-Catalogs\english
E:\CrashCheck\YAM-Catalogs\greek
E:\CrashCheck\YAM-Catalogs\italiano
E:\CrashCheck\YAM-Catalogs\magyar
E:\CrashCheck\YAM-Catalogs\nederlands
E:\CrashCheck\YAM-Catalogs\norsk
E:\CrashCheck\YAM-Catalogs\polski
E:\CrashCheck\YAM-Catalogs\russian
E:\CrashCheck\YAM-Catalogs\slovensko
E:\CrashCheck\YAM-Catalogs\srpski
E:\CrashCheck\YAM-Catalogs\suomi
E:\CrashCheck\YAM-Catalogs\svenska
E:\CrashCheck\YAM-Catalogs\YAM.pot
E:\CrashCheck\YAM-Catalogs\bosanski\YAM.catalog
E:\CrashCheck\YAM-Catalogs\czech\YAM.catalog
E:\CrashCheck\YAM-Catalogs\dansk\YAM.catalog
E:\CrashCheck\YAM-Catalogs\deutsch\YAM.catalog
E:\CrashCheck\YAM-Catalogs\english\YAM.catalog
E:\CrashCheck\YAM-Catalogs\greek\YAM.catalog
E:\CrashCheck\YAM-Catalogs\italiano\YAM.catalog
E:\CrashCheck\YAM-Catalogs\magyar\YAM.catalog
E:\CrashCheck\YAM-Catalogs\nederlands\YAM.catalog
E:\CrashCheck\YAM-Catalogs\norsk\YAM.catalog
E:\CrashCheck\YAM-Catalogs\polski\YAM.catalog
E:\CrashCheck\YAM-Catalogs\russian\YAM.catalog
E:\CrashCheck\YAM-Catalogs\slovensko\YAM.catalog
E:\CrashCheck\YAM-Catalogs\srpski\YAM.catalog
E:\CrashCheck\YAM-Catalogs\suomi\YAM.catalog
E:\CrashCheck\YAM-Catalogs\svenska\YAM.catalog

---------

Folders/Files Below with International Characters Crash FS-UAE Emulation When Reading/Copying...
(Windows DIR command doesnt show filenames correctly, but show enough to know they have international chars)

E:\CrashCheck\Test\catal…
E:\CrashCheck\Test\espa¤ol
E:\CrashCheck\Test\fran‡ais
E:\CrashCheck\Test\portuguˆs
E:\CrashCheck\Test\portuguˆs-brasil
E:\CrashCheck\Test\trk‡e
E:\CrashCheck\Test\catal…\Jabberwocky.catalog
E:\CrashCheck\Test\espa¤ol\Jabberwocky.catalog
E:\CrashCheck\Test\espa¤ol\YAM.catalog
E:\CrashCheck\Test\fran‡ais\Jabberwocky.catalog
E:\CrashCheck\Test\fran‡ais\YAM.catalog
E:\CrashCheck\Test\portuguˆs\Jabberwocky.catalog
E:\CrashCheck\Test\portuguˆs\YAM.catalog
E:\CrashCheck\Test\portuguˆs-brasil\YAM.catalog
E:\CrashCheck\Test\trk‡e\YAM.catalog

Access the "cleansed" folders and all is well, access the test folder and instant crash.

[FrodeSolheim]

It is probably a charset issue somehow, yes. But FS-UAE is supposed to just ignore files on the host if they cannot be correctly represented on the Amiga.

1. Can you tell me how you "installed" Jabberwocky did you unpack it on Windows? How?
2. Can you zip CrashCheck (using Windows built-in zip tool) and send to frode@fs-uae.net? Thanks.

[FrodeSolheim]

Actually, there is one bug fix in 3.0.x - fixed in FS-UAE 3.1 which could cause a crash like this. Can you please try FS-UAE 3.1.x (https://eab.abime.net/showthread.php?t=108745) and see if the problem is fixed?

[DisasterIncarna]

i'll do that shortly, thanks.

[DisasterIncarna]

and it seems to be working, no crash as of yet and ive tried listing every folder on my emulated setup, previously i could only get some things installed manually by using windows to unpack archives to my amiga folder for the ones crashing, now i can do it all inside no problem.

As for the archives themselves such as jabberwocky/yam/etc, it was just archives downloaded using UHC (aminetsearch/aminetextract), i would try to either install from ram or copy whole folders over, and they would crash when trying to access the catalog folders which contained files/folders with special/intl chars.

Just tried it all over again with the old files i had to test with and its fine, tried redownloading straight from aminet and again it all works, i dont have to delete all the offending folders/files via windows anymore.

tyvm

[FrodeSolheim]

Great -And thanks to PowderedToastMan for finding the bug and providing a bugfix

[DisasterIncarna]

legends, both of you