English Amiga Board


Go Back   English Amiga Board > News

 
 
Thread Tools
Old 11 February 2018, 16:28   #1
Toni Wilen
WinUAE developer
 
Join Date: Aug 2001
Location: Hämeenlinna/Finland
Age: 43
Posts: 21,406
PFS3AIO v3.0 Final

PFS3AIO 3.0 final is now available from Aminet.

http://aminet.net/disk/misc/pfs3aio.lha

26.5.2018 WARNING: Do not use OS 3.1.4 Beta HDToolBox Direct SCSI option with 3.0. It causes pfs3aio v3.0 to create incompatible partition geometry with all other pfs3(aio) versions. Will be fixed in soon to be released v3.1.

3.0
---

- Bug fixes, including finally fixed nasty bug causing Wrong Index Block ID
(and others) if partition was >=5G and lots of small files were created
very quickly, for example unpacking archive with thousands of small files.
This bug has most likely existed since PFS3 introduced >=5G partition
support.
- Compiled with m68k optimized GCC 6
(https://github.com/bebbo/amigaos-cross-toolchain), 16k smaller than
previous pfs3aio.
- Some HD controllers modify MaxTransfer after filesystem has been
initialized, which was ignored by previous versions.
- Automatic max transfer limit is only enabled if scsi.device version is v36
or newer and older than v50.
- Limit Direct SCSI mode max transfer size to 65535 blocks (~32MB).
- Automatically attempt to increase number of buffers if all buffers are in
use and more buffers are required.
- Added support for new OS 3.1.4 filesystem mount flags. (SCSIDIRECT,
SUPERFLOPPY and DISABLENSD).
- Shows more detailed information in error requesters (access mode, start
block, end block, SCSI details if SCSI Direct)
- Includes unsupported and experimental >104G partition support. Shows
warning if enabled during formatting.
- ACTION_DIE (unmount) stability fix.
- Filename changed from pfs3_aio-handler to pfs3aio.

--

PFS3AIO 3.0 Test #7 (Yet another attempt of final....)

http://www.winuae.net/files/b/pfs3aio_v3.0_test7.zip

PFS3AIO 3.0 Test #7

- ACTION_DIE (unmount) was replied too early, KillDev that comes with IDEFix crashed with memory list corruption.
- Test #2 TD64/NSD test fix didn't make any sense, was reverted.
- Also add sometimes used PFS\1 and PDS\1 to FileSystem.resource.

--

PFS3AIO 3.0 Test #6 (still bugs found, It looks like I'll never finish this....)

http://www.winuae.net/files/b/pfs3aio_v3.0_test6.zip

PFS3AIO 3.0 Test #6

- OS 3.1.4 SCSIDIRECT option READ CAPACITY bug fix.
- UNSAFEQUIT was not set, it should be or ACTION_DIE with open handles could cause crashes. (Was set in AROS version)
- ACTION_DIE crash fixed (StackSwap start/exit code was rewritten for non-AROS version, of course it had a bug..)
- Previously failed init (for example if OpenDevice() failed) caused pfs3 to wait forever. Now it returns error and exits normally.

--

PFS3AIO 3.0 Test #5 (#4 wasn't final after all, added lost v2 features)

http://www.winuae.net/files/b/pfs3aio_v3.0_test5.zip

- pfs3aio is again rommable and loadmodule etc.. compatible. Feature was lost during AROS gcc to "normal" gcc port.
- pfs3aio-custom is also included again. Version for drivers that have broken filesystem loader and assume single hunk and no relocation entries.

--

PFS3AIO 3.0 Test #4 (probably almost final)

http://www.winuae.net/files/b/pfs3aio_v3.0_test4.zip

- Added embedded struct Resident, enables c:version <device name>: to report name and version.
- Added access mode id and also full sense data if Direct SCSI mode to read/write error messages.
- Removed not very useful "Make sure disk is inserted" part in read/write error messages.
- Removed code duplication, combined separate disk.c read/write functions which were nearly identical.

Access mode IDs: 1 = standard, 2 = Direct SCSI, 3 = TD64, 4 = NSD

--

PFS3AIO 3.0 Test #3

http://www.winuae.net/files/b/pfs3aio_v3.0_test3.zip

- Direct SCSI writes failed with error requester if it needed max transfer splitting (test #2)
- Limit Direct SCSI mode max transfer to 65535 blocks (~32MB) which is READ(10) and WRITE(10) max.

---

PFS3AIO v3.0 Test #2

Don't use, see post #42.

http://www.winuae.net/files/b/pfs3aio_v3.0_test2.zip

- TD64/NSD capability test was not detected as failed if DoIO() succeeded but test read buffer was not modified.
- Added support for new OS 3.1.4 filesystem mount flags. (SCSIDIRECT, SUPERFLOPPY and DISABLENSD). (Don't ask me!)
- Include "PFS3AIO" in embedded version string.
- Added more information (accessed block, start and end of partition block) to out of bounds access error requesters.

---

PFS3AIO v3.0 Test #1 (Based on v19 PFS3)

http://www.winuae.net/files/b/pfs3aio_v3.0_test1.zip

- Finally 100% fixes wrong index block (and similar) errors, see below for details. Thanks to Michiel Pelt for helping to find this nasty bug.
- Fixed two (probably) harmless off-by-one bugs.
- Compiled with m68k optimized GCC 6 (https://github.com/bebbo/amigaos-cross-toolchain), 17k smaller than previous pfs3aio.
- Some HD controllers modify MaxTransfer after filesystem has been initialized which was ignored by previous versions.
- Automatic 0x20000 max transfer limit is only enabled if scsi.device version is v36 or newer and older than v50.
- Automatically attempt to increase number of buffers if all buffers are in use and more buffers are required.
- Includes experimental >104G partition support. Shows warning if enabled during formatting.

Includes all previous pfs3aio features:

- Full KS 1.x compatibility.
- 68000+ compatible.
- TD64, NSD and Direct SCSI supported and autodetected.
and more...

Souces available from https://github.com/tonioni/pfs3aio (and pfsdoctor)
Source tree also includes experimental >4G file size (48 bit file length field) support but it is not enabled in this version. Contact me if you want to test it.

>104G partition support and >4G file size support requires reformat and on-disk structures are not anymore compatible with old PFS3 or PFSDoctor versions. (http://www.winuae.net/files/b/pfsdoc...perimental.zip Note: command line only, no GUI like in official pfsdoctor)

Official version will be released in few weeks or so.

Details:

This version 100% fixes very old (has at least existed since commercial 18.x versions, possibly much longer) bug that causes wrong index block and similar errors when creating lots of new files/dirs quickly. PFSDoctor also reports errors, for example "x reserved blocks not used but allocated".

Trigger condition:
- >=5G partition size ("super index" partition mode)
- Lots of small files created quickly (for example unpacking archive with thousands of small files, for example EmeraldMines_v1.0_CD.lha)

Last edited by Toni Wilen; 26 May 2018 at 08:40. Reason: Final release
Toni Wilen is online now  
AdSense AdSense  
Old 11 February 2018, 22:14   #2
malko
Registered User

malko's Avatar
 
Join Date: Oct 2017
Location: CH
Posts: 607
Thank you .
Will replace my existing hardfile to use this PFS3 test version and report if something unexpected happens.
malko is offline  
Old 11 February 2018, 22:20   #3
spudje
Registered User

 
Join Date: Dec 2014
Location: Netherlands
Posts: 793
Euh, for me, too stupid to understand. Do I need to install this on HDDs/CFs instead of the pfs3aio_handler and still use the same id?

So I understood wrongly (some of your other posts in a different thead, regarding USB CF adapters) when I thought the bug was in WinUAE, not in PFS3AIO?
spudje is offline  
Old 11 February 2018, 22:46   #4
fgh
Registered User
 
Join Date: Dec 2010
Location: Norway
Posts: 618
Awesome, I'm glad you guys were able to hunt it down!
fgh is offline  
Old 12 February 2018, 00:51   #5
Retrofan
Ruler of the Universe

Retrofan's Avatar
 
Join Date: Mar 2010
Location: Lanzarote/Spain
Posts: 5,869
Very wonderful . Thanks Toni and others involved
Retrofan is offline  
Old 12 February 2018, 03:23   #6
gulliver
BoingBagged

 
Join Date: Aug 2007
Location: The South of nowhere
Age: 40
Posts: 1,629
Great!

Thanks.
gulliver is offline  
Old 12 February 2018, 08:00   #7
ShK
In carbonite
ShK's Avatar
 
Join Date: Mar 2013
Location: Lahti / Finland
Age: 47
Posts: 289
@toni. If the max partition size was 104*253*253*32 = 213 021 952 blocks, how is it now?
ShK is offline  
Old 12 February 2018, 08:08   #8
cyberhead97
Registered User

 
Join Date: Feb 2016
Location: Denmark
Posts: 102
Toni has done a really great job with Michiel Pelt releasing this new PFS3AIO version with nice bug fixes.

I have been using an experimental version of PFS3AIO v19.0 over the weekend stress testing it and could not reproduce the wrong index errors pfsdocfor usually reports after extracting EmeraldMines_v1.0_CD.lha and also seen copying all TimeRunner games. With PFS3AIO v2.3 these two games can cause these errors.

My tests was done using 8GB (300MB DH1, 7GB DH1) and 16GB (300MB DH0, 14.1GB DH1) hdf files first installing Workbench 3.1 and all WHDLoad Games. Then extracting EmeraldMines_v1.0_CD.lha a few times and still after this I didn't get any errors .

Last edited by cyberhead97; 12 February 2018 at 08:09. Reason: Spelling
cyberhead97 is offline  
Old 12 February 2018, 08:43   #9
Toni Wilen
WinUAE developer
 
Join Date: Aug 2001
Location: Hämeenlinna/Finland
Age: 43
Posts: 21,406
Quote:
Originally Posted by spudje View Post
Euh, for me, too stupid to understand. Do I need to install this on HDDs/CFs instead of the pfs3aio_handler and still use the same id?
Yes, name isn't same just because I wanted it to be shorter when typing it in old hdtoolbox versions

Quote:
So I understood wrongly (some of your other posts in a different thead, regarding USB CF adapters) when I thought the bug was in WinUAE, not in PFS3AIO?
It was bug in PFS3 (not just pfs3aio but all pfs3 versions since ages ago). It usually only happened in emulation because it is easier and much faster to copy or unpack thousands of files in emulation.

Quote:
Originally Posted by ShK View Post
@toni. If the max partition size was 104*253*253*32 = 213 021 952 blocks, how is it now?
104*253*253*32 = ~104G (original, 1k bitmap blocks, header + 253 long words)
104*509*509*32 = ~421G (2k blocks, header + 509 long words)
104*1021*1021*32 = ~1693G (4k blocks, header + 1021 long words)

(This is now much more clearly defined in struct.h)

There is always chance of some 32-bit calculation overflows in very large partitions but up to 421G mode should be safe. Testing huge partition sizes takes far too much time...
Toni Wilen is online now  
Old 12 February 2018, 09:19   #10
DanyPPC
Registered User

 
Join Date: Dec 2016
Location: Italy
Posts: 51
Thanks Toni, good work !
DanyPPC is offline  
Old 12 February 2018, 09:48   #11
supaduper
Registered User
supaduper's Avatar
 
Join Date: Oct 2012
Location: Birmingham UK
Posts: 804
Awesome PFSaio is a must these days for any Amiga user, thanks for ridding us of those nasty bugs Toni !
supaduper is online now  
Old 12 February 2018, 10:16   #12
spudje
Registered User

 
Join Date: Dec 2014
Location: Netherlands
Posts: 793
Thanks Toni! Awesome. I got the block ID errors a lot when copying/unpacking WHDLoad slaves on CFs in emulation. And I also got in once only recently when updating iGame library on a real Amiga.

I always had some sort of a gut feeling these errors eventually resulted in an unstable setup. So this is very welcome. Although I don't look forward redoing all my Amiga setups again :/
spudje is offline  
Old 12 February 2018, 12:24   #13
Jope
-
Jope's Avatar
 
Join Date: Jul 2003
Location: Helsinki / Finland
Age: 37
Posts: 6,685
Why would you redo them? Just update the handler in your RDB.
Jope is offline  
Old 12 February 2018, 12:36   #14
Toni Wilen
WinUAE developer
 
Join Date: Aug 2001
Location: Hämeenlinna/Finland
Age: 43
Posts: 21,406
If partition is smaller than 5G: no need to reformat.

If partition is 5G or larger: run pfsdoctor (original version that comes with pfs3 is fine), if no errors found: no need to reformat. If errors found: reformat recommended, pfsdoctor can't fix it properly.

EDIT: Note that original pfsdoctor does not support NSD and does not autodetect TD64/Direct SCSI.

Last edited by Toni Wilen; 12 February 2018 at 12:58.
Toni Wilen is online now  
Old 12 February 2018, 12:46   #15
spudje
Registered User

 
Join Date: Dec 2014
Location: Netherlands
Posts: 793
Oh super, that potentially limits the work a lot indeed!
spudje is offline  
Old 12 February 2018, 12:53   #16
Jope
-
Jope's Avatar
 
Join Date: Jul 2003
Location: Helsinki / Finland
Age: 37
Posts: 6,685
I obviously need to put some time aside to test this with all of the SCSI controllers I have hoarded away. I'm especially interested in seeing whether the directscsi problem I had with the GVP Series II is still there.
Jope is offline  
Old 12 February 2018, 13:07   #17
patrik
Registered User
patrik's Avatar
 
Join Date: Jan 2005
Location: Umeå
Age: 38
Posts: 407
Quote:
Originally Posted by Jope View Post
I obviously need to put some time aside to test this with all of the SCSI controllers I have hoarded away. I'm especially interested in seeing whether the directscsi problem I had with the GVP Series II is still there.
I am quite sure I have asked you this before, but did all versions of gvpscsi.device suffer from this, or could it be fixed by upgrading to 4.15 which Ralph Babel has made available for free?
patrik is offline  
Old 12 February 2018, 13:18   #18
supaduper
Registered User
supaduper's Avatar
 
Join Date: Oct 2012
Location: Birmingham UK
Posts: 804
Just updated my RDB with Toni`s Ver 19 pfs3aio and its all good

Any noobs who want to do this for partitions less then 5gb in size , just extract pfs3aio from Toni`s download then put it into L: directory.
Then fire up HDtoolbox, then >, Partition Drive >select your first partition then> tick Advanced Options, >Update > input L: pfs3aio into dialog box > Click OK ( if successful it will change to Ver19 in the window) > Click OK > Save changes to drive.

Your done..enjoy

Last edited by supaduper; 12 February 2018 at 17:22.
supaduper is online now  
Old 12 February 2018, 14:00   #19
Jope
-
Jope's Avatar
 
Join Date: Jul 2003
Location: Helsinki / Finland
Age: 37
Posts: 6,685
Quote:
Originally Posted by patrik View Post
I am quite sure I have asked you this before, but did all versions of gvpscsi.device suffer from this, or could it be fixed by upgrading to 4.15 which Ralph Babel has made available for free?
I always upgrade any GVP I happen to have with the latest on Ralph's site. :-) I probably will not have the motivation to try any other versions but the latest 4.15 and 3.15.
Jope is offline  
Old 12 February 2018, 15:26   #20
Sinphaltimus
Registered User

Sinphaltimus's Avatar
 
Join Date: Aug 2016
Location: Cresco, PA, USA
Age: 47
Posts: 1,086
Quote:
Originally Posted by supaduper View Post
Just updated my RDB with Toni`s Ver 19 pfs3aio and its all good

Any noobs who want to do this for partitions less then 5gb in size , just extract pfs3aio from Toni`s download then put it into L: directory.
Then fire up HDtoolbox, then >, Partition Drive >select your first partition then> tick Advanced Options, >Update > input L: pfs3aio into dialog box > Click OK > Save changes to drive.

Your done..enjoy
I'm slightly confused about the larger than 5GB partition instructions Toni put here..

Quote:
If partition is smaller than 5G: no need to reformat.

If partition is 5G or larger: run pfsdoctor (original version that comes with pfs3 is fine), if no errors found: no need to reformat. If errors found: reformat recommended, pfsdoctor can't fix it properly.

EDIT: Note that original pfsdoctor does not support NSD and does not autodetect TD64/Direct SCSI.
So just to ask for clarity on this.

If the partition is bigger than 5GB, follow the same instructions as you posted for smaller than 5GB partition then run the original PFSDoctor on it and if no errors I'm good to go? If errors then I need to reformat

OR

Do I run the original PFSDoctor BEFORE doing this change over?
Sinphaltimus is online now  
AdSense AdSense  
 


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Similar Threads
Thread Thread Starter Forum Replies Last Post
PFS3aio vs SFS/02 White support.WinUAE 10 13 April 2018 21:44
PFS3AIO Probs ? Foul support.FS-UAE 0 21 February 2018 22:49
PFS3AIO Questions manic23 support.Hardware 26 22 April 2014 13:49
Pfs3aio ???? stingray76 support.Hardware 2 19 February 2014 09:15
FinalWriter 97; FinalCalc 1.04; Final Data 2.00 & Final Copy aebrown-u request.Apps 20 12 July 2009 11:19

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +2. The time now is 20:08.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2018, vBulletin Solutions Inc.
Page generated in 0.09999 seconds with 16 queries