DiskSpeed directory vs hdf

rutra80 · 26 June 2021, 23:57

CPU: 4790K
HD: Kingston A2000 NVMe

WinUAE 4.5.0 Beta17 x64

AmigaOS3.2 directory P96:

Code:

MKSoft DiskSpeed 4.0 - Copyright © 1989-91 MKSoft Development
-------------------------------------------------------------
CPU: 68020  OS Version: 47.96  Normal Video DMA
Device:  dh0:    Buffers: 50
Comments: 3.2 dir

CPU Speed Rating: 282449

Testing directory manipulation speed.
File Create:           74 files/sec  |  CPU Available: 95%
File Open:           5880 files/sec  |  CPU Available: 85%
Directory Scan:      7358 files/sec  |  CPU Available: 95%
File Delete:         2884 files/sec  |  CPU Available: 98%

Seek/Read:          14092 seeks/sec  |  CPU Available: 59%

Testing with a 512 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:      6140864 bytes/sec  |  CPU Available: 82%
Write to file:   14425216 bytes/sec  |  CPU Available: 57%
Read from file:  14091584 bytes/sec  |  CPU Available: 58%

Testing with a 4096 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:      9994752 bytes/sec  |  CPU Available: 98%
Write to file:  112764928 bytes/sec  |  CPU Available: 58%
Read from file: 110489600 bytes/sec  |  CPU Available: 59%

Testing with a 32768 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     10850304 bytes/sec  |  CPU Available: 101%
Write to file:  273608704 bytes/sec  |  CPU Available: 58%
Read from file: 216412160 bytes/sec  |  CPU Available: 62%

Testing with a 262144 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     11010048 bytes/sec  |  CPU Available: 101%
Write to file:  458063872 bytes/sec  |  CPU Available: 66%
Read from file: 328859648 bytes/sec  |  CPU Available: 68%

Average CPU Available: 76%  |  CPU Availability index: 42863

AROS directory RTG:

Code:

MKSoft DiskSpeed 4.0 - Copyright © 1989-91 MKSoft Development
-------------------------------------------------------------
CPU: 68020  OS Version: 51.51  Normal Video DMA
Device: dh0:    Buffers: <information unavailable>
Comments: AROS

CPU Speed Rating: 287599

Testing directory manipulation speed.
File Create:           70 files/sec  |  CPU Available: 99%
File Open:           4842 files/sec  |  CPU Available: 75%
Directory Scan:      6381 files/sec  |  CPU Available: 89%
File Delete:         2537 files/sec  |  CPU Available: 88%

Seek/Read:          12502 seeks/sec  |  CPU Available: 45%

Testing with a 512 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:      5636160 bytes/sec  |  CPU Available: 72%
Write to file:   12530752 bytes/sec  |  CPU Available: 39%
Read from file:  11500288 bytes/sec  |  CPU Available: 44%

Testing with a 4096 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:      9732608 bytes/sec  |  CPU Available: 94%
Write to file:   96463360 bytes/sec  |  CPU Available: 41%
Read from file:  90672640 bytes/sec  |  CPU Available: 44%

Testing with a 32768 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     10784768 bytes/sec  |  CPU Available: 99%
Write to file:  125661184 bytes/sec  |  CPU Available: 44%
Read from file: 111333376 bytes/sec  |  CPU Available: 45%

Testing with a 262144 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     10911744 bytes/sec  |  CPU Available: 99%
Write to file:   16875520 bytes/sec  |  CPU Available: 52%
Read from file: 510263296 bytes/sec  |  CPU Available: 53%

Average CPU Available: 66%  |  CPU Availability index: 18016

AmigaOS3.2 HDF OFS DirCache AGA:

Code:

MKSoft DiskSpeed 4.0 - Copyright © 1989-91 MKSoft Development
-------------------------------------------------------------
CPU: 68020  OS Version: 47.96  Normal Video DMA
Device:  dh0:    Buffers: 50
Comments: 3.2 OFS AGA

CPU Speed Rating: 340455

Testing directory manipulation speed.
File Create:         5378 files/sec  |  CPU Available: 35%
File Open:          16845 files/sec  |  CPU Available: 28%
Directory Scan:    206991 files/sec  |  CPU Available: 0%
File Delete:        19531 files/sec  |  CPU Available: 21%

Seek/Read:          20111 seeks/sec  |  CPU Available: 41%

Testing with a 512 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     12714048 bytes/sec  |  CPU Available: 38%
Write to file:    4554048 bytes/sec  |  CPU Available: 49%
Read from file:  14035904 bytes/sec  |  CPU Available: 36%

Testing with a 4096 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     13701120 bytes/sec  |  CPU Available: 50%
Write to file:    6277120 bytes/sec  |  CPU Available: 54%
Read from file:  17660928 bytes/sec  |  CPU Available: 42%

Testing with a 32768 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     13635584 bytes/sec  |  CPU Available: 52%
Write to file:    6619136 bytes/sec  |  CPU Available: 55%
Read from file:  17911808 bytes/sec  |  CPU Available: 44%

Testing with a 262144 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     13729792 bytes/sec  |  CPU Available: 52%
Write to file:    6651904 bytes/sec  |  CPU Available: 56%
Read from file:  18055168 bytes/sec  |  CPU Available: 44%

Average CPU Available: 41%  |  CPU Availability index: 10737

AmigaOS3.2 HDF FFS NoDirCache AGA:

Code:

MKSoft DiskSpeed 4.0 - Copyright © 1989-91 MKSoft Development
-------------------------------------------------------------
CPU: 68020  OS Version: 47.96  Normal Video DMA
Device:  dh0:    Buffers: 50
Comments: 3.2 FFS AGA

CPU Speed Rating: 336671

Testing directory manipulation speed.
File Create:         4629 files/sec  |  CPU Available: 60%
File Open:          17452 files/sec  |  CPU Available: 29%
Directory Scan:     30241 files/sec  |  CPU Available: 36%
File Delete:        24455 files/sec  |  CPU Available: 24%

Seek/Read:         117538 seeks/sec  |  CPU Available: 3%

Testing with a 512 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     13172800 bytes/sec  |  CPU Available: 42%
Write to file:   13793984 bytes/sec  |  CPU Available: 43%
Read from file:  16147264 bytes/sec  |  CPU Available: 37%

Testing with a 4096 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     57820160 bytes/sec  |  CPU Available: 59%
Write to file:   64463360 bytes/sec  |  CPU Available: 61%
Read from file: 120280576 bytes/sec  |  CPU Available: 40%

Testing with a 32768 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     98357248 bytes/sec  |  CPU Available: 72%
Write to file:  115585024 bytes/sec  |  CPU Available: 77%
Read from file: 436596736 bytes/sec  |  CPU Available: 52%

Testing with a 262144 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:    122585088 bytes/sec  |  CPU Available: 79%
Write to file:  147488768 bytes/sec  |  CPU Available: 86%
Read from file: 400162816 bytes/sec  |  CPU Available: 67%

Average CPU Available: 51%  |  CPU Availability index: 42853

AmigaOS3.2 HDF FFS NoDirCache P96:

Code:

MKSoft DiskSpeed 4.0 - Copyright © 1989-91 MKSoft Development
-------------------------------------------------------------
CPU: 68020  OS Version: 47.96  Normal Video DMA
Device:  dh0:    Buffers: 50
Comments: 3.2 FFS P96

CPU Speed Rating: 152787

Testing directory manipulation speed.
File Create:         2543 files/sec  |  CPU Available: 104%
File Open:          17870 files/sec  |  CPU Available: 69%
Directory Scan:     30346 files/sec  |  CPU Available: 85%
File Delete:        24746 files/sec  |  CPU Available: 58%

Seek/Read:          80174 seeks/sec  |  CPU Available: 4%

Testing with a 512 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     12804608 bytes/sec  |  CPU Available: 102%
Write to file:   13252928 bytes/sec  |  CPU Available: 105%
Read from file:  16179712 bytes/sec  |  CPU Available: 87%

Testing with a 4096 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     58165760 bytes/sec  |  CPU Available: 136%
Write to file:   64601600 bytes/sec  |  CPU Available: 141%
Read from file: 121165824 bytes/sec  |  CPU Available: 93%

Testing with a 32768 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:     97738752 bytes/sec  |  CPU Available: 167%
Write to file:  112713728 bytes/sec  |  CPU Available: 179%
Read from file: 432996352 bytes/sec  |  CPU Available: 122%

Testing with a 262144 byte buffer.  (LONG-aligned, MEMF_FAST)
Create file:    119767040 bytes/sec  |  CPU Available: 182%
Write to file:  142802944 bytes/sec  |  CPU Available: 198%
Read from file: 443908096 bytes/sec  |  CPU Available: 154%

Average CPU Available: 117%  |  CPU Availability index: 6962

So, HDF seems faster than UAE ROM Windows folder access. Except for writes to a file.

I'm quite surprised...

Toni Wilen · 27 June 2021, 10:02

It isn't that surprising.

HDF access only needs basic block aligned reads and writes and are usually quite localized = works very nicely with host OS disk cache.

Other file operations (extending file, creating file, deleting file etc) are not simple operations and can be relatively slow on NTFS.

rutra80 · 27 June 2021, 10:07

My money was on "the more native something is for host, the better".

Tomislav · 27 June 2021, 12:07

Also. Do not use Directory Cache! Search for Directory Cache on this page:

https://en.wikipedia.org/wiki/Amiga_Fast_File_System

27 June 2021, 12:07	#4
Tomislav Registered User Join Date: Aug 2014 Location: Zagreb / Croatia Posts: 302	Also. Do not use Directory Cache! Search for Directory Cache on this page: https://en.wikipedia.org/wiki/Amiga_Fast_File_System Last edited by Tomislav; 27 June 2021 at 12:19.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Creating HDF over an existing HDF with same filename.	ransom1122	support.WinUAE	29	22 February 2018 10:21
Bug when a comma is used in a directory plus .HDF name...	DamienD	support.WinUAE	22	27 March 2017 17:13
Converting between directory and .hdf emulated hard disks.	vext01	support.FS-UAE	2	06 February 2013 18:16
Directory drive and hdf compatibility	yaromir	support.WinUAE	2	23 September 2011 11:34
Directory Opus 4.12	Steve	request.Apps	24	20 November 2001 02:26

27 June 2021, 10:02	#2
Toni Wilen WinUAE developer Join Date: Aug 2001 Location: Hämeenlinna/Finland Age: 49 Posts: 26,505	It isn't that surprising. HDF access only needs basic block aligned reads and writes and are usually quite localized = works very nicely with host OS disk cache. Other file operations (extending file, creating file, deleting file etc) are not simple operations and can be relatively slow on NTFS.

27 June 2021, 10:07	#3
rutra80 Registered User Join Date: Jul 2019 Location: Poland Posts: 308	My money was on "the more native something is for host, the better".

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)