That's very similar to what I did as well.
I made a disk that loaded LIST (I didn't even bother about DIR), COPY, CD, ED and RESIDENT and maybe one or two other commands resident into RAM.
Still the disk took some time to boot.
And your are very correct, it is not fair to compare a C64 with Dolphindos hardware to a stock A-500. I just mentioned that I was used to Dolphindos, and so the Amiga OS useage was a step back for me. On Dolphin, you don't need to type LOAD, LIST or RUN, you just press a function key
Also disk commands are simply typing '@' followed by a one digit command
But still when I compare to standard C64 where I need to type the full 'cryptic' commands, then for me it is still faster and more convenient than having to wait for the boot disk and then swap it for the work disk.
I also think it was not so much the boot time, but the disk-swapping which was the most annoying part.