Amiga File Server - Page 149

macce2 · 26 April 2022, 18:41

Oh, I'm sorry.
I should have investigated the thread more closely before writing !

Maybe the admins could transfer my post to a more relevant thread ?

enigma776 · 26 April 2022, 19:01

Would it be possible to get the Gamebase Amiga stuff in a zip, the many thousands of files is causing havoc?

Turran · 27 April 2022, 09:41

That is an excellent reason for you to use a FTP client instead =)

The FTP is still the main way you should download if you want to get a lot of files or gig. The web service is basically only for downloading a file or 5 here and there.
Trying to download that many files over http(s) would get your over your 500 files or 30 GiB limit fast and get a 7 day ban.

Quote:

Originally Posted by enigma776

Would it be possible to get the Gamebase Amiga stuff in a zip, the many thousands of files is causing havoc?

Turran · 27 April 2022, 11:43

Noticing a few people getting banned from using the webdownload and grabbing way to much.

Changed the text showing your current limit so that it turns yellow at 250 files or 15 GiB and red at 480 files or 25 GiB. Hope that helps.

modrobert · 28 April 2022, 08:48

Quote:

Originally Posted by enigma776

Would it be possible to get the Gamebase Amiga stuff in a zip, the many thousands of files is causing havoc?

It's causing havoc because you are trying to get more games than you will ever play (aka "hamster syndrome" or simply "leecher").

NLS · 28 April 2022, 09:01

It is called safekeeping.
If we stored only what we would play, the emulation community would be non-existent.

I think the last time I tried to find just games I wanted to play from the previous generation machines, was in the 20th century (which ended 23 years ago, in case someone doesn't make the connection).
But this was due to the serious lack of resources, no Internet, no storage.

Turran · 28 April 2022, 09:04

Quote:

Originally Posted by NLS

It is called safekeeping.
If we stored only what we would play, the emulation community would be non-existent.

While I fully understand what you mean, the problem with that comes when thousands of people think the same way and constantly try to download the whole FTP. That does not help anyone.

If you are serious about not wanting the files to vanish, set up a public backup mirror and I'll happily replicate the files over.

Downloading the whole FTP to store on your USB disk in a drawer is not the way to go.

To give you an example.
In 2021, the anonymous FTP account downloaded 52.11 TiB. That is the whole FTP downloaded over 11 times.
So far in 2022, the anonymous FTP account have downloaded 63.75 TiB and we are only 5 months in to 2022. The problem is getting worse.

How many files are just stored somewhere because "its nice to preserve" or because people just like to hoard stuff?
How many of those files do you see available elsewhere?

I'm a data hoarder myself. Hell, I got (almost) all PS1, PS2, PS3, XBOX, XBOX360 (ISO and JTAG formats), WII etc etc games stored here. Almost 35TiB of data so I fully understand your mindset.

NLS · 28 April 2022, 09:18

I am talking in general.
I haven't copied your full FTP.
Actually, it's been maybe months since I downloaded anything.
(still, love the service as I've said already)

I also have a few TB of C64 data (among the 20+ TB of emulation data) and thought on how I should share them, sharing directly from home server is not an option.

How big is your ftp currently? (maybe trigger people to make a couple of official mirrors?)
I think we had the same discussion a few years ago btw.

Deja vu.

modrobert · 28 April 2022, 09:57

I think what triggers me more than wild leeching is the "dupes should be nuked" dilemma (thinking like a sysop).

If you put thousands of games in a zip, what happens when new game "X" is released (or old game is found on floppy) and needs to added? Someone creates all_amiga_games_v1_1.zip, so everyone have to download hundreds of gigs all over again because one game was added, and so on (ad infinitum).

Turran · 28 April 2022, 09:58

Understood =) I just got caught up in the discussion, hehe.
Yes, I think we did. Total size is currently 3.6TiB, so not that much really. We got 8TiB dedicated to room to grow.

FYI, if you have a registered account, you can see used and total storage at the bottom here: https://grandis.nu/turranuser

Quote:

Originally Posted by NLS

I am talking in general.
I haven't copied your full FTP.
Actually, it's been maybe months since I downloaded anything.
(still, love the service as I've said already)

I also have a few TB of C64 data (among the 20+ TB of emulation data) and thought on how I should share them, sharing directly from home server is not an option.

How big is your ftp currently? (maybe trigger people to make a couple of official mirrors?)
I think we had the same discussion a few years ago btw.

Deja vu.

modrobert · 28 April 2022, 10:28

I stumbled across this while searching for some floppies on eBay:

"AMIGA WHDLOAD SPREADSHEET - GET OVER 3300 AMIGA GAMES TODAY! OK 4 AMIGA 500 MINI"
https://www.ebay.com/itm/17525449883...wAAOSwQhZiMO0c

"CLICK HERE TO DOWNLOAD ALL AMIGA WHDLOAD GAMES"

The links provided in the spreadsheet for sale are probably not Turran's site in this case, but potentially they could be, which would explain the wild leeching.

Turran · 28 April 2022, 10:38

Hehe, thats shitty. It says WHDLoad.com Hyperlink on the screenshot and judging by the dates in the screenshots, its from WHDLoad.com directly.

No way to stop idiots like that anyway, so no reason to get upset.

Quote:

Originally Posted by modrobert

I stumbled across this while searching for some floppies on eBay:

"AMIGA WHDLOAD SPREADSHEET - GET OVER 3300 AMIGA GAMES TODAY! OK 4 AMIGA 500 MINI"
https://www.ebay.com/itm/17525449883...wAAOSwQhZiMO0c

"CLICK HERE TO DOWNLOAD ALL AMIGA WHDLOAD GAMES"

The links provided in the spreadsheet for sale are probably not Turran's site in this case, but potentially they could be, which would explain the wild leeching.

modrobert · 28 April 2022, 10:47

Quote:

Originally Posted by Turran

No way to stop idiots like that anyway, so no reason to get upset.

Agreed.

Retroplay · 28 April 2022, 10:48

"You are buying a fully working Amiga WHDLoad Excel spreadsheet", sheesh.

It doesn't look like it's from Turran FTP, so that's great.
Look at 4D Sports Driving, that list has the ancient v1.0 from 2006 listed.

Turran · 28 April 2022, 11:42

Still. Pretty cheap to use as an information spreadsheet. If it DID link to Retroplays repository with all that information, I'd buy it =)

Turran · 03 May 2022, 15:42

Short downtime for some ESXi maintenance.

Edit: All done I think..

Turran · 07 May 2022, 19:30

Fun stats time!

Code:

Total downloads since 2018-05-17 18:42:06. Updated at 2022-05-07 19:05
+----------------+------------------+------------------+-----------+
| TiB Downloaded | Files Downloaded | Days transferred | Locations |
+----------------+------------------+------------------+-----------+
|         217.68 |        122078936 |            10759 |     94258 |
+----------------+------------------+------------------+-----------+

122 million files totaling 217.68 TiB. It took 10759 days to transfer in total from 94258 unique IP addresses.

Same for uploads:

Code:

Total uploads since 2018-02-26 00:00:02. Updated at 2022-05-07 19:22
+--------------+----------------+------------------+-----------+
| TiB Uploaded | Files Uploaded | Days transferred | Locations |
+--------------+----------------+------------------+-----------+
|         4.92 |        2565366 |               62 |       602 |
+--------------+----------------+------------------+-----------+

Stats added to top downloaders and top uploads in the stats on https://grandis.nu/turranuser for registered users. Updates once a month.

Hache · 09 May 2022, 20:13

Hello, I have a question.
I haven't been able to download anything from FTP for a long time (maybe 2 or 3 months). Attached image of the error. Any suggestion?

Thank you and keep up the good work!

Click image for larger version

Name: Error.JPG
Views: 68
Size: 25.5 KB
ID: 75551

enigma776 · 09 May 2022, 20:18

Quote:

Originally Posted by Hache

Hello, I have a question.
I haven't been able to download anything from FTP for a long time (maybe 2 or 3 months). Attached image of the error. Any suggestion?

Thank you and keep up the good work!

Attachment 75551

Which ftp client are you using? Is it set to only allow 1 connection to the FTP? Any more than one and it will throw up this error.

Hache · 09 May 2022, 20:31

Quote:

Originally Posted by enigma776

Which ftp client are you using? Is it set to only allow 1 connection to the FTP? Any more than one and it will throw up this error.

Thanks for your quick response!! I'm using Filezilla. Regarding to "allow 1 connection", I think this is you are you talking about?

28 April 2022, 10:48	#2974
Retroplay Lemon Curry ? Join Date: Sep 2004 Location: Denmark Age: 49 Posts: 4,088	"You are buying a fully working Amiga WHDLoad Excel spreadsheet", sheesh. It doesn't look like it's from Turran FTP, so that's great. Look at 4D Sports Driving, that list has the ancient v1.0 from 2006 listed. Last edited by Retroplay; 28 April 2022 at 10:55.

03 May 2022, 15:42	#2976
Turran Moderator Join Date: May 2012 Location: Stockholm / Sweden Age: 49 Posts: 1,575	Short downtime for some ESXi maintenance. Edit: All done I think.. Last edited by Turran; 03 May 2022 at 15:58.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
While EAB file server is down...	Retroplay	project.Amiga File Server	24	18 March 2020 11:34
SWOS '96-'97 (EAB File Server)	Specksynder	support.Games	8	27 September 2014 14:08
Secondary file server	DannyBoy	project.Amiga File Server	12	12 August 2013 11:33
Is EAB file server deleted ?	Ribdevil	project.Amiga File Server	13	03 February 2012 19:28
'Syncing' with the file server	exoticaga	project.Amiga File Server	5	20 August 2010 00:36

26 April 2022, 18:41	#2961
macce2 Retro maniac Join Date: May 2005 Location: Finland Age: 49 Posts: 1,220	Oh, I'm sorry. I should have investigated the thread more closely before writing ! Maybe the admins could transfer my post to a more relevant thread ?

26 April 2022, 19:01	#2962
enigma776 Bringer of Death Join Date: Apr 2017 Location: Peterborough, UK Age: 40 Posts: 434	Would it be possible to get the Gamebase Amiga stuff in a zip, the many thousands of files is causing havoc?

27 April 2022, 11:43	#2964
Turran Moderator Join Date: May 2012 Location: Stockholm / Sweden Age: 49 Posts: 1,575	Noticing a few people getting banned from using the webdownload and grabbing way to much. Changed the text showing your current limit so that it turns yellow at 250 files or 15 GiB and red at 480 files or 25 GiB. Hope that helps.

28 April 2022, 09:01	#2966
NLS Ancient User Join Date: Apr 2007 Location: GREECE Age: 50 Posts: 758	It is called safekeeping. If we stored only what we would play, the emulation community would be non-existent. I think the last time I tried to find just games I wanted to play from the previous generation machines, was in the 20th century (which ended 23 years ago, in case someone doesn't make the connection). But this was due to the serious lack of resources, no Internet, no storage.

28 April 2022, 09:18	#2968
NLS Ancient User Join Date: Apr 2007 Location: GREECE Age: 50 Posts: 758	I am talking in general. I haven't copied your full FTP. Actually, it's been maybe months since I downloaded anything. (still, love the service as I've said already) I also have a few TB of C64 data (among the 20+ TB of emulation data) and thought on how I should share them, sharing directly from home server is not an option. How big is your ftp currently? (maybe trigger people to make a couple of official mirrors?) I think we had the same discussion a few years ago btw. Deja vu.

28 April 2022, 09:57	#2969
modrobert old bearded fool Join Date: Jan 2010 Location: Bangkok Age: 56 Posts: 779	I think what triggers me more than wild leeching is the "dupes should be nuked" dilemma (thinking like a sysop). If you put thousands of games in a zip, what happens when new game "X" is released (or old game is found on floppy) and needs to added? Someone creates all_amiga_games_v1_1.zip, so everyone have to download hundreds of gigs all over again because one game was added, and so on (ad infinitum).

28 April 2022, 10:28	#2971
modrobert old bearded fool Join Date: Jan 2010 Location: Bangkok Age: 56 Posts: 779	I stumbled across this while searching for some floppies on eBay: "AMIGA WHDLOAD SPREADSHEET - GET OVER 3300 AMIGA GAMES TODAY! OK 4 AMIGA 500 MINI" https://www.ebay.com/itm/17525449883...wAAOSwQhZiMO0c "CLICK HERE TO DOWNLOAD ALL AMIGA WHDLOAD GAMES" The links provided in the spreadsheet for sale are probably not Turran's site in this case, but potentially they could be, which would explain the wild leeching.

28 April 2022, 11:42	#2975
Turran Moderator Join Date: May 2012 Location: Stockholm / Sweden Age: 49 Posts: 1,575	Still. Pretty cheap to use as an information spreadsheet. If it DID link to Retroplays repository with all that information, I'd buy it =)

09 May 2022, 20:13	#2978
Hache Registered User Join Date: Jan 2013 Location: Buenos Aires, Argentina Posts: 257	Hello, I have a question. I haven't been able to download anything from FTP for a long time (maybe 2 or 3 months). Attached image of the error. Any suggestion? Thank you and keep up the good work!

Currently Active Users Viewing This Thread: 2 (0 members and 2 guests)