English Amiga Board


Go Back   English Amiga Board > Other Projects > project.Amiga File Server

 
 
Thread Tools
Old 12 June 2016, 15:49   #1241
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Check previous posts.. I had to restore a backup from 2 days ago sadly =(

Edit: It appears that the mirror managed to get updated before the FTP went down, so everything is there. I'm grabbing your stuff now NeoHippie2016 =)

Last edited by Turran; 12 June 2016 at 15:55.
Turran is offline  
Old 12 June 2016, 19:50   #1242
mai
Registered User
 
Join Date: Feb 2008
Location: Federativnaya Respublika Germaniya
Posts: 4,994
Quote:
Originally Posted by Retroplay View Post
I'd say they're WWarp images, you can use Wepls TrackWarp to convert to ADF.
http://www.whdload.de/whdload/

I already did this, but some of the images has errors according to adf-workshop, it also gets stuck on track 76 when I try to load disk 1.
I've zoned the adfs just in case.
Can you please convert Disk C again?
ADF Disk C in NeoHippies upload folder has an error.

...ok, have found the error free Disk C.

Thanks NeoHippie2ß16, finally all 6 Disks are error free!

Last edited by mai; 12 June 2016 at 20:26.
mai is offline  
Old 01 July 2016, 22:53   #1243
cmsj
Registered User
 
cmsj's Avatar
 
Join Date: Feb 2016
Location: London / UK
Posts: 166
Hey folks

I've had excellent luck getting old programs/games from the file server, for which I would like to say thank you very very much. This is a truly awesome resource.

I wanted to ask two things:

1) How large is the Commodore_Amiga directory on the file server? I worry that it might go away at some point, and I think more copies would be good. I can't host an FTP site, but I could at least keep a synced copy for archival purposes.

2) Has anyone ever gotten in touch with the archive.org people about them mirroring the ftp site? This is right up their alley and I'm sure they'd be happy to do it. I have some friends-of-friends who work there, if a contact point is needed?

Many thanks again!

Chris
cmsj is offline  
Old 01 July 2016, 23:05   #1244
DamienD
Banned
 
DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 47
Posts: 20,420
Hello Chris,

It's already mirrored, see first post: http://eab.abime.net/showpost.php?p=528097&postcount=1

As for backups; I'm sure Turran & DannyBoy keep them + at least for the latest TOSEC stuff I've already sent Turran a USB stick (that's how it all got there without me having to upload everything)
DamienD is offline  
Old 01 July 2016, 23:16   #1245
cmsj
Registered User
 
cmsj's Avatar
 
Join Date: Feb 2016
Location: London / UK
Posts: 166
Quote:
Originally Posted by DamienD View Post
Hello Chris,

It's already mirrored, see first post: http://eab.abime.net/showpost.php?p=528097&postcount=1
Sure, I did see that, but one mirror is not enough mirrors, especially when you're talking about something that is, at least as far as I know, by far the most complete repository of Amiga software


Quote:
Originally Posted by DamienD View Post
As for backups; I'm sure Turran & DannyBoy keep them
I certainly didn't mean to suggest that they are somehow not capable of keeping this running indefinitely, I am motived here by nothing more than concern for the long term accessibility of Amiga software. That was why I suggested hooking up with archive.org - they're set up to keep this stuff available long after we're all dead and buried!
cmsj is offline  
Old 01 July 2016, 23:25   #1246
DamienD
Banned
 
DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 47
Posts: 20,420
Yeah cool, if you can organise something then go ahead

The more mirrors the better
DamienD is offline  
Old 02 July 2016, 09:11   #1247
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Quote:
Originally Posted by cmsj View Post
1) How large is the Commodore_Amiga directory on the file server? I worry that it might go away at some point, and I think more copies would be good. I can't host an FTP site, but I could at least keep a synced copy for archival purposes.
The Commodore_Amiga directory is about 740GB. While I understand your concerns, I feel that one mirror is enough for me to replicate to.
You should know I keep two different backups for the while FTP locally here. One on another server, replicated daily and one USB disk.

That said, I see a LOT of people staying on for weeks on the FTP, leeching the whole thing so there are probably hundreds of backups out there in the wild.

If you want another mirror, you are free to mirror it using normal FTP methods. Personally, I have no plans to let it die and feel that one mirror offsite is enough (and my personal backups). What I am saying is that I do not want to set up another site to replicate to.
Turran is offline  
Old 02 July 2016, 09:51   #1248
Locutus
Registered User
 
Join Date: Jul 2014
Location: Finland
Posts: 1,176
Would it be possible to have a cronjob that creates a textfile of the whole file map of the FTP server?

That would make grepping for items a lot easier then mounting over ftpfs and `find . -name ''` :-)
Locutus is online now  
Old 03 July 2016, 17:09   #1249
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Sure is. Which format you want it in? I did a ls -alR called filelist.txt in the root but I'm guessing thats not the best format for what you are after.
Turran is offline  
Old 03 July 2016, 21:39   #1250
jbl007
Registered User
 
Join Date: Mar 2013
Location: Leipzig/Germany
Posts: 466
Quote:
Originally Posted by Turran View Post
Sure is. Which format you want it in? I did a ls -alR called filelist.txt in the root but I'm guessing thats not the best format for what you are after.
How about
find /path/to/root/ -type f -printf '%TD|%s|%P\n' > filelist.txt

Outputs in
date|size|filename
format. Doesn't look pretty, but is easily parsable.
jbl007 is offline  
Old 05 July 2016, 05:38   #1251
amiga_Forever
Users Awaiting Email Confirmation
 
Join Date: Mar 2011
Location: kkhkj
Posts: 323
Uploaded Amiga Magazine covers (.jpg).

Also, could u move the others across?
amiga_Forever is offline  
Old 05 July 2016, 08:34   #1252
Locutus
Registered User
 
Join Date: Jul 2014
Location: Finland
Posts: 1,176
Quote:
Originally Posted by jbl007 View Post
How about
find /path/to/root/ -type f -printf '%TD|%s|%P\n' > filelist.txt

Outputs in
date|size|filename
format. Doesn't look pretty, but is easily parsable.
Thats an even better idea.

The file currently on the server is a bit less pleasant to search, if you grep for a filename you wont find its path directly you wont get a path to the file.

jbl's format is perfect for if you use something like Percol/Peco (great tool: https://github.com/mooz/percol)
Locutus is online now  
Old 05 July 2016, 12:57   #1253
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Done. Set it to run at midnight every day.
Turran is offline  
Old 05 July 2016, 13:52   #1254
Locutus
Registered User
 
Join Date: Jul 2014
Location: Finland
Posts: 1,176
Thanks a lot!
Locutus is online now  
Old 06 July 2016, 19:50   #1255
DannyBoy
Registered User
 
Join Date: Jul 2013
Location: Helsinki / Finland
Age: 42
Posts: 90
Mirror going down for maintenance. Should not take too long.
DannyBoy is offline  
Old 09 July 2016, 14:47   #1256
tomse
We need more scans!
 
tomse's Avatar
 
Join Date: Feb 2010
Location: Copenhagen / Denmark
Age: 48
Posts: 326
TOSEC ISO updates uploaded to uploads/tomse, can someone please move them to the correct place?

EDIT: it seems there were errors uploading, so not all were sent..
Commodore Amiga is on it's wait.. so please wait until tomorrow to move it.

Last edited by tomse; 09 July 2016 at 15:45.
tomse is offline  
Old 12 July 2016, 00:33   #1257
cmsj
Registered User
 
cmsj's Avatar
 
Join Date: Feb 2016
Location: London / UK
Posts: 166
Is there a problem with the file server at the moment? Or have I been firewalled/banned? (I'm coming from an IP in 86.20.236.xx)
cmsj is offline  
Old 12 July 2016, 07:53   #1258
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Quote:
Originally Posted by cmsj View Post
Is there a problem with the file server at the moment? Or have I been firewalled/banned? (I'm coming from an IP in 86.20.236.xx)
You were IP blocked due to downloading with 2 sessions for 2 days and 11 hours. There seems to be a lot of automated systems just leeching everything and staying on for days so I've started blocking that so
1: The bots go away
2: People start using the mirror more =)

I've removed the IP block.
Turran is offline  
Old 12 July 2016, 10:34   #1259
cmsj
Registered User
 
cmsj's Avatar
 
Join Date: Feb 2016
Location: London / UK
Posts: 166
Quote:
Originally Posted by Turran View Post
You were IP blocked due to downloading with 2 sessions for 2 days and 11 hours. There seems to be a lot of automated systems just leeching everything and staying on for days so I've started blocking that so
1: The bots go away
2: People start using the mirror more =)

I've removed the IP block.
Hey

Sorry, I definitely don't want to be seen as an abuser of the service. I am hoping to get a local copy of the Commodore_Amiga tree, of which I have 781GB so far, so I think I'm pretty close to done.

I've dialled lftp down to a single session for now, but I'm also happy to stop if you want, or only run it at certain times. I don't want to piss you off

Cheers,
Chris
cmsj is offline  
Old 12 July 2016, 10:37   #1260
Turran
Moderator
 
Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 49
Posts: 1,572
Nah, its OK =) I just can't figure out why bots download the whole FTP so that's who I'm targetting. People are worried about backups but there must be 1000 copies of the FTP by now. heh
Turran is offline  
 


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Similar Threads
Thread Thread Starter Forum Replies Last Post
While EAB file server is down... Retroplay project.Amiga File Server 24 18 March 2020 11:34
SWOS '96-'97 (EAB File Server) Specksynder support.Games 8 27 September 2014 14:08
Secondary file server DannyBoy project.Amiga File Server 12 12 August 2013 11:33
Is EAB file server deleted ? Ribdevil project.Amiga File Server 13 03 February 2012 19:28
'Syncing' with the file server exoticaga project.Amiga File Server 5 20 August 2010 00:36

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +2. The time now is 18:22.

Top

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.
Page generated in 0.27875 seconds with 14 queries