English Amiga Board

English Amiga Board (http://eab.abime.net/index.php)
-   project.EAB File Server (http://eab.abime.net/forumdisplay.php?f=108)
-   -   EAB File Server (http://eab.abime.net/showthread.php?t=43633)

Turran 12 June 2016 16:49

Check previous posts.. I had to restore a backup from 2 days ago sadly =(

Edit: It appears that the mirror managed to get updated before the FTP went down, so everything is there. I'm grabbing your stuff now NeoHippie2016 =)

mai 12 June 2016 20:50

Quote:

Originally Posted by Retroplay (Post 1066434)
I'd say they're WWarp images, you can use Wepls TrackWarp to convert to ADF. :)
http://www.whdload.de/whdload/

I already did this, but some of the images has errors according to adf-workshop, it also gets stuck on track 76 when I try to load disk 1. :(
I've zoned the adfs just in case.

Can you please convert Disk C again?
ADF Disk C in NeoHippies upload folder has an error.

...ok, have found the error free Disk C.

Thanks NeoHippie2ß16:great, finally all 6 Disks are error free!

cmsj 01 July 2016 23:53

Hey folks

I've had excellent luck getting old programs/games from the file server, for which I would like to say thank you very very much. This is a truly awesome resource.

I wanted to ask two things:

1) How large is the Commodore_Amiga directory on the file server? I worry that it might go away at some point, and I think more copies would be good. I can't host an FTP site, but I could at least keep a synced copy for archival purposes.

2) Has anyone ever gotten in touch with the archive.org people about them mirroring the ftp site? This is right up their alley and I'm sure they'd be happy to do it. I have some friends-of-friends who work there, if a contact point is needed?

Many thanks again!

Chris

DamienD 02 July 2016 00:05

Hello Chris,

It's already mirrored, see first post: http://eab.abime.net/showpost.php?p=528097&postcount=1 ;)

As for backups; I'm sure Turran & DannyBoy keep them + at least for the latest TOSEC stuff I've already sent Turran a USB stick (that's how it all got there without me having to upload everything) :agree

cmsj 02 July 2016 00:16

Quote:

Originally Posted by DamienD (Post 1099254)
Hello Chris,

It's already mirrored, see first post: http://eab.abime.net/showpost.php?p=528097&postcount=1 ;)

Sure, I did see that, but one mirror is not enough mirrors, especially when you're talking about something that is, at least as far as I know, by far the most complete repository of Amiga software :)


Quote:

Originally Posted by DamienD (Post 1099254)
As for backups; I'm sure Turran & DannyBoy keep them

I certainly didn't mean to suggest that they are somehow not capable of keeping this running indefinitely, I am motived here by nothing more than concern for the long term accessibility of Amiga software. That was why I suggested hooking up with archive.org - they're set up to keep this stuff available long after we're all dead and buried!

DamienD 02 July 2016 00:25

Yeah cool, if you can organise something then go ahead :great

The more mirrors the better ;)

Turran 02 July 2016 10:11

Quote:

Originally Posted by cmsj (Post 1099246)
1) How large is the Commodore_Amiga directory on the file server? I worry that it might go away at some point, and I think more copies would be good. I can't host an FTP site, but I could at least keep a synced copy for archival purposes.

The Commodore_Amiga directory is about 740GB. While I understand your concerns, I feel that one mirror is enough for me to replicate to.
You should know I keep two different backups for the while FTP locally here. One on another server, replicated daily and one USB disk.

That said, I see a LOT of people staying on for weeks on the FTP, leeching the whole thing so there are probably hundreds of backups out there in the wild.

If you want another mirror, you are free to mirror it using normal FTP methods. Personally, I have no plans to let it die and feel that one mirror offsite is enough (and my personal backups). What I am saying is that I do not want to set up another site to replicate to.

Locutus 02 July 2016 10:51

Would it be possible to have a cronjob that creates a textfile of the whole file map of the FTP server?

That would make grepping for items a lot easier then mounting over ftpfs and `find . -name ''` :-)

Turran 03 July 2016 18:09

Sure is. Which format you want it in? I did a ls -alR called filelist.txt in the root but I'm guessing thats not the best format for what you are after.

jbl007 03 July 2016 22:39

Quote:

Originally Posted by Turran (Post 1099538)
Sure is. Which format you want it in? I did a ls -alR called filelist.txt in the root but I'm guessing thats not the best format for what you are after.

How about
find /path/to/root/ -type f -printf '%TD|%s|%P\n' > filelist.txt

Outputs in
date|size|filename
format. Doesn't look pretty, but is easily parsable.

amiga_Forever 05 July 2016 06:38

Uploaded Amiga Magazine covers (.jpg).

Also, could u move the others across?

Locutus 05 July 2016 09:34

Quote:

Originally Posted by jbl007 (Post 1099584)
How about
find /path/to/root/ -type f -printf '%TD|%s|%P\n' > filelist.txt

Outputs in
date|size|filename
format. Doesn't look pretty, but is easily parsable.

Thats an even better idea.

The file currently on the server is a bit less pleasant to search, if you grep for a filename you wont find its path directly you wont get a path to the file.

jbl's format is perfect for if you use something like Percol/Peco (great tool: https://github.com/mooz/percol)

Turran 05 July 2016 13:57

Done. Set it to run at midnight every day.

Locutus 05 July 2016 14:52

Thanks a lot!

DannyBoy 06 July 2016 20:50

Mirror going down for maintenance. Should not take too long.

tomse 09 July 2016 15:47

TOSEC ISO updates uploaded to uploads/tomse, can someone please move them to the correct place?

EDIT: it seems there were errors uploading, so not all were sent..
Commodore Amiga is on it's wait.. so please wait until tomorrow to move it.

cmsj 12 July 2016 01:33

Is there a problem with the file server at the moment? Or have I been firewalled/banned? (I'm coming from an IP in 86.20.236.xx)

Turran 12 July 2016 08:53

Quote:

Originally Posted by cmsj (Post 1100739)
Is there a problem with the file server at the moment? Or have I been firewalled/banned? (I'm coming from an IP in 86.20.236.xx)

You were IP blocked due to downloading with 2 sessions for 2 days and 11 hours. There seems to be a lot of automated systems just leeching everything and staying on for days so I've started blocking that so
1: The bots go away
2: People start using the mirror more =)

I've removed the IP block.

cmsj 12 July 2016 11:34

Quote:

Originally Posted by Turran (Post 1100784)
You were IP blocked due to downloading with 2 sessions for 2 days and 11 hours. There seems to be a lot of automated systems just leeching everything and staying on for days so I've started blocking that so
1: The bots go away
2: People start using the mirror more =)

I've removed the IP block.

Hey

Sorry, I definitely don't want to be seen as an abuser of the service. I am hoping to get a local copy of the Commodore_Amiga tree, of which I have 781GB so far, so I think I'm pretty close to done.

I've dialled lftp down to a single session for now, but I'm also happy to stop if you want, or only run it at certain times. I don't want to piss you off :)

Cheers,
Chris

Turran 12 July 2016 11:37

Nah, its OK =) I just can't figure out why bots download the whole FTP so that's who I'm targetting. People are worried about backups but there must be 1000 copies of the FTP by now. heh


All times are GMT +2. The time now is 13:57.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.

Page generated in 0.16489 seconds with 11 queries