English Amiga Board


Go Back   English Amiga Board > Other Projects > project.EAB File Server

 
 
Thread Tools
Old 12 April 2018, 12:16   #2001
DonAmiga
Registered User

DonAmiga's Avatar
 
Join Date: Apr 2010
Location: Scotland
Posts: 521
Quote:
Originally Posted by Turran View Post
Thanks guys! New disks are on their way. We're going from a 4TB Raid1 array to an 8TB Raid10 array, so we'll have plenty more space on a brand new server soon. Yes, its hardware raid. The new raid card is SATA6 instead of SATA-II in the old server so we'll get a bump in speed there as well.

I wont touch the old server for a while to make sure the new one is stable but once we're happy with it, I'll move over the "old-new" disks to the new server as well.


What is your username on the FTP? Can't seem to find you =)
Don't think I'm on it only ever taken a couple of files from the server
DonAmiga is offline  
AdSense AdSense  
Old 12 April 2018, 12:20   #2002
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Quote:
Originally Posted by Turran View Post
It was kind of a mess already when I took over hosting it. I would not know what to put where as I don't know what 99% of the stuff is basically, so I've been trying to find someone taking on the job of cleaning it up but so far, nothing constructive has come of it.
Some time ago I did volunteer to take on this mammoth task and even devised a suitable plan

...thing is, I'm just sooooo busy with EAB related moderation / other stuff that I really don't have the time.
DamienD is offline  
Old 12 April 2018, 12:22   #2003
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Quote:
Originally Posted by DonAmiga View Post
Don't think I'm on it only ever taken a couple of files from the server
You should create an account here Don, only takes a minute: https://grandis.nu:444/eabadduser/

...otherwise using the "generic" account there are restrictions and access is slooooow.
DamienD is offline  
Old 12 April 2018, 12:34   #2004
NLS
Ancient User
 
Join Date: Apr 2007
Location: GREECE
Age: 44
Posts: 475
Quote:
Originally Posted by Turran View Post
It was kind of a mess already when I took over hosting it. I would not know what to put where as I don't know what 99% of the stuff is basically, so I've been trying to find someone taking on the job of cleaning it up but so far, nothing constructive has come of it.

I did make an attempt about a year or two ago to clean up the Uploads folders by only allowing the uploader to see their own upload folder. They could upload what they wanted and then let a moderator know so it could be moved to its correct place, but there was an uproar about that so I had to revert it =)

Anyway, since then I have more or less decided that I host it and provide everything around it, but I try to not mess with the contents of it.
I realize it is hard. I wish I had the time.

I propose three things (esp. now that things get larger, so the mess can only get larger):

- Move everything not clearly identified (belonging to a collection or whatever) to a "CLEAN UP" or (a folder name I use for such things) "Area 51" or whatever. People can then go there and help identify things, or let the mess in there just be (under the carpet).

- In the root create a clear tree structure that you want people to follow.
For example "TOSEC" folder and inside "Latest FULL TOSEC" and "TOSEC UPDATES" and "TOSEC SOONERS" etc.

- Everybody with upload access should be instructed to only upload followed by a "read me" file (maybe give them an empty form to use), to explain what was uploaded, where it belongs etc. ...or face removal of the upload after a set period.

Just my 0.5.
NLS is offline  
Old 12 April 2018, 12:42   #2005
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Quote:
Originally Posted by NLS View Post
I realize it is hard. I wish I had the time.
That's the thing, people ask for it to be cleaned but nobody actually wants to assist due to lack of time...

Quote:
Originally Posted by NLS View Post
- In the root create a clear tree structure that you want people to follow.
For example "TOSEC" folder and inside "Latest FULL TOSEC" and "TOSEC UPDATES" and "TOSEC SOONERS" etc.
The TOSEC area is already clear / organised.

Quote:
Originally Posted by NLS View Post
- Everybody with upload access should be instructed to only upload followed by a "read me" file (maybe give them an empty form to use), to explain what was uploaded, where it belongs etc.
Exactly, why doesn't everyone who has an "upload" directory go through what's there, work out where best to move everything and then send me a PM?

I will then move accordingly
DamienD is offline  
Old 12 April 2018, 16:08   #2006
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Hmmm, just having a look at the various accounts on the FTP in order to do some maintenance...

These seem to be duplicates:

Code:
deoaxe64        no such EAB member
deoaxe64160     no such EAB member
  
FanAmiga        no such EAB member
FanCamiga       no such EAB member
  
Ktulu           no such EAB member
Kutullu         no such EAB member
If these are anybody's accounts then please let me know by midnight Sunday otherwise I will delete

...and this account "sandro1" is most probably related to the "Sandro" who was banned from EAB in October 2016; therefore the account has now been deleted.
DamienD is offline  
Old 12 April 2018, 16:58   #2007
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Bah, seems we disable all of the above last time...

All now purged permanently
DamienD is offline  
Old 16 April 2018, 17:29   #2008
Turran
Moderator

Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 44
Posts: 1,044
Quick update on the status of the new FTP server. The server is ready with all its new disks. Old server would only produce about 360MB/sec (Megabyte) from its Raid1 array (4TB) so we could not saturate the 10Tb NIC, even if we did get it working (which I did not in the old server).

New server produces about 1700MB/sec from its Raid10 array (8TB) so it should not be the bottleneck in our new 10Tb NIC. New disks payed in part from your generous donations =)

Testing the network internally, it also holds up well.
Code:
[SUM]   0.00-10.00  sec  10.9 GBytes  9.39 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  10.9 GBytes  9.39 Gbits/sec                  receiver
Externally its a bit worse. I can "only" get 6.5Tb/sec when testing to various sources, but it varies a lot depending on where I'm testing. I suspect the various speed check services are not up to the task of testing 10Gb/Sec yet.

I did contact bredbandskollen and complained about the "slow" 6.5Tb/sec speeds (hehe) and according to them, it should be able to handle it (did not expect that response...) so I don't know.

I might be able to tweak that in the future, but I don't see the EAB FTP getting even close to 6500Mb/sec anytime soon anyway. Heck, it did barely any damage to the previous 1Tb link so I have no idea why I need 10Tb or have spent countless thousands on it... When people ask, I simply say "Would you like a Ferrari if you could get one?".

I'm currently in the process of rsyncing everything over from the old to the new. After I'm done, it should just be a simple firewall change to point you to the new one. We'll see when that happens.
Turran is offline  
Old 16 April 2018, 17:55   #2009
chip
Registered User
chip's Avatar
 
Join Date: Oct 2012
Location: Italy
Age: 43
Posts: 665
I must admit that i'm already satisfied with the download speed of this file server

But, out of curiosity Turran, the "new" server should go more fast in download ?

Sorry for the question, but i'm ignorant by a technical point of view
chip is offline  
Old 16 April 2018, 19:06   #2010
Turran
Moderator

Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 44
Posts: 1,044
Depends on your speed really. If you have 100Mbit, probably not. If you have 1Tbit, yes it will be!
Turran is offline  
Old 16 April 2018, 20:03   #2011
chip
Registered User
chip's Avatar
 
Join Date: Oct 2012
Location: Italy
Age: 43
Posts: 665
Actually i don't know

I guess i simply will try when all will be done

At the moment my download speed is 800 kb/sec

I will see how it will change

Thanks for reply Turran
chip is offline  
Old 16 April 2018, 20:29   #2012
nogginthenog
Amigan

 
Join Date: Feb 2012
Location: London
Posts: 605
Holy Guacamole that's insanely fast!

I only have 100Mbps down and 10Mbps up (grr!) at home and 200 up/down at work.
I assume this is not running on an A4000
nogginthenog is offline  
Old 16 April 2018, 21:54   #2013
ma693541
Computer Wizard

ma693541's Avatar
 
Join Date: Aug 2007
Location: Ramberg/Norway
Posts: 650
Less than 2 minutes for a file on 500MB, on downloading. Slow or fast?
ma693541 is offline  
Old 16 April 2018, 22:39   #2014
Turran
Moderator

Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 44
Posts: 1,044
Quote:
Originally Posted by ma693541 View Post
Less than 2 minutes for a file on 500MB, on downloading. Slow or fast?
Bit tired here, but 500x120=4.2MB/Sec (Megabyte) or about 42Mbit (Megabit).

Is it fast or slow? Depends what you pay for and where in the world you are etc. For ADSL, it sounds rather good. For fibre, its not.

Correct my math if you want =) *bedtime*
Turran is offline  
Old 16 April 2018, 23:14   #2015
NLS
Ancient User
 
Join Date: Apr 2007
Location: GREECE
Age: 44
Posts: 475
Did you allow more concurrent connections with the new pipe?
NLS is offline  
Old 17 April 2018, 08:04   #2016
Turran
Moderator

Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 44
Posts: 1,044
Do you need more than two? =)

I have not changed anything yet.
Turran is offline  
Old 17 April 2018, 14:41   #2017
NLS
Ancient User
 
Join Date: Apr 2007
Location: GREECE
Age: 44
Posts: 475
Well, not sure if it helps with anything.
Most modern ftp clients will attempt multiple download threads by default.
Not that it gives any gain probably (if single connection speed limit is not set in your server).
NLS is offline  
Old 19 April 2018, 07:26   #2018
pgovotsos
Registered User

 
Join Date: Oct 2015
Location: US
Posts: 195
@Turran what do you think about eliminating or raising the download limits of people who have donated?
pgovotsos is offline  
Old 19 April 2018, 10:59   #2019
DamienD
Global Moderator

DamienD's Avatar
 
Join Date: Aug 2005
Location: London / Sydney
Age: 41
Posts: 11,838
Quote:
Originally Posted by pgovotsos View Post
@Turran what do you think about eliminating or raising the download limits of people who have donated?
Haven't you leeched everything already with 882.14GB downloaded? You're constantly at the top of each list
DamienD is offline  
Old 19 April 2018, 12:03   #2020
Turran
Moderator

Turran's Avatar
 
Join Date: May 2012
Location: Stockholm / Sweden
Age: 44
Posts: 1,044
Quote:
Originally Posted by pgovotsos View Post
@Turran what do you think about eliminating or raising the download limits of people who have donated?
I really don't want to give anything for donations except a better and more stable service as donating should be totally voluntary =)

While on the subject, I still have not switched to the new server. Had some issues with the raid card so had to replace it for one I had in storage.. Its only SATA-II though, so we can "only" get ~350MByte/sec from it (Roughly 3.5Tbit/sec).
Unsure if I should go with that and be happy or buy a better one with Sata6...

Edit: Made up my mind. Ordered a new SAS 6G raid card =)

Last edited by Turran; 19 April 2018 at 13:30.
Turran is offline  
AdSense AdSense  
 


Currently Active Users Viewing This Thread: 3 (0 members and 3 guests)
 
Thread Tools

Similar Threads
Thread Thread Starter Forum Replies Last Post
While EAB file server is down... Retroplay project.EAB File Server 23 31 December 2013 00:48
Setting up an EAB file server account. fatman2021 project.EAB 1 26 August 2013 08:24
Is EAB file server deleted ? Ribdevil project.EAB File Server 13 03 February 2012 19:28
EAB File Server structure update TCD project.EAB File Server 38 18 November 2010 06:49
EAB File Server team reinforcement TCD project.EAB File Server 9 22 August 2010 20:39

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +2. The time now is 23:25.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2018, vBulletin Solutions Inc.
Page generated in 0.11829 seconds with 14 queries