English Amiga Board


Go Back   English Amiga Board > abime.net - Home Projects > project.EAB

 
 
Thread Tools
Old 26 October 2023, 13:09   #61
RCK
Administrator
 
RCK's Avatar
 
Join Date: Feb 2001
Location: Paris / France
Age: 45
Posts: 3,091
Next time it happens, could you have a look at user agents of guest on WOL page ?
https://eab.abime.net/online.php?s=&...all&ua=1&pp=30
(not sure you can display user agent under "ip" address, see at the bottom of the page)

Goal is to find the most bad one (at least 100 simu guest from same user-agent).
Attached Thumbnails
Click image for larger version

Name:	{9E46F259-0496-4244-BA57-BB349C98AC2B}.png
Views:	52
Size:	70.5 KB
ID:	80558  
RCK is offline  
Old 26 October 2023, 13:14   #62
TCD
HOL/FTP busy bee
 
TCD's Avatar
 
Join Date: Sep 2006
Location: Germany
Age: 46
Posts: 31,604
Quote:
Originally Posted by RCK View Post
Next time it happens, could you have a look at user agents of guest on WOL page ?
https://eab.abime.net/online.php?s=&...all&ua=1&pp=30
Will do (once I can access the forum again). I assume we are looking for an IP address range?
TCD is online now  
Old 26 October 2023, 13:16   #63
DisasterIncarna
Registered User
 
DisasterIncarna's Avatar
 
Join Date: Oct 2021
Location: England
Posts: 1,180
at least some of them have obvious names. lots of repeated entries for the "Spider" guests.

Do the other amiga forums also have a load of guests as well?

Last edited by DisasterIncarna; 26 October 2023 at 23:21.
DisasterIncarna is online now  
Old 27 October 2023, 01:57   #64
giantclam
Registered User
 
giantclam's Avatar
 
Join Date: Jan 2015
Location: australia
Posts: 486
Yeah, I'm hitting this now (at the time of typing) here in AU
giantclam is offline  
Old 27 October 2023, 08:26   #65
TCD
HOL/FTP busy bee
 
TCD's Avatar
 
Join Date: Sep 2006
Location: Germany
Age: 46
Posts: 31,604
Just had a talk with RCK and he changed things once again. Fingers crossed that it will improve things.
TCD is online now  
Old 27 October 2023, 08:28   #66
dreadnought
Registered User
 
Join Date: Dec 2019
Location: Ur, Atlantis
Posts: 1,914
Thank you, I saw the "Sorry...." message quite often in the last few days again.
dreadnought is offline  
Old 27 October 2023, 09:00   #67
RCK
Administrator
 
RCK's Avatar
 
Join Date: Feb 2001
Location: Paris / France
Age: 45
Posts: 3,091
It's always a cat & mouse game, I ban some more bots User-Agent, and they changed them.
Fact is that our old server have not enough CPU power to reply to everyone.
So I will look to change hardware in the next few months.
RCK is offline  
Old 27 October 2023, 09:03   #68
TCD
HOL/FTP busy bee
 
TCD's Avatar
 
Join Date: Sep 2006
Location: Germany
Age: 46
Posts: 31,604
Quote:
Originally Posted by RCK View Post
So I will look to change hardware in the next few months.
Sounds like a plan I'll donate a bit towards the new server fund today.
TCD is online now  
Old 27 October 2023, 09:39   #69
RCK
Administrator
 
RCK's Avatar
 
Join Date: Feb 2001
Location: Paris / France
Age: 45
Posts: 3,091
Thanks TCD, but it's to soon
@others: I will made one announcement to help funding it when it will be time.
RCK is offline  
Old 27 October 2023, 10:17   #70
hooverphonique
ex. demoscener "Bigmama"
 
Join Date: Jun 2012
Location: Fyn / Denmark
Posts: 1,624
I just had the message for some minutes .. just after 10 o'clock (dk timezone).
hooverphonique is offline  
Old 27 October 2023, 11:13   #71
RCK
Administrator
 
RCK's Avatar
 
Join Date: Feb 2001
Location: Paris / France
Age: 45
Posts: 3,091
Okay, I just find that the bots were actually into the new HOL (and not EAB).
And as HOL guest version is not 100% in cached memory, it was killing the whole server by using 100% of CPU when using search engine, game listing, etc.

So:
- I split HOL php pool from other abime.net websites
- I limited HOL ressource to 50% of server CPU max

What it means:
- If bots are coming into HOL, they will slow it down, but it won't slow down EAB of other hosted sites (winuae, etc.)
- Cached HOL pages should be displayed for guest even if bots are smashing the server (game pages for example)
- If you are logged into EAB, you will be auto logged into HOL, so it may be slow, try to switch to "private browsing" tab to see if it's better as guest

Futur:
- To be fine, we should serve to guest a full cached version of HOL (with a limited search engine for example)
- This way, every guest or bots will see a fast HOL and won't take any CPU ressources
- Regular member would have the full HOL without slow down

Last edited by RCK; 27 October 2023 at 11:54.
RCK is offline  
Old 27 October 2023, 11:17   #72
TCD
HOL/FTP busy bee
 
TCD's Avatar
 
Join Date: Sep 2006
Location: Germany
Age: 46
Posts: 31,604
Really good that the reason has been found and that the forum is at least not affected anymore.

Quote:
Originally Posted by RCK View Post
Futur:
- To be fine, we should serve to guest a full cached version of HOL (with a limited search engine for example)
- This way, every guest or bots will see a fast HOL and won't take any CPU ressources
- Regular member would have the full HOL without slow down
That would be very useful. Right now editing HOL is sloooow Hopefully that change won't take too long to implement

Last edited by RCK; 27 October 2023 at 11:54.
TCD is online now  
Old 27 October 2023, 12:05   #73
RCK
Administrator
 
RCK's Avatar
 
Join Date: Feb 2001
Location: Paris / France
Age: 45
Posts: 3,091
I just blacklisted the Bytespider and bytedance.com user-agent who were harvesting HOL, it should be faster for today
RCK is offline  
Old 27 October 2023, 12:08   #74
TCD
HOL/FTP busy bee
 
TCD's Avatar
 
Join Date: Sep 2006
Location: Germany
Age: 46
Posts: 31,604
Much better now

Edit: TikTok scans HOL? Okay...
TCD is online now  
Old 27 October 2023, 12:11   #75
DisasterIncarna
Registered User
 
DisasterIncarna's Avatar
 
Join Date: Oct 2021
Location: England
Posts: 1,180
any ideas what the bots are doing on hol specifically? maybe some retro emulator software harvesting screenshots for games?
DisasterIncarna is online now  
Old 27 October 2023, 12:56   #76
DanielAllsopp
Registered User
 
DanielAllsopp's Avatar
 
Join Date: Feb 2018
Location: Northumberland, UK
Posts: 272
I’m getting 301 moved permanently responses on my macOS machine, actually all three of them, which then redirects me back to my IP address. It’s fine on my phone though.

UserAgent for macOS been banned?

EDIT: Actually, it can’t be because wget gets the same redirect!
DanielAllsopp is offline  
Old 28 October 2023, 18:00   #77
SkulleateR
Registered User
 
SkulleateR's Avatar
 
Join Date: Jan 2016
Location: Germany
Posts: 328
Also issues with Safari here, cannot connect to either EAB or HOL
SkulleateR is offline  
Old 28 October 2023, 20:35   #78
indigolemon
Bit Copying Bard
 
indigolemon's Avatar
 
Join Date: Jan 2017
Location: Kelty, Fife, Scotland
Age: 41
Posts: 1,293
Thirding the issues connecting from OS X (using Safari or Chrome). The minute I spoof the user agent as anything other than OS X I can connect without issue.

[edit] Further testing shows I can spoof Firefox 33 under OS X and still connect without issue. Hmmm ...

Last edited by indigolemon; 28 October 2023 at 20:45.
indigolemon is offline  
Old 29 October 2023, 00:27   #79
LIV2
Tinkerer
 
Join Date: Jan 2020
Location: Sweden
Posts: 103
Also can't connect without fudging my User-Agent

I found that any UA string containing "(Macintosh; Intel Mac OS X 10_15_7)" causes a redirect to my own IP

I'm guessing that this is to mitigate the DDOS - However it should be noted that every Mac running a recent OS will report this version regardless of what version they're actually running
https://bugs.chromium.org/p/chromium...ail?id=1175225
LIV2 is offline  
Old 29 October 2023, 20:46   #80
DanielAllsopp
Registered User
 
DanielAllsopp's Avatar
 
Join Date: Feb 2018
Location: Northumberland, UK
Posts: 272
Spoofing as anything doesn’t make a difference to me. iPad gives me the same redirect, only iPhone works.
DanielAllsopp is offline  
 


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Similar Threads
Thread Thread Starter Forum Replies Last Post
What was your "Whoa s**t!" moment? amifan Nostalgia & memories 98 17 October 2022 23:25
"Voices8" 8 Channel Soundtracker "DemoSongI" song - "This is the Amiga with 8 Voices" DemosongIHunter request.Music 45 23 May 2022 20:07
Distorted sound on FS-UAE with OBS "only" busy R-TEAM support.FS-UAE 1 08 April 2020 10:48
Server is too busy at the moment guy lateur project.EAB 26 08 March 2018 15:54
Should the "EAB File Server" be locked down to members only? DamienD project.Amiga File Server 57 03 November 2017 23:32

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +2. The time now is 15:49.

Top

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.
Page generated in 0.12961 seconds with 14 queries