The site will be slow today

Jason · Posted: Aug 17, 2004 11:17am Post subject: The site will be slow today

A big site has linked to IRCImages.com and it's really hammering the server. The database is quick, as is the web server, but dispite the ircimage files being on a second scsi drive, it's making everything crawl.

I expect the high traffic to only last a few more hours before it starts to calm down.

Meanwhile all the indexers are disabled to help lighten the load.

w00t · Posted: Aug 17, 2004 5:27pm Post subject:

Is this an unsolicited link? In which case, how come you don't just block their requests?

Jason · Posted: Aug 17, 2004 7:33pm Post subject:

I don't mind sites sending traffic this way :)

But ircimages performed poorly. To give you an idea, SearchIRC handles about 5 times the traffic on a normal day, and SearchIRC was able to handle a slashdotting. I don't know how much traffic http://www.flabber.nl/ sent us today, but I doubt it's anywhere close to a /.

Jason · Posted: Aug 17, 2004 7:45pm Post subject:

Just checked - the web logs show about 11,000 visitors. Thats still less than SearchIRC on a normal day.

w00t · Posted: Aug 17, 2004 8:10pm Post subject:

Now you're trying to get sirc to flood them with requests? ;D

Jason · Posted: Aug 22, 2004 6:56pm Post subject:

it turns out everything was slow because max connects was... maxed out.

So i have put ircimages onto it's own web server, freeing searchirc from being crippled by it.

Jason · Posted: Aug 24, 2004 9:12am Post subject:

ircimages still cripples searchirc.

So I placed it on a completely different server, only to watch sql queries eat up about 100 gigs of bandwidth overnight. So I gave it it's own local database, and now it looks like we're good to go. (again).