|
|
| Author |
Message |
Jason
SearchIRC Developer
Joined: 03 May 2003
Posts: 1185
Location: Tampa, FL
|
 Posted: May 23, 2005 11:00pm Post subject: Hardware issues |
 |
|
We've been dealing with high loads for the last week. We've put in some kernel patches, and swapped hard drives to semi-fix the situation. We're just waiting on a shipment to come in with a new raid card to hopefully resolve the issue once and for all.
Thank you |
|
| Back to top |
|
 |
Jason
SearchIRC Developer
Joined: 03 May 2003
Posts: 1185
Location: Tampa, FL
|
| Posted: May 24, 2005 6:15pm Post subject: |
|
|
We're still waiting on the new raid card. Meanwhile my boss took pity on me and lent me a spare server he had laying around - a dual 64bit opteron server with 4 gigs of ram.....
HEH
And away we go! |
|
| Back to top |
|
|
Jason
SearchIRC Developer
Joined: 03 May 2003
Posts: 1185
Location: Tampa, FL
|
| Posted: May 24, 2005 9:42pm Post subject: |
|
|
Ok, raid card will be here soon.
Estimated delivery
May 25, 2005 3:00 PM |
|
| Back to top |
|
|
PingBad
Guru
Joined: 05 Feb 2005
Posts: 2031
Location: New Zealand
|
| Posted: May 24, 2005 11:36pm Post subject: |
|
|
| Jason wrote: | We're still waiting on the new raid card. Meanwhile my boss took pity on me and lent me a spare server he had laying around - a dual 64bit opteron server with 4 gigs of ram.....
HEH
And away we go! |
nice boss, can he employ me?  j/k |
|
| Back to top |
|
|
phrozen77
Newbie
Joined: 13 Jul 2004
Posts: 83
Location: There!! A 3-headed monkey, right behind you!
|
| Posted: May 24, 2005 11:39pm Post subject: |
|
|
| Quote: | | lent me a spare server he had laying around - a dual 64bit opteron server with 4 gigs of ram..... |
| Quote: | | nice boss, can he employ me? Very Happy j/k |
iŽd just take the server, without employment  |
|
| Back to top |
|
|
Dr-Voodo
Eleet
Joined: 07 Nov 2003
Posts: 535
Location: IRC
|
| Posted: May 25, 2005 3:16am Post subject: |
|
|
I take the HD's, the RAM, The Mainboard & CPU and you guys can keep the rest  |
|
| Back to top |
|
|
PingBad
Guru
Joined: 05 Feb 2005
Posts: 2031
Location: New Zealand
|
| Posted: May 25, 2005 3:19am Post subject: |
|
|
| Dr-Voodo wrote: | | I take the HD's, the RAM, The Mainboard & CPU and you guys can keep the rest |
well, that leaves us with a case, a PSU, an optical drive (if any), floppy drive (if any), a few cables, and the peripherials (add-in cards, mouse, heyboard, monitor). Geez yer greedy. |
|
| Back to top |
|
|
Dr-Voodo
Eleet
Joined: 07 Nov 2003
Posts: 535
Location: IRC
|
| Posted: May 25, 2005 3:22am Post subject: |
|
|
| Who said that!? *innocent* |
|
| Back to top |
|
|
Jason
SearchIRC Developer
Joined: 03 May 2003
Posts: 1185
Location: Tampa, FL
|
| Posted: May 25, 2005 3:59am Post subject: |
|
|
Well, to recap:
- The site has been getting load spikes, randomly. I respond by looking over services, code, and when I can't find anything, setting up scripts that kill off processes when the load rises. This seems to work. If the indexers don't run, the load remains low.
- Load issues get worse. So I put the indexers on a seperate box. Everything seems good again. But the box with the indexers show a low load, so something isn't right.
- Load issues now appear on the server, even without the bots.
- Load appears to happen when a lot of disk accessing happens. If I kill off apache, I can do server backups no problem, if I don't, the system starts to go nuts as I do a database dump after about 100 megs, and load goes up to 80 with everything locking up.
- I have two AMD64 3500+ systems, same cpu, same mobo. I take the searchirc hd out from one, and swap it with the other. So now the only thing remaining of the searchirc box is the HD. It doesn't help.
- We think it's a hd issue - there are problems with sata_via since it's new, so I go from SATA150 drive down to a regular PIDE. It seems to have helped, but we still have load issues. I had software raid failure a few weeks back, and reinstalled with no raid - if it's the hd, now instead of every other read/write to the drive, 100% is going, and that might explain why the situation is worse than before.
- So I order a hardware raid card, but meanwhile the site is fubar.
Here is where the new opteron box comes in, I had my doubts about it helping, since I already swapped every single piece of hardware - there is nothing left of the searchirc box. However, it seems to be working now.
The load as I type this, is 0.12. That's slightly better than the day before when I woke up - it was 60.x, 60.x and 15 min avg of.. you guessed it, 60.x.
What I'm left with is - what's wrong with the other hardware? You have to keep in mind when I switched hard drives, I did a complete reinstall. I also upgraded kernels, kicked the server a few times, threatened it with bodily harm, etc.
The two boxes that didn't work were asus a8k deluxe mobos, amd64 3500+ cpus, 2 gigs of ram. What makes the same software, same OS, now run with a dual opteron with 4 gigs of ram?
Has Linus teamed up with HP in a sick twisted plot against me to force me to upgrade my computers? Am I going mad and just imagining things? |
|
| Back to top |
|
|
PingBad
Guru
Joined: 05 Feb 2005
Posts: 2031
Location: New Zealand
|
| Posted: May 25, 2005 6:16am Post subject: |
|
|
| Dr-Voodo wrote: | | Who said that!? *innocent* |
until proven guilty
| Jason wrote: | | kicked the server a few times, threatened it with bodily harm, etc |
Threaten it with windows, it might decide to work better |
|
| Back to top |
|
|
Jason
SearchIRC Developer
Joined: 03 May 2003
Posts: 1185
Location: Tampa, FL
|
| Posted: May 25, 2005 6:55am Post subject: |
|
|
| funny. Can't even install winxp sp2 on it because windows doesn't know how to use the sata drives. I would have to buy a floppy drive, and some spare floppies to install windows. |
|
| Back to top |
|
|
PingBad
Guru
Joined: 05 Feb 2005
Posts: 2031
Location: New Zealand
|
| Posted: May 25, 2005 9:01am Post subject: |
|
|
| Jason wrote: | | funny. Can't even install winxp sp2 on it because windows doesn't know how to use the sata drives. I would have to buy a floppy drive, and some spare floppies to install windows. |
there's a mental image... a frigate full of floppies, and yer playing disk jockey. Its funny how ya have to bend ya back 180 degress just to get something done :/ |
|
| Back to top |
|
|
JohnB
Idler
Joined: 05 Dec 2003
Posts: 314
Location: Manchester, UK
|
| Posted: May 25, 2005 11:18am Post subject: |
|
|
| So far, everything is running smooth on this new server |
|
| Back to top |
|
|
PingBad
Guru
Joined: 05 Feb 2005
Posts: 2031
Location: New Zealand
|
| Posted: May 25, 2005 1:11pm Post subject: |
|
|
| JohnB wrote: | | So far, everything is running smooth on this new server |
yeah, I have to agree there, but I'm still getting the unread post issue (ie: the posts I've just read get remarked as unread each time I post) |
|
| Back to top |
|
|
Roku
Newbie
Joined: 18 Apr 2005
Posts: 92
|
| Posted: May 25, 2005 1:55pm Post subject: |
|
|
| PingBad wrote: | | JohnB wrote: | | So far, everything is running smooth on this new server |
yeah, I have to agree there, but I'm still getting the unread post issue (ie: the posts I've just read get remarked as unread each time I post) |
Ditto |
|
| Back to top |
|
|
|
Register
Log in
