Server dies from too much load

Don´t be shy, Linux is fun! =)
Post Reply
User avatar
ayu
Staff
Staff
Posts: 8109
Joined: 27 Aug 2005, 16:00
18
Contact:

Server dies from too much load

Post by ayu »

Ok so here's the story... I had to move some downloads from my download disk on the server, to the storage disk on the same server. It started transferring, nothing odd so far. Then I opened the torrent client on the server, started some torrents, and then opened the music folder to stream some music to the client I'm sitting at. All of a sudden, I get an error saying that the transfer could not be done because of random reasons, so I check the disk, but it's gone and can not be reached anymore, and I thought "fuck now the disk is dead with all my stuff", so I rebooted to see what happened, and the disk was back up again, so I started the transfer again, and after about 15 minutes, it died again, but this time it seemed like the whole Samba daemon fucked up and could not be reached anymore, so I tried reaching the server with SSH, which didn't work either. So now I had to shut the whole thing down again, and add a graphic card to the server, and plugin a mouse and monitor to see what's really happening in there. It starts up, nothing odd there, I started some transfers again and no errors occur this time, but it's obvious that something is not right .....

and the only oddities that I can find in the syslog, are the the following:
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21846 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21847 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21848 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21849 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21850 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21851 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21852 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21853 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21854 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21855 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21856 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21857 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21858 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21859 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21860 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21861 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21862 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21863 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21864 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21865 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21866 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:13:46 teresa ntfs-3g[1547]: Inode 21867 is used but it wasn't marked in $MFT bitmap. Fixed.
Oct 3 10:11:41 teresa lwresd[1988]: none:0: open: /etc/bind/rndc.key: permission denied
Oct 3 10:11:41 teresa lwresd[1988]: couldn't add command channel 127.0.0.1#953: permission denied
Oct 3 10:11:41 teresa lwresd[1988]: none:0: open: /etc/bind/rndc.key: permission denied
Oct 3 10:11:41 teresa lwresd[1988]: couldn't add command channel ::1#953: permission denied
^-*pretty sure that's not it, but thought id add it anyway*


Oct 3 10:11:39 teresa kernel: system 00:07: iomem range 0xffe80000-0xffefffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:08: iomem range 0xfec00000-0xfec00fff has been reserved
Oct 3 10:11:39 teresa kernel: system 00:08: iomem range 0xfee00000-0xfee00fff has been reserved
Oct 3 10:11:39 teresa kernel: system 00:08: iomem range 0xfff80000-0xffffffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:0a: iomem range 0x0-0x9ffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:0a: iomem range 0xc0000-0xdffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:0a: iomem range 0xe0000-0xfffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:0a: iomem range 0x100000-0x6ffeffff could not be reserved
Oct 3 10:11:39 teresa kernel: system 00:0a: iomem range 0x0-0x0 could not be reserved

The first entry is the only one that seemed to have anything to do with it (it's included in the daemon.log as well, the same message), and I couldn't find anything else that seemed wrong.

I'm starting to think that it's a hardware issue, going to start another transfer and see if it happens while the monitor is on. Any tip would be great.
"The best place to hide a tree, is in a forest"

User avatar
bad_brain
Site Owner
Site Owner
Posts: 11636
Joined: 06 Apr 2005, 16:00
18
Location: In your eye floaters.
Contact:

Post by bad_brain »

hm, the latter errors are no big deal, only irritating (quote from Linus Torvalds), the problem seem to be the errors in the 1st message block....I think it's in context with using a NTFS partition and ntfs-3g.
run chkdsk on XP and check if the problem still exists afterwards...

User avatar
ayu
Staff
Staff
Posts: 8109
Joined: 27 Aug 2005, 16:00
18
Contact:

Post by ayu »

bad_brain wrote:hm, the latter errors are no big deal, only irritating (quote from Linus Torvalds), the problem seem to be the errors in the 1st message block....I think it's in context with using a NTFS partition and ntfs-3g.
run chkdsk on XP and check if the problem still exists afterwards...
I don't have XP...

Will the XP cd do? as in using it from the recovery console?
"The best place to hide a tree, is in a forest"

rob33n
On the way to fame!
On the way to fame!
Posts: 25
Joined: 09 May 2007, 16:00
16
Contact:

Post by rob33n »

type "man ntfs-3g" or "ntfs-3g help" :]
you can use force option to check or use allow_other options.
and also you can checkdisk with bootable xp.
and try mount when you cant reached the disk.

User avatar
ayu
Staff
Staff
Posts: 8109
Joined: 27 Aug 2005, 16:00
18
Contact:

Post by ayu »

It's odd though that SSH seems to be fucking up as well...

Well, I'm analyzing the HDD at the moment with Spinrite
"The best place to hide a tree, is in a forest"

User avatar
ayu
Staff
Staff
Posts: 8109
Joined: 27 Aug 2005, 16:00
18
Contact:

Post by ayu »

Hard drive analyzing is done, no errors found at all. I will take a day next week or so, and go through all the servers relevant configuration files and optimize them as much as possible. I will also buy a new 500 GB hard drive and mirror the data on the first one, for backup purposes. Because loosing that data, is not an option.

Thank you for your answers : )
"The best place to hide a tree, is in a forest"

Post Reply