On 18/12/13 11:22, Jenny Hopkins wrote:
I'm troubleshooting a debian server that is intermittently freezing up and consuming 100% cpu. The problems began about five days ago. At around this time two things changed: exim configuration, and a related server IP (where this server sends on some of its mail). There have also been various package upgrades. The changes to exim were minimal
- change of relay address, so are likely to be unrelated, but thought
I'd better mention them.
[]
I've been running htop and trying to catch what starts the freezing, but it seems different every time - a process will show it is using 100% CPU, then htop itself goes sluggish with lag and when it next shows something there are several processes using 100% CPU in a queue. It can then take up to two minutes to type a command into an ssh terminal. iotop doesn't show anything significant either. Unfortunately these tools are also subject to lag so are probably not showing the current state at time of freeze anyway.
I've tried running tools like iostat, but fail miserably to understand the resulting jumble of numbers.
If anyone can point me to better diagnostic tools, or give any hint of where to look for the culprit of this behaviour, I'd be most grateful.
A guess. Occasionally one of my laptops will get locked up with the processor at 100%. Sometimes when this happens, htop won't tell me what's hogging the processor. I eventually tracked down the problem using top instead of htop. My problem was indicated by the figure near wa being very high. This meant basically that the machine was locked waiting (hence "wa") for disk input/output (i/o).
If it is this, you may find soemthing like lsof (LiSt Open Files) might help. Alternatively, I've found sudo iotop useful sometimes, if the busy thing is network related. Use -i interfacename (e.g. -i eth1) to specify a particular network device.
Hope that helps.
Good luck Steve