NightNinjaMPC
Tue 18th Sep '07, 5:56am
Hi,
I've been playing around with my server for long over 6 months trying to find out what it is that is causing this high load whenver I have 450+ users on the site. On saturday I had 600 and the server was reaching loads close to 13. I am running vBadvanced, vBSEO, and a highly modified version of vBDownloads (the major part of my website). I know that vBSEO inherently causes a higher load than average but the majority of traffic on my website is download based and not forum based and I can't quite figure it out... what can I do to optimize this situation? Is an SCSI hard drive necessary since downloads are in constant use or maybe more RAM?
1. Dedicated
2.
cpu speed/type single or dual cpus: Dual Proc AMD Opteron 248
how much memory installed: 2GB RAM
hard drive type/configuration: 250GB SATA II
linux distributor or windows version: CentOS 4.4-32
apache/IIS version: apache 1.3.37
PHP version: php 4.4.7
MySQL version: mysql 4.1.22-standard
3. vBulletin 3.6.7
4. Don't really understand this question about innodb
5. cPanel? Not sure
6. top - 03:26:26 up 80 days, 13:30, 1 user, load average: 1.18, 0.89, 0.79
Tasks: 167 total, 3 running, 164 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.3% us, 4.3% sy, 47.8% ni, 47.6% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 2074900k total, 1518084k used, 556816k free, 33516k buffers
Swap: 2096440k total, 111592k used, 1984848k free, 733248k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4568 mysql 21 6 215m 159m 2584 S 69 7.9 18159:04 mysqld
6981 nobody 19 4 25240 15m 3268 S 9 0.8 125:02.11 httpd
26028 nobody 20 4 21912 11m 2368 S 4 0.6 0:04.71 httpd
26030 nobody 19 4 22476 12m 2324 S 4 0.6 0:03.44 httpd
26117 nobody 19 4 22424 12m 2324 S 4 0.6 0:01.85 httpd
26120 nobody 19 4 21900 11m 2304 S 3 0.6 0:01.86 httpd
2270 nobody 19 4 22536 12m 2896 R 2 0.6 1:13.50 httpd
26260 nobody 19 4 21848 11m 2260 S 2 0.6 0:00.58 httpd
32181 nobody 19 4 22800 12m 2516 S 2 0.6 1:40.36 httpd
26105 nobody 19 4 21964 11m 2300 S 2 0.6 0:01.52 httpd
26107 nobody 19 4 22052 11m 2336 S 2 0.6 0:01.81 httpd
26249 nobody 19 4 21972 11m 2328 S 2 0.6 0:00.86 httpd
26027 nobody 20 4 22080 11m 2320 R 1 0.6 0:03.62 httpd
26031 nobody 19 4 21952 11m 2380 S 1 0.6 0:03.12 httpd
11985 nails 16 0 41492 20m 2088 S 0 1.0 0:35.52 scanner
26312 root 16 0 2064 1004 764 R 0 0.0 0:00.02 top
1 root 16 0 2700 484 452 S 0 0.0 0:15.14 init
Load is low cause there's only 250 people on when I posted this.
7. [mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
skip-locking
skip-innodb
query_cache_limit=1M
query_cache_size=128M
query_cache_type=1
max_user_connections=100
max_connections=650
interactive_timeout=10
wait_timeout=10
connect_timeout=10
thread_cache_size=128
key_buffer=32M
join_buffer=1M
max_allowed_packet=64M
table_cache=1024
record_buffer=1M
sort_buffer_size=2M
read_buffer_size=2M
max_connect_errors=10
thread_concurrency=8
myisam_sort_buffer_size=64M
server-id=1
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/lib/mysql/mysql.pid
open_files_limit=8192
[mysqldump]
quick
max_allowed_packet=16M
[mysql]
no-auto-rehash
[isamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[myisamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[mysqlhotcopy]
interactive-timeout
8. Gives me access denied error...
9. vB is the only script running on the site per say but it is modded heavily with a download script and about 90% of the site is download based rather than forum based.
10. Average 400
Max 750
12. if you run Apache and you have your own dedicated server or access to your httpd.conf (apache configuration file) can you post the values you have set for the following :
KeepAlive On
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 150
AND Maxrequestsperchild value = 0
13. Nope
14. Post output from these 3 commands
uname -a
Linux amazing.mpcdownloads.com 2.6.9-55.ELsmp #1 SMP Fri Apr 20 17:03:35 EDT 2007 i686 athlon i386 GNU/Linux
ulimit -aH
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
pending signals (-i) 1024
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 32767
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 15
model : 37
model name : AMD Opteron(tm) Processor 248
stepping : 1
cpu MHz : 2205.081
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 pni syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni
bogomips : 4414.01
processor : 1
vendor_id : AuthenticAMD
cpu family : 15
model : 37
model name : AMD Opteron(tm) Processor 248
stepping : 1
cpu MHz : 2205.081
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 pni syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni
bogomips : 4409.48
I've been playing around with my server for long over 6 months trying to find out what it is that is causing this high load whenver I have 450+ users on the site. On saturday I had 600 and the server was reaching loads close to 13. I am running vBadvanced, vBSEO, and a highly modified version of vBDownloads (the major part of my website). I know that vBSEO inherently causes a higher load than average but the majority of traffic on my website is download based and not forum based and I can't quite figure it out... what can I do to optimize this situation? Is an SCSI hard drive necessary since downloads are in constant use or maybe more RAM?
1. Dedicated
2.
cpu speed/type single or dual cpus: Dual Proc AMD Opteron 248
how much memory installed: 2GB RAM
hard drive type/configuration: 250GB SATA II
linux distributor or windows version: CentOS 4.4-32
apache/IIS version: apache 1.3.37
PHP version: php 4.4.7
MySQL version: mysql 4.1.22-standard
3. vBulletin 3.6.7
4. Don't really understand this question about innodb
5. cPanel? Not sure
6. top - 03:26:26 up 80 days, 13:30, 1 user, load average: 1.18, 0.89, 0.79
Tasks: 167 total, 3 running, 164 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.3% us, 4.3% sy, 47.8% ni, 47.6% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 2074900k total, 1518084k used, 556816k free, 33516k buffers
Swap: 2096440k total, 111592k used, 1984848k free, 733248k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4568 mysql 21 6 215m 159m 2584 S 69 7.9 18159:04 mysqld
6981 nobody 19 4 25240 15m 3268 S 9 0.8 125:02.11 httpd
26028 nobody 20 4 21912 11m 2368 S 4 0.6 0:04.71 httpd
26030 nobody 19 4 22476 12m 2324 S 4 0.6 0:03.44 httpd
26117 nobody 19 4 22424 12m 2324 S 4 0.6 0:01.85 httpd
26120 nobody 19 4 21900 11m 2304 S 3 0.6 0:01.86 httpd
2270 nobody 19 4 22536 12m 2896 R 2 0.6 1:13.50 httpd
26260 nobody 19 4 21848 11m 2260 S 2 0.6 0:00.58 httpd
32181 nobody 19 4 22800 12m 2516 S 2 0.6 1:40.36 httpd
26105 nobody 19 4 21964 11m 2300 S 2 0.6 0:01.52 httpd
26107 nobody 19 4 22052 11m 2336 S 2 0.6 0:01.81 httpd
26249 nobody 19 4 21972 11m 2328 S 2 0.6 0:00.86 httpd
26027 nobody 20 4 22080 11m 2320 R 1 0.6 0:03.62 httpd
26031 nobody 19 4 21952 11m 2380 S 1 0.6 0:03.12 httpd
11985 nails 16 0 41492 20m 2088 S 0 1.0 0:35.52 scanner
26312 root 16 0 2064 1004 764 R 0 0.0 0:00.02 top
1 root 16 0 2700 484 452 S 0 0.0 0:15.14 init
Load is low cause there's only 250 people on when I posted this.
7. [mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
skip-locking
skip-innodb
query_cache_limit=1M
query_cache_size=128M
query_cache_type=1
max_user_connections=100
max_connections=650
interactive_timeout=10
wait_timeout=10
connect_timeout=10
thread_cache_size=128
key_buffer=32M
join_buffer=1M
max_allowed_packet=64M
table_cache=1024
record_buffer=1M
sort_buffer_size=2M
read_buffer_size=2M
max_connect_errors=10
thread_concurrency=8
myisam_sort_buffer_size=64M
server-id=1
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/lib/mysql/mysql.pid
open_files_limit=8192
[mysqldump]
quick
max_allowed_packet=16M
[mysql]
no-auto-rehash
[isamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[myisamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[mysqlhotcopy]
interactive-timeout
8. Gives me access denied error...
9. vB is the only script running on the site per say but it is modded heavily with a download script and about 90% of the site is download based rather than forum based.
10. Average 400
Max 750
12. if you run Apache and you have your own dedicated server or access to your httpd.conf (apache configuration file) can you post the values you have set for the following :
KeepAlive On
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 150
AND Maxrequestsperchild value = 0
13. Nope
14. Post output from these 3 commands
uname -a
Linux amazing.mpcdownloads.com 2.6.9-55.ELsmp #1 SMP Fri Apr 20 17:03:35 EDT 2007 i686 athlon i386 GNU/Linux
ulimit -aH
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
pending signals (-i) 1024
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 32767
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 15
model : 37
model name : AMD Opteron(tm) Processor 248
stepping : 1
cpu MHz : 2205.081
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 pni syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni
bogomips : 4414.01
processor : 1
vendor_id : AuthenticAMD
cpu family : 15
model : 37
model name : AMD Opteron(tm) Processor 248
stepping : 1
cpu MHz : 2205.081
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 pni syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni
bogomips : 4409.48