PDA

View Full Version : Large vB, Optimization Request

gigahost
Wed 4th Aug '04, 5:54am
I've recently got a dedicated server but I'm not entirely happy with its performance. Most times it is ok but sometimes i get connections refused etc. I am certain the server is not overloaded, as the sites on it are not huge.

Anyway, if anyone can spot anything out of the order in the following then advice would really be appreciated.


1. this is dedicated server
2. your server specs.:

cpu speed/type single or dual cpus): Pentium IV 2.8ghz
how much memory installed: 2GB ram
hard drive type/configuration: 2x80GB IDE non raid
linux distributor : Red Hat Enterprise Linux
apache/IIS version: apache 1.3.31
PHP version: php 4.3.8
MySQL version: mysql 4.0.20


3. not sure what innodb tables are
4. if possible how mysql was compiled/installed
/scripts/easyapache/cpanel

5. your top stats

15:25:09 up 5:26, 1 user, load average: 21.84, 21.43, 25.21
346 processes: 338 sleeping, 6 running, 1 zombie, 1 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 88.5% 0.0% 11.4% 0.0% 0.0% 0.0% 0.0%
Mem: 2060824k av, 1040740k used, 1020084k free, 0k shrd, 56864k buff
182464k active, 740364k inactive
Swap: 1012084k av, 0k used, 1012084k free 344160k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
2922 root 16 0 11208 10M 10516 S 87.5 0.5 30:08 0 httpd
28367 mysql 15 0 56184 54M 2044 S 10.1 2.7 7:28 0 mysqld
4951 root 18 0 1460 1460 892 R 3.3 0.0 0:05 0 top
1 root 16 0 428 428 372 S 0.0 0.0 0:05 0 init
2 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 keventd
3 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kapmd
4 root 34 19 0 0 0 RWN 0.0 0.0 0:00 0 ksoftirqd/0
6 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 bdflush
5 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 kswapd
7 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kupdated
8 root 21 0 0 0 0 SW 0.0 0.0 0:00 0 mdrecoveryd
12 root 15 0 0 0 0 SW 0.0 0.0 0:03 0 kjournald
515 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald
943 root 15 0 572 572 496 R 0.0 0.0 0:00 0 syslogd
947 root 16 0 392 392 332 S 0.0 0.0 0:00 0 klogd
1017 nobody 15 0 2064 2060 1848 S 0.0 0.0 0:00 0 proftpd
1027 root 16 0 656 656 476 S 0.0 0.0 0:00 0 smartd
1914 root 15 0 3304 3304 1784 S 0.0 0.1 0:00 0 chkservd
2203 root 15 0 612 612 548 S 0.0 0.0 0:00 0 crond
3228 mailnull 16 0 11328 11M 9552 S 0.0 0.5 0:00 0 MailScanner
3357 dbus 18 0 820 820 728 S 0.0 0.0 0:00 0 dbus-daemon-1
3403 root 15 0 484 484 424 S 0.0 0.0 0:00 0 portsentry
3488 root 18 0 356 356 304 S 0.0 0.0 0:00 0 mingetty
3489 root 16 0 356 356 304 S 0.0 0.0 0:00 0 mingetty
3490 root 16 0 356 356 304 S 0.0 0.0 0:00 0 mingetty
3491 root 16 0 356 356 304 S 0.0 0.0 0:00 0 mingetty
3492 root 16 0 356 356 304 S 0.0 0.0 0:00 0 mingetty
3493 root 16 0 352 352 304 S 0.0 0.0 0:00 0 mingetty
3571 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 loop0
3579 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald
5907 mailnull 16 0 1564 1564 1344 S 0.0 0.0 0:00 0 exim


6. my mysql configuration variables located at /etc/my.cnf

[mysqld]
port = 3306
socket=/var/lib/mysql/mysql.sock
skip-locking
max_connections = 500
key_buffer = 16M
myisam_sort_buffer_size = 64M
join_buffer = 1M
read_buffer_size = 1M
sort_buffer_size = 2M
table_cache = 1024
thread_cache = 64
wait_timeout = 28800
connect_timeout = 10
max_allowed_packet = 16M
max_connect_errors = 10
query_cache_limit = 1M
query_cache_size = 32M
query_cache_type = 1
record_buffer = 2M
[mysqldump]
quick
max_allowed_packet = 16M
[mysql]
no-auto-rehash
[isamchk]
key_buffer = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M
[myisamchk]
key_buffer = 64M
sort_buffer = 64M
read_buffer = 16M
write_buffer = 16M
[mysqlhotcopy]
interactive-timeout

7. your mysql extended-status
url: http://noblecare.net/extended-status.php (http://67.18.182.93/mysql_extended.php)


Fri Aug 6 09:35:19 ICT 2004


09:35:20 up 14:34, 1 user, load average: 2.13, 2.55, 2.54
171 processes: 137 sleeping, 5 running, 29 zombie, 0 stopped
total 68.8% 0.0% 31.1% 0.0% 0.0% 0.0% 0.0%
Mem: 2060824k av, 584224k used, 1476600k free, 0k shrd, 101096k buff
311656k active, 196040k inactive
Swap: 1012084k av, 18164k used, 993920k free 238408k cached

PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
31197 nobody 17 0 1280 1280 888 R 8.1 0.0 0:00 0 top


Http processes currently running = 27
Mysql processes currently running = 54

Netstat information summary
1 SYN_SENT
2 LAST_ACK
29 FIN_WAIT1
29 LISTEN
64 SYN_RECV
137 FIN_WAIT2
152 ESTABLISHED
284 TIME_WAIT

8. oh and is your vB the only thing on the server? or other scripts? sites?
several html sites, less than 10 gig per month, phpbb scripts (2 forum with 20 user online),

9. how many average and max concurrent users on your vB forum ? and what your cookie timeout is ?

Avg: 750 users
Max: 1100 users
Cookie Timeout: 600


10. phpinfo

http://noblecare.net/info.php


11. httpd.conf

KeepAlive on

MaxKeepAliveRequests 100

KeepAliveTimeout 15

MinSpareServers 5

MaxSpareServers 10

StartServers 5

MaxClients 450

12. what version of vB are you running ?
vB 3.0.0

vB database about 200MB

Optimization help please
eva2000
Thu 5th Aug '04, 12:05pm
hi your http://noblecare.net/extended-status.php seems to be down...

with that many users you might need to go dual cpu servers at least maybe even 2x dual cpu servers, but i won't know for sure until i see the mysql extended-status output for a good 2-5 days of output or a snapshot at forum peak times
gigahost
Thu 5th Aug '04, 10:48pm
Hi Eva!

sorry, i have problem with DNS, and domain do not work.
this is links extended-status.php and phpinfo:
http://67.18.182.93/info.php
http://67.18.182.93/mysql_extended.php

this forum, Average concurent users - 600. Peak times around 950-1100
and right now, forum load very slow, sometimes mysql service offline, and i have to restart mysql by manual (Sim report mysql online)

thanks for your help.
eva2000
Fri 6th Aug '04, 1:46pm
well i still can't load the pages but from what you tell me 600 av and 1100 max, you will need to move to dual p4 2.8ghz - 3.06ghz xeons with 2GB ram at least

try reducing maxclients in httpd.conf from 450 to 200 and restart apache so as to let less concurrent visitors in on your server for now
gigahost
Fri 6th Aug '04, 10:31pm
Hi Eva!

becase my server die again, this is info mysql extended-status

Sat Aug 7 08:31:13 ICT 2004


08:31:14 up 24 min, 1 user, load average: 2.11, 1.77, 1.33
112 processes: 109 sleeping, 2 running, 0 zombie, 1 stopped
total 51.9% 0.0% 10.5% 0.0% 0.0% 0.0% 37.5%
Mem: 2060824k av, 465796k used, 1595028k free, 0k shrd, 36788k buff
117644k active, 222216k inactive
Swap: 1012084k av, 0k used, 1012084k free 165644k cached

PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
24591 nobody 16 0 1232 1232 888 R 1.9 0.0 0:00 0 top


Http processes currently running = 18
Mysql processes currently running = 33

Netstat information summary
2 CLOSE_WAIT
7 CLOSING
10 FIN_WAIT1
11 SYN_RECV
17 FIN_WAIT2
29 LISTEN
78 ESTABLISHED
334 TIME_WAIT


you can see here
http://67.18.182.93/mysql_extended.php

right now, forum have 310 users online.

PS: i have change MaxClients 450 to 200.
eva2000
Sat 7th Aug '04, 1:07pm
yup definitely from the looks of those stats, you need to split to 2 servers both dual cpus one for web server and one for database server
gigahost
Sun 8th Aug '04, 4:42am
maybe my server runing with 10MBP/S Port , and server load very slow with 650 users online.
if my server as below, this server support how many users?
Server:Dual Xeon 2.8 GHz - Primary HDD:80GB Hard DriveSecondary HDD:80GB Hard DriveRAM:ECC Registered 2048 MB RAM
Bandwidth:2000 GB Bandwidth Uplink Port Speed:100 Mbps Uplink

Thanks for your help.
eva2000
Sun 8th Aug '04, 4:54pm
you mean single P4 2.8ghz xeon with 2GB ram and 80 EIDE hdds ? if so you should be able to handle vB by itself with 350-500 vb users based on 900 second cookie timeout where member to guest ratio is 80/20 but that is a very rough estimate since vB users online can be misleading

You should look at the max_used_connections in mysql extended-status which resets each time you restart mysql or flush-tables in mysql. Once you approach 250-350 max_used_connections dual cpus would be recommended, once you consitently get over 400-500 max_used_connections start looking at 2 servers and splitting web/db servers loads

can you post the output you get from this command in ssh telnet as root user

mysqladmin -u root -p extended-status
gigahost
Sun 8th Aug '04, 10:31pm
this is url for mysqladmin -u root -p extended-status
http://67.18.182.93/extended-status.php
right now, max_used_connections =70

08:30:59 up 2 days, 24 min, 1 user, load average: 2.77, 2.38, 2.34
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
9282 nobody 18 0 1304 1304 888 R 16.3 0.0 0:00 0 top
Mon Aug 9 08:30:59 ICT 2004
+--------------------------+------------+
| Variable_name | Value |
+--------------------------+------------+
| Aborted_clients | 3585 |
| Aborted_connects | 25 |
| Bytes_received | 2085017507 |
| Bytes_sent | 22911012 |
| Com_admin_commands | 0 |
| Com_alter_table | 0 |
| Com_analyze | 0 |
| Com_backup_table | 0 |
| Com_begin | 0 |
| Com_change_db | 728279 |
| Com_change_master | 0 |
| Com_check | 0 |
| Com_commit | 0 |
| Com_create_db | 0 |
| Com_create_function | 0 |
| Com_create_index | 0 |
| Com_create_table | 1 |
| Com_delete | 14574 |
| Com_delete_multi | 0 |
| Com_drop_db | 0 |
| Com_drop_function | 0 |
| Com_drop_index | 0 |
| Com_drop_table | 3 |
| Com_flush | 42 |
| Com_grant | 20 |
| Com_ha_close | 0 |
| Com_ha_open | 0 |
| Com_ha_read | 0 |
| Com_insert | 57766 |
| Com_insert_select | 511 |
| Com_kill | 0 |
| Com_load | 0 |
| Com_load_master_data | 0 |
| Com_load_master_table | 0 |
| Com_lock_tables | 1141 |
| Com_optimize | 0 |
| Com_purge | 0 |
| Com_rename_table | 0 |
| Com_repair | 0 |
| Com_replace | 9799 |
| Com_replace_select | 0 |
| Com_reset | 0 |
| Com_restore_table | 0 |
| Com_revoke | 0 |
| Com_rollback | 0 |
| Com_savepoint | 0 |
| Com_select | 2367150 |
| Com_set_option | 893 |
| Com_show_binlog_events | 0 |
| Com_show_binlogs | 0 |
| Com_show_create | 893 |
| Com_show_databases | 46 |
| Com_show_fields | 910 |
| Com_show_grants | 79 |
| Com_show_keys | 9 |
| Com_show_logs | 0 |
| Com_show_master_status | 0 |
| Com_show_new_master | 0 |
| Com_show_open_tables | 0 |
| Com_show_processlist | 488 |
| Com_show_slave_hosts | 0 |
| Com_show_slave_status | 0 |
| Com_show_status | 2 |
| Com_show_innodb_status | 0 |
| Com_show_tables | 1014 |
| Com_show_variables | 28 |
| Com_slave_start | 0 |
| Com_slave_stop | 0 |
| Com_truncate | 0 |
| Com_unlock_tables | 1141 |
| Com_update | 774218 |
| Connections | 729163 |
| Created_tmp_disk_tables | 337 |
| Created_tmp_tables | 89244 |
| Created_tmp_files | 0 |
| Delayed_insert_threads | 0 |
| Delayed_writes | 0 |
| Delayed_errors | 0 |
| Flush_commands | 1 |
| Handler_commit | 0 |
| Handler_delete | 79231 |
| Handler_read_first | 237363 |
| Handler_read_key | 80798614 |
| Handler_read_next | 19619828 |
| Handler_read_prev | 5099174 |
| Handler_read_rnd | 35076339 |
| Handler_read_rnd_next | 1280566951 |
| Handler_rollback | 0 |
| Handler_update | 815483 |
| Handler_write | 25841461 |
| Key_blocks_used | 13683 |
| Key_read_requests | 179109100 |
| Key_reads | 12432 |
| Key_write_requests | 152392 |
| Key_writes | 122332 |
| Max_used_connections | 70 |
| Not_flushed_key_blocks | 0 |
| Not_flushed_delayed_rows | 0 |
| Open_tables | 566 |
| Open_files | 1019 |
| Open_streams | 0 |
| Opened_tables | 786 |
| Questions | 8161640 |
| Qcache_queries_in_cache | 8609 |
| Qcache_inserts | 2365279 |
| Qcache_hits | 3475301 |
| Qcache_lowmem_prunes | 334 |
| Qcache_not_cached | 1862 |
| Qcache_free_memory | 13444304 |
| Qcache_free_blocks | 3688 |
| Qcache_total_blocks | 21267 |
| Rpl_status | NULL |
| Select_full_join | 101 |
| Select_full_range_join | 0 |
| Select_range | 420370 |
| Select_range_check | 0 |
| Select_scan | 611539 |
| Slave_open_temp_tables | 0 |
| Slave_running | OFF |
| Slow_launch_threads | 5 |
| Slow_queries | 7 |
| Sort_merge_passes | 0 |
| Sort_range | 542271 |
| Sort_rows | 36590752 |
| Sort_scan | 347820 |
| Table_locks_immediate | 6775956 |
| Table_locks_waited | 1809 |
| Threads_cached | 56 |
| Threads_created | 71 |
| Threads_connected | 9 |
| Threads_running | 1 |
| Uptime | 146220 |
+--------------------------+------------+
eva2000
Wed 11th Aug '04, 1:18pm
from looks of it upgrade to dual p4 2.8ghz xeon cpus with 2GB ram would help some