PDA

View Full Version : Server optimisation...


ColinP
Fri 29th Aug '03, 1:17pm
It's time for my 6 monthly plea for help in improving our server load :D

1. Dedicated server (although it is shared with two much smaller sites)
2. Specs:
Dual Xeon 2.0GHz
2GB Ram
Non-RAID HD - I THINK it's IDE
Redhat 7.3
Apache 1.3.27
PHP 4.2.3
MySQL 3.23.54


Top Stats:

4:18pm up 10 days, 21:18, 1 user, load average: 11.25, 12.39, 13.49
502 processes: 495 sleeping, 6 running, 1 zombie, 0 stopped
CPU0 states: 68.3% user, 17.2% system, 0.0% nice, 13.4% idle
CPU1 states: 63.4% user, 21.4% system, 0.0% nice, 14.2% idle
CPU2 states: 69.2% user, 16.3% system, 0.0% nice, 13.4% idle
CPU3 states: 55.1% user, 34.3% system, 0.0% nice, 10.0% idle
Mem: 2064328K av, 2038172K used, 26156K free, 0K shrd, 50160K buff
Swap: 2040244K av, 1752K used, 2038492K free 1352672K cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
30548 root 23 0 1352 1352 844 R 26.5 0.0 0:02 top
29353 mysql 18 0 69800 67M 1392 R 15.1 3.3 2:55 mysqld
26671 apache 15 0 5300 5300 3004 S 10.1 0.2 0:09 httpd
30347 apache 18 0 5212 5212 2976 S 9.9 0.2 0:01 httpd
26657 apache 17 0 5316 5316 3000 S 9.3 0.2 0:08 httpd
26638 apache 17 0 5876 5876 2988 S 8.6 0.2 0:13 httpd
26637 apache 15 0 5112 5112 2992 S 8.4 0.2 0:10 httpd
26643 apache 15 0 4892 4892 2992 S 8.4 0.2 0:14 httpd
26628 apache 15 0 5176 5176 3004 S 8.2 0.2 0:07 httpd
30446 apache 15 0 5140 5140 2952 S 8.0 0.2 0:00 httpd
26668 apache 15 0 5984 5984 3004 S 7.8 0.2 0:13 httpd
26681 apache 15 0 4852 4852 2988 S 7.8 0.2 0:08 httpd
26694 apache 15 0 5280 5280 2996 S 7.8 0.2 0:10 httpd
29931 apache 15 0 4908 4908 2984 S 7.8 0.2 0:01 httpd
30290 apache 15 0 5180 5180 2976 S 7.8 0.2 0:02 httpd
26625 apache 15 0 5232 5232 2992 S 7.4 0.2 0:13 httpd
26679 apache 15 0 5100 5100 2984 S 7.4 0.2 0:12 httpd
30447 apache 15 0 4792 4792 2900 S 7.4 0.2 0:00 httpd
26619 apache 15 0 5112 5112 2992 S 7.2 0.2 0:11 httpd
26667 apache 15 0 5148 5148 3000 S 7.1 0.2 0:08 httpd
30454 apache 15 0 5068 5068 2924 S 7.1 0.2 0:00 httpd
30452 apache 15 0 6048 6048 2896 S 6.9 0.2 0:00 httpd
30284 apache 15 0 5076 5076 2956 S 6.1 0.2 0:00 httpd
30561 apache 17 0 4028 4028 1300 D 4.1 0.1 0:00 index.cgi
29562 mysql 15 0 69852 67M 1392 S 2.9 3.3 2:28 mysqld
29357 mysql 15 0 69800 67M 1392 S 2.0 3.3 2:39 mysqld
29480 mysql 15 0 70232 68M 1392 S 1.8 3.3 2:28 mysqld
17737 mysql 15 0 68772 66M 1392 S 1.6 3.3 4:47 mysqld
29500 mysql 15 0 68824 66M 1392 S 1.6 3.3 2:44 mysqld
30462 apache 15 0 5136 5136 2944 S 1.6 0.2 0:01 httpd
29550 mysql 15 0 69852 67M 1392 S 1.4 3.3 2:09 mysqld
29540 mysql 15 0 69852 67M 1392 S 1.3 3.3 3:01 mysqld
21129 mysql 15 0 69852 67M 1392 S 1.3 3.3 0:47 mysqld
17744 mysql 16 0 68772 66M 1392 S 1.1 3.3 4:19 mysqld
18362 mysql 15 0 68772 66M 1392 S 1.1 3.3 5:18 mysqld
18538 mysql 15 0 68772 66M 1392 R 1.1 3.3 5:16 mysqld
29304 mysql 15 0 69960 68M 1392 S 1.1 3.3 2:53 mysqld
29362 mysql 15 0 69800 67M 1392 S 1.1 3.3 2:28 mysqld
29409 mysql 15 0 70232 68M 1392 R 1.1 3.3 2:09 mysqld
29556 mysql 15 0 69852 67M 1392 S 1.1 3.3 2:33 mysqld
21124 mysql 15 0 69852 67M 1392 S 1.1 3.3 0:32 mysqld
29541 mysql 15 0 69852 67M 1392 S 0.9 3.3 2:30 mysqld
29543 mysql 15 0 69852 67M 1392 S 0.9 3.3 2:41 mysqld
29639 mysql 15 0 69852 67M 1392 S 0.9 3.3 3:16 mysqld
29293 mysql 16 0 69960 68M 1392 S 0.7 3.3 2:09 mysqld
17017 mysql 15 0 70476 68M 1392 S 0.5 3.4 3:54 mysqld



MySQL Variables:


| back_log | 50 |
| basedir | / |
| binlog_cache_size | 32768 |
| character_set | latin1 |
| character_sets | latin1 big5 czech euc_kr gb2312 gbk sjis tis620 ujis dec8 dos german1 hp8 koi8_ru latin2 swe7 usa7 cp1251 danish hebrew win1251 estonia hungarian koi8_ukr win1251ukr greek win1250 croat cp1257 latin5 |
| concurrent_insert | ON |
| connect_timeout | 5 |
| datadir | /usr/mysql/data/ |
| delay_key_write | ON |
| delayed_insert_limit | 100 |
| delayed_insert_timeout | 300 |
| delayed_queue_size | 1000 |
| flush | OFF |
| flush_time | 0 |
| have_bdb | NO |
| have_gemini | NO |
| have_innodb | NO |
| have_isam | YES |
| have_raid | NO |
| have_openssl | NO |
| init_file | |
| interactive_timeout | 28800 |
| join_buffer_size | 1044480 |
| key_buffer_size | 16773120 |
| language | /usr/share/mysql/english/ |
| large_files_support | ON |
| locked_in_memory | OFF |
| log | OFF |
| log_update | OFF |
| log_bin | OFF |
| log_slave_updates | OFF |
| log_long_queries | OFF |
| long_query_time | 10 |
| low_priority_updates | OFF |
| lower_case_table_names | 0 |
| max_allowed_packet | 1048576 |
| max_binlog_cache_size | 4294967295 |
| max_binlog_size | 1073741824 |
| max_connections | 650 |
| max_connect_errors | 10 |
| max_delayed_threads | 20 |
| max_heap_table_size | 16777216 |
| max_join_size | 4294967295 |
| max_sort_length | 1024 |
| max_user_connections | 0 |
| max_tmp_tables | 32 |
| max_write_lock_count | 4294967295 |
| myisam_max_extra_sort_file_size | 256 |
| myisam_max_sort_file_size | 2047 |
| myisam_recover_options | 0 |
| myisam_sort_buffer_size | 8388608 |
| net_buffer_length | 16384 |
| net_read_timeout | 30 |
| net_retry_count | 10 |
| net_write_timeout | 60 |
| open_files_limit | 0 |
| pid_file | /usr/mysql/data/mercury.thedvdforums.com.pid |
| port | 3306 |
| protocol_version | 10 |
| record_buffer | 1044480 |
| record_rnd_buffer | 1044480 |
| query_buffer_size | 0 |
| safe_show_database | OFF |
| server_id | 0 |
| slave_net_timeout | 3600 |
| skip_locking | ON |
| skip_networking | OFF |
| skip_show_database | OFF |
| slow_launch_time | 2 |
| socket | /var/lib/mysql/mysql.sock |
| sort_buffer | 6291448 |
| sql_mode | 0 |
| table_cache | 1024 |
| table_type | MYISAM |
| thread_cache_size | 256 |
| thread_stack | 65536 |
| transaction_isolation | READ-COMMITTED |
| timezone | GMT |
| tmp_table_size | 33554432 |
| tmpdir | /tmp/ |
| version | 3.23.54 |
| wait_timeout | 28800 |


Extended Status:

+--------------------------+------------+
| Variable_name | Value |
+--------------------------+------------+
| Aborted_clients | 37 |
| Aborted_connects | 1 |
| Bytes_received | 1802701140 |
| Bytes_sent | 3371480869 |
| Com_admin_commands | 0 |
| Com_alter_table | 7 |
| Com_analyze | 0 |
| Com_backup_table | 0 |
| Com_begin | 0 |
| Com_change_db | 385804 |
| Com_change_master | 0 |
| Com_check | 0 |
| Com_commit | 0 |
| Com_create_db | 0 |
| Com_create_function | 0 |
| Com_create_index | 0 |
| Com_create_table | 1 |
| Com_delete | 92547 |
| Com_drop_db | 0 |
| Com_drop_function | 0 |
| Com_drop_index | 0 |
| Com_drop_table | 0 |
| Com_flush | 0 |
| Com_grant | 0 |
| Com_insert | 365226 |
| Com_insert_select | 1936 |
| Com_kill | 0 |
| Com_load | 0 |
| Com_load_master_table | 0 |
| Com_lock_tables | 0 |
| Com_optimize | 328 |
| Com_purge | 0 |
| Com_rename_table | 0 |
| Com_repair | 0 |
| Com_replace | 8440 |
| Com_replace_select | 89 |
| Com_reset | 0 |
| Com_restore_table | 0 |
| Com_revoke | 0 |
| Com_rollback | 264347 |
| Com_select | 8536698 |
| Com_set_option | 245 |
| Com_show_binlogs | 0 |
| Com_show_create | 245 |
| Com_show_databases | 15 |
| Com_show_fields | 344 |
| Com_show_grants | 0 |
| Com_show_keys | 31 |
| Com_show_logs | 0 |
| Com_show_master_status | 0 |
| Com_show_open_tables | 0 |
| Com_show_processlist | 0 |
| Com_show_slave_status | 0 |
| Com_show_status | 15424 |
| Com_show_innodb_status | 0 |
| Com_show_tables | 386 |
| Com_show_variables | 181 |
| Com_slave_start | 0 |
| Com_slave_stop | 0 |
| Com_truncate | 0 |
| Com_unlock_tables | 0 |
| Com_update | 776374 |
| Connections | 370175 |
| Created_tmp_disk_tables | 18 |
| Created_tmp_tables | 328573 |
| Created_tmp_files | 8 |
| Delayed_insert_threads | 0 |
| Delayed_writes | 0 |
| Delayed_errors | 0 |
| Flush_commands | 1 |
| Handler_delete | 205195 |
| Handler_read_first | 361881 |
| Handler_read_key | 94199837 |
| Handler_read_next | 515253243 |
| Handler_read_prev | 0 |
| Handler_read_rnd | 99414179 |
| Handler_read_rnd_next | 1515330076 |
| Handler_update | 848777 |
| Handler_write | 32324572 |
| Key_blocks_used | 15582 |
| Key_read_requests | 421390345 |
| Key_reads | 889954 |
| Key_write_requests | 1147078 |
| Key_writes | 924546 |
| Max_used_connections | 370 |
| Not_flushed_key_blocks | 0 |
| Not_flushed_delayed_rows | 0 |
| Open_tables | 1024 |
| Open_files | 1037 |
| Open_streams | 0 |
| Opened_tables | 3936 |
| Questions | 10805802 |
| Select_full_join | 3 |
| Select_full_range_join | 0 |
| Select_range | 2600600 |
| Select_range_check | 0 |
| Select_scan | 1568745 |
| Slave_running | OFF |
| Slave_open_temp_tables | 0 |
| Slow_launch_threads | 0 |
| Slow_queries | 395 |
| Sort_merge_passes | 0 |
| Sort_range | 2296837 |
| Sort_rows | 101336604 |
| Sort_scan | 1026254 |
| Table_locks_immediate | 11762821 |
| Table_locks_waited | 91404 |
| Threads_cached | 175 |
| Threads_created | 396 |
| Threads_connected | 81 |
| Threads_running | 1 |
| Uptime | 153325 |
+--------------------------+------------+



Usually have around 500 concurrent users

Currently running vBulletin 2.2.8





Is that everything you need? :D Any ideas on reducing our load?

Thanks in advance.

eva2000
Fri 29th Aug '03, 3:32pm
can you post your mysqlinfo.php url

ColinP
Fri 29th Aug '03, 4:53pm
can you post your mysqlinfo.php url
Not got that on our server. Do you mean phpinfo.php?

That's http://www.thedvdforums.com/phpinfo.php

Steve Machol
Fri 29th Aug '03, 5:16pm
The mysqlinfo.php file is in the 'extras' directory of the zip file. Upload this to the server and provide the URL.

ColinP
Sun 31st Aug '03, 6:34am
The mysqlinfo.php file is in the 'extras' directory of the zip file. Upload this to the server and provide the URL.
Oops :) I getcha - here it is...

http://www.thedvdforums.com/forums/admin/mysqlinfo.php

The server is quite quiet at the moment so the load is fairly low - but it's still higher than it was say a month or so ago and the traffic levels aren't any higher. It'll get a lot busier later or tomorrow.