InfidelMatt
Tue 15th Nov '05, 10:11pm
Howdy, I'm running this request because I recently took over as sysadmin and things are quite chaotic. I run a LARGE board and recently upgraded to 3.5.1. Users are frequently complaining of slowdowns, and I would like to fix whatever I can.
1. Dedicated Server
2.Xeon 2.4Ghz x4
4GB RAM
2x73GB EIDE non-raid
redhat linux 3
Apache 1.3.34
PHP 4.41
mySQL 4.1.13
3. no innodb tables
4. upgraded via cpanel
5.
20:23:42 up 356 days, 3:53, 1 user, load average: 1.11, 1.00, 0.86
167 processes: 155 sleeping, 1 running, 10 zombie, 1 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 19.4% 0.0% 4.3% 0.0% 0.1% 2.2% 73.7%
cpu00 18.3% 0.0% 4.5% 0.1% 0.5% 0.7% 75.4%
cpu01 30.3% 0.0% 5.5% 0.0% 0.0% 3.7% 60.2%
cpu02 12.1% 0.0% 4.1% 0.0% 0.0% 0.5% 83.0%
cpu03 16.9% 0.0% 3.1% 0.0% 0.0% 3.7% 76.0%
Mem: 4063284k av, 3974428k used, 88856k free, 0k shrd, 148756k buff
2466928k actv, 872936k in_d, 62392k in_c
Swap: 2048276k av, 436340k used, 1611936k free 2596812k cached
total used free shared buffers cached
Mem: 4063284 3955820 107464 0 147292 2605076
-/+ buffers/cache: 1203452 2859832
Swap: 2048276 436352 1611924
Total: 6111560 4392172 1719388
6. Note that I'm sure some problems exist here:[mysqld]
old-passwords
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# IIDB-specific variable changes:
skip-external-locking
set-variable = join_buffer=2M
set-variable = key_buffer=256M
set-variable = max_allowed_packet=1M
set-variable = myisam_sort_buffer_size=128M
set-variable = table_cache=512
set-variable = sort_buffer=2M
set-variable = record_buffer=2M
set-variable = max_connections=600
server-id = 1
# Try number of CPU's*2 for thread_concurrency
set-variable = thread_concurrency=8
set-variable = thread_cache=16
set-variable = thread_cache_size=64
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
#End of my.cnf configuration file.
Quote:
mysqladmin -u root -p variables
copy and paste output here
7. Aborted_clients 71
Aborted_connects 33
Binlog_cache_disk_use 0
Binlog_cache_use 0
Bytes_received 384265556
Bytes_sent 804779571
Com_admin_commands 0
Com_alter_db 0
Com_alter_table 175
Com_analyze 0
Com_backup_table 0
Com_begin 3
Com_change_db 1579214
Com_change_master 0
Com_check 5
Com_checksum 0
Com_commit 3
Com_create_db 3
Com_create_function 0
Com_create_index 38
Com_create_table 48
Com_dealloc_sql 0
Com_delete 101650
Com_delete_multi 0
Com_do 0
Com_drop_db 0
Com_drop_function 0
Com_drop_index 0
Com_drop_table 11
Com_drop_user 0
Com_execute_sql 0
Com_flush 5
Com_grant 21
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_help 0
Com_insert 915308
Com_insert_select 6863
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 35087
Com_optimize 116
Com_preload_keys 0
Com_prepare_sql 0
Com_purge 0
Com_purge_before_date 0
Com_rename_table 0
Com_repair 2
Com_replace 111914
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 2
Com_revoke_all 0
Com_rollback 0
Com_savepoint 0
Com_select 22506649
Com_set_option 4931
Com_show_binlog_events 0
Com_show_binlogs 27
Com_show_charsets 291
Com_show_collations 291
Com_show_column_types 0
Com_show_create_db 23
Com_show_create_table 357
Com_show_databases 149
Com_show_errors 0
Com_show_fields 444
Com_show_grants 23
Com_show_innodb_status 0
Com_show_keys 90
Com_show_logs 0
Com_show_master_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_privileges 0
Com_show_processlist 3187
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 5
Com_show_storage_engines 1
Com_show_tables 1463
Com_show_variables 916
Com_show_warnings 0
Com_slave_start 0
Com_slave_stop 0
Com_stmt_prepare 0
Com_stmt_execute 0
Com_stmt_send_long_data 0
Com_stmt_reset 0
Com_stmt_close 0
Com_truncate 0
Com_unlock_tables 35087
Com_update 2448526
Com_update_multi 308
Connections 1587509
Created_tmp_disk_tables 5114
Created_tmp_files 11861
Created_tmp_tables 514691
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Flush_commands 1
Handler_commit 0
Handler_delete 827695
Handler_discover 0
Handler_read_first 1767643
Handler_read_key 1041845441
Handler_read_next 1322129569
Handler_read_prev 8749624
Handler_read_rnd 234562262
Handler_read_rnd_next 3392401860
Handler_rollback 0
Handler_update 5653440
Handler_write 235365383
Key_blocks_not_flushed 0
Key_blocks_unused 166700
Key_blocks_used 231960
Key_read_requests 2806771060
Key_reads 4981979
Key_write_requests 17995020
Key_writes 3711059
Max_used_connections 250
Not_flushed_delayed_rows 0
Open_files 590
Open_streams 0
Open_tables 512
Opened_tables 28408
Qcache_free_blocks 0
Qcache_free_memory 0
Qcache_hits 0
Qcache_inserts 0
Qcache_lowmem_prunes 0
Qcache_not_cached 0
Qcache_queries_in_cache 0
Qcache_total_blocks 0
Questions 29344420
Rpl_status NULL
Select_full_join 569
Select_full_range_join 428
Select_range 5429324
Select_range_check 0
Select_scan 2946622
Slave_open_temp_tables 0
Slave_running OFF
Slave_retried_transactions 0
Slow_launch_threads 8
Slow_queries 3451
Sort_merge_passes 12911
Sort_range 2026822
Sort_rows 715707279
Sort_scan 997335
Table_locks_immediate 38619444
Table_locks_waited 69778
Threads_cached 62
Threads_connected 3
Threads_created 2700
Threads_running 1
Uptime 956143
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set_client latin1
character_set_connection latin1
character_set_database latin1
character_set_results latin1
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/
collation_connection latin1_swedish_ci
collation_database latin1_swedish_ci
collation_server latin1_swedish_ci
concurrent_insert ON
connect_timeout 5
datadir /var/lib/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
expire_logs_days 0
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
group_concat_max_len 1024
have_archive NO
have_bdb NO
have_blackhole_engine NO
have_compress YES
have_crypt YES
have_csv NO
have_example_engine NO
have_geometry YES
have_innodb YES
have_isam NO
have_ndbcluster NO
have_openssl NO
have_query_cache YES
have_raid NO
have_rtree_keys YES
have_symlink YES
init_connect
init_file
init_slave
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_awe_mem_mb 0
innodb_buffer_pool_size 8388608
innodb_data_file_path ibdata1:10M:autoextend
innodb_data_home_dir
innodb_fast_shutdown ON
innodb_file_io_threads 4
innodb_file_per_table OFF
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_force_recovery 0
innodb_lock_wait_timeout 50
innodb_locks_unsafe_for_binlog OFF
innodb_log_arch_dir
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_mirrored_log_groups 1
innodb_open_files 300
innodb_table_locks ON
innodb_thread_concurrency 8
interactive_timeout 28800
join_buffer_size 2093056
key_buffer_size 268435456
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_bin OFF
log_error
log_slave_updates OFF
log_slow_queries OFF
log_update OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 1047552
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connect_errors 10
max_connections 600
max_delayed_threads 20
max_error_count 64
max_heap_table_size 16777216
max_insert_delayed_threads 20
max_join_size 4294967295
max_length_for_sort_data 1024
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 4294967295
myisam_data_pointer_size 4
myisam_max_extra_sort_file_size 2147483648
myisam_max_sort_file_size 2147483647
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 134217728
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
old_passwords ON
open_files_limit 3010
pid_file /var/lib/mysql/ev1.iidb.org.pid
port 3306
preload_buffer_size 32768
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_min_res_unit 4096
query_cache_size 0
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 2093056
read_only OFF
read_rnd_buffer_size 262144
relay_log_purge ON
relay_log_space_limit 0
rpl_recovery_rank 0
secure_auth OFF
server_id 1
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slave_net_timeout 3600
slave_transaction_retries 0
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 2097144
sql_mode
storage_engine MyISAM
sql_notes OFF
sql_warnings OFF
sync_binlog 0
sync_replication 0
sync_replication_slave_id 0
sync_replication_timeout 0
sync_frm ON
system_time_zone CST
table_cache 512
table_type MyISAM
thread_cache_size 64
thread_stack 126976
time_format %H:%i:%s
time_zone SYSTEM
tmp_table_size 33554432
tmpdir
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
version 4.1.13-standard
version_comment MySQL Community Edition - Standard (GPL)
version_compile_machine i686
version_compile_os pc-linux-gnu
wait_timeout 28800
8. vB is the only thing on the server.
9. Average 250-350 registered users, 200 guest 24/7. Cookie Timeout is: 1800
10. www.iidb.org/test.php (http://www.iidb.org/test.php)
11.[indent]KeepAlive On
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 180
MaxRequestsPerChild 0
12. vB 3.5.1, recently upgraded from 3.0.7
13. Only thing bigger than 2 GB is the 'post' table for vB, and of course any db backups.
Thanks a bunch in advance,
Matt
1. Dedicated Server
2.Xeon 2.4Ghz x4
4GB RAM
2x73GB EIDE non-raid
redhat linux 3
Apache 1.3.34
PHP 4.41
mySQL 4.1.13
3. no innodb tables
4. upgraded via cpanel
5.
20:23:42 up 356 days, 3:53, 1 user, load average: 1.11, 1.00, 0.86
167 processes: 155 sleeping, 1 running, 10 zombie, 1 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 19.4% 0.0% 4.3% 0.0% 0.1% 2.2% 73.7%
cpu00 18.3% 0.0% 4.5% 0.1% 0.5% 0.7% 75.4%
cpu01 30.3% 0.0% 5.5% 0.0% 0.0% 3.7% 60.2%
cpu02 12.1% 0.0% 4.1% 0.0% 0.0% 0.5% 83.0%
cpu03 16.9% 0.0% 3.1% 0.0% 0.0% 3.7% 76.0%
Mem: 4063284k av, 3974428k used, 88856k free, 0k shrd, 148756k buff
2466928k actv, 872936k in_d, 62392k in_c
Swap: 2048276k av, 436340k used, 1611936k free 2596812k cached
total used free shared buffers cached
Mem: 4063284 3955820 107464 0 147292 2605076
-/+ buffers/cache: 1203452 2859832
Swap: 2048276 436352 1611924
Total: 6111560 4392172 1719388
6. Note that I'm sure some problems exist here:[mysqld]
old-passwords
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# IIDB-specific variable changes:
skip-external-locking
set-variable = join_buffer=2M
set-variable = key_buffer=256M
set-variable = max_allowed_packet=1M
set-variable = myisam_sort_buffer_size=128M
set-variable = table_cache=512
set-variable = sort_buffer=2M
set-variable = record_buffer=2M
set-variable = max_connections=600
server-id = 1
# Try number of CPU's*2 for thread_concurrency
set-variable = thread_concurrency=8
set-variable = thread_cache=16
set-variable = thread_cache_size=64
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
#End of my.cnf configuration file.
Quote:
mysqladmin -u root -p variables
copy and paste output here
7. Aborted_clients 71
Aborted_connects 33
Binlog_cache_disk_use 0
Binlog_cache_use 0
Bytes_received 384265556
Bytes_sent 804779571
Com_admin_commands 0
Com_alter_db 0
Com_alter_table 175
Com_analyze 0
Com_backup_table 0
Com_begin 3
Com_change_db 1579214
Com_change_master 0
Com_check 5
Com_checksum 0
Com_commit 3
Com_create_db 3
Com_create_function 0
Com_create_index 38
Com_create_table 48
Com_dealloc_sql 0
Com_delete 101650
Com_delete_multi 0
Com_do 0
Com_drop_db 0
Com_drop_function 0
Com_drop_index 0
Com_drop_table 11
Com_drop_user 0
Com_execute_sql 0
Com_flush 5
Com_grant 21
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_help 0
Com_insert 915308
Com_insert_select 6863
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 35087
Com_optimize 116
Com_preload_keys 0
Com_prepare_sql 0
Com_purge 0
Com_purge_before_date 0
Com_rename_table 0
Com_repair 2
Com_replace 111914
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 2
Com_revoke_all 0
Com_rollback 0
Com_savepoint 0
Com_select 22506649
Com_set_option 4931
Com_show_binlog_events 0
Com_show_binlogs 27
Com_show_charsets 291
Com_show_collations 291
Com_show_column_types 0
Com_show_create_db 23
Com_show_create_table 357
Com_show_databases 149
Com_show_errors 0
Com_show_fields 444
Com_show_grants 23
Com_show_innodb_status 0
Com_show_keys 90
Com_show_logs 0
Com_show_master_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_privileges 0
Com_show_processlist 3187
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 5
Com_show_storage_engines 1
Com_show_tables 1463
Com_show_variables 916
Com_show_warnings 0
Com_slave_start 0
Com_slave_stop 0
Com_stmt_prepare 0
Com_stmt_execute 0
Com_stmt_send_long_data 0
Com_stmt_reset 0
Com_stmt_close 0
Com_truncate 0
Com_unlock_tables 35087
Com_update 2448526
Com_update_multi 308
Connections 1587509
Created_tmp_disk_tables 5114
Created_tmp_files 11861
Created_tmp_tables 514691
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Flush_commands 1
Handler_commit 0
Handler_delete 827695
Handler_discover 0
Handler_read_first 1767643
Handler_read_key 1041845441
Handler_read_next 1322129569
Handler_read_prev 8749624
Handler_read_rnd 234562262
Handler_read_rnd_next 3392401860
Handler_rollback 0
Handler_update 5653440
Handler_write 235365383
Key_blocks_not_flushed 0
Key_blocks_unused 166700
Key_blocks_used 231960
Key_read_requests 2806771060
Key_reads 4981979
Key_write_requests 17995020
Key_writes 3711059
Max_used_connections 250
Not_flushed_delayed_rows 0
Open_files 590
Open_streams 0
Open_tables 512
Opened_tables 28408
Qcache_free_blocks 0
Qcache_free_memory 0
Qcache_hits 0
Qcache_inserts 0
Qcache_lowmem_prunes 0
Qcache_not_cached 0
Qcache_queries_in_cache 0
Qcache_total_blocks 0
Questions 29344420
Rpl_status NULL
Select_full_join 569
Select_full_range_join 428
Select_range 5429324
Select_range_check 0
Select_scan 2946622
Slave_open_temp_tables 0
Slave_running OFF
Slave_retried_transactions 0
Slow_launch_threads 8
Slow_queries 3451
Sort_merge_passes 12911
Sort_range 2026822
Sort_rows 715707279
Sort_scan 997335
Table_locks_immediate 38619444
Table_locks_waited 69778
Threads_cached 62
Threads_connected 3
Threads_created 2700
Threads_running 1
Uptime 956143
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set_client latin1
character_set_connection latin1
character_set_database latin1
character_set_results latin1
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/
collation_connection latin1_swedish_ci
collation_database latin1_swedish_ci
collation_server latin1_swedish_ci
concurrent_insert ON
connect_timeout 5
datadir /var/lib/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
expire_logs_days 0
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
group_concat_max_len 1024
have_archive NO
have_bdb NO
have_blackhole_engine NO
have_compress YES
have_crypt YES
have_csv NO
have_example_engine NO
have_geometry YES
have_innodb YES
have_isam NO
have_ndbcluster NO
have_openssl NO
have_query_cache YES
have_raid NO
have_rtree_keys YES
have_symlink YES
init_connect
init_file
init_slave
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_awe_mem_mb 0
innodb_buffer_pool_size 8388608
innodb_data_file_path ibdata1:10M:autoextend
innodb_data_home_dir
innodb_fast_shutdown ON
innodb_file_io_threads 4
innodb_file_per_table OFF
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_force_recovery 0
innodb_lock_wait_timeout 50
innodb_locks_unsafe_for_binlog OFF
innodb_log_arch_dir
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_mirrored_log_groups 1
innodb_open_files 300
innodb_table_locks ON
innodb_thread_concurrency 8
interactive_timeout 28800
join_buffer_size 2093056
key_buffer_size 268435456
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_bin OFF
log_error
log_slave_updates OFF
log_slow_queries OFF
log_update OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 1047552
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connect_errors 10
max_connections 600
max_delayed_threads 20
max_error_count 64
max_heap_table_size 16777216
max_insert_delayed_threads 20
max_join_size 4294967295
max_length_for_sort_data 1024
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 4294967295
myisam_data_pointer_size 4
myisam_max_extra_sort_file_size 2147483648
myisam_max_sort_file_size 2147483647
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 134217728
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
old_passwords ON
open_files_limit 3010
pid_file /var/lib/mysql/ev1.iidb.org.pid
port 3306
preload_buffer_size 32768
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_min_res_unit 4096
query_cache_size 0
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 2093056
read_only OFF
read_rnd_buffer_size 262144
relay_log_purge ON
relay_log_space_limit 0
rpl_recovery_rank 0
secure_auth OFF
server_id 1
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slave_net_timeout 3600
slave_transaction_retries 0
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 2097144
sql_mode
storage_engine MyISAM
sql_notes OFF
sql_warnings OFF
sync_binlog 0
sync_replication 0
sync_replication_slave_id 0
sync_replication_timeout 0
sync_frm ON
system_time_zone CST
table_cache 512
table_type MyISAM
thread_cache_size 64
thread_stack 126976
time_format %H:%i:%s
time_zone SYSTEM
tmp_table_size 33554432
tmpdir
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
version 4.1.13-standard
version_comment MySQL Community Edition - Standard (GPL)
version_compile_machine i686
version_compile_os pc-linux-gnu
wait_timeout 28800
8. vB is the only thing on the server.
9. Average 250-350 registered users, 200 guest 24/7. Cookie Timeout is: 1800
10. www.iidb.org/test.php (http://www.iidb.org/test.php)
11.[indent]KeepAlive On
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 180
MaxRequestsPerChild 0
12. vB 3.5.1, recently upgraded from 3.0.7
13. Only thing bigger than 2 GB is the 'post' table for vB, and of course any db backups.
Thanks a bunch in advance,
Matt