PDA

View Full Version : Server Optimization Request


777333
Sat 22nd Apr '06, 8:37pm
Everything is working ok but it is sometimes slow. Any help is welcome. Thank you.

1. Is this on dedicated or shared virual server.
Dedicated.

2. Dual Xeon 2.8ghz
2GB ram
74GB SCSI non raid
Red Hat Enterprise Linux ES release 3
Apache v1.3.34
PHP version: php 4.4.2
MySQL version: mysql 4.1.18

3. if you use mysql 4.x instead of mysql 3.23.x, do you have any innodb type databases/tables on your server?
? I have no idea.

4. if possible how mysql was compiled/installed
With WHM/CPANEL

5. your top stats
18:34:21 up 3 days, 8:38, 1 user, load average: 1.79, 1.90, 1.91
126 processes: 125 sleeping, 1 running, 0 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 36.0% 0.0% 4.1% 0.0% 0.1% 1.1% 58.4%
cpu00 27.1% 0.0% 3.7% 0.0% 0.3% 1.1% 67.4%
cpu01 49.5% 0.0% 3.5% 0.0% 0.0% 0.7% 46.1%
cpu02 37.2% 0.0% 4.8% 0.0% 0.0% 1.6% 56.4%
cpu03 30.3% 0.0% 4.3% 0.0% 0.1% 1.1% 63.8%
Mem: 2061576k av, 1974880k used, 86696k free, 0k shrd, 38016k buff
1430940k actv, 284652k in_d, 30416k in_c
Swap: 2040244k av, 592952k used, 1447292k free 962592k cached

6. your mysql configuration variables located at /etc/my.cnf
At /etc/my.cnf I only see
[mysqld]
set-variable = max_connections=500
safe-show-database
:confused:

Via vB admincp:

Help MySQL Variables
Variable_name Value
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set_client latin1
character_set_connection latin1
character_set_database latin1
character_set_results latin1
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/
collation_connection latin1_swedish_ci
collation_database latin1_swedish_ci
collation_server latin1_swedish_ci
concurrent_insert ON
connect_timeout 5
datadir /var/lib/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
expire_logs_days 0
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
group_concat_max_len 1024
have_archive NO
have_bdb NO
have_blackhole_engine NO
have_compress YES
have_crypt YES
have_csv NO
have_example_engine NO
have_geometry YES
have_innodb YES
have_isam NO
have_ndbcluster NO
have_openssl NO
have_query_cache YES
have_raid NO
have_rtree_keys YES
have_symlink YES
init_connect
init_file
init_slave
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_awe_mem_mb 0
innodb_buffer_pool_size 8388608
innodb_data_file_path ibdata1:10M:autoextend
innodb_data_home_dir
innodb_fast_shutdown ON
innodb_file_io_threads 4
innodb_file_per_table OFF
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_force_recovery 0
innodb_lock_wait_timeout 50
innodb_locks_unsafe_for_binlog OFF
innodb_log_arch_dir
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_mirrored_log_groups 1
innodb_open_files 300
innodb_table_locks ON
innodb_thread_concurrency 8
interactive_timeout 28800
join_buffer_size 131072
key_buffer_size 8388600
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_bin OFF
log_error
log_slave_updates OFF
log_slow_queries OFF
log_update OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 1048576
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connect_errors 10
max_connections 500
max_delayed_threads 20
max_error_count 64
max_heap_table_size 16777216
max_insert_delayed_threads 20
max_join_size 4294967295
max_length_for_sort_data 1024
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 4294967295
myisam_data_pointer_size 4
myisam_max_extra_sort_file_size 2147483648
myisam_max_sort_file_size 2147483647
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 8388608
myisam_stats_method nulls_unequal
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
old_passwords OFF
open_files_limit 2510
pid_file /var/lib/mysql/xxxxxx.pid
port 3306
preload_buffer_size 32768
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_min_res_unit 4096
query_cache_size 0
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 131072
read_only OFF
read_rnd_buffer_size 262144
relay_log_purge ON
relay_log_space_limit 0
rpl_recovery_rank 0
secure_auth OFF
server_id 0
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slave_net_timeout 3600
slave_transaction_retries 0
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 2097144
sql_mode
sql_notes OFF
sql_warnings OFF
storage_engine MyISAM
sync_binlog 0
sync_frm ON
sync_replication 0
sync_replication_slave_id 0
sync_replication_timeout 0
system_time_zone EDT
table_cache 64
table_type MyISAM
thread_cache_size 0
thread_stack 126976
time_format %H:%i:%s
time_zone SYSTEM
tmp_table_size 33554432
tmpdir
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
version 4.1.18-standard
version_comment MySQL Community Edition - Standard (GPL)
version_compile_machine i686
version_compile_os pc-linux-gnu
wait_timeout 28800


7. MySQL stats via vB admincp:

Help MySQL Status
Variable_name Value
Aborted_clients 4
Aborted_connects 172
Binlog_cache_disk_use 0
Binlog_cache_use 0
Bytes_received 2462139562
Bytes_sent 689301596
Com_admin_commands 0
Com_alter_db 0
Com_alter_table 5
Com_analyze 0
Com_backup_table 0
Com_begin 0
Com_change_db 1070444
Com_change_master 0
Com_check 748
Com_checksum 0
Com_commit 0
Com_create_db 0
Com_create_function 0
Com_create_index 0
Com_create_table 0
Com_dealloc_sql 0
Com_delete 21545
Com_delete_multi 0
Com_do 0
Com_drop_db 0
Com_drop_function 0
Com_drop_index 0
Com_drop_table 0
Com_drop_user 0
Com_execute_sql 0
Com_flush 2
Com_grant 5
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_help 0
Com_insert 271190
Com_insert_select 618
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 7906
Com_optimize 748
Com_preload_keys 0
Com_prepare_sql 0
Com_purge 0
Com_purge_before_date 0
Com_rename_table 0
Com_repair 0
Com_replace 35715
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 0
Com_revoke_all 0
Com_rollback 0
Com_savepoint 0
Com_select 7008542
Com_set_option 2758
Com_show_binlog_events 0
Com_show_binlogs 1
Com_show_charsets 12
Com_show_collations 12
Com_show_column_types 0
Com_show_create_db 3
Com_show_create_table 913
Com_show_databases 15
Com_show_errors 0
Com_show_fields 915
Com_show_grants 6
Com_show_innodb_status 0
Com_show_keys 25
Com_show_logs 0
Com_show_master_status 0
Com_show_ndb_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_privileges 0
Com_show_processlist 972
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 2
Com_show_storage_engines 0
Com_show_tables 1456
Com_show_variables 997
Com_show_warnings 0
Com_slave_start 0
Com_slave_stop 0
Com_stmt_close 0
Com_stmt_execute 0
Com_stmt_prepare 0
Com_stmt_reset 0
Com_stmt_send_long_data 0
Com_truncate 0
Com_unlock_tables 7905
Com_update 594355
Com_update_multi 442
Connections 902112
Created_tmp_disk_tables 12323
Created_tmp_files 97732
Created_tmp_tables 64226
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Flush_commands 1
Handler_commit 0
Handler_delete 109758
Handler_discover 0
Handler_read_first 1084411
Handler_read_key 114132263
Handler_read_next 2229568162
Handler_read_prev 3270087
Handler_read_rnd 716890515
Handler_read_rnd_next 113305020
Handler_rollback 0
Handler_update 28157950
Handler_write 1154330219
Key_blocks_not_flushed 0
Key_blocks_unused 406
Key_blocks_used 7248
Key_read_requests 352577738
Key_reads 5321236
Key_write_requests 644334
Key_writes 416896
Max_used_connections 27
Not_flushed_delayed_rows 0
Open_files 116
Open_streams 0
Open_tables 64
Opened_tables 286390
Qcache_free_blocks 0
Qcache_free_memory 0
Qcache_hits 0
Qcache_inserts 0
Qcache_lowmem_prunes 0
Qcache_not_cached 0
Qcache_queries_in_cache 0
Qcache_total_blocks 0
Questions 9930335
Rpl_status NULL
Select_full_join 5203
Select_full_range_join 0
Select_range 1677156
Select_range_check 0
Select_scan 1466506
Slave_open_temp_tables 0
Slave_retried_transactions 0
Slave_running OFF
Slow_launch_threads 1
Slow_queries 48
Sort_merge_passes 68149
Sort_range 876333
Sort_rows 1969327871
Sort_scan 247912
Table_locks_immediate 11619311
Table_locks_waited 21926
Threads_cached 0
Threads_connected 6
Threads_created 902111
Threads_running 2
Uptime 291735


8. is your vB the only thing on the server? or other scripts & sites which utilise php and mysql?
One vb (850,000 posts, 38,000 members) and one photopost (40,000 photos)

9. how many average and max concurrent users on your vB forum ? and what your cookie timeout is ?
Average 350, max. 1,300. Cookie timeout of 1,200 seconds.

10.

11. if you run Apache and you have your own dedicated server or access to your httpd.conf (apache configuration file) can you post the values you have set for the following :
KeepAlive: KeepAlive On
MaxKeepAliveRequests: MaxKeepAliveRequests 100
KeepAliveTimeout: KeepAliveTimeout 15
MinSpareServers: MinSpareServers 5
MaxSpareServers: MaxSpareServers 10
StartServers: StartServers 5
MaxClients: MaxClients 150
AND Maxrequestsperchild value = MaxRequestsPerChild 0

12. what version of vB are you running ?
vb3.5.4

13. check to see if any files i.e. apache log files are hitting 2GB or 4GB max file size limits i.e. see if you have max file size exceeded messages in apache error log
None hits 2GB.

eva2000
Sun 23rd Apr '06, 10:41am
1. Edit /etc/my.cnf and place the following mysql server settings in /etc/my.cnf and restart mysql server afterwards


[mysqld]
safe-show-database
back_log = 50
skip-innodb
max_connections = 500
key_buffer = 64M
myisam_sort_buffer_size = 64M
join_buffer_size = 1M
read_buffer_size = 1M
sort_buffer_size = 2M
table_cache = 1800
thread_cache_size = 384
wait_timeout = 60
connect_timeout = 10
tmp_table_size = 64M
max_heap_table_size = 64M
max_allowed_packet = 64M
max_connect_errors = 10
read_rnd_buffer_size = 524288
bulk_insert_buffer_size = 8M
query_cache_limit = 3M
query_cache_size = 80M
query_cache_type = 1
query_prealloc_size = 163840
query_alloc_block_size = 32768
default-storage-engine = MyISAM

[mysqld_safe]
open_files_limit = 8192

[mysqldump]
quick
max_allowed_packet = 16M

[myisamchk]
key_buffer = 64M
sort_buffer = 64M
read_buffer = 16M
write_buffer = 16M

[mysqlhotcopy]
interactive-timeout


2. Install APC Cache lastest version from http://pecl.php.net/package/APC. Read install guide at http://www.vbulletin.com/forum/showthread.php?t=165367 - please remove Zend Optimizer from php.ini before installing APC Cache

3. If you just upgraded to vB 3.5.x try to disable these 4 options:

Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

777333
Sun 23rd Apr '06, 12:22pm
Thank you George :)
I modified my.cnf and the server load is already around 1 instead of 2.
I have modified httpd.conf too: I put the setting posted at http://www.webhostingtalk.com/showthread.php?t=340239&highlight=my.cnf
I will try to install APC Cache now.
Thanks again for your help.

eva2000
Mon 24th Apr '06, 7:56am
no probs...excellent news :)