PDA

View Full Version : Optimization Request (utilizing excessive resources)


murrtex
Mon 27th Feb '06, 7:26am
my host says,
Your account is utilizing excessive resources, causing a significant
degradation of services on the server. This is a shared environment and we can
not allow one user to utilize the majority of the resources on a server as it
affects all users adversely. Because of this, you have been temporarily moved
to the *** server. A detail of the problem is shown below:

User | Domain | %CPU | %MEM | Mysql Processes
numturk2 4umturk.com 5.12 2.05 0.0
Top Process %CPU 99.9 /usr/bin/php
Top Process %CPU 97.5 /usr/bin/php
Top Process %CPU 96.7 /usr/bin/php

blap blap blap.......


I deleted old vb 3.5.3. version and my database and I installed fresh vb 3.5.4 and new database,and I moved only forum,user,thread and post tables,I have only 257 forums on my board


1. 300 accounts
2. 3.02GHz Dual Xeon
4GB
300GB HD
Redhat based Linux OS

my server configration is:

Server Type Linux
Web Server Apache v1.3.34 (cgi)
PHP 4.4.1
PHP Max Post Size 55.00 MB
PHP Maximum Upload Size 2.00 MB
PHP Memory Limit None
MySQL Version 4.0.25-standard
MySQL Packet Size 15.00 MB

Bandwidth per Month
400 GB/Month ,I use 3-5 GB per Month
host name:lunarpages.com

3. /etc/my.cnf


6. MySQL Variables
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set latin1
character_sets latin1 big5 czech euc_kr gb2312 gbk latin1_de sjis tis620 ujis dec8 dos german1 hp8 koi8_ru latin2 swe7 usa7 cp1251 danish hebrew win1251 estonia hungarian koi8_ukr win1251ukr greek win1250 croat cp1257 latin5
concurrent_insert ON
connect_timeout 5
convert_character_set
datadir /var/lib/mysql/
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_min_word_len 4
ft_max_word_len 254
ft_max_word_len_for_sort 20
ft_stopword_file (built-in)
have_bdb NO
have_crypt YES
have_innodb DISABLED
have_isam YES
have_raid NO
have_symlink YES
have_openssl NO
have_query_cache YES
init_file
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_size 8388608
innodb_data_file_path
innodb_data_home_dir
innodb_file_io_threads 4
innodb_force_recovery 0
innodb_thread_concurrency 8
innodb_flush_log_at_trx_commit 1
innodb_fast_shutdown ON
innodb_flush_method
innodb_lock_wait_timeout 50
innodb_log_arch_dir
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir
innodb_mirrored_log_groups 1
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_table_locks ON
interactive_timeout 28800
join_buffer_size 131072
key_buffer_size 67108864
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_update OFF
log_bin OFF
log_slave_updates OFF
log_slow_queries OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 15727616
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connections 1500
max_connect_errors 100000
max_delayed_threads 20
max_insert_delayed_threads 20
max_heap_table_size 16777216
max_join_size 4294967295
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_user_connections 50
max_tmp_tables 32
max_write_lock_count 4294967295
myisam_max_extra_sort_file_size 268435456
myisam_max_sort_file_size 2147483647
myisam_repair_threads 1
myisam_recover_options OFF
myisam_sort_buffer_size 8388608
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
open_files_limit 8096
pid_file /var/lib/mysql/arneb.lunarpages.com.pid
log_error
port 3306
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_size 33554432
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 1044480
read_only OFF
read_rnd_buffer_size 262144
rpl_recovery_rank 0
server_id 0
slave_net_timeout 3600
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 4194296
sql_mode 0
table_cache 256
table_type MYISAM
thread_cache_size 0
thread_stack 126976
tx_isolation REPEATABLE-READ
timezone PST
tmp_table_size 33554432
tmpdir /tmp/
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
version 4.0.25-standard
version_comment Official MySQL RPM
version_compile_os pc-linux-gnu
wait_timeout 200


7. MySQL Status
Aborted_clients 772
Aborted_connects 138
Bytes_received 2893072751
Bytes_sent 1442845732
Com_admin_commands 5466
Com_alter_table 18
Com_analyze 0
Com_backup_table 0
Com_begin 0
Com_change_db 3421958
Com_change_master 0
Com_check 6
Com_commit 0
Com_create_db 5
Com_create_function 0
Com_create_index 0
Com_create_table 76
Com_delete 100800
Com_delete_multi 0
Com_drop_db 1
Com_drop_function 0
Com_drop_index 0
Com_drop_table 1
Com_flush 30
Com_grant 53
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_insert 895176
Com_insert_select 12728
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 15849
Com_optimize 26
Com_purge 0
Com_rename_table 0
Com_repair 0
Com_replace 25029
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 0
Com_rollback 0
Com_savepoint 0
Com_select 7457217
Com_set_option 337703
Com_show_binlog_events 0
Com_show_binlogs 6
Com_show_create 827
Com_show_databases 105
Com_show_fields 425
Com_show_grants 16
Com_show_keys 8
Com_show_logs 0
Com_show_master_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_processlist 751
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 752
Com_show_innodb_status 0
Com_show_tables 1065
Com_show_variables 130
Com_slave_start 0
Com_slave_stop 0
Com_truncate 0
Com_unlock_tables 15849
Com_update 2290396
Com_update_multi 327
Connections 899880
Created_tmp_disk_tables 4048
Created_tmp_tables 274808
Created_tmp_files 0
Delayed_insert_threads 0
Delayed_writes 0
Delayed_errors 0
Flush_commands 1
Handler_commit 0
Handler_delete 190612
Handler_read_first 335186
Handler_read_key 120476325
Handler_read_next 329968219
Handler_read_prev 833511
Handler_read_rnd 70921011
Handler_read_rnd_next 2416276865
Handler_rollback 0
Handler_update 4121859
Handler_write 18881321
Key_blocks_used 62345
Key_read_requests 351430022
Key_reads 116333
Key_write_requests 4360530
Key_writes 3218998
Max_used_connections 99
Not_flushed_key_blocks 0
Not_flushed_delayed_rows 0
Open_tables 256
Open_files 497
Open_streams 0
Opened_tables 13477
Questions 22919774
Qcache_queries_in_cache 2888
Qcache_inserts 6751081
Qcache_hits 7437207
Qcache_lowmem_prunes 87071
Qcache_not_cached 706118
Qcache_free_memory 12360552
Qcache_free_blocks 1974
Qcache_total_blocks 9115
Rpl_status NULL
Select_full_join 1548
Select_full_range_join 29
Select_range 370225
Select_range_check 0
Select_scan 4552070
Slave_open_temp_tables 0
Slave_running OFF
Slow_launch_threads 3
Slow_queries 21
Sort_merge_passes 0
Sort_range 316446
Sort_rows 129849024
Sort_scan 359929
Table_locks_immediate 12191208
Table_locks_waited 149989
Threads_cached 0
Threads_created 899879
Threads_connected 9
Threads_running 4
Uptime 225403


9. cookie timeout 1800 seconds, 20 or 40 user online on my forum
10. http://www.4umturk.com/phpinfo.php (http://www.4umturk.com/phpinfo.php)
12.and my vb version 3.5.4

Today;
User | Domain | %CPU | %MEM | Mysql Processes
numturk2 4umturk.com 1.66 0.74 0.0
Top Process %CPU 72.0 /usr/bin/php
Top Process %CPU 47.0 /usr/bin/php
Top Process %CPU 40.0 [php ]


Best regards

eva2000
Mon 27th Feb '06, 8:33am
is this VPS a/c or just shared a/c as the entire server is only using 99 mysql concurrent connections... do you have the ability to recompile PHP and change mysql my.cnf settings ?

PHP would be better installed as ISAPI instead of CGI but ultimately your web hosts server is over crowded with 300 a/cs and they probably have to be strict on cpu usage

Ensure that usepconnect in vB config.php is set to 0 for disabled as well.

If you just upgraded to vB 3.5.x try to disable these 4 options:

Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

Probably just better to find a better host with less overcrowded server or less severe restrictions on your usage.

murrtex
Mon 27th Feb '06, 9:43am
yes thanks eva2000,all of them are closed I know..

I read and applied all things..And at the final I need server optimization.

and I have no ability mysql my.cnf settings ,my host will change.they are waiting your Optimization.you will suggest,I will sent and they will change

eva2000
Tue 28th Feb '06, 2:31am
For my.cnf try this


[mysqld]
safe-show-database
skip-innodb
max_connections = 1024
# personally get rid of max_user_connection
# but for shared hosting you might want to use such a limit
#max_user_connections 50
key_buffer = 256M
myisam_sort_buffer_size = 128M
join_buffer_size = 1M
read_buffer_size = 1M
sort_buffer_size = 3M
table_cache = 1800
thread_cache_size = 512
wait_timeout = 45
connect_timeout = 10
tmp_table_size = 256M
max_heap_table_size = 256M
max_allowed_packet = 64M
max_connect_errors = 10
read_rnd_buffer_size = 524288
bulk_insert_buffer_size = 8M
thread_concurrency = 4
query_cache_limit = 8M
query_cache_size = 128M
query_cache_type = 1
query_prealloc_size = 65536
query_alloc_block_size = 32768

[mysqld_safe]
open_files_limit = 8192

[mysqldump]
quick
max_allowed_packet = 16M

[myisamchk]
key_buffer = 64M
sort_buffer = 64M
read_buffer = 16M
write_buffer = 16M

[mysqlhotcopy]
interactive-timeout


you will end up using more memory for mysql which is what improves mysql's performance = more fast memory allocation + fast scsi 15k rpm disks in raid 10.

Install mysqlreport http://www.vbulletin.com/forum/showthread.php?t=175177 and run and post it's output before and after the new my.cnf is in place

murrtex
Tue 28th Feb '06, 5:37pm
thanks eva2000 I sent your suggestion to my host,I am waiting good news,I will return you.

murrtex
Tue 28th Feb '06, 6:10pm
bad news they said that
We cannot make these changes to the my.cnf file. As our my.cnf file works fine
with many other installation of vbulliten. Please let us know once you have
corrected the issue.


what will we do now?

murrtex
Tue 28th Feb '06, 6:10pm
...

eva2000
Tue 28th Feb '06, 11:01pm
i suggest you find a better web host then