andewy3k
Mon 11th Dec '06, 4:43pm
I am running a very new (3 months) but increasing FAST growing vbulletin community. About 25-100 new members a day. mySQL is very important as my forum is based around file attachments and has many of them (over 600 mb now). Currently have 4,350 members but concurrent connections can be anywhere from 30 - 500 depending the day. I have noticed that my ram usage tends to be over 90% to the point where usually there is only 40-20 megs left free. And my CPU tends to spike to 0.50 or sometimes more with nothing really going on in the forum.
(Please note: I am new to dedicated servers so I am not too familiar with certain things)
1. Is this on dedicated or shared virtual server. If shared, how many sites share this server (ask web host if needed)
Dedicated, only my vbulletin is on it.2. your server specs. For example:
Intel Celeron - 2.6GHz
1 GB RAM
80GB HD
Fedora Core 3
Apache 2.0 Handler
PHP version: 4.4.4
MySQL version: 4.0.27-standard
3. If you use mysql 4.x instead of mysql 3.23.x, do you have any innodb type databases/tables on your server ?
I don't think so, not that I am aware of.
4. if possible how mysql was compiled/installed
By my host. They setup everything for me.
5. Your top stats
Total Threads: 1,360 Total Posts: 3,344 Total Members: 4,303
6.
[mysqld]
safe-show-database
innodb_data_file_path=ibdata1:10M:autoextend
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
max_allowed_packet = 25M
wait_timeout = 5000
max_connections = 700
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
7.
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set latin1
character_sets latin1 big5 czech euc_kr gb2312 gbk latin1_de sjis tis620 ujis dec8 dos german1 hp8 koi8_ru latin2 swe7 usa7 cp1251 danish hebrew win1251 estonia hungarian koi8_ukr win1251ukr greek win1250 croat cp1257 latin5
concurrent_insert ON
connect_timeout 5
convert_character_set
datadir /var/lib/mysql/
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 254
ft_max_word_len_for_sort 20
ft_min_word_len 4
ft_stopword_file (built-in)
have_bdb NO
have_crypt YES
have_innodb YES
have_isam YES
have_openssl NO
have_query_cache YES
have_raid NO
have_symlink YES
init_file
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_size 8388608
innodb_data_file_path ibdata1:10M:autoextend
innodb_data_home_dir
innodb_fast_shutdown ON
innodb_file_io_threads 4
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_force_recovery 0
innodb_lock_wait_timeout 50
innodb_log_arch_dir ./
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_mirrored_log_groups 1
innodb_table_locks ON
innodb_thread_concurrency 8
interactive_timeout 28800
join_buffer_size 131072
key_buffer_size 8388600
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_bin OFF
log_error
log_slave_updates OFF
log_slow_queries OFF
log_update OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 26213376
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connect_errors 10
max_connections 700
max_delayed_threads 20
max_heap_table_size 16777216
max_insert_delayed_threads 20
max_join_size 4294967295
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 4294967295
myisam_max_extra_sort_file_size 268435456
myisam_max_sort_file_size 2147483647
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 8388608
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
open_files_limit 3510
pid_file /var/lib/mysql/server403.orbidish.com.pid
port 3306
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_size 0
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 131072
read_only OFF
read_rnd_buffer_size 262144
rpl_recovery_rank 0
server_id 0
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slave_net_timeout 3600
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 2097144
sql_mode 0
table_cache 64
table_type MYISAM
thread_cache_size 0
thread_stack 196608
timezone EST
tmp_table_size 33554432
tmpdir /tmp/
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
version 4.0.27-standard
version_comment Official MySQL RPM
version_compile_os pc-linux-gnu
wait_timeout 5000
Aborted_clients 0
Aborted_connects 3
Bytes_received 1958048
Bytes_sent 115886438
Com_admin_commands 0
Com_alter_table 0
Com_analyze 0
Com_backup_table 0
Com_begin 0
Com_change_db 469
Com_change_master 0
Com_check 0
Com_commit 0
Com_create_db 0
Com_create_function 0
Com_create_index 0
Com_create_table 0
Com_delete 35
Com_delete_multi 0
Com_drop_db 0
Com_drop_function 0
Com_drop_index 0
Com_drop_table 0
Com_flush 0
Com_grant 0
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_insert 175
Com_insert_select 0
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 0
Com_optimize 0
Com_purge 0
Com_rename_table 0
Com_repair 0
Com_replace 69
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 0
Com_rollback 0
Com_savepoint 0
Com_select 4460
Com_set_option 25
Com_show_binlog_events 0
Com_show_binlogs 0
Com_show_create 0
Com_show_databases 0
Com_show_fields 2
Com_show_grants 0
Com_show_innodb_status 0
Com_show_keys 2
Com_show_logs 0
Com_show_master_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_processlist 0
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 4
Com_show_tables 3
Com_show_variables 82
Com_slave_start 0
Com_slave_stop 0
Com_truncate 0
Com_unlock_tables 0
Com_update 451
Com_update_multi 0
Connections 396
Created_tmp_disk_tables 8
Created_tmp_files 3
Created_tmp_tables 428
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Flush_commands 1
Handler_commit 0
Handler_delete 18
Handler_read_first 1591
Handler_read_key 40306
Handler_read_next 54577
Handler_read_prev 464
Handler_read_rnd 6119
Handler_read_rnd_next 285423
Handler_rollback 25
Handler_update 534
Handler_write 2954
Key_blocks_used 1110
Key_read_requests 93406
Key_reads 1084
Key_write_requests 391
Key_writes 367
Max_used_connections 2
Not_flushed_delayed_rows 0
Not_flushed_key_blocks 0
Open_files 118
Open_streams 0
Open_tables 64
Opened_tables 278
Qcache_free_blocks 0
Qcache_free_memory 0
Qcache_hits 0
Qcache_inserts 0
Qcache_lowmem_prunes 0
Qcache_not_cached 0
Qcache_queries_in_cache 0
Qcache_total_blocks 0
Questions 6166
Rpl_status NULL
Select_full_join 6
Select_full_range_join 0
Select_range 1037
Select_range_check 0
Select_scan 652
Slave_open_temp_tables 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 0
Sort_merge_passes 0
Sort_range 395
Sort_rows 6082
Sort_scan 237
Table_locks_immediate 7793
Table_locks_waited 0
Threads_cached 0
Threads_connected 1
Threads_created 395
Threads_running 1
Uptime 2753
8. Is your vB the only thing on the server? or other scripts & sites which utilise php and mysql?
Just my VB and thats it..
9. How many average and max concurrent users on your vB forum ? and what your cookie timeout is ?
Average - 50
Max - 500
Cookie Timeout - 1200
10. http://203.121.69.155/phpinfo.php11.
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 15
StartServers 8
MinSpareServers 5
MaxSpareServers 20
ServerLimit 256
MaxClients 256
MaxRequestsPerChild 4000
12. what version of vB are you running ?
The newest v3.6.4
13.
This is what comes up...
find: /proc/5500/task/5500/fd/4: No such file or directory
find: /proc/5500/fd/4: No such file or directory
find: /var/named/run-root/proc/5500/task/5500/fd/4: No such file or directory
find: /var/named/run-root/proc/5500/fd/4: No such file or directory
14.
Linux server403.orbidish.com 2.6.12-2.3.legacy_FC3 #1 Sun Feb 19 07:48:10 EST 2006 i686 i686 i386 GNU/Linux
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
pending signals (-i) 15342
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 15342
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
processor : 0
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Celeron(R) CPU 2.66GHz
stepping : 9
cpu MHz : 2660.124
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm pni monitor ds_cpl tm2 cid cx16 xtpr lahf_lm
bogomips : 5259.26
(Please note: I am new to dedicated servers so I am not too familiar with certain things)
1. Is this on dedicated or shared virtual server. If shared, how many sites share this server (ask web host if needed)
Dedicated, only my vbulletin is on it.2. your server specs. For example:
Intel Celeron - 2.6GHz
1 GB RAM
80GB HD
Fedora Core 3
Apache 2.0 Handler
PHP version: 4.4.4
MySQL version: 4.0.27-standard
3. If you use mysql 4.x instead of mysql 3.23.x, do you have any innodb type databases/tables on your server ?
I don't think so, not that I am aware of.
4. if possible how mysql was compiled/installed
By my host. They setup everything for me.
5. Your top stats
Total Threads: 1,360 Total Posts: 3,344 Total Members: 4,303
6.
[mysqld]
safe-show-database
innodb_data_file_path=ibdata1:10M:autoextend
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
max_allowed_packet = 25M
wait_timeout = 5000
max_connections = 700
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
7.
back_log 50
basedir /
binlog_cache_size 32768
bulk_insert_buffer_size 8388608
character_set latin1
character_sets latin1 big5 czech euc_kr gb2312 gbk latin1_de sjis tis620 ujis dec8 dos german1 hp8 koi8_ru latin2 swe7 usa7 cp1251 danish hebrew win1251 estonia hungarian koi8_ukr win1251ukr greek win1250 croat cp1257 latin5
concurrent_insert ON
connect_timeout 5
convert_character_set
datadir /var/lib/mysql/
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
flush OFF
flush_time 0
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 254
ft_max_word_len_for_sort 20
ft_min_word_len 4
ft_stopword_file (built-in)
have_bdb NO
have_crypt YES
have_innodb YES
have_isam YES
have_openssl NO
have_query_cache YES
have_raid NO
have_symlink YES
init_file
innodb_additional_mem_pool_size 1048576
innodb_autoextend_increment 8
innodb_buffer_pool_size 8388608
innodb_data_file_path ibdata1:10M:autoextend
innodb_data_home_dir
innodb_fast_shutdown ON
innodb_file_io_threads 4
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_force_recovery 0
innodb_lock_wait_timeout 50
innodb_log_arch_dir ./
innodb_log_archive OFF
innodb_log_buffer_size 1048576
innodb_log_file_size 5242880
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_max_dirty_pages_pct 90
innodb_max_purge_lag 0
innodb_mirrored_log_groups 1
innodb_table_locks ON
innodb_thread_concurrency 8
interactive_timeout 28800
join_buffer_size 131072
key_buffer_size 8388600
language /usr/share/mysql/english/
large_files_support ON
license GPL
local_infile ON
locked_in_memory OFF
log OFF
log_bin OFF
log_error
log_slave_updates OFF
log_slow_queries OFF
log_update OFF
log_warnings 1
long_query_time 10
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
max_allowed_packet 26213376
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connect_errors 10
max_connections 700
max_delayed_threads 20
max_heap_table_size 16777216
max_insert_delayed_threads 20
max_join_size 4294967295
max_relay_log_size 0
max_seeks_for_key 4294967295
max_sort_length 1024
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 4294967295
myisam_max_extra_sort_file_size 268435456
myisam_max_sort_file_size 2147483647
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 8388608
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
open_files_limit 3510
pid_file /var/lib/mysql/server403.orbidish.com.pid
port 3306
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_size 0
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 2048
read_buffer_size 131072
read_only OFF
read_rnd_buffer_size 262144
rpl_recovery_rank 0
server_id 0
skip_external_locking ON
skip_networking OFF
skip_show_database OFF
slave_net_timeout 3600
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer_size 2097144
sql_mode 0
table_cache 64
table_type MYISAM
thread_cache_size 0
thread_stack 196608
timezone EST
tmp_table_size 33554432
tmpdir /tmp/
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
version 4.0.27-standard
version_comment Official MySQL RPM
version_compile_os pc-linux-gnu
wait_timeout 5000
Aborted_clients 0
Aborted_connects 3
Bytes_received 1958048
Bytes_sent 115886438
Com_admin_commands 0
Com_alter_table 0
Com_analyze 0
Com_backup_table 0
Com_begin 0
Com_change_db 469
Com_change_master 0
Com_check 0
Com_commit 0
Com_create_db 0
Com_create_function 0
Com_create_index 0
Com_create_table 0
Com_delete 35
Com_delete_multi 0
Com_drop_db 0
Com_drop_function 0
Com_drop_index 0
Com_drop_table 0
Com_flush 0
Com_grant 0
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_insert 175
Com_insert_select 0
Com_kill 0
Com_load 0
Com_load_master_data 0
Com_load_master_table 0
Com_lock_tables 0
Com_optimize 0
Com_purge 0
Com_rename_table 0
Com_repair 0
Com_replace 69
Com_replace_select 0
Com_reset 0
Com_restore_table 0
Com_revoke 0
Com_rollback 0
Com_savepoint 0
Com_select 4460
Com_set_option 25
Com_show_binlog_events 0
Com_show_binlogs 0
Com_show_create 0
Com_show_databases 0
Com_show_fields 2
Com_show_grants 0
Com_show_innodb_status 0
Com_show_keys 2
Com_show_logs 0
Com_show_master_status 0
Com_show_new_master 0
Com_show_open_tables 0
Com_show_processlist 0
Com_show_slave_hosts 0
Com_show_slave_status 0
Com_show_status 4
Com_show_tables 3
Com_show_variables 82
Com_slave_start 0
Com_slave_stop 0
Com_truncate 0
Com_unlock_tables 0
Com_update 451
Com_update_multi 0
Connections 396
Created_tmp_disk_tables 8
Created_tmp_files 3
Created_tmp_tables 428
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Flush_commands 1
Handler_commit 0
Handler_delete 18
Handler_read_first 1591
Handler_read_key 40306
Handler_read_next 54577
Handler_read_prev 464
Handler_read_rnd 6119
Handler_read_rnd_next 285423
Handler_rollback 25
Handler_update 534
Handler_write 2954
Key_blocks_used 1110
Key_read_requests 93406
Key_reads 1084
Key_write_requests 391
Key_writes 367
Max_used_connections 2
Not_flushed_delayed_rows 0
Not_flushed_key_blocks 0
Open_files 118
Open_streams 0
Open_tables 64
Opened_tables 278
Qcache_free_blocks 0
Qcache_free_memory 0
Qcache_hits 0
Qcache_inserts 0
Qcache_lowmem_prunes 0
Qcache_not_cached 0
Qcache_queries_in_cache 0
Qcache_total_blocks 0
Questions 6166
Rpl_status NULL
Select_full_join 6
Select_full_range_join 0
Select_range 1037
Select_range_check 0
Select_scan 652
Slave_open_temp_tables 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 0
Sort_merge_passes 0
Sort_range 395
Sort_rows 6082
Sort_scan 237
Table_locks_immediate 7793
Table_locks_waited 0
Threads_cached 0
Threads_connected 1
Threads_created 395
Threads_running 1
Uptime 2753
8. Is your vB the only thing on the server? or other scripts & sites which utilise php and mysql?
Just my VB and thats it..
9. How many average and max concurrent users on your vB forum ? and what your cookie timeout is ?
Average - 50
Max - 500
Cookie Timeout - 1200
10. http://203.121.69.155/phpinfo.php11.
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 15
StartServers 8
MinSpareServers 5
MaxSpareServers 20
ServerLimit 256
MaxClients 256
MaxRequestsPerChild 4000
12. what version of vB are you running ?
The newest v3.6.4
13.
This is what comes up...
find: /proc/5500/task/5500/fd/4: No such file or directory
find: /proc/5500/fd/4: No such file or directory
find: /var/named/run-root/proc/5500/task/5500/fd/4: No such file or directory
find: /var/named/run-root/proc/5500/fd/4: No such file or directory
14.
Linux server403.orbidish.com 2.6.12-2.3.legacy_FC3 #1 Sun Feb 19 07:48:10 EST 2006 i686 i686 i386 GNU/Linux
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
pending signals (-i) 15342
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
stack size (kbytes, -s) unlimited
cpu time (seconds, -t) unlimited
max user processes (-u) 15342
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
processor : 0
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Celeron(R) CPU 2.66GHz
stepping : 9
cpu MHz : 2660.124
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm pni monitor ds_cpl tm2 cid cx16 xtpr lahf_lm
bogomips : 5259.26