site slow, need help on finding problem..

[Paprika]

Hello everyone,

I run a small sized community.(Threads: 15,131, Posts: 183,079, Members: 2,729, Active Members: 172 ). However, I have a problem with my site running slow periodically throught the day. Members notice it all the time and they complain and get fustrated. I notice it too. My site is on a VPS I have, and I've tried contacting my host about it but at the time(s) I did, I had not additional information such as times of day of slowness, number of users online, ect.. so they basically said there wasn't anything they could do. Since then I have been logging site performace here and there.
I come to you today to get help solving my problem so my users will be happy.

My VPS:
Virtuozzo/WHM/Cpanel
PHP 4.4.1
Apache 1.3.34 (Unix)
MySQL 4.1.21-standard

Here is my little log... each line takes note of the Server Load reported by the top command| server load, # of users reported by vbulletin | my rating of the performance | time of day (EST)
Server Load Averages 1.29 0.36 0.14 | 15 Users Online (6 members and 9 guests) | GOOD | 12:21PM
load average: 0.14, 0.08, 0.01 | Server Load Averages 0.29 0.11 0.02 | 15 Users Online (10 members and 5 guests) | GOOD | 2:31PM
load average: 0.03, 0.03, 0.00 | Server Load Averages 0.46 0.13 0.03 | 18 Users Online (7 members and 11 guests) | Great| 2:46PM
load average: 0.42, 0.18, 0.17 | Server Load Averages 0.76 0.31 0.21 | 7 Users Online (6 members and 1 guests) | Okay.. | 2:06 AM
Server Load Averages 2.57 2.10 1.16 | 9 Users Online (7 members and 2 guests) | BAD - SSH ACCESS DENIED | 11:31 AM
Server Load Averages 1.51 1.66 1.43 | 12 Users Online (6 members and 6 guests) | NOT TOO GOOD | 11:53 AM
load average: 2.82, 2.10, 2.88 | Server Load Averages 3.41 2.52 2.79 | 13 Users Online (10 members and 3 guests) | BAD | 12:00PM
load average: 0.70, 1.33, 1.80 | 1.79 1.71 1.97 | 10 Users Online (7 members and 3 guests) | OKAY | 12:28PM
load average: 0.36, 0.22, 0.36 | 0.50 0.25 0.37 | 16 Users Online (11 members and 5 guests) | FINE | 12:58PM
load average: 0.62, 0.52, 0.39 | .78 0.56 0.40 | 5 Users Online (4 members and 1 guests) | NOT SO GOOD | 10:58 PM
load average: 2.49, 1.74, 1.04 | 2.18 1.78 1.20 | 9 Users Online (4 members and 5 guests) | POOR | 12:13 PM EST
load average: 0.80, 0.22, 0.07 | 0.60 0.24 0.08 | 15 Users Online (6 members and 9 guests) | NOT TOOOO BAD | 9:36 AM
load average: 0.08, 0.04, 0.15 | 0.19 0.07 0.16 | 9 Users Online (4 members and 5 guests) | OKAY | 2:18PM EST
load average: 0.19, 0.17, 0.07 | 0.37 0.21 0.08 | 11 Users Online (6 members and 5 guests) | GOOD | 11:19 AM
load average: 0.53, 0.20, 0.12 |0.60 0.26 0.14 | 15 Users Online (12 members and 3 guests) | OKAY | 2:25 PM
load average: 1.76, 1.77, 1.36 | 1.94 1.83 1.43 | 8 Users Online (6 members and 2 guests) | Not too hott |

If you look, the server load averages are independent of the number of users online.
The loads are consistantly high over the 1, 5, and 15 minute intervals, which indicants the server's CPU is overloaded.


What should I do first to solve this problem that isn't going to be impossibly or extremely difficult?

Thanks for your time

[Paprika]

Help??

[Steve Machol]

For help with optimizing your server, please see this thread:

http://www.vbulletin.com/forum/showthread.php?threadid=70117

Then post the requested info in a new thread in that forum.

[Paprika]

For help with optimizing your server, please see this thread:

http://www.vbulletin.com/forum/showthread.php?threadid=70117

Then post the requested info in a new thread in that forum.

Well okay, I will do that, but does my problem sound like a simple need for optimization or could there be a seriously problem with the server? Because as you can see it's not like more users cause it to have problems. It does it more like at random almost..

[Lats]

It really depends on what the users are doing when the loads are higher (which aren't that high btw) - are they all searching for something, posting etc?

Are there any other accounts on the vps? Perhaps it's running low on memory.

[Paprika]

within the vps itself there is only one account, and that account only has one website, mine. The entire VPS is dedicated to my site lol

however, as you know, being a vps, there should be other VPSes on the actual physical server, how many though... i dunno.

These occourances of slowness last for a while, and searches usually don't take longer than 30 seconds each anyway, so I'm not sure they'll all searching at the same time and causing the site to be slow for 20+ minutes.

[Lats]

20 minutes is quite a long time to recover!

It may be worthwhile doing a 'whos online' and watching them :)

[Paprika]

Hey guys, I am back with the same issue as before.
After having tried eva2000's customized optimization tips for my VPS I am still having the intermittant slowness from the server..

I was getting ready to contact my host today about the problem as my final resort or whatever when I decided I really really want to make sure I cover ALL of my bases before I presented them with this issue that could be a pain-in-the-arse to fix.

Attached is the email I was going to send to them, it kinda gives a good idea of whats been going on and what I've done so far.

If you could give me any idea, tips, clues, other websites to try... ANYTHING, I'd appreciate it!! Thank you :)

[Paprika]

BUMP for helP!!

[eva2000]

refresh my memory as to what i recommended for optimisations as they're not listed in this thread

also repost all info asked at http://www.vbulletin.com/forum/showthread.php?t=70117 after you implemented my suggestions

[Paprika]

Okay, here is my optimization request thread. If you could look here for a sec you'll see my original configuration and what specs I knew, and then your configuration suggestions: http://www.vbulletin.com/forum/showthread.php?t=197788

Okay, and below is the requested information after having implemented the changes:
1) This is a VPS.
2) Server Specs: Dual Opteron 242 @ 800Mhz each - 128Mb Ram burstable to 1Gb - 7.0Gb Unknown type -RedHat 9 i686 - Apache/1.3.37 - PHP Version 4.4.4 -MySQL/4.1.21
3) No innodb type databases/tables.
4) I don't even remember how I upgraded it last time and before that I don't know how it was installed.
5) TOP STATS: 22:21:18 up 14 days, 3:09, 1 user, load average: 0.12, 0.14, 0.15
85 processes: 84 sleeping, 1 running, 0 zombie, 0 stopped
CPU0 states: 0.0% user 0.1% system 0.0% nice 0.0% iowait 99.4% idle
CPU1 states: 0.1% user 0.0% system 0.0% nice 0.0% iowait 99.4% idle
Mem: 3630040k av, 3622664k used, 7376k free, 0k shrd, 17972k buff
2764728k active, 230612k inactive
Swap: 8193140k av, 2553144k used, 5639996k free 918012k cached

PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
1 root 16 0 1308 444 1276 S 0.0 0.0 0:00 0 init
14143 root 16 0 1372 524 1320 S 0.0 0.0 0:00 0 syslogd
15403 named 18 0 14852 2264 4676 S 0.0 0.0 0:00 1 named
15720 root 16 0 3456 1112 3348 S 0.0 0.0 0:00 1 sshd
15875 root 16 0 1976 724 1684 S 0.0 0.0 0:00 0 xinetd
17982 root 16 0 9620 2600 2628 S 0.0 0.0 0:00 0 chkservd
20291 root 16 0 45212 3364 43856 S 0.0 0.0 0:00 1 httpd
20348 root 15 0 1364 580 1316 S 0.0 0.0 0:00 1 crond
24186 root 16 0 5704 1048 5348 S 0.0 0.0 0:00 0 pure-ftpd
24189 root 16 0 3344 656 3132 S 0.0 0.0 0:00 0 pure-authd
25661 root 35 19 11568 5508 4180 S N 0.0 0.1 0:00 1 cpanellogd
26023 cpanel 15 0 6196 2076 3392 S 0.0 0.0 0:00 1 stunnel-4.15loc
30182 mailman 16 0 8936 2096 5412 S 0.0 0.0 0:00 1 mailmanctl
30216 mailman 16 0 8876 1880 5364 S 0.0 0.0 0:00 0 python2.4
30332 root 18 0 1328 392 1284 S 0.0 0.0 0:00 0 portsentry
19550 root 17 0 2052 880 1936 S 0.0 0.0 0:00 1 mysqld_safe
19717 mysql 15 0 91728 35M 6368 S 0.0 1.0 0:00 1 mysqld
3420 mailnull 16 0 6640 1520 6008 S 0.0 0.0 0:00 0 exim
3426 mailnull 18 0 6604 1436 6008 S 0.0 0.0 0:00 0 exim
3464 root 16 0 2740 1328 2344 S 0.0 0.0 0:00 0 antirelayd
31868 root 16 0 10320 3232 7952 S 0.0 0.0 0:00 1 cppop
7748 root 16 0 12128 7580 9532 S 0.0 0.2 0:00 1 cpsrvd
18243 root 16 0 2224 1312 1936 S 0.0 0.0 0:00 1 bash
1702 root 16 0 1804 964 1644 R 0.0 0.0 0:00 0 top



6) /etc/my.cnf :
[mysqld]
#datadir=/var/lib/mysql
#socket=/var/lib/mysql/mysql.sock
skip-locking
skip-innodb
query_cache_limit=1M
query_cache_size=32M
query_cache_type=1
max_connections=500
interactive_timeout=100
wait_timeout=100
connect_timeout=10
thread_cache_size=128
key_buffer=16M
join_buffer=1M
max_allowed_packet=16M
table_cache=1024
record_buffer=1M
sort_buffer_size=2M
read_buffer_size=2M
max_connect_errors=10
# Try number of CPU's*2 for thread_concurrency
thread_concurrency=4
myisam_sort_buffer_size=64M
log-bin
server-id=1
[mysql.server]
user=mysql
basedir=/var/lib
old-passwords = 1
[safe_mysqld]
err-log=/var/log/mysqld.log
#pid-file=/var/lib/mysql/mysql.pid
open_files_limit=8192
[mysqldump]
quick
max_allowed_packet=16M
[mysql]
no-auto-rehash
#safe-updates
[isamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[myisamchk]
key_buffer=64M
sort_buffer=64M
read_buffer=16M
write_buffer=16M
[mysqlhotcopy]
interactive-timeout


7) MySQL stats from ssh telnet as root user type:

+---------------------------------+------------------------------------------+
| Variable_name | Value |
+---------------------------------+------------------------------------------+
| back_log | 50 |
| basedir | / |
| binlog_cache_size | 32768 |
| bulk_insert_buffer_size | 8388608 |
| character_set_client | latin1 |
| character_set_connection | latin1 |
| character_set_database | latin1 |
| character_set_results | latin1 |
| character_set_server | latin1 |
| character_set_system | utf8 |
| character_sets_dir | /usr/share/mysql/charsets/ |
| collation_connection | latin1_swedish_ci |
| collation_database | latin1_swedish_ci |
| collation_server | latin1_swedish_ci |
| concurrent_insert | ON |
| connect_timeout | 10 |
| datadir | /var/lib/mysql/ |
| date_format | %Y-%m-%d |
| datetime_format | %Y-%m-%d %H:%i:%s |
| default_week_format | 0 |
| delay_key_write | ON |
| delayed_insert_limit | 100 |
| delayed_insert_timeout | 300 |
| delayed_queue_size | 1000 |
| expire_logs_days | 0 |
| flush | OFF |
| flush_time | 0 |
| ft_boolean_syntax | + -><()~*:""&| |
| ft_max_word_len | 84 |
| ft_min_word_len | 4 |
| ft_query_expansion_limit | 20 |
| ft_stopword_file | (built-in) |
| group_concat_max_len | 1024 |
| have_archive | NO |
| have_bdb | NO |
| have_blackhole_engine | NO |
| have_compress | YES |
| have_crypt | YES |
| have_csv | NO |
| have_example_engine | NO |
| have_geometry | YES |
| have_innodb | DISABLED |
| have_isam | NO |
| have_ndbcluster | NO |
| have_merge_engine | YES |
| have_openssl | NO |
| have_query_cache | YES |
| have_raid | NO |
| have_rtree_keys | YES |
| have_symlink | YES |
| init_connect | |
| init_file | |
| init_slave | |
| innodb_additional_mem_pool_size | 1048576 |
| innodb_autoextend_increment | 8 |
| innodb_buffer_pool_awe_mem_mb | 0 |
| innodb_buffer_pool_size | 8388608 |
| innodb_data_file_path | |
| innodb_data_home_dir | |
| innodb_fast_shutdown | ON |
| innodb_file_io_threads | 4 |
| innodb_file_per_table | OFF |
| innodb_flush_log_at_trx_commit | 1 |
| innodb_flush_method | |
| innodb_force_recovery | 0 |
| innodb_lock_wait_timeout | 50 |
| innodb_locks_unsafe_for_binlog | OFF |
| innodb_log_arch_dir | |
| innodb_log_archive | OFF |
| innodb_log_buffer_size | 1048576 |
| innodb_log_file_size | 5242880 |
| innodb_log_files_in_group | 2 |
| innodb_log_group_home_dir | |
| innodb_max_dirty_pages_pct | 90 |
| innodb_max_purge_lag | 0 |
| innodb_mirrored_log_groups | 1 |
| innodb_open_files | 300 |
| innodb_table_locks | ON |
| innodb_thread_concurrency | 8 |
| interactive_timeout | 100 |
| join_buffer_size | 1044480 |
| key_buffer_size | 16777216 |
| key_cache_age_threshold | 300 |
| key_cache_block_size | 1024 |
| key_cache_division_limit | 100 |
| language | /usr/share/mysql/english/ |
| large_files_support | ON |
| lc_time_names | en_US |
| license | GPL |
| local_infile | ON |
| locked_in_memory | OFF |
| log | OFF |
| log_bin | ON |
| log_error | |
| log_slave_updates | OFF |
| log_slow_queries | OFF |
| log_update | OFF |
| log_warnings | 1 |
| long_query_time | 10 |
| low_priority_updates | OFF |
| lower_case_file_system | OFF |
| lower_case_table_names | 0 |
| max_allowed_packet | 16776192 |
| max_binlog_cache_size | 4294967295 |
| max_binlog_size | 1073741824 |
| max_connect_errors | 10 |
| max_connections | 500 |
| max_delayed_threads | 20 |
| max_error_count | 64 |
| max_heap_table_size | 16777216 |
| max_insert_delayed_threads | 20 |
| max_join_size | 4294967295 |
| max_length_for_sort_data | 1024 |
| max_prepared_stmt_count | 16382 |
| max_relay_log_size | 0 |
| max_seeks_for_key | 4294967295 |
| max_sort_length | 1024 |
| max_tmp_tables | 32 |
| max_user_connections | 0 |
| max_write_lock_count | 4294967295 |
| myisam_data_pointer_size | 4 |
| myisam_max_extra_sort_file_size | 2147483648 |
| myisam_max_sort_file_size | 2147483647 |
| myisam_recover_options | OFF |
| myisam_repair_threads | 1 |
| myisam_sort_buffer_size | 67108864 |
| myisam_stats_method | nulls_unequal |
| net_buffer_length | 16384 |
| net_read_timeout | 30 |
| net_retry_count | 10 |
| net_write_timeout | 60 |
| new | OFF |
| old_passwords | OFF |
| open_files_limit | 10000 |
| pid_file | /var/lib/mysql/server.teen-moods.net.pid |
| port | 3306 |
| preload_buffer_size | 32768 |
| prepared_stmt_count | 0 |
| protocol_version | 10 |
| query_alloc_block_size | 8192 |
| query_cache_limit | 1048576 |
| query_cache_min_res_unit | 4096 |
| query_cache_size | 33554432 |
| query_cache_type | ON |
| query_cache_wlock_invalidate | OFF |
| query_prealloc_size | 8192 |
| range_alloc_block_size | 2048 |
| read_buffer_size | 2093056 |
| read_only | OFF |
| read_rnd_buffer_size | 262144 |
| relay_log_purge | ON |
| relay_log_space_limit | 0 |
| rpl_recovery_rank | 0 |
| secure_auth | OFF |
| server_id | 1 |
| skip_external_locking | ON |
| skip_networking | OFF |
| skip_show_database | OFF |
| slave_net_timeout | 3600 |
| slave_transaction_retries | 0 |
| slow_launch_time | 2 |
| socket | /var/lib/mysql/mysql.sock |
| sort_buffer_size | 2097144 |
| sql_mode | |
| sql_notes | ON |
| sql_warnings | ON |
| storage_engine | MyISAM |
| sync_binlog | 0 |
| sync_frm | ON |
| sync_replication | 0 |
| sync_replication_slave_id | 0 |
| sync_replication_timeout | 0 |
| system_time_zone | EDT |
| table_cache | 1024 |
| table_type | MyISAM |
| thread_cache_size | 128 |
| thread_stack | 196608 |
| time_format | %H:%i:%s |
| time_zone | SYSTEM |
| tmp_table_size | 33554432 |
| tmpdir | |
| transaction_alloc_block_size | 8192 |
| transaction_prealloc_size | 4096 |
| tx_isolation | REPEATABLE-READ |
| version | 4.1.21-standard-log |
| version_comment | MySQL Community Edition - Standard (GPL) |
| version_compile_machine | i686 |
| version_compile_os | pc-linux-gnu |
| wait_timeout | 100 |
+---------------------------------+------------------------------------------+
+----------------------------+----------+
| Variable_name | Value |
+----------------------------+----------+
| Aborted_clients | 0 |
| Aborted_connects | 0 |
| Binlog_cache_disk_use | 0 |
| Binlog_cache_use | 0 |
| Bytes_received | 40096 |
| Bytes_sent | 35018 |
| Com_admin_commands | 0 |
| Com_alter_db | 0 |
| Com_alter_table | 33 |
| Com_analyze | 0 |
| Com_backup_table | 0 |
| Com_begin | 3 |
| Com_change_db | 37 |
| Com_change_master | 0 |
| Com_check | 0 |
| Com_checksum | 0 |
| Com_commit | 3 |
| Com_create_db | 1 |
| Com_create_function | 0 |
| Com_create_index | 42 |
| Com_create_table | 22 |
| Com_dealloc_sql | 0 |
| Com_delete | 1 |
| Com_delete_multi | 0 |
| Com_do | 0 |
| Com_drop_db | 0 |
| Com_drop_function | 0 |
| Com_drop_index | 0 |
| Com_drop_table | 0 |
| Com_drop_user | 0 |
| Com_execute_sql | 0 |
| Com_flush | 2 |
| Com_grant | 22 |
| Com_ha_close | 0 |
| Com_ha_open | 0 |
| Com_ha_read | 0 |
| Com_help | 0 |
| Com_insert | 122 |
| Com_insert_select | 0 |
| Com_kill | 0 |
| Com_load | 0 |
| Com_load_master_data | 0 |
| Com_load_master_table | 0 |
| Com_lock_tables | 0 |
| Com_optimize | 0 |
| Com_preload_keys | 0 |
| Com_prepare_sql | 0 |
| Com_purge | 0 |
| Com_purge_before_date | 0 |
| Com_rename_table | 0 |
| Com_repair | 0 |
| Com_replace | 5 |
| Com_replace_select | 0 |
| Com_reset | 0 |
| Com_restore_table | 0 |
| Com_revoke | 0 |
| Com_revoke_all | 0 |
| Com_rollback | 0 |
| Com_savepoint | 0 |
| Com_select | 21 |
| Com_set_option | 1 |
| Com_show_binlog_events | 0 |
| Com_show_binlogs | 0 |
| Com_show_charsets | 0 |
| Com_show_collations | 0 |
| Com_show_column_types | 0 |
| Com_show_create_db | 0 |
| Com_show_create_table | 0 |
| Com_show_databases | 0 |
| Com_show_errors | 0 |
| Com_show_fields | 0 |
| Com_show_grants | 0 |
| Com_show_innodb_status | 0 |
| Com_show_keys | 0 |
| Com_show_logs | 0 |
| Com_show_master_status | 0 |
| Com_show_ndb_status | 0 |
| Com_show_new_master | 0 |
| Com_show_open_tables | 0 |
| Com_show_privileges | 0 |
| Com_show_processlist | 0 |
| Com_show_slave_hosts | 0 |
| Com_show_slave_status | 0 |
| Com_show_status | 4 |
| Com_show_storage_engines | 0 |
| Com_show_tables | 0 |
| Com_show_variables | 2 |
| Com_show_warnings | 0 |
| Com_slave_start | 0 |
| Com_slave_stop | 0 |
| Com_stmt_close | 0 |
| Com_stmt_execute | 0 |
| Com_stmt_prepare | 0 |
| Com_stmt_reset | 0 |
| Com_stmt_send_long_data | 0 |
| Com_truncate | 0 |
| Com_unlock_tables | 0 |
| Com_update | 2 |
| Com_update_multi | 0 |
| Connections | 26 |
| Created_tmp_disk_tables | 2 |
| Created_tmp_files | 0 |
| Created_tmp_tables | 2 |
| Delayed_errors | 0 |
| Delayed_insert_threads | 0 |
| Delayed_writes | 0 |
| Flush_commands | 1 |
| Handler_commit | 0 |
| Handler_delete | 0 |
| Handler_discover | 0 |
| Handler_read_first | 15 |
| Handler_read_key | 52 |
| Handler_read_next | 48 |
| Handler_read_prev | 0 |
| Handler_read_rnd | 2 |
| Handler_read_rnd_next | 190 |
| Handler_rollback | 0 |
| Handler_update | 24 |
| Handler_write | 157 |
| Key_blocks_not_flushed | 0 |
| Key_blocks_unused | 14482 |
| Key_blocks_used | 15 |
| Key_read_requests | 351 |
| Key_reads | 17 |
| Key_write_requests | 63 |
| Key_writes | 5 |
| Max_used_connections | 2 |
| Not_flushed_delayed_rows | 0 |
| Open_files | 40 |
| Open_streams | 0 |
| Open_tables | 19 |
| Opened_tables | 58 |
| Qcache_free_blocks | 1 |
| Qcache_free_memory | 33523896 |
| Qcache_hits | 6 |
| Qcache_inserts | 16 |
| Qcache_lowmem_prunes | 0 |
| Qcache_not_cached | 5 |
| Qcache_queries_in_cache | 16 |
| Qcache_total_blocks | 41 |
| Questions | 351 |
| Rpl_status | NULL |
| Select_full_join | 0 |
| Select_full_range_join | 0 |
| Select_range | 0 |
| Select_range_check | 0 |
| Select_scan | 1 |
| Slave_open_temp_tables | 0 |
| Slave_retried_transactions | 0 |
| Slave_running | OFF |
| Slow_launch_threads | 0 |
| Slow_queries | 0 |
| Sort_merge_passes | 0 |
| Sort_range | 1 |
| Sort_rows | 0 |
| Sort_scan | 2 |
| Table_locks_immediate | 288 |
| Table_locks_waited | 0 |
| Threads_cached | 1 |
| Threads_connected | 1 |
| Threads_created | 2 |
| Threads_running | 1 |
| Uptime | 159 |
+----------------------------+----------+
Uptime: 159 Threads: 1 Questions: 352 Slow queries: 0 Opens: 58 Flush tables: 1 Open tables: 19 Queries per second avg: 2.214
mysqladmin Ver 8.41 Distrib 4.1.21, for pc-linux-gnu on i686
Copyright (C) 2000 MySQL AB & MySQL Finland AB & TCX DataKonsult AB
This software comes with ABSOLUTELY NO WARRANTY. This is free software,
and you are welcome to modify and redistribute it under the GPL license
Server version 4.1.21-standard-log
Protocol version 10
Connection Localhost via UNIX socket
UNIX socket /var/lib/mysql/mysql.sock
Uptime: 2 min 39 sec
Threads: 1 Questions: 352 Slow queries: 0 Opens: 58 Flush tables: 1 Open tables: 19 Queries per second avg: 2.214

8) vB is not alone on the server. It shares a database with 4images Photo Gallery for common user database. Also on the server using php & mysql are Joomla! CMS, Digital Diary (custom/lightly used), and Plugged-out Blog.

9) Average concurrent: 8; Max seen: Most users ever online was 377, 05-06-2006 at 02:46 AM; No maximum user limit set; Cookie Timeout: 1800 Seconds.

10) Here is that infromation (http://www.teen-moods.net/ifejiw0inso/phpinfo.php)

11) Select Values:
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 5
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 150
MaxRequestsPerChild 500

12) vBulletin version 3.5.4 ... can't upgrade for a while. Applied security patch though.

13) No max file size exceeded messages in apache error log nor did i find any extra large files like that...

14)uname -a
Linux server.teen-moods.net 2.6.9-022stab078.14-smp #1 SMP Wed Jul 19 14:26:20 MSD 2006 i686 athlon i386 GNU/Linux


ulimit -aH

core file size (blocks, -c) 1000000
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) unlimited
open files (-n) 4096
pipe size (512 bytes, -p) 8
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 14335
virtual memory (kbytes, -v) unlimited


cat /proc/cpuinfo

processor : 0
vendor_id : AuthenticAMD
cpu family : 15
model : 5
model name : AMD Opteron(tm) Processor 242
stepping : 10
cpu MHz : 801.966
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext lm 3dnowext 3dnow
bogomips : 3145.72
processor : 1
vendor_id : AuthenticAMD
cpu family : 15
model : 5
model name : AMD Opteron(tm) Processor 242
stepping : 10
cpu MHz : 801.966
cache size : 1024 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext lm 3dnowext 3dnow
bogomips : 3203.07


THANK YOU FOR YOUR ASSISTANCE AND TIME!!