Optimizing Ensim Server--Help Me Eva

[pgowder]

Ok, I've taken the advice you kept giving me and got rid of the RaQ.

So now I'm on a P4 1.7 with 512 mb ram and want to make sure I have it optimized!

[pgowder]

Originally posted by pgowder
Ok, I've taken the advice you kept giving me and got rid of the RaQ.

So now I'm on a P4 1.7 and want to make sure I have it optimized! MySQL 3.23.41
PHP 4.1.1

[pgowder]

Here are the top stats:

4:59pm up 9 days, 1:25, 1 user, load average: 0.34, 0.33, 0.54
258 processes: 254 sleeping, 3 running, 1 zombie, 0 stopped
CPU states: 26.3% user, 10.3% system, 1.8% nice, 61.3% idle
Mem: 512920K av, 498792K used, 14128K free, 1416K shrd, 61664K buff
Swap: 1028152K av, 39152K used, 989000K free 226676K cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
3486 root 14 0 1224 1224 828 R 4.7 0.2 0:01 top
16312 apache 8 0 13892 10M 8308 S 3.0 2.0 0:24 httpd
21275 apache 9 0 14248 10M 8484 S 1.6 2.1 0:14 httpd
21142 apache 8 0 14464 11M 8296 S 0.9 2.2 0:22 httpd
3283 apache 8 0 12208 9072 8368 S 0.9 1.7 0:00 httpd
3532 admin2 20 0 1516 1516 1076 R 0.7 0.2 0:00 adcycle.cgi
1958 root 9 0 32484 30M 2084 S 0.3 6.1 22:30 java
3277 apache 9 0 14020 10M 8356 S 0.3 2.1 0:00 httpd
1892 root 0 0 32484 30M 2084 S 0.1 6.1 0:43 java
1905 root 9 0 32484 30M 2084 S 0.1 6.1 0:10 java
1931 root 9 0 32484 30M 2084 S 0.1 6.1 0:09 java
1942 root 9 0 32484 30M 2084 S 0.1 6.1 1:57 java
17298 apache 9 0 14132 10M 8296 S 0.1 2.1 0:23 httpd
2341 root 9 0 32484 30M 2084 S 0.1 6.1 0:00 java
3131 apache 8 0 13528 10M 8356 S 0.1 2.0 0:00 httpd
3132 apache 8 0 13784 10M 8360 S 0.1 2.0 0:00 httpd
3530 mysql 15 10 0 0 0 Z N 0.1 0.0 0:00 mysqld <defunct>
1 root 8 0 516 476 448 S 0.0 0.0 0:09 init
2 root 8 0 0 0 0 SW 0.0 0.0 0:00 keventd
3 root 19 19 0 0 0 SWN 0.0 0.0 0:01 ksoftirqd_CPU0
4 root 9 0 0 0 0 SW 0.0 0.0 0:17 kswapd
5 root 9 0 0 0 0 SW 0.0 0.0 0:00 kreclaimd
6 root 9 0 0 0 0 SW 0.0 0.0 0:00 bdflush
7 root 9 0 0 0 0 SW 0.0 0.0 0:00 kupdated
8 root -1 -20 0 0 0 SW< 0.0 0.0 0:00 mdrecoveryd
12 root 9 0 0 0 0 SW 0.0 0.0 3:34 kjournald

[pgowder]

my.cnf

[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock

[mysql.server]
user=mysql
basedir=/var/lib

[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

[pgowder]

variables

back_log 50
basedir /usr/
bdb_cache_size 8388600
bdb_log_buffer_size 32768
bdb_home /var/lib/mysql/
bdb_max_lock 10000
bdb_logdir
bdb_shared_data OFF
bdb_tmpdir /tmp/
bdb_version Sleepycat Software: Berkeley DB 3.2.9a: (August 11, 2001)
binlog_cache_size 32768
character_set latin1
character_sets latin1 big5 cp1251 cp1257 croat czech danish dec8 dos estonia euc_kr gb2312 gbk german1 greek hebrew hp8 hungarian koi8_ru koi8_ukr latin2 latin5 swe7 usa7 win1250 win1251 win1251ukr ujis sjis tis620
concurrent_insert ON
connect_timeout 5
datadir /var/lib/mysql/
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
flush OFF
flush_time 0
have_bdb YES
have_gemini NO
have_innodb NO
have_isam YES
have_raid NO
have_ssl NO
init_file
interactive_timeout 28800
join_buffer_size 131072
key_buffer_size 8388600
language /usr/share/mysql/english/

[pgowder]

variables continued


large_files_support ON
locked_in_memory OFF
log OFF
log_update OFF
log_bin OFF
log_slave_updates OFF
log_long_queries OFF
long_query_time 10
low_priority_updates OFF
lower_case_table_names 0
max_allowed_packet 1048576
max_binlog_cache_size 4294967295
max_binlog_size 1073741824
max_connections 100
max_connect_errors 10
max_delayed_threads 20
max_heap_table_size 16777216
max_join_size 4294967295
max_sort_length 1024
max_user_connections 0
max_tmp_tables 32
max_write_lock_count 4294967295
myisam_recover_options 0
myisam_max_extra_sort_file_size 256
myisam_max_sort_file_size 2047
myisam_sort_buffer_size 8388608
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
open_files_limit 0

[pgowder]

variables continued

pid_file /var/run/mysqld/mysqld.pid
port 3306
protocol_version 10
record_buffer 131072
record_rnd_buffer 131072
query_buffer_size 0
safe_show_database OFF
server_id 0
slave_net_timeout 3600
skip_locking ON
skip_networking OFF
skip_show_database OFF
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer 2097144
sql_mode 0
table_cache 64
table_type MYISAM
thread_cache_size 0
thread_stack 65536
transaction_isolation READ-COMMITTED
timezone EST
tmp_table_size 33554432
tmpdir /tmp/
version 3.23.41
wait_timeout 28800

[pgowder]

variables continued

pid_file /var/run/mysqld/mysqld.pid
port 3306
protocol_version 10
record_buffer 131072
record_rnd_buffer 131072
query_buffer_size 0
safe_show_database OFF
server_id 0
slave_net_timeout 3600
skip_locking ON
skip_networking OFF
skip_show_database OFF
slow_launch_time 2
socket /var/lib/mysql/mysql.sock
sort_buffer 2097144
sql_mode 0
table_cache 64
table_type MYISAM
thread_cache_size 0
thread_stack 65536
transaction_isolation READ-COMMITTED
timezone EST
tmp_table_size 33554432
tmpdir /tmp/
version 3.23.41
wait_timeout 28800

[pgowder]

extended status

Aborted_clients 1
Aborted_connects 2
Bytes_received 1137532796
Bytes_sent 6937051
Connections 456236
Created_tmp_disk_tables 511
Created_tmp_tables 228574
Created_tmp_files 0
Delayed_insert_threads 0
Delayed_writes 0
Delayed_errors 0
Flush_commands 1
Handler_delete 17532
Handler_read_first 318647
Handler_read_key 35627524
Handler_read_next 157191519
Handler_read_prev 66347
Handler_read_rnd 56391138
Handler_read_rnd_next 887859553
Handler_update 4807343
Handler_write 3762361
Key_blocks_used 7793
Key_read_requests 156992317
Key_reads 183155
Key_write_requests 360261
Key_writes 339231
Max_used_connections 22
Not_flushed_key_blocks 0
Not_flushed_delayed_rows 0
Open_tables 64

[pgowder]

extended status continued

Open_files 121
Open_streams 0
Opened_tables 15078
Questions 8843258
Select_full_join 293
Select_full_range_join 1
Select_range 2292036
Select_range_check 0
Select_scan 1387725
Slave_running OFF
Slave_open_temp_tables 0
Slow_launch_threads 0
Slow_queries 10
Sort_merge_passes 0
Sort_range 2386907
Sort_rows 104291478
Sort_scan 538146
Table_locks_immediate 8662164
Table_locks_waited 4907
Threads_cached 0
Threads_created 456235
Threads_connected 7
Threads_running 1
Uptime 478033

[pgowder]

vb info

I'm averaging about 50 people online, with a max of 84. But it has been increasing.

And I can pm you the url of my phpinfo.php file.

vb 2.2.8

[pgowder]

Originally posted by pgowder
vb info

I'm averaging about 50 people online, with a max of 84. But it has been increasing.

And I can pm you the url of my phpinfo.php file. KeepAlive on
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 150

[eva2000]

Originally posted by pgowder
KeepAlive on
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 10
StartServers 5
MaxClients 150 Ensim.. not the best control panel around :(

i'd upgrade PHP to 4.2.3 and MySQL to 3.23.53a

and change my.cnf to below and restart mysql

[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
set-variable = max_connections=650
set-variable = key_buffer=16M
set-variable = myisam_sort_buffer_size=64M
set-variable = join_buffer=1M
set-variable = record_buffer=1M
set-variable = sort_buffer=2M
set-variable = table_cache=1024
set-variable = thread_cache_size=256
set-variable = wait_timeout=9600
set-variable = connect_timeout=10
set-variable = max_allowed_packet=16M
set-variable = max_connect_errors=10

[mysql.server]
user=mysql
basedir=/var/lib

[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
open_files_limit=8192

[mysqldump]
quick
set-variable = max_allowed_packet=16M

[myisamchk]
set-variable = key_buffer=64M
set-variable = sort_buffer=64M
set-variable = read_buffer=16M
set-variable = write_buffer=16M

[pgowder]

I know, Plesk is better, but I got a good deal. So far Ensim isn't too bad for me.

I'll try these changes and see what happens.

Thanks

[eva2000]

Originally posted by pgowder
I know, Plesk is better, but I got a good deal. So far Ensim isn't too bad for me.

I'll try these changes and see what happens.

Thanks let me know how it goes

[Paul]

Originally posted by eva2000
let me know how it goes Just curious George--would you recommend these settings for any ensim server or is it particular to pgowder's case?

Thanks,
Paul

[eva2000]

Originally posted by LoveShack
Just curious George--would you recommend these settings for any ensim server or is it particular to pgowder's case?

Thanks,
Paul it's a case by case basis... i take into a/c how much ram you have, and your mysql and vB activity

[Paul]

Thanks. :) We haven't had any problems, and actually our vb install seems to be running quite well speed-wise. If we run into problems I'll be sure to post here. For now, can't complain :)

Thanks,
Paul

[pgowder]

I tried that my.cnf file, and mysql would not restart??

[eva2000]

Originally posted by pgowder
I tried that my.cnf file, and mysql would not restart?? really.. hmm must be one of the paths try this one

[mysqld]
set-variable = max_connections=650
set-variable = key_buffer=16M
set-variable = myisam_sort_buffer_size=64M
set-variable = join_buffer=1M
set-variable = record_buffer=1M
set-variable = sort_buffer=2M
set-variable = table_cache=1024
set-variable = thread_cache_size=256
set-variable = wait_timeout=9600
set-variable = connect_timeout=10
set-variable = max_allowed_packet=16M
set-variable = max_connect_errors=10

[safe_mysqld]
open_files_limit=8192

[mysqldump]
quick
set-variable = max_allowed_packet=16M

[myisamchk]
set-variable = key_buffer=64M
set-variable = sort_buffer=64M
set-variable = read_buffer=16M
set-variable = write_buffer=16M

[pgowder]

Here is my current file:

[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid



Do I replace yours over mine, or add those lines to mine?

Thanks!

[pgowder]

I replaced yours over mine, and it worked.

So I don't need those lines from my old file?

[eva2000]

Originally posted by pgowder
I replaced yours over mine, and it worked.

So I don't need those lines from my old file? nope.. :)

[pgowder]

Great!

Is there anything else I need to tweak to improve performance?

[eva2000]

Originally posted by pgowder
Great!

Is there anything else I need to tweak to improve performance? should be good to go..

[pgowder]

I'm watching things today to see how the server is doing and with 40 people online here it the top:

11:07am up 22 days, 14:58, 1 user, load average: 7.63, 4.16, 2.34
237 processes: 235 sleeping, 2 running, 0 zombie, 0 stopped
CPU states: 22.7% user, 8.9% system, 0.0% nice, 68.3% idle
Mem: 512920K av, 494088K used, 18832K free, 1408K shrd, 87792K buff
Swap: 1028152K av, 18960K used, 1009192K free 221940K cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
9606 apache 4 -10 12500 11M 9724 S < 4.9 2.3 0:07 httpd
11802 admin 14 0 1304 1304 896 R 4.5 0.2 0:11 top
23330 apache 5 -10 12680 12M 9668 S < 1.9 2.4 0:58 httpd
9415 apache 5 -10 12288 11M 9672 S < 1.3 2.3 0:10 httpd
2468 mysql 5 -10 17912 17M 2244 S < 0.9 3.4 1:32 mysqld
26315 mysql 5 -10 17912 17M 2244 S < 0.3 3.4 0:08 mysqld
26430 mysql 5 -10 17912 17M 2244 S < 0.3 3.4 2:25 mysqld
12212 apache 4 -10 12268 11M 9764 S < 0.3 2.3 0:00 httpd
12 root 9 0 0 0 0 SW 0.1 0.0 4:06 kjournald
1758 root 9 0 27176 25M 1900 S 0.1 5.0 1:37 java
3270 mysql 5 -10 17912 17M 2244 S < 0.1 3.4 1:38 mysqld
23173 apache 5 -10 12728 12M 9736 S < 0.1 2.4 0:57 httpd
12209 apache 4 -10 12264 11M 9692 S < 0.1 2.3 0:00 httpd
12210 apache 5 -10 12184 11M 9776 S < 0.1 2.3 0:01 httpd
12412 apache 4 -10 10724 10M 9796 S < 0.1 2.0 0:00 httpd
1 root 9 0 516 476 452 S 0.0 0.0 0:10 init
2 root 8 0 0 0 0 SW 0.0 0.0 0:00 keventd
3 root 19 19 0 0 0 SWN 0.0 0.0 0:02 ksoftirqd_CPU0
4 root 9 0 0 0 0 SW 0.0 0.0 0:34 kswapd
5 root 9 0 0 0 0 SW 0.0 0.0 0:00 kreclaimd
6 root 9 0 0 0 0 SW 0.0 0.0 0:00 bdflush
7 root 9 0 0 0 0 SW 0.0 0.0 0:00 kupdated
8 root -1 -20 0 0 0 SW< 0.0 0.0 0:00 mdrecoveryd
89 root 9 0 0 0 0 SW 0.0 0.0 0:00 khubd
181 root 9 0 0 0 0 SW 0.0 0.0 0:00 kjournald

[pgowder]

It did settle back down to this with 44 users online:

11:09am up 22 days, 15:00, 1 user, load average: 2.03, 3.27, 2.24
233 processes: 231 sleeping, 2 running, 0 zombie, 0 stopped
CPU states: 9.0% user, 5.5% system, 0.0% nice, 85.4% idle
Mem: 512920K av, 482016K used, 30904K free, 1408K shrd, 87792K buff
Swap: 1028152K av, 18960K used, 1009192K free 222860K cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
12568 admin 14 0 1204 1204 828 R 4.2 0.2 0:01 top
9415 apache 5 -10 12288 11M 9672 S < 1.3 2.3 0:11 httpd
12569 apache 5 -10 12308 11M 9796 S < 0.7 2.3 0:00 httpd
23315 apache 4 -10 12528 11M 9712 S < 0.5 2.3 0:54 httpd
1693 root 9 0 27184 25M 1900 S 0.3 5.0 25:20 java
8088 mysql 5 -10 17836 17M 2244 S < 0.3 3.4 1:36 mysqld
1745 root 9 0 27184 25M 1900 S 0.1 5.0 3:30 java
1757 root 9 0 27184 25M 1900 S 0.1 5.0 1:36 java
1765 root 9 0 27184 25M 1900 S 0.1 5.0 28:47 java
12586 root 9 0 27184 25M 1900 S 0.1 5.0 0:00 java

[pgowder]

But should I be concerned about that load average?

Here is the load over the last few weeks:

(The load numbers are off-24.0 is really 2.4)

And the spikes are during backups.

[waddy]

Hi pgpowder.

I had an ensim box for a few months and hated every minute of it, close down as many services as possible that you arent using, tomcat, telnet etc etc

I got rid of my ensim box and got a plain Red Hat.

Ensim really really sux for a number of reasons.

1. Cant apply the latest apaches, mySQL and PHP updates otherwise it breaks.

2. Uses tons of memory for no reason.

3. Uses loads of CPU cycles for nothing.

4. Difficult to tweak.

For the amount of users on your site that load is way to high and memory usage is too high also.

:(