PDA

View Full Version : [fixed] Anyone else see a server load increase with 2.2.2?



David Bott
Thu 31st Jan '02, 3:49pm
Hi...

I run two servers...One for the MySQL database and the other for the web end.

My normal database server load is under 1.0...I upgraded to 2.2.2 yeasterday and all day today thus far I have been over 4 on the database server load.

Anyone else notice a sever load increase afer going to 2.2.2 from 2.2.1?

Can I drop back down to 2.2.1 to see if the load drops without any issues seeing I already did the upgrade?

Omero
Fri 1st Feb '02, 2:51pm
I'm EXACTLY in the same situation... i had a BIG load increase switching from 2.2.1 to 2.2.2 and this is killing my board... i'm really fighting hard to keep mysql to go 100% of CPU and giving D.O.S. to users.

I'd just like to know which are the changed things in 2.2.2. which would have cause the added load, and how can i deal with them to "switch" them back, and reduce the load.

THanks, this is important.

David Bott
Fri 1st Feb '02, 3:21pm
NOTICE...

I went back to 2.2.1 and the loads dropped. I then went again to 2.2.2 and the DB load increase is back!

VB PLEASE ADVISE!!!!!

Omero
Fri 1st Feb '02, 3:30pm
This is a SERIOUS thing, I'm currently having a 2 days forum service stop because of this...

I would like to know ASAP what are the changes responsible of this increased load, and what can i do in order to switch back and get rid of this.

PLease David, if you find out something BEFORE vbb notify us about this, let me know here IMMEDIATLY. Thanks bud ;)

tubedogg
Fri 1st Feb '02, 5:45pm
There were no changes that would account for a spike in server load.

David Bott
Fri 1st Feb '02, 5:49pm
Ya...so that is what I hear....Sorry though...I can reproduce it.

LuBi
Fri 1st Feb '02, 6:07pm
I also have seen a rise in server load. Are there any explenations for this?

Freddie Bingham
Fri 1st Feb '02, 6:23pm
Put the 2.2.1 forumdisplay.php in with the other 2.2.2 files and let me know what you see.

Omero
Fri 1st Feb '02, 6:26pm
Originally posted by freddie
Put the 2.2.1 forumdisplay.php in with the other 2.2.2 files and let me know what you see.

I'll try. Can someone send me forumdisplay.php from 2.2.1 version into my mailbox? I dont have a 2.2.1 zip here :(

Thanks.

omero@ngx.sm

Side Note: I use InnoDB table format.

Floris
Fri 1st Feb '02, 6:44pm
Nope,
Everything is below 1.0 and stayed that way! No probs here what so ever with 2.2.2

Freddie Bingham
Fri 1st Feb '02, 6:45pm
If you still have the 2.2.1 file, put it back and try it out. Alternatively I will make some changes and send you a new version to try out.

David Bott
Fri 1st Feb '02, 7:21pm
I just put back only 2.2.1 of forumdisplay.php and my load went from 3.5+ to UNDER 1 !!!!

Now, it has only been 3 mins, but from 2.2.2 the DB server has been over 3 as mentioned above (I am not a small site so this hurts!). Now with just this, back under 1 and holding.

Will repost back after about 30 mins has gone by.

PLEASE ADVISE thus far though.

Freddie Bingham
Fri 1st Feb '02, 7:24pm
Yes there seems to be problems in forumdisplay.php and I working on optimizing it right now.

Floris
Fri 1st Feb '02, 7:28pm
Originally posted by freddie
Yes there seems to be problems in forumdisplay.php and I working on optimizing it right now.

Useful Admin Stuff
Server Load Averages 0.09, 0.11, 0.14 6 users online (2 members & 4 guests).

vBulletin 2.2.2

But I only have a little forum with 222 members and 27.000 pageviews in January.

Maybe that is why I experience no problems?



Hey David, very cool to found this problem!

David Bott
Fri 1st Feb '02, 7:48pm
ok...Update...

With 2.2.1 forumdisplay.php in place...my DB server is at .29 right now with like 800 members on-line! Yea!

So...To thouse who said their were no changes...Please try to trust some of us. :D

David Bott
Fri 1st Feb '02, 7:51pm
And Freddie....Thank you.

miniwar
Fri 1st Feb '02, 7:52pm
Good catch.

Now, where do we get the old 2.2.1 forumdisplay.php file? There's no "old versions" in the support area.

I have closed my board down until I can revert back. I don't want to take any chances, even though I haven't had a complaint from my web provider -- yet.

Rod

Freddie Bingham
Fri 1st Feb '02, 7:58pm
The new version is now running here and makes a hell of a difference. I am not sure how John will get this updated file to you but I will point him to this thread.

John
Fri 1st Feb '02, 7:59pm
I've attached the new forumdisplay.php to this message.

John

David Bott
Fri 1st Feb '02, 8:00pm
Mods...If not allowed, please remove this post.


Here is 2.2.1 of forumdisplay.php .

[removed the 2.2.1 version since an updated 2.2.2 version is included above --John]

David Bott
Fri 1st Feb '02, 8:00pm
Might I please ask what it was?

miniwar
Fri 1st Feb '02, 8:04pm
Excellent! Thanks guys.

Rod

Freddie Bingham
Fri 1st Feb '02, 8:04pm
This one will actually be faster than the 2.2.0 and 2.2.1 versions were as I also fixed an issue with the user's browsing the forum option that was in both of those versions. The main problem was with the query that retrieves sticky threads that was changed in v2.2.2 to try to fix missing threads on page 2. It's all good now.

David Bott
Fri 1st Feb '02, 8:07pm
BTW...New code in place and holding steady.

So...After 6 shutdowns and restarts of MySQL, Three my.cnf changes, and three consulting sessions with other parties...it was in fact a code issue. (Many hours BTW)

Good news is...1) It was fixed after someone listened and looked. And 2) It was not my hardware which is the best part. (Few!!!)

Thanks guys.

tomk
Fri 1st Feb '02, 8:08pm
replace our v2.2.2 forumdisplay.php with this version?

TomK

David Bott
Fri 1st Feb '02, 8:09pm
Yes tomK...and then do the happy dance!

miniwar
Fri 1st Feb '02, 8:09pm
It's just awesome support, that's all. :)

Freddie -- you da man!

Server loads well under 1.0 now and holding. :)

Rod

Freddie Bingham
Fri 1st Feb '02, 8:11pm
Originally posted by tubedogg
There were no changes that would account for a spike in server load. /me whistles innocently as I did not work on v2.2.2

tomk
Fri 1st Feb '02, 8:12pm
David,

Send the bill for your SQA work to John. :)

PS - I've been a member of your boards a LONG time...like before 1.0 TiVo shipped....and worked with tivolutionary for support/beta, etc.

You run some GREAT forums and have an awesome community! Keep up the good work.

TomK

David Bott
Fri 1st Feb '02, 8:21pm
Thanks....And to think...We are not even listed on VB's home page as a example. LOL

"Most users ever online was 1135 on 01-02-02 at 12:18 PM."

I have my cookie timeout set for 900 seconds. Some of you know what I mean by that and can relate to the nuumber above.


Now if I can only get them to listen about the deleting of a thread/port. IT TAKES WAY TO LONG ON A LARGE SITE. IT CAN BE FIXED. Really.

tomk
Fri 1st Feb '02, 8:40pm
WOW!

7:22pm up 8 days, 5:38, 3 users, load average: 45.15, 18.07, 6.98
331 processes: 251 sleeping, 80 running, 0 zombie, 0 stopped
CPU0 states: 90.3% user, 9.7% system, 0.0% nice, 0.0% idle
CPU1 states: 91.0% user, 8.11% system, 0.0% nice, 0.0% idle
Mem: 1027952K av, 1020180K used, 7772K free, 72K shrd, 165060K buff
Swap: 923696K av, 344K used, 923352K free 465612K cached

This is a dual AMD 1.4 Athlon with a gig of DDR 2100 RAM! RH 7.2, latest apache and latest MySQL.

No users were active on the system, and nothing (except for postfix) is running on this server!

*I* was able to generate this load, simply by holding on to the Ctrl-R key at the main index for 30 seconds...it spawned and spawned MySQL....both apache and MySQL run on same machine.

I am running the newest forumdisplay.php.

Yikes!

PS - This proves nothing, I just wanted to get up there with you Godz that have monster boards! :cool: :cool:

TomK :D

Floris
Fri 1st Feb '02, 8:40pm
Originally posted by John
I've attached the new forumdisplay.php to this message.

John


Hi John, maybe its just me but .. the original .php that came with vbulletin 2.2.2 when it got released didn't gave me any trouble. Now I wanted to be sure, and I uploaded the one you have attached above, browsed my forum and logged into the admin control panel.

Useful Admin Stuff
Server Load Averages 1.77, 1.30, 0.77 3 users online (1 members & 2 guests).

(update: few mins later)
Useful Admin Stuff
Server Load Averages 1.38, 1.27, 0.86 3 users online (1 members & 2 guests).

(update: few mins later)
Useful Admin Stuff
Server Load Averages 1.19, 1.30, 0.98 1 users online (1 members & 0 guests).



This could be a few things:

1- The server just accidently has a nice big load
2- The new php file actually gives me nice big load, and the old one didn't!


By the way, the forum home page gets loaded 'so much faster!' then usual .. but I haven't been over 1.00 as load, now I can't seem to get under it.

Freddie Bingham
Fri 1st Feb '02, 8:42pm
You definately need to use the new file.

Floris
Fri 1st Feb '02, 8:44pm
Originally posted by freddie
You definately need to use the new file.

To whom did you just say that ?

David Bott
Fri 1st Feb '02, 9:03pm
To you I would guess.

Just be sure you are in fact using the new file. I say this because I am having no load issues now at all.

Ed FvC
Fri 1st Feb '02, 9:13pm
This dropped my loads considerably! Thanks!

fury
Sat 2nd Feb '02, 12:23am
Would there be any problem with uploading this forumdisplay.php on a 2.2.0 or 2.2.1 installation? In case we don't have any problems and don't want to upgrade?

Or are there some things in forumdisplay.php that require some files from 2.2.2 present?

Freddie Bingham
Sat 2nd Feb '02, 1:04am
There would be no problem as I have put it on my board which is still on 2.2.0.

tubedogg
Sat 2nd Feb '02, 1:05am
Originally posted by freddie
/me whistles innocently as I did not work on v2.2.2 LOL :)

NetherChris
Sat 2nd Feb '02, 1:25am
Has this been updated in the .ZIP available in the members area?

LuBi
Sat 2nd Feb '02, 1:34am
Worked for me, thanks! :D

Freddie Bingham
Sat 2nd Feb '02, 1:35am
Yes it has been. A new release will not be issued to resolve this problem considering we released only a few days ago.

Omero
Sat 2nd Feb '02, 3:49am
THank you VERY much guys: you saved my board :)

I want especially to thank david who supported me in this "report the nasty bug" mission, and Freddie who trusted us and checked if that was right or wrong :)

I'm an happy man now.

P.s. im uploading file now, ill let you know what it happens later today ;)

LeeS
Sat 2nd Feb '02, 1:41pm
A magical drop in load, this is just what my boards need right now! I will put it in place tonight and see what difference it makes, as load regularly goes up to 6+ during the evenings which isn't good (2.2.1).

Omero
Sat 2nd Feb '02, 2:05pm
Originally posted by Omero
im uploading file now, ill let you know what it happens later today ;)

Tested it... work perfectly: load VERY low, compared to previous forumdisplay.php

Never higher than 20% cpu, while before it was 100% with less ppl on the board :)

Koss
Sat 2nd Feb '02, 3:05pm
Sorry I'm a bit new to this ...but these figures seem a bit strange to me, do these look ok?
I got these numbers after uploading the forumdisplay.php in my "forums" directory

Server Load Averages:
0.97, 1.54, 1.70 7 users online (6 members & 1 guests).

(a bit later)
2.63, 2.00, 1.82 5 users online (4 members & 1 guests).

(a bit later)
1.08, 1.47, 1.63 5 users online (4 members & 1 guests).

:confused:

David Bott
Sat 2nd Feb '02, 3:41pm
Looks to me like you are not the only one on that server...thus it would really be hard to tell without some sort of baseline.

After all, you really don't know what the other sites are doing at the time.

(I say this because of the user count on the server (on VB) when you copied took the date.)

The Realist
Sun 3rd Feb '02, 7:54pm
Well I must take my hat off to you VB guys. There have been times were I thought that support like this came along at a cost.

I uploaded the new file and my forums load dropped a great deal and the page's loads up a lot faster as well.


Well done M8.

Congrats,

Brian
:D

Dado
Mon 4th Feb '02, 8:17pm
my load average is much higher. Last week I had about 1000 users online and load was about 1. Right now there is about 600 users online and the load is at 2.02 2.28 2.38

My server is slow! :(

****edit****

Sorry didn't see page 2 with the new file :) Running better now at about 1.25 server load :D

TechTalk
Mon 4th Feb '02, 8:21pm
I am going to bet you are on a shared server too



Originally posted by Dado
my load average is much higher. Last week I had about 1000 users online and load was about 1. Right now there is about 600 users online and the load is at 2.02 2.28 2.38

Please fix this soon :( :( My server is slow!

Dado
Mon 4th Feb '02, 8:22pm
nope I have a VO dedicated server dual pentium 933 with 768 of ram. My database is about 1gig and the forum has about 3000+ posts per day with a total 170,000 posts since October.

Joe Gronlund
Mon 4th Feb '02, 10:15pm
Originally posted by David Bott
ok...Update...

With 2.2.1 forumdisplay.php in place...my DB server is at .29 right now with like 800 members on-line! Yea!

So...To thouse who said their were no changes...Please try to trust some of us. :D

good job, my board was under alot of load to, mostly refreshing the main page you could just tell something was not quite right.

seems all fixed now :cool:

ubbuser
Tue 5th Feb '02, 2:39am
Hmm Ok so since January 30, 2002 (when I downloaded 2.2.2) what files have been modified (fixed) and which ones should I upload to my 2.2.2 board too? Thanks..

nuno
Tue 5th Feb '02, 4:30am
take a peek into Annoucements Forum ;)

tubedogg
Tue 5th Feb '02, 5:13am
Originally posted by ubbuser
Hmm Ok so since January 30, 2002 (when I downloaded 2.2.2) what files have been modified (fixed) and which ones should I upload to my 2.2.2 board too? Thanks.. Any files that were posted after January 30 are obviously newer than the versions you have and so you should download them and upload them to your site.

ubbuser
Tue 5th Feb '02, 7:36am
Hmm, I did a filecompare using Beyondcompare on the files in the admin directory of the files I have and the files in the member section. The only thing different (besides time stamps) is one file vbulletin.styles with a diff. file size. rest all have the same file sizes...so what's the recommendation? I don't want to upload some more files than needed and then see that a working board is dead.. :confused:

Joshua Clinard
Tue 5th Feb '02, 3:36pm
I uploaded this file, and I now get this error when clicking on any forum.

Freddie Bingham
Tue 5th Feb '02, 4:17pm
Originally posted by Joshua Clinard
I uploaded this file, and I now get this error when clicking on any forum. What error?

Joshua Clinard
Tue 5th Feb '02, 4:22pm
Whoops, I forgot to cut and paste the error message. Nevermind, I fixed it. It was a hack I installed causing the error.

John
Thu 7th Feb '02, 11:22am
Just to let people know, the file is here:
http://www.vbulletin.com/forum/showthread.php?postid=242990#post242990

John