PDA

View Full Version : 3.6 upgrade on large forum?


polira
Tue 15th Aug '06, 2:00am
My forums have roughly 10 million posts. Do I need to run the upgrade process manually in anyway (ie modifications to the post table that may stall) or am I good to go pending a db backup?
Colin F
Tue 15th Aug '06, 9:23am
The upgrade to 3.6 does have a few queries that will most likely time out with 10 million posts.

What you'd have to do is run those queries per SSH and remove them from the upgrade script.
polira
Tue 15th Aug '06, 11:14am
Are there instructions for that anywhere, or a switch in the upgrade script to display on screen which queries to run manually at what point? If not, it may be something worth looking into for future upgrades.
Colin F
Tue 15th Aug '06, 11:20am
As far as I know a switch or something similiar is being looked into, but currently there's no such thing, sorry.
ColinP
Wed 16th Aug '06, 5:55am
How about a 3 million post forum? I'm keen to get an upgrade done over the next couple of months but I need to minimise the downtime.

Will there be a problem with a forum of this size and do you have any estimates on how long an upgrade might take?

Threads: 216,988, Posts: 3,661,390, Members: 51,451
Colin F
Wed 16th Aug '06, 8:23am
A different customer with a 2.8 million post board did use the upgrade script, but had over 8 hours for only the first step.
ColinP
Wed 16th Aug '06, 8:28am
That's fine - I don't want to get halfway through a process and find it dies on me. That's all.
InfidelMatt
Wed 16th Aug '06, 12:49pm
That's fine - I don't want to get halfway through a process and find it dies on me. That's all.


It totally depends on your hardware. I have a 3.6M post board and the two post queries took 40 minutes each.

Matt
PSS
Thu 17th Aug '06, 8:36am
The upgrade to 3.6 does have a few queries that will most likely time out with 10 million posts.

What you'd have to do is run those queries per SSH and remove them from the upgrade script.

Would it be impossible to reveal those queries or give a link to a post explaining the steps so that I wouldn't have to learn the source code to do the upgrade properly?
eoc_Jason
Thu 17th Aug '06, 1:57pm
Even if the browser times out, mysql will continue to run the query. It's best to have a shell open with mysql or use phpmyadmin and do a 'show processlist' to see what it is doing...
stryka
Sat 19th Aug '06, 5:14am
Just a FYI... not sure why VB doesn't announce this somewhere for large forums...

Anyhow... here is the post that others found which explains what queries to run... [/URL]

[URL="http://www.andreas-kraus.net/blog/updating-to-vbulletin-36-update-timeouts/"]VBULLETIN UPGRADE TIMING OUT (http://www.andreas-kraus.net/blog/updating-to-vbulletin-36-update-timeouts/)
xmlxp
Sat 19th Aug '06, 7:28am
why doesnt vb team provide for large boards an upgrade script can be run via SSH instead of web browser ?

we are the owners of large boards need a strong solutions for upgrading
PSS
Sat 19th Aug '06, 8:55am
The upgrade to 3.6 does have a few queries that will most likely time out with 10 million posts.

What you'd have to do is run those queries per SSH and remove them from the upgrade script.

I ask again: Would it be impossible to reveal those queries or give a link to a post explaining the steps so that I wouldn't have to learn the source code to do the upgrade properly?
Mark.B
Sat 19th Aug '06, 9:48am
I ask again: Would it be impossible to reveal those queries or give a link to a post explaining the steps so that I wouldn't have to learn the source code to do the upgrade properly?

Have a look HERE (http://www.andreas-kraus.net/blog/updating-to-vbulletin-36-update-timeouts/).

This will work, however afterwards, your report post function will not create threads correctly unless you make further changes to your POST table as detailed HERE (http://www.vbulletin.com/forum/showpost.php?p=1190407&postcount=27).

Worked great for me. I too couldn't upgrade the 'normal' way due to too many posts.
Colin F
Sun 20th Aug '06, 6:12am
why doesnt vb team provide for large boards an upgrade script can be run via SSH instead of web browser ?

we are the owners of large boards need a strong solutions for upgrading
We're looking into that.
xmlxp
Sun 20th Aug '06, 7:20am
We're looking into that.

thanks alot for this great news :)
Erwin
Sun 27th Aug '06, 12:47am
My forums have over 26 million posts, and the first 2 queries took just over 2 hours to run - helps when you have a quad opteron 15k SCSI RAID 10 with 8 Mb RAM just for the database to do the queries, with no other queries touching it. So far so good.
SaN-DeeP
Sun 27th Aug '06, 2:59am
26 million posts, and the first 2 queries took just over 2 hours to run - helps when you have a quad opteron 15k SCSI RAID 10 with 8 Mb RAM just for the database rich hardware :)
TwinsForMe
Fri 8th Sep '06, 7:51pm
Just a FYI... not sure why VB doesn't announce this somewhere for large forums...

Anyhow... here is the post that others found which explains what queries to run... [/URL]

[URL="http://www.andreas-kraus.net/blog/updating-to-vbulletin-36-update-timeouts/"]VBULLETIN UPGRADE TIMING OUT (http://www.andreas-kraus.net/blog/updating-to-vbulletin-36-update-timeouts/)

What would be the exact string once you would use to access the database to run the query via ssh? I know how to run queries within phpmyadmin but running them via ssh is foreign to me other than backing up and restoring a database. I only know that because all the steps/strings are shown in the vb manual.