Extremely high volume forums?
Collapse
X
-
Boss ...
I am not sure what the final decision is going to be. I did a lot of the research and left it in the CTO's hands. I know they are very much wanting a threaded/linear option a la WWWThreads. vBulletin is very solid and has great features but being linear view only is making them hesitant.
They will end up using something in-house probably long term but short term they are still looking at WWWThreads and vBulletin as well as some others but no decisions just yet.
Thanks for the compliment on the site. Lots of work but we're getting there. This new network is going to have some massive traffic so you'll have to check out the boards once we are up and running.
GrassyComment
-
Threaded is Usenet style:
Code:|------ |-------- |-------- | |------------- | |---- | |---- |------ |-------- |------ |---------- |--------
Comment
-
I am the technical webmaster for the Dis site and I just wanted to add that the software runs like a clock and far exceeded our expectations. We had talked to Alex at bigbigsavings before undertaking our migration but we still didn't quite know what to expect. I was checking top when we hit the 625 users and the SQL server didn't budge and the Web Server was running around 2-2.5 and that is with dual CPU's! If anyone needs more info on what we have seen and how we are doing it please feel free to email me at
[email protected]
Eva,
Those 2 boxes are dedicated entirely to running the Vbulletin Forums, we have an NT server that runs the rest of our siteLast edited by alexi; Mon 14 May '01, 8:48am.Webmaster in charge of technical stuff and taking out the trash. www.disboards.com, www.wdwinfo.com
www.dreamsunlimitedtravel.com and a few others I am forgetting!Comment
-
if its one thing that database servers LOVE! its ram
more ram, the merrier...but the only downfall to mysql is its inability to love dual processors.
as I hear Postgresql supports dual processors and is ideal for large-data carrying databases. I know for a fact that www.rackspace.com runs thier entire customer support ticket system and customer information off of a single postgresql server on a dual 933 proc system with 1.5gb of ram. WHen they benched mysql on it before using postgres...it choked and died after a few weeks of constant usage.
I hope postgres is supported in the near future. That really stuns me how those big sites barely twitch when it comes to that many active users. Mind boggling...Comment
-
Um MySQL does love dual processors. If you are on a big Sun box with 10 processors, it'll love that even more. MySQL is fully multi-threaded and has been since the dawn of time. Okay, well, not that long, but still.
The only time you'll have problems with MySQL and not being able to use CPUs is if you use an OS which doesn't let one process use more than one CPU, like FreeBSD. They are trying to get that fixed with an all new thread approach in FreeBSD 5.0, but that is a ways off. If you use Linux or Solaris, then MySQL will use all of the CPUs you have fully. It's the reason why we're moving to Debian linux for our database box. I love FreeBSD in general and it's fast and stable for web servers, etc, but for multithreaded software it doesn't do multiple CPUs.
Apache has no problem using both CPUs on FreeBSD because it uses seperate processes, not one process with seperate threads. Some FreeBSD people run two MySQL servers on the same machine, so each uses a cpu, but that's too much of a hack for me. BTW, the 2.4 linux kernel has significant threading library improvements, so for maximum performance 2.4 is the way to go.
As for rackspace, there's no way to know what was going on there without more info. Perhaps they have a lot of simultanous read/write locks going on, and MySQL only does table locks in all of the "default" table types. That can cause performance problems, esp. with things like vbulletin under heavy usage. But it does support the same sort of row locking PostGres does in InnoDB, and also does page locking in BDB. (PostGres and MySQL's InnoDB seem to be related since they both had the same 8K data per row restriction, and some other identical features.)
PostGres is a fine database system and works great for many people. But please don't claim MySQL won't use dual CPUs, that's false.
-JonathanLast edited by roy7; Fri 1 Jun '01, 7:05am.Comment
-
Here is my experience...
First of all let talk about the servers:
- 6 web server, dual processor PIII (four of them are 700Mhz and two of them are 866Mhz), 256Mb Ram
- 1 mysql server, quad Xeon 700Mhz with 1Mb Cache, 768Mb RAM & raid5 scsi disks [Kernel 2.4.10]
Web pages between the web servers are shared using NFS (Please note that all the servers are running on a 100Mb/FD switched lan)...
Between the users and the web servers there is a director which splits the traffic between the web cluster (look at http://www.linuxvirtualserver.org for that)
We are currently handling 15000000 page views per month (60-70% of the pages are done using forums)...
The web is mod_gzip enabled.....
On the mysql side the only thing I can change is adding more CPU or memory (I think I'll add 1gb mem next months)...
Our Mysql handles ~400 queries/seconds...
Using mysql 3.23.36... All the servers are using latest Debian stable release....
On the web side I tried out APC but it eats the server memory...
zend cache is too expensive so right now i'm exploring other solutions...
All the web site is dynamic and there is also some user tracking ... so the mysql server isn't hitted only by vbulletin...
The only problem we got with vb is regarding the search indexes (250mb data table + 250mb index file, ~18mils records)...
It seems to be too big for that conf
I also have a spare server in order to make mysql replication.. but I'm waiting mysql 4 for that....
If anyone have to suggest me anything to let everything running better please mail me...
Bye
NatComment
-
Wow -- those are some huge server specs. A little mind boggling, though. We recieve 10 mil impressions a month (and growing) with only two dual CPU servers. Still, if we had the money I'd want a Sun E420R or maybe one of the E280s.Matt
Sybase DBA / PHP fanatic
Sybase v. MySQL v. Oracle | Why I don't like MySQL | Download Sybase TODAY! | Visit DBForums.com!Comment
-
Originally posted by nat
Can you mail me how many qry/sec your mysql server handles & your my.cnf file ?
I'm curios about your 10mils pages dual-proc conf...
We do not run MySQL so I can't provide any help there. Sorry!Matt
Sybase DBA / PHP fanatic
Sybase v. MySQL v. Oracle | Why I don't like MySQL | Download Sybase TODAY! | Visit DBForums.com!Comment
-
Originally posted by MattR
Nat,
We do not run MySQL so I can't provide any help there. Sorry!:: Always Back Up Forum Database + Attachments BEFORE upgrading !
:: Nginx SPDY SSL - World Flags Demo [video results]
:: vBulletin hacked forums: Clean Up Guide for VPS/Dedicated hosting users [ vbulletin.com blog summary ]Comment
-
MattR does quite abit of traffic. There are numerous threads that are on the topic. Try a search. I remember a thread sometime back that listed quite a few large boards.
I will say this though, many were mysql. I would also like to see a future version that could be used with other db's such as Sybase. Something in the installation that would ask what db you would like to use. You would choose your db, and then vBulletin would check to see if indeed it had all of the necessary requirements. Iv'e seen some pretty large boards using mysql. I would be curious as to what HARDOCP uses. If he has any modifications. The board there always flys at great speeds while having an amazing amount of concurrent users. MattR doesn't think mysql can handle the large amount of traffic that some boards out there have and he does indeed have valid reasons for his perception.
Maybe MattR would be so kind to set up a site dedicated to porting vBulletin to Sybase for those who prefer it. If anyone would be able to help in this area it would be MattR.Last edited by Hooper; Sat 6 Oct '01, 5:04am.Comment
widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
Comment