Heavey Mysql activity on submit story

[Jaffery]

I am seeing that whenever I submit a story, there is heavy mysql activity. I see only problem only with submission ie. when finally press submit, there is delay and heavy CPU usage by Mysql.
And if there are many user browser at that time, they also get slowed, ultimately a chain reaction and everything get slowed.

If I disable submission then site works good..

So where can I start fixing things ?
Pligg 1.0.3 !

[Jaffery]

Ahem !!!!
......

[chuckroast]

Ahem !!!!
......

If no one answers your post it's probably due to lack of information. Instead of just saying "Ahem" maybe you should provide more details.

I can't recreate your issue.
What modules are you using?
What are your server specifications?
You need to help us help you.

[Jaffery]

I understand your concern.. ,

Anyways, its a VPS as shared host kicked site off many times at many places.
I am provided with 1 GB RAM and total RAM on server I see 32GB and processor is quad core. Mostly server load is less than 0% but when you submit a story, I see mysql usage going up to 100% for few seconds and if that is busy time then, as said .. due to chain reaction , everything is slowed.

My database is little big and it has 90000 links in total. I guess, whenver a story is submitted, pligg iterates through whole links to check duplicates, I may disable checking dupes but I don't want to do that.
Any suggestion !

[chuckroast]

I understand your concern.. ,

Anyways, its a VPS as shared host kicked site off many times at many places.
I am provided with 1 GB RAM and total RAM on server I see 32GB and processor is quad core. Mostly server load is less than 0% but when you submit a story, I see mysql usage going up to 100% for few seconds and if that is busy time then, as said .. due to chain reaction , everything is slowed.

My database is little big and it has 90000 links in total. I guess, whenver a story is submitted, pligg iterates through whole links to check duplicates, I may disable checking dupes but I don't want to do that.
Any suggestion !

Well here is my input.. I'm not trying to be rude ( I get accused of being rude everyday for just stating facts)

As I'm sure you are well aware a VPS is still shared hosting. You are still sharing everything across a number of other sites running on the same host.

You have tens of thousands of stories, which in turn consist of tens of thousands of URLS, and I can only imagine millions of tags.

As you've also stated you are away that a submission looks for duplicates. But not only does it do that, it's also checking to see if a URL has been banned. This also takes up resources.

I've said this many times before but I can't say it enough. People can't expect to run a high active web 2.0 application on a web 1.0 environment and not run into problems eventually. It's not like Digg, Reddit, or Facebook are running of a VPS or a Godaddy hosting account they are running dedicated racks co located around the planet.

If you expect to be a big site, then you should expect to run some heavy equipment.

As you explained in your post that you don't want to turn off URL validation. Well, this is the result of your decision. Frankly most people should be happy that it's even a possibility to turn this off. Even when you submit something to Digg, it tells you "Please wait while we check" This is done because it takes a ton of resources to do this, and they have a much better server environment than your VPS.

All I can suggest to you is to turn off URL validation during submit or take the plunge and go to a dedicated server.
If you are running a site that doesn't get much traffic and you possibly just imported a huge amount of content thinking that it would benefit you, purge it, cause it's not benefiting you..

[Jaffery]

Well, if my site gives me even fraction of digg or reddit then will go for dedicated or even cluster but problem is that, I am maintaining as had given a considerable time otherwise, there is nothing much I get other than able to pay expenses of VPS from this site.

However, those so many links developed over a long period, most of them credits to SPAM and automated submission, however now I am keeping eye and have done custom modifications and pligg is improved also so now spam submission are reduced to its 2-3% only what it used to have earlier ie. early days of pligg..

Well, just to add a wonderful fact here that before VPS, I had moved this site to a old dedicated box with P4 3 Ghz and 2 GB RAM and to my surprise, site was almost unusable on it, then I moved VPS as you are actually part of very high end server as with burstable RAM and CPU power feature (ie. if server is not busy, I almost enjoy full power of CPU and double RAM and not to mention RAID 10 hdds), and it solved the most of the problems. However, now a days there are no such loads problem (may be because I took measures to prevent automated submission).. as of now Pligg seems to be good on current VPS but I do want to be ready for future expansion once I promote my site !

[kevin4uguys]

i have the same issue like Jaffery , but my actual problem is my site get slow in the third step of submiting a story ...basicaly my site has more than 5k members n has huge stories...any how my hosting is vps hosting with a extremely gud bandwidth..... idont know what is the actual problem...according to my knowledge this happens only after i upgraded from 1.0.2 to 1.0.3 ..

can any one please solve dis issue Tamil10.com [தமிழ்10 ] - தமிழ் செய்திகள் இணையும் இடம்

[kevin4uguys]

guys please help me ....my site is realy going down

[Yankidank]

You never answered some questions from before. The important one being "what modules are you using?" The akismet or other modules that interact with the submission process may be the cause of your problem.