Uploads offline to prepare for Cata

Asagi · Post by **Asagi** » Mon Dec 13, 2010 3:31 pm

Ah but they are only old after like 30 days. If I remember correctly.

1974ER · Post by **1974ER** » Mon Dec 13, 2010 5:44 pm

I posted the reasons against deletions in the thread in General discussion, so not repeating myself here.

FuxieDK · Post by **FuxieDK** » Mon Dec 13, 2010 10:43 pm

EpikPhailure wrote:It has been a week since the uploads went offline. My suggestion is to delete all the old updates and start over.

Just my 2 cents.

That would be the worst idea ever.. It would ruing updates at the most critial time in this sites history; At expansion release..

Without level-updates, we're left with nothing...

Post by **Rollie** » Tue Dec 14, 2010 8:39 am

I am planning on working on it more throughout the day as work permits. I'm as concerned as anyone else with the general performance of things lately.

Jonathan91 · Post by **Jonathan91** » Tue Dec 14, 2010 2:43 pm

We understand your time is limited Rollie. You take your time, do what needs to get done. We will be here for you when you?re ready. Day by day line by line.

Asagi · Post by **Asagi** » Tue Dec 14, 2010 8:10 pm

Oh I totally understand. Hence if there's anything we can do to help just ask!

Mean while I keep running the Census.

Post by **Rollie** » Wed Dec 15, 2010 8:55 am

Unfortunately I'm getting slammed with work... everyone trying to get stuff done before the holidays. I've been working 16 hour days for the past 5 days =/

PrimeKnight · Post by **PrimeKnight** » Wed Dec 15, 2010 10:36 am

Did you need help in fixing your database performance? Please let us know, or perhaps just explain what the problem is. I'm sure that we have a lot of people who work in software development or database administration. I would be very happy to help you out if you needed it.

Asagi · Post by **Asagi** » Wed Dec 15, 2010 1:21 pm

LOL, that's why I keep offering but I understand being slammed.

Post by **Rollie** » Thu Dec 16, 2010 12:57 pm

@Prime - I would be happy to have some folks offer suggestions to improve db performance.

I know of some things that can be done, but none of them are simple solutions that could be done on the same hardware without a lot of downtime.

MySQL 5.5 was just released yesterday which supposedly has much better support for partitioning and that would be very helpful. The problem is actually making that move.

gmmmpresser · Post by **gmmmpresser** » Thu Dec 16, 2010 3:09 pm

What I don't understand is why this has suddenly gone bad now?
We have had other upgrades & patches applied to the system without any major problems before, but since 4.0.3 (?) it appears as though the wheels have just fallen off.

1974ER · Post by **1974ER** » Fri Dec 17, 2010 2:43 am

Rollie can you give you much better answer than I can... My belief is that the database has simply grown to a size, where it is pressing the limits of the programs Rollie uses to manage it.

We have, according to the database stats base... just passed the 95 M characters marker... 95,014,599 character entries, says the page... before I went to bed it was still hovering around 94,981,xxx or so...

Balgair · Post by **Balgair** » Fri Dec 17, 2010 10:10 am

What ER said - this isn't the first time the site's had major database issues, due to the sheer size of it, but in the past, Rollie's usually managed to find a bandaid that's got it running again for a while. This time, it seems the scale is just too large for the current hardware limitations, hence it being rather harder to solve.

EpikPhailure · Post by **EpikPhailure** » Fri Dec 17, 2010 11:16 am

1974ER wrote:...We have, according to the database stats base... just passed the 95 M characters marker... 95,014,599 character entries, says the page... before I went to bed it was still hovering around 94,981,xxx or so...

Again, not to upset anyone, but really, there can not be 95 MIL toons on this game anymore, I feel that a good purge and restart would really help out this site, this addon, and more.
Anything over 30 days should be deleted.
In the interest of getting this addon back up and running, this database and site working again, sometimes sacrifices need to be made.

To those who feel that their hard work will be lost, I think you are loosing the big picture here.
This site and addon are to help people with current data, while there are some people I am sure who like old legacy data. Their numbers are much fewer than those who want the current stats.
I have heard this site discussed on my old realm, of Mal'Ganis, because of the free transfers in place now.
A lot of people want to know data before they take the plunge on a new site.
However at the current state, most people who don't know all the details except that the data on this site now is getting close to be over two weeks old, are loosing faith in it.

This again is all my two cents. Please don't attack me for my opinions.

Post by **Rollie** » Fri Dec 17, 2010 11:39 am

There is a purge of sorts taking place to cull out old, unplayed toons.

And yes, this has been a problem before. There is a critical mass of characters that once reached cause the database to really chug to make the necessary updates.

With proper partitioning and the appropriate application logic to handle it, it can be improved considerably, that just requires time, which is something I don't usually have a lot of, but lately I've had zero of.

IroncladzOTE · Post by **IroncladzOTE** » Sat Dec 18, 2010 2:50 pm

Still waiting!
So when is this update up?

Fett · Post by **Fett** » Sat Dec 18, 2010 7:01 pm

Well, let's see, on December 9 Rollie said that at the current rate it would take about 15 days. He hasn't had time to make the improvements he was hoping for, so my math says it should be complete about December 24. My guess is that updates will go back up after that. The moral of the story? Be patient.

EpikPhailure · Post by **EpikPhailure** » Sun Dec 19, 2010 12:09 am

Fett wrote:Well, let's see, on December 9 Rollie said that at the current rate it would take about 15 days. He hasn't had time to make the improvements he was hoping for, so my math says it should be complete about December 24. My guess is that updates will go back up after that. The moral of the story? Be patient.

Don't mess with the Fett!

Post by **Rollie** » Sun Dec 19, 2010 12:25 am

Hehe, well, I plan on bringing them back online before that.

1974ER · Post by **1974ER** » Sun Dec 19, 2010 7:51 am

I look forward to that, as I am already "sitting" on almost 40 .luas... which means that it will most likely take at least a couple of days before I have even gotten rid of most current backlog I have waiting...