PDA

View Full Version : Pocket Legends is Down for Maintenance



Remiem
02-03-2015, 12:49 PM
Hello Legends!

Pocket Legends is currently down for maintenance and expected to be down for another 1-2 hours. The devs are doing some back-end work on updating the database servers. The game will be back up as soon as possible!

Remiem

Seoratrek
02-03-2015, 07:59 PM
Update: Maintenance is taking longer than expected and you may experience intermittent downtime throughout the evening. If you have any specific questions or concerns, please PM me.

Seoratrek

Seoratrek
02-03-2015, 11:06 PM
Update (9:25PM EDT): Pocket Legends continues to experience poor database performance that is causing extremely long load times for many players. We have brought the game down again to upgrade the disks and apply some other optimizations to the database server that we believe will resolve the problem. We expect the downtime to be no more than two hours and we'll post here when we bring the game back online. Once we've had a chance to review the entire maintenance process we'll post some more detailed information about what went wrong and what we're doing to prevent it in the future for this and all our other games.

Update (10:38PM EDT): We've upgraded the disks in the server, and applied some system settings that should improve performance but we are still seeing long load times for many players. We are continuing to work on the problem. We will post here again as soon as we have new information.

Again, many thanks for everyone's patience (and TzatOps for bringing the news) while we sort out the issue.

Krato5
02-04-2015, 03:44 PM
Hey everyone!

We just wanted to provide you with a little more information about the issues that were experienced with PL yesterday. We performed an upgrade of the database and operating system on the database servers. Once we started up the game, we noticed that our database was performing poorly and under an unusually high load. We also noticed that players were experiencing significantly long load times. This was a result of our database queries taking an extremely long amount of time to complete. We performed several tasks, such as, upgrading the volumes of the database to obtain higher IOPS and executing some clean up/performance optimization actions on the database tables, in an attempt to resolve the problem. Ultimately, the root cause of the problem was that our database was executing a certain query in a very inefficient manner. Instead of using an index scan on our tables, which completed the query in seconds, it used a sequential scan that took minutes to complete. In order to resolve this issue, we made a configuration change that would tell the database to prefer an index scan when executing queries. Once that was implemented, our queries finished quickly and performance returned to normal.

Just want to say thank you all for being patient with us! Apologies for the extremely long downtime, as I know it must have been frustrating having the game down for so long. Thanks again for bearing with us while we worked to find a solution! Have fun playing PL!