Update Monday 10/15
Members,
Engineering and Operations worked together throughout the weekend the identify and resolve the cause of the trouble with this avatar server. Issues with database performance were identified and new database tuning paramaters as well as changes to the data itself were tested.
This morning, Monday 10/15, we extended our maintenance window to deploy these fixes to address the problem. These fixes were deployed to all avatar servers. Avatar server 4 has not experienced the problem again all day! Operations would like to thank our Eng team for their help this weekend, and we'd like to thank you, our members, for your patience if you were impacted by this problem.
--There Operations
------
Update 10:30pm PT: This issue is still present. Our engineering group is working together with operations on troubleshooting to deploy a fix for the issue causing the server to crash and restart.
--
Update 1pm PT: We are still troubleshooting the issue on this server. Please note that due to the way avatar servers interact, servers that are otherwise healthy may experience "sympathy pains" due to the inability to contact the server that is down. This may cause issues for other members, including inability to log in, even though they are not on the down server.
--
Members homed on avatar server 4 may be experiencing login failures and/or other problems interacting with the There world, starting around service open today (5am PST), Saturday October 13, 2007.
Operations is working to resolve this issue ASAP.
=There_Monitor