• DEV
  • Developer
  • Offline

Topic: Datacenter maintenance - 2015-02-12

We have received the following, which will probably affect the Perpetuum servers:

Internap has announced the following maintenance:

Start Date: Wed, 11 Feb 2015 10PM EST
End Date: Thu, 12 Feb 2015 1AM EST

Location: AMS2 (Amsterdam)

Summary of Work: Switch Upgrade (software)

During this maintenance window, Agile Hosting engineers will be
upgrading the firmware on some of the switches in our AMS2 facility
to address defects with the current switch firmware.

Physical servers connected to the switches due for upgrade
will experience loss of connectivity for short periods of time
ranging from 5 to 15 minutes.

We thank you for your continued support while we work to make these improvements.

In server time (which is currently UTC+1), this means 04:00-07:00 on 12 Feb (tomorrow morning).

UPDATE:

Today's missing EP package has now been sent out to everyone. To make up for the longer downtime we have also sent an extra daily package (so altogether 2 days worth of EP for today).

2 Reply by Chemist (edited by Chemist 2015-02-11 18:06:49)

  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Good-Good.

Mr. Zoom, You did not give them my traceroute? What they say about this?

Fresh (1 min ago):

1    <1 мс    <1 мс    <1 мс  Home.RU [192.168.0.1]
2     3 ms     3 ms     3 ms  ksk-bbar2.ncc.sibirtelecom.ru [213.228.116.39]
3     3 ms     3 ms     3 ms  xe-1-3-0.ksk-dr2.ncc.sibirtelecom.ru [213.228.119.157]
4     5 ms     3 ms     3 ms  188.128.106.64
5   126 ms    80 ms    81 ms  xe-8-0-0.stkm-ar1.intl.ip.rostelecom.ru [87.226.133.227]
6   100 ms   100 ms    84 ms  s-b3-link.telia.net [213.248.95.105]
7   100 ms   117 ms    83 ms  s-bb3-link.telia.net [213.155.133.18]
8   133 ms   110 ms   108 ms  internap-gw.ip4.gtt.net [77.67.82.66]
9   107 ms   111 ms   108 ms  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
10   110 ms   108 ms   108 ms  95.172.88.206
11   108 ms   112 ms   107 ms  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
12   103 ms   102 ms   102 ms  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
13   107 ms   121 ms   124 ms  95.172.88.206
14   115 ms   109 ms   110 ms  relay.perpetuum-online.com [72.26.219.246]

  • TM-UAS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Thank you for keeping us posted.

@CodexMMO

4 Reply by Sieges (edited by Sieges 2015-02-11 19:28:39)

  • TM-UAS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Double post

@CodexMMO
  • NSE
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

DEV Zoom wrote:

We have received the following, which will probably affect the Perpetuum servers:

Internap has announced the following maintenance:

Start Date: Wed, 11 Feb 2015 10PM EST
End Date: Thu, 12 Feb 2015 1AM EST

Location: AMS2 (Amsterdam)

Summary of Work: Switch Upgrade (software)

During this maintenance window, Agile Hosting engineers will be
upgrading the firmware on some of the switches in our AMS2 facility
to address defects with the current switch firmware.

Physical servers connected to the switches due for upgrade
will experience loss of connectivity for short periods of time
ranging from 5 to 15 minutes.

We thank you for your continued support while we work to make these improvements.

In server time (which is currently UTC+1), this means 04:00-07:00 on 12 Feb (tomorrow morning).


What happened to 5-15 minutes....we have been down for more than an hour, a ticket will be forthcoming from some corpmates for an expired mining can.

  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Any technical works hint at what you need to complete all the works before they start and resume after the end of the technical work. You're a noob. lol cool

  • NSE
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Chemist wrote:

Any technical works hint at what you need to complete all the works before they start and resume after the end of the technical work. You're a noob. lol cool

I along with most people forgot about this, only remembered it after it went down...woulda been nice for a broadcast to happen

  • CIR
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

:tinfoil: the DEVs have actually run out of money & the servers are shutting down! tongue

True Pros make a Podcast to influence the Devs minds, 
The rest of you guys are Hacks tongue

PS. I got my Highways & stopped playing b4 they came in & have never used them! ...... Irony much ? tongue

9 Reply by Race Drones (edited by Race Drones 2015-02-12 11:02:35)

  • PHM
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 4:46:01 to 12/02/2015 4:52:35

Hop Sent Err   PL% Min Max Avg  Host Name / [IP]
...
8   145   0   0,0  61 121  68  xe-5-2-0.was12.ip4.tinet.net [213.200.84.121]
9   139   0   0,0 162 197 170  xe-11-2-3.ams12.ip4.gtt.net [89.149.128.17]
10   142   0   0,0 138 172 145  internap-gw.ip4.gtt.net [77.67.82.66]
11   138   0   0,0 137 205 145  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
12   128   0   0,0 138 175 146  [95.172.88.206]
13    26   0   0,0 139 159 146  [95.172.88.206]
14   131   1   0,8 137 183 148  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
15   130   8   6,2 138 172 144  relay.perpetuum-online.com [72.26.219.246]



Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 4:46:01 to 12/02/2015 4:53:07

Hop Sent Err   PL% Min Max Avg  Host Name / [IP]
...
9   143   0   0,0 162 197 170  xe-11-2-3.ams12.ip4.gtt.net [89.149.128.17]
10   146   0   0,0 138 172 145  internap-gw.ip4.gtt.net [77.67.82.66]
11   142   0   0,0 137 205 145  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
12   132   0   0,0 138 175 145  [95.172.88.206]
13   135   1   0,7 137 183 148  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
14    23   0   0,0 138 165 146  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
15   133   8   6,0 138 172 144  relay.perpetuum-online.com [72.26.219.246]

NO WAY!, HOP LOOPS EVERYWHERE.

--------------------------------------
Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 4:46:01 to 12/02/2015 5:21:14

Hop Sent Err   PL% Min  Max Avg  Host Name / [IP]
...
8   466   4   0,9  60 2092  72  xe-5-2-0.was12.ip4.tinet.net [213.200.84.121]
9   467   5   1,1 162 2163 174  xe-11-2-3.ams12.ip4.gtt.net [89.149.128.17]
10    22   0   0,0 163  185 169  xe-11-2-3.ams12.ip4.gtt.net [89.149.128.17]
11   462   4   0,9 137 2106 148  internap-gw.ip4.gtt.net [77.67.82.66]
12   462   4   0,9 137 2075 149  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
13   453   4   0,9 137 2054 150  [95.172.88.206]
14    64   0   0,0 138  168 147  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
15   432  22   5,1 137 1982 149  relay.perpetuum-online.com [72.26.219.246]
-----------------------------------------
Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 4:46:06 to 12/02/2015 5:28:51

Hop Sent Err   PL% Min  Max Avg  Host Name / [IP]
...
8   472   4   0,8  60 2092  72  xe-5-2-0.was12.ip4.tinet.net [213.200.84.121]
9     7   0   0,0 153  174 161  xe-1-0-7.ams12.ip4.gtt.net [89.149.180.145]
10   467   4   0,9 135 2106 148  internap-gw.ip4.gtt.net [77.67.82.66]
11    38   4  10,5 137  163 145  internap-gw.ip4.gtt.net [77.67.82.66]
12   468   4   0,9 136 2075 149  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
13   458   4   0,9 134 2054 150  [95.172.88.206]
14   438  23   5,3 136 1982 148  relay.perpetuum-online.com [72.26.219.246]

Ignorance is curable, Stupidity is not.
The "Planet of the Apes" is not science fiction, is a daily reality.
All is in "The Matrix".
See Beyond the Obvious.
  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Does anyone know of an e-mail telia.net? I want to ask why my traffic comes through their anus before it reaches the server perpetuum.

  • OTHERS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Just checking, the server is still down for everyone yeah ?

  • *
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

still down for me

  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

+

  • WaK
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

longest 15mins I ever seen

  • ETHOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

6 hours and counting!

16 Reply by Race Drones (edited by Race Drones 2015-02-12 14:31:19)

  • PHM
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

... and the silence says a lot.

(watching the lastnight episode from _The 100_ TV Serie).

Ignorance is curable, Stupidity is not.
The "Planet of the Apes" is not science fiction, is a daily reality.
All is in "The Matrix".
See Beyond the Obvious.
  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

5    80 ms    84 ms    77 ms  xe-8-0-0.stkm-ar1.intl.ip.rostelecom.ru [87.226.133.227]
  6    99 ms    82 ms    99 ms  ae2.stk30.ip4.gtt.net [77.67.95.153]
  7   106 ms    81 ms   105 ms  xe-7-3-0.ams12.ip4.gtt.net [89.149.182.41]
  8   102 ms    99 ms    97 ms  hbg-bb4-link.telia.net [213.155.130.11]
  9   100 ms   102 ms   103 ms  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
10   108 ms   104 ms   103 ms  95.172.88.206
11   100 ms   113 ms    97 ms  internap-ic-155294-adm-b2.c.telia.net [80.239.161.58]
12   100 ms   100 ms   100 ms  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
13   104 ms   100 ms   101 ms  relay.perpetuum-online.com [72.26.219.246]

Again... 3 extra node ... *** ...

  • WaK
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

everything is reset we all have to start new characters

  • ICS-DD
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

It would appear that your hosting provider disconnected the network cable to your server. You might want to give them a call and have them plug it back in. fuuu

20 Reply by Race Drones (edited by Race Drones 2015-02-12 15:25:42)

  • PHM
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 9:36:44 to 12/02/2015 9:39:30

Hop Sent Err   PL% Min Max Avg  Host Name / [IP]
,,,
8    62   0   0,0  61 132  87  xe-5-2-0.was12.ip4.tinet.net [213.200.84.121]
9    64   0   0,0 161 231 177  xe-9-1-2.ams12.ip4.gtt.net [89.149.180.53]
10    65   1   1,5 139 202 158  internap-gw.ip4.gtt.net [77.67.82.66]
11    59   1   1,7 138 199 157  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
12     8   0   0,0 140 212 160  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
13    58   0   0,0 138 223 159  [95.172.88.206]
14    67   0   0,0 139 211 162  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]

Destination not reached in 35 hops


Target Name: relay.perpetuum-online.com
         IP: 72.26.219.246
  Date/Time: 12/02/2015 9:36:44 to 12/02/2015 9:48:55

Hop Sent Err   PL% Min Max Avg  Host Name / [IP]
...
8    84   1   1,2  61 238  88  xe-5-2-0.was12.ip4.tinet.net [213.200.84.121]
9    86   0   0,0 161 265 179  xe-9-1-2.ams12.ip4.gtt.net [89.149.180.53]
10    86   1   1,2 139 202 157  internap-gw.ip4.gtt.net [77.67.82.66]
11    82   1   1,2 138 199 155  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
12    16   0   0,0 140 168 152  [95.172.88.206]
13    82   0   0,0 139 211 161  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
14    14   0   0,0 139 186 158  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]

Destination not reached in 35 hops

--------------------------------------------------------
0.te3-4.tsr1.ams2.nl.voxel.net is the end of the packets 35/67 (52%) of the time, and never reach relay.perpetuum-online.com.

EDIT: 35/91 (38%) the last trace.

EDIT: 100% Voxel technicians are sh¡t.

Ignorance is curable, Stupidity is not.
The "Planet of the Apes" is not science fiction, is a daily reality.
All is in "The Matrix".
See Beyond the Obvious.

21 Reply by Chemist (edited by Chemist 2015-02-12 15:27:21)

  • CHAOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

My ok:

5    79 ms    82 ms    80 ms  xe-8-0-0.stkm-ar1.intl.ip.rostelecom.ru [87.226.133.227]
6    83 ms   101 ms   100 ms  ae2.stk30.ip4.gtt.net [77.67.95.153]
7    81 ms   100 ms    80 ms  s-bb4-link.telia.net [80.91.249.216]
8    98 ms   101 ms   102 ms  hbg-bb4-link.telia.net [213.155.130.11]
9   108 ms   107 ms   104 ms  border1.tge8-1-bbnet2.ams004.pnap.net [95.172.78.66]
10   110 ms   108 ms   105 ms  adm-b2-link.telia.net [62.115.141.23]
11    99 ms   106 ms   102 ms  0.te3-4.tsr1.ams2.nl.voxel.net [173.231.161.121]
12   100 ms   106 ms   106 ms  relay.perpetuum-online.com [72.26.219.246]

But! each execution trace shows different results. A different route, and from 12 to 15 hops.

  • ETHOS
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

8 hours and still counting!!!

  • NSE
  • Agent
  • Offline

Re: Datacenter maintenance - 2015-02-12

I somehow knew when I went to sleep last night that I would wake up and the servers would still be down. Glad I didn't wait for it to be up.

  • DEV
  • Developer
  • Offline

Re: Datacenter maintenance - 2015-02-12

Server is back up, sorry about the long downtime.

  • DEV
  • Developer
  • Offline

Re: Datacenter maintenance - 2015-02-12

Noone received the daily EP package this morning, we're working on that.