Incidents reported on status page for Scaleblade https://status.scaleblade.com/ https://d1lppblt9t2x15.cloudfront.net/logos/76da0ebcb9cfc4dc1a8e7b1a3d5c7325.svg https://status.scaleblade.com/ en https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:51:29 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:51:29 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:51:29 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:30:00 +0000 https://status.scaleblade.com/incident/560170#8677dccfd8d455f4f493400eb2be3547cf480ff0f7a717a834bca785fae29ff7 Maintenance completed https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:30:00 +0000 https://status.scaleblade.com/incident/560170#8677dccfd8d455f4f493400eb2be3547cf480ff0f7a717a834bca785fae29ff7 Maintenance completed https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:30:00 +0000 https://status.scaleblade.com/incident/560170#8677dccfd8d455f4f493400eb2be3547cf480ff0f7a717a834bca785fae29ff7 Maintenance completed https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:00:00 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:00:00 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/560170 Mon, 12 May 2025 09:00:00 -0000 https://status.scaleblade.com/incident/560170#90229a3ca8b8fa1de3a3a5189c39f1d49ea21b618b7a13ae7c44b50387b44b21 We are making some final changes to our BGP configuration for our ddos protected services. This will allow us to complete the new London scrubbing site onboarding. We do not anticipate any changes however there could be brief interruption as routes change. https://status.scaleblade.com/incident/559743 Sat, 10 May 2025 14:05:00 -0000 https://status.scaleblade.com/incident/559743#bdf5da1aff3a787e217cf7cc6d0acb303d635254e20e59ec229acbfa7ccb2088 See the reason for outage for this incident provided by our 3rd Party DDoS mitigation provider in London: While performing routine maintenance to apply a config option for BGP at 2025-05-10 15:43:54 CET on one of our mitigation devices in Amsterdam, trying to address a relatively urgent issue, the BGP daemon lost connection to the control plane causing a short loss of routes and thus, packet loss on one of the mitigation devices. This is not expected to ever re-occur. https://status.scaleblade.com/incident/559743 Sat, 10 May 2025 13:45:00 -0000 https://status.scaleblade.com/incident/559743#71c88cd2c983ee1c34273a884e0321f0e51ff66e58b821330bd88944b74f3319 Issue has been confirmed resolved and traffic is not expected to be disrupted further. RFO to follow. https://status.scaleblade.com/incident/559743 Sat, 10 May 2025 13:43:00 -0000 https://status.scaleblade.com/incident/559743#cca44729222bf022217ea2acc06352f1b8064f895dc5f03bfefdf4de46ef5677 We have identified a drop in ddos protected traffic in our London datacenter. We are investigating this issue. https://status.scaleblade.com/incident/557475 Tue, 06 May 2025 14:45:37 +0000 https://status.scaleblade.com/incident/557475#9bac94c2c9a833a7cf2447c468be7c976215dab7dd2176f88de2d1bc1675da83 Maintenance completed https://status.scaleblade.com/incident/557475 Tue, 06 May 2025 14:18:37 -0000 https://status.scaleblade.com/incident/557475#3404037bda6e49ef3ad7e747614a118f4bcd000a57252c2f42a4b19079ae3304 We are doing an update the the backend metal provisioning platform. This will not affect customer systems. Operating system installs and power controls via the portal may be delayed/queued for the update. https://status.scaleblade.com/incident/552709 Mon, 28 Apr 2025 11:59:35 +0000 https://status.scaleblade.com/incident/552709#cb192ccd12eba17fb31747b48d4b656da33db664bdbbc3c95cf7d3d97a442c39 Maintenance completed https://status.scaleblade.com/incident/552709 Mon, 28 Apr 2025 06:00:35 -0000 https://status.scaleblade.com/incident/552709#6d9c65a0621a46692d31bfbdd45b6683d7b20a2ee7e24a5f3ad28737fe16108f We will be making changes to how we connect to our 3rd party mitigation provider in London in hopes of reducing latency and improving reliability in the site. This maintenance is expected to be non disruptive but you may see some traffic drops as routes rebalance. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 15:59:00 -0000 https://status.scaleblade.com/incident/532243#a7dd2e67faece9dd62fe19425fe4ecdf3a9904a144b5f79f34b1aed8800381a6 Customer accounts have been updated and credit has been applied. Any further issues please reach out to support or via your account manager. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 15:59:00 -0000 https://status.scaleblade.com/incident/532243#a7dd2e67faece9dd62fe19425fe4ecdf3a9904a144b5f79f34b1aed8800381a6 Customer accounts have been updated and credit has been applied. Any further issues please reach out to support or via your account manager. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 14:50:00 -0000 https://status.scaleblade.com/incident/532243#2e999f11bc59c0f60be6b2212d2d2f73f9697db534dac34ad94c710c2eca841c This incident has been resolved. Reason for outage is as follows: We initially took on a large attack with similar footprint to what we have been seeing the past few days, mostly targeting our infrastructure over ranges instead of specific client destinations. During this attack Datapacket's synchronisation between routers applied the protection measurements (ACLs) on their "backend" which generates the rules. This caused the rule for the attacks to be active way long after the attack had ended. It was apparently induced by a recent update of their backend software today and is now fully resolved and should not reoccur. Thresholds are now set to not interfere anymore when such an attacks are presented allowing for them to be processed further down the net-stack where they can be filtered in a non-disruptive way to live game-server based UDP traffic. The confirmed outage duration was from 13:41:40 GMT to 14:26:20 GMT. As a goodwill gesture, we will apply a 10% service credit to all affected services outside of our usual SLA. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 14:50:00 -0000 https://status.scaleblade.com/incident/532243#2e999f11bc59c0f60be6b2212d2d2f73f9697db534dac34ad94c710c2eca841c This incident has been resolved. Reason for outage is as follows: We initially took on a large attack with similar footprint to what we have been seeing the past few days, mostly targeting our infrastructure over ranges instead of specific client destinations. During this attack Datapacket's synchronisation between routers applied the protection measurements (ACLs) on their "backend" which generates the rules. This caused the rule for the attacks to be active way long after the attack had ended. It was apparently induced by a recent update of their backend software today and is now fully resolved and should not reoccur. Thresholds are now set to not interfere anymore when such an attacks are presented allowing for them to be processed further down the net-stack where they can be filtered in a non-disruptive way to live game-server based UDP traffic. The confirmed outage duration was from 13:41:40 GMT to 14:26:20 GMT. As a goodwill gesture, we will apply a 10% service credit to all affected services outside of our usual SLA. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 13:30:00 -0000 https://status.scaleblade.com/incident/532243#32e256d8c5a60606d901a19071f8de5eda1b37625dc18cea3159a17e04490fdb A fix has been put in place, we are monitoring traffic recovery currently. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 13:30:00 -0000 https://status.scaleblade.com/incident/532243#32e256d8c5a60606d901a19071f8de5eda1b37625dc18cea3159a17e04490fdb A fix has been put in place, we are monitoring traffic recovery currently. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 13:09:00 -0000 https://status.scaleblade.com/incident/532243#ae1d636964bc60c1180619d2b743b5625d64e1f6733f5d1e1e01c1d35b6a601f It has been confirmed this is due to a targeted infrastructure attack currently causing filtering issues with UDP. More information to come. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 13:09:00 -0000 https://status.scaleblade.com/incident/532243#ae1d636964bc60c1180619d2b743b5625d64e1f6733f5d1e1e01c1d35b6a601f It has been confirmed this is due to a targeted infrastructure attack currently causing filtering issues with UDP. More information to come. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 12:41:00 -0000 https://status.scaleblade.com/incident/532243#4a30a83ede5970c6f1a3f2d746a5e918135375208272e4e9607cdc5baff1817a We have noticed issues with UDP traffic on select prefixes with our DDoS protection provider. https://status.scaleblade.com/incident/532243 Fri, 21 Mar 2025 12:41:00 -0000 https://status.scaleblade.com/incident/532243#4a30a83ede5970c6f1a3f2d746a5e918135375208272e4e9607cdc5baff1817a We have noticed issues with UDP traffic on select prefixes with our DDoS protection provider. https://status.scaleblade.com/incident/525360 Mon, 10 Mar 2025 10:25:59 -0000 https://status.scaleblade.com/incident/525360#86f1ce1ed58e3c3a122e826fbaf1b279c59c7f698a9c28515047076c1ade36d7 We will be performing some emergency maintenance on our core routing stack due to a potential bug during deployment of the site. These works should alleviate some configuration issues that could be a culprit of some of the issues with outbound connections we have seen in the site the past few days. We don't expect this to cause anymore than a traffic drop, however we are performing this out of hours (pre-6AM localtime) in order to avoid peak time disruption to services. https://status.scaleblade.com/incident/525360 Mon, 10 Mar 2025 09:46:00 +0000 https://status.scaleblade.com/incident/525360#8fd9ed0fd038a62529438b8291349f6951679a26ffe048ef3f339fec9c7568a9 Maintenance completed https://status.scaleblade.com/incident/525360 Mon, 10 Mar 2025 09:35:57 -0000 https://status.scaleblade.com/incident/525360#86f1ce1ed58e3c3a122e826fbaf1b279c59c7f698a9c28515047076c1ade36d7 We will be performing some emergency maintenance on our core routing stack due to a potential bug during deployment of the site. These works should alleviate some configuration issues that could be a culprit of some of the issues with outbound connections we have seen in the site the past few days. We don't expect this to cause anymore than a traffic drop, however we are performing this out of hours (pre-6AM localtime) in order to avoid peak time disruption to services. https://status.scaleblade.com/incident/525360 Mon, 10 Mar 2025 09:30:00 -0000 https://status.scaleblade.com/incident/525360#86f1ce1ed58e3c3a122e826fbaf1b279c59c7f698a9c28515047076c1ade36d7 We will be performing some emergency maintenance on our core routing stack due to a potential bug during deployment of the site. These works should alleviate some configuration issues that could be a culprit of some of the issues with outbound connections we have seen in the site the past few days. We don't expect this to cause anymore than a traffic drop, however we are performing this out of hours (pre-6AM localtime) in order to avoid peak time disruption to services. https://status.scaleblade.com/incident/513472 Sat, 15 Feb 2025 15:41:00 -0000 https://status.scaleblade.com/incident/513472#4e0dbfca3e0269e6a37fe6f2cc1e88eee66014fc51c1c49cc0210e13936bf2aa Issue has resolved, awaiting RFO from GTT. https://status.scaleblade.com/incident/513472 Sat, 15 Feb 2025 15:41:00 -0000 https://status.scaleblade.com/incident/513472#4e0dbfca3e0269e6a37fe6f2cc1e88eee66014fc51c1c49cc0210e13936bf2aa Issue has resolved, awaiting RFO from GTT. https://status.scaleblade.com/incident/513472 Sat, 15 Feb 2025 15:37:00 -0000 https://status.scaleblade.com/incident/513472#b6255a54088bd85e3f1d96303a6b1bf0f28bb7e6029cd247fc8351700701a16f We observed an issue with GTT routes across all of our sites. We have confirmed that it has recovered and reached out to GTT for confirmation and RFO report. https://status.scaleblade.com/incident/513472 Sat, 15 Feb 2025 15:37:00 -0000 https://status.scaleblade.com/incident/513472#b6255a54088bd85e3f1d96303a6b1bf0f28bb7e6029cd247fc8351700701a16f We observed an issue with GTT routes across all of our sites. We have confirmed that it has recovered and reached out to GTT for confirmation and RFO report. https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:31:00 -0000 https://status.scaleblade.com/incident/506015#ace88674f911fa5c0302ba50cf1a74ae80ea822d75b3cbe04e05c821cf7fa329 The issue has been resolved, the root cause of the issue was an issue with our remotely triggered blackhole system for our services (non-third party ddos protected services) being triggered and subsequently re-routing one of our backhaul IPs on one of our core switches. This configuration issue was quickly resolved and we expect no further disruptions following this incident. Apologies for any inconvenience this disruption caused. https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:31:00 -0000 https://status.scaleblade.com/incident/506015#ace88674f911fa5c0302ba50cf1a74ae80ea822d75b3cbe04e05c821cf7fa329 The issue has been resolved, the root cause of the issue was an issue with our remotely triggered blackhole system for our services (non-third party ddos protected services) being triggered and subsequently re-routing one of our backhaul IPs on one of our core switches. This configuration issue was quickly resolved and we expect no further disruptions following this incident. Apologies for any inconvenience this disruption caused. https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:31:00 -0000 https://status.scaleblade.com/incident/506015#ace88674f911fa5c0302ba50cf1a74ae80ea822d75b3cbe04e05c821cf7fa329 The issue has been resolved, the root cause of the issue was an issue with our remotely triggered blackhole system for our services (non-third party ddos protected services) being triggered and subsequently re-routing one of our backhaul IPs on one of our core switches. This configuration issue was quickly resolved and we expect no further disruptions following this incident. Apologies for any inconvenience this disruption caused. https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:00:00 -0000 https://status.scaleblade.com/incident/506015#e7f95f18b112d6b31e35362e0427ca020c01e892c5388efdc8208ade695c35ab We are investigating an issue with unreachable services in London https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:00:00 -0000 https://status.scaleblade.com/incident/506015#e7f95f18b112d6b31e35362e0427ca020c01e892c5388efdc8208ade695c35ab We are investigating an issue with unreachable services in London https://status.scaleblade.com/incident/506015 Sun, 02 Feb 2025 14:00:00 -0000 https://status.scaleblade.com/incident/506015#e7f95f18b112d6b31e35362e0427ca020c01e892c5388efdc8208ade695c35ab We are investigating an issue with unreachable services in London https://status.scaleblade.com/incident/505100 Sat, 01 Feb 2025 05:30:48 +0000 https://status.scaleblade.com/incident/505100#0eebf153c456c82bf7f08b63f343f332f531e0c1c986891e218a3a752bea71b7 Maintenance completed https://status.scaleblade.com/incident/505100 Sat, 01 Feb 2025 05:30:48 +0000 https://status.scaleblade.com/incident/505100#0eebf153c456c82bf7f08b63f343f332f531e0c1c986891e218a3a752bea71b7 Maintenance completed https://status.scaleblade.com/incident/505100 Fri, 31 Jan 2025 15:50:48 -0000 https://status.scaleblade.com/incident/505100#4cd0500ab7e69989ace1cce63a63ce59bd7636f0dde5020a2897233f5367a067 Last night we recieved notification from Path that all european sites will be affected simultaneously by the recent outages as of 05:45AM tomorrow morning. Tonight Scaleblade will be moving path traffic over to another provider to ensure that we can still serve clients for the duration of the outage. This will be a temporary change so you may see increased latency in London and Dallas. Rule and filter updates will not work in the portal during this time. If you need a rule updating urgently please reach out to us via a ticket and we will do it manually as soon as we can. We are porting over all rules now so no further configuration should be needed on your end. We are doing the setup for this move now, when we start to reroute traffic there may be a brief disruption to connectivity over the Path subnets this is while we move the announcement off Path. https://status.scaleblade.com/incident/505100 Fri, 31 Jan 2025 15:50:48 -0000 https://status.scaleblade.com/incident/505100#4cd0500ab7e69989ace1cce63a63ce59bd7636f0dde5020a2897233f5367a067 Last night we recieved notification from Path that all european sites will be affected simultaneously by the recent outages as of 05:45AM tomorrow morning. Tonight Scaleblade will be moving path traffic over to another provider to ensure that we can still serve clients for the duration of the outage. This will be a temporary change so you may see increased latency in London and Dallas. Rule and filter updates will not work in the portal during this time. If you need a rule updating urgently please reach out to us via a ticket and we will do it manually as soon as we can. We are porting over all rules now so no further configuration should be needed on your end. We are doing the setup for this move now, when we start to reroute traffic there may be a brief disruption to connectivity over the Path subnets this is while we move the announcement off Path. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 21:39:00 -0000 https://status.scaleblade.com/incident/504003#04504e40b17478174d2560c377eddd1660a4c80c0c8faf7234ca54587089e1e8 This has been completed. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 21:39:00 -0000 https://status.scaleblade.com/incident/504003#04504e40b17478174d2560c377eddd1660a4c80c0c8faf7234ca54587089e1e8 This has been completed. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 21:39:00 -0000 https://status.scaleblade.com/incident/504003#04504e40b17478174d2560c377eddd1660a4c80c0c8faf7234ca54587089e1e8 This has been completed. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 21:39:00 -0000 https://status.scaleblade.com/incident/504003#04504e40b17478174d2560c377eddd1660a4c80c0c8faf7234ca54587089e1e8 This has been completed. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:53:00 -0000 https://status.scaleblade.com/incident/504003#c3e069e3acf9e5bae85f39205bbc8399e3e4571e009d5277964433c1f0aa6839 The change has been made on our end to modify the internal traffic routing. We are now monitoring to ensure traffic is not further impacted. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:53:00 -0000 https://status.scaleblade.com/incident/504003#c3e069e3acf9e5bae85f39205bbc8399e3e4571e009d5277964433c1f0aa6839 The change has been made on our end to modify the internal traffic routing. We are now monitoring to ensure traffic is not further impacted. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:53:00 -0000 https://status.scaleblade.com/incident/504003#c3e069e3acf9e5bae85f39205bbc8399e3e4571e009d5277964433c1f0aa6839 The change has been made on our end to modify the internal traffic routing. We are now monitoring to ensure traffic is not further impacted. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:53:00 -0000 https://status.scaleblade.com/incident/504003#c3e069e3acf9e5bae85f39205bbc8399e3e4571e009d5277964433c1f0aa6839 The change has been made on our end to modify the internal traffic routing. We are now monitoring to ensure traffic is not further impacted. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:20:00 -0000 https://status.scaleblade.com/incident/504003#d80768ee36b27f3b6c7d7a176c8884aeba02b4322a913f309cdc0a826e0f97b8 We have just been notified by one of our backhaul providers that there will be emergency maintenance on their switches at 10AM tomorrow. I order to avoid a sustained outage we are shifting some traffic around internally to alternative routes. Scaleblade VPS and Dedicated Server customers may notice a momentary blip in traffic (non ddos protected transit) while we do this. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:20:00 -0000 https://status.scaleblade.com/incident/504003#d80768ee36b27f3b6c7d7a176c8884aeba02b4322a913f309cdc0a826e0f97b8 We have just been notified by one of our backhaul providers that there will be emergency maintenance on their switches at 10AM tomorrow. I order to avoid a sustained outage we are shifting some traffic around internally to alternative routes. Scaleblade VPS and Dedicated Server customers may notice a momentary blip in traffic (non ddos protected transit) while we do this. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:20:00 -0000 https://status.scaleblade.com/incident/504003#d80768ee36b27f3b6c7d7a176c8884aeba02b4322a913f309cdc0a826e0f97b8 We have just been notified by one of our backhaul providers that there will be emergency maintenance on their switches at 10AM tomorrow. I order to avoid a sustained outage we are shifting some traffic around internally to alternative routes. Scaleblade VPS and Dedicated Server customers may notice a momentary blip in traffic (non ddos protected transit) while we do this. https://status.scaleblade.com/incident/504003 Wed, 29 Jan 2025 20:20:00 -0000 https://status.scaleblade.com/incident/504003#d80768ee36b27f3b6c7d7a176c8884aeba02b4322a913f309cdc0a826e0f97b8 We have just been notified by one of our backhaul providers that there will be emergency maintenance on their switches at 10AM tomorrow. I order to avoid a sustained outage we are shifting some traffic around internally to alternative routes. Scaleblade VPS and Dedicated Server customers may notice a momentary blip in traffic (non ddos protected transit) while we do this. https://status.scaleblade.com/incident/486675 Sat, 28 Dec 2024 13:38:00 -0000 https://status.scaleblade.com/incident/486675#e6a21b406da6ed0a02f1a293323cd74d299569c7e9492821ad41e0c20b23bfae We have replaced the hardware and all services on this hypervisor has been restored. We will issue the appropriate SLA balance by early next week to affected users. https://status.scaleblade.com/incident/486675 Wed, 25 Dec 2024 08:51:00 -0000 https://status.scaleblade.com/incident/486675#78f659d05ad1b818444e81bf4bcf72e70b3d299789646e5d7343dbb259fd8ad5 We are currently experiencing issues with one of our London hypervisors. We are currently investigating, due to the holidays and limited staffing we do not have an ETA to resolution at this time. https://status.scaleblade.com/incident/470184 Sun, 01 Dec 2024 19:00:50 +0000 https://status.scaleblade.com/incident/470184#0d0b25f6c16a5c070ebd88cb6484a392f3b500a4c047690db64560940b607769 Maintenance completed https://status.scaleblade.com/incident/470184 Sun, 01 Dec 2024 19:00:50 +0000 https://status.scaleblade.com/incident/470184#0d0b25f6c16a5c070ebd88cb6484a392f3b500a4c047690db64560940b607769 Maintenance completed https://status.scaleblade.com/incident/470184 Sat, 30 Nov 2024 14:13:50 -0000 https://status.scaleblade.com/incident/470184#c7038b3ff0a20625ae0d6555d308e8b72685db7aadde171e02cc619cd724314c Following on from this mornings maintenance some internal services are running in a reduced state. You may have issues with Metal Automated Reinstall and Customer BGP. If you need assistance please open a ticket on https://my.scaleblade.com and we will get back to you as soon as possible. https://status.scaleblade.com/incident/470184 Sat, 30 Nov 2024 14:13:50 -0000 https://status.scaleblade.com/incident/470184#c7038b3ff0a20625ae0d6555d308e8b72685db7aadde171e02cc619cd724314c Following on from this mornings maintenance some internal services are running in a reduced state. You may have issues with Metal Automated Reinstall and Customer BGP. If you need assistance please open a ticket on https://my.scaleblade.com and we will get back to you as soon as possible. https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 12:00:00 +0000 https://status.scaleblade.com/incident/451011#92257f2545399776084e034f9c03a7d5a783c1ce725d0cc5a6539101cb4ac410 Maintenance completed https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 12:00:00 +0000 https://status.scaleblade.com/incident/451011#92257f2545399776084e034f9c03a7d5a783c1ce725d0cc5a6539101cb4ac410 Maintenance completed https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 12:00:00 +0000 https://status.scaleblade.com/incident/451011#92257f2545399776084e034f9c03a7d5a783c1ce725d0cc5a6539101cb4ac410 Maintenance completed https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 12:00:00 +0000 https://status.scaleblade.com/incident/451011#92257f2545399776084e034f9c03a7d5a783c1ce725d0cc5a6539101cb4ac410 Maintenance completed https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 11:07:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 11:07:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 11:07:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 11:07:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 10:00:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 10:00:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 10:00:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/451011 Sat, 30 Nov 2024 10:00:00 -0000 https://status.scaleblade.com/incident/451011#e5b89d9103c23913c99654d59ba4d55424b3bee05e882de7f1517a809b46c5ab We will be upgrading our core routing and switching devices in LON1 (indirectly affecting LON2 for the duration of the maintenance). This upgrade is in line with our ongoing goals to improve connectivity and latency to our site(s) with network peers as well increase our service capacity, reliability and redundancy solutions. Saturday 30th 10:00AM GMT (local) we will begin the deployment steps needed to move traffic over to our new router/switches in the site (these will be setup the evening before). We expect there to be a brief outage between LON1 & LON2 due to there being a physical move of the XC's between equipment at the same time. We aim to re-establish connectivity within 15-20 minutes, 1 hour has been scheduled as the maximum time outage before restoring back to previous safe configuration in the event of unforeseen circumstances. No further action is required from clients. During the outage any emergency communication can be made directly via our noc email (noc@scaleblade.com). https://status.scaleblade.com/incident/424287 Thu, 05 Sep 2024 13:02:00 -0000 https://status.scaleblade.com/incident/424287#43fe6d3e03d72212d845d79806e7621fcf0950ee179dcd8805d80d51f45f742d Path has resolved this issue and notified us that no further disruption is expected. https://status.scaleblade.com/incident/424287 Wed, 04 Sep 2024 19:28:00 -0000 https://status.scaleblade.com/incident/424287#dd861f8d7957e1ac8f8d0430ac13b22b60cf91b6d157e84bbbf22edda79b27e0 We are currently seeing PL issues in London for our DDoS Protected customers. We are working with the Path Network team to try and get this resolved as soon as possible. https://status.scaleblade.com/incident/417270 Thu, 22 Aug 2024 06:00:00 +0000 https://status.scaleblade.com/incident/417270#5d72dfb11f974d53ce94837512be0f493f808b07454631fb395519d6202f845c Maintenance completed https://status.scaleblade.com/incident/417270 Thu, 22 Aug 2024 02:00:00 -0000 https://status.scaleblade.com/incident/417270#6608930bc22e119c823b58281ecc26863741a27808e229fb1ba39e0526124262 GTT has notified us of a maintenance window starting at 3am BST to 7am BST. We have moved all prefix traffic over to RETN for the evening, after the maintenance window has been confirmed resolved by GTT we will re-establish routes back. https://status.scaleblade.com/incident/398374 Sun, 28 Jul 2024 15:30:00 +0000 https://status.scaleblade.com/incident/398374#b60ed5c53188ffab314e19fc6c2e2d2eba0ca1c7222b4e8f7ddf5799ae5d0528 Maintenance completed https://status.scaleblade.com/incident/398374 Sun, 28 Jul 2024 11:30:00 -0000 https://status.scaleblade.com/incident/398374#969def1d77713c035c79c99bd38c551f50d5df61df56661343407ee095ff7bae Some systems within our old facility are due to be migrated over at the end of July. **If your system has already been moved it will not be affected by this move.** Affected customers will be reached out to via email by the end of Mon 15th July regarding the migration. Downtime is not expected to exceed 2hours. https://status.scaleblade.com/incident/398780 Tue, 16 Jul 2024 08:11:00 -0000 https://status.scaleblade.com/incident/398780#f6449d9a636c79dc56425c4fbd4d12b58e5c6e8e198a3d7d02b0b8d5b4e7d439 Hypervisor fully recovered. Due to increase in ambient temperature in the data hall in which this hypervisor is located, it caused the machine to shut down to avoid hardware failure due to elevated temperature. This has now been resolved and we do not expect further disruption. We apologize for any inconvenience caused by this and we thank you for your patience. https://status.scaleblade.com/incident/398780 Tue, 16 Jul 2024 07:36:00 -0000 https://status.scaleblade.com/incident/398780#efb9c659595e94f1180b947572d295e418905d805a6a00ee0918feb8e169223f We have implemented a fix and are monitoring the issue. https://status.scaleblade.com/incident/398780 Tue, 16 Jul 2024 06:57:00 -0000 https://status.scaleblade.com/incident/398780#83b3826fb1d6ea02d1fefd1dc23601a7d24b6963d42cc710adf9835ca4c67da2 Hypervisor offline due to hardware fault. One of our hypervisors are offline due to a hardware fault, we are investigating and working to resolve this issue as soon as possible for affected customers. https://status.scaleblade.com/incident/395168 Wed, 10 Jul 2024 16:00:00 +0000 https://status.scaleblade.com/incident/395168#2b687c64bb37fb72123ac5bd17cfa6681c05343ea6596b933823c4112002c5ae Maintenance completed https://status.scaleblade.com/incident/395168 Tue, 09 Jul 2024 08:00:00 -0000 https://status.scaleblade.com/incident/395168#568dbe7e8452ac810855f4713fba01c5e56445fbdedce47229e107b89d46204e Within this timeframe some clients may experience KVMs being inaccessible due to hardware upgrades and other reconfiguration of the KVMs for a lot of machines. This will not affect machine uptime, your machine will remain accessible. We will update this post as we proceed with the maintenance. https://status.scaleblade.com/incident/377505 Fri, 07 Jun 2024 16:00:00 +0000 https://status.scaleblade.com/incident/377505#02a3edcd01e289f00a7b6560a92b1c383eb73a1f20be6de4102075d5bb0afb05 Maintenance completed https://status.scaleblade.com/incident/377505 Wed, 05 Jun 2024 07:30:00 -0000 https://status.scaleblade.com/incident/377505#a3d0d43fd7a4c5c59eb242e05a8f9729654bdc1c32a8c86000d2b76dcf761e45 We have been notified about some upcoming power upgrades within our LON2 facility. The planned infrastructure upgrades to Generator systems on the dates and times shown. During this window, there will be a no impact to clients, unless there is a failure in the utility supply, whereby only a single power source may be available whilst these works are on-going. Please note, only loss of utility supply exceeding 2hrs will result in a single side power path loss, as we have this capacity currently available in our UPS systems. **Service Affecting:** No **Impact:** Single power supply, only if utility power is lost for a duration exceeding 2 hours. https://status.scaleblade.com/incident/378778 Tue, 04 Jun 2024 05:09:00 -0000 https://status.scaleblade.com/incident/378778#2f16a0078ac3d322ca5a454bf64dfca3a1b93afccc49b0a2673ffcd6ae1392b7 All remaining customer services have been confirmed restored and stable. If you are having issues with your particular configuration please reach out on the customer portal to our support staff. We apologize for any inconvenience caused by this. Blog post will follow addressing the incident and steps being taken to ensure something similar does not happen again in the future. Best regards, The Scaleblade Team https://status.scaleblade.com/incident/378778 Tue, 04 Jun 2024 03:22:00 -0000 https://status.scaleblade.com/incident/378778#15073b0e740bbd3dfaa614cc10dbfd7e98163ae1a0efaae47c7d4e05a2eba948 Service provider has restored dark fiber connection and we are slowly migrating services to route back over the dark fiber. https://status.scaleblade.com/incident/378778 Mon, 03 Jun 2024 19:48:00 -0000 https://status.scaleblade.com/incident/378778#01b26fef0bbbd40491e5b63c2fb07759794425103bcc0831fd841996a9ae8af6 We have put in place measures to ensure site is accessible. Some services (like customer BGP) will be degraded until Dark Fiber connection has been fully restored. https://status.scaleblade.com/incident/378778 Mon, 03 Jun 2024 13:30:00 -0000 https://status.scaleblade.com/incident/378778#1f2c6832d63a217e843f60e465828ddd7d58968354a8b0671ddaf0816de6b426 We have identified an issue with the Dark Fiber connecting our network and hardware in the London area. We have engineers en-route to resolve this issue and will update once we know more about the situation as well as the steps being taken to ensure this does not happen again. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 13:30:00 +0000 https://status.scaleblade.com/incident/348668#4f45cf637a47766c707c690a4bb5800cc4883d69cc3300bf2dd3b4166a45184a Maintenance completed https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 13:30:00 +0000 https://status.scaleblade.com/incident/348668#4f45cf637a47766c707c690a4bb5800cc4883d69cc3300bf2dd3b4166a45184a Maintenance completed https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 13:30:00 +0000 https://status.scaleblade.com/incident/348668#4f45cf637a47766c707c690a4bb5800cc4883d69cc3300bf2dd3b4166a45184a Maintenance completed https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 13:30:00 +0000 https://status.scaleblade.com/incident/348668#4f45cf637a47766c707c690a4bb5800cc4883d69cc3300bf2dd3b4166a45184a Maintenance completed https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 12:28:54 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 12:28:54 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 12:28:54 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 12:28:54 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 08:40:56 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 08:40:56 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 08:40:56 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 08:40:56 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 07:00:00 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 07:00:00 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 07:00:00 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/348668 Sun, 05 May 2024 07:00:00 -0000 https://status.scaleblade.com/incident/348668#6a0e202c7cd79e9f2482958d36f462f04613b16c66a73a5bb06d27567ab68d33 On May 5th we will be bringing online our new LON2 pop. Some dedicated servers and our cloud hypervisor cluster have been scheduled to move to this new facility. We expect this to take place on 5th May 2024 starting from 8am BST. Clients that will be affected by this move will be notified by Monday 8th April. More details to follow (This date/time is preliminary and subject to change). **Update - 08/04/2024 17:00:00 BST** An email has been sent out to users that will need an IP renumbering prior to the move in order to minimize the disruption window on the day. Please check your inbox regarding instructions on what needs to be done. Please reach out in a ticket or to noc@scaleblade.com if you have any questions or need assistance with this. **Update - 25/04/2024 10:00:00 BST** Yesterday emails were sent out to all clients in the LON3 pop giving final details and an updated timeline for the maintenance window. We will start the maintenance window from 08:00:00 BST on May 5th with us expecting to start physical disconnections and equipment move around 08:20:00 BST. We are hoping to have internal services restored and back within a 90 minute window however the maintenance period is set until 14:30:00 BST to account for any unforeseen issues. In the event the maintenance window overruns, we will supply detailed updates where possible via this maintenance page. Once the maintenance is completed on our end we will mark this as resolved and send out an email to clients notifying of this. If you are still having issues after this email has been received please ensure to open a ticket via our portal for support or reach out to your account representative. https://status.scaleblade.com/incident/356340 Tue, 16 Apr 2024 20:42:00 -0000 https://status.scaleblade.com/incident/356340#84c0d9581aea35675a81d06e0a71abbc35d6952a53bbaf341bb7b62f3b938555 We are now seeing regular latency with the search API. We will continue to monitor and co-ordinate with Stripe on a root cause. https://status.scaleblade.com/incident/356340 Tue, 16 Apr 2024 17:57:00 -0000 https://status.scaleblade.com/incident/356340#983193e65759fbe92ca476934d73f85b32af5bab7b123887da72b8c9106a83f3 Stripe has acknowledged an issue on their end causing data availability delay for the Search API. They are aware of the issue and are seeing some recovery, though their engineering teams continue to actively investigate the root cause. https://status.scaleblade.com/incident/356340 Tue, 16 Apr 2024 15:56:00 -0000 https://status.scaleblade.com/incident/356340#577c1226b98976e4f282ada5c1e00e3eb8b72258b9d0e9f963f44078e69d508c We are noticing a delay in responses from our payment api to client endpoints. This is currently causing issues when displaying new invoices that are generated. We are investigating the issue and will update when we have further information. https://status.scaleblade.com/incident/341153 Fri, 15 Mar 2024 09:19:00 -0000 https://status.scaleblade.com/incident/341153#872bb0e7efe1441d3d0e6999f6eb2baf1f797c86b1032cd59e0fef8bb3766f18 Issue with our automatic api deployment after a system update performed yesterday evening was identified and corrected. No further disruption is expected. https://status.scaleblade.com/incident/341153 Fri, 15 Mar 2024 07:49:00 -0000 https://status.scaleblade.com/incident/341153#b42ed8729070e87058b8c91f5a97bed5df8eb311149a7efd4a123a0e0588335c We are currently experiencing issues with our API authentication, this is resulting in errors when attempting to log in or reset password on the portal. No client services are affected at this time. For urgent enquiries reach out to noc@scaleblade.com via email. https://status.scaleblade.com/incident/332211 Tue, 27 Feb 2024 16:42:00 +0000 https://status.scaleblade.com/incident/332211#938521e0c82d69844e9024d3b71a59ecc7b4313160dea1e75287bf0b892f8446 Maintenance completed https://status.scaleblade.com/incident/332211 Mon, 26 Feb 2024 20:09:52 -0000 https://status.scaleblade.com/incident/332211#d9030fea9d2c360f2b4cc495e1019ce9497458fcede976537a22038c70ae55ad We are investigating a problem with one of our cloud server nodes, while we are rectifying this affected customers will be relayed over to a backup device. Some downtime will occur to facilitate this migration. https://status.scaleblade.com/incident/332211 Mon, 26 Feb 2024 16:42:00 -0000 https://status.scaleblade.com/incident/332211#d9030fea9d2c360f2b4cc495e1019ce9497458fcede976537a22038c70ae55ad We are investigating a problem with one of our cloud server nodes, while we are rectifying this affected customers will be relayed over to a backup device. Some downtime will occur to facilitate this migration. https://status.scaleblade.com/incident/326651 Fri, 16 Feb 2024 10:54:00 -0000 https://status.scaleblade.com/incident/326651#68a5ce32c4803d06fc2b1ad9dd4048a23b2d8cf40c1ceb8828d4586a72343db2 IPv6 connectivity spiked after Cogent depeered with one of our T1 upstream. Prefixes have been announced over another T1 to mitigate this issue. https://status.scaleblade.com/incident/326651 Wed, 14 Feb 2024 10:51:00 -0000 https://status.scaleblade.com/incident/326651#abf0e5bde9c056ba09428386dde8e061b88deeb48c81b4894d6ea05513e314fe We have identified an issue with our ipv6 routing via AS30456 resulting in increased latency to other peers. They are aware of the issue and we are looking to resolve this issue as soon as possible. https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 23:30:00 +0000 https://status.scaleblade.com/incident/293930#7c367c0c8179d28f1793b4becdd9af1f153cc4ca7e8290c7b8c2421a9077c293 Maintenance completed https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 23:30:00 +0000 https://status.scaleblade.com/incident/293930#7c367c0c8179d28f1793b4becdd9af1f153cc4ca7e8290c7b8c2421a9077c293 Maintenance completed https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 23:30:00 +0000 https://status.scaleblade.com/incident/293930#7c367c0c8179d28f1793b4becdd9af1f153cc4ca7e8290c7b8c2421a9077c293 Maintenance completed https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 17:00:00 -0000 https://status.scaleblade.com/incident/293930#d92232a89d44242581041ab17879c0359fbeedea4ce3fa876e30fdf1938b6a54 We will be performing maintenance to one of the switches in our client cabinets. During the window we intend to failover customers to our relay switch in that space. There will be a brief interruption to services as we switch over. https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 17:00:00 -0000 https://status.scaleblade.com/incident/293930#d92232a89d44242581041ab17879c0359fbeedea4ce3fa876e30fdf1938b6a54 We will be performing maintenance to one of the switches in our client cabinets. During the window we intend to failover customers to our relay switch in that space. There will be a brief interruption to services as we switch over. https://status.scaleblade.com/incident/293930 Mon, 04 Dec 2023 17:00:00 -0000 https://status.scaleblade.com/incident/293930#d92232a89d44242581041ab17879c0359fbeedea4ce3fa876e30fdf1938b6a54 We will be performing maintenance to one of the switches in our client cabinets. During the window we intend to failover customers to our relay switch in that space. There will be a brief interruption to services as we switch over. https://status.scaleblade.com/incident/293929 Thu, 30 Nov 2023 19:00:00 +0000 https://status.scaleblade.com/incident/293929#4444ce262d61f7c3c096ba0327b2769f27cb6cd95f059239a95f854af877da08 Maintenance completed https://status.scaleblade.com/incident/293929 Thu, 30 Nov 2023 14:00:00 -0000 https://status.scaleblade.com/incident/293929#52d7f27ba09647f96506951ca0305c84cd0c38389be1db8f318cff61dc73103a We will be performing maintenance on our Portal API to better prepare for our Cloud Instance product release. During this time there may be a period where tickets and billing with be unavailable. All client services will be unaffected. https://status.scaleblade.com/incident/280811 Wed, 01 Nov 2023 08:52:00 -0000 https://status.scaleblade.com/incident/280811#5ea049f04d35f7d3bf871b0fcb6256ef2e41a890bc0a976e4de72963af0cdc15 While debugging an issue with recaptcha on our portal, the API was restarted several times resulting in some unavailability. We have found the root cause of the problem to be with DNS resolving of the google.com domain and have implemented a fix. We do not expect any further downtime. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:38:00 -0000 https://status.scaleblade.com/incident/279600#1b9831b30801f20444d716ccdb187820d25ba5ed3674f34421553813d3bb9689 **Post-mortem:** 08:53AM we were notified of an outage of all client services in our London location. 08:55AM as30456 noc team were notified of the outage requesting assistance. 09:02AM we identified the cause of the issue being all ipv4 prefixes within London had been dropped. 09:11AM we received acknowledgement from an engineer at as30456 investigating the issue. 09:17AM our ipv4 prefixes were re-routed after a soft bgp session refresh on as30456-side 09:18AM we received notification that our services had started recovering. We are yet to receive information in regards to the root cause of this issue, however we believe it to be related to an bgp filter reconciliation issue. We do not expect any further disruption to any client services. We thank you for your patience. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:38:00 -0000 https://status.scaleblade.com/incident/279600#1b9831b30801f20444d716ccdb187820d25ba5ed3674f34421553813d3bb9689 **Post-mortem:** 08:53AM we were notified of an outage of all client services in our London location. 08:55AM as30456 noc team were notified of the outage requesting assistance. 09:02AM we identified the cause of the issue being all ipv4 prefixes within London had been dropped. 09:11AM we received acknowledgement from an engineer at as30456 investigating the issue. 09:17AM our ipv4 prefixes were re-routed after a soft bgp session refresh on as30456-side 09:18AM we received notification that our services had started recovering. We are yet to receive information in regards to the root cause of this issue, however we believe it to be related to an bgp filter reconciliation issue. We do not expect any further disruption to any client services. We thank you for your patience. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:38:00 -0000 https://status.scaleblade.com/incident/279600#1b9831b30801f20444d716ccdb187820d25ba5ed3674f34421553813d3bb9689 **Post-mortem:** 08:53AM we were notified of an outage of all client services in our London location. 08:55AM as30456 noc team were notified of the outage requesting assistance. 09:02AM we identified the cause of the issue being all ipv4 prefixes within London had been dropped. 09:11AM we received acknowledgement from an engineer at as30456 investigating the issue. 09:17AM our ipv4 prefixes were re-routed after a soft bgp session refresh on as30456-side 09:18AM we received notification that our services had started recovering. We are yet to receive information in regards to the root cause of this issue, however we believe it to be related to an bgp filter reconciliation issue. We do not expect any further disruption to any client services. We thank you for your patience. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:38:00 -0000 https://status.scaleblade.com/incident/279600#1b9831b30801f20444d716ccdb187820d25ba5ed3674f34421553813d3bb9689 **Post-mortem:** 08:53AM we were notified of an outage of all client services in our London location. 08:55AM as30456 noc team were notified of the outage requesting assistance. 09:02AM we identified the cause of the issue being all ipv4 prefixes within London had been dropped. 09:11AM we received acknowledgement from an engineer at as30456 investigating the issue. 09:17AM our ipv4 prefixes were re-routed after a soft bgp session refresh on as30456-side 09:18AM we received notification that our services had started recovering. We are yet to receive information in regards to the root cause of this issue, however we believe it to be related to an bgp filter reconciliation issue. We do not expect any further disruption to any client services. We thank you for your patience. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:17:00 -0000 https://status.scaleblade.com/incident/279600#5f30b065ba3d68f4d26e9a3f2e3ace96bfb8d53b8118bfd7c539410b41f8a134 All systems recovered, post-mortem on situation to follow. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:17:00 -0000 https://status.scaleblade.com/incident/279600#5f30b065ba3d68f4d26e9a3f2e3ace96bfb8d53b8118bfd7c539410b41f8a134 All systems recovered, post-mortem on situation to follow. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:17:00 -0000 https://status.scaleblade.com/incident/279600#5f30b065ba3d68f4d26e9a3f2e3ace96bfb8d53b8118bfd7c539410b41f8a134 All systems recovered, post-mortem on situation to follow. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:17:00 -0000 https://status.scaleblade.com/incident/279600#5f30b065ba3d68f4d26e9a3f2e3ace96bfb8d53b8118bfd7c539410b41f8a134 All systems recovered, post-mortem on situation to follow. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:15:00 -0000 https://status.scaleblade.com/incident/279600#3c27ac4df7328463f836f89f524118a88d20969c8af78b78be9c7dc0ff866e86 CosmicGuard NOC has acknowledged the issue and is currently investigating the cause. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:15:00 -0000 https://status.scaleblade.com/incident/279600#3c27ac4df7328463f836f89f524118a88d20969c8af78b78be9c7dc0ff866e86 CosmicGuard NOC has acknowledged the issue and is currently investigating the cause. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:15:00 -0000 https://status.scaleblade.com/incident/279600#3c27ac4df7328463f836f89f524118a88d20969c8af78b78be9c7dc0ff866e86 CosmicGuard NOC has acknowledged the issue and is currently investigating the cause. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 09:15:00 -0000 https://status.scaleblade.com/incident/279600#3c27ac4df7328463f836f89f524118a88d20969c8af78b78be9c7dc0ff866e86 CosmicGuard NOC has acknowledged the issue and is currently investigating the cause. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 08:53:00 -0000 https://status.scaleblade.com/incident/279600#fbd404815132feddabead826830b9326002d0ba5f06d44eaf28b06cd91821ada We are currently suffering a outage in London for our IPv4 connectivity. We have investigated and found that CosmicGuard (Upstream AS30456) has dropped our v4 prefixes. We are working with their NOC team on a resolution. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 08:53:00 -0000 https://status.scaleblade.com/incident/279600#fbd404815132feddabead826830b9326002d0ba5f06d44eaf28b06cd91821ada We are currently suffering a outage in London for our IPv4 connectivity. We have investigated and found that CosmicGuard (Upstream AS30456) has dropped our v4 prefixes. We are working with their NOC team on a resolution. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 08:53:00 -0000 https://status.scaleblade.com/incident/279600#fbd404815132feddabead826830b9326002d0ba5f06d44eaf28b06cd91821ada We are currently suffering a outage in London for our IPv4 connectivity. We have investigated and found that CosmicGuard (Upstream AS30456) has dropped our v4 prefixes. We are working with their NOC team on a resolution. https://status.scaleblade.com/incident/279600 Mon, 30 Oct 2023 08:53:00 -0000 https://status.scaleblade.com/incident/279600#fbd404815132feddabead826830b9326002d0ba5f06d44eaf28b06cd91821ada We are currently suffering a outage in London for our IPv4 connectivity. We have investigated and found that CosmicGuard (Upstream AS30456) has dropped our v4 prefixes. We are working with their NOC team on a resolution. https://status.scaleblade.com/incident/275313 Sat, 28 Oct 2023 13:30:00 +0000 https://status.scaleblade.com/incident/275313#a38cca5685ccf3ae1a8f825aa4ac8ae7a98e14ea28cf621c03f8245c373c83cc Maintenance completed https://status.scaleblade.com/incident/275313 Sat, 28 Oct 2023 09:30:00 -0000 https://status.scaleblade.com/incident/275313#76e54318f7a2f20793cbbd3dc71843fad2a727aa4240c5ebbbd7ee0c48c344f4 On Saturday 28th October we will be performing a move to select customers based in our London location. This is to allow us to better utilize existing space and power restrictions in our existing space. Affected clients will be emailed to notify them that they will be affected by the end of day on Tuesday 24th October. Any individual service will not be down for longer than 5-10 minutes at any given time. Services will be moved one-by-one and their connectivity status confirmed after reconnection. Edit: Final emails are being sent out today by noon. https://status.scaleblade.com/incident/277801 Thu, 26 Oct 2023 04:24:00 +0000 https://status.scaleblade.com/incident/277801#c44e8aae1a44ac75e5a4ffde11f5e42f8068a770739519bb2ce3de323afadef0 Maintenance completed https://status.scaleblade.com/incident/277801 Thu, 26 Oct 2023 03:24:00 -0000 https://status.scaleblade.com/incident/277801#706a2d78ffcc86aa6e3ee93aa2faac4b88fe9f3d77681742c98c99d77c22ca7f Performing some routine API maintenance https://status.scaleblade.com/incident/265064 Sun, 01 Oct 2023 15:25:40 +0000 https://status.scaleblade.com/incident/265064#cd36ba730e87d4d38a4f1c2dcdc778313d21b1d425c61cb01c7b58f77aedac4c Maintenance completed https://status.scaleblade.com/incident/265064 Sun, 01 Oct 2023 15:25:40 -0000 https://status.scaleblade.com/incident/265064#4c9ee2402c4688259cd176681b0c360eb91a7a3a8418814749071889496118bc We will be bringing down our client API for maintenance during this hour, this is to help prepare support for an update within our client and services portal. This downtime will not directly affect customer services however you will be unable to control, restart, stop, start or reinstall your services via the panel during this window. Edit (30/09): Maintenance delayed by 1hr due to staffing reasons. https://status.scaleblade.com/incident/265064 Sun, 01 Oct 2023 14:30:00 -0000 https://status.scaleblade.com/incident/265064#4c9ee2402c4688259cd176681b0c360eb91a7a3a8418814749071889496118bc We will be bringing down our client API for maintenance during this hour, this is to help prepare support for an update within our client and services portal. This downtime will not directly affect customer services however you will be unable to control, restart, stop, start or reinstall your services via the panel during this window. Edit (30/09): Maintenance delayed by 1hr due to staffing reasons. https://status.scaleblade.com/incident/260130 Sat, 23 Sep 2023 15:00:00 +0000 https://status.scaleblade.com/incident/260130#0435003ecd010bacce3a1557df24bf45ed06555216773e16bc05332330e613e1 Maintenance completed https://status.scaleblade.com/incident/260130 Sat, 23 Sep 2023 11:00:00 -0000 https://status.scaleblade.com/incident/260130#22fd3460a9151e1e84ef14499b607317ac52902473a9026fe86f584257dde6dc We are scheduling in a migration window for select customers to allow us to better optimise power availability in our London site. Customers that are directly affected should not see outages lasting longer than 5-10 minutes for any individual customer at a time. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:29:00 -0000 https://status.scaleblade.com/incident/258239#2072dff454e75c58d1d6775b1612aa1ed46ddf97cf0136a8b0fdf545dc97f023 It has been confirmed that everything is recovered and back to normal operations. Apologies for the disruption caused. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:29:00 -0000 https://status.scaleblade.com/incident/258239#2072dff454e75c58d1d6775b1612aa1ed46ddf97cf0136a8b0fdf545dc97f023 It has been confirmed that everything is recovered and back to normal operations. Apologies for the disruption caused. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:29:00 -0000 https://status.scaleblade.com/incident/258239#2072dff454e75c58d1d6775b1612aa1ed46ddf97cf0136a8b0fdf545dc97f023 It has been confirmed that everything is recovered and back to normal operations. Apologies for the disruption caused. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:29:00 -0000 https://status.scaleblade.com/incident/258239#2072dff454e75c58d1d6775b1612aa1ed46ddf97cf0136a8b0fdf545dc97f023 It has been confirmed that everything is recovered and back to normal operations. Apologies for the disruption caused. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:07:00 -0000 https://status.scaleblade.com/incident/258239#7937baf1b3c9ac153475a0b042a25278ce1c8da4f059d1dc12aa33b498dd5929 We just had brief connectivity issues in London, a fix has been implemented by our upstream and we are monitoring for changes now. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:07:00 -0000 https://status.scaleblade.com/incident/258239#7937baf1b3c9ac153475a0b042a25278ce1c8da4f059d1dc12aa33b498dd5929 We just had brief connectivity issues in London, a fix has been implemented by our upstream and we are monitoring for changes now. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:07:00 -0000 https://status.scaleblade.com/incident/258239#7937baf1b3c9ac153475a0b042a25278ce1c8da4f059d1dc12aa33b498dd5929 We just had brief connectivity issues in London, a fix has been implemented by our upstream and we are monitoring for changes now. https://status.scaleblade.com/incident/258239 Tue, 12 Sep 2023 09:07:00 -0000 https://status.scaleblade.com/incident/258239#7937baf1b3c9ac153475a0b042a25278ce1c8da4f059d1dc12aa33b498dd5929 We just had brief connectivity issues in London, a fix has been implemented by our upstream and we are monitoring for changes now. https://status.scaleblade.com/incident/234984 Wed, 19 Jul 2023 23:00:00 +0000 https://status.scaleblade.com/incident/234984#3686b3d363ced94de9d367c24c2af57b5a1a85f66f0732b6d0ef0ce3a7e4cae1 Maintenance completed https://status.scaleblade.com/incident/234984 Wed, 19 Jul 2023 19:06:00 -0000 https://status.scaleblade.com/incident/234984#3de28b97a1623f48af1beda89be3ac2861d371d9678bbae35f65db8fe6aab078 We're working on migrating over to our new (v2) panel platform for our customer billing and services api/panel. During this time you may find yourself unable to login or access client billing services. Hosting services will not be affected. https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 17:01:00 -0000 https://status.scaleblade.com/incident/207040#992b867b984d16208cd8bc4fd8f9ec0ca4ddc8d4951d4cde36d8cea4e9907e27 This issue has been resolved https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 17:01:00 -0000 https://status.scaleblade.com/incident/207040#992b867b984d16208cd8bc4fd8f9ec0ca4ddc8d4951d4cde36d8cea4e9907e27 This issue has been resolved https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 16:57:00 -0000 https://status.scaleblade.com/incident/207040#85184e01e07f09ba3dc3f06f2f4c4fa12f1868cfe5f14f30a0c89d23e76af6f2 The scope of the issues have been confirmed to only be affecting our portal api and landing page website. No client services are affected. https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 16:57:00 -0000 https://status.scaleblade.com/incident/207040#85184e01e07f09ba3dc3f06f2f4c4fa12f1868cfe5f14f30a0c89d23e76af6f2 The scope of the issues have been confirmed to only be affecting our portal api and landing page website. No client services are affected. https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 16:43:00 -0000 https://status.scaleblade.com/incident/207040#f09d58120db57ac0dbc5b3bede2f9b2f787ac778fc61edea5b4a22abb4e7727f We are observing issues with Cloudflare's edge tunnels (cloudflared), we are currently investigating. https://status.scaleblade.com/incident/207040 Sat, 13 May 2023 16:43:00 -0000 https://status.scaleblade.com/incident/207040#f09d58120db57ac0dbc5b3bede2f9b2f787ac778fc61edea5b4a22abb4e7727f We are observing issues with Cloudflare's edge tunnels (cloudflared), we are currently investigating. https://status.scaleblade.com/incident/201259 Fri, 28 Apr 2023 08:33:00 -0000 https://status.scaleblade.com/incident/201259#1e50e9f52efbfd6021e4a92232acd096fdf065ec3c7523808b3946a978c95d57 A majority of our customers are back online and we do not expect any further disruption to these services. We are aware of a few cases where recovery has not been completed, we are working with our on-site partners to get these back up. Please keep an eye on communication channels (discord/email) as a member of the team may reach out regarding next steps and further updates related to your service. **If you are still having issues with your service and we have not communicated that we are aware of your situation please reach out via a ticket as soon as possible.** https://status.scaleblade.com/incident/201259 Fri, 28 Apr 2023 05:55:00 -0000 https://status.scaleblade.com/incident/201259#47a3fe8eaae3918662df3b9cb9b65a7811d3788c10c3c813b05ebf1bf33543f9 Most services have recovered, we are just dealing with the final few servers that shutdown due to the 90 deg ambient temperatures during the initial outage. Full post-mortem and SLA notice to come. https://status.scaleblade.com/incident/201259 Fri, 28 Apr 2023 00:49:00 -0000 https://status.scaleblade.com/incident/201259#d21b8983daff56364805868e2affe2b414ce104f6f2a474ac3f6fb90ba5b2de2 At 1:49AM we were notified of the fire suppression systems being triggered in Docklands DC. We are investigating the incident currently with technicians on site. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 10:15:00 +0000 https://status.scaleblade.com/incident/183023#4d8ddbeacf1100a985e93812e3ad3d41332160398044d4911ebabfe31fcbdef7 Maintenance completed https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 10:15:00 +0000 https://status.scaleblade.com/incident/183023#4d8ddbeacf1100a985e93812e3ad3d41332160398044d4911ebabfe31fcbdef7 Maintenance completed https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 10:15:00 +0000 https://status.scaleblade.com/incident/183023#4d8ddbeacf1100a985e93812e3ad3d41332160398044d4911ebabfe31fcbdef7 Maintenance completed https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:01:33 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:01:33 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:01:33 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:00:00 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:00:00 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/183023 Fri, 24 Mar 2023 09:00:00 -0000 https://status.scaleblade.com/incident/183023#bd7b3f6f33eba23bfe715af264d28773227847d87b6613ffa3f3e44fe006cc34 This maintenance is expected to cause a brief interruption while we relay onto our new switching infrastructure. This is designed to introduce higher upstream capacity as well as allow for future expansion within the site and allow larger port and commit size for colocation clients. **There is expected to be a brief interruption while our upstream BGP sessions swap to the new switch.** 45 minutes have been scheduled to allow adequate time for the swap, actual downtime should not exceed 5 minutes. https://status.scaleblade.com/incident/182191 Tue, 07 Mar 2023 16:00:00 +0000 https://status.scaleblade.com/incident/182191#a9b988446751c531692db6fde2ffce0c247280a443265d44e3194772d84540bb Maintenance completed https://status.scaleblade.com/incident/182191 Tue, 07 Mar 2023 14:00:00 -0000 https://status.scaleblade.com/incident/182191#80b5ef47b8ecff02c204e4ec511f911ebfb01bdbb3450c0d324f794bd82f2d0c During this timeframe the API might be rendered unresponsive for a brief period of time. https://status.scaleblade.com/incident/181128 Sat, 04 Mar 2023 00:49:58 +0000 https://status.scaleblade.com/incident/181128#9081745c1f6ebcfab9dc0f1898802390e6fb4fba80bd220723b392de0437170b Maintenance completed https://status.scaleblade.com/incident/181128 Sat, 04 Mar 2023 00:49:58 -0000 https://status.scaleblade.com/incident/181128#9f2db823398383ded7637130d71f18c05eca23ca5d2c8d702301e8e8fce28a34 We received notification of a critical firmware update required for some of our switching devices, due to the potential security and access risk this could pose, we have initiated these firmware updates immediately. Some customers in our London datacenter may notice brief interrupts during the reboots. https://status.scaleblade.com/incident/181128 Fri, 03 Mar 2023 22:40:34 -0000 https://status.scaleblade.com/incident/181128#9f2db823398383ded7637130d71f18c05eca23ca5d2c8d702301e8e8fce28a34 We received notification of a critical firmware update required for some of our switching devices, due to the potential security and access risk this could pose, we have initiated these firmware updates immediately. Some customers in our London datacenter may notice brief interrupts during the reboots. https://status.scaleblade.com/incident/181128 Fri, 03 Mar 2023 20:57:50 -0000 https://status.scaleblade.com/incident/181128#9f2db823398383ded7637130d71f18c05eca23ca5d2c8d702301e8e8fce28a34 We received notification of a critical firmware update required for some of our switching devices, due to the potential security and access risk this could pose, we have initiated these firmware updates immediately. Some customers in our London datacenter may notice brief interrupts during the reboots. https://status.scaleblade.com/incident/181128 Fri, 03 Mar 2023 17:53:51 -0000 https://status.scaleblade.com/incident/181128#9f2db823398383ded7637130d71f18c05eca23ca5d2c8d702301e8e8fce28a34 We received notification of a critical firmware update required for some of our switching devices, due to the potential security and access risk this could pose, we have initiated these firmware updates immediately. Some customers in our London datacenter may notice brief interrupts during the reboots. https://status.scaleblade.com/incident/181128 Fri, 03 Mar 2023 15:29:00 -0000 https://status.scaleblade.com/incident/181128#9f2db823398383ded7637130d71f18c05eca23ca5d2c8d702301e8e8fce28a34 We received notification of a critical firmware update required for some of our switching devices, due to the potential security and access risk this could pose, we have initiated these firmware updates immediately. Some customers in our London datacenter may notice brief interrupts during the reboots. https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 23:30:00 +0000 https://status.scaleblade.com/incident/176282#c2f636dd692a880251dd41f08a40c6826ec8c9a18b18da898688e727ac310384 Maintenance completed https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 23:30:00 +0000 https://status.scaleblade.com/incident/176282#c2f636dd692a880251dd41f08a40c6826ec8c9a18b18da898688e727ac310384 Maintenance completed https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 23:30:00 +0000 https://status.scaleblade.com/incident/176282#c2f636dd692a880251dd41f08a40c6826ec8c9a18b18da898688e727ac310384 Maintenance completed https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 15:30:00 -0000 https://status.scaleblade.com/incident/176282#b18a480c6a64ebaa87ff393ddcdcf9dbeff2f5baf7615a5c77e6b54fd5202f89 We will be performing a BGP session swap in London. This should not be disruptive to clients. **Edit** There was a brief disruption to services in our London location at 23:20pm GMT this was due to a routing error with our upstream when we swapped our BGP session. This has been resolved and no further disruption is expected. https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 15:30:00 -0000 https://status.scaleblade.com/incident/176282#b18a480c6a64ebaa87ff393ddcdcf9dbeff2f5baf7615a5c77e6b54fd5202f89 We will be performing a BGP session swap in London. This should not be disruptive to clients. **Edit** There was a brief disruption to services in our London location at 23:20pm GMT this was due to a routing error with our upstream when we swapped our BGP session. This has been resolved and no further disruption is expected. https://status.scaleblade.com/incident/176282 Fri, 17 Feb 2023 15:30:00 -0000 https://status.scaleblade.com/incident/176282#b18a480c6a64ebaa87ff393ddcdcf9dbeff2f5baf7615a5c77e6b54fd5202f89 We will be performing a BGP session swap in London. This should not be disruptive to clients. **Edit** There was a brief disruption to services in our London location at 23:20pm GMT this was due to a routing error with our upstream when we swapped our BGP session. This has been resolved and no further disruption is expected.