Skip to content

Archives

Links for 2018-06-20

Published June 20, 2018

  • Visa admits 5m payments failed over a broken switch

    “We operate two redundant data centres in the UK, meaning that either one can independently handle 100% of the transactions for Visa in Europe. In normal circumstances, the systems are synchronised and either centre can take over from the other immediately … in this instance, a component with a switch in our primary data centre suffered a very rare partial failure which prevented the backup switch from activating.”

    (tags: visa outages post-mortems fail europe dcs)

  • 10-hour Microsoft Azure outage in Europe

    Service availability issue in North Europe Summary of impact: From 17:44 on 19 Jun 2018 to 04:30 UTC on 20 Jun 2018 customers using Azure services in North Europe may have experienced connection failures when attempting to access resources hosted in the region. Customers leveraging a subset of Azure services may have experienced residual impact for a sustained period post-mitigation of the underlying issue. We are communicating with these customers directly in their Management Portal. Preliminary root cause: Engineers identified that an underlying temperature issue in one of the datacenters in the region triggered an infrastructure alert, which in turn caused a structured shutdown of a subset of Storage and Network devices in this location to ensure hardware and data integrity. Mitigation: Engineers addressed the temperature issue, and performed a structured recovery of the affected devices and the affected downstream services.
    The specific services were: ‘Virtual Machines, Storage, SQL Database, Key Vault, App Service, Site Recovery, Automation, Service Bus, Event Hubs, Data Factory, Backup, API management, Log Analytics, Application Insight, Azure Batch Azure Search, Redis Cache, Media Services, IoT Hub, Stream Analytics, Power BI, Azure Monitor, Azure Cosmo DB or Logic Apps in North Europe’. Holy cow

    (tags: microsoft outages fail azure post-mortems cooling-systems datacenters)

  • Here’s a list of organizations that are mobilizing to help separated immigrant children | The Texas Tribune

    We’ve compiled a list of organizations that are mobilizing to try and help children that have been separated from their parents at the Texas-Mexico border.

    (tags: texas children immigration family-separations us-politics usa charity)