Skip to main content

Incident: Partial disruption 2023-09-11 00:10 - 07:20 due to DDoS attack


Type

Maintenance

Summary

Update of multiple server / infrastructure components

Impact

Multiple downtimes of impacted services

Duration

2023-08-12 19:00 - 2023-08-13 01:00 (CEST)

Status

Success

Reporter(s)

@b2c@wien.rocks

Responder(s)

@fossie@wien.rocks, @b2c@wien.rocks

Internal reference

n/a

Introduction

Maintenance has to be conducted on multiple core infrastructure servers and components to apply necessary software, server, distribution, security and firmware updates. This will ensure continued stable and secure operation of the fediverse.foundation environment.

Service interruptions are to be expected due to multiple reboots of the impacted components.

We apologize for any inconvenience!


Maintenance tasks

  • Router firmware upgrade
  • Configuration changes
    • Configure NICs on various virtual machines for IPv6 multicast
    • Misc. VM configuration changes (CPU/Memory allocation etc.)
  • Distribution upgrade on all Debian-based servers
    • Upgrade all physical servers to Debian 12 'Bookworm'
    • Upgrade all virtual machines to Debian 12 'Bookworm'
  • Update Openshift/OKD to 4.13
  • Introduction of the Mastodon "Translate" feature (based on libretranslate)
  • Update to Mastodon 4.2-beta1 on instance fedi.at