15 minute update

02 Mar - 03 Apr

RT Client Subject First work started First post-work reply Time to reply
54100 BD Group CRITICAL: HTTP: formations.elementalcosec.com HTTPS on ef-v5-nodes.c.ef-platform.internal 2025-03-10 19:39:35 None 4h 20m
57695 Midnight Hax fw.midnighthax.com configure graceful shutdown on power outage. 2026-03-19 15:32:40 2026-03-19 15:56:35 0h 24m
57640 Trident Honda vmsvr2.trident.lan storage volume usage /var 2026-03-16 10:51:47 None 1d 3h 08m
57703 OGT Storage alert: /srv/ngs on rodney.internal.ogtip.com 2026-03-19 12:22:38 2026-03-19 12:31:44 0h 09m
57638 DLS Plastics DLS Medical site down 2026-03-13 08:49:36 2026-03-13 10:15:30 1h 26m
56447 Troika Troika Support 2026-03-02 10:48:58 2026-03-02 10:58:13 0h 09m
57639 Tangram Gitlab and lost emails 2026-03-17 10:34:31 2026-03-17 10:51:55 0h 17m
57527 Troika QNAP/Firewall health-checks 2026-03-06 09:54:37 2026-03-06 10:41:51 0h 47m
57152 Tangram Important kubernetes change - tangram 2026-03-02 11:01:36 2026-03-02 11:05:02 0h 03m
57482 Globecast DNS updates 2026-03-05 11:05:48 2026-03-05 11:22:23 0h 17m
57558 Tangram Confirmation of Global Admin Access Requirement 2026-03-12 17:40:18 2026-03-12 17:41:34 0h 01m
57650 Sucden CrackArmor: Multiple vulnerabilities in AppArmor 2026-03-16 10:39:14 2026-03-16 10:42:39 0h 03m
57678 Top To Toe Upgrade server to Debian 13 Trixie 2026-03-19 09:15:21 2026-03-19 09:36:41 0h 21m
57467 OGT manuel.internal.ogtip.com restic scheduling 2026-03-03 12:05:31 2026-03-03 12:40:16 0h 35m
57531 Gravytrain web.prod.bf2.bedfordinsurance.co.uk Multiple HTTP/HTTPS timeouts 2026-03-02 11:57:03 2026-03-02 12:02:49 0h 06m
57529 Rotastat gallus.rotastat.com SSL/TLS certificate expiry 2026-03-04 08:38:43 2026-03-04 09:45:42 1h 07m
56410 Sucden interstar07-10 2026-03-02 10:24:43 2026-03-02 10:30:10 0h 05m
57533 Tangram Gitlab persistent volume filling up 2026-03-02 13:31:46 2026-03-02 16:19:50 2h 48m
57476 ATA Group Spike on data usage 2026-03-02 11:43:04 None 1d 2h 17m
56752 OpenCorporates OC - Quote to remove all hardware from Sysgroup 2025-12-11 11:47:05 None 1d 2h 13m
57536 OpenCorporates CRITICAL: Networking: SSH on vm-host31.opencorporates.internal 2026-03-02 16:43:41 None 7h 16m
57524 Top To Toe gait-prod.toptotoe.com expired crl 2026-03-03 10:11:50 2026-03-03 10:42:18 0h 30m
57535 Novadata RE: Resolved: NovaData expiring VPN certs 2026-03-03 11:41:48 2026-03-03 11:48:59 0h 07m
57532 AskBio Skye, Talisker, DarkMatter & Macleod outage 2026-03-02 17:40:33 2026-03-02 17:55:31 0h 15m
57615 AskBio Network Outage 5-6pm today 2026-03-10 11:32:36 2026-03-10 11:32:58 0h 00m
57561 BD Group CRITICAL: HTTP: www.1stformations.co.uk HTTPS on ef-v5-nodes.c.ef-platform.internal 2026-03-07 02:40:30 2026-03-07 02:47:11 0h 07m
57658 Sucden patrs-gs2-p1l01.sucden.co.uk configuration failure 2026-03-16 16:07:26 2026-03-16 16:19:07 0h 12m
57700 Sucden declan and duffman decom 2026-03-19 13:14:00 None 1d 0h 46m
57627 Geograph Geograph Gitlab upgrade (18.9.2) 2026-03-12 08:19:33 2026-03-12 08:34:18 0h 15m
57665 Azura ford1/2 SSL/TLS certificate expiry (customgeophev.com) 2026-03-19 14:28:12 2026-03-19 14:29:43 0h 02m
57684 Imoves Upgrade servers to Debian 13 Trixie 2026-03-18 09:55:10 2026-03-18 10:12:47 0h 18m
57675 AskBio Upgrade servers to Debian 13 Trixie 2026-03-19 10:10:06 2026-03-19 10:41:08 0h 31m
57667 Rotastat gallus.rotastat.com heavy load/timeouts 2026-03-17 11:27:03 2026-03-17 11:29:05 0h 02m
57567 Sucden Oracle Linux Patching - 60 day cycle 2026-03-09 17:09:34 2026-03-10 14:45:52 2d 1h 36m
57653 Azura Configure Fivetran access to Ocado* servers 2026-03-16 12:38:37 2026-03-16 15:55:25 3h 17m
57526 Troika New client onboarding (Pre-Contract Checks): Troika 2026-03-04 16:47:11 2026-03-05 11:36:54 1d 8h 50m
57569 Geograph [FIRING: 1 for geograph/prod] NodeFilesystemSpaceFillingUp in tcl-monitoring 2026-03-09 14:20:48 2026-03-09 16:35:46 2h 15m
57618 Tangram CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk 2026-03-10 17:36:40 2026-03-10 17:38:05 0h 01m
57693 Rotastat CRITICAL: System Health: Systemd State on gallus.rotastat.com 2026-03-18 12:47:47 2026-03-18 13:09:34 0h 22m
57694 Tangram GItLab error "The source branch X does not exist." 2026-03-18 16:09:14 2026-03-18 16:23:13 0h 14m
57710 AskBio CRITICAL: Networking: ping4 on macleod.synpromics.com 2026-03-21 00:40:31 2026-03-21 00:48:06 0h 08m
57641 BD Group Storage alert: / on ef-v5-* 2026-03-13 16:17:26 2026-03-13 16:26:55 0h 09m
57691 Top To Toe CRITICAL: HTTP: staging.toptotoe-gait.com on gait-prod.toptotoe.com 2026-03-18 11:47:38 2026-03-18 11:50:31 0h 03m
57451 Advensys Arpino Warehouse Site Visit 2026-03-02 20:12:27 2026-03-03 11:05:11 1d 4h 53m
57628 Tangram Tangram Gitlab upgrade (18.9.2) 2026-03-12 08:01:14 2026-03-12 08:33:42 0h 32m
57623 Tangram AWS Backup copy jobs failed 2026-03-11 15:32:25 2026-03-11 16:04:07 0h 32m
57632 Sucden duffman.sucden.co.uk mount missing /data/dl/releases 2026-03-12 10:39:25 2026-03-12 10:49:53 0h 10m
57681 TCV Upgrade servers to Debian 13 Trixie 2026-03-18 10:49:27 2026-03-18 11:09:48 0h 20m
57685 Koinex Upgrade server to Debian 13 Trixie 2026-03-19 09:44:54 2026-03-19 10:03:49 0h 19m
57573 DLS Plastics Setup Lets Encrypt for DLS Zimbra servers (consultancy) 2026-03-09 14:38:36 None 9h 21m
57654 Tangram tangram/prod backup job failure 2026-03-17 09:24:47 2026-03-17 09:58:13 0h 33m
57713 OGT rodney1.internal.ogtip.com failed disk 2026-03-23 11:25:58 2026-03-23 12:03:10 0h 37m
57646 OGT rodney.internal.ogtip.com volume usage /srv/illumina_data 2026-03-17 09:52:52 2026-03-17 10:15:53 0h 23m
57688 Reigate College rc-mss.reigate.ac.uk /mnt/network/SharedArea/Staff not mounted 2026-03-18 08:09:02 2026-03-18 08:25:08 0h 16m
57151 Sysdoc Important kubernetes change - sysdoc 2026-03-18 14:25:56 None 9h 34m
57534 Sucden Server usage/performance statistics after move of all STAR services to Interstar07-10 2026-03-02 15:51:09 2026-03-02 16:02:14 0h 11m
57689 Midnight Hax CRITICAL: Environment: APC UPS Status on woodlands.midnighthax.com 2026-03-18 08:41:06 2026-03-18 08:44:44 0h 04m
57609 Gravytrain CRITICAL: System Health: Systemd State on app.prod.qs1.grvytrn.co.uk 2026-03-10 10:17:09 2026-03-10 10:23:31 0h 06m
57624 Gravytrain CRITICAL: System Health: Systemd State on app.prod.qs1.grvytrn.co.uk 2026-03-11 13:42:08 2026-03-11 14:06:18 0h 24m
57669 Quickline RADIUS 2026-03-17 13:03:35 2026-03-17 15:16:29 2h 13m
57697 Azura ocado1/2.opentrk.com storage volume usage /usr 2026-03-19 10:41:15 2026-03-19 10:42:31 0h 01m
57647 OGT granddad/damien winbind failure 2026-03-16 09:29:37 2026-03-16 11:26:41 1h 57m
57651 Ingeus ingeus/iw/prd-aks/tcl-monitoring loki failing 2026-03-16 12:20:12 2026-03-16 12:37:15 0h 17m
57706 Tangram Tangram/prod/data-management logical backup failure 2026-03-20 10:53:44 2026-03-20 11:16:06 0h 22m
57542 Azura Azura systems updates failing 2026-03-03 14:45:53 2026-03-03 16:23:23 1h 38m
57553 OGT docker on mickey 2026-03-05 10:29:46 2026-03-05 10:35:08 0h 05m
57659 Sucden VMs don't auto-unlock LUKS at boot 2026-03-16 16:11:00 2026-03-16 21:28:21 5h 17m
57568 Ingeus [FIRING: 1 for ingeus/iw-prd-aks] KubeNodeUnschedulable in tcl-monitoring 2026-03-09 16:16:43 2026-03-09 17:08:23 0h 52m
57714 Gravytrain web.prod.bf2.bedfordinsurance.co.uk HTTP/HTTPS timeout for www.bedfordinsuranceforbusiness.co.uk 2026-03-23 10:31:52 2026-03-23 11:10:36 0h 39m
57543 Quickline WARNING: HTTP: Zabbix HTTPS Cert on aql-svr-zabbix-app.quickline.co.uk 2026-03-03 10:58:46 2026-03-03 13:24:52 2h 26m
57546 BD Group CRITICAL: HTTP: www.1stformations.co.uk HTTPS on ef-v5-nodes.c.ef-platform.internal 2026-03-04 08:25:32 2026-03-05 15:29:49 7h 04m
57457 Geograph Loki Slow and unreliable 2026-03-03 12:33:35 2026-03-03 12:49:29 0h 16m
57438 BD Group Amend eFiling apache logging config 2026-03-03 15:53:12 2026-03-03 17:12:43 1h 20m
57555 Cirencester College Suspending Active Monitoring - March 30th 2026-03-05 13:52:07 2026-03-05 13:55:47 0h 04m
57621 OpenCorporates Help needed with us_dc_companies_fetcher deploy on aws-bot2 2026-03-11 10:00:59 2026-03-11 10:05:32 0h 05m
57528 Sucden interstar10 - ssh 2026-03-02 14:47:30 2026-03-02 15:14:51 0h 27m
57630 Sucden DOWN: interstar05.sucden.co.uk 2026-03-12 10:30:21 None 1d 3h 30m
57674 Crystal Units Upgrade servers to Debian 13 Trixie 2026-03-18 10:14:54 2026-03-18 10:35:14 0h 20m
57677 BD Group Upgrade servers to Debian 13 Trixie 2026-03-20 09:23:18 2026-03-20 09:29:26 0h 06m
57683 Entrepreneurs Circle Upgrade server to Debian 13 Trixie 2026-03-18 09:11:17 2026-03-18 09:14:26 0h 03m
57633 Geograph geograph/prod/tcl-monitoring loki failing 2026-03-12 09:05:28 2026-03-16 11:40:54 2h 35m
57715 Tangram tangram/prod issues 2026-03-23 08:48:15 2026-03-23 10:13:57 1h 26m
57545 Sucden Rebuild interstar05/06 2026-03-11 14:21:41 2026-03-11 14:45:10 0h 23m
57614 Globecast CRITICAL: Disk: multipath on gcukscheddb02.globecastne.com 2026-03-10 11:08:21 2026-03-10 11:21:53 0h 14m
57610 Tangram [FIRING: 1 for tangram/prod] KubePodCrashLooping in gitlab 2026-03-10 10:23:48 2026-03-10 14:32:21 4h 09m
57566 Tangram [FIRING: 1 for tangram/stage] ThanosCompactIsDown 2026-03-10 10:22:04 2026-03-10 11:47:37 1h 26m
57150 Ingeus Important kubernetes change - ingeus 2026-03-18 12:19:49 None 1d 1h 40m
57551 Sucden Market Volatility causing re-requests and packet drops. 2026-03-04 17:31:27 2026-03-05 11:38:54 1d 8h 07m

git hash: master (b637c68b)