15 minute update

16 Mar - 17 Apr

RT Client Subject First work started First post-work reply Time to reply
54100 BD Group CRITICAL: HTTP: formations.elementalcosec.com HTTPS on ef-v5-nodes.c.ef-platform.internal 2025-03-10 19:39:35 None 4h 20m
57640 Trident Honda vmsvr2.trident.lan storage volume usage /var 2026-03-16 10:51:47 None 1d 3h 08m
57703 OGT Storage alert: /srv/ngs on rodney.internal.ogtip.com 2026-03-19 12:22:38 2026-03-19 12:31:44 0h 09m
57639 Tangram Gitlab and lost emails 2026-03-17 10:34:31 2026-03-17 10:51:55 0h 17m
57744 Geograph Geograph Gitlab upgrade (18.10.1) 2026-03-27 08:16:32 2026-03-27 08:17:31 0h 01m
57769 NFW nfwgs2.nfw.internal samba cleanup script error 2026-04-01 13:00:40 2026-04-01 13:13:30 0h 13m
57671 JISC Upgrade servers to Debian 13 Trixie 2026-03-25 12:03:36 2026-03-25 12:11:22 0h 08m
57707 Azura Azura - Ocado vpn certificates 2026-03-25 14:35:38 2026-03-25 14:44:30 0h 09m
57745 JISC Access for new employee 2026-03-31 10:51:59 2026-03-31 11:07:22 0h 15m
57851 NFW nfwgs2.nfw.internal unmerged configuration 2026-04-08 08:45:19 2026-04-08 09:02:10 0h 17m
57710 AskBio CRITICAL: Networking: ping4 on macleod.synpromics.com 2026-03-21 00:40:31 2026-03-21 00:48:06 0h 08m
57667 Rotastat gallus.rotastat.com heavy load/timeouts 2026-03-17 11:27:03 2026-03-17 11:29:05 0h 02m
57726 Ingeus Ingeus: login to Azure 2026-03-24 08:42:33 2026-03-24 08:44:37 0h 02m
57938 Sucden CRITICAL: HTTP: Uyuni HTTPS on patrs-gs2-p1l01.sucden.co.uk 2026-04-16 11:39:45 2026-04-16 11:53:25 0h 14m
57691 Top To Toe CRITICAL: HTTP: staging.toptotoe-gait.com on gait-prod.toptotoe.com 2026-03-18 11:47:38 2026-03-18 11:50:31 0h 03m
57693 Rotastat CRITICAL: System Health: Systemd State on gallus.rotastat.com 2026-03-18 12:47:47 2026-03-18 13:09:34 0h 22m
57665 Azura ford1/2 SSL/TLS certificate expiry (customgeophev.com) 2026-03-19 14:28:12 2026-03-19 14:29:43 0h 02m
57700 Sucden declan and duffman decom 2026-03-19 13:14:00 2026-03-23 15:38:33 2h 25m
57658 Sucden patrs-gs2-p1l01.sucden.co.uk configuration failure 2026-03-16 16:07:26 2026-03-16 16:19:07 0h 12m
57654 Tangram tangram/prod backup job failure 2026-03-17 09:24:47 2026-03-17 09:58:13 0h 33m
57646 OGT rodney.internal.ogtip.com volume usage /srv/illumina_data 2026-03-17 09:52:52 2026-03-17 10:15:53 0h 23m
57151 Sysdoc Important kubernetes change - sysdoc 2026-03-18 14:25:56 None 9h 34m
57688 Reigate College rc-mss.reigate.ac.uk /mnt/network/SharedArea/Staff not mounted 2026-03-18 08:09:02 2026-03-18 08:25:08 0h 16m
57783 Reigate College CRITICAL: Networking: SSH on rc-mss.reigate.ac.uk 2026-04-02 10:11:31 2026-04-02 10:17:20 0h 06m
57782 Gravytrain CRITICAL: HTTP: www.bedfordinsuranceforbusiness.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk 2026-04-02 10:05:06 2026-04-02 10:23:11 0h 18m
57713 OGT rodney1.internal.ogtip.com failed disk 2026-03-23 11:25:58 2026-03-23 12:03:10 0h 37m
57723 OGT OOM - blaney.internal.ogtip.com 2026-03-23 17:10:42 2026-03-23 17:22:15 0h 12m
57573 DLS Plastics Setup Lets Encrypt for DLS Zimbra servers (consultancy) 2026-03-09 14:38:36 None 9h 21m
57685 Koinex Upgrade server to Debian 13 Trixie 2026-03-19 09:44:54 2026-03-19 10:03:49 0h 19m
57735 Tangram CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk 2026-03-24 17:23:38 2026-03-24 17:24:30 0h 01m
57746 Trident Honda VM unifi 2026-03-26 09:50:32 2026-03-26 17:09:40 7h 19m
57694 Tangram GItLab error "The source branch X does not exist." 2026-03-18 16:09:14 2026-03-18 16:23:13 0h 14m
57722 Sucden iLO maintenance 2026-03-24 10:19:35 2026-03-24 10:20:40 0h 01m
57733 Tangram tangram/prod/gitlab eviction/saml errors 2026-03-25 15:33:57 2026-03-26 13:02:03 2d 1h 28m
57659 Sucden VMs don't auto-unlock LUKS at boot 2026-03-16 16:11:00 2026-03-16 21:28:21 5h 17m
57732 Troika Bring up VPN tunnels 2026-03-24 14:48:24 None 9h 12m
57729 Geograph geograph/prod haproxy deployments failing 2026-03-24 16:20:27 None 7h 40m
57684 Imoves Upgrade servers to Debian 13 Trixie 2026-03-18 09:55:10 2026-03-18 10:12:47 0h 18m
57689 Midnight Hax CRITICAL: Environment: APC UPS Status on woodlands.midnighthax.com 2026-03-18 08:41:06 2026-03-18 08:44:44 0h 04m
56919 Ingeus Remove Ingeus systems from support 2026-03-26 15:16:50 2026-03-26 16:12:12 0h 55m
57718 Trident Honda smbfs1.trident.lan volume usage /srv 2026-03-24 13:00:56 2026-03-24 13:02:56 0h 02m
57740 Geograph geograph/prod/gitlab pod status 2026-03-25 08:18:40 2026-03-25 14:39:44 6h 21m
57754 Tangram tangram/prod ThanosCompactIsDown 2026-03-27 09:47:40 2026-03-27 11:06:09 1h 18m
57759 AskBio AskBio hosts down 2026-03-30 13:39:33 2026-03-30 14:39:32 0h 60m
57647 OGT granddad/damien winbind failure 2026-03-16 09:29:37 2026-03-16 11:26:41 1h 57m
57651 Ingeus ingeus/iw/prd-aks/tcl-monitoring loki failing 2026-03-16 12:20:12 2026-03-16 12:37:15 0h 17m
57941 AskBio /var on Talisker at 90% 2026-04-16 10:01:19 2026-04-16 10:09:10 0h 08m
57682 ERF Electrical Upgrade servers to Debian 13 Trixie 2026-03-25 12:42:25 2026-03-25 12:55:33 0h 13m
57669 Quickline RADIUS 2026-03-17 13:03:35 2026-03-17 15:16:29 2h 13m
57715 Tangram tangram/prod issues 2026-03-23 08:48:15 2026-03-23 10:13:57 1h 26m
57771 Novadata purge leonis from everywhere. 2026-03-31 16:38:23 None 7h 22m
57773 OpenCorporates [FIRING:1] DatasourceError Tiger Computing (ElastiCache Connections (openc-frontend-003)) 2026-03-31 10:10:01 2026-04-01 10:22:36 0h 13m
57779 TCV WARNING: NRPE Disk: /var on web4.tcv.org.uk 2026-04-02 10:37:03 2026-04-02 10:38:14 0h 01m
57853 Tangram Expiring SSL certificate: AWS Client VPN 2026-04-10 16:36:27 2026-04-10 16:43:06 0h 07m
57150 Ingeus Important kubernetes change - ingeus 2026-03-18 12:19:49 None 1d 1h 40m
57664 JISC OpenAthens server patching 2026-03-26 08:17:58 2026-03-26 08:26:47 0h 09m
57743 Tangram Tangram Gitlab upgrade (18.10.1) 2026-03-26 08:14:05 2026-03-26 08:15:57 0h 02m
57719 Trident Honda VM migration 2026-03-23 16:37:26 2026-03-25 10:46:44 1d 8h 09m
57633 Geograph geograph/prod/tcl-monitoring loki failing 2026-03-12 09:05:28 2026-03-16 11:40:54 2h 35m
57952 ITC Compliance Timings for system 2026-04-17 14:40:22 2026-04-17 14:47:57 0h 08m
57919 Imoves Investigate PHP-related issues with staging site 2026-04-13 16:45:29 2026-04-14 11:18:51 1d 8h 33m
57933 Sucden interstar07-10 local firewall check (Star Echo Service) 2026-04-15 09:54:42 2026-04-15 09:59:13 0h 05m
57727 Quickline Zabbix Upgrade 2026-03-24 11:36:20 2026-03-24 12:55:38 1h 19m
57929 Trident Honda WARNING: Cluster: Pacemaker CRM on vmsvr1.trident.lan 2026-04-15 09:05:46 2026-04-15 09:07:56 0h 02m
57673 Global Brands Upgrade servers to Debian 13 Trixie 2026-03-25 16:02:32 2026-03-25 16:05:33 0h 03m
57752 Geograph Re: CRITICAL: HTTP: Geograph staging HTTPS on staging.geograph.org.uk 2026-03-27 08:54:54 2026-03-27 09:12:32 0h 18m
57949 Troika tricky.troika.lan stuck updates 2026-04-17 10:07:10 None 1d 3h 53m
57951 Midnight Hax Fix package double declaration on ws-trixie.midnighthax.com 2026-04-17 14:26:02 2026-04-17 15:11:38 0h 46m
57861 Geograph Geograph Gitlab upgrade (18.10.3) 2026-04-09 10:16:11 2026-04-09 11:49:13 1h 33m
57866 JISC WARNING: Cluster: ClusterCheck on ath-lin-prx-l01.int.openathens.net 2026-04-09 10:57:15 2026-04-09 11:00:01 0h 03m
57810 Troika Independent check: tricky.troika.lan 2026-04-08 12:56:24 None 1d 1h 04m
57870 Cirencester College All systems down 2026-04-10 12:04:30 2026-04-10 12:04:41 0h 00m
57798 Koinex koinexserver.local owncloud/php version 2026-04-10 10:21:21 2026-04-10 10:34:10 0h 13m
57751 Troika Onboard server to support: tricky.troika.lan 2026-03-26 13:05:49 2026-03-26 16:38:59 3h 33m
57883 Koinex WARNING: Mail: Queue Length on koinexserver.home 2026-04-13 08:54:10 2026-04-13 09:18:43 0h 25m
57750 Sucden Relocate interstar03/04 from IXN to GS2 -build out to Ubuntu 2026-03-27 15:55:31 2026-03-27 15:59:38 0h 04m
57697 Azura ocado1/2.opentrk.com storage volume usage /usr 2026-03-19 10:41:15 2026-03-19 10:42:31 0h 01m
57927 Trident Honda smbfs1.trident.lan root storage volume usage 2026-04-14 11:33:22 2026-04-14 11:40:31 0h 07m
57864 Sucden Interstar01/02 rebuild to ubuntu 2026-04-13 14:04:56 2026-04-13 17:42:43 3h 38m
57680 Trident Honda Upgrade servers to Debian 13 Trixie 2026-03-25 15:08:07 2026-03-25 15:42:41 0h 35m
57695 Midnight Hax fw.midnighthax.com configure graceful shutdown on power outage. 2026-03-19 15:32:40 2026-03-19 15:56:35 0h 24m
57867 ITC Compliance Urgent - SSL Root Cert 2026-04-09 14:21:16 2026-04-09 14:24:51 0h 04m
57611 Crystal Units crylonlis2024 RHEL renewal 2026-04-29 15:04:45 None 8h 55m
57755 Trident Honda VM topaz 2026-03-27 15:03:44 2026-03-27 15:21:56 0h 18m
57930 Sucden Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk 2026-04-16 10:55:35 2026-04-16 10:56:16 0h 01m
57850 Sucden apt-show-versions.service failed on interstar05,06 2026-04-08 11:47:51 None 1d 2h 12m
57862 Tangram Tangram Gitlab upgrade (18.10.3) 2026-04-10 08:02:24 2026-04-10 08:36:16 0h 34m
57874 BD Group Install PHP 8.2 on staging server 2026-04-10 14:36:17 None 9h 24m
57884 Tangram CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk 2026-04-13 10:12:44 2026-04-13 10:15:32 0h 03m
57858 Troika tricky.troika.lan monitoring enhancements 2026-04-10 12:45:51 2026-04-13 12:08:27 2d 3h 23m
57921 Trident Honda New access key 2026-04-13 15:48:33 2026-04-13 16:09:08 0h 21m
57876 OGT Storage alert: /srv/department on rodney.internal.ogtip.com 2026-04-10 15:51:23 2026-04-10 15:52:00 0h 01m
57786 Trident Honda VM hera - /etc/sudoers.d/azure-sudo 2026-04-02 17:56:21 2026-04-02 18:03:45 0h 07m
57683 Entrepreneurs Circle Upgrade server to Debian 13 Trixie 2026-03-18 09:11:17 2026-03-18 09:14:26 0h 03m
57781 OGT basil.internal.ogtip.com volume usage /var 2026-04-07 11:52:25 2026-04-07 11:57:14 0h 05m
57716 OGT sybil.internal.ogtip.com volume usage /Data 2026-03-25 17:19:23 2026-03-25 17:22:31 0h 03m
57774 Tangram DGX H100 Maintenance – GPU Replacement 2026-03-31 12:42:41 2026-03-31 12:44:28 0h 02m
57770 TCV tcv-crm.tcv.org.uk cron php script error 2026-04-01 15:29:08 2026-04-01 16:03:12 0h 34m
57706 Tangram Tangram/prod/data-management logical backup failure 2026-03-20 10:53:44 2026-03-20 11:16:06 0h 22m
57772 Quickline Zabbix Upgrade (Consultancy) 2026-03-31 09:39:55 None 1d 4h 20m
57629 Sucden Upgrade Uyuni 2026-04-08 15:28:31 2026-04-08 16:30:52 1h 02m
57877 AskBio All systems down 2026-04-13 09:28:30 2026-04-13 10:10:06 0h 42m
57855 Troika Unable to login to tricky 2026-04-08 15:12:45 2026-04-08 15:26:06 0h 13m
57863 Tangram [FIRING: 5 for tangram/prod] AWSBackupCopyJobFailedToComplete 2026-04-09 09:59:15 2026-04-09 11:24:14 1h 25m
57944 AskBio ZFS pool data fragmentation on talisker.synpromics.com 2026-04-16 10:22:56 2026-04-17 10:02:57 2d 3h 40m
57717 AskBio edb-iona.askbio.com HTTP status for prompt-softdev.askbio.com 2026-03-24 15:49:45 2026-03-26 11:23:30 1d 9h 34m
57650 Sucden CrackArmor: Multiple vulnerabilities in AppArmor 2026-03-16 10:39:14 2026-03-16 10:42:39 0h 03m
57937 Quickline Disk critically full on aql-svr-zabbix-db 2026-04-09 11:21:17 2026-04-15 07:45:51 2d 0h 25m
57925 AskBio New installs 2026-04-17 11:38:49 2026-04-17 12:05:11 0h 26m
57762 Reigate College rc-mss.reigate.ac.uk disk volume usage 2026-04-02 10:34:16 2026-04-02 10:36:56 0h 03m
57936 Crystal Units FW: Shapes drawing with spacer cutting size 2026-04-15 10:51:07 2026-04-15 11:03:48 0h 13m
57720 Azura UNKNOWN: Hardware: Dell OpenManage on ocado2.opentrk.com 2026-03-23 14:48:29 2026-03-27 16:21:22 1h 33m
57879 Quickline Zabbix database partition error; please verify and fix as needed (workaround currently in place) 2026-04-14 13:08:18 2026-04-14 14:55:43 1h 47m
57714 Gravytrain web.prod.bf2.bedfordinsurance.co.uk HTTP/HTTPS timeout for www.bedfordinsuranceforbusiness.co.uk 2026-03-23 10:31:52 2026-03-23 11:10:36 0h 39m
57672 Cirencester College Upgrade servers to Debian 13 Trixie 2026-03-25 15:47:14 2026-03-25 15:50:27 0h 03m
57932 Sucden Readdress globabstr01 and 02 2026-04-16 11:24:08 2026-04-16 11:28:52 0h 05m
57852 Sucden Server Decommission & replacements 2026-04-08 10:56:39 2026-04-08 11:38:25 0h 42m
57674 Crystal Units Upgrade servers to Debian 13 Trixie 2026-03-18 10:14:54 2026-03-18 10:35:14 0h 20m
57675 AskBio Upgrade servers to Debian 13 Trixie 2026-03-19 10:10:06 2026-03-19 10:41:08 0h 31m
57784 AskBio Configure RTP server for support and functionality 2026-04-10 16:59:03 2026-04-13 11:14:18 1d 8h 15m
57763 Sucden interstar05-10.sucden.co.uk IPMI errors 2026-03-30 14:51:22 2026-03-30 15:11:48 0h 20m
57681 TCV Upgrade servers to Debian 13 Trixie 2026-03-18 10:49:27 2026-03-18 11:09:48 0h 20m
57678 Top To Toe Upgrade server to Debian 13 Trixie 2026-03-19 09:15:21 2026-03-19 09:36:41 0h 21m
57679 Rotastat Upgrade server to Debian 13 Trixie 2026-03-30 12:23:24 2026-03-30 12:49:12 0h 26m
57677 BD Group Upgrade servers to Debian 13 Trixie | EFSRV-21666 2026-03-20 09:23:18 2026-03-20 09:29:26 0h 06m

git hash: master (6c029d07)