RT updates report

13 Apr - 15 May

RT Work date Ticket updated? Client Subject
57878 13 Apr Yes Internal Nextcloud is down
57883 13 Apr Yes Koinex WARNING: Mail: Queue Length on koinexserver.home
57877 13 Apr Yes AskBio All systems down
57871 13 Apr Yes Internal Another phishing email: Fwd: FW: PH26-KEI04-47052-FGL 35
57884 13 Apr Yes Tangram CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk
57859 13 Apr Yes Internal tcl/avon prometheus job missing
57876 13 Apr Yes OGT Storage alert: /srv/department on rodney.internal.ogtip.com
57784 13 Apr Yes AskBio Configure RTP server for support and functionality
57858 13 Apr Yes Troika tricky.troika.lan monitoring enhancements
57875 13 Apr Yes Troika Rebuild Tron with Proxmox (consultancy)
57864 13 Apr Yes Sucden Interstar01/02 rebuild to ubuntu
57919 13 Apr Yes Imoves Investigate PHP-related issues with staging site
57923 14 Apr Yes Internal Check for Security Notices and System Updates
57922 14 Apr Yes Internal Weekly checks
57853 14 Apr Yes Tangram Expiring SSL certificate: AWS Client VPN
57671 14 Apr Yes JISC Upgrade servers to Debian 13 Trixie
57934 15 Apr Yes Internal Check for Security Notices and System Updates
57937 15 Apr Yes Quickline Disk critically full on aql-svr-zabbix-db
57879 15 Apr No Quickline Zabbix database partition error; please verify and fix as needed (workaround currently in place)
57859 16 Apr Yes Internal tcl/avon prometheus job missing
57941 16 Apr Yes AskBio /var on Talisker at 90%
57930 16 Apr Yes Sucden Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk
57932 16 Apr Yes Sucden Readdress globabstr01 and 02
57936 16 Apr Yes Crystal Units FW: Shapes drawing with spacer cutting size
57232 16 Apr No Gravytrain Setup SecurityGroups for Gravytrain
57149 16 Apr Yes Geograph Important kubernetes change - geograph
57763 16 Apr Yes Sucden interstar05-10.sucden.co.uk IPMI errors
57947 17 Apr Yes Internal Check for Security Notices and System Updates
57944 17 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
57930 17 Apr No Sucden Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk
57949 17 Apr Yes Troika tricky.troika.lan stuck updates
57784 17 Apr Yes AskBio Configure RTP server for support and functionality
57948 17 Apr Yes Internal ouse/trident/jisc cluster package diffs
57879 17 Apr Yes Quickline Zabbix database partition error; please verify and fix as needed (workaround currently in place)
56447 17 Apr No Troika Troika Support
57925 17 Apr Yes AskBio New installs
57951 17 Apr Yes Midnight Hax Fix package double declaration on ws-trixie.midnighthax.com
57952 17 Apr Yes ITC Compliance Timings for system
57958 20 Apr Yes Internal Check for Security Notices and System Updates
57963 20 Apr Yes AskBio WARNING: Security: Let's Encrypt Certificates on darkmatter.synpromics.com
57919 20 Apr Yes Imoves Investigate PHP-related issues with staging site
57175 20 Apr No Internal crl expiry check
57232 20 Apr Yes Gravytrain Setup SecurityGroups for Gravytrain
57954 20 Apr Yes BD Group EFSRV-21761 eFiling high load
57959 20 Apr Yes OGT rodney1.internal.ogtip.com failed disk
57965 20 Apr Yes OGT Spare disk for Rodneys
57961 20 Apr Yes Reigate College rc-mss.reigate.ac.uk root volume usage
57674 20 Apr Yes Crystal Units Upgrade servers to Debian 13 Trixie
57763 20 Apr Yes Sucden interstar05-10.sucden.co.uk IPMI errors
57967 20 Apr Yes Tangram tangram/prod pods in non ready state
56127 20 Apr No Gravytrain Gravytrain - Tiger Computing
57962 20 Apr Yes Cirencester College ccolive.cirencester.local storage volume usage /var
57944 20 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
55616 20 Apr Yes OGT OGT OS upgrades (Debian 10)
56127 21 Apr No Gravytrain Gravytrain - Tiger Computing
57971 21 Apr Yes Sucden Rebuild HK servers
57959 21 Apr Yes OGT rodney1.internal.ogtip.com failed disk
57967 21 Apr No Tangram tangram/prod pods in non ready state
57964 21 Apr Yes Trident Honda WARNING: Cluster: Csync2 on vmsvr2.trident.lan
57675 21 Apr Yes AskBio Upgrade servers to Debian 13 Trixie
57975 21 Apr Yes OGT Storage alert: /srv/illumina_data on rodney.internal.ogtip.com
57976 21 Apr Yes NFW WARNING: Mail: Exim Panic Log on nfwgs2.nfw.internal
57968 21 Apr Yes NFW Email Forwarding
57965 21 Apr Yes OGT Spare disk for Rodneys
57355 21 Apr No Internal TigerEye / Client Portal / Django Clients Development
57671 22 Apr Yes JISC Upgrade servers to Debian 13 Trixie
57982 22 Apr Yes Sucden globalstar01/02.sucden.co.uk failed services
57972 22 Apr Yes Sucden Connectivity Issue from IXN and PPS and GS2 to Azure.
57962 22 Apr Yes Cirencester College ccolive.cirencester.local storage volume usage /var
57944 22 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
57964 22 Apr Yes Trident Honda WARNING: Cluster: Csync2 on vmsvr2.trident.lan
57675 22 Apr Yes AskBio Upgrade servers to Debian 13 Trixie
57981 22 Apr Yes Internal Check for Security Notices and System Updates
57977 22 Apr Yes Troika Tron VM NFS mounts
57985 22 Apr Yes JISC BCP questions
54777 22 Apr No Internal system reboot required monitoring
57943 22 Apr No Internal Piesup Development
57988 22 Apr Yes Troika Tron Rebuild
57989 22 Apr Yes Internal Gitlab upgrades (18.11)
57996 23 Apr Yes Internal Check for Security Notices and System Updates
57997 23 Apr Yes OGT rodney1 reboot/stonith problem
57944 23 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
57232 23 Apr Yes Gravytrain Setup SecurityGroups for Gravytrain
57714 23 Apr Yes Gravytrain web.prod.bf2.bedfordinsurance.co.uk HTTP/HTTPS timeout for www.bedfordinsuranceforbusiness.co.uk
57999 23 Apr Yes AskBio AskBio outage
57987 23 Apr Yes OpenCorporates Update a user for access to aws-bot2 server
57994 23 Apr Yes Tangram [FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring
58000 23 Apr Yes Tangram [FIRING: 1 for tangram/prod] KubePersistentVolumeFillingUp in tcl-monitoring
57879 23 Apr Yes Quickline Zabbix database partition error; please verify and fix as needed (workaround currently in place)
57940 23 Apr Yes OpenCorporates analysis app release/prod deploy
57992 23 Apr Yes AskBio GITLAB_TOKEN and GITLAB_USERNAME on new RTP server
57678 23 Apr Yes Top To Toe Upgrade server to Debian 13 Trixie
57990 24 Apr Yes Tangram Tangram Gitlab upgrade (18.11)
58007 24 Apr Yes Internal Check for Security Notices and System Updates
57681 24 Apr Yes TCV Upgrade servers to Debian 13 Trixie
58008 24 Apr Yes Tangram CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk
58006 24 Apr Yes AskBio Darkmatter ssh oddity
57232 24 Apr Yes Gravytrain Setup SecurityGroups for Gravytrain
55616 24 Apr Yes OGT OGT OS upgrades (Debian 10)
57987 24 Apr Yes OpenCorporates Update a user for access to aws-bot2 server
58010 24 Apr Yes Trident Honda VMs Hera and Dokuwiki
58014 24 Apr Yes AskBio uv
58011 24 Apr Yes Sucden OLM (svaolmgs201) decommission
58022 27 Apr Yes Internal Check for Security Notices and System Updates
57944 27 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
57675 27 Apr Yes AskBio Upgrade servers to Debian 13 Trixie
58024 27 Apr Yes Tangram tangram/prod pods in non ready state
58006 27 Apr Yes AskBio Darkmatter ssh oddity
57962 27 Apr Yes Cirencester College ccolive.cirencester.local storage volume usage /var
58023 27 Apr Yes Quickline aql-svr-zabbix-app.quickline.co.uk backups to mersey problem
57968 27 Apr Yes NFW Email Forwarding
58019 27 Apr Yes Top To Toe Re: STILL DOWN: toptotoe-staging.net is still offline ([28] Timeout was reached (Operation timed out after 30001 milliseconds with 0 bytes received))
58060 27 Apr Yes Global Brands Printer issue
58062 27 Apr Yes AskBio python-is-python3
57943 27 Apr No Internal Piesup Development
58019 28 Apr Yes Top To Toe Re: STILL DOWN: toptotoe-staging.net is still offline ([28] Timeout was reached (Operation timed out after 30001 milliseconds with 0 bytes received))
58061 28 Apr Yes NFW DOWN: nfwgs2.nfw.internal
58074 28 Apr Yes Crystal Units crylonlis2024 reboot
58069 28 Apr Yes Internal Weekly checks
58072 28 Apr Yes Koinex DOWN: koinexserver.home
57675 28 Apr Yes AskBio Upgrade servers to Debian 13 Trixie
57940 28 Apr Yes OpenCorporates analysis app release/prod deploy
57962 28 Apr Yes Cirencester College ccolive.cirencester.local storage volume usage /var
57379 28 Apr No Sucden F5 load balancer replacement (consultancy)
57985 28 Apr Yes JISC BCP questions
58060 28 Apr Yes Global Brands Printer issue
58076 28 Apr Yes AskBio exim4 not starting on coll,jura
57379 29 Apr No Sucden F5 load balancer replacement (consultancy)
57675 29 Apr Yes AskBio Upgrade servers to Debian 13 Trixie
58023 29 Apr No Quickline aql-svr-zabbix-app.quickline.co.uk backups to mersey problem
58079 29 Apr Yes AskBio pyenv on upgraded servers
58061 29 Apr Yes NFW DOWN: nfwgs2.nfw.internal
57944 29 Apr Yes AskBio ZFS pool data fragmentation on talisker.synpromics.com
57965 29 Apr Yes OGT Spare disk for Rodneys
58078 29 Apr Yes TCV RT autoreply issues
55616 29 Apr Yes OGT OGT OS upgrades (Debian 10)
58090 30 Apr Yes Internal Copy fail
58134 30 Apr Yes Internal Green monitoring check showing as a problem in Icinga
58068 30 Apr Yes BD Group Update .htaccess config.
55616 30 Apr Yes OGT OGT OS upgrades (Debian 10)
58011 30 Apr Yes Sucden OLM (svaolmgs201) decommission
57679 30 Apr Yes Rotastat Upgrade server to Debian 13 Trixie
57611 30 Apr No Crystal Units crylonlis2024 RHEL renewal
57879 01 May Yes Quickline Zabbix database partition error; please verify and fix as needed (workaround currently in place)
58093 01 May Yes AskBio Linux vulnerability: Copy fail (CVE-2026-31431)
58090 01 May Yes Internal Copy fail
58106 01 May Yes Imoves Linux vulnerability: Copy fail (CVE-2026-31431)
58133 01 May Yes ATA Group [-External-] Linux kernel security update (CVE-2026-31431)
58132 01 May Yes Sucden Linux kernel security update (CVE-2026-31431)
58097 01 May Yes Cirencester College Linux vulnerability: Copy fail (CVE-2026-31431)
58139 01 May Yes Sucden Create @sucfin.com accounts for TCL
58144 02 May Yes Sucden CRITICAL: System Health: Systemd State on megastar04.sucden.co.uk
57674 05 May Yes Crystal Units Upgrade servers to Debian 13 Trixie
58154 05 May Yes Globecast gcukscheddbdev and gcukscheddb01 insights client failure
58097 05 May Yes Cirencester College Linux vulnerability: Copy fail (CVE-2026-31431)
58125 05 May Yes Entrepreneurs Circle Linux vulnerability: Copy fail (CVE-2026-31431)
58132 05 May Yes Sucden Linux kernel security update (CVE-2026-31431)
58152 05 May Yes Internal Weekly checks
58150 05 May Yes AskBio login to RTP server
58133 05 May Yes ATA Group [-External-] Linux kernel security update (CVE-2026-31431)
58140 05 May Yes Midnight Hax CRITICAL: Disk: fstab mounts on woodlands.midnighthax.com
58064 05 May Yes OGT rodney.internal.ogtip.com volume usage /srv/ngs
57714 05 May Yes Gravytrain web.prod.bf2.bedfordinsurance.co.uk HTTP/HTTPS timeout for www.bedfordinsuranceforbusiness.co.uk
58096 05 May Yes BD Group Linux vulnerability: Copy fail (CVE-2026-31431)
58104 05 May Yes Globecast Linux vulnerability: Copy fail (CVE-2026-31431)
58103 05 May Yes Global Brands Linux vulnerability: Copy fail (CVE-2026-31431)
58101 05 May Yes ERF Electrical Linux vulnerability: Copy fail (CVE-2026-31431)
58161 06 May Yes Crystal Units FW:
58133 06 May Yes ATA Group [-External-] Linux kernel security update (CVE-2026-31431)
58116 06 May Yes Quickline Linux vulnerability: Copy fail (CVE-2026-31431)
58111 06 May Yes Midnight Hax Linux vulnerability: Copy fail (CVE-2026-31431)
58113 06 May Yes Novadata Linux vulnerability: Copy fail (CVE-2026-31431)
58115 06 May Yes OGT Linux vulnerability: Copy fail (CVE-2026-31431)
58117 06 May Yes Reigate College Linux vulnerability: Copy fail (CVE-2026-31431)
58171 06 May Yes Sucden Storage alert: / on strlb-gs2-p1l01.sucden.co.uk > 90%
58132 06 May Yes Sucden Linux kernel security update (CVE-2026-31431)
58127 06 May Yes Trident Honda Linux vulnerability: Copy fail (CVE-2026-31431)
58097 06 May Yes Cirencester College Linux vulnerability: Copy fail (CVE-2026-31431)
58108 07 May Yes JISC Linux vulnerability: Copy fail (CVE-2026-31431)
58179 07 May Yes Internal Check for Security Notices and System Updates
58101 07 May Yes ERF Electrical Linux vulnerability: Copy fail (CVE-2026-31431)
58172 07 May Yes Crystal Units Fw: can't connect lisec server
58132 07 May Yes Sucden Linux kernel security update (CVE-2026-31431)
58133 07 May Yes ATA Group [-External-] Linux kernel security update (CVE-2026-31431)
58114 07 May Yes OpenCorporates Linux vulnerability: Copy fail (CVE-2026-31431)
58118 07 May Yes Rotastat Linux vulnerability: Copy fail (CVE-2026-31431)
58092 07 May Yes Advensys Linux vulnerability: Copy fail (CVE-2026-31431)
58110 07 May Yes Lantech Linux vulnerability: Copy fail (CVE-2026-31431)
58124 07 May Yes TCV Linux vulnerability: Copy fail (CVE-2026-31431)
58155 07 May No Quickline aql-svr-zabbix-db.quickline.co.uk Zabbix partitioning less than 10 days
58188 07 May Yes Lantech Fw: Incident# 224771 - Multiple Vulnerabilities in Apache HTTP Server
58192 08 May Yes Internal Check for Security Notices and System Updates
58197 08 May Yes TCV web4.tcv.org.uk HTTP/S checks timing out
58181 08 May No Internal Websites down on wey.tiger-computing.co.uk
58125 08 May Yes Entrepreneurs Circle Linux vulnerability: Copy fail (CVE-2026-31431)
58133 08 May Yes ATA Group [-External-] Linux kernel security update (CVE-2026-31431)
58090 08 May Yes Internal Copy fail
58187 08 May No BD Group eFiling: File Access Error
58117 08 May Yes Reigate College Linux vulnerability: Copy fail (CVE-2026-31431)
58105 08 May Yes Gravytrain Linux vulnerability: Copy fail (CVE-2026-31431)
58103 08 May Yes Global Brands Linux vulnerability: Copy fail (CVE-2026-31431)
58132 09 May Yes Sucden Linux kernel security update (CVE-2026-31431)
58213 11 May Yes OGT CRITICAL: System Health: Log Rotation on basil.internal.ogtip.com
58214 11 May Yes Midnight Hax fw.midnighthax.com volume usage /boot
58217 11 May Yes OGT DOWN: damien.internal.ogtip.com
58220 12 May Yes Internal icinga error
58218 12 May Yes Internal Weekly checks
58092 12 May Yes Advensys Linux vulnerability: Copy fail (CVE-2026-31431)
58110 12 May Yes Lantech Linux vulnerability: Copy fail (CVE-2026-31431)
58119 12 May Yes STS NHS FT Linux vulnerability: Copy fail (CVE-2026-31431)
58123 12 May Yes Tennants Distribution Linux vulnerability: Copy fail (CVE-2026-31431)
58112 12 May Yes NFW Linux vulnerability: Copy fail (CVE-2026-31431)
58213 12 May Yes OGT CRITICAL: System Health: Log Rotation on basil.internal.ogtip.com
58189 12 May No Internal /tcl/avon/tcl-ingresss restarts
58155 12 May No Quickline aql-svr-zabbix-db.quickline.co.uk Zabbix partitioning less than 10 days
58116 12 May Yes Quickline Linux vulnerability: Copy fail (CVE-2026-31431)
58124 12 May Yes TCV Linux vulnerability: Copy fail (CVE-2026-31431)
57681 12 May No TCV Upgrade servers to Debian 13 Trixie
58126 12 May Yes Top To Toe Linux vulnerability: Copy fail (CVE-2026-31431)
58234 14 May Yes Internal Action Required: Shared item received 05/13/2026 (admin@tiger-computing.co.uk)
57714 14 May Yes Gravytrain web.prod.bf2.bedfordinsurance.co.uk HTTP/HTTPS timeout for www.bedfordinsuranceforbusiness.co.uk
58213 14 May No OGT CRITICAL: System Health: Log Rotation on basil.internal.ogtip.com
58156 14 May Yes Quickline Zabbix DB
58207 14 May Yes Top To Toe Examine / Potentially Block Outgoing URL Requests To A Particular Domain
58228 14 May Yes Gravytrain Certbot failed on app.prod.qs1.grvytrn.co.uk
58184 14 May Yes Troika Deletion of confidential data request
58224 14 May Yes AskBio Cristina
58090 14 May No Internal Copy fail
58199 14 May Yes Internal Certificate expiring: calcifer.boo.tc (crb)
57734 14 May Yes Entrepreneurs Circle Multiple Servers
58088 14 May Yes OGT Upgrade blaney.internal.ogtip.com to Debian 13 Trixie
58185 14 May Yes OpenCorporates Add Cloudwatch Agent to bot VM
58242 15 May Yes Tangram Tangram Gitlab upgrade (18.11.3)
58247 15 May Yes Internal Check for Security Notices and System Updates
58112 15 May Yes NFW Linux vulnerability: Copy fail (CVE-2026-31431)
58228 15 May Yes Gravytrain Certbot failed on app.prod.qs1.grvytrn.co.uk
58091 15 May Yes Internal CRITICAL: Backups: Backup to woodlands.midnighthax.com on mersey.tiger-computing.co.uk
58170 15 May Yes AskBio New user
57677 15 May Yes BD Group Upgrade servers to Debian 13 Trixie | EFSRV-21666
55616 15 May Yes OGT OGT OS upgrades (Debian 10)
58221 15 May Yes TCV TCV-CRM PHP Update
57681 15 May Yes TCV Upgrade servers to Debian 13 Trixie

git hash: master (6c029d07)