15 minute update

14 Apr - 16 May

RT Client Subject First work started First post-work reply Time to reply
54776 Ingeus DaemonSet rollout stuck | kube-system/csi-azuredisk-node 2025-05-12 10:14:33 2025-05-12 10:56:00 0h 41m
54582 Quickline DNS issues on aql-svr-zabbix-app.quickline.co.uk 2025-04-16 17:55:54 2025-04-16 18:01:02 0h 05m
54603 Sysdoc URL Change for pipelines 2025-05-08 10:08:37 2025-05-08 10:10:19 0h 02m
54566 Aston Matthews Support Tree / Aston Matthews - Linux Support 2025-04-29 15:59:55 2025-04-29 17:01:12 1h 01m
54837 AskBio Root Passwords for Darkmatter, MacLoud, Talisker, Skye 2025-05-13 14:47:06 2025-05-13 15:00:43 0h 14m
53567 OGT Borgmatic issues at OGT 2025-05-13 12:38:32 2025-05-13 12:40:52 0h 02m
54509 OGT Borg backup running long 2025-04-14 14:15:57 2025-04-14 14:16:39 0h 01m
54787 AskBio edb-mull.askbio.com config/timeouts 2025-05-12 10:56:23 2025-05-12 11:15:31 0h 19m
54606 JISC OpenAthens patching 2025-04-23 09:26:24 2025-04-23 09:31:10 0h 05m
54783 Sucden interstar01/3.sucden.co.uk Systemd State 2025-05-12 11:15:53 2025-05-12 14:43:45 3h 28m
54647 Azura Ocado Firewall 2025-04-28 13:04:11 2025-04-28 13:24:04 0h 20m
54842 AskBio New Server and BMC IPs 2025-05-14 10:04:38 2025-05-14 11:04:20 0h 60m
54607 Tusk IC 'arpanpal' gid 2025-04-23 09:52:08 2025-04-23 10:01:27 0h 09m
54569 TCV mis.tcv.org.uk is unreachable 2025-04-16 08:00:00 2025-04-16 08:14:00 0h 14m
54479 OpenCorporates Improve OC ES monitoring 2025-04-23 10:15:42 2025-04-23 10:31:30 0h 16m
54520 AskBio /tmp cleared on Coll, Jura, Mull and Iona 2025-04-15 13:01:51 2025-04-15 13:05:06 0h 03m
54790 eTherapeutics DGX SSH keys 2025-05-13 15:01:50 2025-05-13 15:23:12 0h 21m
54601 OpenCorporates Frontend Redis Dump 2025-04-24 10:30:24 2025-04-24 10:46:07 0h 16m
54869 AskBio cc'd tickets 2025-05-16 12:08:55 2025-05-16 12:13:29 0h 05m
54867 AskBio Login Failure 2025-05-16 10:08:39 2025-05-16 10:10:40 0h 02m
54644 Sucden SpanHost service failed 2025-04-28 15:51:48 2025-04-28 16:09:52 0h 18m
54756 AskBio Gitlab group access token as ENV variable? 2025-05-07 17:04:21 2025-05-07 17:06:49 0h 02m
54599 TCV TCV DNS performance 2025-04-22 11:26:47 2025-04-22 11:48:56 0h 22m
54753 OGT Borg to Restic Switch 2025-05-15 15:08:53 2025-05-20 16:59:54 1h 51m
54741 Gravytrain web.prod.bf2.bedfordinsurance.co.uk 2025-05-12 12:52:35 None 1d 1h 07m
54789 Tusk IC mammoth.tusknet disk volume usage /srv/scratch 2025-05-16 09:01:47 2025-05-16 09:05:19 0h 04m
54497 Sucden FW: STAR hardware decommission 2025-04-17 15:13:48 2025-04-17 16:00:31 0h 47m
54846 OGT *.ogtip.com connectivity issue 2025-05-14 10:56:41 2025-05-14 11:07:14 0h 11m
54838 AskBio AskBio Highly Available Reverse Proxy 2025-05-13 15:51:08 2025-05-13 15:54:01 0h 03m
54483 OpenCorporates OpenC Release 2025-04-11 11:29:57 None 1d 2h 30m
54649 AskBio Gitlab runners 2025-05-02 12:00:31 2025-05-02 12:06:26 0h 06m
54577 eTherapeutics CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx2.internal.etherapeutics.co.uk 2025-04-16 11:01:02 2025-04-16 12:00:11 0h 59m
54562 Quickline aql-svr-zabbix-app/aql-svr-zabbix-db distro upgrade 2025-05-02 11:41:02 2025-05-02 11:42:05 0h 01m
54397 Ingeus Fwd: PIM: Tiger Admin 365's Owner role expires in 14 day(s) 2025-04-28 16:19:24 2025-04-28 16:20:55 0h 02m
54615 Kahootz Daily dashboard (RT-34259) empty again 2025-04-24 09:30:00 2025-04-24 09:48:18 0h 18m
54738 Gravytrain app.prod.bf1.grvytrn.co.uk 2025-05-12 13:09:47 None 1d 0h 50m
54739 Gravytrain app.prod.qs1.grvytrn.co.uk 2025-05-12 13:05:00 None 1d 0h 55m
54502 OpenCorporates san1 drive failure 2025-04-25 09:08:11 2025-04-25 11:56:17 2h 48m
54740 Gravytrain prod.gt1.grvytrn.co.uk 2025-05-12 12:48:01 None 1d 1h 12m
54346 AskBio Datavita server migration 2025-05-07 16:25:08 2025-05-12 16:27:51 0h 03m
54608 Sucden Service Removals 2025-04-23 14:43:14 None 9h 17m
54651 Tusk IC change user passwords 2025-05-06 10:24:27 2025-05-06 10:26:35 0h 02m
54782 BD Group ef-v5-nodes.c.ef-platform.internal multiple/all domain timeouts 2025-05-12 15:30:31 2025-05-12 16:13:42 0h 43m
54670 ERF Electrical FTP Access - erfelectrical.co.uk / erfmakingme 2025-05-08 12:04:39 2025-05-08 12:25:20 0h 21m
54748 Tusk IC new sudo user 2025-05-07 09:28:34 2025-05-07 09:45:08 0h 17m
54506 AskBio edb-coll: restic-home-backup.service fails 2025-04-14 13:40:21 None 1d 0h 20m
54164 Sucden Sucden systems monitoring cleanup 2025-04-14 12:39:13 2025-04-14 17:04:33 4h 25m
54372 OpenCorporates Improve OC mysql cluster monitoring 2025-04-23 10:30:58 2025-04-23 11:13:38 0h 43m
54482 Ingeus Git Repository is not Ready 2025-04-16 15:45:56 2025-04-16 16:23:08 0h 37m
54576 BD Group PEN Tests 2025-04-16 10:50:28 2025-04-16 10:52:02 0h 02m
54563 Lantech ipa-m3.private.ipa.ie distro upgrade 2025-05-07 09:17:20 2025-05-07 17:39:58 8h 23m
54513 Trident Honda Storage alert: / on smbfs1.trident.lan 2025-04-14 10:02:03 2025-04-14 10:12:48 0h 11m
54678 Cambridge Flow Solutions Ansys issue and move SLURM master 2025-05-14 11:23:58 2025-05-20 09:50:01 2d 2h 26m
54564 DLS Plastics dls-zimbra1.dls.internal distro upgrade 2025-05-06 12:18:51 2025-05-06 12:19:52 0h 01m
54510 AskBio Non-symlink files in /etc/apache2/sites-enabled on edb-iona.askbio.com 2025-04-15 13:19:17 2025-04-15 14:51:19 1h 32m
54077 Sucden Support for svaolmgs201 2025-04-15 14:54:43 None 9h 05m
54511 OpenCorporates sec1 backup failure 2025-04-23 08:29:49 2025-04-23 08:42:15 0h 12m
54793 Novadata arcturus failed system updates 2025-05-13 08:51:10 None 1d 5h 09m
54324 Sucden Onboarding of svaolmgs201 2025-04-14 10:40:07 2025-04-14 11:23:46 0h 44m
54440 OpenCorporates ElastiCache Monitoring 2025-05-08 10:11:00 2025-05-08 10:27:47 0h 17m
54393 TCV Test domain? 2025-04-14 17:09:25 2025-04-14 17:20:33 0h 11m
54565 OGT /srv on blaney.internal.ogtip.com is at 91% utilisation 2025-04-15 13:38:45 2025-04-15 13:50:22 0h 12m
54755 AskBio prompt-softdev.askbio.com and capsiddb-softdev.askbio.com 2025-05-08 10:03:22 2025-05-08 10:07:17 0h 04m
54735 ITC Compliance Expiring certificate: ITC Compliance 2025-05-08 10:33:16 2025-05-08 11:01:22 0h 28m
54757 AskBio CRITICAL: System Health: Systemd State on edb-iona.askbio.com 2025-05-08 09:47:21 2025-05-08 09:47:50 0h 00m
54769 OpenCorporates Backgrounder2 crash 2025-05-08 13:09:42 2025-05-08 14:44:41 1h 35m
54642 Sucden openibd in a failed state 2025-04-28 16:11:35 2025-04-28 16:36:19 0h 25m
54591 Novadata X2go connection failure 2025-04-17 15:39:29 2025-04-17 15:53:12 0h 14m
54595 OpenCorporates frontend-sentinel12.opencorporates.internal 2025-04-18 02:09:13 2025-04-18 02:17:41 0h 08m
54600 Entrepreneurs Circle Urgent Update Required: IP Address Change for New HQ 2025-04-22 11:51:22 2025-04-22 11:57:22 0h 06m
54598 Gravytrain prod.gt1.grvytrn.co.uk disk full 2025-04-22 09:58:33 2025-04-22 10:02:11 0h 04m
54574 OpenCorporates Better uptime 2025-04-16 09:08:18 2025-04-16 10:30:24 1h 22m
54770 Econic Bio Configure Microsoft 365 Identity Provider 2025-05-14 14:18:57 2025-05-14 14:27:00 0h 08m
54797 Lantech IPA-M3 Database backup schedule 2025-05-14 09:02:45 2025-05-14 09:19:13 0h 16m
54852 eTherapeutics Gitlab issues 2025-05-14 16:04:32 2025-05-14 16:28:17 0h 24m
54798 Gravytrain app.prod.qs1.grvytrn.co.uk unmerged config 2025-05-13 09:58:09 2025-05-13 09:59:48 0h 02m
54799 OGT *.ogtip.com connectivity issue 2025-05-13 09:01:23 2025-05-13 09:03:21 0h 02m
54841 Quickline CRITICAL: System Health: Systemd State on aql-svr-zabbix-app.quickline.co.uk 2025-05-13 17:11:56 2025-05-13 17:18:17 0h 06m
54667 TCV mis.tcv.org.uk 2025-05-06 10:54:07 2025-05-06 11:36:57 0h 43m
54643 Sucden DKMS in a failed state | interstar01,2 2025-05-07 16:56:34 2025-05-09 12:07:46 1d 9h 11m
54800 NFW nfw access issue 2025-05-13 09:17:27 2025-05-13 10:29:49 1h 12m
54585 ERF Electrical WARNING: Security: WordPress Versions on weblive.erfelectrical.co.uk 2025-04-23 08:49:37 2025-04-23 09:01:35 0h 12m
54588 Reigate College Backups cannot reach rc-mss.reigate.ac.uk 2025-04-22 10:54:34 2025-04-22 11:07:58 0h 13m
54575 OpenCorporates OpenC - GitHub PR to deploy code to PreProd environment 2025-04-16 10:40:16 None 1d 3h 20m
54736 ITC Compliance DR Testing 2025-05-13 11:16:05 2025-05-13 11:34:02 0h 18m
54567 OpenCorporates OpenC API - PR to remove Circle CI tests and replace with GitHub Workflow 2025-04-15 13:57:59 None 1d 0h 02m
54692 STS NHS FT Quarterly Systems Check 2025-05-06 12:08:45 2025-05-06 12:35:03 0h 26m
54845 Cambridge Flow Solutions cfsj0*.cfs connection lost 2025-05-14 09:56:42 2025-05-14 10:01:14 0h 05m
54617 Geograph Geograph Gitlab upgrade (17.11.1) 2025-04-24 10:01:03 2025-04-24 12:35:40 2h 35m
54604 OpenCorporates frontend-sentinel12 connection fail 2025-04-23 08:42:30 2025-04-23 08:49:26 0h 07m
54610 OpenCorporates frontend-sentinel12 redis ping problem 2025-04-23 15:32:53 2025-04-23 15:46:37 0h 14m
54614 OpenCorporates OpenCorporates Gitlab upgrade 17.11.1 2025-04-24 08:30:54 2025-04-24 08:57:43 0h 27m
54616 eTherapeutics ETX Gitlab upgrade (17.11.1) 2025-04-25 07:58:41 2025-04-25 08:55:37 0h 57m
54618 OpenCorporates web / api / frontend redis 2025-05-08 10:02:12 2025-05-08 10:03:32 0h 01m
54619 Global Brands CRITICAL: Ontech/Vision IPsec VPN from claycross on claycross.global-brands.internal 2025-04-24 12:09:32 2025-04-24 12:33:44 0h 24m
54621 OpenCorporates Frontend Sentinels 2025-04-29 08:35:40 2025-04-29 10:28:45 1h 53m
54622 BD Group IP Whitelisting 2025-04-24 15:34:30 2025-04-24 17:06:43 1h 32m
54624 OpenCorporates [FIRING:1] OpenSearch Health (openc) Tiger Computing (527311303844:oc-prod-opensearch-openc yellow prom-exporter-opensearch-oc-prod-cluster-openc-prometheus-elast.monitoring.svc:9108 prom-exporter-ope 2025-04-25 10:55:05 2025-04-25 10:58:22 0h 03m
54623 OGT blaney.internal.ogtip.com disk volume usage /srv 2025-04-24 15:59:24 2025-04-24 16:16:57 0h 18m
54634 Kahootz Puppet config 2025-04-25 12:51:44 2025-04-25 13:55:05 1h 03m
54635 Kahootz CRITICAL: NRPE Disk: All Disks on xray.hosting.inovem.com 2025-04-25 17:10:17 None 6h 50m
54638 BD Group ef-v5-nodes.c.ef-platform.internal multiple/all domain timeouts 2025-04-28 08:54:38 2025-04-28 09:02:15 0h 08m
54639 eTherapeutics dgx2.internal.etherapeutics.co.uk volume usage / 2025-04-30 10:51:32 2025-04-30 10:53:01 0h 01m
54645 Sucden Mail Queue Check not working | declan 2025-04-28 15:38:45 2025-04-28 15:46:32 0h 08m
54646 BD Group CRITICAL: HTTP: portal.ownyourownbusiness.co.uk HTTPS on ef-v5-nodes.c.ef-platform.internal 2025-04-28 12:57:11 2025-04-28 12:59:15 0h 02m
54648 Tusk IC TUSK IC: Linux password reset 2025-04-28 15:48:28 2025-04-30 16:07:00 0h 19m
54650 Geograph Persistent Volume filling up 2025-04-28 14:55:34 2025-04-28 15:21:57 0h 26m
54652 Tusk IC DOWN: *.tusknet 2025-04-28 16:59:54 None 7h 00m
54654 Cambridge Flow Solutions cfsj01 node reboot 2025-04-28 17:27:40 2025-04-28 17:29:53 0h 02m
54656 OpenCorporates CRITICAL: Check Ceph Health on san1.opencorporates.internal 2025-04-29 10:31:40 2025-04-30 10:50:55 0h 19m
54659 OpenCorporates OC system removals 2025-04-29 12:10:34 None 1d 1h 49m
54660 AskBio docker version on iona/mull/coll/jura 2025-05-02 12:10:55 2025-05-02 16:04:24 3h 53m
54669 Quickline aql-svr-zabbix-app: failed system updates 2025-05-02 09:03:34 2025-05-02 09:21:50 0h 18m
54662 TCV TCV-Web4 PHP 2025-05-06 08:00:42 2025-05-06 08:01:33 0h 01m
54663 AskBio group change for Andrew Kirkwood 2025-05-02 11:03:47 2025-05-02 11:40:00 0h 36m
54665 Kahootz EC private key for a client TLS certificate 2025-04-30 12:45:29 2025-04-30 12:48:14 0h 03m
54666 Sucden *.sucden.co.uk unmerged configuration files 2025-04-30 15:48:40 2025-04-30 16:37:14 0h 49m
54671 TCV WARNING: Security: Let's Encrypt Certificates on web4.tcv.org.uk 2025-05-06 13:47:36 2025-05-06 14:13:10 0h 26m
54672 Kahootz Add pmohq.shepherdsafetyservices.com to named.conf.local on oscar. 2025-05-02 10:18:47 2025-05-02 11:38:37 1h 20m
54674 AskBio WARNING: NRPE Disk: All Disks on edb-lab-skye.askbio.com 2025-05-02 11:34:30 2025-05-02 11:36:28 0h 02m
54681 AskBio Http to https 2025-05-07 11:04:34 2025-05-07 11:36:11 0h 32m
54683 OpenCorporates backgrounder2 stalled 2025-05-02 11:16:11 2025-05-02 11:32:15 0h 16m
54684 AskBio edb-lab-skye.askbio.com storage volume usage / 2025-05-02 13:43:40 2025-05-02 15:19:32 1h 36m
54685 Edinburgh University mathsgpu2/3 offline 2025-05-02 17:50:16 2025-05-06 09:53:15 1d 6h 03m
54693 Ingeus Ingeus: login to Azure 2025-05-06 10:40:17 2025-05-06 10:50:03 0h 10m
54696 Sucden Unmerged config files on interstar03,04,05 2025-05-06 09:56:00 2025-05-06 10:08:41 0h 13m
54835 OpenCorporates sql13.opencorporates.internal - ZFS Health sanoid_cacheupdate 2025-05-13 13:03:08 None 1d 0h 57m
54697 DLS Plastics WARNING: Mail: Queue Length on dls-filestore1.dls.internal 2025-05-06 11:54:30 2025-05-06 12:02:30 0h 08m
54699 Tusk IC DOWN: *.tusknet 2025-05-06 15:34:33 2025-05-06 15:38:10 0h 04m
54743 OpenCorporates Backgrounder2 crash 2025-05-06 15:19:12 2025-05-06 15:20:41 0h 01m
54749 JISC Re: Google Cloud Armor WAF Implementation Testing 2025-05-07 16:38:41 2025-05-07 16:46:44 0h 08m
54751 Cirencester College Remove from support: ccweb02,ccweb03,ccsitert 2025-05-07 09:55:07 2025-05-07 10:11:40 0h 17m
54752 Lantech Liaising in relation to IPA moodle.ipa.ie 2025-05-07 14:10:33 2025-05-07 14:11:06 0h 01m
54763 eTherapeutics Upgrade GitLab to 17.11.2 2025-05-09 08:00:13 2025-05-09 08:30:31 0h 30m
54764 OpenCorporates Upgrade GitLab to 17.11.2 2025-05-08 11:49:36 2025-05-08 11:50:52 0h 01m
54765 Geograph Upgrade GitLab to 17.11.2 2025-05-08 17:11:19 2025-05-08 17:32:05 0h 21m
54766 Quickline RADIUS 2025-05-08 12:40:26 2025-05-08 12:49:11 0h 09m
54775 OpenCorporates CRITICAL: Systemd State on sql13.opencorporates.internal 2025-05-09 13:30:44 2025-05-09 13:49:08 0h 18m
54778 Quickline Drive Filling - RADIUS 2025-05-09 09:51:23 2025-05-09 09:52:42 0h 01m
54779 eTherapeutics WARNING: NRPE Disk: /var on dgx1.internal.etherapeutics.co.uk 2025-05-09 11:09:26 2025-05-09 11:21:22 0h 12m
54796 Novadata arcturus.novadata.internal disk volume usage /home 2025-05-13 11:54:22 2025-05-13 12:04:51 0h 10m
54100 BD Group CRITICAL: HTTP: formations.elementalcosec.com HTTPS on ef-v5-nodes.c.ef-platform.internal 2025-03-10 19:39:35 None 4h 20m

git hash: master (6c029d07)