Client updates report (Incidents)

18 May - 19 Jun

RT	Client	Replies missed	Subject
58370	Internal		[FIRING: 1 for tcl/avon] NodeMemoryMajorPagesFaults in tcl-monitoring
58348	OGT		WARNING: NRPE Disk: /srv/ngs on rodney.internal.ogtip.com
58337	Internal		Check for Security Notices and System Updates
58352	Internal		Multiple client systems down
58335	OGT		rodney.internal.ogtip.com volume usage /srv/department
58338	Internal		nene1/2.ipa.tigr.uk unmerged config
58501	Sucden		Urgent LUKS Code Required
58317	OGT	25 May	manuel.internal.ogtip.com restic issues
58308	Geograph		geograph/prod node not ready
58305	Internal		Check for Security Notices and System Updates
58307	Cirencester College		ccolive.cirencester.local stars HTTP/HTTPS timeouts
58291	AskBio		CRITICAL: Networking: SSH on rtp-promptdv-01.askbio.com
58315	Internal		Check for Security Notices and System Updates
58503	Internal		Check for Security Notices and System Updates
58330	OGT		manuel.internal.ogtip.com backup repo check failed (/srv/projects)
58269	Internal		Check for Security Notices and System Updates
58292	Internal		DOWN: trent.tiger-computing.co.uk
58117	Reigate College	17 May	Linux vulnerability: Copy fail (CVE-2026-31431)
58293	OGT		mickey/granddad.internal.ogtip.com configuration failure
58343	Internal		Check for Security Notices and System Updates
58439	Rotastat	13 Jun	Server Connection
58344	AskBio		edb-coll.askbio.com backup failure
58349	Advensys		CRITICAL: Networking: SSH on arpinodeb.clients.advensys.internal
58374	AskBio		CRITICAL: System Health: Systemd State on edb-mull.askbio.com
58270	Troika		tron.troika.lan volume usage /mnt/pve/troika_vm_v2
58422	Novadata		WARNING: NRPE Disk: All Disks on arcturus.novadata.internal
58282	OGT		Restart Docker service on Basil
58251	OGT		basil.internal.ogtip.com volume usage /data
58290	Internal		Check for Security Notices and System Updates
58408	Cirencester College		CRITICAL: System Health: Systemd State on ccwebdb01.cirencester.ac.uk
58284	Internal		Check for Security Notices and System Updates
58278	AskBio		/tmp cleanup script errors on talisker
58271	NFW		nfwgs2.nfw.internal volume usage /home
58354	Internal		Check for Security Notices and System Updates
58377	Internal		Check for Security Notices and System Updates
58321	NFW		DOWN: nfwgs2.nfw.internal
58431	Internal		Check for Security Notices and System Updates
58508	Internal		FluxResourceNotReady multiple if not all clusters for HelmRepository/sealed-secrets
58359	Koinex		WARNING: System Health: Reboot Alert on koinexserver.home
58523	TCV		WARNING: NRPE Disk: /boot on web4.tcv.org.uk
58530	Cirencester College		CRITICAL: Disk: fstab mounts on ccolive.cirencester.local
58333	Internal		[FIRING: 1 for tcl/avon] KubePodCrashLooping in rt
58273	OGT	19 May	Run updates failure on blaney.internal.ogtip.com
58346	Sucden		equistar03/04 megastar03/04 NTP offset
58230	AskBio		Backup failure on macleod.synpromics.com
58228	Gravytrain		Certbot failed on app.prod.qs1.grvytrn.co.uk
58325	Internal		Check for Security Notices and System Updates
58285	Troika		Unmerged config file on tron.troika.lan
58296	Internal		WARNING: Backups: BackupPC directories (NRPE) on mersey.tiger-computing.co.uk
58360	Novadata		WARNING: System Health: Kitchen Sink on arcturus.novadata.internal
58334	Internal		Check for Security Notices and System Updates
58511	Globecast		gcuksched*.globecastne.com proxy not working
58286	Lantech		Storage utilisation warning: / on ipa-m3.private.ipa.ie
58255	Lantech		ClamAV warnings this morning (15/05/2026)
58155	Quickline	06 May	aql-svr-zabbix-db.quickline.co.uk Zabbix partitioning less than 10 days
58361	TCV		WARNING: System Health: Kitchen Sink on tcv-crm.tcv.org.uk
58468	AskBio		/ade mount unavailable
58420	Internal		Check for Security Notices and System Updates
58524	Internal		Check for Security Notices and System Updates
58275	TCV		Storage alert: /var on web4.tcv.org.uk
58434	Internal		Icinga timeouts
58430	Reigate College		rc-mss.reigate.ac.uk root volume expansion
58091	Internal		CRITICAL: Backups: Backup to woodlands.midnighthax.com on mersey.tiger-computing.co.uk
58287	Crystal Units		Storage utilisation warning: /backup on crylonlis2024.crystal.local
58442	Internal		Check for Security Notices and System Updates
58276	OGT		Storage alert: /srv/illumina_data on rodney.internal.ogtip.com
58110	Lantech	17 May	Linux vulnerability: Copy fail (CVE-2026-31431)
58432	OGT		CRITICAL: NRPE Disk: All Disks on manuel.internal.ogtip.com
58329	AskBio		backups issue
58495	AskBio		CRITICAL: Backups: Restic s3.askbio.backup on edb-jura.askbio.com
58441	OGT		CRITICAL: NRPE Disk: All Disks on basil.internal.ogtip.com
58460	Internal		Check for Security Notices and System Updates
58433	BD Group		CRITICAL: HTTP: my.eacbs.com HTTP on ef-v5-nodes.c.ef-platform.internal
58466	Internal		Check for Security Notices and System Updates
58514	AskBio		CRITICAL: NRPE Disk: All Disks on edb-lab-skye.askbio.com
58525	OGT		basil.internal.ogtip.com volume usage /data
58444	Reigate College		rc-mss.reigate.ac.uk volume expansion
58540	Internal		Check for Security Notices and System Updates
58446	Troika		CRITICAL: System Health: Systemd State on tricky.troika.lan
58469	TCV		TCV-CRM PHP Version
58481	Crystal Units		Fw: Invoice email copy - not sending email
58535	AskBio		All hosts down.synpromics.com
58533	Quickline		aql-svr-sf-radius01.quickline.co.uk systemd unit failure
58532	Internal		Check for Security Notices and System Updates
58412	OGT	05 Jun	rodney: /srv/department and /srv/projects filling up
58448	Internal		Check for Security Notices and System Updates
58450	Internal	09 Jun	Server with excess backups and no quota
58541	Internal		pre/backups conf issue?
58465	OGT	13 Jun	WARNING: NRPE Disk: /srv on blaney.internal.ogtip.com
58472	Internal		Service failed on Thames: restic-forget
58517	Internal		Check for Security Notices and System Updates
58512	AskBio		“relay not permitted”
58534	Sucden		CRITICAL: Networking: *.sucden.co.uk
58526	Internal		tcl systems unmerged bird config
58115	OGT	18 May, 23 May, 30 May, 05 Jun	Linux vulnerability: Copy fail (CVE-2026-31431)
58487	TCV		WARNING: Puppet: Checking-in on it.tcv.org.uk
58490	Internal		Check for Security Notices and System Updates
58494	Internal		CRITICAL: Backups: Restic tcl-thames on avon1.tcl.internal
58452	AskBio		Storage in /usr/local on rtp-promptdv-01
58536	OGT		basil.internal.ogtip.com down
58454	OGT		CRITICAL: NRPE Disk: All Disks on mickey.internal.ogtip.com
58518	Advensys		DOWN: arpinodeb.clients.advensys.internal
58350	Lantech		ipa-m3.private.ipa.ie moodle.ipa.ie HTTP/S timeouts
58429	AskBio		Fw: FAO All Tenants: Easter Bush Buildings Network Outage 18th June 2026 07:00-08:30 AM
58527	OGT		cassandra.internal.ogtip.com raid/jbod controller battery
58437	AskBio		Pyenv issue
58498	OGT		Storage alert: /srv/projects on rodney.internal.ogtip.com @ 95%
58537	OGT		Failed sending HTTP2 data on sybil when using git clone on github repo
58492	Sucden		WARNING: NRPE Disk: All Disks on ubjen-gs2-p1l01.sucden.co.uk
58421	AskBio		CRITICAL: Backups: Restic s3.weka.backup on edb-coll.askbio.com
58485	Internal		Check for Security Notices and System Updates
58538	Sucden		strlb-gs2-p1l01/2.sucden.co.uk root volume usage
58500	AskBio		CRITICAL: Backups: Backup to thames.tiger-computing.co.uk on rtp-promptdv-01.askbio.com
58486	Sucden		CRITICAL: System Health: Systemd State on strlb-gs2-p1l01.sucden.co.uk
58528	Lantech		ipa-m3.private.ipa.ie unmerged config
58520	Globecast	18 Jun	gcukscheddbdev.globecastne.com license check

git hash: master (6c029d07)

Package	Version	Homepage	Summary
alchemical	1.0.3	None	Modern SQLAlchemy simplified
alembic	1.18.5	None	A database migration tool for SQLAlchemy.
annotated-types	0.7.0	None	Reusable constraint types to use with typing.Annotated
anyio	4.14.1	None	High-level concurrency and networking framework on top of asyncio or Trio
ast_serialize	0.6.0	None	Python bindings for mypy AST serialization
asttokens	3.0.1	https://github.com/gristlabs/asttokens	Annotate AST trees with source code positions
backoff	2.2.1	https://github.com/litl/backoff	Function decoration for backoff and retry
blinker	1.9.0	None	Fast, simple object-to-object and broadcast signaling
Bootstrap-Flask	2.5.0	None	Bootstrap 4 & 5 helper for your Flask projects.
certifi	2026.6.17	https://github.com/certifi/python-certifi	Python package for providing Mozilla's CA Bundle.
charset-normalizer	3.4.7	None	The Real First Universal Charset Detector. Open, modern and actively maintained alternative to Chardet.
click	8.4.2	None	Composable command line interface toolkit
colorlog	6.10.1	https://github.com/borntyping/python-colorlog	Add colours to the output of Python's logging module.
decorator	5.3.1	None	Decorators for Humans
executing	2.2.1	https://github.com/alexmojaki/executing	Get the currently executing AST node of a frame, and other information
Flask	3.1.3	None	A simple framework for building complex web applications.
Flask-DebugToolbar	0.16.0	None	A toolbar overlay for debugging Flask applications.
Flask-DebugToolbar-LineProfilerPanel	1.0.2	https://github.com/phleet/flask_debugtoolbar_lineprofilerpanel	Panel for the Flask Debug toolbar to capture and view line-by-line profiling stats
Flask-Migrate	4.1.0	None	SQLAlchemy database migrations for Flask applications using Alembic.
Flask-SQLAlchemy	3.1.1	None	Add SQLAlchemy support to your Flask application.
Flask-WTF	1.3.0	None	Form rendering, validation, and CSRF protection for Flask with WTForms.
freezegun	1.5.5	https://github.com/spulec/freezegun	Let your Python tests travel through time
gql	4.0.0	https://github.com/graphql-python/gql	GraphQL client for Python
graphql-core	3.2.11	https://github.com/graphql-python/graphql-core	GraphQL implementation for Python, a port of GraphQL.js, the JavaScript reference implementation for GraphQL.
greenlet	3.5.3	None	Lightweight in-process concurrent programming
gunicorn	26.0.0	None	WSGI HTTP Server for UNIX
h11	0.16.0	https://github.com/python-hyper/h11	A pure-Python, bring-your-own-I/O implementation of HTTP/1.1
httpcore	1.0.9	None	A minimal low-level HTTP client.
httpx	0.28.1	None	The next generation HTTP client.
idna	3.18	None	Internationalized Domain Names in Applications (IDNA)
ilock	1.0.3	https://github.com/symonsoft/ilock	Inter-process named lock library
ipython	9.15.0	None	IPython: Productive Interactive Computing
ipython_pygments_lexers	1.1.1	None	Defines a variety of Pygments lexers for highlighting IPython code.
itsdangerous	2.2.0	None	Safely pass data to untrusted environments and back.
jedi	0.20.0	https://github.com/davidhalter/jedi	An autocompletion tool for Python that can be used for text editors.
Jinja2	3.1.6	None	A very fast and expressive template engine.
librt	0.12.0	None	Mypyc runtime library
line_profiler	5.0.2	https://github.com/pyutils/line_profiler	Line-by-line profiler
Mako	1.3.12	https://www.makotemplates.org/	A super-fast templating language that borrows the best ideas from the existing templating languages.
MarkupSafe	3.0.3	None	Safely add untrusted strings to HTML/XML markup.
matplotlib-inline	0.2.2	None	Inline Matplotlib backend for Jupyter
multidict	6.7.1	https://github.com/aio-libs/multidict	multidict implementation
mypy	2.2.0	None	Optional static typing for Python
mypy_extensions	1.1.0	None	Type system extensions for programs checked with the mypy type checker.
packaging	26.2	None	Core utilities for Python packages
parso	0.8.7	https://github.com/davidhalter/parso	A Python Parser
pathspec	1.1.1	None	Utility library for gitignore style pattern matching of file paths.
pdbp	1.8.2	https://github.com/mdmintz/pdbp	pdbp (Pdb+): A drop-in replacement for pdb and pdbpp.
pexpect	4.9.0	https://pexpect.readthedocs.io/	Pexpect allows easy control of interactive console applications.
portalocker	3.2.0	None	Wraps the portalocker recipe for easy usage
prompt_toolkit	3.0.52	None	Library for building powerful interactive command lines in Python
propcache	0.5.2	https://github.com/aio-libs/propcache	Accelerated property cache
psutil	7.2.2	https://github.com/giampaolo/psutil	Cross-platform lib for process and system monitoring.
psycopg	3.3.4	None	PostgreSQL database adapter for Python
psycopg-binary	3.3.4	None	PostgreSQL database adapter for Python -- C optimisation distribution
ptyprocess	0.7.0	https://github.com/pexpect/ptyprocess	Run a subprocess in a pseudo terminal
pure_eval	0.2.3	http://github.com/alexmojaki/pure_eval	Safely evaluate AST nodes without side effects
pydantic	2.13.4	None	Data validation using Python type hints
pydantic_core	2.46.4	https://github.com/pydantic/pydantic	Core functionality for Pydantic validation and serialization
Pygments	2.20.0	None	Pygments is a syntax highlighting package written in Python.
python-dateutil	2.9.0.post0	https://github.com/dateutil/dateutil	Extensions to the standard Python datetime module
python-dotenv	1.2.2	None	Read key-value pairs from a .env file and set them as environment variables
pytz	2026.2	http://pythonhosted.org/pytz	World timezone definitions, modern and historical
requests	2.34.2	None	Python HTTP for Humans.
requests-toolbelt	1.0.0	https://toolbelt.readthedocs.io/	A utility belt for advanced users of python-requests
rt	3.7.1	None	Python interface to Request Tracker API
six	1.17.0	https://github.com/benjaminp/six	Python 2 and 3 compatibility utilities
SQLAlchemy	2.0.51	https://www.sqlalchemy.org	Database Abstraction Library
stack-data	0.6.3	http://github.com/alexmojaki/stack_data	Extract data from python stack frames and tracebacks for informative displays
stackprinter	0.2.13	https://github.com/cknd/stackprinter	Debug-friendly stack traces, with variable values and semantic highlighting
tabcompleter	1.4.1	https://github.com/mdmintz/tabcompleter	tabcompleter --- Autocompletion in the Python console.
traitlets	5.15.1	None	Traitlets Python configuration system
types-pytz	2026.2.0.20260518	None	Typing stubs for pytz
typing-inspection	0.4.2	None	Runtime typing introspection tools
typing_extensions	4.16.0	None	Backported and Experimental Type Hints for Python 3.9+
urllib3	2.7.0	None	HTTP library with thread-safe connection pooling, file post, and more.
wcwidth	0.8.2	None	Measures the displayed width of unicode strings in a terminal
Werkzeug	3.1.8	None	The comprehensive WSGI web application library.
WTForms	3.2.2	None	Form validation and rendering for Python web development.
yarl	1.24.2	https://github.com/aio-libs/yarl	Yet another URL library

Resource	Value
User CPU time	123.065 msec
System CPU time	2.462 msec
Total CPU time	125.527 msec
Elapsed time	149.447 msec
Context switches	195 voluntary, 3 involuntary

Key	Value
HTTP_ACCEPT	/
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_HOST	dashboard.uat.tigr.uk
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
QUERY_STRING	end=2026-06-19&start=2026-05-18
REMOTE_ADDR	10.42.140.143
REQUEST_METHOD	GET
SCRIPT_NAME
SERVER_NAME	0.0.0.0
SERVER_PORT	8000
SERVER_PROTOCOL	HTTP/1.1
SERVER_SOFTWARE	gunicorn/26.0.0

Variable	Value
'end'	'2026-06-19'
'start'	'2026-05-18'

Variable	Value
g	<flask.g of 'app'>
meta	{'title': 'Client updates report (Incidents)', 'start': datetime.date(2026, 5, 18), 'end': datetime.date(2026, 6, 19)}
request	<Request 'http://dashboard.uat.tigr.uk/client_updates_report_drilldown/Incidents?end=2026-06-19&start=2026-05-18' [GET]>
tickets	[<Ticket(id=8784, rt_number=58370, queue=Incidents, subject=[FIRING: 1 for tcl/avon] NodeMemoryMajorPagesFaults in tcl-monitoring, ticket_status=closed, client=Internal, priority=41, created=2026-06-01 14:06:11, last_txn_id=0>, <Ticket(id=8762, rt_number=58348, queue=Incidents, subject=WARNING: NRPE Disk: /srv/ngs on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-05-29 12:49:04, last_txn_id=0>, <Ticket(id=8751, rt_number=58337, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-28 00:00:03, last_txn_id=0>, <Ticket(id=8766, rt_number=58352, queue=Incidents, subject=Multiple client systems down, ticket_status=closed, client=Internal, priority=81, created=2026-05-30 13:20:29, last_txn_id=0>, <Ticket(id=8749, rt_number=58335, queue=Incidents, subject=rodney.internal.ogtip.com volume usage /srv/department, ticket_status=closed, client=OGT, priority=51, created=2026-05-27 14:16:43, last_txn_id=0>, <Ticket(id=8752, rt_number=58338, queue=Incidents, subject=nene1/2.ipa.tigr.uk unmerged config, ticket_status=closed, client=Internal, priority=41, created=2026-05-28 08:23:16, last_txn_id=0>, <Ticket(id=8947, rt_number=58501, queue=Incidents, subject=Urgent LUKS Code Required, ticket_status=closed, client=Sucden, priority=61, created=2026-06-13 17:15:03, last_txn_id=0>, <Ticket(id=8731, rt_number=58317, queue=Incidents, subject=manuel.internal.ogtip.com restic issues, ticket_status=closed, client=OGT, priority=51, created=2026-05-22 08:15:11, last_txn_id=0>, <Ticket(id=8722, rt_number=58308, queue=Incidents, subject=geograph/prod node not ready, ticket_status=closed, client=Geograph, priority=51, created=2026-05-21 10:21:28, last_txn_id=0>, <Ticket(id=8719, rt_number=58305, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-21 00:00:03, last_txn_id=0>, <Ticket(id=8721, rt_number=58307, queue=Incidents, subject=ccolive.cirencester.local stars HTTP/HTTPS timeouts, ticket_status=closed, client=Cirencester College, priority=61, created=2026-05-21 09:18:45, last_txn_id=0>, <Ticket(id=8673, rt_number=58291, queue=Incidents, subject=CRITICAL: Networking: SSH on rtp-promptdv-01.askbio.com, ticket_status=closed, client=AskBio, priority=71, created=2026-05-20 02:28:24, last_txn_id=0>, <Ticket(id=8729, rt_number=58315, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-22 00:00:03, last_txn_id=0>, <Ticket(id=8949, rt_number=58503, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-15 00:00:05, last_txn_id=0>, <Ticket(id=8744, rt_number=58330, queue=Incidents, subject=manuel.internal.ogtip.com backup repo check failed (/srv/projects), ticket_status=closed, client=OGT, priority=51, created=2026-05-26 08:25:34, last_txn_id=0>, <Ticket(id=8651, rt_number=58269, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-18 00:00:05, last_txn_id=0>, <Ticket(id=8674, rt_number=58292, queue=Incidents, subject=DOWN: trent.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=61, created=2026-05-20 02:35:34, last_txn_id=0>, <Ticket(id=8467, rt_number=58117, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Reigate College, priority=74, created=2026-04-30 10:03:37, last_txn_id=0>, <Ticket(id=8675, rt_number=58293, queue=Incidents, subject=mickey/granddad.internal.ogtip.com configuration failure, ticket_status=closed, client=OGT, priority=41, created=2026-05-20 08:14:07, last_txn_id=0>, <Ticket(id=8757, rt_number=58343, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-29 00:00:03, last_txn_id=0>, <Ticket(id=8853, rt_number=58439, queue=Incidents, subject=Server Connection, ticket_status=resolved, client=Rotastat, priority=44, created=2026-06-04 14:36:09, last_txn_id=0>, <Ticket(id=8758, rt_number=58344, queue=Incidents, subject=edb-coll.askbio.com backup failure, ticket_status=closed, client=AskBio, priority=71, created=2026-05-29 08:43:17, last_txn_id=0>, <Ticket(id=8763, rt_number=58349, queue=Incidents, subject=CRITICAL: Networking: SSH on arpinodeb.clients.advensys.internal, ticket_status=closed, client=Advensys, priority=51, created=2026-05-29 14:20:16, last_txn_id=0>, <Ticket(id=8788, rt_number=58374, queue=Incidents, subject=CRITICAL: System Health: Systemd State on edb-mull.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-01 18:15:29, last_txn_id=0>, <Ticket(id=8652, rt_number=58270, queue=Incidents, subject=tron.troika.lan volume usage /mnt/pve/troika_vm_v2, ticket_status=closed, client=Troika, priority=41, created=2026-05-18 08:28:41, last_txn_id=0>, <Ticket(id=8836, rt_number=58422, queue=Incidents, subject=WARNING: NRPE Disk: All Disks on arcturus.novadata.internal, ticket_status=closed, client=Novadata, priority=41, created=2026-06-03 08:54:56, last_txn_id=0>, <Ticket(id=8664, rt_number=58282, queue=Incidents, subject=Restart Docker service on Basil, ticket_status=closed, client=OGT, priority=51, created=2026-05-18 16:17:16, last_txn_id=0>, <Ticket(id=8633, rt_number=58251, queue=Incidents, subject=basil.internal.ogtip.com volume usage /data, ticket_status=closed, client=OGT, priority=31, created=2026-05-15 08:19:58, last_txn_id=0>, <Ticket(id=8672, rt_number=58290, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-20 00:00:03, last_txn_id=0>, <Ticket(id=8822, rt_number=58408, queue=Incidents, subject=CRITICAL: System Health: Systemd State on ccwebdb01.cirencester.ac.uk, ticket_status=closed, client=Cirencester College, priority=41, created=2026-06-02 10:59:49, last_txn_id=0>, <Ticket(id=8666, rt_number=58284, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-19 00:00:05, last_txn_id=0>, <Ticket(id=8660, rt_number=58278, queue=Incidents, subject=/tmp cleanup script errors on talisker, ticket_status=closed, client=AskBio, priority=61, created=2026-05-18 10:57:23, last_txn_id=0>, <Ticket(id=8653, rt_number=58271, queue=Incidents, subject=nfwgs2.nfw.internal volume usage /home, ticket_status=closed, client=NFW, priority=51, created=2026-05-18 08:50:51, last_txn_id=0>, <Ticket(id=8768, rt_number=58354, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-01 00:00:04, last_txn_id=0>, <Ticket(id=8791, rt_number=58377, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-02 00:00:05, last_txn_id=0>, <Ticket(id=8735, rt_number=58321, queue=Incidents, subject=DOWN: nfwgs2.nfw.internal, ticket_status=closed, client=NFW, priority=61, created=2026-05-22 14:57:50, last_txn_id=0>, <Ticket(id=8845, rt_number=58431, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-04 00:00:05, last_txn_id=0>, <Ticket(id=8954, rt_number=58508, queue=Incidents, subject=FluxResourceNotReady multiple if not all clusters for HelmRepository/sealed-secrets, ticket_status=closed, client=Internal, priority=41, created=2026-06-15 11:08:35, last_txn_id=0>, <Ticket(id=8773, rt_number=58359, queue=Incidents, subject=WARNING: System Health: Reboot Alert on koinexserver.home, ticket_status=closed, client=Koinex, priority=41, created=2026-06-01 08:05:35, last_txn_id=0>, <Ticket(id=8969, rt_number=58523, queue=Incidents, subject=WARNING: NRPE Disk: /boot on web4.tcv.org.uk, ticket_status=closed, client=TCV, priority=41, created=2026-06-16 12:21:37, last_txn_id=0>, <Ticket(id=8976, rt_number=58530, queue=Incidents, subject=CRITICAL: Disk: fstab mounts on ccolive.cirencester.local, ticket_status=closed, client=Cirencester College, priority=41, created=2026-06-17 13:16:26, last_txn_id=0>, <Ticket(id=8747, rt_number=58333, queue=Incidents, subject=[FIRING: 1 for tcl/avon] KubePodCrashLooping in rt, ticket_status=closed, client=Internal, priority=51, created=2026-05-26 16:21:07, last_txn_id=0>, <Ticket(id=8655, rt_number=58273, queue=Incidents, subject=Run updates failure on blaney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=42, created=2026-05-18 10:26:58, last_txn_id=0>, <Ticket(id=8760, rt_number=58346, queue=Incidents, subject=equistar03/04 megastar03/04 NTP offset, ticket_status=closed, client=Sucden, priority=71, created=2026-05-29 10:49:47, last_txn_id=0>, <Ticket(id=8612, rt_number=58230, queue=Incidents, subject=Backup failure on macleod.synpromics.com, ticket_status=closed, client=AskBio, priority=62, created=2026-05-13 10:12:42, last_txn_id=0>, <Ticket(id=8610, rt_number=58228, queue=Incidents, subject=Certbot failed on app.prod.qs1.grvytrn.co.uk, ticket_status=closed, client=Gravytrain, priority=22, created=2026-05-13 10:12:33, last_txn_id=0>, <Ticket(id=8739, rt_number=58325, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-25 00:00:06, last_txn_id=0>, <Ticket(id=8667, rt_number=58285, queue=Incidents, subject=Unmerged config file on tron.troika.lan, ticket_status=closed, client=Troika, priority=21, created=2026-05-19 11:00:40, last_txn_id=0>, <Ticket(id=8678, rt_number=58296, queue=Incidents, subject=WARNING: Backups: BackupPC directories (NRPE) on mersey.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=41, created=2026-05-20 09:24:38, last_txn_id=0>, <Ticket(id=8774, rt_number=58360, queue=Incidents, subject=WARNING: System Health: Kitchen Sink on arcturus.novadata.internal, ticket_status=closed, client=Novadata, priority=41, created=2026-06-01 08:11:00, last_txn_id=0>, <Ticket(id=8748, rt_number=58334, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-27 00:00:03, last_txn_id=0>, <Ticket(id=8957, rt_number=58511, queue=Incidents, subject=gcuksched.globecastne.com proxy not working, ticket_status=closed, client=Globecast, priority=31, created=2026-06-15 15:54:50, last_txn_id=0>, <Ticket(id=8668, rt_number=58286, queue=Incidents, subject=Storage utilisation warning: / on ipa-m3.private.ipa.ie, ticket_status=closed, client=Lantech, priority=22, created=2026-05-19 11:04:21, last_txn_id=2507477>, <Ticket(id=8637, rt_number=58255, queue=Incidents, subject=ClamAV warnings this morning (15/05/2026), ticket_status=closed, client=Lantech, priority=41, created=2026-05-15 10:42:49, last_txn_id=0>, <Ticket(id=8537, rt_number=58155, queue=Incidents, subject=aql-svr-zabbix-db.quickline.co.uk Zabbix partitioning less than 10 days, ticket_status=closed, client=Quickline, priority=53, created=2026-05-05 08:31:42, last_txn_id=0>, <Ticket(id=8775, rt_number=58361, queue=Incidents, subject=WARNING: System Health: Kitchen Sink on tcv-crm.tcv.org.uk, ticket_status=closed, client=TCV, priority=41, created=2026-06-01 08:17:40, last_txn_id=0>, <Ticket(id=8914, rt_number=58468, queue=Incidents, subject=/ade mount unavailable, ticket_status=closed, client=AskBio, priority=71, created=2026-06-10 05:04:01, last_txn_id=0>, <Ticket(id=8834, rt_number=58420, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-03 00:00:03, last_txn_id=0>, <Ticket(id=8970, rt_number=58524, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-17 00:00:03, last_txn_id=0>, <Ticket(id=8657, rt_number=58275, queue=Incidents, subject=Storage alert: /var on web4.tcv.org.uk, ticket_status=closed, client=TCV, priority=41, created=2026-05-18 10:35:20, last_txn_id=0>, <Ticket(id=8848, rt_number=58434, queue=Incidents, subject=Icinga timeouts, ticket_status=closed, client=Internal, priority=71, created=2026-06-04 13:16:40, last_txn_id=0>, <Ticket(id=8844, rt_number=58430, queue=Incidents, subject=rc-mss.reigate.ac.uk root volume expansion, ticket_status=closed, client=Reigate College, priority=1, created=2026-06-03 21:02:56, last_txn_id=0>, <Ticket(id=8441, rt_number=58091, queue=Incidents, subject=CRITICAL: Backups: Backup to woodlands.midnighthax.com on mersey.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=53, created=2026-04-30 08:53:57, last_txn_id=2498019>, <Ticket(id=8669, rt_number=58287, queue=Incidents, subject=Storage utilisation warning: /backup on crylonlis2024.crystal.local, ticket_status=closed, client=Crystal Units, priority=61, created=2026-05-19 11:06:09, last_txn_id=0>, <Ticket(id=8856, rt_number=58442, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-05 00:00:02, last_txn_id=0>, <Ticket(id=8658, rt_number=58276, queue=Incidents, subject=Storage alert: /srv/illumina_data on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-05-18 10:37:54, last_txn_id=0>, <Ticket(id=8460, rt_number=58110, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Lantech, priority=53, created=2026-04-30 10:00:51, last_txn_id=0>, <Ticket(id=8846, rt_number=58432, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on manuel.internal.ogtip.com, ticket_status=closed, client=OGT, priority=51, created=2026-06-04 08:58:00, last_txn_id=0>, <Ticket(id=8743, rt_number=58329, queue=Incidents, subject=backups issue, ticket_status=closed, client=AskBio, priority=51, created=2026-05-26 08:16:14, last_txn_id=0>, <Ticket(id=8941, rt_number=58495, queue=Incidents, subject=CRITICAL: Backups: Restic s3.askbio.backup on edb-jura.askbio.com, ticket_status=closed, client=AskBio, priority=1, created=2026-06-12 08:47:50, last_txn_id=0>, <Ticket(id=8855, rt_number=58441, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on basil.internal.ogtip.com, ticket_status=closed, client=OGT, priority=22, created=2026-06-04 15:15:13, last_txn_id=0>, <Ticket(id=8874, rt_number=58460, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-09 00:00:03, last_txn_id=0>, <Ticket(id=8847, rt_number=58433, queue=Incidents, subject=CRITICAL: HTTP: my.eacbs.com HTTP on ef-v5-nodes.c.ef-platform.internal, ticket_status=closed, client=BD Group, priority=52, created=2026-06-04 09:51:31, last_txn_id=0>, <Ticket(id=8912, rt_number=58466, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-10 00:00:04, last_txn_id=0>, <Ticket(id=8960, rt_number=58514, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on edb-lab-skye.askbio.com, ticket_status=closed, client=AskBio, priority=71, created=2026-06-15 18:11:24, last_txn_id=0>, <Ticket(id=8971, rt_number=58525, queue=Incidents, subject=basil.internal.ogtip.com volume usage /data, ticket_status=closed, client=OGT, priority=31, created=2026-06-17 08:00:07, last_txn_id=0>, <Ticket(id=8858, rt_number=58444, queue=Incidents, subject=rc-mss.reigate.ac.uk volume expansion, ticket_status=closed, client=Reigate College, priority=41, created=2026-06-05 09:09:41, last_txn_id=0>, <Ticket(id=8987, rt_number=58540, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-19 00:00:03, last_txn_id=0>, <Ticket(id=8860, rt_number=58446, queue=Incidents, subject=CRITICAL: System Health: Systemd State on tricky.troika.lan, ticket_status=closed, client=Troika, priority=41, created=2026-06-05 14:45:02, last_txn_id=0>, <Ticket(id=8915, rt_number=58469, queue=Incidents, subject=TCV-CRM PHP Version, ticket_status=closed, client=TCV, priority=41, created=2026-06-10 08:57:00, last_txn_id=0>, <Ticket(id=8927, rt_number=58481, queue=Incidents, subject=Fw: Invoice email copy - not sending email, ticket_status=closed, client=Crystal Units, priority=71, created=2026-06-10 14:03:35, last_txn_id=2513288>, <Ticket(id=8981, rt_number=58535, queue=Incidents, subject=All hosts down.synpromics.com, ticket_status=closed, client=AskBio, priority=91, created=2026-06-18 07:09:35, last_txn_id=0>, <Ticket(id=8979, rt_number=58533, queue=Incidents, subject=aql-svr-sf-radius01.quickline.co.uk systemd unit failure, ticket_status=closed, client=Quickline, priority=61, created=2026-06-18 01:09:41, last_txn_id=0>, <Ticket(id=8978, rt_number=58532, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-18 00:00:03, last_txn_id=0>, <Ticket(id=8826, rt_number=58412, queue=Incidents, subject=rodney: /srv/department and /srv/projects filling up, ticket_status=closed, client=OGT, priority=42, created=2026-06-02 13:08:28, last_txn_id=0>, <Ticket(id=8862, rt_number=58448, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-08 00:00:04, last_txn_id=0>, <Ticket(id=8864, rt_number=58450, queue=Incidents, subject=Server with excess backups and no quota, ticket_status=resolved, client=Internal, priority=53, created=2026-06-08 09:35:05, last_txn_id=0>, <Ticket(id=8988, rt_number=58541, queue=Incidents, subject=pre/backups conf issue?, ticket_status=closed, client=Internal, priority=51, created=2026-06-19 08:18:42, last_txn_id=0>, <Ticket(id=8879, rt_number=58465, queue=Incidents, subject=WARNING: NRPE Disk: /srv on blaney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=42, created=2026-06-09 14:37:23, last_txn_id=2514233>, <Ticket(id=8918, rt_number=58472, queue=Incidents, subject=Service failed on Thames: restic-forget, ticket_status=closed, client=Internal, priority=41, created=2026-06-10 09:11:54, last_txn_id=0>, <Ticket(id=8963, rt_number=58517, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-16 00:00:04, last_txn_id=0>, <Ticket(id=8958, rt_number=58512, queue=Incidents, subject=“relay not permitted”, ticket_status=closed, client=AskBio, priority=51, created=2026-06-15 16:09:36, last_txn_id=0>, <Ticket(id=8980, rt_number=58534, queue=Incidents, subject=CRITICAL: Networking: .sucden.co.uk, ticket_status=resolved, client=Sucden, priority=91, created=2026-06-18 01:15:17, last_txn_id=0>, <Ticket(id=8972, rt_number=58526, queue=Incidents, subject=tcl systems unmerged bird config, ticket_status=closed, client=Internal, priority=41, created=2026-06-17 08:23:01, last_txn_id=0>, <Ticket(id=8465, rt_number=58115, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=resolved, client=OGT, priority=76, created=2026-04-30 10:02:21, last_txn_id=2514298>, <Ticket(id=8933, rt_number=58487, queue=Incidents, subject=WARNING: Puppet: Checking-in on it.tcv.org.uk, ticket_status=closed, client=TCV, priority=51, created=2026-06-11 10:37:24, last_txn_id=0>, <Ticket(id=8936, rt_number=58490, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-12 00:00:03, last_txn_id=0>, <Ticket(id=8940, rt_number=58494, queue=Incidents, subject=CRITICAL: Backups: Restic tcl-thames on avon1.tcl.internal, ticket_status=closed, client=Internal, priority=41, created=2026-06-12 08:44:29, last_txn_id=0>, <Ticket(id=8866, rt_number=58452, queue=Incidents, subject=Storage in /usr/local on rtp-promptdv-01, ticket_status=closed, client=AskBio, priority=71, created=2026-06-08 10:14:06, last_txn_id=0>, <Ticket(id=8982, rt_number=58536, queue=Incidents, subject=basil.internal.ogtip.com down, ticket_status=resolved, client=OGT, priority=41, created=2026-06-18 08:06:41, last_txn_id=0>, <Ticket(id=8868, rt_number=58454, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on mickey.internal.ogtip.com, ticket_status=closed, client=OGT, priority=1, created=2026-06-08 14:01:06, last_txn_id=0>, <Ticket(id=8964, rt_number=58518, queue=Incidents, subject=DOWN: arpinodeb.clients.advensys.internal, ticket_status=closed, client=Advensys, priority=31, created=2026-06-16 08:02:05, last_txn_id=0>, <Ticket(id=8764, rt_number=58350, queue=Incidents, subject=ipa-m3.private.ipa.ie moodle.ipa.ie HTTP/S timeouts, ticket_status=closed, client=Lantech, priority=21, created=2026-05-29 15:28:06, last_txn_id=0>, <Ticket(id=8843, rt_number=58429, queue=Incidents, subject=Fw: FAO All Tenants: Easter Bush Buildings Network Outage 18th June 2026 07:00-08:30 AM, ticket_status=closed, client=AskBio, priority=71, created=2026-06-03 15:30:03, last_txn_id=0>, <Ticket(id=8973, rt_number=58527, queue=Incidents, subject=cassandra.internal.ogtip.com raid/jbod controller battery, ticket_status=closed, client=OGT, priority=31, created=2026-06-17 08:38:04, last_txn_id=0>, <Ticket(id=8851, rt_number=58437, queue=Incidents, subject=Pyenv issue, ticket_status=closed, client=AskBio, priority=62, created=2026-06-04 13:31:53, last_txn_id=0>, <Ticket(id=8944, rt_number=58498, queue=Incidents, subject=Storage alert: /srv/projects on rodney.internal.ogtip.com @ 95%, ticket_status=closed, client=OGT, priority=41, created=2026-06-12 14:38:40, last_txn_id=0>, <Ticket(id=8983, rt_number=58537, queue=Incidents, subject=Failed sending HTTP2 data on sybil when using git clone on github repo, ticket_status=closed, client=OGT, priority=41, created=2026-06-18 10:40:25, last_txn_id=0>, <Ticket(id=8938, rt_number=58492, queue=Incidents, subject=WARNING: NRPE Disk: All Disks on ubjen-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=1, created=2026-06-12 08:20:59, last_txn_id=0>, <Ticket(id=8835, rt_number=58421, queue=Incidents, subject=CRITICAL: Backups: Restic s3.weka.backup on edb-coll.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-03 08:42:35, last_txn_id=0>, <Ticket(id=8931, rt_number=58485, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-11 00:00:03, last_txn_id=0>, <Ticket(id=8984, rt_number=58538, queue=Incidents, subject=strlb-gs2-p1l01/2.sucden.co.uk root volume usage , ticket_status=closed, client=Sucden, priority=61, created=2026-06-18 11:30:14, last_txn_id=0>, <Ticket(id=8946, rt_number=58500, queue=Incidents, subject=CRITICAL: Backups: Backup to thames.tiger-computing.co.uk on rtp-promptdv-01.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-12 17:06:43, last_txn_id=0>, <Ticket(id=8932, rt_number=58486, queue=Incidents, subject=CRITICAL: System Health: Systemd State on strlb-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=50, created=2026-06-11 08:45:16, last_txn_id=0>, <Ticket(id=8974, rt_number=58528, queue=Incidents, subject=ipa-m3.private.ipa.ie unmerged config, ticket_status=closed, client=Lantech, priority=21, created=2026-06-17 10:24:31, last_txn_id=0>, <Ticket(id=8966, rt_number=58520, queue=Incidents, subject=gcukscheddbdev.globecastne.com license check, ticket_status=resolved, client=Globecast, priority=52, created=2026-06-16 09:43:45, last_txn_id=0>]

Client updates report (Incidents)

18 May - 19 Jun

Versions

Installed Packages

Resource Usage

HTTP Headers

Request Vars

View information

COOKIES Variables

SESSION Variables

GET Variables

POST Variables

Templates

client_updates_report_drilldown.html

SQLAlchemy queries

Queries Unavailable

Configure Flask-SQLAlchemy:

Log Messages

Line Profiler Usage Docs

Usage Instructions

Level	Time	Message	Location
DEBUG	2026-07-10 07:25:27.427999	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428056	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428069	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428077	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428083	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428089	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428095	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428101	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428106	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428111	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428117	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428122	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428128	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428133	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428138	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428143	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428148	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428154	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428159	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428164	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428169	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428174	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428180	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428186	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428192	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428197	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428202	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428208	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428213	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428218	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428223	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428228	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428240	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428246	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428252	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428256	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428262	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428267	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428272	xxx	./services/model.py:838
DEBUG	2026-07-10 07:25:27.428277	xxx	./services/model.py:838