Client updates report (Incidents)

25 May - 26 Jun

RT	Client	Replies missed	Subject
58370	Internal		[FIRING: 1 for tcl/avon] NodeMemoryMajorPagesFaults in tcl-monitoring
58348	OGT		WARNING: NRPE Disk: /srv/ngs on rodney.internal.ogtip.com
58337	Internal		Check for Security Notices and System Updates
58352	Internal		Multiple client systems down
58335	OGT		rodney.internal.ogtip.com volume usage /srv/department
58338	Internal		nene1/2.ipa.tigr.uk unmerged config
58549	TCV		web4.tcv.org.uk volume usage /home
58501	Sucden		Urgent LUKS Code Required
58317	OGT	25 May	manuel.internal.ogtip.com restic issues
58545	Sucden		interstar05/09.sucden.co.uk ntp timeout
58503	Internal		Check for Security Notices and System Updates
58330	OGT		manuel.internal.ogtip.com backup repo check failed (/srv/projects)
58573	Sucden		Sucden outage
58343	Internal		Check for Security Notices and System Updates
58439	Rotastat	13 Jun	Server Connection
58344	AskBio		edb-coll.askbio.com backup failure
58349	Advensys		CRITICAL: Networking: SSH on arpinodeb.clients.advensys.internal
58374	AskBio		CRITICAL: System Health: Systemd State on edb-mull.askbio.com
58422	Novadata		WARNING: NRPE Disk: All Disks on arcturus.novadata.internal
58408	Cirencester College		CRITICAL: System Health: Systemd State on ccwebdb01.cirencester.ac.uk
58562	Internal		Check for Security Notices and System Updates
58354	Internal		Check for Security Notices and System Updates
58377	Internal		Check for Security Notices and System Updates
58547	Internal		Check for Security Notices and System Updates
58431	Internal		Check for Security Notices and System Updates
58508	Internal		FluxResourceNotReady multiple if not all clusters for HelmRepository/sealed-secrets
58359	Koinex		WARNING: System Health: Reboot Alert on koinexserver.home
58594	Internal		Check for Security Notices and System Updates
58544	Crystal Units		crylonlis001/002 ntp timeout
58523	TCV		WARNING: NRPE Disk: /boot on web4.tcv.org.uk
58530	Cirencester College		CRITICAL: Disk: fstab mounts on ccolive.cirencester.local
58333	Internal		[FIRING: 1 for tcl/avon] KubePodCrashLooping in rt
58346	Sucden		equistar03/04 megastar03/04 NTP offset
58325	Internal		Check for Security Notices and System Updates
58360	Novadata		WARNING: System Health: Kitchen Sink on arcturus.novadata.internal
58334	Internal		Check for Security Notices and System Updates
58511	Globecast		gcuksched*.globecastne.com proxy not working
58286	Lantech		Storage utilisation warning: / on ipa-m3.private.ipa.ie
58593	AskBio		Storage critical: /var on rtp-promptdv-01.askbio.com
58361	TCV		WARNING: System Health: Kitchen Sink on tcv-crm.tcv.org.uk
58468	AskBio		/ade mount unavailable
58420	Internal		Check for Security Notices and System Updates
58524	Internal		Check for Security Notices and System Updates
58434	Internal		Icinga timeouts
58430	Reigate College		rc-mss.reigate.ac.uk root volume expansion
58596	ATA Group		SAP Services Dropped
58442	Internal		Check for Security Notices and System Updates
58432	OGT		CRITICAL: NRPE Disk: All Disks on manuel.internal.ogtip.com
58329	AskBio		backups issue
58495	AskBio		CRITICAL: Backups: Restic s3.askbio.backup on edb-jura.askbio.com
58553	AskBio		exim4 failed on edb-mull.askbio.com
58441	OGT		CRITICAL: NRPE Disk: All Disks on basil.internal.ogtip.com
58548	Troika		tricky/tron.troika.lan down
58460	Internal		Check for Security Notices and System Updates
58433	BD Group		CRITICAL: HTTP: my.eacbs.com HTTP on ef-v5-nodes.c.ef-platform.internal
58551	AskBio		WARNING: Storage: RAID on talisker.synpromics.com
58550	OGT		Storage warning: /srv/ngs on rodney.internal.ogtip.com
58568	DLS Plastics		Peterborough site outage
58466	Internal		Check for Security Notices and System Updates
58514	AskBio		CRITICAL: NRPE Disk: All Disks on edb-lab-skye.askbio.com
58575	Internal		WARNING: Cluster: Csync2 on ouse1/2.tiger-computing.co.uk
58543	Sucden		CRITICAL: Networking: *.sucden.co.uk
58525	OGT		basil.internal.ogtip.com volume usage /data
58444	Reigate College		rc-mss.reigate.ac.uk volume expansion
58540	Internal		Check for Security Notices and System Updates
58563	BD Group		api.bdgroup.co.uk HTTP/HTTPS status code
58598	Internal		[FIRING: 1 for tcl/calder] KubePersistentVolumeFillingUp in puppet
58446	Troika		CRITICAL: System Health: Systemd State on tricky.troika.lan
58569	Internal	24 Jun	ogt/askbio sssd.conf mod issue - puppet changeloop
58576	OGT		mickey.internal.ogtip.com volume usage /var
58469	TCV		TCV-CRM PHP Version
58578	OGT		Storage alert: /var on mickey.internal.ogtip.com
58481	Crystal Units		Fw: Invoice email copy - not sending email
58535	AskBio		All hosts down.synpromics.com
58533	Quickline		aql-svr-sf-radius01.quickline.co.uk systemd unit failure
58532	Internal		Check for Security Notices and System Updates
58412	OGT	05 Jun	rodney: /srv/department and /srv/projects filling up
58448	Internal		Check for Security Notices and System Updates
58450	Internal	09 Jun, 19 Jun	Server with excess backups and no quota
58541	Internal		pre/backups conf issue?
58554	AskBio		exim4 failure on darkmatter.synpromics.com
58465	OGT	13 Jun	WARNING: NRPE Disk: /srv on blaney.internal.ogtip.com
58570	TCV		mis.tcv.org.uk config loop
58472	Internal		Service failed on Thames: restic-forget
58517	Internal		Check for Security Notices and System Updates
58512	AskBio		“relay not permitted”
58534	Sucden		CRITICAL: Networking: *.sucden.co.uk
58574	Internal		Check for Security Notices and System Updates
58526	Internal		tcl systems unmerged bird config
58115	OGT	30 May, 05 Jun, 20 Jun	Linux vulnerability: Copy fail (CVE-2026-31431)
58589	Internal		WARNING: NRPE Disk: All Disks on avon2.tcl.internal
58487	TCV		WARNING: Puppet: Checking-in on it.tcv.org.uk
58490	Internal		Check for Security Notices and System Updates
58494	Internal		CRITICAL: Backups: Restic tcl-thames on avon1.tcl.internal
58452	AskBio		Storage in /usr/local on rtp-promptdv-01
58536	OGT		basil.internal.ogtip.com down
58454	OGT		CRITICAL: NRPE Disk: All Disks on mickey.internal.ogtip.com
58518	Advensys		DOWN: arpinodeb.clients.advensys.internal
58350	Lantech		ipa-m3.private.ipa.ie moodle.ipa.ie HTTP/S timeouts
58429	AskBio		Fw: FAO All Tenants: Easter Bush Buildings Network Outage 18th June 2026 07:00-08:30 AM
58527	OGT		cassandra.internal.ogtip.com raid/jbod controller battery
58437	AskBio		Pyenv issue
58498	OGT		Storage alert: /srv/projects on rodney.internal.ogtip.com @ 95%
58537	OGT		Failed sending HTTP2 data on sybil when using git clone on github repo
58579	OGT		Storage alert: /srv on blaney.internal.ogtip.com
58492	Sucden		WARNING: NRPE Disk: All Disks on ubjen-gs2-p1l01.sucden.co.uk
58421	AskBio		CRITICAL: Backups: Restic s3.weka.backup on edb-coll.askbio.com
58567	OGT		Temperature
58556	Midnight Hax		WARNING: Mail: Queue Length on woodlands.midnighthax.com
58485	Internal		Check for Security Notices and System Updates
58582	Internal		Check for Security Notices and System Updates
58572	OGT		Basil access issues?
58538	Sucden		strlb-gs2-p1l01/2.sucden.co.uk root volume usage
58557	Crystal Units		Automatic patching services not running
58500	AskBio		CRITICAL: Backups: Backup to thames.tiger-computing.co.uk on rtp-promptdv-01.askbio.com
58486	Sucden		CRITICAL: System Health: Systemd State on strlb-gs2-p1l01.sucden.co.uk
58577	Crystal Units		Sytems outage
58528	Lantech		ipa-m3.private.ipa.ie unmerged config
58520	Globecast	18 Jun, 23 Jun	gcukscheddbdev.globecastne.com license check
58584	Rotastat		gallus.rotastat.com unmerged configuration

git hash: master (6c029d07)

Package	Version	Homepage	Summary
alchemical	1.0.3	None	Modern SQLAlchemy simplified
alembic	1.18.5	None	A database migration tool for SQLAlchemy.
annotated-types	0.7.0	None	Reusable constraint types to use with typing.Annotated
anyio	4.14.1	None	High-level concurrency and networking framework on top of asyncio or Trio
ast_serialize	0.6.0	None	Python bindings for mypy AST serialization
asttokens	3.0.1	https://github.com/gristlabs/asttokens	Annotate AST trees with source code positions
backoff	2.2.1	https://github.com/litl/backoff	Function decoration for backoff and retry
blinker	1.9.0	None	Fast, simple object-to-object and broadcast signaling
Bootstrap-Flask	2.5.0	None	Bootstrap 4 & 5 helper for your Flask projects.
certifi	2026.6.17	https://github.com/certifi/python-certifi	Python package for providing Mozilla's CA Bundle.
charset-normalizer	3.4.7	None	The Real First Universal Charset Detector. Open, modern and actively maintained alternative to Chardet.
click	8.4.2	None	Composable command line interface toolkit
colorlog	6.10.1	https://github.com/borntyping/python-colorlog	Add colours to the output of Python's logging module.
decorator	5.3.1	None	Decorators for Humans
executing	2.2.1	https://github.com/alexmojaki/executing	Get the currently executing AST node of a frame, and other information
Flask	3.1.3	None	A simple framework for building complex web applications.
Flask-DebugToolbar	0.16.0	None	A toolbar overlay for debugging Flask applications.
Flask-DebugToolbar-LineProfilerPanel	1.0.2	https://github.com/phleet/flask_debugtoolbar_lineprofilerpanel	Panel for the Flask Debug toolbar to capture and view line-by-line profiling stats
Flask-Migrate	4.1.0	None	SQLAlchemy database migrations for Flask applications using Alembic.
Flask-SQLAlchemy	3.1.1	None	Add SQLAlchemy support to your Flask application.
Flask-WTF	1.3.0	None	Form rendering, validation, and CSRF protection for Flask with WTForms.
freezegun	1.5.5	https://github.com/spulec/freezegun	Let your Python tests travel through time
gql	4.0.0	https://github.com/graphql-python/gql	GraphQL client for Python
graphql-core	3.2.11	https://github.com/graphql-python/graphql-core	GraphQL implementation for Python, a port of GraphQL.js, the JavaScript reference implementation for GraphQL.
greenlet	3.5.3	None	Lightweight in-process concurrent programming
gunicorn	26.0.0	None	WSGI HTTP Server for UNIX
h11	0.16.0	https://github.com/python-hyper/h11	A pure-Python, bring-your-own-I/O implementation of HTTP/1.1
httpcore	1.0.9	None	A minimal low-level HTTP client.
httpx	0.28.1	None	The next generation HTTP client.
idna	3.18	None	Internationalized Domain Names in Applications (IDNA)
ilock	1.0.3	https://github.com/symonsoft/ilock	Inter-process named lock library
ipython	9.15.0	None	IPython: Productive Interactive Computing
ipython_pygments_lexers	1.1.1	None	Defines a variety of Pygments lexers for highlighting IPython code.
itsdangerous	2.2.0	None	Safely pass data to untrusted environments and back.
jedi	0.20.0	https://github.com/davidhalter/jedi	An autocompletion tool for Python that can be used for text editors.
Jinja2	3.1.6	None	A very fast and expressive template engine.
librt	0.12.0	None	Mypyc runtime library
line_profiler	5.0.2	https://github.com/pyutils/line_profiler	Line-by-line profiler
Mako	1.3.12	https://www.makotemplates.org/	A super-fast templating language that borrows the best ideas from the existing templating languages.
MarkupSafe	3.0.3	None	Safely add untrusted strings to HTML/XML markup.
matplotlib-inline	0.2.2	None	Inline Matplotlib backend for Jupyter
multidict	6.7.1	https://github.com/aio-libs/multidict	multidict implementation
mypy	2.2.0	None	Optional static typing for Python
mypy_extensions	1.1.0	None	Type system extensions for programs checked with the mypy type checker.
packaging	26.2	None	Core utilities for Python packages
parso	0.8.7	https://github.com/davidhalter/parso	A Python Parser
pathspec	1.1.1	None	Utility library for gitignore style pattern matching of file paths.
pdbp	1.8.2	https://github.com/mdmintz/pdbp	pdbp (Pdb+): A drop-in replacement for pdb and pdbpp.
pexpect	4.9.0	https://pexpect.readthedocs.io/	Pexpect allows easy control of interactive console applications.
portalocker	3.2.0	None	Wraps the portalocker recipe for easy usage
prompt_toolkit	3.0.52	None	Library for building powerful interactive command lines in Python
propcache	0.5.2	https://github.com/aio-libs/propcache	Accelerated property cache
psutil	7.2.2	https://github.com/giampaolo/psutil	Cross-platform lib for process and system monitoring.
psycopg	3.3.4	None	PostgreSQL database adapter for Python
psycopg-binary	3.3.4	None	PostgreSQL database adapter for Python -- C optimisation distribution
ptyprocess	0.7.0	https://github.com/pexpect/ptyprocess	Run a subprocess in a pseudo terminal
pure_eval	0.2.3	http://github.com/alexmojaki/pure_eval	Safely evaluate AST nodes without side effects
pydantic	2.13.4	None	Data validation using Python type hints
pydantic_core	2.46.4	https://github.com/pydantic/pydantic	Core functionality for Pydantic validation and serialization
Pygments	2.20.0	None	Pygments is a syntax highlighting package written in Python.
python-dateutil	2.9.0.post0	https://github.com/dateutil/dateutil	Extensions to the standard Python datetime module
python-dotenv	1.2.2	None	Read key-value pairs from a .env file and set them as environment variables
pytz	2026.2	http://pythonhosted.org/pytz	World timezone definitions, modern and historical
requests	2.34.2	None	Python HTTP for Humans.
requests-toolbelt	1.0.0	https://toolbelt.readthedocs.io/	A utility belt for advanced users of python-requests
rt	3.7.1	None	Python interface to Request Tracker API
six	1.17.0	https://github.com/benjaminp/six	Python 2 and 3 compatibility utilities
SQLAlchemy	2.0.51	https://www.sqlalchemy.org	Database Abstraction Library
stack-data	0.6.3	http://github.com/alexmojaki/stack_data	Extract data from python stack frames and tracebacks for informative displays
stackprinter	0.2.13	https://github.com/cknd/stackprinter	Debug-friendly stack traces, with variable values and semantic highlighting
tabcompleter	1.4.1	https://github.com/mdmintz/tabcompleter	tabcompleter --- Autocompletion in the Python console.
traitlets	5.15.1	None	Traitlets Python configuration system
types-pytz	2026.2.0.20260518	None	Typing stubs for pytz
typing-inspection	0.4.2	None	Runtime typing introspection tools
typing_extensions	4.16.0	None	Backported and Experimental Type Hints for Python 3.9+
urllib3	2.7.0	None	HTTP library with thread-safe connection pooling, file post, and more.
wcwidth	0.8.2	None	Measures the displayed width of unicode strings in a terminal
Werkzeug	3.1.8	None	The comprehensive WSGI web application library.
WTForms	3.2.2	None	Form validation and rendering for Python web development.
yarl	1.24.2	https://github.com/aio-libs/yarl	Yet another URL library

Resource	Value
User CPU time	107.780 msec
System CPU time	0.000 msec
Total CPU time	107.780 msec
Elapsed time	131.750 msec
Context switches	217 voluntary, 3 involuntary

Key	Value
HTTP_ACCEPT	/
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_HOST	dashboard.uat.tigr.uk
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
QUERY_STRING	end=2026-06-26&start=2026-05-25
REMOTE_ADDR	10.42.140.143
REQUEST_METHOD	GET
SCRIPT_NAME
SERVER_NAME	0.0.0.0
SERVER_PORT	8000
SERVER_PROTOCOL	HTTP/1.1
SERVER_SOFTWARE	gunicorn/26.0.0

Variable	Value
'end'	'2026-06-26'
'start'	'2026-05-25'

Variable	Value
g	<flask.g of 'app'>
meta	{'title': 'Client updates report (Incidents)', 'start': datetime.date(2026, 5, 25), 'end': datetime.date(2026, 6, 26)}
request	<Request 'http://dashboard.uat.tigr.uk/client_updates_report_drilldown/Incidents?end=2026-06-26&start=2026-05-25' [GET]>
tickets	[<Ticket(id=8784, rt_number=58370, queue=Incidents, subject=[FIRING: 1 for tcl/avon] NodeMemoryMajorPagesFaults in tcl-monitoring, ticket_status=closed, client=Internal, priority=41, created=2026-06-01 14:06:11, last_txn_id=0>, <Ticket(id=8762, rt_number=58348, queue=Incidents, subject=WARNING: NRPE Disk: /srv/ngs on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-05-29 12:49:04, last_txn_id=0>, <Ticket(id=8751, rt_number=58337, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-28 00:00:03, last_txn_id=0>, <Ticket(id=8766, rt_number=58352, queue=Incidents, subject=Multiple client systems down, ticket_status=closed, client=Internal, priority=81, created=2026-05-30 13:20:29, last_txn_id=0>, <Ticket(id=8749, rt_number=58335, queue=Incidents, subject=rodney.internal.ogtip.com volume usage /srv/department, ticket_status=closed, client=OGT, priority=51, created=2026-05-27 14:16:43, last_txn_id=0>, <Ticket(id=8752, rt_number=58338, queue=Incidents, subject=nene1/2.ipa.tigr.uk unmerged config, ticket_status=closed, client=Internal, priority=41, created=2026-05-28 08:23:16, last_txn_id=0>, <Ticket(id=8996, rt_number=58549, queue=Incidents, subject=web4.tcv.org.uk volume usage /home, ticket_status=resolved, client=TCV, priority=51, created=2026-06-22 08:56:19, last_txn_id=0>, <Ticket(id=8947, rt_number=58501, queue=Incidents, subject=Urgent LUKS Code Required, ticket_status=closed, client=Sucden, priority=61, created=2026-06-13 17:15:03, last_txn_id=0>, <Ticket(id=8731, rt_number=58317, queue=Incidents, subject=manuel.internal.ogtip.com restic issues, ticket_status=closed, client=OGT, priority=51, created=2026-05-22 08:15:11, last_txn_id=0>, <Ticket(id=8992, rt_number=58545, queue=Incidents, subject=interstar05/09.sucden.co.uk ntp timeout, ticket_status=resolved, client=Sucden, priority=61, created=2026-06-21 15:55:49, last_txn_id=0>, <Ticket(id=8949, rt_number=58503, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-15 00:00:05, last_txn_id=0>, <Ticket(id=8744, rt_number=58330, queue=Incidents, subject=manuel.internal.ogtip.com backup repo check failed (/srv/projects), ticket_status=closed, client=OGT, priority=51, created=2026-05-26 08:25:34, last_txn_id=0>, <Ticket(id=9020, rt_number=58573, queue=Incidents, subject=Sucden outage, ticket_status=resolved, client=Sucden, priority=91, created=2026-06-23 20:39:15, last_txn_id=0>, <Ticket(id=8757, rt_number=58343, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-29 00:00:03, last_txn_id=0>, <Ticket(id=8853, rt_number=58439, queue=Incidents, subject=Server Connection, ticket_status=resolved, client=Rotastat, priority=44, created=2026-06-04 14:36:09, last_txn_id=0>, <Ticket(id=8758, rt_number=58344, queue=Incidents, subject=edb-coll.askbio.com backup failure, ticket_status=closed, client=AskBio, priority=71, created=2026-05-29 08:43:17, last_txn_id=0>, <Ticket(id=8763, rt_number=58349, queue=Incidents, subject=CRITICAL: Networking: SSH on arpinodeb.clients.advensys.internal, ticket_status=closed, client=Advensys, priority=51, created=2026-05-29 14:20:16, last_txn_id=0>, <Ticket(id=8788, rt_number=58374, queue=Incidents, subject=CRITICAL: System Health: Systemd State on edb-mull.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-01 18:15:29, last_txn_id=0>, <Ticket(id=8836, rt_number=58422, queue=Incidents, subject=WARNING: NRPE Disk: All Disks on arcturus.novadata.internal, ticket_status=closed, client=Novadata, priority=41, created=2026-06-03 08:54:56, last_txn_id=0>, <Ticket(id=8822, rt_number=58408, queue=Incidents, subject=CRITICAL: System Health: Systemd State on ccwebdb01.cirencester.ac.uk, ticket_status=closed, client=Cirencester College, priority=41, created=2026-06-02 10:59:49, last_txn_id=0>, <Ticket(id=9009, rt_number=58562, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=resolved, client=Internal, priority=41, created=2026-06-23 00:00:04, last_txn_id=0>, <Ticket(id=8768, rt_number=58354, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-01 00:00:04, last_txn_id=0>, <Ticket(id=8791, rt_number=58377, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-02 00:00:05, last_txn_id=0>, <Ticket(id=8994, rt_number=58547, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=resolved, client=Internal, priority=41, created=2026-06-22 00:00:04, last_txn_id=0>, <Ticket(id=8845, rt_number=58431, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-04 00:00:05, last_txn_id=0>, <Ticket(id=8954, rt_number=58508, queue=Incidents, subject=FluxResourceNotReady multiple if not all clusters for HelmRepository/sealed-secrets, ticket_status=closed, client=Internal, priority=41, created=2026-06-15 11:08:35, last_txn_id=0>, <Ticket(id=8773, rt_number=58359, queue=Incidents, subject=WARNING: System Health: Reboot Alert on koinexserver.home, ticket_status=closed, client=Koinex, priority=41, created=2026-06-01 08:05:35, last_txn_id=0>, <Ticket(id=9042, rt_number=58594, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=resolved, client=Internal, priority=41, created=2026-06-26 00:00:03, last_txn_id=0>, <Ticket(id=8991, rt_number=58544, queue=Incidents, subject=crylonlis001/002 ntp timeout, ticket_status=resolved, client=Crystal Units, priority=61, created=2026-06-21 02:14:18, last_txn_id=0>, <Ticket(id=8969, rt_number=58523, queue=Incidents, subject=WARNING: NRPE Disk: /boot on web4.tcv.org.uk, ticket_status=closed, client=TCV, priority=41, created=2026-06-16 12:21:37, last_txn_id=0>, <Ticket(id=8976, rt_number=58530, queue=Incidents, subject=CRITICAL: Disk: fstab mounts on ccolive.cirencester.local, ticket_status=closed, client=Cirencester College, priority=41, created=2026-06-17 13:16:26, last_txn_id=0>, <Ticket(id=8747, rt_number=58333, queue=Incidents, subject=[FIRING: 1 for tcl/avon] KubePodCrashLooping in rt, ticket_status=closed, client=Internal, priority=51, created=2026-05-26 16:21:07, last_txn_id=0>, <Ticket(id=8760, rt_number=58346, queue=Incidents, subject=equistar03/04 megastar03/04 NTP offset, ticket_status=closed, client=Sucden, priority=71, created=2026-05-29 10:49:47, last_txn_id=0>, <Ticket(id=8739, rt_number=58325, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-25 00:00:06, last_txn_id=0>, <Ticket(id=8774, rt_number=58360, queue=Incidents, subject=WARNING: System Health: Kitchen Sink on arcturus.novadata.internal, ticket_status=closed, client=Novadata, priority=41, created=2026-06-01 08:11:00, last_txn_id=0>, <Ticket(id=8748, rt_number=58334, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-27 00:00:03, last_txn_id=0>, <Ticket(id=8957, rt_number=58511, queue=Incidents, subject=gcuksched.globecastne.com proxy not working, ticket_status=closed, client=Globecast, priority=31, created=2026-06-15 15:54:50, last_txn_id=0>, <Ticket(id=8668, rt_number=58286, queue=Incidents, subject=Storage utilisation warning: / on ipa-m3.private.ipa.ie, ticket_status=closed, client=Lantech, priority=22, created=2026-05-19 11:04:21, last_txn_id=2507477>, <Ticket(id=9041, rt_number=58593, queue=Incidents, subject=Storage critical: /var on rtp-promptdv-01.askbio.com, ticket_status=resolved, client=AskBio, priority=81, created=2026-06-25 18:07:40, last_txn_id=0>, <Ticket(id=8775, rt_number=58361, queue=Incidents, subject=WARNING: System Health: Kitchen Sink on tcv-crm.tcv.org.uk, ticket_status=closed, client=TCV, priority=41, created=2026-06-01 08:17:40, last_txn_id=0>, <Ticket(id=8914, rt_number=58468, queue=Incidents, subject=/ade mount unavailable, ticket_status=closed, client=AskBio, priority=71, created=2026-06-10 05:04:01, last_txn_id=0>, <Ticket(id=8834, rt_number=58420, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-03 00:00:03, last_txn_id=0>, <Ticket(id=8970, rt_number=58524, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-17 00:00:03, last_txn_id=0>, <Ticket(id=8848, rt_number=58434, queue=Incidents, subject=Icinga timeouts, ticket_status=closed, client=Internal, priority=71, created=2026-06-04 13:16:40, last_txn_id=0>, <Ticket(id=8844, rt_number=58430, queue=Incidents, subject=rc-mss.reigate.ac.uk root volume expansion, ticket_status=closed, client=Reigate College, priority=1, created=2026-06-03 21:02:56, last_txn_id=0>, <Ticket(id=9044, rt_number=58596, queue=Incidents, subject=SAP Services Dropped, ticket_status=open, client=ATA Group, priority=61, created=2026-06-26 11:27:44, last_txn_id=0>, <Ticket(id=8856, rt_number=58442, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-05 00:00:02, last_txn_id=0>, <Ticket(id=8846, rt_number=58432, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on manuel.internal.ogtip.com, ticket_status=closed, client=OGT, priority=51, created=2026-06-04 08:58:00, last_txn_id=0>, <Ticket(id=8743, rt_number=58329, queue=Incidents, subject=backups issue, ticket_status=closed, client=AskBio, priority=51, created=2026-05-26 08:16:14, last_txn_id=0>, <Ticket(id=8941, rt_number=58495, queue=Incidents, subject=CRITICAL: Backups: Restic s3.askbio.backup on edb-jura.askbio.com, ticket_status=closed, client=AskBio, priority=1, created=2026-06-12 08:47:50, last_txn_id=0>, <Ticket(id=9000, rt_number=58553, queue=Incidents, subject=exim4 failed on edb-mull.askbio.com, ticket_status=resolved, client=AskBio, priority=81, created=2026-06-22 11:19:07, last_txn_id=0>, <Ticket(id=8855, rt_number=58441, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on basil.internal.ogtip.com, ticket_status=closed, client=OGT, priority=22, created=2026-06-04 15:15:13, last_txn_id=0>, <Ticket(id=8995, rt_number=58548, queue=Incidents, subject=tricky/tron.troika.lan down, ticket_status=resolved, client=Troika, priority=41, created=2026-06-22 08:03:46, last_txn_id=0>, <Ticket(id=8874, rt_number=58460, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-09 00:00:03, last_txn_id=0>, <Ticket(id=8847, rt_number=58433, queue=Incidents, subject=CRITICAL: HTTP: my.eacbs.com HTTP on ef-v5-nodes.c.ef-platform.internal, ticket_status=closed, client=BD Group, priority=52, created=2026-06-04 09:51:31, last_txn_id=0>, <Ticket(id=8998, rt_number=58551, queue=Incidents, subject=WARNING: Storage: RAID on talisker.synpromics.com, ticket_status=open, client=AskBio, priority=72, created=2026-06-22 09:09:07, last_txn_id=2521298>, <Ticket(id=8997, rt_number=58550, queue=Incidents, subject=Storage warning: /srv/ngs on rodney.internal.ogtip.com, ticket_status=resolved, client=OGT, priority=41, created=2026-06-22 09:03:01, last_txn_id=0>, <Ticket(id=9015, rt_number=58568, queue=Incidents, subject=Peterborough site outage, ticket_status=resolved, client=DLS Plastics, priority=61, created=2026-06-23 14:19:34, last_txn_id=0>, <Ticket(id=8912, rt_number=58466, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-10 00:00:04, last_txn_id=0>, <Ticket(id=8960, rt_number=58514, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on edb-lab-skye.askbio.com, ticket_status=closed, client=AskBio, priority=71, created=2026-06-15 18:11:24, last_txn_id=0>, <Ticket(id=9022, rt_number=58575, queue=Incidents, subject=WARNING: Cluster: Csync2 on ouse1/2.tiger-computing.co.uk, ticket_status=resolved, client=Internal, priority=41, created=2026-06-24 09:01:15, last_txn_id=0>, <Ticket(id=8990, rt_number=58543, queue=Incidents, subject=CRITICAL: Networking: .sucden.co.uk, ticket_status=resolved, client=Sucden, priority=81, created=2026-06-20 12:15:26, last_txn_id=0>, <Ticket(id=8971, rt_number=58525, queue=Incidents, subject=basil.internal.ogtip.com volume usage /data, ticket_status=closed, client=OGT, priority=31, created=2026-06-17 08:00:07, last_txn_id=0>, <Ticket(id=8858, rt_number=58444, queue=Incidents, subject=rc-mss.reigate.ac.uk volume expansion, ticket_status=closed, client=Reigate College, priority=41, created=2026-06-05 09:09:41, last_txn_id=0>, <Ticket(id=8987, rt_number=58540, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-19 00:00:03, last_txn_id=0>, <Ticket(id=9010, rt_number=58563, queue=Incidents, subject=api.bdgroup.co.uk HTTP/HTTPS status code, ticket_status=resolved, client=BD Group, priority=81, created=2026-06-23 08:18:59, last_txn_id=0>, <Ticket(id=9046, rt_number=58598, queue=Incidents, subject=[FIRING: 1 for tcl/calder] KubePersistentVolumeFillingUp in puppet, ticket_status=resolved, client=Internal, priority=51, created=2026-06-26 13:25:36, last_txn_id=0>, <Ticket(id=8860, rt_number=58446, queue=Incidents, subject=CRITICAL: System Health: Systemd State on tricky.troika.lan, ticket_status=closed, client=Troika, priority=41, created=2026-06-05 14:45:02, last_txn_id=0>, <Ticket(id=9016, rt_number=58569, queue=Incidents, subject=ogt/askbio sssd.conf mod issue - puppet changeloop, ticket_status=open, client=Internal, priority=52, created=2026-06-23 14:41:53, last_txn_id=0>, <Ticket(id=9023, rt_number=58576, queue=Incidents, subject=mickey.internal.ogtip.com volume usage /var, ticket_status=resolved, client=OGT, priority=31, created=2026-06-24 09:04:00, last_txn_id=0>, <Ticket(id=8915, rt_number=58469, queue=Incidents, subject=TCV-CRM PHP Version, ticket_status=closed, client=TCV, priority=41, created=2026-06-10 08:57:00, last_txn_id=0>, <Ticket(id=9025, rt_number=58578, queue=Incidents, subject=Storage alert: /var on mickey.internal.ogtip.com, ticket_status=resolved, client=OGT, priority=41, created=2026-06-24 12:57:47, last_txn_id=0>, <Ticket(id=8927, rt_number=58481, queue=Incidents, subject=Fw: Invoice email copy - not sending email, ticket_status=closed, client=Crystal Units, priority=71, created=2026-06-10 14:03:35, last_txn_id=2513288>, <Ticket(id=8981, rt_number=58535, queue=Incidents, subject=All hosts down.synpromics.com, ticket_status=closed, client=AskBio, priority=91, created=2026-06-18 07:09:35, last_txn_id=0>, <Ticket(id=8979, rt_number=58533, queue=Incidents, subject=aql-svr-sf-radius01.quickline.co.uk systemd unit failure, ticket_status=closed, client=Quickline, priority=61, created=2026-06-18 01:09:41, last_txn_id=0>, <Ticket(id=8978, rt_number=58532, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-18 00:00:03, last_txn_id=0>, <Ticket(id=8826, rt_number=58412, queue=Incidents, subject=rodney: /srv/department and /srv/projects filling up, ticket_status=closed, client=OGT, priority=42, created=2026-06-02 13:08:28, last_txn_id=0>, <Ticket(id=8862, rt_number=58448, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-08 00:00:04, last_txn_id=0>, <Ticket(id=8864, rt_number=58450, queue=Incidents, subject=Server with excess backups and no quota, ticket_status=resolved, client=Internal, priority=53, created=2026-06-08 09:35:05, last_txn_id=0>, <Ticket(id=8988, rt_number=58541, queue=Incidents, subject=pre/backups conf issue?, ticket_status=closed, client=Internal, priority=51, created=2026-06-19 08:18:42, last_txn_id=0>, <Ticket(id=9001, rt_number=58554, queue=Incidents, subject=exim4 failure on darkmatter.synpromics.com, ticket_status=resolved, client=AskBio, priority=71, created=2026-06-22 14:10:52, last_txn_id=0>, <Ticket(id=8879, rt_number=58465, queue=Incidents, subject=WARNING: NRPE Disk: /srv on blaney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=42, created=2026-06-09 14:37:23, last_txn_id=2514233>, <Ticket(id=9017, rt_number=58570, queue=Incidents, subject=mis.tcv.org.uk config loop, ticket_status=resolved, client=TCV, priority=51, created=2026-06-23 15:04:59, last_txn_id=0>, <Ticket(id=8918, rt_number=58472, queue=Incidents, subject=Service failed on Thames: restic-forget, ticket_status=closed, client=Internal, priority=41, created=2026-06-10 09:11:54, last_txn_id=0>, <Ticket(id=8963, rt_number=58517, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-16 00:00:04, last_txn_id=0>, <Ticket(id=8958, rt_number=58512, queue=Incidents, subject=“relay not permitted”, ticket_status=closed, client=AskBio, priority=51, created=2026-06-15 16:09:36, last_txn_id=0>, <Ticket(id=8980, rt_number=58534, queue=Incidents, subject=CRITICAL: Networking: *.sucden.co.uk, ticket_status=resolved, client=Sucden, priority=91, created=2026-06-18 01:15:17, last_txn_id=0>, <Ticket(id=9021, rt_number=58574, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=resolved, client=Internal, priority=41, created=2026-06-24 00:00:03, last_txn_id=0>, <Ticket(id=8972, rt_number=58526, queue=Incidents, subject=tcl systems unmerged bird config, ticket_status=closed, client=Internal, priority=41, created=2026-06-17 08:23:01, last_txn_id=0>, <Ticket(id=8465, rt_number=58115, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=resolved, client=OGT, priority=76, created=2026-04-30 10:02:21, last_txn_id=2514298>, <Ticket(id=9036, rt_number=58589, queue=Incidents, subject=WARNING: NRPE Disk: All Disks on avon2.tcl.internal, ticket_status=resolved, client=Internal, priority=41, created=2026-06-25 10:18:46, last_txn_id=0>, <Ticket(id=8933, rt_number=58487, queue=Incidents, subject=WARNING: Puppet: Checking-in on it.tcv.org.uk, ticket_status=closed, client=TCV, priority=51, created=2026-06-11 10:37:24, last_txn_id=0>, <Ticket(id=8936, rt_number=58490, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-12 00:00:03, last_txn_id=0>, <Ticket(id=8940, rt_number=58494, queue=Incidents, subject=CRITICAL: Backups: Restic tcl-thames on avon1.tcl.internal, ticket_status=closed, client=Internal, priority=41, created=2026-06-12 08:44:29, last_txn_id=0>, <Ticket(id=8866, rt_number=58452, queue=Incidents, subject=Storage in /usr/local on rtp-promptdv-01, ticket_status=closed, client=AskBio, priority=71, created=2026-06-08 10:14:06, last_txn_id=0>, <Ticket(id=8982, rt_number=58536, queue=Incidents, subject=basil.internal.ogtip.com down, ticket_status=resolved, client=OGT, priority=41, created=2026-06-18 08:06:41, last_txn_id=0>, <Ticket(id=8868, rt_number=58454, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on mickey.internal.ogtip.com, ticket_status=closed, client=OGT, priority=1, created=2026-06-08 14:01:06, last_txn_id=0>, <Ticket(id=8964, rt_number=58518, queue=Incidents, subject=DOWN: arpinodeb.clients.advensys.internal, ticket_status=closed, client=Advensys, priority=31, created=2026-06-16 08:02:05, last_txn_id=0>, <Ticket(id=8764, rt_number=58350, queue=Incidents, subject=ipa-m3.private.ipa.ie moodle.ipa.ie HTTP/S timeouts, ticket_status=closed, client=Lantech, priority=21, created=2026-05-29 15:28:06, last_txn_id=0>, <Ticket(id=8843, rt_number=58429, queue=Incidents, subject=Fw: FAO All Tenants: Easter Bush Buildings Network Outage 18th June 2026 07:00-08:30 AM, ticket_status=closed, client=AskBio, priority=71, created=2026-06-03 15:30:03, last_txn_id=0>, <Ticket(id=8973, rt_number=58527, queue=Incidents, subject=cassandra.internal.ogtip.com raid/jbod controller battery, ticket_status=closed, client=OGT, priority=31, created=2026-06-17 08:38:04, last_txn_id=0>, <Ticket(id=8851, rt_number=58437, queue=Incidents, subject=Pyenv issue, ticket_status=closed, client=AskBio, priority=62, created=2026-06-04 13:31:53, last_txn_id=0>, <Ticket(id=8944, rt_number=58498, queue=Incidents, subject=Storage alert: /srv/projects on rodney.internal.ogtip.com @ 95%, ticket_status=closed, client=OGT, priority=41, created=2026-06-12 14:38:40, last_txn_id=0>, <Ticket(id=8983, rt_number=58537, queue=Incidents, subject=Failed sending HTTP2 data on sybil when using git clone on github repo, ticket_status=closed, client=OGT, priority=41, created=2026-06-18 10:40:25, last_txn_id=0>, <Ticket(id=9026, rt_number=58579, queue=Incidents, subject=Storage alert: /srv on blaney.internal.ogtip.com, ticket_status=resolved, client=OGT, priority=41, created=2026-06-24 12:57:56, last_txn_id=0>, <Ticket(id=8938, rt_number=58492, queue=Incidents, subject=WARNING: NRPE Disk: All Disks on ubjen-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=1, created=2026-06-12 08:20:59, last_txn_id=0>, <Ticket(id=8835, rt_number=58421, queue=Incidents, subject=CRITICAL: Backups: Restic s3.weka.backup on edb-coll.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-03 08:42:35, last_txn_id=0>, <Ticket(id=9014, rt_number=58567, queue=Incidents, subject=Temperature, ticket_status=resolved, client=OGT, priority=61, created=2026-06-23 12:46:33, last_txn_id=0>, <Ticket(id=9003, rt_number=58556, queue=Incidents, subject=WARNING: Mail: Queue Length on woodlands.midnighthax.com, ticket_status=resolved, client=Midnight Hax, priority=51, created=2026-06-22 14:27:00, last_txn_id=0>, <Ticket(id=8931, rt_number=58485, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-06-11 00:00:03, last_txn_id=0>, <Ticket(id=9029, rt_number=58582, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=resolved, client=Internal, priority=41, created=2026-06-25 00:00:04, last_txn_id=0>, <Ticket(id=9019, rt_number=58572, queue=Incidents, subject=Basil access issues?, ticket_status=resolved, client=OGT, priority=61, created=2026-06-23 16:05:59, last_txn_id=0>, <Ticket(id=8984, rt_number=58538, queue=Incidents, subject=strlb-gs2-p1l01/2.sucden.co.uk root volume usage , ticket_status=closed, client=Sucden, priority=61, created=2026-06-18 11:30:14, last_txn_id=0>, <Ticket(id=9004, rt_number=58557, queue=Incidents, subject=Automatic patching services not running, ticket_status=resolved, client=Crystal Units, priority=81, created=2026-06-22 15:06:32, last_txn_id=0>, <Ticket(id=8946, rt_number=58500, queue=Incidents, subject=CRITICAL: Backups: Backup to thames.tiger-computing.co.uk on rtp-promptdv-01.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-06-12 17:06:43, last_txn_id=0>, <Ticket(id=8932, rt_number=58486, queue=Incidents, subject=CRITICAL: System Health: Systemd State on strlb-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=50, created=2026-06-11 08:45:16, last_txn_id=0>, <Ticket(id=9024, rt_number=58577, queue=Incidents, subject=Sytems outage, ticket_status=resolved, client=Crystal Units, priority=81, created=2026-06-24 12:33:24, last_txn_id=0>, <Ticket(id=8974, rt_number=58528, queue=Incidents, subject=ipa-m3.private.ipa.ie unmerged config, ticket_status=closed, client=Lantech, priority=21, created=2026-06-17 10:24:31, last_txn_id=0>, <Ticket(id=8966, rt_number=58520, queue=Incidents, subject=gcukscheddbdev.globecastne.com license check, ticket_status=resolved, client=Globecast, priority=52, created=2026-06-16 09:43:45, last_txn_id=0>, <Ticket(id=9031, rt_number=58584, queue=Incidents, subject=gallus.rotastat.com unmerged configuration, ticket_status=resolved, client=Rotastat, priority=41, created=2026-06-25 08:16:42, last_txn_id=0>]

Client updates report (Incidents)

25 May - 26 Jun

Versions

Installed Packages

Resource Usage

HTTP Headers

Request Vars

View information

COOKIES Variables

SESSION Variables

GET Variables

POST Variables

Templates

client_updates_report_drilldown.html

SQLAlchemy queries

Queries Unavailable

Configure Flask-SQLAlchemy:

Log Messages

Line Profiler Usage Docs

Usage Instructions

Level	Time	Message	Location
DEBUG	2026-07-09 07:55:57.052516	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052580	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052591	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052598	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052604	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052610	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052616	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052621	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052626	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052632	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052639	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052645	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052650	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052657	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052662	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052668	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052673	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052678	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052683	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052689	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052695	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052701	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052707	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052712	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052718	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052724	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052730	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052736	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052741	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052747	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052753	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052759	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052764	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052771	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052776	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052782	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052788	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052793	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052798	xxx	./services/model.py:838
DEBUG	2026-07-09 07:55:57.052804	xxx	./services/model.py:838