Client updates report (Incidents)

23 Mar - 24 Apr

RT	Client	Replies missed	Subject
57976	NFW		WARNING: Mail: Exim Panic Log on nfwgs2.nfw.internal
57768	Internal		Check for Security Notices and System Updates
57769	NFW		nfwgs2.nfw.internal samba cleanup script error
57954	BD Group		EFSRV-21761 eFiling high load
57780	Internal		Check for Security Notices and System Updates
57942	Internal		Check for Security Notices and System Updates
57737	Internal		Check for Security Notices and System Updates
57641	BD Group		Storage alert: / on ef-v5-*
57851	NFW		nfwgs2.nfw.internal unmerged configuration
57712	Internal		Check for Security Notices and System Updates
57710	AskBio		CRITICAL: Networking: ping4 on macleod.synpromics.com
57857	Internal		Check for Security Notices and System Updates
57997	OGT		rodney1 reboot/stonith problem
57725	Internal		Check for Security Notices and System Updates
57982	Sucden		globalstar01/02.sucden.co.uk failed services
57938	Sucden		CRITICAL: HTTP: Uyuni HTTPS on patrs-gs2-p1l01.sucden.co.uk
57849	Internal		Check for Security Notices and System Updates
57783	Reigate College		CRITICAL: Networking: SSH on rc-mss.reigate.ac.uk
57782	Gravytrain		CRITICAL: HTTP: www.bedfordinsuranceforbusiness.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk
57723	OGT		OOM - blaney.internal.ogtip.com
57735	Tangram		CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk
57694	Tangram		GItLab error "The source branch X does not exist."
57733	Tangram	25 Mar	tangram/prod/gitlab eviction/saml errors
57729	Geograph		geograph/prod haproxy deployments failing
57718	Trident Honda		smbfs1.trident.lan volume usage /srv
57740	Geograph		geograph/prod/gitlab pod status
57754	Tangram		tangram/prod ThanosCompactIsDown
57759	AskBio		AskBio hosts down
57941	AskBio		/var on Talisker at 90%
57715	Tangram		tangram/prod issues
57721	Quickline		CRITICAL: System Health: Systemd State on aql-svr-zabbix-app.quickline.co.uk
57773	OpenCorporates		[FIRING:1] DatasourceError Tiger Computing (ElastiCache Connections (openc-frontend-003))
57728	Ingeus		CRITICAL: HTTP: iw-prd/uk-diagnostics-interface-web on k8s.iw-prd-aks.internal
57779	TCV		WARNING: NRPE Disk: /var on web4.tcv.org.uk
57923	Internal		Check for Security Notices and System Updates
57919	Imoves	15 Apr, 17 Apr	Investigate PHP-related issues with staging site
57776	Internal		Check for Security Notices and System Updates
57958	Internal		Check for Security Notices and System Updates
57929	Trident Honda		WARNING: Cluster: Pacemaker CRM on vmsvr1.trident.lan
57752	Geograph		Re: CRITICAL: HTTP: Geograph staging HTTPS on staging.geograph.org.uk
57951	Midnight Hax		Fix package double declaration on ws-trixie.midnighthax.com
57866	JISC		WARNING: Cluster: ClusterCheck on ath-lin-prx-l01.int.openathens.net
57811	Sucden		DOWN: globalstar{01,02}.sucden.co.uk
57870	Cirencester College		All systems down
57917	Internal		Error when reviewing draft schedules
57883	Koinex		WARNING: Mail: Queue Length on koinexserver.home
57924	Trident Honda		CRITICAL: Cluster: Pacemaker CRM on vmsvr2.trident.lan
57927	Trident Honda		smbfs1.trident.lan root storage volume usage
57934	Internal		Check for Security Notices and System Updates
57939	Lantech		CRITICAL: HTTP: moodle.ipa.ie HTTPS on moodle.ipa.ie
57867	ITC Compliance		Urgent - SSL Root Cert
57945	Internal		WARNING: Special: IcingaDB State on towy2.tiger-computing.co.uk
57753	Internal		Check for Security Notices and System Updates
57859	Internal	10 Apr, 15 Apr	tcl/avon prometheus job missing
57930	Sucden		Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk
57850	Sucden		apt-show-versions.service failed on interstar05,06
57918	Imoves		Investigate PHP-related issues with staging site
57884	Tangram		CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk
57876	OGT		Storage alert: /srv/department on rodney.internal.ogtip.com
57786	Trident Honda	03 Apr	VM hera - /etc/sudoers.d/azure-sudo
57781	OGT	04 Apr	basil.internal.ogtip.com volume usage /var
57770	TCV	03 Apr	tcv-crm.tcv.org.uk cron php script error
57877	AskBio		All systems down
57761	Internal		Check for Security Notices and System Updates
57855	Troika		Unable to login to tricky
57863	Tangram		[FIRING: 5 for tangram/prod] AWSBackupCopyJobFailedToComplete
57868	Internal		Check for Security Notices and System Updates
57944	AskBio	23 Apr	ZFS pool data fragmentation on talisker.synpromics.com
57881	Internal		Check for Security Notices and System Updates
57717	AskBio	24 Mar	edb-iona.askbio.com HTTP status for prompt-softdev.askbio.com
57748	Internal		Check for Security Notices and System Updates
57937	Quickline		Disk critically full on aql-svr-zabbix-db
57762	Reigate College	01 Apr	rc-mss.reigate.ac.uk disk volume usage
57787	Internal	06 Apr	Check for Security Notices and System Updates
57998	Quickline		aql-svr-zabbix-app.quickline.co.uk backups to mersey problem
58015	Tangram		[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring
57960	Troika		CRITICAL: System Health: Systemd State on tron.troika.lan
57996	Internal		Check for Security Notices and System Updates
57959	OGT		rodney1.internal.ogtip.com failed disk
58008	Tangram		CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk
57999	AskBio		AskBio outage
57961	Reigate College		rc-mss.reigate.ac.uk root volume usage
57981	Internal		Check for Security Notices and System Updates
58007	Internal		Check for Security Notices and System Updates
57963	AskBio		WARNING: Security: Let's Encrypt Certificates on darkmatter.synpromics.com
58009	AskBio		WARNING: NRPE Disk: / on edb-lab-skye.askbio.com
57947	Internal		Check for Security Notices and System Updates
57962	Cirencester College		ccolive.cirencester.local storage volume usage /var
57993	Tangram		[FIRING: 1 for tangram/prod] KubeJobFailed in gitlab
57964	Trident Honda		WARNING: Cluster: Csync2 on vmsvr2.trident.lan
57994	Tangram		[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring
58000	Tangram		[FIRING: 1 for tangram/prod] KubePersistentVolumeFillingUp in tcl-monitoring
57967	Tangram	21 Apr	tangram/prod pods in non ready state
58001	Troika		WARNING: Puppet: Checking-in on tron.troika.lan
57970	Internal		Check for Security Notices and System Updates
57974	Troika		UNKNOWN: Hardware: IPMI on tron.troika.lan
57972	Sucden		Connectivity Issue from IXN and PPS and GS2 to Azure.
57973	Internal		CRITICAL: Backups: Prebackup for mersey.tiger-computing.co.uk on aql-svr-zabbix-app.quickline.co.uk
58006	AskBio		Darkmatter ssh oddity
57975	OGT		Storage alert: /srv/illumina_data on rodney.internal.ogtip.com

git hash: master (6c029d07)

Package	Version	Homepage	Summary
alchemical	1.0.3	None	Modern SQLAlchemy simplified
alembic	1.18.5	None	A database migration tool for SQLAlchemy.
annotated-types	0.7.0	None	Reusable constraint types to use with typing.Annotated
anyio	4.14.1	None	High-level concurrency and networking framework on top of asyncio or Trio
ast_serialize	0.6.0	None	Python bindings for mypy AST serialization
asttokens	3.0.1	https://github.com/gristlabs/asttokens	Annotate AST trees with source code positions
backoff	2.2.1	https://github.com/litl/backoff	Function decoration for backoff and retry
blinker	1.9.0	None	Fast, simple object-to-object and broadcast signaling
Bootstrap-Flask	2.5.0	None	Bootstrap 4 & 5 helper for your Flask projects.
certifi	2026.6.17	https://github.com/certifi/python-certifi	Python package for providing Mozilla's CA Bundle.
charset-normalizer	3.4.7	None	The Real First Universal Charset Detector. Open, modern and actively maintained alternative to Chardet.
click	8.4.2	None	Composable command line interface toolkit
colorlog	6.10.1	https://github.com/borntyping/python-colorlog	Add colours to the output of Python's logging module.
decorator	5.3.1	None	Decorators for Humans
executing	2.2.1	https://github.com/alexmojaki/executing	Get the currently executing AST node of a frame, and other information
Flask	3.1.3	None	A simple framework for building complex web applications.
Flask-DebugToolbar	0.16.0	None	A toolbar overlay for debugging Flask applications.
Flask-DebugToolbar-LineProfilerPanel	1.0.2	https://github.com/phleet/flask_debugtoolbar_lineprofilerpanel	Panel for the Flask Debug toolbar to capture and view line-by-line profiling stats
Flask-Migrate	4.1.0	None	SQLAlchemy database migrations for Flask applications using Alembic.
Flask-SQLAlchemy	3.1.1	None	Add SQLAlchemy support to your Flask application.
Flask-WTF	1.3.0	None	Form rendering, validation, and CSRF protection for Flask with WTForms.
freezegun	1.5.5	https://github.com/spulec/freezegun	Let your Python tests travel through time
gql	4.0.0	https://github.com/graphql-python/gql	GraphQL client for Python
graphql-core	3.2.11	https://github.com/graphql-python/graphql-core	GraphQL implementation for Python, a port of GraphQL.js, the JavaScript reference implementation for GraphQL.
greenlet	3.5.3	None	Lightweight in-process concurrent programming
gunicorn	26.0.0	None	WSGI HTTP Server for UNIX
h11	0.16.0	https://github.com/python-hyper/h11	A pure-Python, bring-your-own-I/O implementation of HTTP/1.1
httpcore	1.0.9	None	A minimal low-level HTTP client.
httpx	0.28.1	None	The next generation HTTP client.
idna	3.18	None	Internationalized Domain Names in Applications (IDNA)
ilock	1.0.3	https://github.com/symonsoft/ilock	Inter-process named lock library
ipython	9.15.0	None	IPython: Productive Interactive Computing
ipython_pygments_lexers	1.1.1	None	Defines a variety of Pygments lexers for highlighting IPython code.
itsdangerous	2.2.0	None	Safely pass data to untrusted environments and back.
jedi	0.20.0	https://github.com/davidhalter/jedi	An autocompletion tool for Python that can be used for text editors.
Jinja2	3.1.6	None	A very fast and expressive template engine.
librt	0.12.0	None	Mypyc runtime library
line_profiler	5.0.2	https://github.com/pyutils/line_profiler	Line-by-line profiler
Mako	1.3.12	https://www.makotemplates.org/	A super-fast templating language that borrows the best ideas from the existing templating languages.
MarkupSafe	3.0.3	None	Safely add untrusted strings to HTML/XML markup.
matplotlib-inline	0.2.2	None	Inline Matplotlib backend for Jupyter
multidict	6.7.1	https://github.com/aio-libs/multidict	multidict implementation
mypy	2.2.0	None	Optional static typing for Python
mypy_extensions	1.1.0	None	Type system extensions for programs checked with the mypy type checker.
packaging	26.2	None	Core utilities for Python packages
parso	0.8.7	https://github.com/davidhalter/parso	A Python Parser
pathspec	1.1.1	None	Utility library for gitignore style pattern matching of file paths.
pdbp	1.8.2	https://github.com/mdmintz/pdbp	pdbp (Pdb+): A drop-in replacement for pdb and pdbpp.
pexpect	4.9.0	https://pexpect.readthedocs.io/	Pexpect allows easy control of interactive console applications.
portalocker	3.2.0	None	Wraps the portalocker recipe for easy usage
prompt_toolkit	3.0.52	None	Library for building powerful interactive command lines in Python
propcache	0.5.2	https://github.com/aio-libs/propcache	Accelerated property cache
psutil	7.2.2	https://github.com/giampaolo/psutil	Cross-platform lib for process and system monitoring.
psycopg	3.3.4	None	PostgreSQL database adapter for Python
psycopg-binary	3.3.4	None	PostgreSQL database adapter for Python -- C optimisation distribution
ptyprocess	0.7.0	https://github.com/pexpect/ptyprocess	Run a subprocess in a pseudo terminal
pure_eval	0.2.3	http://github.com/alexmojaki/pure_eval	Safely evaluate AST nodes without side effects
pydantic	2.13.4	None	Data validation using Python type hints
pydantic_core	2.46.4	https://github.com/pydantic/pydantic	Core functionality for Pydantic validation and serialization
Pygments	2.20.0	None	Pygments is a syntax highlighting package written in Python.
python-dateutil	2.9.0.post0	https://github.com/dateutil/dateutil	Extensions to the standard Python datetime module
python-dotenv	1.2.2	None	Read key-value pairs from a .env file and set them as environment variables
pytz	2026.2	http://pythonhosted.org/pytz	World timezone definitions, modern and historical
requests	2.34.2	None	Python HTTP for Humans.
requests-toolbelt	1.0.0	https://toolbelt.readthedocs.io/	A utility belt for advanced users of python-requests
rt	3.7.1	None	Python interface to Request Tracker API
six	1.17.0	https://github.com/benjaminp/six	Python 2 and 3 compatibility utilities
SQLAlchemy	2.0.51	https://www.sqlalchemy.org	Database Abstraction Library
stack-data	0.6.3	http://github.com/alexmojaki/stack_data	Extract data from python stack frames and tracebacks for informative displays
stackprinter	0.2.13	https://github.com/cknd/stackprinter	Debug-friendly stack traces, with variable values and semantic highlighting
tabcompleter	1.4.1	https://github.com/mdmintz/tabcompleter	tabcompleter --- Autocompletion in the Python console.
traitlets	5.15.1	None	Traitlets Python configuration system
types-pytz	2026.2.0.20260518	None	Typing stubs for pytz
typing-inspection	0.4.2	None	Runtime typing introspection tools
typing_extensions	4.16.0	None	Backported and Experimental Type Hints for Python 3.9+
urllib3	2.7.0	None	HTTP library with thread-safe connection pooling, file post, and more.
wcwidth	0.8.2	None	Measures the displayed width of unicode strings in a terminal
Werkzeug	3.1.8	None	The comprehensive WSGI web application library.
WTForms	3.2.2	None	Form validation and rendering for Python web development.
yarl	1.24.2	https://github.com/aio-libs/yarl	Yet another URL library

Resource	Value
User CPU time	72.748 msec
System CPU time	0.151 msec
Total CPU time	72.899 msec
Elapsed time	92.587 msec
Context switches	136 voluntary, 25 involuntary

Key	Value
HTTP_ACCEPT	/
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_HOST	dashboard.uat.tigr.uk
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
QUERY_STRING	end=2026-04-24&start=2026-03-23
REMOTE_ADDR	10.42.13.21
REQUEST_METHOD	GET
SCRIPT_NAME
SERVER_NAME	0.0.0.0
SERVER_PORT	8000
SERVER_PROTOCOL	HTTP/1.1
SERVER_SOFTWARE	gunicorn/26.0.0

Variable	Value
'end'	'2026-04-24'
'start'	'2026-03-23'

Variable	Value
g	<flask.g of 'app'>
meta	{'title': 'Client updates report (Incidents)', 'start': datetime.date(2026, 3, 23), 'end': datetime.date(2026, 4, 24)}
request	<Request 'http://dashboard.uat.tigr.uk/client_updates_report_drilldown/Incidents?end=2026-04-24&start=2026-03-23' [GET]>
tickets	[<Ticket(id=8358, rt_number=57976, queue=Incidents, subject=WARNING: Mail: Exim Panic Log on nfwgs2.nfw.internal, ticket_status=closed, client=NFW, priority=41, created=2026-04-21 15:43:05, last_txn_id=0>, <Ticket(id=8181, rt_number=57768, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-31 00:00:04, last_txn_id=0>, <Ticket(id=8182, rt_number=57769, queue=Incidents, subject=nfwgs2.nfw.internal samba cleanup script error, ticket_status=closed, client=NFW, priority=41, created=2026-03-31 09:14:34, last_txn_id=0>, <Ticket(id=8336, rt_number=57954, queue=Incidents, subject=EFSRV-21761 eFiling high load, ticket_status=closed, client=BD Group, priority=81, created=2026-04-17 21:37:17, last_txn_id=0>, <Ticket(id=8193, rt_number=57780, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-02 00:00:05, last_txn_id=0>, <Ticket(id=8323, rt_number=57942, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-16 00:00:03, last_txn_id=0>, <Ticket(id=8150, rt_number=57737, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-25 00:00:05, last_txn_id=0>, <Ticket(id=8054, rt_number=57641, queue=Incidents, subject=Storage alert: / on ef-v5-*, ticket_status=closed, client=BD Group, priority=72, created=2026-03-13 15:52:35, last_txn_id=0>, <Ticket(id=8232, rt_number=57851, queue=Incidents, subject=nfwgs2.nfw.internal unmerged configuration, ticket_status=closed, client=NFW, priority=41, created=2026-04-08 08:08:47, last_txn_id=0>, <Ticket(id=8125, rt_number=57712, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-23 00:00:06, last_txn_id=0>, <Ticket(id=8123, rt_number=57710, queue=Incidents, subject=CRITICAL: Networking: ping4 on macleod.synpromics.com, ticket_status=closed, client=AskBio, priority=61, created=2026-03-21 00:44:19, last_txn_id=0>, <Ticket(id=8238, rt_number=57857, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-09 00:00:04, last_txn_id=0>, <Ticket(id=8379, rt_number=57997, queue=Incidents, subject=rodney1 reboot/stonith problem, ticket_status=closed, client=OGT, priority=51, created=2026-04-23 07:58:43, last_txn_id=0>, <Ticket(id=8138, rt_number=57725, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-24 00:00:05, last_txn_id=0>, <Ticket(id=8364, rt_number=57982, queue=Incidents, subject=globalstar01/02.sucden.co.uk failed services, ticket_status=closed, client=Sucden, priority=41, created=2026-04-22 07:30:55, last_txn_id=0>, <Ticket(id=8319, rt_number=57938, queue=Incidents, subject=CRITICAL: HTTP: Uyuni HTTPS on patrs-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=1, created=2026-04-15 09:12:59, last_txn_id=0>, <Ticket(id=8230, rt_number=57849, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-08 00:00:05, last_txn_id=0>, <Ticket(id=8196, rt_number=57783, queue=Incidents, subject=CRITICAL: Networking: SSH on rc-mss.reigate.ac.uk, ticket_status=closed, client=Reigate College, priority=61, created=2026-04-02 10:10:11, last_txn_id=0>, <Ticket(id=8195, rt_number=57782, queue=Incidents, subject=CRITICAL: HTTP: www.bedfordinsuranceforbusiness.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk, ticket_status=closed, client=Gravytrain, priority=51, created=2026-04-02 09:54:36, last_txn_id=0>, <Ticket(id=8136, rt_number=57723, queue=Incidents, subject=OOM - blaney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=1, created=2026-03-23 17:02:50, last_txn_id=0>, <Ticket(id=8148, rt_number=57735, queue=Incidents, subject=CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk, ticket_status=closed, client=Tangram, priority=1, created=2026-03-24 17:23:27, last_txn_id=0>, <Ticket(id=8107, rt_number=57694, queue=Incidents, subject=GItLab error "The source branch X does not exist.", ticket_status=closed, client=Tangram, priority=42, created=2026-03-18 16:02:06, last_txn_id=0>, <Ticket(id=8146, rt_number=57733, queue=Incidents, subject=tangram/prod/gitlab eviction/saml errors, ticket_status=closed, client=Tangram, priority=51, created=2026-03-24 16:31:25, last_txn_id=0>, <Ticket(id=8142, rt_number=57729, queue=Incidents, subject=geograph/prod haproxy deployments failing, ticket_status=closed, client=Geograph, priority=51, created=2026-03-24 12:06:49, last_txn_id=0>, <Ticket(id=8131, rt_number=57718, queue=Incidents, subject=smbfs1.trident.lan volume usage /srv, ticket_status=closed, client=Trident Honda, priority=52, created=2026-03-23 11:42:53, last_txn_id=0>, <Ticket(id=8153, rt_number=57740, queue=Incidents, subject=geograph/prod/gitlab pod status, ticket_status=closed, client=Geograph, priority=51, created=2026-03-25 08:15:20, last_txn_id=0>, <Ticket(id=8167, rt_number=57754, queue=Incidents, subject=tangram/prod ThanosCompactIsDown, ticket_status=closed, client=Tangram, priority=51, created=2026-03-27 08:45:56, last_txn_id=0>, <Ticket(id=8172, rt_number=57759, queue=Incidents, subject=AskBio hosts down, ticket_status=closed, client=AskBio, priority=61, created=2026-03-28 08:54:02, last_txn_id=0>, <Ticket(id=8322, rt_number=57941, queue=Incidents, subject=/var on Talisker at 90%, ticket_status=closed, client=AskBio, priority=71, created=2026-04-15 18:35:20, last_txn_id=0>, <Ticket(id=8128, rt_number=57715, queue=Incidents, subject=tangram/prod issues, ticket_status=closed, client=Tangram, priority=51, created=2026-03-23 08:20:17, last_txn_id=0>, <Ticket(id=8134, rt_number=57721, queue=Incidents, subject=CRITICAL: System Health: Systemd State on aql-svr-zabbix-app.quickline.co.uk, ticket_status=closed, client=Quickline, priority=50, created=2026-03-23 16:09:50, last_txn_id=0>, <Ticket(id=8186, rt_number=57773, queue=Incidents, subject=[FIRING:1] DatasourceError Tiger Computing (ElastiCache Connections (openc-frontend-003)), ticket_status=closed, client=OpenCorporates, priority=71, created=2026-03-31 10:04:51, last_txn_id=0>, <Ticket(id=8141, rt_number=57728, queue=Incidents, subject=CRITICAL: HTTP: iw-prd/uk-diagnostics-interface-web on k8s.iw-prd-aks.internal, ticket_status=closed, client=Ingeus, priority=41, created=2026-03-24 09:33:53, last_txn_id=0>, <Ticket(id=8192, rt_number=57779, queue=Incidents, subject=WARNING: NRPE Disk: /var on web4.tcv.org.uk, ticket_status=closed, client=TCV, priority=51, created=2026-04-01 15:10:29, last_txn_id=0>, <Ticket(id=8304, rt_number=57923, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-14 00:00:05, last_txn_id=0>, <Ticket(id=8300, rt_number=57919, queue=Incidents, subject=Investigate PHP-related issues with staging site, ticket_status=closed, client=Imoves, priority=22, created=2026-04-13 12:16:55, last_txn_id=0>, <Ticket(id=8189, rt_number=57776, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-01 00:00:03, last_txn_id=0>, <Ticket(id=8340, rt_number=57958, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-20 00:00:04, last_txn_id=0>, <Ticket(id=8310, rt_number=57929, queue=Incidents, subject=WARNING: Cluster: Pacemaker CRM on vmsvr1.trident.lan, ticket_status=closed, client=Trident Honda, priority=41, created=2026-04-14 12:57:58, last_txn_id=0>, <Ticket(id=8165, rt_number=57752, queue=Incidents, subject=Re: CRITICAL: HTTP: Geograph staging HTTPS on staging.geograph.org.uk, ticket_status=closed, client=Geograph, priority=51, created=2026-03-26 18:45:42, last_txn_id=0>, <Ticket(id=8333, rt_number=57951, queue=Incidents, subject=Fix package double declaration on ws-trixie.midnighthax.com, ticket_status=closed, client=Midnight Hax, priority=41, created=2026-04-17 12:46:55, last_txn_id=0>, <Ticket(id=8247, rt_number=57866, queue=Incidents, subject=WARNING: Cluster: ClusterCheck on ath-lin-prx-l01.int.openathens.net, ticket_status=closed, client=JISC, priority=61, created=2026-04-09 10:51:55, last_txn_id=0>, <Ticket(id=8224, rt_number=57811, queue=Incidents, subject=DOWN: globalstar{01,02}.sucden.co.uk, ticket_status=closed, client=Sucden, priority=81, created=2026-04-07 12:48:42, last_txn_id=0>, <Ticket(id=8251, rt_number=57870, queue=Incidents, subject=All systems down, ticket_status=closed, client=Cirencester College, priority=71, created=2026-04-10 11:35:39, last_txn_id=0>, <Ticket(id=8298, rt_number=57917, queue=Incidents, subject=Error when reviewing draft schedules, ticket_status=closed, client=Internal, priority=51, created=2026-04-13 11:45:50, last_txn_id=0>, <Ticket(id=8264, rt_number=57883, queue=Incidents, subject=WARNING: Mail: Queue Length on koinexserver.home, ticket_status=closed, client=Koinex, priority=51, created=2026-04-13 08:21:58, last_txn_id=0>, <Ticket(id=8305, rt_number=57924, queue=Incidents, subject=CRITICAL: Cluster: Pacemaker CRM on vmsvr2.trident.lan, ticket_status=closed, client=Trident Honda, priority=61, created=2026-04-14 08:01:30, last_txn_id=0>, <Ticket(id=8308, rt_number=57927, queue=Incidents, subject=smbfs1.trident.lan root storage volume usage , ticket_status=closed, client=Trident Honda, priority=51, created=2026-04-14 11:25:47, last_txn_id=0>, <Ticket(id=8315, rt_number=57934, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-15 00:00:03, last_txn_id=0>, <Ticket(id=8320, rt_number=57939, queue=Incidents, subject=CRITICAL: HTTP: moodle.ipa.ie HTTPS on moodle.ipa.ie, ticket_status=closed, client=Lantech, priority=41, created=2026-04-15 10:10:33, last_txn_id=0>, <Ticket(id=8248, rt_number=57867, queue=Incidents, subject=Urgent - SSL Root Cert, ticket_status=closed, client=ITC Compliance, priority=81, created=2026-04-09 14:03:55, last_txn_id=0>, <Ticket(id=8327, rt_number=57945, queue=Incidents, subject=WARNING: Special: IcingaDB State on towy2.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=61, created=2026-04-16 10:23:17, last_txn_id=0>, <Ticket(id=8166, rt_number=57753, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-27 00:00:04, last_txn_id=0>, <Ticket(id=8240, rt_number=57859, queue=Incidents, subject=tcl/avon prometheus job missing, ticket_status=closed, client=Internal, priority=52, created=2026-04-09 08:23:52, last_txn_id=0>, <Ticket(id=8311, rt_number=57930, queue=Incidents, subject=Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=42, created=2026-04-14 13:01:03, last_txn_id=0>, <Ticket(id=8231, rt_number=57850, queue=Incidents, subject=apt-show-versions.service failed on interstar05,06, ticket_status=closed, client=Sucden, priority=61, created=2026-04-08 01:05:35, last_txn_id=0>, <Ticket(id=8299, rt_number=57918, queue=Incidents, subject=Investigate PHP-related issues with staging site, ticket_status=rejected, client=Imoves, priority=1, created=2026-04-13 12:14:33, last_txn_id=0>, <Ticket(id=8265, rt_number=57884, queue=Incidents, subject=CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk, ticket_status=closed, client=Tangram, priority=41, created=2026-04-13 08:30:00, last_txn_id=0>, <Ticket(id=8257, rt_number=57876, queue=Incidents, subject=Storage alert: /srv/department on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-04-10 15:39:04, last_txn_id=0>, <Ticket(id=8199, rt_number=57786, queue=Incidents, subject=VM hera - /etc/sudoers.d/azure-sudo, ticket_status=closed, client=Trident Honda, priority=52, created=2026-04-02 17:52:14, last_txn_id=0>, <Ticket(id=8194, rt_number=57781, queue=Incidents, subject=basil.internal.ogtip.com volume usage /var, ticket_status=closed, client=OGT, priority=52, created=2026-04-02 08:20:52, last_txn_id=0>, <Ticket(id=8183, rt_number=57770, queue=Incidents, subject=tcv-crm.tcv.org.uk cron php script error, ticket_status=closed, client=TCV, priority=42, created=2026-03-31 09:19:43, last_txn_id=0>, <Ticket(id=8258, rt_number=57877, queue=Incidents, subject=All systems down, ticket_status=closed, client=AskBio, priority=91, created=2026-04-11 08:03:30, last_txn_id=0>, <Ticket(id=8174, rt_number=57761, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-30 00:00:04, last_txn_id=0>, <Ticket(id=8236, rt_number=57855, queue=Incidents, subject=Unable to login to tricky, ticket_status=closed, client=Troika, priority=21, created=2026-04-08 13:53:49, last_txn_id=0>, <Ticket(id=8244, rt_number=57863, queue=Incidents, subject=[FIRING: 5 for tangram/prod] AWSBackupCopyJobFailedToComplete, ticket_status=closed, client=Tangram, priority=41, created=2026-04-09 09:22:11, last_txn_id=0>, <Ticket(id=8249, rt_number=57868, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-10 00:00:05, last_txn_id=0>, <Ticket(id=8326, rt_number=57944, queue=Incidents, subject=ZFS pool data fragmentation on talisker.synpromics.com, ticket_status=closed, client=AskBio, priority=73, created=2026-04-16 10:20:00, last_txn_id=2484184>, <Ticket(id=8262, rt_number=57881, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-13 00:00:04, last_txn_id=0>, <Ticket(id=8130, rt_number=57717, queue=Incidents, subject= edb-iona.askbio.com HTTP status for prompt-softdev.askbio.com, ticket_status=closed, client=AskBio, priority=72, created=2026-03-23 11:39:03, last_txn_id=0>, <Ticket(id=8161, rt_number=57748, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-26 00:00:03, last_txn_id=0>, <Ticket(id=8318, rt_number=57937, queue=Incidents, subject=Disk critically full on aql-svr-zabbix-db, ticket_status=closed, client=Quickline, priority=81, created=2026-04-15 07:34:19, last_txn_id=2482732>, <Ticket(id=8175, rt_number=57762, queue=Incidents, subject=rc-mss.reigate.ac.uk disk volume usage, ticket_status=closed, client=Reigate College, priority=52, created=2026-03-30 08:19:36, last_txn_id=0>, <Ticket(id=8200, rt_number=57787, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=42, created=2026-04-03 00:00:03, last_txn_id=0>, <Ticket(id=8380, rt_number=57998, queue=Incidents, subject=aql-svr-zabbix-app.quickline.co.uk backups to mersey problem, ticket_status=closed, client=Quickline, priority=51, created=2026-04-23 08:04:30, last_txn_id=0>, <Ticket(id=8397, rt_number=58015, queue=Incidents, subject=[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring, ticket_status=closed, client=Tangram, priority=41, created=2026-04-24 15:42:36, last_txn_id=0>, <Ticket(id=8342, rt_number=57960, queue=Incidents, subject=CRITICAL: System Health: Systemd State on tron.troika.lan, ticket_status=closed, client=Troika, priority=21, created=2026-04-20 08:15:45, last_txn_id=0>, <Ticket(id=8378, rt_number=57996, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-23 00:00:03, last_txn_id=0>, <Ticket(id=8341, rt_number=57959, queue=Incidents, subject=rodney1.internal.ogtip.com failed disk, ticket_status=closed, client=OGT, priority=51, created=2026-04-20 08:12:01, last_txn_id=0>, <Ticket(id=8390, rt_number=58008, queue=Incidents, subject=CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk, ticket_status=closed, client=Tangram, priority=51, created=2026-04-24 08:25:20, last_txn_id=0>, <Ticket(id=8381, rt_number=57999, queue=Incidents, subject=AskBio outage, ticket_status=closed, client=AskBio, priority=91, created=2026-04-23 11:16:26, last_txn_id=0>, <Ticket(id=8343, rt_number=57961, queue=Incidents, subject=rc-mss.reigate.ac.uk root volume usage, ticket_status=closed, client=Reigate College, priority=51, created=2026-04-20 08:21:25, last_txn_id=0>, <Ticket(id=8363, rt_number=57981, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-22 00:00:03, last_txn_id=0>, <Ticket(id=8389, rt_number=58007, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-24 00:00:03, last_txn_id=0>, <Ticket(id=8345, rt_number=57963, queue=Incidents, subject=WARNING: Security: Let's Encrypt Certificates on darkmatter.synpromics.com, ticket_status=closed, client=AskBio, priority=61, created=2026-04-20 09:16:54, last_txn_id=0>, <Ticket(id=8391, rt_number=58009, queue=Incidents, subject=WARNING: NRPE Disk: / on edb-lab-skye.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-04-24 10:56:16, last_txn_id=0>, <Ticket(id=8329, rt_number=57947, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-17 00:00:03, last_txn_id=0>, <Ticket(id=8344, rt_number=57962, queue=Incidents, subject=ccolive.cirencester.local storage volume usage /var, ticket_status=closed, client=Cirencester College, priority=52, created=2026-04-20 08:54:16, last_txn_id=0>, <Ticket(id=8375, rt_number=57993, queue=Incidents, subject=[FIRING: 1 for tangram/prod] KubeJobFailed in gitlab, ticket_status=closed, client=Tangram, priority=41, created=2026-04-22 17:12:06, last_txn_id=0>, <Ticket(id=8346, rt_number=57964, queue=Incidents, subject=WARNING: Cluster: Csync2 on vmsvr2.trident.lan, ticket_status=closed, client=Trident Honda, priority=41, created=2026-04-20 09:22:14, last_txn_id=0>, <Ticket(id=8376, rt_number=57994, queue=Incidents, subject=[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring, ticket_status=closed, client=Tangram, priority=41, created=2026-04-22 17:16:39, last_txn_id=0>, <Ticket(id=8382, rt_number=58000, queue=Incidents, subject=[FIRING: 1 for tangram/prod] KubePersistentVolumeFillingUp in tcl-monitoring, ticket_status=closed, client=Tangram, priority=51, created=2026-04-23 12:29:13, last_txn_id=0>, <Ticket(id=8349, rt_number=57967, queue=Incidents, subject=tangram/prod pods in non ready state, ticket_status=closed, client=Tangram, priority=51, created=2026-04-20 14:18:52, last_txn_id=0>, <Ticket(id=8383, rt_number=58001, queue=Incidents, subject=WARNING: Puppet: Checking-in on tron.troika.lan, ticket_status=closed, client=Troika, priority=31, created=2026-04-23 15:11:43, last_txn_id=0>, <Ticket(id=8352, rt_number=57970, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-21 00:00:05, last_txn_id=0>, <Ticket(id=8356, rt_number=57974, queue=Incidents, subject=UNKNOWN: Hardware: IPMI on tron.troika.lan, ticket_status=closed, client=Troika, priority=21, created=2026-04-21 11:31:56, last_txn_id=0>, <Ticket(id=8354, rt_number=57972, queue=Incidents, subject=Connectivity Issue from IXN and PPS and GS2 to Azure., ticket_status=closed, client=Sucden, priority=72, created=2026-04-21 10:15:51, last_txn_id=0>, <Ticket(id=8355, rt_number=57973, queue=Incidents, subject=CRITICAL: Backups: Prebackup for mersey.tiger-computing.co.uk on aql-svr-zabbix-app.quickline.co.uk, ticket_status=closed, client=Internal, priority=41, created=2026-04-21 10:49:43, last_txn_id=0>, <Ticket(id=8388, rt_number=58006, queue=Incidents, subject=Darkmatter ssh oddity, ticket_status=closed, client=AskBio, priority=71, created=2026-04-23 17:24:34, last_txn_id=0>, <Ticket(id=8357, rt_number=57975, queue=Incidents, subject=Storage alert: /srv/illumina_data on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-04-21 13:08:18, last_txn_id=0>]

Client updates report (Incidents)

23 Mar - 24 Apr

Versions

Installed Packages

Resource Usage

HTTP Headers

Request Vars

View information

COOKIES Variables

SESSION Variables

GET Variables

POST Variables

Templates

client_updates_report_drilldown.html

SQLAlchemy queries

Queries Unavailable

Configure Flask-SQLAlchemy:

Log Messages

Line Profiler Usage Docs

Usage Instructions

Level	Time	Message	Location
DEBUG	2026-07-09 12:19:54.263284	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263335	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263345	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263353	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263359	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263365	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263372	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263377	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263382	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263388	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263394	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263399	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263404	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263410	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263416	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263421	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263426	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263431	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263436	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263441	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263446	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263453	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263458	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263463	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263469	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263475	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263481	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263487	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263492	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263498	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263503	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263508	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263514	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263519	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263524	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263529	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263535	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263540	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263545	xxx	./services/model.py:838
DEBUG	2026-07-09 12:19:54.263551	xxx	./services/model.py:838