Client updates report (Incidents)

30 Mar - 01 May

RT	Client	Replies missed	Subject
57976	NFW		WARNING: Mail: Exim Panic Log on nfwgs2.nfw.internal
57768	Internal		Check for Security Notices and System Updates
57769	NFW		nfwgs2.nfw.internal samba cleanup script error
57954	BD Group		EFSRV-21761 eFiling high load
57780	Internal		Check for Security Notices and System Updates
57942	Internal		Check for Security Notices and System Updates
57851	NFW		nfwgs2.nfw.internal unmerged configuration
57857	Internal		Check for Security Notices and System Updates
57997	OGT		rodney1 reboot/stonith problem
57982	Sucden		globalstar01/02.sucden.co.uk failed services
57938	Sucden		CRITICAL: HTTP: Uyuni HTTPS on patrs-gs2-p1l01.sucden.co.uk
57849	Internal		Check for Security Notices and System Updates
57783	Reigate College		CRITICAL: Networking: SSH on rc-mss.reigate.ac.uk
57782	Gravytrain		CRITICAL: HTTP: www.bedfordinsuranceforbusiness.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk
57759	AskBio		AskBio hosts down
57941	AskBio		/var on Talisker at 90%
58082	Midnight Hax		woodlands.midnighthax.com high storage volume usage /home
57773	OpenCorporates		[FIRING:1] DatasourceError Tiger Computing (ElastiCache Connections (openc-frontend-003))
57779	TCV		WARNING: NRPE Disk: /var on web4.tcv.org.uk
58070	Internal		Check for Security Notices and System Updates
57923	Internal		Check for Security Notices and System Updates
57919	Imoves	15 Apr, 17 Apr	Investigate PHP-related issues with staging site
57776	Internal		Check for Security Notices and System Updates
57958	Internal		Check for Security Notices and System Updates
57929	Trident Honda		WARNING: Cluster: Pacemaker CRM on vmsvr1.trident.lan
57951	Midnight Hax		Fix package double declaration on ws-trixie.midnighthax.com
57866	JISC		WARNING: Cluster: ClusterCheck on ath-lin-prx-l01.int.openathens.net
58064	OGT		rodney.internal.ogtip.com volume usage /srv/ngs
57811	Sucden		DOWN: globalstar{01,02}.sucden.co.uk
57870	Cirencester College		All systems down
57917	Internal		Error when reviewing draft schedules
57883	Koinex		WARNING: Mail: Queue Length on koinexserver.home
57924	Trident Honda		CRITICAL: Cluster: Pacemaker CRM on vmsvr2.trident.lan
57927	Trident Honda		smbfs1.trident.lan root storage volume usage
57934	Internal		Check for Security Notices and System Updates
57939	Lantech		CRITICAL: HTTP: moodle.ipa.ie HTTPS on moodle.ipa.ie
57867	ITC Compliance		Urgent - SSL Root Cert
57945	Internal		WARNING: Special: IcingaDB State on towy2.tiger-computing.co.uk
57859	Internal	10 Apr, 15 Apr	tcl/avon prometheus job missing
57930	Sucden		Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk
57850	Sucden		apt-show-versions.service failed on interstar05,06
57918	Imoves		Investigate PHP-related issues with staging site
57884	Tangram		CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk
57876	OGT		Storage alert: /srv/department on rodney.internal.ogtip.com
57786	Trident Honda	03 Apr	VM hera - /etc/sudoers.d/azure-sudo
57781	OGT	04 Apr	basil.internal.ogtip.com volume usage /var
57770	TCV	03 Apr	tcv-crm.tcv.org.uk cron php script error
57877	AskBio		All systems down
57761	Internal		Check for Security Notices and System Updates
57855	Troika		Unable to login to tricky
57863	Tangram		[FIRING: 5 for tangram/prod] AWSBackupCopyJobFailedToComplete
57868	Internal		Check for Security Notices and System Updates
58081	Internal		Check for Security Notices and System Updates
57944	AskBio	23 Apr, 28 Apr	ZFS pool data fragmentation on talisker.synpromics.com
57881	Internal		Check for Security Notices and System Updates
57937	Quickline		Disk critically full on aql-svr-zabbix-db
58113	Novadata		Linux vulnerability: Copy fail (CVE-2026-31431)
57762	Reigate College	01 Apr	rc-mss.reigate.ac.uk disk volume usage
57787	Internal	06 Apr	Check for Security Notices and System Updates
58071	Midnight Hax		CRITICAL: NRPE Disk: All Disks on woodlands.midnighthax.com
57998	Quickline		aql-svr-zabbix-app.quickline.co.uk backups to mersey problem
58089	Internal		Check for Security Notices and System Updates
58015	Tangram		[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring
58136	Internal		Check for Security Notices and System Updates
58083	Lantech		ipa-m3.private.ipa.ie root storage volume usage
58134	Internal		Green monitoring check showing as a problem in Icinga
57960	Troika		CRITICAL: System Health: Systemd State on tron.troika.lan
57996	Internal		Check for Security Notices and System Updates
57959	OGT		rodney1.internal.ogtip.com failed disk
58132	Sucden		Linux kernel security update (CVE-2026-31431)
58008	Tangram		CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk
58117	Reigate College		Linux vulnerability: Copy fail (CVE-2026-31431)
58093	AskBio		Linux vulnerability: Copy fail (CVE-2026-31431)
57999	AskBio		AskBio outage
57961	Reigate College		rc-mss.reigate.ac.uk root volume usage
58072	Koinex		DOWN: koinexserver.home
58059	NFW		DOWN: nfwgs2.nfw.internal
57981	Internal		Check for Security Notices and System Updates
58095	Azura		Linux vulnerability: Copy fail (CVE-2026-31431)
58007	Internal		Check for Security Notices and System Updates
57963	AskBio		WARNING: Security: Let's Encrypt Certificates on darkmatter.synpromics.com
58009	AskBio		WARNING: NRPE Disk: / on edb-lab-skye.askbio.com
58085	AskBio		talisker.synpromics.com root / volume usage
58096	BD Group		Linux vulnerability: Copy fail (CVE-2026-31431)
58019	Top To Toe		Re: STILL DOWN: toptotoe-staging.net is still offline ([28] Timeout was reached (Operation timed out after 30001 milliseconds with 0 bytes received))
58022	Internal		Check for Security Notices and System Updates
58020	Sucden		equistar03/04 megastar03/04 NTP Timeouts
57947	Internal		Check for Security Notices and System Updates
58111	Midnight Hax		Linux vulnerability: Copy fail (CVE-2026-31431)
57962	Cirencester College	25 Apr	ccolive.cirencester.local storage volume usage /var
58075	Gravytrain		CRITICAL: HTTP: www.rightsure.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk
58060	Global Brands		Printer issue
57993	Tangram		[FIRING: 1 for tangram/prod] KubeJobFailed in gitlab
58086	Internal		[FIRING: 1 for tcl/avon] KubeJobFailed in nextcloud
57964	Trident Honda		WARNING: Cluster: Csync2 on vmsvr2.trident.lan
58100	Econic Bio		Linux vulnerability: Copy fail (CVE-2026-31431)
58124	TCV		Linux vulnerability: Copy fail (CVE-2026-31431)
57994	Tangram		[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring
58000	Tangram		[FIRING: 1 for tangram/prod] KubePersistentVolumeFillingUp in tcl-monitoring
58104	Globecast		Linux vulnerability: Copy fail (CVE-2026-31431)
58140	Midnight Hax		CRITICAL: Disk: fstab mounts on woodlands.midnighthax.com
58127	Trident Honda		Linux vulnerability: Copy fail (CVE-2026-31431)
58024	Tangram		tangram/prod pods in non ready state
57967	Tangram	21 Apr	tangram/prod pods in non ready state
58076	AskBio		exim4 not starting on coll,jura
58001	Troika		WARNING: Puppet: Checking-in on tron.troika.lan
57970	Internal		Check for Security Notices and System Updates
58107	ITC Compliance		Linux vulnerability: Copy fail (CVE-2026-31431)
58141	Sucden		DOWN: patrs-gs2-p1l01.sucden.co.uk
58091	Internal		CRITICAL: Backups: Backup to woodlands.midnighthax.com on mersey.tiger-computing.co.uk
58109	Koinex		Linux vulnerability: Copy fail (CVE-2026-31431)
57974	Troika		UNKNOWN: Hardware: IPMI on tron.troika.lan
57972	Sucden		Connectivity Issue from IXN and PPS and GS2 to Azure.
57973	Internal		CRITICAL: Backups: Prebackup for mersey.tiger-computing.co.uk on aql-svr-zabbix-app.quickline.co.uk
58006	AskBio		Darkmatter ssh oddity
57975	OGT		Storage alert: /srv/illumina_data on rodney.internal.ogtip.com
58078	TCV		RT autoreply issues
58110	Lantech		Linux vulnerability: Copy fail (CVE-2026-31431)
58115	OGT		Linux vulnerability: Copy fail (CVE-2026-31431)

git hash: master (f521b466)

Package	Version	Homepage	Summary
alchemical	1.0.3	None	Modern SQLAlchemy simplified
alembic	1.18.5	None	A database migration tool for SQLAlchemy.
annotated-types	0.7.0	None	Reusable constraint types to use with typing.Annotated
anyio	4.14.1	None	High-level concurrency and networking framework on top of asyncio or Trio
ast_serialize	0.6.0	None	Python bindings for mypy AST serialization
asttokens	3.0.1	https://github.com/gristlabs/asttokens	Annotate AST trees with source code positions
backoff	2.2.1	https://github.com/litl/backoff	Function decoration for backoff and retry
blinker	1.9.0	None	Fast, simple object-to-object and broadcast signaling
Bootstrap-Flask	2.5.0	None	Bootstrap 4 & 5 helper for your Flask projects.
certifi	2026.6.17	https://github.com/certifi/python-certifi	Python package for providing Mozilla's CA Bundle.
charset-normalizer	3.4.7	None	The Real First Universal Charset Detector. Open, modern and actively maintained alternative to Chardet.
click	8.4.2	None	Composable command line interface toolkit
colorlog	6.10.1	https://github.com/borntyping/python-colorlog	Add colours to the output of Python's logging module.
decorator	5.3.1	None	Decorators for Humans
executing	2.2.1	https://github.com/alexmojaki/executing	Get the currently executing AST node of a frame, and other information
Flask	3.1.3	None	A simple framework for building complex web applications.
Flask-DebugToolbar	0.16.0	None	A toolbar overlay for debugging Flask applications.
Flask-DebugToolbar-LineProfilerPanel	1.0.2	https://github.com/phleet/flask_debugtoolbar_lineprofilerpanel	Panel for the Flask Debug toolbar to capture and view line-by-line profiling stats
Flask-Migrate	4.1.0	None	SQLAlchemy database migrations for Flask applications using Alembic.
Flask-SQLAlchemy	3.1.1	None	Add SQLAlchemy support to your Flask application.
Flask-WTF	1.3.0	None	Form rendering, validation, and CSRF protection for Flask with WTForms.
freezegun	1.5.5	https://github.com/spulec/freezegun	Let your Python tests travel through time
gql	4.0.0	https://github.com/graphql-python/gql	GraphQL client for Python
graphql-core	3.2.11	https://github.com/graphql-python/graphql-core	GraphQL implementation for Python, a port of GraphQL.js, the JavaScript reference implementation for GraphQL.
greenlet	3.5.3	None	Lightweight in-process concurrent programming
gunicorn	26.0.0	None	WSGI HTTP Server for UNIX
h11	0.16.0	https://github.com/python-hyper/h11	A pure-Python, bring-your-own-I/O implementation of HTTP/1.1
httpcore	1.0.9	None	A minimal low-level HTTP client.
httpx	0.28.1	None	The next generation HTTP client.
idna	3.18	None	Internationalized Domain Names in Applications (IDNA)
ilock	1.0.3	https://github.com/symonsoft/ilock	Inter-process named lock library
ipython	9.15.0	None	IPython: Productive Interactive Computing
ipython_pygments_lexers	1.1.1	None	Defines a variety of Pygments lexers for highlighting IPython code.
itsdangerous	2.2.0	None	Safely pass data to untrusted environments and back.
jedi	0.20.0	https://github.com/davidhalter/jedi	An autocompletion tool for Python that can be used for text editors.
Jinja2	3.1.6	None	A very fast and expressive template engine.
librt	0.12.0	None	Mypyc runtime library
line_profiler	5.0.2	https://github.com/pyutils/line_profiler	Line-by-line profiler
Mako	1.3.12	https://www.makotemplates.org/	A super-fast templating language that borrows the best ideas from the existing templating languages.
MarkupSafe	3.0.3	None	Safely add untrusted strings to HTML/XML markup.
matplotlib-inline	0.2.2	None	Inline Matplotlib backend for Jupyter
multidict	6.7.1	https://github.com/aio-libs/multidict	multidict implementation
mypy	2.1.0	None	Optional static typing for Python
mypy_extensions	1.1.0	None	Type system extensions for programs checked with the mypy type checker.
packaging	26.2	None	Core utilities for Python packages
parso	0.8.7	https://github.com/davidhalter/parso	A Python Parser
pathspec	1.1.1	None	Utility library for gitignore style pattern matching of file paths.
pdbp	1.8.2	https://github.com/mdmintz/pdbp	pdbp (Pdb+): A drop-in replacement for pdb and pdbpp.
pexpect	4.9.0	https://pexpect.readthedocs.io/	Pexpect allows easy control of interactive console applications.
portalocker	3.2.0	None	Wraps the portalocker recipe for easy usage
prompt_toolkit	3.0.52	None	Library for building powerful interactive command lines in Python
propcache	0.5.2	https://github.com/aio-libs/propcache	Accelerated property cache
psutil	7.2.2	https://github.com/giampaolo/psutil	Cross-platform lib for process and system monitoring.
psycopg	3.3.4	None	PostgreSQL database adapter for Python
psycopg-binary	3.3.4	None	PostgreSQL database adapter for Python -- C optimisation distribution
ptyprocess	0.7.0	https://github.com/pexpect/ptyprocess	Run a subprocess in a pseudo terminal
pure_eval	0.2.3	http://github.com/alexmojaki/pure_eval	Safely evaluate AST nodes without side effects
pydantic	2.13.4	None	Data validation using Python type hints
pydantic_core	2.46.4	https://github.com/pydantic/pydantic	Core functionality for Pydantic validation and serialization
Pygments	2.20.0	None	Pygments is a syntax highlighting package written in Python.
python-dateutil	2.9.0.post0	https://github.com/dateutil/dateutil	Extensions to the standard Python datetime module
python-dotenv	1.2.2	None	Read key-value pairs from a .env file and set them as environment variables
pytz	2026.2	http://pythonhosted.org/pytz	World timezone definitions, modern and historical
requests	2.34.2	None	Python HTTP for Humans.
requests-toolbelt	1.0.0	https://toolbelt.readthedocs.io/	A utility belt for advanced users of python-requests
rt	3.7.1	None	Python interface to Request Tracker API
six	1.17.0	https://github.com/benjaminp/six	Python 2 and 3 compatibility utilities
SQLAlchemy	2.0.51	https://www.sqlalchemy.org	Database Abstraction Library
stack-data	0.6.3	http://github.com/alexmojaki/stack_data	Extract data from python stack frames and tracebacks for informative displays
stackprinter	0.2.13	https://github.com/cknd/stackprinter	Debug-friendly stack traces, with variable values and semantic highlighting
tabcompleter	1.4.1	https://github.com/mdmintz/tabcompleter	tabcompleter --- Autocompletion in the Python console.
traitlets	5.15.1	None	Traitlets Python configuration system
types-pytz	2026.2.0.20260518	None	Typing stubs for pytz
typing-inspection	0.4.2	None	Runtime typing introspection tools
typing_extensions	4.16.0	None	Backported and Experimental Type Hints for Python 3.9+
urllib3	2.7.0	None	HTTP library with thread-safe connection pooling, file post, and more.
wcwidth	0.8.2	None	Measures the displayed width of unicode strings in a terminal
Werkzeug	3.1.8	None	The comprehensive WSGI web application library.
WTForms	3.2.2	None	Form validation and rendering for Python web development.
yarl	1.24.2	https://github.com/aio-libs/yarl	Yet another URL library

Resource	Value
User CPU time	128.714 msec
System CPU time	7.831 msec
Total CPU time	136.545 msec
Elapsed time	199.326 msec
Context switches	89 voluntary, 8 involuntary

Key	Value
HTTP_ACCEPT	/
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_HOST	dashboard.uat.tigr.uk
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
QUERY_STRING	end=2026-05-01&start=2026-03-30
REMOTE_ADDR	10.42.140.166
REQUEST_METHOD	GET
SCRIPT_NAME
SERVER_NAME	0.0.0.0
SERVER_PORT	8000
SERVER_PROTOCOL	HTTP/1.1
SERVER_SOFTWARE	gunicorn/26.0.0

Variable	Value
'end'	'2026-05-01'
'start'	'2026-03-30'

Variable	Value
g	<flask.g of 'app'>
meta	{'title': 'Client updates report (Incidents)', 'start': datetime.date(2026, 3, 30), 'end': datetime.date(2026, 5, 1)}
request	<Request 'http://dashboard.uat.tigr.uk/client_updates_report_drilldown/Incidents?end=2026-05-01&start=2026-03-30' [GET]>
tickets	[<Ticket(id=8358, rt_number=57976, queue=Incidents, subject=WARNING: Mail: Exim Panic Log on nfwgs2.nfw.internal, ticket_status=closed, client=NFW, priority=41, created=2026-04-21 15:43:05, last_txn_id=0>, <Ticket(id=8181, rt_number=57768, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-31 00:00:04, last_txn_id=0>, <Ticket(id=8182, rt_number=57769, queue=Incidents, subject=nfwgs2.nfw.internal samba cleanup script error, ticket_status=closed, client=NFW, priority=41, created=2026-03-31 09:14:34, last_txn_id=0>, <Ticket(id=8336, rt_number=57954, queue=Incidents, subject=EFSRV-21761 eFiling high load, ticket_status=closed, client=BD Group, priority=81, created=2026-04-17 21:37:17, last_txn_id=0>, <Ticket(id=8193, rt_number=57780, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-02 00:00:05, last_txn_id=0>, <Ticket(id=8323, rt_number=57942, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-16 00:00:03, last_txn_id=0>, <Ticket(id=8232, rt_number=57851, queue=Incidents, subject=nfwgs2.nfw.internal unmerged configuration, ticket_status=closed, client=NFW, priority=41, created=2026-04-08 08:08:47, last_txn_id=0>, <Ticket(id=8238, rt_number=57857, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-09 00:00:04, last_txn_id=0>, <Ticket(id=8379, rt_number=57997, queue=Incidents, subject=rodney1 reboot/stonith problem, ticket_status=closed, client=OGT, priority=51, created=2026-04-23 07:58:43, last_txn_id=0>, <Ticket(id=8364, rt_number=57982, queue=Incidents, subject=globalstar01/02.sucden.co.uk failed services, ticket_status=closed, client=Sucden, priority=41, created=2026-04-22 07:30:55, last_txn_id=0>, <Ticket(id=8319, rt_number=57938, queue=Incidents, subject=CRITICAL: HTTP: Uyuni HTTPS on patrs-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=1, created=2026-04-15 09:12:59, last_txn_id=0>, <Ticket(id=8230, rt_number=57849, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-08 00:00:05, last_txn_id=0>, <Ticket(id=8196, rt_number=57783, queue=Incidents, subject=CRITICAL: Networking: SSH on rc-mss.reigate.ac.uk, ticket_status=closed, client=Reigate College, priority=61, created=2026-04-02 10:10:11, last_txn_id=0>, <Ticket(id=8195, rt_number=57782, queue=Incidents, subject=CRITICAL: HTTP: www.bedfordinsuranceforbusiness.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk, ticket_status=closed, client=Gravytrain, priority=51, created=2026-04-02 09:54:36, last_txn_id=0>, <Ticket(id=8172, rt_number=57759, queue=Incidents, subject=AskBio hosts down, ticket_status=closed, client=AskBio, priority=61, created=2026-03-28 08:54:02, last_txn_id=0>, <Ticket(id=8322, rt_number=57941, queue=Incidents, subject=/var on Talisker at 90%, ticket_status=closed, client=AskBio, priority=71, created=2026-04-15 18:35:20, last_txn_id=0>, <Ticket(id=8432, rt_number=58082, queue=Incidents, subject=woodlands.midnighthax.com high storage volume usage /home, ticket_status=closed, client=Midnight Hax, priority=41, created=2026-04-29 08:15:29, last_txn_id=0>, <Ticket(id=8186, rt_number=57773, queue=Incidents, subject=[FIRING:1] DatasourceError Tiger Computing (ElastiCache Connections (openc-frontend-003)), ticket_status=closed, client=OpenCorporates, priority=71, created=2026-03-31 10:04:51, last_txn_id=0>, <Ticket(id=8192, rt_number=57779, queue=Incidents, subject=WARNING: NRPE Disk: /var on web4.tcv.org.uk, ticket_status=closed, client=TCV, priority=51, created=2026-04-01 15:10:29, last_txn_id=0>, <Ticket(id=8420, rt_number=58070, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-28 00:00:05, last_txn_id=0>, <Ticket(id=8304, rt_number=57923, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-14 00:00:05, last_txn_id=0>, <Ticket(id=8300, rt_number=57919, queue=Incidents, subject=Investigate PHP-related issues with staging site, ticket_status=closed, client=Imoves, priority=22, created=2026-04-13 12:16:55, last_txn_id=0>, <Ticket(id=8189, rt_number=57776, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-01 00:00:03, last_txn_id=0>, <Ticket(id=8340, rt_number=57958, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-20 00:00:04, last_txn_id=0>, <Ticket(id=8310, rt_number=57929, queue=Incidents, subject=WARNING: Cluster: Pacemaker CRM on vmsvr1.trident.lan, ticket_status=closed, client=Trident Honda, priority=41, created=2026-04-14 12:57:58, last_txn_id=0>, <Ticket(id=8333, rt_number=57951, queue=Incidents, subject=Fix package double declaration on ws-trixie.midnighthax.com, ticket_status=closed, client=Midnight Hax, priority=41, created=2026-04-17 12:46:55, last_txn_id=0>, <Ticket(id=8247, rt_number=57866, queue=Incidents, subject=WARNING: Cluster: ClusterCheck on ath-lin-prx-l01.int.openathens.net, ticket_status=closed, client=JISC, priority=61, created=2026-04-09 10:51:55, last_txn_id=0>, <Ticket(id=8414, rt_number=58064, queue=Incidents, subject=rodney.internal.ogtip.com volume usage /srv/ngs, ticket_status=closed, client=OGT, priority=43, created=2026-04-27 14:42:56, last_txn_id=0>, <Ticket(id=8224, rt_number=57811, queue=Incidents, subject=DOWN: globalstar{01,02}.sucden.co.uk, ticket_status=closed, client=Sucden, priority=81, created=2026-04-07 12:48:42, last_txn_id=0>, <Ticket(id=8251, rt_number=57870, queue=Incidents, subject=All systems down, ticket_status=closed, client=Cirencester College, priority=71, created=2026-04-10 11:35:39, last_txn_id=0>, <Ticket(id=8298, rt_number=57917, queue=Incidents, subject=Error when reviewing draft schedules, ticket_status=closed, client=Internal, priority=51, created=2026-04-13 11:45:50, last_txn_id=0>, <Ticket(id=8264, rt_number=57883, queue=Incidents, subject=WARNING: Mail: Queue Length on koinexserver.home, ticket_status=closed, client=Koinex, priority=51, created=2026-04-13 08:21:58, last_txn_id=0>, <Ticket(id=8305, rt_number=57924, queue=Incidents, subject=CRITICAL: Cluster: Pacemaker CRM on vmsvr2.trident.lan, ticket_status=closed, client=Trident Honda, priority=61, created=2026-04-14 08:01:30, last_txn_id=0>, <Ticket(id=8308, rt_number=57927, queue=Incidents, subject=smbfs1.trident.lan root storage volume usage , ticket_status=closed, client=Trident Honda, priority=51, created=2026-04-14 11:25:47, last_txn_id=0>, <Ticket(id=8315, rt_number=57934, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-15 00:00:03, last_txn_id=0>, <Ticket(id=8320, rt_number=57939, queue=Incidents, subject=CRITICAL: HTTP: moodle.ipa.ie HTTPS on moodle.ipa.ie, ticket_status=closed, client=Lantech, priority=41, created=2026-04-15 10:10:33, last_txn_id=0>, <Ticket(id=8248, rt_number=57867, queue=Incidents, subject=Urgent - SSL Root Cert, ticket_status=closed, client=ITC Compliance, priority=81, created=2026-04-09 14:03:55, last_txn_id=0>, <Ticket(id=8327, rt_number=57945, queue=Incidents, subject=WARNING: Special: IcingaDB State on towy2.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=61, created=2026-04-16 10:23:17, last_txn_id=0>, <Ticket(id=8240, rt_number=57859, queue=Incidents, subject=tcl/avon prometheus job missing, ticket_status=closed, client=Internal, priority=52, created=2026-04-09 08:23:52, last_txn_id=0>, <Ticket(id=8311, rt_number=57930, queue=Incidents, subject=Storage alert: /srv/uyuni/srv/www on patrs-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=42, created=2026-04-14 13:01:03, last_txn_id=0>, <Ticket(id=8231, rt_number=57850, queue=Incidents, subject=apt-show-versions.service failed on interstar05,06, ticket_status=closed, client=Sucden, priority=61, created=2026-04-08 01:05:35, last_txn_id=0>, <Ticket(id=8299, rt_number=57918, queue=Incidents, subject=Investigate PHP-related issues with staging site, ticket_status=rejected, client=Imoves, priority=1, created=2026-04-13 12:14:33, last_txn_id=0>, <Ticket(id=8265, rt_number=57884, queue=Incidents, subject=CRITICAL: System Health: Systemd State on dgx1.internal.etherapeutics.co.uk, ticket_status=closed, client=Tangram, priority=41, created=2026-04-13 08:30:00, last_txn_id=0>, <Ticket(id=8257, rt_number=57876, queue=Incidents, subject=Storage alert: /srv/department on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-04-10 15:39:04, last_txn_id=0>, <Ticket(id=8199, rt_number=57786, queue=Incidents, subject=VM hera - /etc/sudoers.d/azure-sudo, ticket_status=closed, client=Trident Honda, priority=52, created=2026-04-02 17:52:14, last_txn_id=0>, <Ticket(id=8194, rt_number=57781, queue=Incidents, subject=basil.internal.ogtip.com volume usage /var, ticket_status=closed, client=OGT, priority=52, created=2026-04-02 08:20:52, last_txn_id=0>, <Ticket(id=8183, rt_number=57770, queue=Incidents, subject=tcv-crm.tcv.org.uk cron php script error, ticket_status=closed, client=TCV, priority=42, created=2026-03-31 09:19:43, last_txn_id=0>, <Ticket(id=8258, rt_number=57877, queue=Incidents, subject=All systems down, ticket_status=closed, client=AskBio, priority=91, created=2026-04-11 08:03:30, last_txn_id=0>, <Ticket(id=8174, rt_number=57761, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-03-30 00:00:04, last_txn_id=0>, <Ticket(id=8236, rt_number=57855, queue=Incidents, subject=Unable to login to tricky, ticket_status=closed, client=Troika, priority=21, created=2026-04-08 13:53:49, last_txn_id=0>, <Ticket(id=8244, rt_number=57863, queue=Incidents, subject=[FIRING: 5 for tangram/prod] AWSBackupCopyJobFailedToComplete, ticket_status=closed, client=Tangram, priority=41, created=2026-04-09 09:22:11, last_txn_id=0>, <Ticket(id=8249, rt_number=57868, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-10 00:00:05, last_txn_id=0>, <Ticket(id=8431, rt_number=58081, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-29 00:00:04, last_txn_id=0>, <Ticket(id=8326, rt_number=57944, queue=Incidents, subject=ZFS pool data fragmentation on talisker.synpromics.com, ticket_status=closed, client=AskBio, priority=73, created=2026-04-16 10:20:00, last_txn_id=2484184>, <Ticket(id=8262, rt_number=57881, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-13 00:00:04, last_txn_id=0>, <Ticket(id=8318, rt_number=57937, queue=Incidents, subject=Disk critically full on aql-svr-zabbix-db, ticket_status=closed, client=Quickline, priority=81, created=2026-04-15 07:34:19, last_txn_id=2482732>, <Ticket(id=8463, rt_number=58113, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Novadata, priority=72, created=2026-04-30 10:01:45, last_txn_id=0>, <Ticket(id=8175, rt_number=57762, queue=Incidents, subject=rc-mss.reigate.ac.uk disk volume usage, ticket_status=closed, client=Reigate College, priority=52, created=2026-03-30 08:19:36, last_txn_id=0>, <Ticket(id=8200, rt_number=57787, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=42, created=2026-04-03 00:00:03, last_txn_id=0>, <Ticket(id=8421, rt_number=58071, queue=Incidents, subject=CRITICAL: NRPE Disk: All Disks on woodlands.midnighthax.com, ticket_status=closed, client=Midnight Hax, priority=41, created=2026-04-28 08:05:26, last_txn_id=0>, <Ticket(id=8380, rt_number=57998, queue=Incidents, subject=aql-svr-zabbix-app.quickline.co.uk backups to mersey problem, ticket_status=closed, client=Quickline, priority=51, created=2026-04-23 08:04:30, last_txn_id=0>, <Ticket(id=8439, rt_number=58089, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-30 00:00:03, last_txn_id=0>, <Ticket(id=8397, rt_number=58015, queue=Incidents, subject=[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring, ticket_status=closed, client=Tangram, priority=41, created=2026-04-24 15:42:36, last_txn_id=0>, <Ticket(id=8518, rt_number=58136, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-05-01 00:00:04, last_txn_id=0>, <Ticket(id=8433, rt_number=58083, queue=Incidents, subject=ipa-m3.private.ipa.ie root storage volume usage, ticket_status=closed, client=Lantech, priority=22, created=2026-04-29 09:59:45, last_txn_id=0>, <Ticket(id=8484, rt_number=58134, queue=Incidents, subject=Green monitoring check showing as a problem in Icinga, ticket_status=closed, client=Internal, priority=41, created=2026-04-30 12:18:55, last_txn_id=0>, <Ticket(id=8342, rt_number=57960, queue=Incidents, subject=CRITICAL: System Health: Systemd State on tron.troika.lan, ticket_status=closed, client=Troika, priority=21, created=2026-04-20 08:15:45, last_txn_id=0>, <Ticket(id=8378, rt_number=57996, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-23 00:00:03, last_txn_id=0>, <Ticket(id=8341, rt_number=57959, queue=Incidents, subject=rodney1.internal.ogtip.com failed disk, ticket_status=closed, client=OGT, priority=51, created=2026-04-20 08:12:01, last_txn_id=0>, <Ticket(id=8482, rt_number=58132, queue=Incidents, subject=Linux kernel security update (CVE-2026-31431), ticket_status=closed, client=Sucden, priority=93, created=2026-04-30 11:27:34, last_txn_id=2491796>, <Ticket(id=8390, rt_number=58008, queue=Incidents, subject=CRITICAL: AWS Site-to-Site VPN: Tunnel2 on dgx1.internal.etherapeutics.co.uk, ticket_status=closed, client=Tangram, priority=51, created=2026-04-24 08:25:20, last_txn_id=0>, <Ticket(id=8467, rt_number=58117, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Reigate College, priority=74, created=2026-04-30 10:03:37, last_txn_id=0>, <Ticket(id=8443, rt_number=58093, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=AskBio, priority=91, created=2026-04-30 09:53:11, last_txn_id=2492662>, <Ticket(id=8381, rt_number=57999, queue=Incidents, subject=AskBio outage, ticket_status=closed, client=AskBio, priority=91, created=2026-04-23 11:16:26, last_txn_id=0>, <Ticket(id=8343, rt_number=57961, queue=Incidents, subject=rc-mss.reigate.ac.uk root volume usage, ticket_status=closed, client=Reigate College, priority=51, created=2026-04-20 08:21:25, last_txn_id=0>, <Ticket(id=8422, rt_number=58072, queue=Incidents, subject=DOWN: koinexserver.home, ticket_status=closed, client=Koinex, priority=51, created=2026-04-28 08:35:05, last_txn_id=0>, <Ticket(id=8409, rt_number=58059, queue=Incidents, subject=DOWN: nfwgs2.nfw.internal, ticket_status=closed, client=NFW, priority=50, created=2026-04-27 12:30:09, last_txn_id=0>, <Ticket(id=8363, rt_number=57981, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-22 00:00:03, last_txn_id=0>, <Ticket(id=8445, rt_number=58095, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Azura, priority=72, created=2026-04-30 09:54:42, last_txn_id=0>, <Ticket(id=8389, rt_number=58007, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-24 00:00:03, last_txn_id=0>, <Ticket(id=8345, rt_number=57963, queue=Incidents, subject=WARNING: Security: Let's Encrypt Certificates on darkmatter.synpromics.com, ticket_status=closed, client=AskBio, priority=61, created=2026-04-20 09:16:54, last_txn_id=0>, <Ticket(id=8391, rt_number=58009, queue=Incidents, subject=WARNING: NRPE Disk: / on edb-lab-skye.askbio.com, ticket_status=closed, client=AskBio, priority=61, created=2026-04-24 10:56:16, last_txn_id=0>, <Ticket(id=8435, rt_number=58085, queue=Incidents, subject=talisker.synpromics.com root / volume usage , ticket_status=closed, client=AskBio, priority=61, created=2026-04-29 11:44:51, last_txn_id=0>, <Ticket(id=8446, rt_number=58096, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=BD Group, priority=92, created=2026-04-30 09:55:06, last_txn_id=0>, <Ticket(id=8401, rt_number=58019, queue=Incidents, subject=Re: STILL DOWN: toptotoe-staging.net is still offline ([28] Timeout was reached (Operation timed out after 30001 milliseconds with 0 bytes received)), ticket_status=closed, client=Top To Toe, priority=52, created=2026-04-26 02:27:18, last_txn_id=0>, <Ticket(id=8404, rt_number=58022, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-27 00:00:04, last_txn_id=0>, <Ticket(id=8402, rt_number=58020, queue=Incidents, subject=equistar03/04 megastar03/04 NTP Timeouts, ticket_status=closed, client=Sucden, priority=71, created=2026-04-26 11:19:06, last_txn_id=0>, <Ticket(id=8329, rt_number=57947, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-17 00:00:03, last_txn_id=0>, <Ticket(id=8461, rt_number=58111, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Midnight Hax, priority=72, created=2026-04-30 10:01:06, last_txn_id=0>, <Ticket(id=8344, rt_number=57962, queue=Incidents, subject=ccolive.cirencester.local storage volume usage /var, ticket_status=closed, client=Cirencester College, priority=52, created=2026-04-20 08:54:16, last_txn_id=0>, <Ticket(id=8425, rt_number=58075, queue=Incidents, subject=CRITICAL: HTTP: www.rightsure.co.uk HTTPS on web.prod.bf2.bedfordinsurance.co.uk, ticket_status=closed, client=Gravytrain, priority=61, created=2026-04-28 09:09:20, last_txn_id=0>, <Ticket(id=8410, rt_number=58060, queue=Incidents, subject=Printer issue, ticket_status=closed, client=Global Brands, priority=51, created=2026-04-27 12:50:58, last_txn_id=0>, <Ticket(id=8375, rt_number=57993, queue=Incidents, subject=[FIRING: 1 for tangram/prod] KubeJobFailed in gitlab, ticket_status=closed, client=Tangram, priority=41, created=2026-04-22 17:12:06, last_txn_id=0>, <Ticket(id=8436, rt_number=58086, queue=Incidents, subject=[FIRING: 1 for tcl/avon] KubeJobFailed in nextcloud, ticket_status=closed, client=Internal, priority=51, created=2026-04-29 12:18:46, last_txn_id=0>, <Ticket(id=8346, rt_number=57964, queue=Incidents, subject=WARNING: Cluster: Csync2 on vmsvr2.trident.lan, ticket_status=closed, client=Trident Honda, priority=41, created=2026-04-20 09:22:14, last_txn_id=0>, <Ticket(id=8450, rt_number=58100, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Econic Bio, priority=73, created=2026-04-30 09:56:48, last_txn_id=0>, <Ticket(id=8474, rt_number=58124, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=TCV, priority=53, created=2026-04-30 10:07:34, last_txn_id=0>, <Ticket(id=8376, rt_number=57994, queue=Incidents, subject=[FIRING: 1 for tangram/stage] ThanosCompactHalted in tcl-monitoring, ticket_status=closed, client=Tangram, priority=41, created=2026-04-22 17:16:39, last_txn_id=0>, <Ticket(id=8382, rt_number=58000, queue=Incidents, subject=[FIRING: 1 for tangram/prod] KubePersistentVolumeFillingUp in tcl-monitoring, ticket_status=closed, client=Tangram, priority=51, created=2026-04-23 12:29:13, last_txn_id=0>, <Ticket(id=8454, rt_number=58104, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Globecast, priority=72, created=2026-04-30 09:58:18, last_txn_id=2494530>, <Ticket(id=8522, rt_number=58140, queue=Incidents, subject=CRITICAL: Disk: fstab mounts on woodlands.midnighthax.com, ticket_status=closed, client=Midnight Hax, priority=51, created=2026-05-01 16:19:10, last_txn_id=0>, <Ticket(id=8477, rt_number=58127, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Trident Honda, priority=72, created=2026-04-30 10:08:41, last_txn_id=2495678>, <Ticket(id=8406, rt_number=58024, queue=Incidents, subject=tangram/prod pods in non ready state, ticket_status=closed, client=Tangram, priority=51, created=2026-04-27 10:06:31, last_txn_id=0>, <Ticket(id=8349, rt_number=57967, queue=Incidents, subject=tangram/prod pods in non ready state, ticket_status=closed, client=Tangram, priority=51, created=2026-04-20 14:18:52, last_txn_id=0>, <Ticket(id=8426, rt_number=58076, queue=Incidents, subject=exim4 not starting on coll,jura, ticket_status=closed, client=AskBio, priority=81, created=2026-04-28 12:36:24, last_txn_id=0>, <Ticket(id=8383, rt_number=58001, queue=Incidents, subject=WARNING: Puppet: Checking-in on tron.troika.lan, ticket_status=closed, client=Troika, priority=31, created=2026-04-23 15:11:43, last_txn_id=0>, <Ticket(id=8352, rt_number=57970, queue=Incidents, subject=Check for Security Notices and System Updates, ticket_status=closed, client=Internal, priority=41, created=2026-04-21 00:00:05, last_txn_id=0>, <Ticket(id=8457, rt_number=58107, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=ITC Compliance, priority=72, created=2026-04-30 09:59:20, last_txn_id=0>, <Ticket(id=8523, rt_number=58141, queue=Incidents, subject=DOWN: patrs-gs2-p1l01.sucden.co.uk, ticket_status=closed, client=Sucden, priority=11, created=2026-05-01 16:21:05, last_txn_id=0>, <Ticket(id=8441, rt_number=58091, queue=Incidents, subject=CRITICAL: Backups: Backup to woodlands.midnighthax.com on mersey.tiger-computing.co.uk, ticket_status=closed, client=Internal, priority=53, created=2026-04-30 08:53:57, last_txn_id=2498019>, <Ticket(id=8459, rt_number=58109, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Koinex, priority=51, created=2026-04-30 10:00:12, last_txn_id=0>, <Ticket(id=8356, rt_number=57974, queue=Incidents, subject=UNKNOWN: Hardware: IPMI on tron.troika.lan, ticket_status=closed, client=Troika, priority=21, created=2026-04-21 11:31:56, last_txn_id=0>, <Ticket(id=8354, rt_number=57972, queue=Incidents, subject=Connectivity Issue from IXN and PPS and GS2 to Azure., ticket_status=closed, client=Sucden, priority=72, created=2026-04-21 10:15:51, last_txn_id=0>, <Ticket(id=8355, rt_number=57973, queue=Incidents, subject=CRITICAL: Backups: Prebackup for mersey.tiger-computing.co.uk on aql-svr-zabbix-app.quickline.co.uk, ticket_status=closed, client=Internal, priority=41, created=2026-04-21 10:49:43, last_txn_id=0>, <Ticket(id=8388, rt_number=58006, queue=Incidents, subject=Darkmatter ssh oddity, ticket_status=closed, client=AskBio, priority=71, created=2026-04-23 17:24:34, last_txn_id=0>, <Ticket(id=8357, rt_number=57975, queue=Incidents, subject=Storage alert: /srv/illumina_data on rodney.internal.ogtip.com, ticket_status=closed, client=OGT, priority=41, created=2026-04-21 13:08:18, last_txn_id=0>, <Ticket(id=8428, rt_number=58078, queue=Incidents, subject=RT autoreply issues, ticket_status=closed, client=TCV, priority=52, created=2026-04-28 14:51:17, last_txn_id=0>, <Ticket(id=8460, rt_number=58110, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=closed, client=Lantech, priority=53, created=2026-04-30 10:00:51, last_txn_id=0>, <Ticket(id=8465, rt_number=58115, queue=Incidents, subject=Linux vulnerability: Copy fail (CVE-2026-31431), ticket_status=resolved, client=OGT, priority=76, created=2026-04-30 10:02:21, last_txn_id=2514298>]

Client updates report (Incidents)

30 Mar - 01 May

Versions

Installed Packages

Resource Usage

HTTP Headers

Request Vars

View information

COOKIES Variables

SESSION Variables

GET Variables

POST Variables

Templates

client_updates_report_drilldown.html

SQLAlchemy queries

Queries Unavailable

Configure Flask-SQLAlchemy:

Log Messages

Line Profiler Usage Docs

Usage Instructions

Level	Time	Message	Location
DEBUG	2026-07-06 22:46:44.774718	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774791	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774806	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774826	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774837	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774848	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774860	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774873	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774884	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774894	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774907	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774918	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774930	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774939	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774948	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774959	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774969	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774979	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774986	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.774993	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775000	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775007	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775014	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775021	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775028	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775036	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775045	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775080	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775091	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775101	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775110	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775121	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775132	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775143	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775154	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775165	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775176	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775187	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775197	xxx	./services/model.py:838
DEBUG	2026-07-06 22:46:44.775207	xxx	./services/model.py:838