task日志如下
[2025-08-16 14:36:32][121][134897756800768][DEBUG][databases.Meta.database:23][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] conn:134897664889408 sql===>("DELETE FROM jit_task where ((taskId = ‘888d2db849c44fde8dae1d18e7bcf689’)) ",)
[2025-08-16 14:36:32][121][134897756800768][DEBUG][databases.Meta.database:30][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] sql耗时===>2
[2025-08-16 14:36:32][121][134897756800768][DEBUG][tasks.Meta.base:97][_produce]: [7cd09990400d495394c7a0769a6bf8b3] 创建任务:8465ebca2f6d4ce9a81b917c516bf059
[2025-08-16 14:36:32][121][134897756800768][DEBUG][databases.Meta.client:98][get_connection]: [7cd09990400d495394c7a0769a6bf8b3] 从连接池获取连接:134897664885664
[2025-08-16 14:36:32][121][134897756800768][DEBUG][databases.Meta.database:23][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] conn:134897664885664 sql===>(‘INSERT INTO jit_task (taskId,envId,appId,orgId,taskType,taskFunc,funcType,status,element,rowId,argDict,createTime,creator,startTime) VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)’,)
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:23][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] conn:134897664885664 sql===>(‘SHOW ENGINE INNODB STATUS’,)
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:245][executeSql]: [7cd09990400d495394c7a0769a6bf8b3] 查询记录数：1
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:30][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] sql耗时===>3
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:23][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] conn:134897664885664 sql===>(‘SHOW FULL PROCESSLIST’,)
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:245][executeSql]: [7cd09990400d495394c7a0769a6bf8b3] 查询记录数：5
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:30][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] sql耗时===>3
[2025-08-16 14:37:22][121][134897756800768][ERROR][jit.commons.utils.logger:371][error]: [7cd09990400d495394c7a0769a6bf8b3] ====SHOW ENGINE INNODB STATUS====
[{‘Type’: ‘InnoDB’, ‘Name’: ‘’, ‘Status’: “\n=====================================\n2025-08-16 14:37:22 8927336515264 INNODB MONITOR OUTPUT\n=====================================\nPer second averages calculated from the last 8 seconds\n-----------------\nBACKGROUND THREAD\n-----------------\nsrv_master_thread loops: 84821 srv_active, 0 srv_shutdown, 2408505 srv_idle\nsrv_master_thread log flush and writes: 0\n----------\nSEMAPHORES\n----------\nOS WAIT ARRAY INFO: reservation count 190396\nOS WAIT ARRAY INFO: signal count 181774\nRW-shared spins 0, rounds 0, OS waits 0\nRW-excl spins 0, rounds 0, OS waits 0\nRW-sx spins 0, rounds 0, OS waits 0\nSpin rounds per wait: 0.00 RW-shared, 0.00 RW-excl, 0.00 RW-sx\n------------\nTRANSACTIONS\n------------\nTrx id counter 789436\nPurge done for trx’s n:o < 789434 undo n:o < 0 state: running but idle\nHistory list length 6\nLIST OF TRANSACTIONS FOR EACH SESSION:\n—TRANSACTION 290407734302288, not started\n0 lock struct(s), heap size 1128, 0 row lock(s)\n—TRANSACTION 290407734301480, not started\n0 lock struct(s), heap size 1128, 0 row lock(s)\n—TRANSACTION 290407734299056, not started\n0 lock struct(s), heap size 1128, 0 row lock(s)\n—TRANSACTION 290407734298248, not started\n0 lock struct(s), heap size 1128, 0 row lock(s)\n—TRANSACTION 789435, ACTIVE 50 sec\n1 lock struct(s), heap size 1128, 1 row lock(s)\nMySQL thread id 15539, OS thread handle 8927336515264, query id 19254930 10.20.30.171 DataCenter starting\nSHOW ENGINE INNODB STATUS\n—TRANSACTION 789434, ACTIVE 50 sec\n3 lock struct(s), heap size 1128, 2 row lock(s), undo log entries 1\nMySQL thread id 15538, OS thread handle 8927347730112, query id 19254924 10.20.30.171 DataCenter\n--------\nFILE I/O\n--------\nI/O thread 0 state: waiting for i/o request ((null))\nI/O thread 1 state: waiting for i/o request (insert buffer thread)\nI/O thread 2 state: waiting for i/o request (read thread)\nI/O thread 3 state: waiting for i/o request (read thread)\nI/O thread 4 state: waiting for i/o request (read thread)\nI/O thread 5 state: waiting for i/o request (read thread)\nI/O thread 6 state: waiting for i/o request (read thread)\nI/O thread 7 state: waiting for i/o request (read thread)\nI/O thread 8 state: waiting for i/o request (read thread)\nI/O thread 9 state: waiting for i/o request (read thread)\nI/O thread 10 state: waiting for i/o request (read thread)\nI/O thread 11 state: waiting for i/o request (read thread)\nI/O thread 12 state: waiting for i/o request (read thread)\nI/O thread 13 state: waiting for i/o request (read thread)\nI/O thread 14 state: waiting for i/o request (read thread)\nI/O thread 15 state: waiting for i/o request (read thread)\nI/O thread 16 state: waiting for i/o request (read thread)\nI/O thread 17 state: waiting for i/o request (read thread)\nI/O thread 18 state: waiting for i/o request (read thread)\nI/O thread 19 state: waiting for i/o request (read thread)\nI/O thread 20 state: waiting for i/o request (read thread)\nI/O thread 21 state: waiting for i/o request (read thread)\nI/O thread 22 state: waiting for i/o request (read thread)\nI/O thread 23 state: waiting for i/o request (read thread)\nI/O thread 24 state: waiting for i/o request (read thread)\nI/O thread 25 state: waiting for i/o request (read thread)\nI/O thread 26 state: waiting for i/o request (read thread)\nI/O thread 27 state: waiting for i/o request (read thread)\nI/O thread 28 state: waiting for i/o request (read thread)\nI/O thread 29 state: waiting for i/o request (read thread)\nI/O thread 30 state: waiting for i/o request (read thread)\nI/O thread 31 state: waiting for i/o request (read thread)\nI/O thread 32 state: waiting for i/o request (read thread)\nI/O thread 33 state: waiting for i/o request (read thread)\nI/O thread 34 state: waiting for i/o request (write thread)\nI/O thread 35 state: waiting for i/o request (write thread)\nI/O thread 36 state: waiting for i/o request (write thread)\nI/O thread 37 state: waiting for i/o request (write thread)\nI/O thread 38 state: waiting for i/o request (write thread)\nI/O thread 39 state: waiting for i/o request (write thread)\nI/O thread 40 state: waiting for i/o request (write thread)\nI/O thread 41 state: waiting for i/o request (write thread)\nI/O thread 42 state: waiting for i/o request (write thread)\nI/O thread 43 state: waiting for i/o request (write thread)\nI/O thread 44 state: waiting for i/o request (write thread)\nI/O thread 45 state: waiting for i/o request (write thread)\nI/O thread 46 state: waiting for i/o request (write thread)\nI/O thread 47 state: waiting for i/o request (write thread)\nI/O thread 48 state: waiting for i/o request (write thread)\nI/O thread 49 state: waiting for i/o request (write thread)\nI/O thread 50 state: waiting for i/o request (write thread)\nI/O thread 51 state: waiting for i/o request (write thread)\nI/O thread 52 state: waiting for i/o request (write thread)\nI/O thread 53 state: waiting for i/o request (write thread)\nI/O thread 54 state: waiting for i/o request (write thread)\nI/O thread 55 state: waiting for i/o request (write thread)\nI/O thread 56 state: waiting for i/o request (write thread)\nI/O thread 57 state: waiting for i/o request (write thread)\nI/O thread 58 state: waiting for i/o request (write thread)\nI/O thread 59 state: waiting for i/o request (write thread)\nI/O thread 60 state: waiting for i/o request (write thread)\nI/O thread 61 state: waiting for i/o request (write thread)\nI/O thread 62 state: waiting for i/o request (write thread)\nI/O thread 63 state: waiting for i/o request (write thread)\nI/O thread 64 state: waiting for i/o request (write thread)\nPending normal aio reads: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] , aio writes: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] ,\n ibuf aio reads:\nPending flushes (fsync) log: 0; buffer pool: 0\n865142 OS file reads, 6341096 OS file writes, 4831516 OS fsyncs\n0.00 reads/s, 0 avg bytes/read, 0.00 writes/s, 0.00 fsyncs/s\n-------------------------------------\nINSERT BUFFER AND ADAPTIVE HASH INDEX\n-------------------------------------\nIbuf: size 1, free list len 32, seg size 34, 16055 merges\nmerged operations:\n insert 28117, delete mark 370, delete 16\ndiscarded operations:\n insert 0, delete mark 0, delete 0\nHash table size 138401, node heap has 59 buffer(s)\nHash table size 138401, node heap has 2 buffer(s)\nHash table size 138401, node heap has 6 buffer(s)\nHash table size 138401, node heap has 83 buffer(s)\nHash table size 138401, node heap has 3 buffer(s)\nHash table size 138401, node heap has 15 buffer(s)\nHash table size 138401, node heap has 2 buffer(s)\nHash table size 138401, node heap has 81 buffer(s)\n0.00 hash searches/s, 0.00 non-hash searches/s\n—\nLOG\n—\nLog sequence number 4984628940\nLog buffer assigned up to 4984628940\nLog buffer completed up to 4984628940\nLog written up to 4984628940\nLog flushed up to 4984628940\nAdded dirty pages up to 4984628940\nPages flushed up to 4984628940\nLast checkpoint at 4984628940\nLog minimum file id is 275\nLog maximum file id is 297\n3036898 log i/o’s done, 0.00 log i/o’s/second\n----------------------\nBUFFER POOL AND MEMORY\n----------------------\nTotal large memory allocated 0\nDictionary memory allocated 10101685\nBuffer pool size 32765\nFree buffers 1031\nDatabase pages 31483\nOld database pages 11602\nModified db pages 0\nPending reads 0\nPending writes: LRU 0, flush list 0, single page 0\nPages made young 519638, not young 9966670\n0.00 youngs/s, 0.00 non-youngs/s\nPages read 864695, created 15478, written 2372684\n0.00 reads/s, 0.00 creates/s, 0.00 writes/s\nNo buffer pool page gets since the last printout\nPages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s\nLRU len: 31483, unzip_LRU len: 0\nI/O sum[61]:cur[0], unzip sum[0]:cur[0]\n--------------\nROW OPERATIONS\n--------------\n0 queries inside InnoDB, 0 queries in queue\n0 read views open inside InnoDB\nProcess ID=716291, Main thread ID=8929924810432 , state=sleeping\nNumber of rows inserted 124490, updated 1944961, deleted 13575, read 356850694992\n0.00 inserts/s, 0.00 updates/s, 0.00 deletes/s, 0.00 reads/s\nNumber of system rows inserted 6602, updated 7518, deleted 121, read 559233\n0.00 inserts/s, 0.00 updates/s, 0.00 deletes/s, 0.00 reads/s\n----------------------------\nEND OF INNODB MONITOR OUTPUT\n============================\n”}]
=====SHOW FULL PROCESSLIST=====
[{‘Id’: 5, ‘User’: ‘event_scheduler’, ‘Host’: ‘localhost’, ‘db’: None, ‘Command’: ‘Daemon’, ‘Time’: 2493779, ‘State’: ‘Waiting on empty queue’, ‘Info’: None}, {‘Id’: 15538, ‘User’: ‘DataCenter’, ‘Host’: ‘10.20.30.171:54902’, ‘db’: ‘datacenter’, ‘Command’: ‘Sleep’, ‘Time’: 50, ‘State’: ‘’, ‘Info’: None}, {‘Id’: 15539, ‘User’: ‘DataCenter’, ‘Host’: ‘10.20.30.171:54914’, ‘db’: ‘datacenter’, ‘Command’: ‘Query’, ‘Time’: 0, ‘State’: ‘init’, ‘Info’: ‘SHOW FULL PROCESSLIST’}, {‘Id’: 15540, ‘User’: ‘DataCenter’, ‘Host’: ‘10.20.30.171:54916’, ‘db’: ‘datacenter’, ‘Command’: ‘Sleep’, ‘Time’: 441, ‘State’: ‘’, ‘Info’: None}, {‘Id’: 15541, ‘User’: ‘DataCenter’, ‘Host’: ‘10.20.30.171:57484’, ‘db’: ‘datacenter’, ‘Command’: ‘Sleep’, ‘Time’: 50, ‘State’: ‘’, ‘Info’: None}]
Traceback (most recent call last):
File “databases.Meta.database”, line 24, in wrapper
File “databases.MySQLType.database”, line 107, in executemany
File “databases.Meta.database”, line 273, in executemany
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 173, in executemany
return self._do_execute_many(
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 211, in _do_execute_many
rows += self.execute(sql + postfix)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 148, in execute
result = self._query(query)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 310, in _query
conn.query(q)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 775, in _read_query_result
result.read()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 1156, in read
first_packet = self.connection._read_packet()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 725, in _read_packet
packet.raise_for_error()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/protocol.py”, line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/err.py”, line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.OperationalError: (1205, ‘Lock wait timeout exceeded; try restarting transaction’)
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.database:30][wrapper]: [7cd09990400d495394c7a0769a6bf8b3] sql耗时===>50016
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.client:270][rollback]: [7cd09990400d495394c7a0769a6bf8b3] 数据库134897664885664回滚数据
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.client:280][releaseConnect]: [7cd09990400d495394c7a0769a6bf8b3] 数据库134897664885664连接释放
[2025-08-16 14:37:22][121][134897756800768][DEBUG][databases.Meta.client:377][releaseConnect]: [7cd09990400d495394c7a0769a6bf8b3] 释放连接回连接池 134897664885664
[2025-08-16 14:37:22][121][134897756800768][ERROR][tasks.Meta.runtime:214][run]: [7cd09990400d495394c7a0769a6bf8b3] {“code”: 8000038, “reason”: “sql执行错误，错误信息:(1205, ‘Lock wait timeout exceeded; try restarting transaction’)”}
Traceback (most recent call last):
File “databases.Meta.database”, line 24, in wrapper
File “databases.MySQLType.database”, line 107, in executemany
File “databases.Meta.database”, line 273, in executemany
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 173, in executemany
return self._do_execute_many(
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 211, in _do_execute_many
rows += self.execute(sql + postfix)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 148, in execute
result = self._query(query)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/cursors.py”, line 310, in _query
conn.query(q)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 548, in query
self._affected_rows = self._read_query_result(unbuffered=unbuffered)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 775, in _read_query_result
result.read()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 1156, in read
first_packet = self.connection._read_packet()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/connections.py”, line 725, in _read_packet
packet.raise_for_error()
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/protocol.py”, line 221, in raise_for_error
err.raise_mysql_exception(self._data)
File “/data/JitNode/system/bin/python/lib/python3.10/site-packages/pymysql/err.py”, line 143, in raise_mysql_exception
raise errorclass(errno, errval)
pymysql.err.OperationalError: (1205, ‘Lock wait timeout exceeded; try restarting transaction’)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File “tasks.Meta.runtime”, line 212, in run
File “tasks.Meta.runtime”, line 168, in run
File “databases.Meta.transaction”, line 40, in call
File “tasks.Meta.runtime”, line 152, in afterReturn
File “jit.elements.element”, line 35, in wrapper
File “jit.elements.element”, line 33, in wrapper
File “tasks.Meta.base”, line 67, in afterReturn
File “tasks.Meta.base”, line 98, in _produce
File “tasks.models.TaskModel.model”, line 23, in create
File “models.NormalType.queryset”, line 209, in create
File “models.NormalType.queryset”, line 102, in wrapper
File “models.NormalType.queryset”, line 76, in wrapper
File “models.NormalType.queryset”, line 223, in __insertDb
File “models.Meta.proxy”, line 37, in insert
File “models.Meta.disk”, line 27, in insert
File “models.Meta.disk”, line 53, in writeByTQL
File “jit.elements.element”, line 35, in wrapper
File “jit.elements.element”, line 33, in wrapper
File “databases.Meta.database”, line 304, in write
File “databases.Meta.database”, line 27, in wrapper
jit.errcode.Code: {“code”: 8000038, “reason”: “sql执行错误，错误信息:(1205, ‘Lock wait timeout exceeded; try restarting transaction’)”}