Commit Graph

58 Commits

Author SHA1 Message Date
Simon Guan d02196a231
refactor: adjust some logs (#30245)
* refactor: adjust wal log infos

* refactor: adjust some log's level

* refactor: adjust some log's level

* fix: add traceId for sync module

* refactor: adjust log level

* refactor: adjust log level

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* refactor: adjust log levels

* docs: update keywords

* fix: compile errors in windows

* docs: minor changes

* docs: minor changes

* refactor: minor changes

* docs: fminro changes

* docs: format

* refactr: remove uncessory logs

* docs: format doc
2025-03-18 17:55:36 +08:00
Haojun Liao ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105)
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
2025-03-17 10:20:17 +08:00
Haojun Liao ea549364d4 fix(stream): free array and check the return values. 2025-02-21 16:38:26 +08:00
Haojun Liao 6d5984421f refactor(stream): update the long trans threshold. 2025-02-20 17:27:41 +08:00
Haojun Liao 0a672f1b96 refactor(stream): update logs. 2025-02-20 16:55:10 +08:00
Haojun Liao 99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Haojun Liao 3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Haojun Liao 9f2c448e36 fix(stream): fix error in check node update trans. 2025-01-22 14:05:40 +08:00
Haojun Liao 30358f1297 fix(stream): fix error in check node update trans. 2025-01-22 12:52:30 +08:00
Haojun Liao 88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Haojun Liao 06f91b64e6 fix(stream): fix syntax error. 2024-12-07 11:51:42 +08:00
Haojun Liao 85c7d513c5 refactor(stream): remove unused variables. 2024-12-06 19:17:35 +08:00
Haojun Liao 1d700079d4 refactor: 1) add update task nodeep trans for every involved streams. 2) do some internal refactor for conflict check. 2024-12-06 18:56:49 +08:00
xsren 7198202611 fix: build on windows 2024-09-27 18:21:01 +08:00
xsren 54ea1466fc fix: cpy mem overflow 2024-09-27 15:24:19 +08:00
xsren 6749067c33 build error 2024-09-26 15:47:05 +08:00
xsren 18bc5a048f taosStrndup 2024-09-26 14:46:53 +08:00
Haojun Liao 0a7022693c refactor: do some internal refactor. 2024-09-19 18:13:46 +08:00
Haojun Liao a29903101a refactor: remove void and do some internal refactor. 2024-09-09 14:49:05 +08:00
Haojun Liao 979c6e20e6 fix(stream):set the code to be in_progress and do some internal refactor. 2024-09-09 11:12:30 +08:00
Haojun Liao 54fdea3173 fix(stream): perform node update when mnode leader/follower switches. 2024-08-15 18:01:28 +08:00
Haojun Liao 099064af5e other: merge 3.0 2024-08-02 13:29:35 +08:00
Haojun Liao 079f6358aa refactor: do some internal refactor. 2024-08-02 11:49:21 +08:00
kailixu 2fd3bf87fc Merge branch '3.0' into enh/TD-30988-3.0 2024-07-24 16:08:34 +08:00
kailixu 66dda35f75 Merge branch '3.0' into enh/TD-30988-3.0 2024-07-23 18:06:44 +08:00
Haojun Liao 7497f193c7 fix(stream): check return value, and do some internal refactor. 2024-07-23 14:47:29 +08:00
Haojun Liao 0d131116e7 fix(stream): check return value. 2024-07-23 11:32:21 +08:00
kailixu 280c5d4b3d enh: return error code 2024-07-22 16:33:42 +08:00
Haojun Liao be162fb62f fix(stream): check return value. 2024-07-22 13:31:57 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao dc2497791a fix(stream): accept invalid vgroup id error code when handling the update checkpoint info. 2024-06-12 10:11:55 +08:00
Haojun Liao 6effeabc8e fix(stream): handle checkpoint-info-update in write queue. 2024-06-11 10:53:32 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Haojun Liao a9ba534f48 fix(stream): adjust conflict level when creating stream. 2024-03-20 18:31:57 +08:00
Haojun Liao 03bc2d7c6d test(stream): add unit test cases. 2024-02-20 10:27:02 +08:00
Haojun Liao 11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
Haojun Liao b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao 9b3b03caab refactor: do some internal refactor. 2024-01-26 10:22:16 +08:00
Haojun Liao bd1d1cddaf refactor: do some internal refactor. 2024-01-26 10:03:54 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao bc7434e2b5 fix(stream): set error code for return. 2024-01-12 14:49:16 +08:00
Haojun Liao 5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao 284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00