xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
76,763 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

80 Commits

Author SHA1 Message Date
Haojun Liao dfe32225de chore: merge main. 2025-03-17 14:51:11 +08:00
Haojun Liao ab92886820
fix(stream): reduce the consensus checkpoint id trans. (#30105) 
* fix(stream): reduce the consensus checkpoint id trans.

* refactor(stream): add some logs.

* refactor(stream): set the max checkpoint exec time 30min.

* refactor(stream): add checkpoint-consensus trans conflict check.

* refactor(stream): remove unused local variables.

* fix(stream): fix syntax error.

* fix(stream): 1. fix free memory error 2. continue if put result into dst hashmap failed.

* fix issue

* fix issue

* fix(mnd): follower mnode not processes the timer event.

* fix(stream): print correct error msg.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): truncate long subtable name

* fix(stream): add buffer len.

* refactor(stream): update some logs.

* fix issue

* refactor(stream): update some logs.

* refactor(stream): update some logs.

* fix(stream): check return value.

* fix(stream): fix syntax error.

* fix(stream): check return value.

* fix(stream): update the timer check in mnode.

* fix(stream): add restart stage tracking.

* fix(stream): track the start task stage for meta.

* fix(stream): fix error in log.

* refactor(stream): adjust log info.

* fix mem issue

* fix(stream): check the number of required tasks for consensus checkpointId.

* fix(stream): lock the whole start procedure.

* fix(stream): add lock during start all tasks.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): update logs.

* fix(stream): fix dead-lock.

* fix(stream): fix syntax error.

* fix(stream): not drop the scan-history task.

* fix(stream): fix syntax error.

* fix(stream): wait for executor stop before restarting.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): add some logs.

* fix(stream): disable some logs.

* fix(stream): reset the start info if no task left.

---------

Co-authored-by: 54liuyao <54liuyao@163.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
 2025-03-17 10:20:17 +08:00
Haojun Liao a71f414d97 refactor(stream): stop all tasks before drop vnodes. 2025-03-02 02:06:14 +08:00
Haojun Liao 99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Haojun Liao 3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Haojun Liao 88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Haojun Liao 0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
xiao-77 c66a834d1e Replace unsafe memory functions with safe versions in wal&sync. 2024-12-13 15:19:29 +08:00
Shengliang Guan 84ea0f1ddd Merge branch 'main' into merge/mainto2.0 2024-12-03 15:50:18 +08:00
Haojun Liao 9a9a1828c1 refactor: display the time window for force_window_close. 2024-11-29 13:47:20 +08:00
Haojun Liao b2b5a14d9d fix(stream): reset task add the failed chkptId info. 2024-11-14 17:38:40 +08:00
Haojun Liao 39495ec935 refactor: do some internal refactor. 2024-10-09 10:07:08 +08:00
Haojun Liao 6170bb5c1c enh(stream): check the existence for snode. 2024-10-09 09:39:32 +08:00
Haojun Liao 0a7022693c refactor: do some internal refactor. 2024-09-19 18:13:46 +08:00
Haojun Liao 979c6e20e6 fix(stream):set the code to be in_progress and do some internal refactor. 2024-09-09 11:12:30 +08:00
Haojun Liao 868898d11c fix(stream): delay to load the stream task. 2024-08-16 00:28:49 +08:00
Haojun Liao 54fdea3173 fix(stream): perform node update when mnode leader/follower switches. 2024-08-15 18:01:28 +08:00
Haojun Liao eb029395a2 fix(stream): init exec when mnd become leader. 2024-08-14 00:38:15 +08:00
Haojun Liao dfa74f82d7 fix(stream): avoid repeat send checkpoint-report msg. 2024-08-09 00:40:05 +08:00
Haojun Liao aefb9d275e fix(stream): add ts in HbMsg. 2024-08-01 15:22:37 +08:00
Haojun Liao 6ba428fbf8 other: merge 3.0. 2024-08-01 11:15:49 +08:00
Haojun Liao 52b3e1be6f fix(stream): drop orphan tasks/reset task in trans done by write-queue. 2024-07-31 14:08:22 +08:00
Haojun Liao ad96333336 fix(stream): discard the processed hbmsg in the mnode. 2024-07-23 17:16:40 +08:00
Haojun Liao be162fb62f fix(stream): check return value. 2024-07-22 13:31:57 +08:00
Haojun Liao ebe1d09d74 fix(stream): check return value. 2024-07-22 10:07:18 +08:00
Haojun Liao ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Haojun Liao 8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Haojun Liao 653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
Haojun Liao c73a003ee3 fix(stream): set the initial checkpointId for a new created stream. 2024-07-02 19:13:20 +08:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Haojun Liao dc2497791a fix(stream): accept invalid vgroup id error code when handling the update checkpoint info. 2024-06-12 10:11:55 +08:00
Haojun Liao 00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao d0675a660e fix(stream): init the node list and task list when starting mnode. 2024-06-07 17:53:53 +08:00
Haojun Liao 34205ba62c refactor: do some internal refactor. 2024-06-07 10:09:40 +08:00
Haojun Liao 88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao 29648be30d fix(stream): add the new node info when adding stream tasks. 2024-06-04 23:28:08 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
Haojun Liao a9ba534f48 fix(stream): adjust conflict level when creating stream. 2024-03-20 18:31:57 +08:00
Haojun Liao cdfbbc2985 fix(stream): set the dest epset from mnode, and set the retry error code for trans. 2024-03-05 13:28:34 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Haojun Liao 03bc2d7c6d test(stream): add unit test cases. 2024-02-20 10:27:02 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao 739485a419 test(stream): add unit test case for the mnode stream module. 2024-02-05 09:10:04 +08:00
Haojun Liao 11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
Haojun Liao b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao 9087a0d9d0 feat(stream): drop orphan tasks. 2024-01-29 11:03:50 +08:00