Commit Graph

729 Commits

Author SHA1 Message Date
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao 810eb8e0e3 fix(stream): fix syntax error. 2023-11-23 16:25:12 +08:00
Haojun Liao de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Haojun Liao 0654b9299a fix(stream): fix memory leak. 2023-11-23 11:44:25 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao ff9c0c0df4 fix(stream): fix error in check trans conflict. 2023-11-23 09:38:11 +08:00
Haojun Liao 6fca8c170c enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-23 09:33:44 +08:00
Haojun Liao 8204db13aa enh(stream): add sink_quota column for stream tasks. 2023-11-23 09:33:42 +08:00
Haojun Liao 41aa175099 fix(stream): add return. 2023-11-23 09:33:36 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
Haojun Liao a2a68ce256 fix(stream): fix memory leak. 2023-11-22 18:28:38 +08:00
Haojun Liao d88b32e93d fix(stream): fix memory leak. 2023-11-22 18:18:43 +08:00
Haojun Liao 9988720a1e fix(stream): fix the invalid check of trans conflict. 2023-11-22 16:39:29 +08:00
Haojun Liao ebb1993900 fix(stream): fix error in check trans conflict. 2023-11-22 16:20:59 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
Haojun Liao 3907268f40 fix(stream): register checkpoint trans. 2023-11-22 08:40:40 +08:00
Haojun Liao d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao 43e6722fd8 refactor: refactor the stream trans conflict check 2023-11-22 08:38:32 +08:00
yihaoDeng 947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
Haojun Liao 8c4558c5c2
Merge pull request #23763 from taosdata/fix/pause_stream
fix(stream): fix error in generating token in bucket.
2023-11-21 15:46:25 +08:00
Haojun Liao 1077378d51 other: merge main. 2023-11-21 10:14:30 +08:00
yihaoDeng 939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
dmchen 2d7c4890da TD-27416 2023-11-20 16:50:43 +08:00
dmchen 376f78788e TD-27416 2023-11-20 08:43:12 +00:00
Haojun Liao ec919415b8 enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao 56edf1b52c enh(stream): add sink_quota column for stream tasks. 2023-11-20 12:03:23 +08:00
Haojun Liao 7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
Haojun Liao 3912e49309 enh(stream): add sink_quota column for stream tasks. 2023-11-20 11:46:11 +08:00
yihaoDeng 734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
wade zhang 43a8a76719
Merge pull request #23713 from taosdata/FIX/TD-27336-3.0
fix/TD-27336
2023-11-17 08:59:50 +08:00
yihaoDeng 7905f22aae fix stream backend convert 2023-11-16 17:35:17 +08:00
yihaoDeng 8023f2bebd fix stream backend convert 2023-11-16 15:30:01 +08:00
dmchen 8dbb7ff2d4 copy sql before destroy 2023-11-16 10:28:11 +08:00
dmchen 1e2c9b03a1 copy sql before destroy 2023-11-16 02:22:01 +00:00
dm chen b18aa087da Revert "create steam"
This reverts commit cd6df48df5.
2023-11-16 10:09:46 +08:00
dmchen cd6df48df5 create steam 2023-11-16 01:49:31 +00:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
dmchen 9e37fd8fc6 create stream 2023-11-15 18:48:41 +08:00
dmchen 82498a9b4e create stream 2023-11-15 10:44:53 +00:00
Haojun Liao 1b89d4f404 fix(stream): add return. 2023-11-15 18:06:16 +08:00
Haojun Liao 6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Haojun Liao 974d0bbb48 fix(stream): add return. 2023-11-15 16:53:51 +08:00
Haojun Liao 115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
Haojun Liao 1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00
Haojun Liao f299bdb387 fix(stream): register checkpoint trans. 2023-11-15 14:29:01 +08:00
Haojun Liao 51897a679f fix(stream): fix invalid read. 2023-11-15 11:21:31 +08:00
Haojun Liao 61552e30d9 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:13:40 +08:00
Haojun Liao b390ee859c fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 17:04:54 +08:00
Haojun Liao 18333d7347 fix(stream): send msg by using epset extract from mnode, instead of cached epset in streamObj. 2023-11-14 15:48:00 +08:00
Haojun Liao 9a852b723d refactor: refactor the stream trans conflict check 2023-11-13 23:26:16 +08:00
wangmm0220 56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220 1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 3bacd7516e fix(stream): extact stream nodes list if not initialized. 2023-11-11 15:40:35 +08:00
Haojun Liao 15430f4d50 refactor: 2023-11-11 15:40:33 +08:00
Haojun Liao 5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao 77d6fd5394 refactor: do some internal refactor. 2023-11-11 15:39:09 +08:00
Haojun Liao 438c303b0d other: merge main. 2023-11-10 17:05:36 +08:00
Haojun Liao 08a9244230 fix(stream): extact stream nodes list if not initialized. 2023-11-10 16:24:20 +08:00
Haojun Liao d0307e5876 refactor: 2023-11-10 15:30:21 +08:00
Haojun Liao 0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
Haojun Liao 5824caa8f5
Merge pull request #23631 from taosdata/fix/liaohj
multiple fix
2023-11-10 13:09:40 +08:00
yihaoDeng 3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
yihaoDeng 15b73354f8 change chkpid gen way 2023-11-09 13:59:21 +08:00
yihaoDeng ef726fee53 change chkpid gen way 2023-11-09 13:58:36 +08:00
yihaoDeng 98a2ca6bfd change chkpid gen way 2023-11-09 10:07:24 +08:00
yihaoDeng 17ea6f39c1 change chkp gen way 2023-11-09 09:55:09 +08:00
yihaoDeng 06f196b71d change check out seq 2023-11-09 09:08:41 +08:00
yihaoDeng 0f98f4daa5 change check out seq 2023-11-08 20:29:37 +08:00
yihaoDeng 08e3448498 add seq 2023-11-08 19:54:57 +08:00
Haojun Liao 658fafd03c refactor: do some internal refactor. 2023-11-08 14:02:08 +08:00
yihaoDeng 6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
yihaoDeng 1e96edcdd7 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 17:30:46 +08:00
yihaoDeng 4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
dmchen 0ab4e809c5 db and resource 2023-11-01 15:12:45 +08:00
dmchen bbfecb7383 db and resource 2023-11-01 07:04:20 +00:00
Haojun Liao 0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-11-01 12:01:54 +08:00
Haojun Liao 1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao 91121974d7 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-30 09:32:40 +08:00
Haojun Liao 48202a1e45 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao 1a1b9f5ea3 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao 790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
Haojun Liao da6e3cb293 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-29 17:37:10 +08:00
Haojun Liao 1e696287d8 fix(stream): set the trans exec sequentially. 2023-10-29 02:45:47 +08:00
Haojun Liao 3bf3d00d90 fix(stream): set the trans exec sequentially. 2023-10-27 23:45:50 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
Haojun Liao 29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao 38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao 4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 4badb445c4 refactor: do some internal refactor W.R.T. global configurations. 2023-10-27 09:54:07 +08:00
Haojun Liao a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
Haojun Liao c95cd8da8b refactor(stream): do some internal refactor. 2023-10-25 18:14:28 +08:00
Haojun Liao 9220731313 other: add some logs. 2023-10-25 14:51:59 +08:00
Haojun Liao 07e9d56e07 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-25 11:42:46 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
yihaoDeng d46cf878eb refactor stream backend 2023-10-24 11:53:52 +08:00
yihaoDeng 986a502019 refactor stream backend 2023-10-23 18:22:58 +08:00
yihaoDeng ca1ffd584d refactor stream backend 2023-10-23 16:45:17 +08:00
yihaoDeng 9d210ec957 refactor stream backend 2023-10-23 14:06:25 +08:00
Haojun Liao a882c639be fix(stream): remove invalid assert. 2023-10-22 16:16:59 +08:00
Haojun Liao 825195b351 refactor: do some internal refactor. 2023-10-21 16:38:46 +08:00
Haojun Liao 74572dd6a7 refactor: do some internal refactor. 2023-10-21 15:21:02 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
yihaoDeng 1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
yihaoDeng 67dc52d2d6 refactor stream checkpoint 2023-10-19 15:19:52 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
Haojun Liao 531f478ade refactor: do some internal refactor W.R.T. global configurations. 2023-10-17 08:17:49 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Haojun Liao 33d9f772be other: merge 3.0 2023-10-13 09:06:13 +08:00
Haojun Liao 21fb502690 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 20:10:26 +08:00
Haojun Liao 9d5a3b8d78 other: merge stream fix. 2023-10-09 20:10:13 +08:00
Haojun Liao 11d8c8da39 fix(stream): update the sink data. 2023-10-09 20:09:23 +08:00
Haojun Liao f0c5b5a970 refactor(stream): revised the display info. 2023-10-09 20:09:22 +08:00
Haojun Liao 28008f8263 enh(stream): add more info for sink task. 2023-10-09 20:09:22 +08:00
Haojun Liao 932d93ab35 refactor: wait for more time for future data 2023-10-09 20:09:21 +08:00
Haojun Liao 0ab5d4b342 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c295ec322a refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao 583ac1fc45 refactor: do some internal refactor. 2023-10-09 20:09:20 +08:00
Haojun Liao c759d90bf6 enh(stream): optimize the stream status when creating without fill-history option. 2023-10-09 20:09:09 +08:00
Haojun Liao 65f66f0986 fix(stream): transfer state when all downstream rsp already. 2023-10-09 20:08:11 +08:00
Haojun Liao 4fe1382cd9 fix(stream): adjust nodeUpdate check interval. 2023-10-09 20:08:09 +08:00
Haojun Liao 498519c94d fix(stream): remove invalid node. 2023-10-09 20:08:02 +08:00
Haojun Liao 124e1ed1ab enh(stream): add stage info for streamt tasks. 2023-10-09 20:08:02 +08:00
Haojun Liao a3d13d6634 fix(stream): remove invalid cached task info in buffer. 2023-10-09 20:07:08 +08:00
Haojun Liao 53237c34d1 enh(stream): add info in log. 2023-10-09 20:06:09 +08:00
Haojun Liao e27111ecd1 enh(stream): add node stage check. 2023-10-09 20:06:09 +08:00
Haojun Liao ff3ea366e2 fix(stream): keep the status entry in hash table, instead entry index. 2023-10-09 20:06:05 +08:00
Haojun Liao 38bf2d24e7 fix(stream): remove stream in buf. 2023-10-09 20:05:39 +08:00
Haojun Liao 57bf1cadc4 fix(stream): fix error in decode stream task. 2023-10-09 20:05:37 +08:00
Haojun Liao 0459a4628c fix(stream): fix stream task id error. 2023-10-09 20:05:36 +08:00
Haojun Liao 5f1146d415 fix(stream): fix memory leak. 2023-10-09 20:04:17 +08:00
Haojun Liao 1256eafddb other: merge stream fix. 2023-10-09 19:59:24 +08:00
Haojun Liao be09c173ab fix:fix coverity issue and remove unnecessary files. 2023-10-09 19:56:17 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
Haojun Liao f542a8c786 fix(stream): update the sink data. 2023-10-07 09:22:25 +08:00
Haojun Liao 798f559b62 refactor(stream): revised the display info. 2023-10-07 09:04:38 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
Haojun Liao c9576d7a85 fix(stream): transfer state when all downstream rsp already. 2023-09-25 17:31:38 +08:00
Haojun Liao dbc53069db
Merge branch 'main' into fix/liaohj 2023-09-25 10:41:18 +08:00
Haojun Liao 1af95969b2 fix(stream): adjust nodeUpdate check interval. 2023-09-25 10:40:30 +08:00
Haojun Liao 7380151322 fix(stream): remove invalid node. 2023-09-22 11:45:46 +08:00
Haojun Liao 198e6bb023 enh(stream): add stage info for streamt tasks. 2023-09-22 10:36:15 +08:00
Haojun Liao 92f18989df fix(stream): remove invalid cached task info in buffer. 2023-09-20 19:19:04 +08:00
Haojun Liao 5e3a268b6d enh(stream): add info in log. 2023-09-20 13:15:50 +08:00
dm chen 4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-20 11:13:34 +08:00
Haojun Liao b4419bda65 enh(stream): add node stage check. 2023-09-20 10:35:01 +08:00
dmchen e36ff1282c revert dependency 2023-09-19 13:42:02 +08:00
slzhou c882f4ba08 fix: fix address sanitizer error 2023-09-19 11:31:20 +08:00
Haojun Liao 5a6e50d523 fix(stream): keep the status entry in hash table, instead entry index. 2023-09-19 10:33:58 +08:00
Haojun Liao 1ca06e960f fix(stream): remove stream in buf. 2023-09-18 20:25:24 +08:00
dmchen b473122dac break dependency 2023-09-18 12:29:08 +08:00
dm chen fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql 2023-09-18 09:41:47 +08:00
Haojun Liao 3dfdda3283 fix(stream): fix error in decode stream task. 2023-09-17 18:07:26 +08:00
Haojun Liao 01144c58a7 fix(stream): fix stream task id error. 2023-09-17 01:19:59 +08:00
Haojun Liao 5f55f489d8 fix(stream): fix memory leak. 2023-09-14 22:59:11 +08:00
Haojun Liao fce5be0eb4 fix(stream): fix dead lock. 2023-09-14 14:09:05 +08:00
Haojun Liao 9b70c0c457 fix:fix coverity issue and remove unnecessary files. 2023-09-14 09:06:10 +08:00
Haojun Liao 025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj
fix(tsdb): check the schema before merge rows in buffer
2023-09-12 11:43:27 +08:00
Haojun Liao f602aa965f fix(stream): fix coverity scan issues. 2023-09-12 09:16:18 +08:00
wangmm0220 842bb5742a fix:[TS-3922]rollback because cases failed & avoid atomic_store_64 core if parameters not aligned by 8 2023-09-07 19:26:33 +08:00
dmchen 231ba12f70 feat/TD-26127 2023-09-06 11:00:24 +08:00
Haojun Liao 77eed06bcd
Merge branch '3.0' into fix/3_liaohj 2023-09-04 18:51:07 +08:00
Haojun Liao aeea699c9c Merge branch '3.0' into fix/3_liaohj 2023-09-04 15:53:39 +08:00
Haojun Liao 21dab8ceab other: merge 3.0 2023-09-04 13:08:19 +08:00
Haojun Liao d73de8ba1e fix(stream): add null ptr check. 2023-09-02 16:44:21 +08:00
Haojun Liao 037a232bfa refactor: do some internal refactor. 2023-09-01 17:05:36 +08:00
dapan1121 cc17848b78 fix: merge 3.0 to main 2023-09-01 13:24:47 +08:00
Haojun Liao 3765fbbba2 fix(stream): fix memory leak. 2023-09-01 09:59:56 +08:00
Haojun Liao e8294ed8dc fix(stream): fix bug in multi-replica vnode redistribute. 2023-09-01 03:10:12 +08:00
Haojun Liao fecba5b097 fix(stream): check for meta 2023-08-31 20:54:02 +08:00
Haojun Liao 95da66e3e8 fix(stream): fix error. 2023-08-31 20:50:12 +08:00
dmchen 03de7ad5a6 stream name 2023-08-31 16:44:36 +08:00
yihaoDeng 05ca71d5de stream change ver 2023-08-31 09:28:43 +08:00
Haojun Liao c5b279f045 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-30 16:01:08 +08:00
Haojun Liao 24b1a050fc other: merge 3.0 2023-08-30 16:00:14 +08:00
liuyao 0a72e576bd op stream pause
pause data dispatch

opt stream pause
2023-08-30 14:53:49 +08:00
dmchen 1372cede48 init 2023-08-28 17:44:10 +08:00
dapan1121 778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
Fix/m23.0
2023-08-28 17:35:35 +08:00
dapan1121 1f40da6fef Merge remote-tracking branch 'origin/main' into 3.0 2023-08-28 09:28:55 +08:00
dmchen 06083e1eb9 init 2023-08-28 09:15:51 +08:00
Haojun Liao 7ceb8dc627 fix(stream): disable the follower to execute the stop/resume instruction. 2023-08-25 19:20:49 +08:00
liuyao 7d44b7e4cb mem leak 2023-08-25 14:53:29 +08:00
liuyao a72e6fd219 mem leak 2023-08-24 16:32:34 +08:00
Haojun Liao 809d3087ff Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
2023-08-23 17:53:50 +08:00
Haojun Liao 230d8c2d80 fix(stream): fix error in stream computing after vnode is transferred to other dnodes. 2023-08-23 17:50:44 +08:00
yihaoDeng 5b621fc0c5 fix mem leak 2023-08-23 16:32:32 +08:00
yihaoDeng faa4bbcaca fix mem leak 2023-08-23 14:26:45 +08:00
Haojun Liao 000e39aa18 fix(stream): add one more check. 2023-08-22 15:52:29 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
Haojun Liao fbd67ce977 fix(stream): fix memory leak. 2023-08-21 11:50:53 +08:00
Haojun Liao 99024e9d78 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-21 11:49:08 +08:00
Haojun Liao 29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
yihaoDeng d934d91fb1 refactor checkpoint 2023-08-21 10:34:08 +08:00
Haojun Liao 41fe441dad fix(stream): update the conflict scope. 2023-08-18 17:00:35 +08:00
Haojun Liao 2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
2023-08-18 10:30:30 +08:00
Haojun Liao 87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
yihaoDeng 80f6d092a1 add trace log 2023-08-18 08:43:37 +08:00
yihaoDeng ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng 46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
kailixu 242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
kailixu 8a84dce641 enh: disable udf/stream/rsma/tsma for windows 2023-08-15 16:04:30 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
kailixu 27db6cfd67 enh: disable udf/stream for mnd on windows 2023-08-15 14:25:31 +08:00
Haojun Liao 1f792f09c4 fix(stream): remove invalid code. 2023-08-14 10:39:47 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
Haojun Liao ba7825141f fix(stream): enable the checkpoint . 2023-08-11 13:33:14 +08:00
Haojun Liao 9322f80343 fix(stream): register the rsp callback. 2023-08-11 13:31:50 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
Haojun Liao a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao 76288f311f
Merge pull request #22311 from taosdata/fix/TD-25543
delete atomic_exchange_64
2023-08-07 10:34:50 +08:00
liuyao 944c1f68d2 delete atomic_exchange_64 2023-08-04 16:49:02 +08:00
yihaoDeng 56ed422f88 add stream ver 2023-08-04 14:09:00 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
yihaoDeng f7dc9497ef add stream verion 2023-08-03 20:28:34 +08:00
yihaoDeng 4aef18733f fix state mem leak 2023-08-02 03:16:24 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Haojun Liao e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Haojun Liao c016a58623 enh(stream): do some internal refactor. 2023-08-01 19:22:59 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
Haojun Liao cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
yihaoDeng 8ab545ac77 fillhistory task not trigger checkpoint 2023-07-18 01:16:48 +00:00
wangmm0220 da9e30434a fix:add sdbFetchCancel to release hash node 2023-07-17 20:21:23 +08:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
yihaoDeng dd4740e5a4 add checkpoint 2023-07-14 03:45:30 +00:00
yihaoDeng 44170b9b16 fix recover error 2023-07-14 10:36:27 +08:00
yihaoDeng e588640e02 fix recover error 2023-07-13 20:46:58 +08:00
yihaoDeng e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
yihaoDeng 4d838d3dff add checkpoint 2023-07-10 15:51:35 +08:00
yihaoDeng 2dc041929a add checkpoint 2023-07-07 10:13:31 +00:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
yihaoDeng 483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
liuyao bc5e709d31 set task status of ins_stream_tasks 2023-07-03 14:00:30 +08:00
liuyao 863da2ae05 set task status of ins_stream_tasks 2023-07-03 11:10:38 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
Benguang Zhao e8649670aa enh: not allow to split vgroup when streams or topics exist 2023-06-26 11:57:24 +08:00
Haojun Liao 000325f716 fix(stream): fix memory leak. 2023-06-25 19:30:21 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
yihaoDeng 8937192799 refactor checkpoint 2023-06-16 18:04:57 +08:00
yihaoDeng b0a3a8d619 refactor checkpoint 2023-06-16 17:28:50 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
yihaoDeng bd0168e562 trigger checkpoint 2023-06-14 21:43:47 +08:00
yihaoDeng 551cd7cdc8 trigger checkpoint 2023-06-14 21:14:00 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng 52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
yihaoDeng 83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Benguang Zhao 3689b41f3a Merge branch '3.0' into FIX/TD-24182-3.0 2023-06-12 09:39:49 +08:00
yihaoDeng a0c2897124 add trigger checkpoint 2023-06-09 10:46:03 +00:00
yihaoDeng 88d765c71a add trigger checkpoint 2023-06-07 14:32:56 +00:00
yihaoDeng 1f1f37312d add trigger checkpoint 2023-06-07 14:32:48 +00:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00