Commit Graph

921 Commits

Author SHA1 Message Date
yihaoDeng 2ec67bcc08 rm expire checkpoint 2023-07-13 10:00:16 +08:00
Haojun Liao 773ae39d33 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamCheckpoint.c
2023-07-13 09:17:51 +08:00
Haojun Liao 08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
yihaoDeng 82468f162a Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:43:56 +08:00
yihaoDeng e1de4984a6 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:39:19 +08:00
yihaoDeng bb72f07a94 rm expire checkpoint 2023-07-12 16:38:46 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
Haojun Liao a049e310f6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 10:16:26 +08:00
Haojun Liao 6f2fc4fab3 fix(stream): commit task meta after do vnode-wide checkpoint. 2023-07-12 10:16:14 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
yihaoDeng 503d7540f7 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-11 16:31:07 +08:00
yihaoDeng e547ed3699 rm expire checkpoint 2023-07-11 16:30:14 +08:00
Haojun Liao da6a4de021 fix(stream): disable invalid set normal task status. 2023-07-11 15:12:34 +08:00
Haojun Liao 09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
Haojun Liao 571cccd737 refactor: do some internal refactor. 2023-07-11 11:41:37 +08:00
Haojun Liao 62a763ead3 fix(stream): fix invalid assert. 2023-07-11 11:22:48 +08:00
Haojun Liao a803eaee3e fix(stream): fix concurrent bug in save task meta. 2023-07-11 10:01:43 +08:00
Haojun Liao a571663a5d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamExec.c
2023-07-11 09:53:41 +08:00
Haojun Liao cbda61c7f9 fix(stream): fix error in checkpointing. 2023-07-11 09:53:08 +08:00
yihaoDeng c056e34534 fix compile error 2023-07-11 09:39:58 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao a6cd702676 fix(stream): supress the warning 2023-07-11 08:54:11 +08:00
Haojun Liao 8a6a876f67 fix(stream): fix error in generating checkpoint. 2023-07-10 22:53:15 +08:00
Haojun Liao 87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao 385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
yihaoDeng e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Haojun Liao d6e7e6e174 fix(stream): fix typo. 2023-07-10 14:57:28 +08:00
Haojun Liao 16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao f6515e2a2c fix(stream): fix error in checkpointing. 2023-07-10 11:43:37 +08:00
Haojun Liao 5940bbfb33 fix(stream): set correct datablock. 2023-07-10 10:42:38 +08:00
Haojun Liao 9ad5e05751 fix(stream): fix error in checking status. 2023-07-10 10:24:04 +08:00
Haojun Liao e8eba3175a fix(stream): fix error in checking status. 2023-07-10 10:23:05 +08:00
Haojun Liao dd15ca6103 fix(stream): add missing status check. 2023-07-10 10:06:21 +08:00
Haojun Liao ed1181a1d1 fix(stream): fix invalid read bug. 2023-07-10 09:55:29 +08:00
Haojun Liao 4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao ab4e2ebc3a fix(stream): fix bug that causes the endless loop. 2023-07-07 21:45:22 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao b03ca31a7f fix(stream): fix error in generating checkpoint. 2023-07-07 17:21:46 +08:00
Haojun Liao 8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao 4f814db5d5 fix(stream): fix error during transferring executor state, while a task is not in normal status. 2023-07-06 18:34:01 +08:00
Haojun Liao 61f3585714 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-06 18:26:44 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
yihaoDeng 8e9ef2a384 fix mem leak 2023-07-06 09:01:34 +00:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng 483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao 7a417a33b0
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
2023-07-05 17:47:18 +08:00
Haojun Liao 1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 77530e1956 refactor: record the downstream input Queue blocking time. 2023-07-04 10:58:11 +08:00
yihaoDeng e7b37486bb vnode snapshot read 2023-07-04 00:46:39 +00:00
Haojun Liao 393b36d83d Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-07-03 17:53:18 +08:00
Haojun Liao 2dbccc1573 refactor: do some internal refactor. 2023-07-03 17:52:17 +08:00
Haojun Liao 42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
2023-07-03 17:37:56 +08:00
Haojun Liao 9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Haojun Liao ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao 5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao 317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
yihaoDeng 247d3ac7ee vnode snapshot read 2023-06-30 12:05:05 +00:00
yihaoDeng 7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
yihaoDeng bb520b56e7 add checkpoint 2023-06-28 09:58:07 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao 78739e4bdb fix(stream): fix syntax error. 2023-06-28 14:21:11 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
yihaoDeng 2c1fc501ff add checkpoint 2023-06-26 12:28:42 +00:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao 6b8549dea5 set table name 2023-06-26 14:14:46 +08:00
yihaoDeng 9b451bc56a add checkpoint 2023-06-25 20:14:07 +08:00
yihaoDeng 52f588955b add checkpoint 2023-06-25 20:05:42 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
yihaoDeng 74a4a89d70 add checkpoint 2023-06-25 17:59:36 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
yihaoDeng 832aed5e98 add checkpoint 2023-06-25 17:10:59 +08:00
yihaoDeng 0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
yihaoDeng e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00