Commit Graph

1674 Commits

Author SHA1 Message Date
Haojun Liao 29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
yihaoDeng 9ef69dd455 refactor checkpoint 2023-08-21 10:27:47 +08:00
yihaoDeng 1c5346b13c refactor checkpoint 2023-08-19 16:10:03 +08:00
yihaoDeng 52788aca1c fix checkpoint error 2023-08-19 12:25:22 +08:00
yihaoDeng fbdea723b0 fix checkpoint error 2023-08-19 11:58:12 +08:00
Haojun Liao 718bb4a881 fix(stream): fix the invalid free. 2023-08-18 22:40:04 +08:00
yihaoDeng 8e4411c144 fix checkpoint error 2023-08-18 21:42:35 +08:00
Haojun Liao 4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
yihaoDeng 3a3385bb84 fix mem leak 2023-08-18 17:01:57 +08:00
yihaoDeng 0537323bac fix get error 2023-08-18 16:54:33 +08:00
Haojun Liao c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2 2023-08-18 15:51:07 +08:00
liuyao 9afd5155ed Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-18 15:33:37 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
Haojun Liao 10872240ae
Merge pull request #22476 from taosdata/fix/3_liaohj
fix(stream): pause when outputQ is blocked.
2023-08-18 15:12:54 +08:00
Haojun Liao 3ec28ca5e1 Merge branch 'enh/triggerCheckPoint2' of github.com:taosdata/tdengine into enh/triggerCheckPoint2 2023-08-18 15:11:19 +08:00
Haojun Liao edbad45772 other: add logs. 2023-08-18 13:45:08 +08:00
yihaoDeng ac10f0f9b4 add trace log 2023-08-18 12:06:41 +08:00
Haojun Liao a8b53c2e69 other: add logs. 2023-08-18 10:51:59 +08:00
Haojun Liao 2a9668da67 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/dnode/mnode/impl/src/mndStream.c
2023-08-18 10:30:30 +08:00
Haojun Liao 87785b1d9c refactor: add some logs. 2023-08-18 10:30:00 +08:00
yihaoDeng 002d5979c1 add trace log 2023-08-17 21:13:03 +08:00
yihaoDeng ebd4cac36b Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-08-17 18:58:18 +08:00
yihaoDeng 46574c385f fix mem leak 2023-08-17 18:52:33 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
Haojun Liao 9e9d83d4a1 refactor: do some internal refactor 2023-08-17 11:57:04 +08:00
Haojun Liao bb4f8515bd fix(stream): pause when outputQ is blocked. 2023-08-17 11:53:17 +08:00
Haojun Liao 58c0a3d8ef fix(stream): fix syntax error. 2023-08-17 09:13:37 +08:00
Haojun Liao eb76b6f175 fix(stream): fix syntax error. 2023-08-17 09:11:32 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
yihaoDeng 114df7c349 fix transfer error 2023-08-16 11:37:15 +00:00
Haojun Liao 59d5858b95 fix(stream): fix a typo 2023-08-16 19:22:45 +08:00
Haojun Liao 9a76ae72d6 fix(stream): add the back pressure for sink node. 2023-08-16 19:11:43 +08:00
Haojun Liao ec84d7fd81 fix(stream): add the back pressure for sink node. 2023-08-16 19:00:35 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
Haojun Liao d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
yihaoDeng 993ae84398 close backend 2023-08-16 07:17:15 +00:00
yihaoDeng 7815e44655 fix invalid free 2023-08-16 09:48:11 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
Haojun Liao 7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
yihaoDeng 7fd918962f fix invalid free 2023-08-16 00:53:10 +00:00
Haojun Liao 9551fcf7bb fix(tsdb): check the 2023-08-15 20:57:12 +08:00
Haojun Liao 13640f5f53 other 2023-08-15 20:46:06 +08:00
Haojun Liao 6d7b6fbb74 other: add some logs. 2023-08-15 20:01:53 +08:00
liuyao 19dfcf3a59 refactor stream scan log 2023-08-15 16:29:48 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Haojun Liao 71c3c710e6 fix(stream): continue process when met with trans-state msg. 2023-08-15 14:23:20 +08:00
Haojun Liao 0acb00c516 fix(stream): add log. 2023-08-15 11:48:56 +08:00
Haojun Liao c9f3e0b0e1 fix(stream): fix an syntax error. 2023-08-15 09:34:19 +08:00
Haojun Liao fe5e48b87d fix(stream): remove redundant include. 2023-08-15 09:26:35 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao a334547726 fix(stream): fix an syntax error. 2023-08-14 19:28:36 +08:00
Haojun Liao 1a08ffc79f fix(stream): check error. 2023-08-14 19:27:09 +08:00
Haojun Liao 5d3232d275 fix(stream): fix an syntax error. 2023-08-14 18:14:32 +08:00
Haojun Liao 2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
Haojun Liao a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Haojun Liao 91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
Haojun Liao 2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
Haojun Liao 98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
Haojun Liao a81cc9aebf fix(stream): fix the error when no agg tasks exist. 2023-08-13 17:31:09 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao 0e189f70a1 refactor 2023-08-12 19:44:44 +08:00
Haojun Liao 03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 075b5e9481 refactor: do some internal refactor. 2023-08-12 18:41:54 +08:00
Haojun Liao a0534ee715 refactor: do some internal refactor. 2023-08-12 18:40:09 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao 30c2a9c619 refactor: do some internal refactor. 2023-08-12 18:27:51 +08:00
Haojun Liao 0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
Haojun Liao 87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
Haojun Liao 4afe603c6e fix(stream): fix error. 2023-08-11 14:17:09 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
yihaoDeng 32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
Haojun Liao 8890fa5781 fix(stream): execute the stream task directly, instead of executing it in a asynchronized way. 2023-08-10 15:13:49 +08:00
yihaoDeng b2fb94d7f8 Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:25 +08:00
yihaoDeng ea00f676fc Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:12 +08:00
yihaoDeng 100d2240c3 support reopen stream state 2023-08-10 06:35:25 +00:00
Haojun Liao a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao 4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao 0cf8144952 fix(stream): fix the invalid key used by remove data in stream meta hash table. 2023-08-09 22:28:23 +08:00
yihaoDeng a20b299f9b support reopen stream state 2023-08-09 13:06:10 +00:00
yihaoDeng 19ac9054d0 support reopen stream state 2023-08-09 12:47:49 +00:00
Haojun Liao d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
yihaoDeng 1db15da4e1 support reopen stream state 2023-08-09 09:50:49 +00:00
yihaoDeng 6fdcd82a33 support reopen stream state 2023-08-09 09:19:03 +00:00
yihaoDeng f3cf907d5a support reopen stream state 2023-08-09 09:07:13 +00:00
yihaoDeng a336a7b1a4 support reopen stream state 2023-08-09 09:06:22 +00:00
yihaoDeng a619b8f5be rm duplicate para 2023-08-09 08:58:49 +00:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
yihaoDeng 92b247aae8 support reopen stream state 2023-08-09 07:36:00 +00:00
yihaoDeng bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng c43a6b272c support reopen stream state 2023-08-09 02:09:50 +00:00
yihaoDeng ac11537fc8 support reopen stream state 2023-08-08 07:21:47 +00:00
Haojun Liao 17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Haojun Liao a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
Haojun Liao db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao 327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao d6d63ec54c fix(stream): add more check. 2023-08-08 09:54:49 +08:00
Haojun Liao e89d3c18d6 fix(stream): remove invalid check. 2023-08-08 09:54:46 +08:00
Haojun Liao ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao 0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
Haojun Liao 1e680d4df1 fix(stream): ignore the sink task transfer state. 2023-08-08 09:52:19 +08:00
Haojun Liao 3bcc7ed83e fix(stream): transfer the state for agg tasks. 2023-08-08 09:52:04 +08:00
Haojun Liao d43cb3fcdf fix(stream): kill task when pause the stream execution. 2023-08-08 09:51:21 +08:00
Haojun Liao ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao 82ab81810b refactor: do some internal refactor. 2023-08-08 09:40:21 +08:00
Haojun Liao 51e0b903b0 refactor: do some internal refactor. 2023-08-08 09:36:42 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj
other: merge main and fix bugs in stop stream tasks.
2023-08-07 22:57:13 +08:00
Haojun Liao 85756e4404
Merge pull request #22353 from taosdata/fix/liaohj
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
2023-08-07 22:57:08 +08:00
yihaoDeng 6b73fc9c06 support reopen stream state 2023-08-07 13:56:53 +00:00
yihaoDeng 80e78e054d support reopen stream state 2023-08-07 11:39:32 +00:00
Haojun Liao 2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
yihaoDeng 6a69c56b32 support reopen stream state 2023-08-07 10:55:42 +00:00
yihaoDeng 6c8c575549 support reopen stream state 2023-08-07 10:48:04 +00:00
Haojun Liao aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
yihaoDeng 7ef4df8752 support reopen stream state 2023-08-07 07:20:05 +00:00
Haojun Liao 7924d7e0af
Merge pull request #22337 from taosdata/fix/fixInvalidFree
fix invalid free
2023-08-07 11:45:29 +08:00
Haojun Liao a8006d3d0d
Merge pull request #22278 from taosdata/fix/fixStateMemleak
fix state mem leak
2023-08-07 11:45:16 +08:00
yihaoDeng 4ca39d0f3c support reopen stream state 2023-08-07 01:45:16 +00:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng 7396799d90 fix invalid free 2023-08-04 19:06:16 +08:00
yihaoDeng 36e841b6d0 fix invalid free 2023-08-04 18:59:17 +08:00
Hui Li f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer
add stream verion
2023-08-04 17:36:21 +08:00
yihaoDeng a4da6e9a88 fix mem leak 2023-08-04 15:59:34 +08:00
yihaoDeng 81908be32f add stream ver 2023-08-04 14:02:03 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
liuyao 9cb481dd6e use stream task 2023-08-04 11:01:36 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
liuyao 3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
yihaoDeng 918eca4d22 fix state mem leak 2023-08-02 03:31:11 +00:00
yihaoDeng 6cdf94fec0 fix state mem leak 2023-08-02 03:29:13 +00:00
yihaoDeng d9fd95777a fix state mem leak 2023-08-02 03:21:39 +00:00
yihaoDeng 83468a7710 fix state mem leak 2023-08-02 03:18:59 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
liuyao 71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
yihaoDeng 111481cef9 fix state mem leak 2023-08-01 08:09:10 +00:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
Haojun Liao f1e0e64918 fix(stream): add more check. 2023-08-01 14:31:41 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao e11cda17c0 fix(stream): remove invalid check. 2023-08-01 10:30:24 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao b83860372c fix(stream): dump results to sink node before paused. 2023-08-01 00:50:30 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao 8c1c17e31e fix(stream): ignore the sink task transfer state. 2023-07-31 19:23:53 +08:00
Haojun Liao d72580dad7 fix(stream): transfer the state for agg tasks. 2023-07-31 19:12:23 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
Haojun Liao cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao 0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
Haojun Liao 6c9fa4d7c8 fix(stream): check for pause when handling the fill history data. 2023-07-28 19:58:52 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao 6319cb8dd4 fix: fix syntax error. 2023-07-27 17:16:45 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
yihaoDeng 287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
liuyao c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
Haojun Liao 12986ff594 fix(stream): fix memory leaks. 2023-07-26 09:25:30 +08:00
yihaoDeng 22c85fcbad fix stream state transfer 2023-07-25 13:07:49 +00:00
yihaoDeng 0c2e86f416 fix stream state transfer 2023-07-25 10:17:30 +00:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 063673726a fix(stream): fix syntax error 2023-07-25 18:08:22 +08:00
Haojun Liao 2cc4e0a727 fix(stream): fix syntax error 2023-07-25 17:56:40 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
Haojun Liao f3f1fade43 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-25 09:25:32 +08:00
Haojun Liao c116b69941 fix(stream): fix memory leak. 2023-07-25 09:25:18 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
yihaoDeng fe262d308e del wal 2023-07-24 11:10:15 +00:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
yihaoDeng 6a27e81964 fix stream state transfer 2023-07-24 02:05:14 +00:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 9679cc4527 fix(stream): fix race condition. 2023-07-22 10:19:51 +08:00
Haojun Liao f4864b8713 fix(stream): fix memory leak. 2023-07-22 01:02:58 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao 0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng 82df77eba8 fix stream state transfer 2023-07-20 11:52:31 +00:00
yihaoDeng fc2d6744e2 fix stream state transfer 2023-07-20 10:52:34 +00:00
yihaoDeng 519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
yihaoDeng 733db123ad refactor code 2023-07-19 13:24:59 +00:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Haojun Liao 5b29a5ec97 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 18:30:10 +08:00
Haojun Liao 902f9d1f94 fix(stream): set not-ready initial value. 2023-07-18 18:29:35 +08:00
yihaoDeng 039befa3d6 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 10:15:20 +00:00
yihaoDeng 790101ced2 fix mem leak 2023-07-18 10:14:04 +00:00
Haojun Liao d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
yihaoDeng 95b8754dab Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 04:03:56 +00:00
yihaoDeng 40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Haojun Liao 92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Haojun Liao 2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
yihaoDeng 40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
Haojun Liao 14b9d920ba fix(stream): fix memory leak. 2023-07-17 16:02:41 +08:00
Haojun Liao 08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
yihaoDeng 394cc771e5 add checkpoint 2023-07-17 06:47:23 +00:00
yihaoDeng f0f2215f49 add checkpoint 2023-07-17 06:21:45 +00:00
yihaoDeng 3168096e40 add checkpoint 2023-07-17 06:06:21 +00:00
yihaoDeng e0bb3c8f94 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 05:26:57 +00:00
yihaoDeng f7732ddd18 recoverSnapshot 2023-07-17 05:26:30 +00:00
Haojun Liao 4dd93494d1 fix(stream): fix syntax error 2023-07-17 13:23:06 +08:00
Haojun Liao d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
yihaoDeng 5adf580764 add checkpoint 2023-07-17 03:44:06 +00:00
Haojun Liao 8c8b1a6d79 fix(stream): handle block before checkpoint msg in the inputQ. 2023-07-17 10:47:05 +08:00
yihaoDeng dea2e73d2e add checkpoint 2023-07-17 02:22:21 +00:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng b4de0892e6 add checkpoint 2023-07-15 09:35:33 +00:00
yihaoDeng 7b4185dc56 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-15 04:27:39 +00:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng aad669e33c add checkpoint 2023-07-14 14:46:13 +00:00
Haojun Liao 725db16af9 fix(stream): set save checkpoint ver. 2023-07-14 19:47:19 +08:00
Haojun Liao 035b199497 refactor(stream): do some internal refactor. 2023-07-14 18:46:38 +08:00
Haojun Liao 6798e31bb5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 18:35:53 +08:00
Haojun Liao 8c79157822 fix(stream): close the inputQ if checkpoint msg received. 2023-07-14 18:35:41 +08:00
yihaoDeng 3020e27114 fix mem leak 2023-07-14 10:20:37 +00:00
yihaoDeng ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao 2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
yihaoDeng be050e12ea fix recover error 2023-07-14 15:46:00 +08:00
yihaoDeng d0ccbd48d2 fix coverity scan problem 2023-07-14 14:54:20 +08:00
yihaoDeng 49b21b3ccb fix coverity scan problem 2023-07-14 14:53:11 +08:00
yihaoDeng 2279706357 fix coverity scan problem 2023-07-14 14:49:02 +08:00
yihaoDeng 15f5fd19eb fix recover error 2023-07-14 14:47:06 +08:00
yihaoDeng e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
liuyao c3375dd744 mem leak 2023-07-13 19:24:11 +08:00
Haojun Liao e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
other: merge main
2023-07-13 17:55:28 +08:00
Haojun Liao 2fd72500e2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 16:32:37 +08:00
Haojun Liao 813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
liuyao ec2134f758 op ci 2023-07-13 16:24:38 +08:00
yihaoDeng 9e128b92f8 fix recover error 2023-07-13 16:17:18 +08:00
yihaoDeng 1307776786 fix recover error 2023-07-13 16:09:34 +08:00
yihaoDeng 9434b4eaac fix recover error 2023-07-13 16:07:58 +08:00
yihaoDeng 18f9882834 fix recover error 2023-07-13 16:06:23 +08:00
Haojun Liao 66d577d134 fix(stream): abort exec when task is dropped. 2023-07-13 15:04:39 +08:00
yihaoDeng b7403cd171 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-13 10:38:34 +08:00
yihaoDeng 0e1a91d134 fix compile error 2023-07-13 10:38:21 +08:00
Haojun Liao af7f78ada2 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-13 10:17:10 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
yihaoDeng f3f3893872 fix compile error 2023-07-13 10:05:29 +08:00
yihaoDeng 2ec67bcc08 rm expire checkpoint 2023-07-13 10:00:16 +08:00
Haojun Liao 773ae39d33 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamCheckpoint.c
2023-07-13 09:17:51 +08:00
Haojun Liao 08a4fb06ae fix(stream): dispatch checkpoint msg to downstream by puting message into input queue. 2023-07-13 09:17:20 +08:00
yihaoDeng 82468f162a Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:43:56 +08:00
yihaoDeng e1de4984a6 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-12 16:39:19 +08:00
yihaoDeng bb72f07a94 rm expire checkpoint 2023-07-12 16:38:46 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
Haojun Liao 9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-12 10:20:18 +08:00
Haojun Liao a049e310f6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 10:16:26 +08:00
Haojun Liao 6f2fc4fab3 fix(stream): commit task meta after do vnode-wide checkpoint. 2023-07-12 10:16:14 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
yihaoDeng 503d7540f7 Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2 2023-07-11 16:31:07 +08:00
yihaoDeng e547ed3699 rm expire checkpoint 2023-07-11 16:30:14 +08:00
Haojun Liao da6a4de021 fix(stream): disable invalid set normal task status. 2023-07-11 15:12:34 +08:00
Haojun Liao 09b764494d fix(stream): set correct checkpoint version when starting stream tasks. 2023-07-11 14:03:43 +08:00
Haojun Liao 571cccd737 refactor: do some internal refactor. 2023-07-11 11:41:37 +08:00
Haojun Liao 62a763ead3 fix(stream): fix invalid assert. 2023-07-11 11:22:48 +08:00
Haojun Liao a803eaee3e fix(stream): fix concurrent bug in save task meta. 2023-07-11 10:01:43 +08:00
Haojun Liao a571663a5d Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamExec.c
2023-07-11 09:53:41 +08:00
Haojun Liao cbda61c7f9 fix(stream): fix error in checkpointing. 2023-07-11 09:53:08 +08:00
yihaoDeng c056e34534 fix compile error 2023-07-11 09:39:58 +08:00
Haojun Liao 3ffdbe923d other: merge 3.0 2023-07-11 09:12:57 +08:00
Haojun Liao a6cd702676 fix(stream): supress the warning 2023-07-11 08:54:11 +08:00
Haojun Liao 8a6a876f67 fix(stream): fix error in generating checkpoint. 2023-07-10 22:53:15 +08:00
Haojun Liao 87bedef2cd fix(stream): fix error in checkpointing. 2023-07-10 19:20:05 +08:00
Haojun Liao ab5b2fe0a8 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-10 18:21:02 +08:00
Haojun Liao 385a5c9651 fix(stream): fix error in generating checkpoint. 2023-07-10 18:20:50 +08:00
yihaoDeng e263d5f55f add checkpoint 2023-07-10 17:33:48 +08:00
Haojun Liao d6e7e6e174 fix(stream): fix typo. 2023-07-10 14:57:28 +08:00
Haojun Liao 16ee72ab06 fix(stream): free msg after send checkpoint rsp. 2023-07-10 13:57:51 +08:00
Haojun Liao f6515e2a2c fix(stream): fix error in checkpointing. 2023-07-10 11:43:37 +08:00
Haojun Liao 5940bbfb33 fix(stream): set correct datablock. 2023-07-10 10:42:38 +08:00
Haojun Liao 9ad5e05751 fix(stream): fix error in checking status. 2023-07-10 10:24:04 +08:00
Haojun Liao e8eba3175a fix(stream): fix error in checking status. 2023-07-10 10:23:05 +08:00
Haojun Liao dd15ca6103 fix(stream): add missing status check. 2023-07-10 10:06:21 +08:00
Haojun Liao ed1181a1d1 fix(stream): fix invalid read bug. 2023-07-10 09:55:29 +08:00
Haojun Liao 4f534ce6e9 fix(stream): fix error in generating checkpoint. 2023-07-08 10:29:09 +08:00
Haojun Liao a5c19427e7 fix(stream): send correct rsp to mnode. 2023-07-08 09:39:44 +08:00
Haojun Liao ab4e2ebc3a fix(stream): fix bug that causes the endless loop. 2023-07-07 21:45:22 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao b03ca31a7f fix(stream): fix error in generating checkpoint. 2023-07-07 17:21:46 +08:00
Haojun Liao 8298f30e56 fix(stream): fix bug in checkpoint. 2023-07-07 17:16:08 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao 4f814db5d5 fix(stream): fix error during transferring executor state, while a task is not in normal status. 2023-07-06 18:34:01 +08:00
Haojun Liao 61f3585714 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-06 18:26:44 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
yihaoDeng 8e9ef2a384 fix mem leak 2023-07-06 09:01:34 +00:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng 483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao 7a417a33b0
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
2023-07-05 17:47:18 +08:00
Haojun Liao 1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 77530e1956 refactor: record the downstream input Queue blocking time. 2023-07-04 10:58:11 +08:00
yihaoDeng e7b37486bb vnode snapshot read 2023-07-04 00:46:39 +00:00
Haojun Liao 393b36d83d Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-07-03 17:53:18 +08:00
Haojun Liao 2dbccc1573 refactor: do some internal refactor. 2023-07-03 17:52:17 +08:00
Haojun Liao 42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
2023-07-03 17:37:56 +08:00
Haojun Liao 9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Haojun Liao ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao 5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao 317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
yihaoDeng 247d3ac7ee vnode snapshot read 2023-06-30 12:05:05 +00:00
yihaoDeng 7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
yihaoDeng bb520b56e7 add checkpoint 2023-06-28 09:58:07 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao 78739e4bdb fix(stream): fix syntax error. 2023-06-28 14:21:11 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
yihaoDeng 2c1fc501ff add checkpoint 2023-06-26 12:28:42 +00:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao 6b8549dea5 set table name 2023-06-26 14:14:46 +08:00
yihaoDeng 9b451bc56a add checkpoint 2023-06-25 20:14:07 +08:00
yihaoDeng 52f588955b add checkpoint 2023-06-25 20:05:42 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
yihaoDeng 74a4a89d70 add checkpoint 2023-06-25 17:59:36 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
yihaoDeng 832aed5e98 add checkpoint 2023-06-25 17:10:59 +08:00
yihaoDeng 0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
yihaoDeng e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00
Haojun Liao 0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
yihaoDeng c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
yihaoDeng 2f656f3854 add checkpoint 2023-06-21 18:04:10 +08:00
yihaoDeng ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
yihaoDeng e5c62cfa06 add static lib 2023-06-21 12:10:42 +08:00
liuyao d23c80b12f free mem 2023-06-21 10:24:34 +08:00
yihaoDeng daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
yihaoDeng d9e24566c0 add checkpoint 2023-06-20 18:32:56 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
yihaoDeng b6d4e98e68 fix restart crash 2023-06-20 13:47:46 +08:00
yihaoDeng f1fcc1d2f1 add checkpoint 2023-06-20 11:44:51 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
yihaoDeng 5ccfae87d9 add checkpoint 2023-06-19 20:49:04 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng 0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
yihaoDeng 1e05f5c693 support fill history 2023-06-16 10:00:16 +08:00
yihaoDeng f4b9d630c0 support fill history 2023-06-16 09:36:44 +08:00
yihaoDeng 0ef8afbdaa support fill history 2023-06-16 09:32:38 +08:00
yihaoDeng 8cb8c05428 support fill history 2023-06-15 21:55:46 +08:00
yihaoDeng 9f9171719a support fill history 2023-06-15 21:29:52 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng 52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao 11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao 5282492663 refactor: do some internal refactor. 2023-06-14 10:35:03 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng 83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
yihaoDeng ae7d5c79e5 fix invald read/write 2023-06-12 02:24:49 +00:00
yihaoDeng a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
yihaoDeng a0c2897124 add trigger checkpoint 2023-06-09 10:46:03 +00:00
yihaoDeng d38e3835c0 opt batch write 2023-06-09 08:12:39 +00:00
yihaoDeng 06b65ce5c1 opt batch write 2023-06-09 07:49:43 +00:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
yihaoDeng a67ef8ce91 opt batch write 2023-06-09 01:27:08 +00:00
yihaoDeng d5c0ca3163 opt batch write 2023-06-08 13:36:52 +00:00
Haojun Liao 0fd11aaefe other: add some logs. 2023-06-08 19:14:36 +08:00
Haojun Liao c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao 6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
yihaoDeng 9828ca9d7f add trigger checkpoint 2023-06-08 09:28:34 +00:00
Haojun Liao 6c13491428 refactor: do some internal refactor. 2023-06-08 16:55:41 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
yihaoDeng 8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
Haojun Liao 30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
fix/td-24600-dv3
2023-06-08 13:42:02 +08:00
yihaoDeng 9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Haojun Liao cb26dd9fa2 refactor(stream): do some internal refactor. 2023-06-08 10:17:21 +08:00
yihaoDeng 79b628101c add trigger checkpoint 2023-06-07 14:32:22 +00:00
Haojun Liao 9abe47ff93
Merge pull request #21638 from taosdata/enh/changeLinkOpt
change link opt
2023-06-07 19:07:06 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng 4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
Haojun Liao 7bf07b78b2 fix(client): remove dependency 2023-06-07 11:36:01 +08:00
liuyao 1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
yihaoDeng 66f483e51a fix invalid free 2023-06-06 02:32:06 +00:00
yihaoDeng c6242fee01 fix invalid free 2023-06-05 10:54:02 +00:00
yihaoDeng cb024ca069 fix invalid free 2023-06-05 10:52:07 +00:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
yihaoDeng 63c4929089 fix invalid free 2023-06-05 08:42:00 +00:00
Haojun Liao e8549ce511 refactor: do some internal refactor. 2023-06-05 16:19:37 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
yihaoDeng c77f7f65d2 fix invalid free 2023-06-05 07:32:28 +00:00
yihaoDeng 3108ecf84b fix invalid free 2023-06-05 06:38:17 +00:00
yihaoDeng 74d5f02969 fix invalid free 2023-06-05 04:56:07 +00:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515
reset unclosed window info
2023-06-03 11:21:06 +08:00
yihaoDeng 9e0392ff59 fix mem leak 2023-06-03 09:17:05 +08:00
yihaoDeng 7244ab1f6b fix mem leak 2023-06-03 08:28:21 +08:00
yihaoDeng 81fe174aa2 fix mem leak 2023-06-03 08:19:59 +08:00
yihaoDeng 5063c175f4 fix mem problem 2023-06-02 23:47:14 +08:00
yihaoDeng 3ec700e0f7 fix mem problem 2023-06-02 22:25:38 +08:00
yihaoDeng e48e485b6c update default buffer 2023-06-02 11:56:24 +00:00
yihaoDeng 6ee68331b3 update DEFAULT_BUFF 2023-06-02 11:54:36 +00:00
Haojun Liao cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao 17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
yihaoDeng 449051cda6 avoid mem leak 2023-06-02 10:05:32 +00:00
wangmm0220 56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220 b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Haojun Liao 6a9c03309e
Merge pull request #21553 from taosdata/enh/changeRocksParam
change log level
2023-06-02 14:23:50 +08:00
Haojun Liao cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
yihaoDeng 63d9a5dcf3 avoid mem leak 2023-06-02 04:08:08 +00:00
Haojun Liao 27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
yihaoDeng becc5c51a4 fix compatibility 2023-06-02 02:35:15 +00:00
yihaoDeng 420ae73728 Avoid creating the same ID task multiple times 2023-06-02 00:35:45 +00:00
yihaoDeng 1571ea844a Avoid creating the same ID task multiple times 2023-06-01 11:25:55 +00:00
yihaoDeng 0315e89591 Avoid creating the same ID task multiple times 2023-06-01 11:13:01 +00:00
yihaoDeng 64edab6302 refactor code 2023-06-01 07:51:52 +00:00
Haojun Liao 91de00597d refactor: do some internal refactor. 2023-05-31 22:12:14 +08:00
Haojun Liao 46f731e4d9
Merge pull request #21551 from taosdata/fix/resume_mem
fix(query): check the version range when dump partial rows. #TD-24504
2023-05-31 21:51:07 +08:00
Haojun Liao ccc86f9916 refactor: do some internal refactor. 2023-05-31 19:36:34 +08:00
Haojun Liao 87deb36f8a refactor: do some internal refactor. 2023-05-31 19:36:02 +08:00
yihaoDeng 04f3784696 change log level 2023-05-31 11:05:03 +00:00
Haojun Liao a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
Haojun Liao 65b81a803f refactor: do some internal refactor and add some logs. 2023-05-31 18:05:53 +08:00
Haojun Liao 8c240cede9
Merge pull request #21545 from taosdata/enh/changeRocksParam
Enh/change rocks param
2023-05-31 13:51:32 +08:00
Haojun Liao dd9f810f81
Merge pull request #21530 from taosdata/fix/TD-24365
fix sliding window issue
2023-05-31 13:51:14 +08:00
yihaoDeng 3b0a6d7f0b change db param 2023-05-31 03:15:25 +00:00
yihaoDeng 67becbd4d1 change db param 2023-05-31 01:10:36 +00:00
Haojun Liao fc20ca8423 fix(stream): set the correct rps flag as the dispatch rsp. 2023-05-30 18:42:23 +08:00
Haojun Liao d9cc9f2157 fix(stream): remove invalid free. 2023-05-30 18:03:21 +08:00
Haojun Liao 937f67f07b fix(stream): fix invalid free. 2023-05-30 18:02:42 +08:00
Haojun Liao e96ed81ec0 fix(stream): add input queue capacity check. 2023-05-30 17:29:01 +08:00
Haojun Liao eda06081ff enh(stream): refactor and serialize the attributes of history tasks. 2023-05-30 16:55:37 +08:00
Haojun Liao d9c364d663 Merge branch '3.0' into refact/fillhistory 2023-05-30 15:51:12 +08:00
Haojun Liao de7231e59e fix(stream): fix memory leak in handling dispatch msg when output buffer is full. 2023-05-30 15:35:59 +08:00
liuyao 7d699ae579 fix sliding window issue 2023-05-30 15:16:11 +08:00
Haojun Liao 2977a4d07f refactor: do some internal refactor. 2023-05-30 09:41:19 +08:00
Haojun Liao 20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError
change parameter
2023-05-30 09:36:36 +08:00
yihaoDeng e00f79367d merge 3.0 2023-05-29 18:57:21 +08:00
Haojun Liao 3628888ecc refactor: do some internal refactor. 2023-05-29 18:02:45 +08:00
Haojun Liao cd2d225c93 refactor: do some internal refactor. 2023-05-29 17:50:39 +08:00
yihaoDeng 1782ecd57e Merge branch 'fix/shared_link_rocksdb' into enh/addCompileError 2023-05-29 08:20:11 +00:00
Haojun Liao f2887278e2 refactor: do some internal refactor. 2023-05-29 15:44:45 +08:00
yihaoDeng 26cbcf996c Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 07:31:14 +00:00
yihaoDeng 342ce14c7d Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:37:47 +00:00
yihaoDeng 58cc631c22 Merge branch 'enh/3.0' into fix/shared_link_rocksdb 2023-05-29 02:29:56 +00:00
yihaoDeng 0be1858b4b Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:50:43 +00:00
yihaoDeng de739ce086 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-29 01:11:13 +00:00
yihaoDeng 2f5fe2dec6 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 14:01:05 +00:00
yihaoDeng 4b931d3007 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:59:16 +00:00
yihaoDeng a71bffd719 Merge branch 'enh/dev3.0' into enh/addCompileError 2023-05-26 13:03:35 +00:00
yihaoDeng 57a4e56a61 change parameter 2023-05-26 20:30:03 +08:00
yihaoDeng 34d21bc03f change parameter 2023-05-26 20:11:33 +08:00
liuyao 5ebe75599e fix pause issue 2023-05-26 14:58:39 +08:00
Haojun Liao 1e845acabe fix(tmq): allow seek before get assignment 2023-05-26 11:34:12 +08:00
yihaoDeng 52c384c7c9 change parameter 2023-05-26 09:06:19 +08:00
Haojun Liao cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
refactor: remove the module dependency.  TD-24279
2023-05-26 09:01:45 +08:00
Haojun Liao 30de31e374 fix(test): fix unit test link error. 2023-05-25 18:17:09 +08:00
yihaoDeng cd44bd9f3f change parameter 2023-05-25 18:16:33 +08:00
yihaoDeng 9cb4a114e2 change parameter 2023-05-25 16:20:00 +08:00
yihaoDeng 2f90fda13d change parameter 2023-05-25 16:15:10 +08:00