Commit Graph

16068 Commits

Author SHA1 Message Date
Haojun Liao c68c0eda79 fix(stream): fix bugs caused by refactor sm. 2023-10-20 16:27:39 +08:00
Haojun Liao 4feebffb05 refactor: add ref in log. 2023-10-20 15:59:43 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Haojun Liao d75948160d Merge branch 'main' into refact/streamsm 2023-10-20 11:10:19 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 4d5d078fbe fix(stream): fix bugs caused by refactor. 2023-10-19 18:00:54 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
Haojun Liao 402aefd95d refactor(stream): do some internal refactor. 2023-10-19 15:09:47 +08:00
slzhou 24436c8502 fix: tag scan support limit and remove slimit optimization 2023-10-19 11:40:10 +08:00
Haojun Liao f4caeca24a refactor(stream): add state machine to manage the state of stream tasks. 2023-10-19 10:34:20 +08:00
Haojun Liao 54ec679b58 refactor(stream): do some internal refactor. 2023-10-18 15:34:53 +08:00
Haojun Liao 2904cfd4d5 Merge branch 'main' into refact/streamsm 2023-10-18 10:29:09 +08:00
Haojun Liao 5115a1ac88
Merge pull request #23304 from taosdata/fix/TD-26771
double free
2023-10-18 10:09:17 +08:00
Haojun Liao df07443379
Merge pull request #23288 from taosdata/fix/liaohj
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
liuyao afa44732e2 Merge branch 'main' of https://github.com/taosdata/TDengine into main 2023-10-17 14:49:30 +08:00
liuyao 5e0f9cb908 double free 2023-10-17 14:32:09 +08:00
Haojun Liao 64ed7e49a2 enh(stream): sm for stream tasks. 2023-10-17 13:47:55 +08:00
Haojun Liao 7b7ce10475 refactor(stream): do some internal refactor. 2023-10-17 11:23:04 +08:00
Haojun Liao 14035c763c refactor: do some internal refactor. 2023-10-17 09:57:13 +08:00
Haojun Liao fdb6ec1fa3 enh(stream): add parameter to limit the stream sink task. 2023-10-16 22:52:39 +08:00
liuyao 990d36654d release buff 2023-10-16 19:49:45 +08:00
Haojun Liao a1aa2c9e0c fix(stream):add more check for test cases. 2023-10-16 18:47:01 +08:00
Haojun Liao 582bedd4bb
Merge pull request #23277 from taosdata/fix/TD-26722
set fill history range
2023-10-16 17:38:49 +08:00
liuyao 4ba45abd01 set fill history range 2023-10-16 13:53:54 +08:00
Haojun Liao 67bee17e5e other: merge main. 2023-10-16 09:55:41 +08:00
Haojun Liao f90cf54714 fix(stream): fix error in creating update node trans. 2023-10-15 21:56:49 +08:00
Haojun Liao 6611f216ac enh(stream): add some logs. 2023-10-13 19:45:29 +08:00
Alex Duan 35fced8796
Merge pull request #23234 from taosdata/main_3_merge
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
Haojun Liao 90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
Haojun Liao eb4449999f other: merge 3.0 2023-10-12 10:33:48 +08:00
wangmm0220 05c016b667 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 13:55:54 +08:00
dapan1121 3ff3fe7477
Merge pull request #23181 from taosdata/enh/TD-26604
enh: support balance group leader on vgroup_id
2023-10-11 13:25:51 +08:00
Hongze Cheng ef94767758
Merge pull request #23213 from taosdata/FIX/TD-26664-3.0
enh: send rpc rsp on error of tmsgPutToQueue
2023-10-10 22:46:24 -05:00
wangmm0220 f7d1e0ea82 fix:[TD-26671] judge if pointer is null to avoid core dump 2023-10-11 11:08:14 +08:00
Haojun Liao 6982935df7
Merge pull request #23157 from taosdata/fix/liaohj
refactor(stream): fix bugs and do some internal refactor.
2023-10-11 10:30:16 +08:00
dapan1121 17e3b99bed
Merge pull request #23200 from taosdata/szhou/main/revert-create-table-sql
Revert "fix: add create table sql to audit log"
2023-10-11 08:52:53 +08:00
dapan1121 c5ec45ddb4
Merge pull request #23185 from taosdata/feat/TD-26639
feat: remove partition node for agg
2023-10-11 08:36:48 +08:00
Haojun Liao 1d4f0c8599
Merge pull request #23201 from taosdata/enh/TD-26646
Enh/td 26646
2023-10-10 22:59:37 +08:00
Benguang Zhao a9ed36e167 enh: send rpc rsp on error of tmsgPutToQueue 2023-10-10 16:53:15 +08:00
Haojun Liao 5f9b858fc1 other: merge main. 2023-10-10 15:38:46 +08:00
yihaoDeng b36163a197 add session iter 2023-10-10 15:12:21 +08:00
yihaoDeng 825341d90a add sess iter 2023-10-10 14:35:02 +08:00
wangjiaming0909 eea90507d4 feat: remove partition node for agg 2023-10-10 14:29:36 +08:00
Haojun Liao ba1690f0dd Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-10-10 14:00:48 +08:00
Haojun Liao adf6f65d09 fix(stream): set initial version for fill-history task. disable reentry of scan-history task function. 2023-10-10 14:00:30 +08:00
Alex Duan 9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
fix: add case for lost data after  split vgroup (main)
2023-10-10 00:54:34 -05:00
Alex Duan e566027cef
Merge pull request #23019 from taosdata/case/TD-26408-3.0
fix: add case for lost data after split 3.0
2023-10-10 00:53:56 -05:00
yihaoDeng 6adf7532a8 add sess iter 2023-10-10 11:35:18 +08:00
shenglian zhou 6c30c4faab Revert "fix: add create table sql to audit log"
This reverts commit 658de2a04e.
2023-10-10 11:12:53 +08:00
yihaoDeng 7ac4ef5beb add sess iter 2023-10-10 10:41:46 +08:00
liuyao 26c87e5f41 fix mem leak 2023-10-10 10:26:26 +08:00
yihaoDeng 0fc6ffe6b6 change test case 2023-10-09 20:51:26 +08:00
yihaoDeng c6e9134cea add sess iter 2023-10-09 20:02:23 +08:00
Haojun Liao b0ef091430 fix(stream): retry when error occurs during timer. 2023-10-09 16:40:05 +08:00
Haojun Liao be0a2e4573 fix(stream): disable retrieving results during checkpoint procedure 2023-10-09 16:33:28 +08:00
dapan1121 7c7cf2b1aa enh: support balance group leader on vgroup_id 2023-10-09 15:46:41 +08:00
wade zhang 7c738cbe0c
Merge pull request #23168 from taosdata/feat/TS-4036-main
feat: alter local/dnode asynclog
2023-10-09 15:44:39 +08:00
Haojun Liao 8266c4ff77 fix(stream): remove invalid clear of rspmsg list. 2023-10-09 15:26:42 +08:00
Haojun Liao d87db2f829 fix(stream): fix the pause failure bug. 2023-10-09 14:48:11 +08:00
yihaoDeng 28b546a4ad fix mem leak 2023-10-09 14:25:57 +08:00
yihaoDeng be42143362 Merge branch '3.0' into case/TD-26408-3.0 2023-10-09 14:24:31 +08:00
yihaoDeng 3f9784f475 fix mem leak 2023-10-09 14:07:22 +08:00
Haojun Liao 74ff0c5b50 Merge branch 'main' into fix/liaohj 2023-10-09 10:14:53 +08:00
Haojun Liao ee6516f3c4 enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks. 2023-10-09 10:13:53 +08:00
Haojun Liao 4b8cd3bccd fix(stream): not idle for sink task when no tokens are available. 2023-10-09 10:07:19 +08:00
Haojun Liao e9ce38e2b0
Merge pull request #23159 from taosdata/fix/TD-26602
init bloomfilter array
2023-10-08 18:56:05 +08:00
liuyao 1d952ca8ea rebuild session window 2023-10-08 18:27:05 +08:00
Shungang Li a7507d26b0 feat: alter local/dnode asynclog 2023-10-08 18:26:25 +08:00
wade zhang 8e0179b73e
Merge pull request #23142 from taosdata/FIX/TS-4096-main
enh: reserve half a buffer size at syncLogBufferInit
2023-10-08 16:00:38 +08:00
liuyao 1cbb8ef444 init bloomfilter array 2023-10-08 14:43:44 +08:00
yihaoDeng b5994b31e2 fix mem leak 2023-10-08 13:33:02 +08:00
liuyao ed8cad22cb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-08 13:31:51 +08:00
yihaoDeng e3f18495e0 fix mem leak 2023-10-08 11:22:26 +08:00
Haojun Liao 23fb26798f fix(stream): sleep for 10ms 2023-10-07 19:47:49 +08:00
Haojun Liao e4e4c5a36e fix(stream): wait for a while when no available token. 2023-10-07 19:41:49 +08:00
Haojun Liao 45bb3f50d7 fix(stream): continue 2023-10-07 19:25:40 +08:00
liuyao 95ffe6fa23 stream recover 2023-10-07 19:24:21 +08:00
Haojun Liao 62cdcbc7e3 refactor: inc the dump batch. 2023-10-07 19:20:48 +08:00
Haojun Liao 4d6f143146 fix(stream): add missing refactor. 2023-10-07 19:18:26 +08:00
Haojun Liao ab17bfdf09 refactor: do some internal refactor. 2023-10-07 19:16:55 +08:00
Haojun Liao 0e8a8aabc1 fix(stream): check items in queue and qall, stead of only the queue items. 2023-10-07 19:16:25 +08:00
liuyao c088ee7f91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-10-07 19:13:07 +08:00
liuyao 1e323c0408 fix issue 2023-10-07 19:11:46 +08:00
liuyao 19bbf10579 fix issue 2023-10-07 17:59:53 +08:00
yihaoDeng 97fdcbc60b fix mem leak 2023-10-07 17:48:24 +08:00
liuyao 1aaf873134 fix issue 2023-10-07 17:43:50 +08:00
Haojun Liao d11c0a113c fix(stream): fix syntax error. 2023-10-07 14:56:09 +08:00
Haojun Liao 7ce3d2c200 fix(stream): quit from loop when input queue is full. 2023-10-07 14:54:11 +08:00
Benguang Zhao be3ba000a1 enh: reserve half a buffer size at syncLogBufferInit 2023-10-07 14:17:46 +08:00
liuyao 460ee86fdf fix issue 2023-10-07 11:55:40 +08:00
liuyao 59d47e1e1f fix issuse 2023-10-07 10:34:35 +08:00
Haojun Liao 115a284ac0 enh(stream): update the checkpoint interval 2023-10-07 09:56:03 +08:00
liuyao b7b96b67be use secondary pointer 2023-10-07 09:40:23 +08:00
Haojun Liao 011627d50a fix(stream): update the current processing version. 2023-10-07 09:07:44 +08:00
Haojun Liao c20dd002fb enh(stream): add more info for sink task. 2023-10-07 01:14:00 +08:00
Haojun Liao 98659ad323 fix(stream): fix the invalid check. 2023-10-05 00:09:47 +08:00
Haojun Liao 41ef1a45c1 enh(stream): optimize the scan wal perf 2023-10-04 22:06:46 +08:00
Haojun Liao 45e413f8d5 refactor: wait for 100ms before scan wal again. 2023-10-03 20:57:19 +08:00
Haojun Liao 132fb8e82e refactor: wait for more time for future data 2023-10-03 15:42:00 +08:00
Haojun Liao 38aff641ee fix(stream): add null check. 2023-10-03 02:39:57 +08:00
Haojun Liao 58f410a9df refactor: do some internal refactor. 2023-10-03 02:37:52 +08:00
Haojun Liao a543f4ca97 refactor: do some internal refactor. 2023-10-03 01:52:03 +08:00
Haojun Liao 5564eb215c fix(stream): fix invalid check. 2023-10-03 00:38:24 +08:00
Haojun Liao 5718158fc0 refactor: do some internal refactor. 2023-10-01 22:27:29 +08:00
Haojun Liao 31acbc6fe2 refactor: do some internal refactor (discard the checkpoint source msg during restoring). 2023-09-28 22:44:13 +08:00
Haojun Liao f2d8431619 fix(stream): enable new time range for stream task. 2023-09-28 18:26:52 +08:00
Minglei Jin 2d3652c723 fix(keep0-duration): force keep0 at least thrice of duration 2023-09-28 16:15:35 +08:00
Haojun Liao 0047d1e1a6 Merge branch 'main' into fix/liaohj 2023-09-28 14:35:14 +08:00
wade zhang b75baa5b0e
Merge pull request #23100 from taosdata/fix/m/TD-26525
fix: group by operator may cause client assert fail
2023-09-28 14:16:35 +08:00
Haojun Liao 80ec77cbb6 enh(stream): optimize the stream status when creating without fill-history option. 2023-09-28 11:23:03 +08:00
wangjiaming0909 2340a952aa fix: group by operator may cause client assert fail 2023-09-28 10:23:33 +08:00
Haojun Liao 22e485d132 fix(stream): opt perf. 2023-09-28 09:25:23 +08:00
slzhou f659e36d2c fix: internal error when show normal db.tables like pattern 2023-09-28 09:20:12 +08:00
Haojun Liao 9df5217221
Merge pull request #23106 from taosdata/fix/fixTransInvalidReadMain
fix trans invalid read
2023-09-28 09:15:12 +08:00
Haojun Liao cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
dapan1121 913c75e654
Merge pull request #23097 from taosdata/fix/ts-4088
fix: timestamp computation output type is float
2023-09-28 08:42:07 +08:00
Haojun Liao f525778aef fix(stream): fix syntax error. 2023-09-28 00:53:36 +08:00
Haojun Liao 25a3c727e3
Merge pull request #23090 from taosdata/fix/dead_lock
fix(stream): fix dead lock.
2023-09-28 00:42:52 +08:00
yihaoDeng 4581c296d0 fix trans invalid read 2023-09-27 19:54:09 +08:00
Haojun Liao 8c998673ad fix(stream): fix dead lock. 2023-09-27 17:15:49 +08:00
shenglian zhou fc824a3bb9 fix: timestamp add return float when get time range 2023-09-27 16:39:49 +08:00
dapan1121 c8aee79e3f fix: apercentile parameter validation and result error 2023-09-27 16:08:06 +08:00
Haojun Liao 2dade996bb log(stream): update logs. 2023-09-27 15:37:12 +08:00
Haojun Liao 9ab89ef961 fix(stream): fix dead lock. 2023-09-27 15:26:46 +08:00
Haojun Liao 8f2d217834 log: update logs. 2023-09-27 14:48:53 +08:00
Haojun Liao 11641e1115 refactor: do some internal refactor. 2023-09-27 14:18:01 +08:00
Haojun Liao 34d547bfff fix(stream): avoid repeatly free obj. 2023-09-27 14:05:14 +08:00
Haojun Liao ae020fcd2d log(stream): update the log. 2023-09-27 14:03:57 +08:00
Haojun Liao e13efd5b04 refactor: optimize the fill-history task launch policy, and do some other internal refactor. 2023-09-27 14:00:48 +08:00
dapan1121 222deba430
Merge pull request #23070 from taosdata/szhou/fix-td4070
fix: set null when creating empty input for count
2023-09-27 13:27:11 +08:00
Haojun Liao a7e6933ce7 refactor: do some internal refactor. 2023-09-27 09:46:15 +08:00
Haojun Liao 37bf387453 fix(stream): reduce the counter when remove stream tasks. 2023-09-27 09:36:20 +08:00
Haojun Liao 9ab9de0ad3 fix(stream): limit sink quota. 2023-09-27 00:30:38 +08:00
Haojun Liao 27dcbcb96f fix(stream): update the retry interval. 2023-09-26 23:42:02 +08:00
Haojun Liao aec15ae39f enh(stream): add quota limitation for sink task. 2023-09-26 23:29:54 +08:00
liuyao ebf4283e91 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 17:19:41 +08:00
liuyao c95dc167b7 add ci 2023-09-26 17:19:21 +08:00
dapan1121 17e1da0be7 fix: log typo 2023-09-26 16:53:29 +08:00
shenglian zhou 5a28981d50 fix: set null when creating empty input for count 2023-09-26 16:00:56 +08:00
wade zhang f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao 890d658aea refactor: do some internal refactor. 2023-09-26 14:11:45 +08:00
Haojun Liao 525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao f3f18b0fa3 fix(stream): add new status for meta. 2023-09-26 12:15:12 +08:00
liuyao ca2325f886 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174 2023-09-26 10:41:31 +08:00
liuyao 82e18e32b0 add ci 2023-09-26 10:41:12 +08:00
Haojun Liao d214a2f6bd fix(stream): do some internal refactor. 2023-09-26 09:32:57 +08:00
Haojun Liao 6cc3618ed9 fix(stream): fix error in pause scan-history data. 2023-09-26 01:09:55 +08:00
Haojun Liao 5a4a0aa0e3 fix(stream): fix invalid read and memory leak. 2023-09-25 23:10:33 +08:00