Commit Graph

5934 Commits

Author SHA1 Message Date
Jinqing Kuang fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
dmchen cc3b883a43 feat/TS-5927-long-password-compatable 2025-02-14 06:04:22 +00:00
dmchen 8f2370f3fa feat/TS-5927-long-password-fix-case 2025-02-14 01:12:09 +00:00
dmchen 55e12e520b feat/TS-5927-long-password-encrypt-pass 2025-02-13 07:45:42 +00:00
Zhixiao Bao e71c03a90f
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-13 10:17:58 +08:00
dongming chen 2fd8792c7a
Merge branch '3.0' into feat/TS-5927-long-password 2025-02-12 15:26:41 +08:00
xiao-77 359399f1cd feat rename some names. 2025-02-12 14:49:59 +08:00
dmchen b422e2b2f2 feat/TS-5805-force-assign-leader-msg-type 2025-02-12 06:29:24 +00:00
dongming chen 0350f46ba4
Merge pull request #29756 from taosdata/3.0
3.0
2025-02-12 14:00:02 +08:00
Shengliang Guan 67b678f9f0
Merge pull request #29746 from taosdata/merge/mainto3.02
merge: from main to 3.0 branch
2025-02-12 13:57:36 +08:00
dmchen d128c3927d fix/TS-5805-check-arb-fix-comment 2025-02-12 02:04:13 +00:00
xiao-77 bdcec392b4 Merge remote-tracking branch 'origin/3.0' into feat/3.0/TS-5584 2025-02-12 09:56:23 +08:00
xiao-77 a1a3f83283 Add unapplied to show vnodes. 2025-02-12 09:55:36 +08:00
xiao-77 b62d8d37b1 Feat(sync):Use remaining time to replace progress. 2025-02-11 15:51:05 +08:00
Shengliang Guan cd52401303 Merge branch 'main' into merge/mainto3.02 2025-02-11 15:15:35 +08:00
dmchen 635b4a5cb1 fix/TS-5805-check-arb-trans-compatable 2025-02-11 02:56:12 +00:00
Haojun Liao 267f7d3b08 refactor(stream): limit the maximum number of consensus checkpoint trans. 2025-02-11 10:31:11 +08:00
Haojun Liao d08a81cc98 fix(stream): fix bug in limiting concurrent checkpoints 2025-02-10 19:24:37 +08:00
Haojun Liao 6c7a8e9774 refactor(stream): allow ready stream to start checkpoint procedure. 2025-02-10 19:24:36 +08:00
Shengliang Guan dae17cd1b0
Merge pull request #29718 from taosdata/enh/streamqueue
refactor(stream): notify close stream in main thread
2025-02-10 18:44:27 +08:00
xiao-77 fbe65197d6 Feat(sync):Add restore progress to the "show vnodes" command, and add the applied index to the "show vgroups" command. 2025-02-10 15:58:25 +08:00
dmchen b1dc31a2bd fix/TS-5805-check-arb-add-column 2025-02-10 06:57:50 +00:00
dmchen 946a0c1bb5 fix/TS-5805-check-arb-remve-useless-code 2025-02-10 02:58:42 +00:00
dongming chen 240a8b5d5b
Merge pull request #29723 from taosdata/3.0
3.0
2025-02-10 09:56:12 +08:00
Haojun Liao ec954bf408 refactor(stream): record the dropped stream. 2025-02-09 21:13:10 +08:00
xiao-77 adfab1f2b6 Fix some review errors. 2025-02-08 18:51:39 +08:00
xiao-77 4011d01148 Fix some review errors. 2025-02-08 17:42:48 +08:00
xiao-77 7707e5d8dd Fix some review errors. 2025-02-08 17:37:15 +08:00
xiao-77 a2f11f21c9 Fix review problems. 2025-02-08 17:07:55 +08:00
xiao-77 72f228fa97 Fix build errors. 2025-02-07 18:52:54 +08:00
xiao-77 2cbb7a7814 Fix sdb config compare errors. 2025-02-07 18:49:00 +08:00
Shengliang Guan a004d95996 Merge branch '3.0' into merge/mainto3.02 2025-02-06 13:46:36 +08:00
factosea fbe345a82e fix: cols funcs, sub query 2025-02-05 15:26:03 +08:00
dmchen 2b4d4162a7 feat/TS-5805-force-set-assign 2025-01-24 08:50:04 +00:00
Haojun Liao 2f6977dfda Merge branch 'main' into enh/analysis 2025-01-23 18:55:32 +08:00
dmchen d9401fd75d feat/TS-5805-add-sql-command 2025-01-23 09:37:07 +00:00
dmchen 3c5b8037e3 feat/TS-5927-long-password 2025-01-23 08:46:29 +00:00
Haojun Liao 55ca679571 fix(analysis): fix compiling error on windows. 2025-01-23 09:06:55 +08:00
Haojun Liao 989c20078a refactor: do some internal refactor. 2025-01-23 00:32:46 +08:00
Haojun Liao 883b1b79a2 enh(analysis): add the algorithm in telemetry report. 2025-01-23 00:29:18 +08:00
Haojun Liao d6dc966ed1 fix(analysis): fix compiler error on windows. 2025-01-22 15:12:43 +08:00
Haojun Liao 9f2c448e36 fix(stream): fix error in check node update trans. 2025-01-22 14:05:40 +08:00
Haojun Liao 30358f1297 fix(stream): fix error in check node update trans. 2025-01-22 12:52:30 +08:00
Haojun Liao 84580286ce enh(analysis): enable community edition to support anodes. 2025-01-22 11:11:06 +08:00
Haojun Liao 2f065062c3 fix(stream): adjust position of checking trans. 2025-01-21 19:04:14 +08:00
Haojun Liao 88a94919c4 fix(stream): check for nodeupdate trans before create streams. 2025-01-21 18:41:52 +08:00
Jinqing Kuang eb5d463490 feat(stream)[TS-5469]. add support for window event notifications in stream processing
- Introduce new syntax to specify notification type and destination address
- Collect relevant event information during window computations
- Implement websocket-based notification delivery to the specified address
2025-01-21 17:39:46 +08:00
Haojun Liao 0ea46585f4 fix(stream): update checkpoint-info after check the failed checkpointId, and update the consensus-checkpoint id in mnode. 2025-01-21 16:29:00 +08:00
Haojun Liao df6ec3afc2 fix(stream): check null ptr. 2025-01-21 11:21:53 +08:00
Haojun Liao 08092aeb0c fix(stream): not clear task list if check failed, and add more checks. 2025-01-21 10:27:39 +08:00
Haojun Liao 7900c725d5 fix(stream): fix syntax error. 2025-01-21 09:15:27 +08:00
Haojun Liao efd33aa4d7 fix(stream): check the checkpoint-report transId and checkpointId, and identify the expired checkpoint-report info. 2025-01-21 01:25:53 +08:00
Shengliang Guan e48b48f93c Merge branch 'main' into merge/mainto3.0 2025-01-10 12:07:40 +08:00
Hongze Cheng 74c7420c1d
Merge pull request #29527 from taosdata/fix/main/TD-33457
Test(cfg): add alter config to compatibility.py and fix some memory leak.
2025-01-09 17:22:07 +08:00
Shengliang Guan c62e189496 Merge branch 'main' into merge/mainto3.0 2025-01-09 13:38:37 +08:00
xiao-77 c3e025713b Rename some vars. 2025-01-09 13:38:20 +08:00
xiao-77 c1732ba41d Fix asan problems at ci test. 2025-01-09 13:36:23 +08:00
Shengliang Guan 081c902c64
Merge pull request #29520 from taosdata/fix/TD-32471-main
fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL
2025-01-09 13:33:48 +08:00
xiao-77 9eb1239783 Fix mem leak. 2025-01-09 10:50:23 +08:00
Shengliang Guan fe4555f060
Merge pull request #29517 from taosdata/fix/tag
fix(stream): check the stream task last ready timestamp before start the checkpoint procedure.
2025-01-08 18:29:55 +08:00
wangmm0220 ba9892bae0 fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL 2025-01-08 16:50:38 +08:00
xiao-77 742e3251b7 Remove unused rpcRsp. 2025-01-08 15:51:58 +08:00
xiao-77 4a5d575894 Fix unhandle msg. 2025-01-08 15:45:58 +08:00
Haojun Liao 130ad28d2c fix(stream): check stream task status before start checkpoint. 2025-01-08 15:31:15 +08:00
xiao-77 430e62aab6 Fix double free. 2025-01-08 14:55:37 +08:00
xiao-77 b46bd98f6d Fix mem leak. 2025-01-08 09:29:46 +08:00
xiao-77 e597baa345 Fix mnode = 3 , trans stuck. 2025-01-07 22:01:33 +08:00
xiao-77 77359f26b3 Fix(cfg): resolve dynamic configuration update failure after rolling upgrade to 3.3.5.0 2025-01-07 15:26:01 +08:00
Shengliang Guan fcca5e7c2e
Merge pull request #29381 from taosdata/fix/liaohj
test: add test cases and fix related bugs.
2024-12-31 11:10:34 +08:00
Haojun Liao f03e2305e0 fix(stream): add logs and set the reset-stream rsp. 2024-12-30 14:26:20 +08:00
kailixu b0fa490dd6 test: add test case for auto compact 2024-12-29 15:13:38 +08:00
kailixu 458a72c66a test: add test case for auto compact 2024-12-29 13:45:59 +08:00
kailixu f529339fb8 test: add test case for auto compact 2024-12-29 13:26:40 +08:00
kailixu 7b69c29c9e test: add test case for auto compact 2024-12-29 12:49:03 +08:00
kailixu 104f37337f test: add test case for auto compact 2024-12-29 12:24:15 +08:00
kailixu 5f3e8ef5aa test: add test case for auto compact 2024-12-28 15:35:12 +08:00
kailixu bf33ef0c07 test: add test case for auto compact 2024-12-27 18:57:12 +08:00
kailixu fcd436830f test: add test case for auto compact 2024-12-27 18:54:22 +08:00
kailixu 78018b3a16 test: add test case for auto compact 2024-12-27 17:05:09 +08:00
54liuyao 0bf9fb1e31 add reset stream 2024-12-27 15:11:19 +08:00
dmchen 1aec478c45 fix/TS-5805-check-arb 2024-12-26 03:06:33 +00:00
dmchen 1bc47199be fix/TS-5805-check-arb 2024-12-25 02:43:51 +00:00
dmchen d3ab816838 fix/TS-5805-check-arb-updatetime 2024-12-25 02:10:21 +00:00
dmchen 0da606c7fb show code 2024-12-24 12:14:47 +00:00
dongming chen c6f3ac65dc
Merge branch '3.0' into enh/TD-29974-improve-trans 2024-12-24 19:15:27 +08:00
Hongze Cheng 91a9bc30e2
Merge pull request #29228 from taosdata/fix/TD-33284-compact-coverage
Fix/td 33284 compact coverage
2024-12-24 19:01:42 +08:00
dmchen 150dd5af3f fix/TS-5805-check-arb 2024-12-24 10:50:56 +00:00
dongming chen 48b24804d4
Merge pull request #29275 from taosdata/3.0
3.0
2024-12-23 13:53:16 +08:00
Shengliang Guan e2011c9ffb Merge branch '3.0' into merge/mainto3.0 2024-12-20 17:58:11 +08:00
Shengliang Guan b6b14f7a1a
Merge pull request #29236 from taosdata/fix/contrib
enh: skip password check if create user with is_import options
2024-12-20 15:12:51 +08:00
dmchen 9715bb59fe fix/TD-33294-compact-coverage-fix-case 2024-12-20 11:33:26 +08:00
Shengliang Guan 2dda013646 enh: skil password check if create user with is_import 2024-12-20 10:13:53 +08:00
Shengliang Guan ab58fdd6da
Merge pull request #29213 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-12-19 11:15:30 +08:00
Shengliang Guan 3040260bfe
Merge pull request #29181 from taosdata/fix/TD-33225-main
fix:[TD-33225]remove the limitation when creating index or modifing col…
2024-12-18 21:07:03 +08:00
wangmm0220 c7615868b0 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-32166 2024-12-18 17:37:02 +08:00
wangmm0220 c2baa7e177 fix:ci error 2024-12-18 17:36:06 +08:00
dongming chen 69980ac5a8
Merge pull request #29194 from taosdata/3.0
3.0
2024-12-18 08:33:58 +08:00
dmchen 6f124e7b23 enh/TD-29974-improve-trans-fix-case 2024-12-17 10:36:12 +00:00
54liuyao e6ac454303 Merge branch 'main' of https://github.com/taosdata/TDengine 2024-12-17 18:02:36 +08:00
54liuyao 63a6428e34 fix(stream):adjust status of ins_streams 2024-12-17 17:59:53 +08:00
Shengliang Guan cdfd618157
Merge pull request #29107 from taosdata/fix/liaohj
fix(stream): record the failure of dispatch msg, and set the update nodeId
2024-12-17 17:41:45 +08:00
Shengliang Guan 40e246059e
Merge pull request #29178 from taosdata/fix/main/TD-33227
Fix(cfg):can not restart taosd  cause cfg trans exec failed.
2024-12-17 15:25:10 +08:00
wangmm0220 5972054c2d fix:[TD-33225]remove the limition when creating index or modifing column compression if there is a topic/stream/tsma 2024-12-17 14:33:44 +08:00
dmchen 134d593458 enh/TD-29974-improve-trans-fix-case 2024-12-17 14:23:44 +08:00
dmchen 26507e6faa enh/TD-29974-improve-trans-fix-case 2024-12-17 11:32:38 +08:00
xiao-77 474113da4e Move rebuild config sdb to after restored. 2024-12-17 11:22:38 +08:00
dmchen 4b6eec21f4 enh/TD-29974-improve-trans-fix-case 2024-12-17 09:54:54 +08:00
xiao-77 6eb183a032 Fix(cfg):only write sdb on leader. 2024-12-17 09:50:18 +08:00
Haojun Liao d2146a2efb other: merge main 2024-12-17 09:23:13 +08:00
yihaoDeng 10f2094bd4 Merge remote-tracking branch 'origin/main' into enh/TD-32951 2024-12-17 08:33:43 +08:00
yihaoDeng 638b0ab7f0 Merge remote-tracking branch 'origin/main' into enh/TD-32951 2024-12-16 21:41:53 +08:00
Shengliang Guan 4c1499ebeb
Merge pull request #29122 from taosdata/enh/3.0/TD-31709
Replace unsafe memory functions with safe versions in wal&sync&mnode.
2024-12-16 21:37:33 +08:00
dmchen ce86b1d687 change show transtion detial timestamp 2024-12-16 16:30:09 +08:00
xiao-77 8a2ae888cc fix ci errors. 2024-12-16 15:41:19 +08:00
xiao-77 9d733c03b4 Fix merge errors. 2024-12-16 14:13:23 +08:00
Haojun Liao 779c1bd8ad refactor(stream): inject the reject dispatch error in stream to test the effect of fix. 2024-12-16 13:53:13 +08:00
xiao-77 b4afa6ff90 Fix merge errors. 2024-12-16 13:44:58 +08:00
Hongze Cheng 1ca396f6d0
Merge pull request #29149 from taosdata/feat/TS-4994-3.0
fix: compile problem of community
2024-12-16 13:24:03 +08:00
Shengliang Guan 3311e71cd9
Merge pull request #29152 from taosdata/main
merge: from main to 3.0 branch
2024-12-16 11:27:02 +08:00
kailixu 2fa755d49c fix: compile problem of community 2024-12-16 10:49:58 +08:00
dongming chen 20cc54aaaa
Merge branch 'enh/TD-29974-improve-trans' into dmchen/trans-improve 2024-12-16 10:34:11 +08:00
xiao-77 c4ed102c11 Merge branch '3.0' into enh/3.0/TD-31709 2024-12-16 10:00:02 +08:00
Shengliang Guan 6b49eededd
Merge pull request #29105 from taosdata/fix/3_liaohj
enh: update the mnode epset in stream hb rsp.
2024-12-16 09:23:38 +08:00
Shengliang Guan 5461502ed1
Merge pull request #29106 from taosdata/fix/init_meta
refactor(stream): check mnode when issue the nodeEp update trans.
2024-12-16 09:23:18 +08:00
yihaoDeng d586026e25 telemetry refactor 2024-12-15 18:01:21 +08:00
yihaoDeng 0922b28123 update test case 2024-12-15 12:16:24 +08:00
Shengliang Guan e8fcf16b89
Merge pull request #29138 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2024-12-15 12:08:55 +08:00
Hongze Cheng 37c1be4818 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-14 23:51:25 +08:00
yihaoDeng cd4f92ebf2 telemetry refactor 2024-12-14 21:27:37 +08:00
Shengliang Guan ea96f51ba2 Merge branch '3.0' into merge/mainto3.0 2024-12-14 18:24:39 +08:00
Shengliang Guan 9c15eb7b3b Merge branch 'main' into merge/mainto3.0 2024-12-14 18:20:51 +08:00
Hongze Cheng c2e3dd4b4e Merge branch 'feat/TS-4994-3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-13 18:12:58 +08:00
Hongze Cheng 7905c80fd4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-13 18:12:53 +08:00
xiao-77 7b921b81d2 Fix ci. 2024-12-13 17:48:51 +08:00
xiao-77 da8dd39bd8 Fix ci problems. 2024-12-13 17:21:30 +08:00
xiao-77 d191caca98 Fix merge errors. 2024-12-13 17:10:47 +08:00
Kaili Xu 60fdd0fe64
enh: calculation of compact time offset 2024-12-13 17:05:46 +08:00
Zhixiao Bao 7aa089e1f9
Merge branch '3.0' into enh/3.0/TD-31709 2024-12-13 17:02:50 +08:00
xiao-77 c66a834d1e Replace unsafe memory functions with safe versions in wal&sync. 2024-12-13 15:19:29 +08:00
xiao-77 a6e1af6b42 Merge branch '3.0' into enh/3.0/TS-5007 2024-12-13 15:04:36 +08:00
Shengliang Guan b11638812b
Merge pull request #29127 from taosdata/fix/main/TD-33179
refact: merge unnecessary code.
2024-12-13 14:38:04 +08:00
Shengliang Guan 3f6ddbcf48
Merge pull request #29124 from taosdata/feat/TD-30268
feat: support query memory pool
2024-12-13 14:37:42 +08:00
Hongze Cheng 8bf5f3f62b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4994-3.0 2024-12-13 13:54:45 +08:00
xiao-77 19ea042318 Fix some review errors. 2024-12-13 12:32:08 +08:00
Shengliang Guan 8136363fbe refact: merge unnecessary code. 2024-12-13 11:14:21 +08:00
Shengliang Guan 925a222366
Merge pull request #29099 from taosdata/fix/main/TD-33179
Enh(mnode):Add sdbCancelFetch and sdbRelease while exit iter.
2024-12-13 11:05:24 +08:00
Haojun Liao e9f398b3f8 fix(test): check null ptr. 2024-12-13 00:15:10 +08:00
xiao-77 f8a6489bb8 Fix ci problems. 2024-12-12 19:31:28 +08:00
xiao-77 d6078fd0b7 Enh use tmsg to encode/decode global config. 2024-12-12 17:40:35 +08:00
wangmm0220 e598486b10 feat:[TD-32166] check input params for tmq 2024-12-12 16:44:14 +08:00