Commit Graph

17191 Commits

Author SHA1 Message Date
dmchen 3359483836 fix:decouple get mload 2025-03-01 00:22:40 +08:00
dmchen 774c512148 fix:add-status-timestamp 2025-03-01 00:22:37 +08:00
dmchen 48787ba1aa fix/move-status-to-new-queue 2025-03-01 00:22:35 +08:00
Haojun Liao c726420081 Merge branch 'main' into fix/droptask 2025-02-28 19:42:35 +08:00
Haojun Liao 8c3035cf24 fix(stream): avoid lock in timer to avoid sync operation blocks. 2025-02-28 17:47:43 +08:00
Haojun Liao e1c4451f81 fix(stream): avoid lock in timer to avoid sync operation blocks. 2025-02-28 17:46:54 +08:00
Simon Guan 43ca6d5f9e refactor: adjust some logs 2025-02-28 16:49:46 +08:00
Haojun Liao 5f6ecab854 fix(stream): check the return values. 2025-02-28 15:05:00 +08:00
dmchen 45cdd871db fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 14:15:20 +08:00
Haojun Liao 6e1206bbc1 fix(stream): add some logs. 2025-02-28 13:55:37 +08:00
Haojun Liao 951b469b10 fix(stream): add some logs. 2025-02-28 13:55:24 +08:00
Haojun Liao 14ef25101d fix(stream): adjust log. 2025-02-28 13:55:09 +08:00
Haojun Liao 3e55f8edfe fix(stream): follower nodes not restart tasks. 2025-02-28 13:54:26 +08:00
Haojun Liao ed03b3a22c fix(stream): try starting task even the inputQ is full. 2025-02-28 13:48:05 +08:00
Simon Guan 24fae6adbb
Merge pull request #29900 from taosdata/fix/checkfh
refactor(stream): scan wal is driven by time, instead of insert events.
2025-02-28 13:42:43 +08:00
Hongze Cheng 0174d7404d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-28 13:26:53 +08:00
dmchen aa7cb880bb fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 11:53:18 +08:00
dmchen 1237e762c1 fix/remove-get-queue-size-when-print-heartbeat-log 2025-02-28 11:52:27 +08:00
Simon Guan aa1bf309ea
Merge pull request #29959 from taosdata/fix/droptask
refactor(stream): create task epset update trans out of lock
2025-02-28 11:00:58 +08:00
Simon Guan ed2d3b258d Merge branch '3.0' into merge/mainto3.0 2025-02-28 09:11:14 +08:00
Simon Guan f5429637fa Merge branch 'main' into merge/mainto3.0 2025-02-28 09:11:10 +08:00
dmchen 2d4697d32f fix:decouple get mload 2025-02-27 19:17:54 +08:00
dmchen 4dd0622594 fix:decouple get mload 2025-02-27 19:07:33 +08:00
dmchen f6a472ae68 fix:decouple get mload 2025-02-27 19:05:06 +08:00
Hongze Cheng 0d2ca243b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-27 17:18:33 +08:00
dmchen d435bbae1d fix:add-status-timestamp 2025-02-27 15:54:07 +08:00
dmchen 55f58d743f fix/move-status-to-new-queue 2025-02-27 15:54:06 +08:00
Simon Guan 5d777f9bcf
Merge pull request #29654 from taosdata/feat/TS-5805-force-assign-leader
Feat/ts 5805 force assign leader
2025-02-27 15:42:27 +08:00
dmchen 7eeb800213 fix:add-status-timestamp 2025-02-27 15:29:52 +08:00
dmchen 1f6c4df422 fix/move-status-to-new-queue 2025-02-27 15:26:06 +08:00
dmchen 93992f3d6e fix:add-status-timestamp 2025-02-27 15:22:33 +08:00
Haojun Liao 45dfa0f12e refactor(stream): create task epset update trans out of lock, to avoid blocking mnode-read thread. 2025-02-27 15:18:01 +08:00
Hongze Cheng e2b48e4397 enh: add more code 2025-02-27 15:06:49 +08:00
Haojun Liao 7b56df0adc refactor(stream): create task epset update trans out of lock, to avoid blocking mnode-read thread. 2025-02-27 14:51:26 +08:00
Hongze Cheng b3ae5df8ac enh: more code 2025-02-27 14:06:30 +08:00
dmchen 5635b285cd feat/TS-5805-force-assign-leader-fix-check 2025-02-27 03:17:21 +00:00
dmchen 031f176aa1 fix/move-status-to-new-queue 2025-02-27 11:02:18 +08:00
Simon Guan 7f10288df1 Merge branch '3.0' into fix/internal 2025-02-27 10:04:34 +08:00
Simon Guan 76ad364b93 enh: adjust some logs 2025-02-27 09:55:11 +08:00
Simon Guan b91dd10846 enh: add log level to each log entry 2025-02-27 09:55:11 +08:00
wangmm0220 ef13df2e3d feat:[TD-33798]modify metadata logic for tmq 2025-02-27 09:55:11 +08:00
wangmm0220 a823efb3c4 feat:[TD-33798]modify metadata logic for tmq 2025-02-27 09:55:11 +08:00
wangmm0220 ebc8a2e433 fix:[TD-337958]send batch metadata & remove data if subscribe only meta 2025-02-27 09:55:11 +08:00
Haojun Liao 899d2cef20 fix(stream): not discard stream msg 2025-02-27 00:39:30 +08:00
Haojun Liao 786ee101cd other: merge main. 2025-02-27 00:18:25 +08:00
Haojun Liao bf1f162aa0 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:36 +08:00
Haojun Liao 012ee53d35 fix(stream): drop task in synch model in write thread. 2025-02-27 00:15:31 +08:00
Haojun Liao 45b0e47a19 refactor(stream): add long exec stream queue for history tasks in step1 and re-calculate task execution. 2025-02-27 00:15:03 +08:00
Haojun Liao 7319f544c2 refactor(stream): drop task in async ways 2025-02-27 00:14:34 +08:00
Haojun Liao c14ba08d7c refactor(stream): drop task in async ways 2025-02-27 00:12:11 +08:00
Hongze Cheng df96529e0d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-26 15:09:54 +08:00
Simon Guan ac056f153f
Merge pull request #29871 from taosdata/fix/TS-6028-check-column-name
fix:[TS-6028]check-column-name
2025-02-26 14:00:45 +08:00
dongming chen 0ce087f2b3
Merge branch '3.0' into feat/TS-5805-force-assign-leader 2025-02-26 13:57:36 +08:00
dmchen ebd2e657c6 fix/TS-6028-check-column-name-fix-review 2025-02-26 01:30:33 +00:00
dmchen 26f3adcf6a fix/TS-6028-check-column-name-fix-review 2025-02-25 10:27:32 +00:00
Hongze Cheng b26166b48d support meta_only option 2025-02-25 17:57:25 +08:00
Hongze Cheng d48547ed64 more code 2025-02-25 16:48:43 +08:00
Shengliang Guan e429264432
Merge pull request #29884 from taosdata/enh/killtrans
enh(stream): auto kill checkpoint trans that last long time
2025-02-25 11:29:49 +08:00
Hongze Cheng f85ddb6633 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-25 09:47:38 +08:00
Shengliang Guan 8a324a45d5
Merge pull request #29885 from taosdata/feat/TD-33798
feat:[TD-33798]send batch metadata & remove data if subscribe only meta
2025-02-24 19:32:26 +08:00
Hongze Cheng 9a95abd26d more code 2025-02-24 16:32:09 +08:00
wangmm0220 e87541efaa feat:[TD-33798]modify metadata logic for tmq 2025-02-24 16:18:27 +08:00
Shengliang Guan 8fccf318ab
Merge pull request #29902 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-02-24 15:47:21 +08:00
Hongze Cheng b01ed3bb80 more code 2025-02-24 15:32:46 +08:00
Hongze Cheng b048c597dc more code 2025-02-24 14:41:56 +08:00
Shengliang Guan 3a1d06f4d7
Merge pull request #29354 from taosdata/enh/TS-5255/colsFunc2
enh: ts5255/cols func2
2025-02-24 14:19:37 +08:00
Haojun Liao 91271f3fa4 refactor: do some internal refactor. 2025-02-24 13:53:28 +08:00
Haojun Liao 4d21d5e055 fix(stream): fix memory leak. 2025-02-24 13:50:38 +08:00
Haojun Liao c7d9a1cd73 fix(stream): fix memory leak. 2025-02-24 13:48:21 +08:00
Hongze Cheng f8a0dc8fe0 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-24 09:49:31 +08:00
Haojun Liao 97071f1d29 other: add some logs. 2025-02-24 09:42:15 +08:00
Haojun Liao 514a63ab37 fix(stream): fix the error in check scan interval 2025-02-24 00:40:16 +08:00
Haojun Liao 00edb8e612 fix(stream): adjust init tmr position. 2025-02-23 16:27:18 +08:00
Haojun Liao 787590b6c9 fix(stream): adjust init tmr position. 2025-02-23 16:25:17 +08:00
Haojun Liao b4de2d16b6 fix(stream): add some logs. 2025-02-23 16:18:49 +08:00
Haojun Liao f4c3fdedbd fix(stream): add some logs. 2025-02-23 16:18:19 +08:00
Haojun Liao 4ff74ab2ea fix(stream): adjust log. 2025-02-23 15:37:59 +08:00
Haojun Liao 8c0ead7c61 refactor: add some comments. 2025-02-23 11:03:49 +08:00
Haojun Liao 2fdb31a41a fix(stream): adjust scan timer 2025-02-23 10:49:13 +08:00
Haojun Liao f1c4d2734f fix(stream): follower nodes not restart tasks. 2025-02-23 10:43:56 +08:00
Haojun Liao e378b5cb8a fix(stream): adjust scan timer 2025-02-23 03:42:44 +08:00
Haojun Liao 9018970135 refactor: do some internal refactor. 2025-02-23 01:39:00 +08:00
Haojun Liao 034c907ee1 refactor: do some internal refactor. 2025-02-23 01:38:05 +08:00
Shengliang Guan 3a739beaa5 Merge branch 'main' into merge/mainto3.0 2025-02-22 20:07:40 +08:00
Haojun Liao a8d50f28a6 fix(stream): disable error injection. 2025-02-22 14:19:44 +08:00
Haojun Liao 56f1c80018 fix(stream): disable error injection. 2025-02-22 14:18:44 +08:00
Haojun Liao 4d62c60aaf fix(stream): fix syntax error. 2025-02-22 14:17:19 +08:00
Haojun Liao 6c92474afd fix(stream): fix syntax error. 2025-02-22 14:16:46 +08:00
Haojun Liao a9b5d0fbf0 fix(stream): update function return value. 2025-02-22 14:13:42 +08:00
Haojun Liao 9bd8b532ad fix(stream): update function return value. 2025-02-22 14:12:38 +08:00
Haojun Liao 0ec8e1e202 refactor(stream): remove comments. 2025-02-22 12:38:19 +08:00
Haojun Liao 0f89421b62 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:38:03 +08:00
Haojun Liao b5fdb44193 refactor(stream): remove comments. 2025-02-22 12:35:37 +08:00
Haojun Liao 09b6642e45 refactor(stream): scan wal is driven by time, instead of insert events. 2025-02-22 12:33:32 +08:00
Haojun Liao ea549364d4 fix(stream): free array and check the return values. 2025-02-21 16:38:26 +08:00
Hongze Cheng 93e17112e1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-5445-3.0 2025-02-21 15:22:22 +08:00
dmchen 6a81665ffa fix/TS-6028-check-column-name-add-case 2025-02-21 14:51:40 +08:00
wangmm0220 e594c2bbd5 feat:[TD-33798]modify metadata logic for tmq 2025-02-21 11:49:17 +08:00
Haojun Liao 2228a9fc33
Merge branch 'main' into fix/checkfh 2025-02-21 11:11:36 +08:00
dmchen cdb11dd497 fix/TS-6028-column-name-fix-cases 2025-02-21 10:10:44 +08:00
Haojun Liao ecc667c22b
Revert "refactor(stream): drop task in async ways" 2025-02-21 01:10:18 +08:00
wangmm0220 7b5edade95 fix:[TD-337958]send batch metadata & remove data if subscribe only meta 2025-02-20 19:50:37 +08:00
Haojun Liao 9d5735703b Merge branch 'fix/checkfh' into fix/checkpoint 2025-02-20 18:28:46 +08:00
Haojun Liao bea8fe42db fix(stream): check status before scan history. 2025-02-20 18:28:19 +08:00
Haojun Liao 66697ee188 fix(stream): check status before scan history. 2025-02-20 18:22:45 +08:00
Shengliang Guan 2bee60a41a Merge branch 'main' into merge/mainto3.0 2025-02-20 18:12:02 +08:00
Hongze Cheng b980bb35bc more code 2025-02-20 18:08:20 +08:00
dmchen 078c7bdc31 fix/TS-6028-check-column-name 2025-02-20 17:33:48 +08:00
Haojun Liao 22c05fde79 Merge branch 'enh/killtrans' into fix/checkpoint 2025-02-20 17:28:13 +08:00
Haojun Liao 6d5984421f refactor(stream): update the long trans threshold. 2025-02-20 17:27:41 +08:00
Haojun Liao 85c164c855 other: merge main. 2025-02-20 17:25:48 +08:00
Haojun Liao 0a672f1b96 refactor(stream): update logs. 2025-02-20 16:55:10 +08:00
Haojun Liao 6766e6db53 refactor(stream): add checkpoint queue to handle chkpt. 2025-02-20 16:13:33 +08:00
Haojun Liao 55f03f2187 fix(stream): try starting task even the inputQ is full. 2025-02-20 16:07:05 +08:00
Haojun Liao 99d6086c5a enh(stream): kill too long checkpoint trans. 2025-02-20 15:07:24 +08:00
Shengliang Guan 42bafc0d47
Merge pull request #29848 from taosdata/fix/ly_stream
fix(tsma):drop invalid state for tsma
2025-02-20 15:04:03 +08:00
Shengliang Guan 0a9f5086f0
Merge pull request #29775 from taosdata/fix/analysis
refactor(stream): drop task in async ways
2025-02-20 13:38:53 +08:00
54liuyao 870fe1c071 fix(tsma):drop invalid state for tsma 2025-02-20 11:52:04 +08:00
Shengliang Guan 86ea533b36 Merge branch '3.0' into merge/mainto3.03 2025-02-20 11:38:43 +08:00
Shengliang Guan d0eb99809f Merge branch 'main' into merge/mainto3.03 2025-02-20 11:38:41 +08:00
Shengliang Guan f16ae7abe1
Merge pull request #29809 from taosdata/merge/mainto3.0
merge: from main to 3.0 branch
2025-02-20 10:27:20 +08:00
Haojun Liao 3048654484 refactor(stream): kill too long checkpoint trans. 2025-02-20 10:01:30 +08:00
Shengliang Guan 4e064b5aec
Merge pull request #29823 from taosdata/feat/TS-5928
fix:[TS-5928]add consumer parameters
2025-02-19 19:22:26 +08:00
Shengliang Guan f2f8cb1648 Merge branch '3.0' into merge/mainto3.03 2025-02-19 17:00:41 +08:00
Shengliang Guan d13f9448eb
Merge pull request #29730 from taosdata/feat/3.0/TS-5584
Feat(sync):Add restore progress to the "show vnodes" command, and add…
2025-02-19 16:30:27 +08:00
wangmm0220 fc3995a10c fix:[TS-5776]add test case 2025-02-19 11:12:13 +08:00
Haojun Liao 7d617a7cde
fix(stream): fix the invalid start task condition
1. Get the basic checkpointId, and wait for 10 s, it's allowed to go.  2. All tasks have the same checkpointId, go immedidately.
2025-02-19 00:39:01 +08:00
Shengliang Guan 6735e5e948
Merge pull request #29822 from taosdata/kjq/enh-code-clarity
enh(stream): add options to control message and frame size
2025-02-18 18:59:28 +08:00
Shengliang Guan 8bee0e7030
Merge pull request #29666 from taosdata/feat/TS-5776
fix:[TS-5776]add raw type from consumer
2025-02-18 17:53:52 +08:00
wangmm0220 bdfa67e4a9 fix:[TS-5928]add consumer parameters 2025-02-18 17:32:00 +08:00
Jinqing Kuang a48095d467 enh(streams): add options to control message and frame size
Add options to allow users to specify message and frame size limits for
event notifications.
2025-02-18 17:20:38 +08:00
Shengliang Guan b43aaa5f8a Merge branch '3.0' into merge/mainto3.02 2025-02-18 16:48:55 +08:00
Zhixiao Bao 05112546fd
Merge branch '3.0' into feat/3.0/TS-5584 2025-02-18 16:07:47 +08:00
wangmm0220 f824a75f4d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-18 15:28:10 +08:00
wangmm0220 07e4265dde fix:[TS-5776]error in create table time 2025-02-18 15:21:51 +08:00
Shengliang Guan 92eb6038e2
Merge pull request #29762 from taosdata/feat/TS-5469-3.0
feat(stream)[TS-5469]: add more stream event notifications
2025-02-18 15:14:58 +08:00
wangmm0220 9dcac195cb fix:[TS-5776]error in ci 2025-02-18 11:20:42 +08:00
Shengliang Guan 63fc5dea34 Merge branch '3.0' into merge/mainto3.0 2025-02-18 10:29:16 +08:00
xiao-77 d071f40328 Fix review errors. 2025-02-18 09:31:15 +08:00
wangmm0220 6f2ccfc3b2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-5776 2025-02-17 17:41:25 +08:00
wangmm0220 bf5dc63a30 fix:[TS-5776]add test case 2025-02-17 17:40:54 +08:00
Linhe Huo a0090b5cdf
Merge pull request #29763 from taosdata/enh/TD-33678-3.0
enh: unified oem --version output 3.0
2025-02-17 10:41:33 +08:00
Linhe Huo f21ffcb510
Merge pull request #29764 from taosdata/enh/TD-33678-MAIN
fix: oem taosdump taosBenchmark --version support -main
2025-02-17 10:41:06 +08:00
Shengliang Guan 6dedab4bba
Merge pull request #29784 from taosdata/fix/TS-6017-3.0m
fix: timeseries statistics and test case
2025-02-17 10:25:44 +08:00
wangmm0220 3da00b7c74 fix:[TS-5776]add raw type from consumer 2025-02-17 10:13:49 +08:00
Haojun Liao c4cd6dd62d fix(stream): drop task in synch model in write thread. 2025-02-17 10:06:09 +08:00
Shengliang Guan 596e381e0e
Merge pull request #29779 from taosdata/fix/metanull
fix(stream): access value after null ptr check.
2025-02-17 09:36:09 +08:00
Jinqing Kuang fc2d2672b9 feat(stream)[TS-5469]: add more stream event notifications
- Add event notifications for all window types
- Implement window invalidation notifications
- Add statistics for event notification delivery
2025-02-16 11:07:16 +08:00
wangmm0220 47a6836c27 fix:[TS-5776]add raw type from consumer 2025-02-16 00:15:01 +08:00
Haojun Liao 465e5eabd7 fix(stream): drop task in synch model in write thread. 2025-02-15 23:20:05 +08:00