Commit Graph

19138 Commits

Author SHA1 Message Date
Haojun Liao 5f4b506777
Merge pull request #26131 from taosdata/fix/3_liaohj
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
2024-06-13 17:38:28 +08:00
factosea d9043d6984 fix: unexpected udf function 2024-06-13 16:57:49 +08:00
kailixu 1f646713fe fix: check range option of alter user 2024-06-13 16:36:18 +08:00
54liuyao 7620be6e28 optimize show cluster alive stmt 2024-06-13 16:23:50 +08:00
54liuyao 367b3b153f check cursor for count window 2024-06-13 15:35:26 +08:00
Yihao Deng f59b88ea93 double check enableWhiteList 2024-06-13 07:03:15 +00:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
facetosea 6da1215573 fix blockid 2024-06-13 14:48:02 +08:00
facetosea ff24eaf94d fix: code review 2024-06-13 14:13:44 +08:00
dapan1121 8bbdfacca0
Merge pull request #26123 from taosdata/fix/TD-30579
fix:[TD-30579]compile error in macOS 14.5 and m3 chip
2024-06-13 13:52:28 +08:00
kailixu 50d163f10d Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:29 +08:00
kailixu cdc7083b09 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:01 +08:00
Minglei Jin 0adbf110d9 check wal level on mnode 2024-06-13 11:02:05 +08:00
dapan1121 e62120be7a
Merge pull request #26104 from taosdata/fix/TD-30483
fix: count always true for group by tbname performance issue
2024-06-13 10:20:25 +08:00
Minglei Jin c13ba895ee fix translater rules for replica & wal level 2024-06-13 09:47:14 +08:00
dapan1121 18b5475771
Merge pull request #25511 from taosdata/fix/TD-29671/tableAliasName
fix: select failed as using table alias name
2024-06-13 08:50:19 +08:00
Jeff Tao ad0dd88ba1 fix:[TD-30579]compile error in macOS 14.5 and m3 chip 2024-06-12 22:31:08 +08:00
Haojun Liao 9c42c90209
Merge pull request #26118 from taosdata/fix/3_liaohj
fix(stream): add fill-history task id in msg.
2024-06-12 18:03:43 +08:00
kailixu ff47e1eab1 enh: support enable/disable tfs config entries 2024-06-12 17:12:30 +08:00
dapan1121 13a0bf3fdf fix: count empty table with group by issue 2024-06-12 16:18:22 +08:00
kailixu e7754a0b3e Merge branch '3.0' into enh/TD-30554-3.0 2024-06-12 15:40:01 +08:00
Haojun Liao d06e1549f1 fix(stream): add fill-history task id in msg. 2024-06-12 15:27:19 +08:00
Minglei Jin 568799a6a3 fix(wal/level): enable alter replica from fake walLevel 1 2024-06-12 15:16:58 +08:00
kailixu f2401f32a2 enh: support enable/disable tfs config entries 2024-06-12 15:14:38 +08:00
dapan1121 3c8cb76161
Merge pull request #26100 from taosdata/fix/TD-30481.3
fix: case when memory leak
2024-06-12 13:26:42 +08:00
Haojun Liao 623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Hongze Cheng 206280e529
Merge pull request #25395 from taosdata/fix/limitIdxMaxThread3
limit index bg thread
2024-06-12 10:27:33 +08:00
Haojun Liao a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
dapan1121 fee3cd9570
Merge pull request #26103 from taosdata/fix/TD-30519
fix: first dynamic data filter issue
2024-06-11 18:34:28 +08:00
dapan1121 e17cdf84c2 fix: count always true for group by tbname performance issue 2024-06-11 18:08:34 +08:00
dapan1121 bee01f9dba
Merge pull request #26081 from taosdata/enh/stmtPerf.3
enh: optimize stmt performance
2024-06-11 16:12:58 +08:00
Hongze Cheng d321fbbc87
Merge pull request #26005 from taosdata/enh/TS-3737-3.0
enh: support createdb permission for user
2024-06-11 15:46:00 +08:00
dapan1121 6b1d4b842e fix: case when memory leak 2024-06-11 15:28:04 +08:00
dapan1121 7cc3eeee3d fix: first dynamic data filter issue 2024-06-11 15:03:17 +08:00
Haojun Liao 00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
kailixu 4c9b66c42c Merge branch '3.0' into enh/TS-3737-3.0 2024-06-10 19:55:39 +08:00
Haojun Liao 20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao 895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
“happyguoxy” 16ceacac2b fix: no tag value 2024-06-07 20:12:18 +08:00
Hongze Cheng 9db638b2ba
Merge pull request #26027 from taosdata/fix/fixInvalidRead30
Fix/fixInvalidRead30
2024-06-07 17:37:37 +08:00
“happyguoxy” 6d98a56778 fix group count 2024-06-07 16:49:29 +08:00
kailixu ffa235edbd fix: check range option 2024-06-07 16:10:27 +08:00
kailixu 054cb9b64a Merge branch '3.0' into enh/TS-3737-3.0 2024-06-07 14:09:23 +08:00
Haojun Liao cbd9f86a34
Merge pull request #26065 from taosdata/fix/3_liaohj
fix(stream): always load the data for fill-history scan.
2024-06-07 14:01:50 +08:00
kailixu a8788ec3a6 enh: check range for user enable/sysinfo/createdb 2024-06-07 13:30:10 +08:00
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
kailixu 7de2928c86 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-07 10:28:22 +08:00
dapan1121 4d12374b3f fix: enable remote write 2024-06-07 09:35:25 +08:00
dapan1121 3f99e5e064 fix: memory issues 2024-06-07 09:25:17 +08:00
kailixu 13a0183599 check enable/sysinfo range 2024-06-07 09:04:28 +08:00
Haojun Liao 385e1a8b0d refactor: do some internal refactor. 2024-06-06 23:55:54 +08:00
Haojun Liao 88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao 420cbc36e5 other: fix syntax error. 2024-06-06 17:40:17 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
kailixu 2f5179cf44 Merge branch '3.0' into enh/TS-3737-3.0 2024-06-06 16:42:04 +08:00
Haojun Liao 2da9476e48 fix(stream): always load the data for fill-history scan. 2024-06-06 14:18:04 +08:00
Hongze Cheng 070ec1412e
Merge pull request #26048 from taosdata/enh/TS-4885
enh/wal_level: new level 0 to disable wal writing
2024-06-06 10:19:50 +08:00
kailixu 4beaf871b7 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-06 08:33:48 +08:00
Minglei Jin 11b26d80b7 wal_level 0: update unit & tsim test cases 2024-06-05 18:22:23 +08:00
dapan1121 ddf15fa55c Merge remote-tracking branch 'origin/3.0' into enh/stmtPerf.3 2024-06-05 17:13:48 +08:00
dapan1121 da8616d98a fix: add stbInterlace mode test cases 2024-06-05 17:12:15 +08:00
dapan1121 95c4b7748f
Merge pull request #26047 from taosdata/fix/TD-30214
add ts column for last cache
2024-06-05 16:32:12 +08:00
Minglei Jin fdc2de2bd0 fix/wal_level 0: error with wal_level 0 to replica > 1 2024-06-05 15:47:09 +08:00
Minglei Jin d6b2bcba68 enh/wal_level: new level 0 to disable wal writing 2024-06-05 15:19:55 +08:00
kailixu c89f06eaf3 chore: adjust test case 2024-06-05 14:56:47 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
kailixu ee9ccdea86 Merge branch '3.0' into feat/TD-30053-3.0 2024-06-05 12:38:09 +08:00
54liuyao 545fa5ebcb add ts column for last cache 2024-06-05 11:38:38 +08:00
dapan1121 2b3ed37b47
Merge pull request #26036 from taosdata/fix/TS-4955
fix: insert into select constant issue
2024-06-05 11:04:43 +08:00
Haojun Liao 8f1e999638
Merge pull request #26029 from taosdata/feat/ly_stream
set scan mode for stream
2024-06-05 10:51:38 +08:00
kailixu b8069ed33c Merge branch '3.0' into enh/TS-3737-3.0 2024-06-05 09:42:39 +08:00
Hongze Cheng 4490cd7db3
Merge pull request #26040 from taosdata/enh/lsg-restore-3.0
enh: add more log for restore
2024-06-05 09:11:42 +08:00
Haojun Liao bf9a5135fb fix(stream): disable timer for checkpoint-ready msg in rsma. 2024-06-05 00:13:57 +08:00
factosea 7a8e87f8cd fix: slot id 2024-06-04 19:05:19 +08:00
Haojun Liao 2ff79c81d7 enh(query): allocate the compress buffer before compress data. 2024-06-04 17:47:50 +08:00
Shungang Li 1f73bb106e enh: add more log for restore 2024-06-04 17:14:59 +08:00
Haojun Liao 3fc20f761f
Merge pull request #26021 from taosdata/fix/TD-30303
coverity scan for stream
2024-06-04 16:55:06 +08:00
kailixu 2f222514dc chore: merge 3.0 2024-06-04 16:34:02 +08:00
dapan1121 6f696a3933 fix: insert into select constant issue 2024-06-04 16:27:51 +08:00
Haojun Liao 6d7e1eb576 fix(query): check for the server ep and client ep to set the compress flag. 2024-06-04 15:07:02 +08:00
factosea c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao 4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
54liuyao 5ab81da4a0 set scan mode for stream 2024-06-04 09:50:26 +08:00
Yihao Deng 66cb3e1576 fix invalid read 2024-06-03 11:40:54 +00:00
dapan1121 86cadeabba fix: stmt write issue 2024-06-03 19:24:53 +08:00
Haojun Liao 407f79cfa6 fix(stream): fix dead-lock. 2024-06-03 19:14:45 +08:00
dapan1121 91375c8ca1 fix: taosc exit issue 2024-06-03 19:13:14 +08:00
Haojun Liao 0c8e9046f6
Merge pull request #26015 from taosdata/fix/TD-3036
adj stream count state buff
2024-06-03 19:03:24 +08:00
54liuyao 3e38c1f973 coverity scan for 2024-06-03 19:01:24 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
54liuyao 1ad25599ca init delete mark 2024-06-03 16:41:38 +08:00
dapan1121 3c98aa1b3d
Merge pull request #26006 from taosdata/fix/3.0/TS-4879
fix exchange operator memory access problem
2024-06-03 16:30:18 +08:00
Haojun Liao 5a575dc53f
Merge pull request #25998 from taosdata/fix/TD-30343
when dst table has composite primary key, need to delete result
2024-06-03 16:25:32 +08:00
Haojun Liao 927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
Hongze Cheng 6f72fd4170
Merge pull request #25996 from taosdata/feat/TD-30006-3
Feat/TD-30006-3
2024-06-03 15:41:47 +08:00
54liuyao ca7e1344e1 adj stream count state buff 2024-06-03 15:22:12 +08:00
wangjiaming0909 6fcd071144 fix exchange operator memory access problem 2024-06-03 13:57:35 +08:00
dapan1121 affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Yihao Deng ac2d9ab276 add error 2024-05-31 11:41:05 +00:00
Yihao Deng 69e402d547 add error 2024-05-31 11:40:54 +00:00
Yihao Deng 9f0d6eddae add error 2024-05-31 11:40:08 +00:00
factosea a6217eec03 partition interval and limimt, dataload error 2024-05-31 18:58:35 +08:00
Yihao Deng 9fb329f481 add error 2024-05-31 08:08:54 +00:00
kailixu 4ae8aeb909 Merge branch '3.0' into enh/TS-3737-3.0 2024-05-31 15:48:19 +08:00
54liuyao a77c6940da when dst table has composite primary key, need to delete result 2024-05-31 15:22:38 +08:00
Yihao Deng fd385d7c52 support add column compress 2024-05-31 06:41:36 +00:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Yihao Deng c253ac73a9 support add column compress 2024-05-31 06:27:54 +00:00
Haojun Liao bef1953b24
Merge branch '3.0' into fix/3_liaohj 2024-05-31 14:27:46 +08:00
Yihao Deng 116409d73f merge 3.0 2024-05-31 02:53:36 +00:00
Yihao Deng 5293c4a1dd Merge branch '3.0' into feat/TD-30006 2024-05-31 02:49:58 +00:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Yihao Deng c6407277dc support add column compress 2024-05-30 11:41:22 +00:00
dapan1121 4f67ccc5d5
Merge pull request #25935 from taosdata/fix/3.0/TD-30188
fix select from union all caused crash
2024-05-30 15:45:44 +08:00
Haojun Liao 5768cc94a1 Merge branch '3.0' into fix/3_liaohj 2024-05-30 15:35:00 +08:00
dapan1121 c0e4ab20a4 enh: optimize stmt performance 2024-05-30 13:26:17 +08:00
Yihao Deng 5a91039f04 TD-30340 2024-05-30 03:00:56 +00:00
dapan1121 f09135abed
Merge pull request #25968 from taosdata/fix/TD-30108
fix: add ut thread join
2024-05-30 08:46:18 +08:00
Haojun Liao 0946f25e5f fix(stream): fix syntax error. 2024-05-29 22:36:22 +08:00
Haojun Liao becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
dapan1121 a98394949a fix: add ut thread join 2024-05-29 17:20:56 +08:00
Haojun Liao 46ca55ac74 fix(stream): avoid deadlock. 2024-05-29 15:20:35 +08:00
Haojun Liao 27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao 09efbad117 fix(stream): drop related fill history task. 2024-05-29 11:16:26 +08:00
dmchen 5283ca87ed fix/TD-30307 2024-05-29 03:08:15 +00:00
Haojun Liao a9abe78eab other: comment invalid sleep for test purpose 2024-05-29 09:16:37 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao 8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao c3c6b680fb Merge branch '3.0' into fix/3_liaohj 2024-05-28 17:29:22 +08:00
Hongze Cheng 913612e4a6
Merge pull request #25913 from taosdata/enh/TS-4723-3.0
enh: reduce compact block write time
2024-05-28 13:18:57 +08:00
Haojun Liao cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
Haojun Liao 230631a535
Merge pull request #25943 from taosdata/fix/TD-30028
fix(query): check if pSliceIno->pPrevGroupKey is initialized or not.
2024-05-28 11:08:47 +08:00
54liuyao 7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao a9ca820b06 fix(query): check if pSliceIno->pPrevGroupKey is initialized or not. 2024-05-27 22:31:02 +08:00
dapan1121 99859c30ed
Merge pull request #25932 from taosdata/fix/TD-30190
Fix/td 30190
2024-05-27 18:53:21 +08:00
wangjiaming0909 fd34087b8c fix select from union all caused crash 2024-05-27 16:20:13 +08:00
dapan1121 a25b70c45c fix: add timeline test cases 2024-05-27 14:53:30 +08:00
Hongze Cheng 72736ba7b9 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-27 09:33:33 +08:00
Haojun Liao 03a5230bd7
Merge pull request #25923 from taosdata/fix/TD-30028
fix(stream): fix memory leak if write failed.
2024-05-25 00:40:14 +08:00
Haojun Liao 01fb950cbc refactor: add some logs. 2024-05-24 11:44:17 +08:00
Haojun Liao d001a87a58 Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2024-05-24 11:42:04 +08:00
Haojun Liao 89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00