xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
63,621 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

14089 Commits

Author SHA1 Message Date
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220 5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220 a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
Haojun Liao ecdcc6dee1
Merge pull request #24738 from taosdata/fix/3_liaohj 
test(stream): add unit test case for the mnode stream module.
 2024-02-05 13:32:46 +08:00
dmchen 5c7f839da8 remove tmp log 2024-02-05 03:28:33 +00:00
Haojun Liao fc218a1f69 fix(test): fix syntax errors on windows. 2024-02-05 11:09:19 +08:00
wade zhang 0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-05 10:32:34 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen 16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao 3533f7ecea Merge branch '3.0' into fix/3_liaohj 2024-02-05 09:23:29 +08:00
kailixu 196256d9af feat: support uniq grant 2024-02-05 09:23:19 +08:00
kailixu 7e5dc8a024 feat: support uniq grant 2024-02-05 09:21:11 +08:00
Haojun Liao 3111a01a12 test: add unit test files. 2024-02-05 09:10:43 +08:00
Haojun Liao 739485a419 test(stream): add unit test case for the mnode stream module. 2024-02-05 09:10:04 +08:00
Haojun Liao 2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj 
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
 2024-02-05 09:00:32 +08:00
dmchen 71d9065d47 tmp log 2024-02-05 00:12:35 +00:00
kailixu 6098538162 feat: support uniq grant 2024-02-04 18:00:02 +08:00
kailixu d281bc70b0 feat: remove hb of grantInfo 2024-02-04 16:46:24 +08:00
kailixu 3ebc26e1fb feat: support uniq grant 2024-02-04 16:33:43 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
kailixu 3a08926319 feat: support uniq grant 2024-02-03 17:32:02 +08:00
kailixu 1a6b491405 Merge branch '3.0' into feat/TD-27463-3.0 2024-02-03 12:11:23 +08:00
Hongze Cheng 89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou 4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan 035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0 
coverage: metaIdx.c comment no use function
 2024-02-02 09:05:51 +08:00
kailixu 231cf000da Merge branch 'feat/TD-27463-3.0a' into feat/TD-27463-3.0 2024-02-02 00:07:15 +08:00
kailixu 67425fce1e feat: support uniq grant 2024-02-01 22:57:56 +08:00
Alex Duan 963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
kailixu adee720128 feat: support uniq grant 2024-02-01 17:48:29 +08:00
Minglei Jin d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao 0fe9c05c5f
Merge pull request #24704 from taosdata/fix/3_liaohj 
fix(stream): take ver snapshot for all vgroups
 2024-02-01 17:07:36 +08:00
Haojun Liao 88f246b988 fix(stream): fix syntax error on windows, and add null ptr check for pTrans obj. 2024-02-01 15:08:06 +08:00
dmchen 907e06ad4d clusterid by taosd 2024-02-01 04:52:54 +00:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
wade zhang eeba6a24ad
Merge pull request #24686 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-01 09:47:14 +08:00
54liuyao 0afed5263e add mid operator retrive 2024-01-31 18:09:13 +08:00
kailixu 1e9c963e02 feat: support uniq grant 2024-01-31 17:22:57 +08:00
kailixu 9458b86b41 feat: support uniq grant 2024-01-31 16:09:06 +08:00
kailixu a860e9039d feat: support uniq grant 2024-01-31 13:52:03 +08:00
kailixu 4ffc4017bd feat: support uniq grant 2024-01-31 13:02:17 +08:00
kailixu ac5fa32867 feat: support uniq grant 2024-01-31 12:36:58 +08:00
dmchen 5cf8687fd7 fix/TD-28519 2024-01-31 04:23:28 +00:00
kailixu f50867831b feat: support uniq grant 2024-01-31 10:43:31 +08:00
kailixu 18ece50f86 feat: support uniq grant 2024-01-31 10:02:44 +08:00
kailixu 41072348b9 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-31 10:02:12 +08:00
kailixu a11410378f feat: support uniq grant 2024-01-31 09:47:10 +08:00
kailixu 93c0890f68 feat: support uniq grant 2024-01-31 09:13:10 +08:00
wade zhang 17e74e76e6
Merge pull request #24679 from taosdata/fix/TD-28503-3.0 
fix/TD-28503
 2024-01-31 09:11:36 +08:00
kailixu 2b1a0cdbfe feat: support uniq grant 2024-01-31 08:53:45 +08:00
kailixu 5fd10d4049 feat: support uniq grant 2024-01-31 00:40:47 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 086943ea5c
Merge pull request #24610 from taosdata/fix/TD-28446 
fix:[TD-28446] modify trans confilct in subscribe
 2024-01-30 17:49:05 +08:00
Haojun Liao 4c22e03c1b
Merge pull request #24642 from taosdata/feat/TD-28247 
feat:[TD-28247]add grant for subscribe and stream
 2024-01-30 17:48:05 +08:00
dmchen 917a6eb5a7 fix/TD-28503 2024-01-30 09:47:20 +00:00
Haojun Liao efbc7e1402 fix(stream): fix memory leak. 2024-01-30 15:35:01 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
Haojun Liao 584b7f236f
Merge pull request #24665 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-30 10:38:19 +08:00
Haojun Liao 11c9c7d936 refactor: do some internal refactor. 2024-01-30 09:17:02 +08:00
Haojun Liao 45891babd3
Merge pull request #24655 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-30 09:15:10 +08:00
dmchen 8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
wangmm0220 51b7cd99d6 feat:[TD-28247]add grant for subscribe and stream 2024-01-29 14:28:48 +08:00
Haojun Liao b714c70434 refactor: do some internal refactor. 2024-01-29 13:46:33 +08:00
Haojun Liao f4f01e4bf4
Merge pull request #24654 from taosdata/fix/3_liaohj 
feat(stream): drop orphan tasks.
 2024-01-29 13:10:47 +08:00
Haojun Liao 9087a0d9d0 feat(stream): drop orphan tasks. 2024-01-29 11:03:50 +08:00
kailixu 80b1ad77d6 feat: support uniq grant 2024-01-28 21:24:30 +08:00
kailixu e0d61c40f5 feat: support uniq grant 2024-01-26 19:06:56 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 18:08:54 +08:00
Hongze Cheng e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng 09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
wangmm0220 35e2b681c7 fix:conflicts from 3.0 2024-01-26 16:32:40 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
Haojun Liao 50b59ad936 fix(stream): add null ptr check. 2024-01-26 16:08:01 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
wangmm0220 ce2a3e4be2 fix:test case error 2024-01-26 15:35:29 +08:00
wangmm0220 bd2bef2428 fix:add test case 2024-01-26 15:05:31 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao 9b3b03caab refactor: do some internal refactor. 2024-01-26 10:22:16 +08:00
Haojun Liao bc7fe1fe6a refactor: do some internal refactor. 2024-01-26 10:08:20 +08:00
Haojun Liao bd1d1cddaf refactor: do some internal refactor. 2024-01-26 10:03:54 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 09:09:44 +08:00
wangmm0220 474514ab66 fix:test case error 2024-01-25 17:29:55 +08:00
Haojun Liao 43c035678f refactor: do some internal refactor. 2024-01-25 16:55:05 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj 
fix(stream): do checkpoint after fill-history task completed.
 2024-01-25 16:53:11 +08:00
wangmm0220 2798ff824c feat:[TD-28247]add grant for subscribe and stream 2024-01-25 16:07:09 +08:00
Hongze Cheng e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng 7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao 7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
Hongze Cheng 9d9306a03b
Merge pull request #24612 from taosdata/fix/TD-28437-3.0 
fix/TD-28437
 2024-01-25 10:01:29 +08:00
dmchen f6ecd8d204 keep old protocal 2024-01-25 01:37:32 +00:00
kailixu 4d345b819a feat: support uniq grant 2024-01-24 19:08:19 +08:00
dmchen d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Haojun Liao dc1ea9f9a1 fix(stream): clear htask info when unregistering the task. 2024-01-24 16:23:47 +08:00
kailixu e13e61f4d5 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-24 14:26:17 +08:00
Hongze Cheng 82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0 
fix: no retry for ttl drop table
 2024-01-24 14:03:18 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Hongze Cheng 77e36f401f
Merge pull request #24591 from taosdata/FIX/TD-28415-3.0 
enh: trigger vnodeCommit at exit even if no data changed
 2024-01-24 11:12:45 +08:00
dmchen 262bb4cf12 fix/TD-28437 2024-01-24 02:30:03 +00:00
wade zhang 86272dee4e
Merge pull request #24542 from taosdata/fix/refactorRetry1 
refactor retry
 2024-01-24 09:57:55 +08:00
Hongze Cheng 200c57ed8e
Merge pull request #24604 from taosdata/fix/TD-28437-3.0 
fix/TD-28437
 2024-01-24 09:41:31 +08:00
wangmm0220 416c87b5b7 fix:[TD-28446] modify trans confilct in subscribe 2024-01-23 18:48:19 +08:00
Haojun Liao 0cd84aa587 fix(stream): gen checkpoint for single task. 2024-01-23 17:51:50 +08:00
dmchen e65c80d495 fix/TD-28431 2024-01-23 09:43:23 +00:00
dmchen f349bbd51f fix/TD-28437 2024-01-23 09:25:48 +00:00
dmchen 74fdc14ed3 fix/TD-28430 2024-01-23 08:33:12 +00:00
Yihao Deng 2479df3b1e sort epset 2024-01-23 06:42:42 +00:00
Yihao Deng 62e6b5ca31 sort epset 2024-01-23 06:23:34 +00:00
Shungang Li 5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao 192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Shungang Li 6c823efc60 fix: no retry for ttl drop table 2024-01-22 19:55:27 +08:00
kailixu 486e3b7479 feat: support uniq grant 2024-01-22 18:18:01 +08:00
kailixu dbd3c53182 feat: support uniq grant 2024-01-22 13:20:15 +08:00
kailixu 5208829f23 Merge branch '3.0' into feat/TD-27463-3.0 2024-01-22 13:20:00 +08:00
Haojun Liao db474626e6 fix(stream): fix memory leak. 2024-01-22 11:49:16 +08:00
Haojun Liao ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118 
opti:[TD-28118] raw block data for tmq
 2024-01-22 11:47:13 +08:00
Haojun Liao 2cc584ff44 fix(stream): fix error in check vgId. 2024-01-22 11:05:42 +08:00
Yihao Deng a20845ec69 refactor retry 2024-01-22 01:04:06 +00:00
Haojun Liao 4a5ab10b3d fix(stream): fix memory leak. 2024-01-19 20:28:43 +08:00
kailixu b7ea583f3a feat: support uniq grant 2024-01-19 17:01:19 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
Yihao Deng c56ddc1ba9 refactor retry 2024-01-19 07:52:32 +00:00
kailixu 5d6703c3ef feat: support uniq grant 2024-01-19 14:59:02 +08:00
Yihao Deng 6c732a14a3 refactor retry 2024-01-19 06:20:16 +00:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
kailixu 99c493dc5c feat: support uniq grant 2024-01-18 19:40:41 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
kailixu 1daa224651 feat: support uniq grant 2024-01-18 17:49:11 +08:00
factosea b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao 996e2939a9 refactor: do some internal refactor. 2024-01-18 15:58:46 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
kailixu 76558da849 feat: support uniq grant 2024-01-18 15:23:38 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj 
fix(stream): fix some errors and do some internal refactor.
 2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
kailixu bf0205b54d Merge branch '3.0' into feat/TD-27463-3.0 2024-01-17 11:29:47 +08:00
kailixu 95cb004f80 feat: support uniq active code 2024-01-17 11:24:48 +08:00
dapan1121 66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional 
Fix/xsren/td 28204/where optimize conditional
 2024-01-17 10:20:51 +08:00
Haojun Liao a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338 
fix:[TD-28338]empty varchar value return NULL in tmq
 2024-01-17 10:09:40 +08:00
yihaoDeng 0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 0280f129bd fix(stream):add some logs. 2024-01-16 18:21:29 +08:00
Haojun Liao 882b916940 fix(stream): adjust stream trans conflict check. 2024-01-16 16:11:04 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Hongze Cheng c40a87ab0e
Merge pull request #24319 from taosdata/ENH/TD-28135-3.0 
enh: use learner in redistribute vgroup
 2024-01-16 15:04:52 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao d1da8ef986
Merge pull request #24477 from taosdata/fix/fixResumeBug 
fix pause/resume error
 2024-01-16 14:06:20 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock in pause.
 2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003 
Fix : use last row scan when select last_row, last
 2024-01-16 08:50:23 +08:00
Yihao Deng 7a09ba2630 fix pause/resume error 2024-01-15 11:56:38 +00:00
fullhonest fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
Haojun Liao 1296700092
Merge pull request #24433 from taosdata/fix/TD-28188 
fix:[TD-28188]the epset of snode is error because epset is not initil…
 2024-01-15 17:05:11 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-15 10:58:45 +08:00
kailixu 414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao 59ee690301
Merge pull request #24450 from taosdata/fix/3_liaohj 
fix(stream): set error code for return.
 2024-01-12 16:04:14 +08:00
Haojun Liao bc7434e2b5 fix(stream): set error code for return. 2024-01-12 14:49:16 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj 
fix(stream): close the inputQ of the related stream task.
 2024-01-12 13:41:30 +08:00
Haojun Liao cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng 8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30 
fix(tsdb/cache): clear fs state before next open
 2024-01-12 10:38:43 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182 
fix: table merge scan return disordered rows
 2024-01-12 10:16:21 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode 
opt msg on mnd
 2024-01-12 09:36:37 +08:00
Haojun Liao fe839527f3
Merge pull request #24435 from taosdata/fix/TD-28202 
fix:[TD-28202]move tq timer to write thread in mnode
 2024-01-12 09:35:45 +08:00
Minglei Jin aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
kailixu ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
wangmm0220 d3659db2ff fix:[TD-28202]move tq timer to write thread in mnode 2024-01-11 19:22:54 +08:00
wangmm0220 89ca3418af fix:[TD-28188]the epset of snode is error because epset is not initilized 2024-01-11 17:38:15 +08:00
Haojun Liao 9703018f56 fix(stream): add checkpoint status check. 2024-01-11 16:47:51 +08:00
Yihao Deng b0f6709474 split sync/status channel 2024-01-11 07:30:39 +00:00
Yihao Deng 5a1510aa2f split sync/status channel 2024-01-11 07:30:03 +00:00
Yihao Deng 5e1a7c694b split sync/status channel 2024-01-11 07:23:46 +00:00
Yihao Deng 423fa76207 split sync/status channel 2024-01-11 06:01:06 +00:00
yihaoDeng 44146caa9a opt msg on mnd 2024-01-11 13:46:54 +08:00
Haojun Liao 5f7ce21530 refactor: do some internal refactor. 2024-01-11 11:59:29 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
Yihao Deng df235b0adf split sync/status channel 2024-01-11 03:22:34 +00:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220 216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Yihao Deng 3f0236ec17 opt msg on mnode 2024-01-10 06:18:39 +00:00
Yihao Deng 2537adb728 opt msg on mnode 2024-01-10 06:00:44 +00:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
yihaoDeng 9dbddeed16 opt msg on mnd 2024-01-10 10:03:38 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao 273e47a1fb
Merge pull request #24405 from taosdata/fix/optMsgOnMnd 
opt msg on mnode
 2024-01-10 09:43:48 +08:00
Haojun Liao 2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0 
opti:[TD-28142]memory size if block num is too large
 2024-01-10 09:40:07 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Yihao Deng 220cef4a61 opt msg on mnode 2024-01-09 11:02:10 +00:00
Hongze Cheng 7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208 
fix(tsdb/cache): destory brin block with fs loading
 2024-01-09 16:31:41 +08:00
wangmm0220 6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Hongze Cheng a518cba133
Merge pull request #24380 from taosdata/fix/TD-28134-3.0 
fix: possible race condition
 2024-01-09 09:47:01 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng 5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Yihao Deng 1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
Haojun Liao 3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao f7ab55fb71
Merge pull request #24342 from taosdata/fix/TD-28155 
fix:[TD-28155] set consumer lost if all current topic is 0
 2024-01-08 11:39:16 +08:00
Haojun Liao 275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao 29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao 23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao 445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
wangmm0220 f2a1d24ab1 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-05 19:28:40 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
dmchen 8ddff2eecb fix/TD-28073 2024-01-05 07:02:16 +00:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
wade zhang a4f68411ed
Merge pull request #24332 from taosdata/ENH/TD-25112-3.0 
enh: use learner in split vgroup
 2024-01-05 14:26:27 +08:00
wade zhang cab9a243de
Merge pull request #24334 from taosdata/ENH/TD-26498-3.0 
enh: allow to drop an empty dnode, no matter online or not
 2024-01-05 14:16:50 +08:00
kailixu 1169fe357a feat: uniq grant 2024-01-05 00:53:38 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988 
fix: remove useless code
 2024-01-04 19:03:45 +08:00
wangmm0220 bd64a78094 fix:[TD-28155] set consumer lost if all current topic is 0 2024-01-04 18:53:37 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Benguang Zhao b85f36bcea enh: allow to drop an empty dnode, no matter online or not 2024-01-04 12:00:49 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0 
enh: send rsp msg on rejecting snap replication due to smaller term
 2024-01-04 10:15:09 +08:00
Benguang Zhao f4ad4ea998 enh: use learner in split vgroup 2024-01-04 10:01:05 +08:00
wade zhang 5aae347566
Merge pull request #24330 from taosdata/fix/TS-4419 
fix: refactor logdebugs
 2024-01-04 09:58:51 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813 
enh: support group by tag/tbname to list empty groups
 2024-01-04 09:08:03 +08:00
Haojun Liao 1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
Shungang Li de631e20a5 fix: refactor logdebugs 2024-01-03 19:57:22 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
Haojun Liao 3fea717373 fix(stream): discard the orphan tasks. 2024-01-03 19:28:49 +08:00
Haojun Liao b06ccc0ca7 fix(stream): cleanup the checkpoint trans & task info in execInfo 2024-01-03 19:18:06 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104 
fix: last table scan reported invalid param when col was dropped which
 2024-01-03 15:47:33 +08:00
Haojun Liao 284ef7d085 fix(stream): remove the related checkpoint trans when trying to drop stream. 2024-01-03 14:44:04 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj 
refactor: remove stream-scan-history event for stream task.
 2024-01-03 14:43:20 +08:00
Benguang Zhao de5f9b351f enh: use learner in redistribute vgroup 2024-01-03 11:49:05 +08:00
Haojun Liao 453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220 ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao 6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream 
fix(tsdb): check if stt blocks are clean before building data blocks.
 2024-01-02 21:30:28 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao 29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao 59642c674d
Merge pull request #24254 from taosdata/fix/TS-3491-3.0 
fix:[TS-4391] rebalance cnt always 1 if msg lost
 2024-01-02 10:34:41 +08:00
Haojun Liao d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909 be0d35a5af fix: last table scan reported invalid param when col was dropped which 
should report invalid col
 2024-01-02 10:20:04 +08:00
Haojun Liao 83172f4580
Merge pull request #24286 from taosdata/fix/crash_stream 
fix(stream): update the stream error code.
 2023-12-29 22:39:24 +08:00
Haojun Liao 7abeb5a27a fix(stream): update the stream error code. 2023-12-29 17:44:10 +08:00
Haojun Liao 8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
wangmm0220 d158ca74d8 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 17:22:27 +08:00
Hongze Cheng 7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
wangmm0220 c83989754f fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 14:09:49 +08:00
wangmm0220 b58a23df49 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-29 13:57:13 +08:00
Benguang Zhao 68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao 1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng 90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988 
fix: remove useless code
 2023-12-27 21:23:26 +08:00
wangmm0220 10e86fc733 fix:[TS-4391] rebalance cnt always 1 if msg lost 2023-12-27 19:25:08 +08:00
Hongze Cheng 2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061 
fix(tsdb/cache): erase entry from lru if deleted
 2023-12-27 18:13:16 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Haojun Liao 130f57859f
Merge pull request #24234 from taosdata/fix/TS-4403_30 
fix tag index double free
 2023-12-26 18:01:01 +08:00
wade zhang 1a215daefa
Merge pull request #24176 from taosdata/FIX/TD-27916-3.0 
enh: demarcate top and bottom halves of task trans execution
 2023-12-26 18:00:41 +08:00
Minglei Jin 2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng 40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Benguang Zhao 7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao 4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Benguang Zhao 2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
wangmm0220 902504b39b fix:partical func parameters for middle interval[checkStreamSTable1.sim] 2023-12-22 15:28:02 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 67edc29a65
Merge pull request #24179 from taosdata/fix/TD-27957-30 
fix snode crash
 2023-12-22 14:41:41 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng 02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974 
fix(tsdb/cache): prepend ts col to load stt
 2023-12-22 13:53:15 +08:00
Minglei Jin 16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng 46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974 
fix(tsdb/cache): plus 1 to nCols to load stt data
 2023-12-22 09:43:20 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
kailixu 3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
yihaoDeng 913fda4a36 fix snode crash 2023-12-21 18:52:25 +08:00
Minglei Jin 9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan 9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
kailixu 47fedce263 chore: more code 2023-12-21 12:11:00 +08:00
Haojun Liao 71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
Benguang Zhao 572368703d enh: ensure mndTransProcessRsp invoked in mnode-write thread 2023-12-21 09:33:56 +08:00
Haojun Liao ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao a0d1933134
Merge pull request #24113 from taosdata/mark/3.0 
opti:logic in parse raw line & make log more specific
 2023-12-20 15:25:26 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
wangmm0220 1f70f51ac8 fix:sdb maxId should use int64* instead of int32* 2023-12-20 11:20:41 +08:00
wangmm0220 dd0afef6f2 fix:set triggerParams=0 in mid interval 2023-12-20 11:00:25 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Benguang Zhao e06f355143 enh: improve logging msg of mndPostMgmtCode 2023-12-19 20:16:33 +08:00
Benguang Zhao f7ab8e99b5 enh: demarcate top and bottom halves of task trans execution to ensure a consistent order 2023-12-19 19:52:11 +08:00
Haojun Liao 2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
wade zhang 8bbf03a695
Merge pull request #24116 from taosdata/fix/release-mem-check-3.0 
release mem check
 2023-12-19 18:13:53 +08:00
kailixu 1f5384ad40 feat: support uniq active code 2023-12-19 18:02:53 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
wangmm0220 78c8ebae7f fix:remove useless code in split logic plan & random choose vnode in stream task & add test case 2023-12-19 16:35:04 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
wangmm0220 81b5f59fa5 Merge branch 'feat/ly_multi_marks' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2023-12-19 10:54:12 +08:00
wangmm0220 3a0af1ea49 fix:aggCnt must bigger than 1 & move msg code to the end to be compatible with old version 2023-12-19 10:53:46 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 579366ec00
Merge pull request #24121 from taosdata/fix/liaohj 
other: merge main into 3.0
 2023-12-18 23:11:36 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin 64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
dmchen 19637fd148 release mem check 2023-12-18 09:32:31 +00:00
kailixu 70006bb711 feat: support alter cluster 2023-12-18 16:34:31 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang 4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845 
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
 2023-12-18 16:27:18 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj 
fix(stream): add check for null ptr and leader .
 2023-12-18 16:24:07 +08:00
WANG MINGMING 6f23b63d9e
Merge branch '3.0' into feat/ly_multi_marks 2023-12-18 16:22:56 +08:00
Minglei Jin 5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
kailixu 9fa90fc953 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-18 14:20:10 +08:00
Benguang Zhao 25ab03e5d3 refact: improve info logging msg in mmProcessWriteMsg 2023-12-18 13:35:21 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao 93f3a3135f
Merge pull request #24104 from taosdata/fix/3_liaohj 
fix(stream): avoid invalid read.
 2023-12-18 11:03:37 +08:00
wangmm0220 64f98744e2 fix:set trigger parms = 0 in source task if levelPlan != 1 2023-12-18 10:57:36 +08:00
Haojun Liao edc3841a2c fix(stream): avoid invalid read. 2023-12-18 09:26:56 +08:00
dmchen dd317d6738 add more log 2023-12-17 11:03:25 +00:00
dmchen 6347792a93 TD-27906 2023-12-17 08:47:51 +00:00
wade zhang 967a259219
Merge pull request #24092 from taosdata/fix/TD-27902 
fix/TD-27902
 2023-12-17 12:31:15 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj 
fix(stream): send checkpoint complete msg to mnode when dropping it.
 2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj 
fix(tsdb): add desc check for clean file block.
 2023-12-16 18:10:15 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash 
Fix/snode backend crash
 2023-12-16 13:13:28 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
dmchen 62672b84a2 fix/TD-27902 2023-12-15 11:39:45 +00:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj 
fix(query): add rows info if blocks exist.
 2023-12-15 18:24:45 +08:00
yihaoDeng bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
dapan1121 50d6f0ed41
Merge pull request #24067 from taosdata/fix/TD-27839-3.0 
fix: update dmodule lib
 2023-12-15 17:44:31 +08:00
Haojun Liao aedc5e6b05 fix(stream): set the correct dst stable name. 2023-12-15 17:16:25 +08:00
Hongze Cheng 4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229 
feat: compact monitor and kill
 2023-12-15 16:20:13 +08:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao 556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0 
fix:core dump if tqOpen error in vnodeOpen
 2023-12-15 13:55:10 +08:00
wangmm0220 812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
kailixu 6f3b578df7 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-15 10:06:44 +08:00
slzhou d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
dmchen 5e7aead4d8 keep killed compact 2023-12-15 01:43:24 +00:00
Yihao Deng 5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220 740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
dmchen 7183fd66a1 keep killed compact 2023-12-15 00:59:56 +00:00
slzhou 5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
kailixu b7bfbdd2b3 Merge branch '3.0' into fix/TD-27839-3.0 2023-12-14 19:48:13 +08:00
dmchen 7bb3d43f4e kill compact 2023-12-14 11:22:07 +00:00
dmchen d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
kailixu 7d18bd9811 chore: reduce the dependencies 2023-12-14 18:49:32 +08:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou 4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
Haojun Liao 0449b5f1bd other: add some logs. 2023-12-14 15:43:59 +08:00
dmchen 1ca0858a97 compact detail log 2023-12-14 07:11:00 +00:00
wade zhang c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0 
revert dependency
 2023-12-14 14:03:04 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-14 13:52:04 +08:00
Haojun Liao 7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
dmchen 606a6fe891 field encode 2023-12-14 03:24:53 +00:00
kailixu e2fcf79089 chore: remove obsolote code 2023-12-14 10:28:56 +08:00
kailixu fa7a09589e Merge branch '3.0' into feat/TD-27463-3.0 2023-12-14 10:27:48 +08:00
dapan1121 7803a717c2
Merge pull request #24051 from taosdata/fix/TD-27839-3.0 
enh: add check and reduce offset dependencies in lib
 2023-12-14 10:19:02 +08:00
kailixu d7e16bb91d chore: merge 3.0 2023-12-14 10:09:32 +08:00
Haojun Liao f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao 8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Cary Xu 46f27a77f1
Update dmMgmt.h 2023-12-13 23:05:46 +08:00
Haojun Liao 26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj 
fix(tsdb): fix error in tsdb read.
 2023-12-13 22:35:08 +08:00
Haojun Liao 105542bb21 fix(stream):handle the case of delete orphaned tasks. 2023-12-13 17:44:00 +08:00
Haojun Liao 88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao 840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
kailixu f685b6c34a enh: reduce offset dependencies in lib 2023-12-13 16:56:45 +08:00
dmchen 04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
wade zhang fe0248afbc
Merge pull request #24029 from taosdata/fix/TS-4251-3.0 
Fix/ts 4251 3.0
 2023-12-13 11:05:51 +08:00
wade zhang 3be9af9765
Merge pull request #24039 from taosdata/FIX/TD-27843-3.0 
enh: resend new snap replication msg on all acked if not finished yet
 2023-12-13 09:51:31 +08:00
dmchen e9cf639adb db is null 2023-12-13 01:04:34 +00:00
dmchen 71020e4812 show command db field is null 2023-12-13 00:53:33 +00:00
dapan1121 8528fb7a15
Merge pull request #23963 from taosdata/enh/xsren/TD-22212/taosQueryParam3.0 
enh: td-22212 taos query param3.0
 2023-12-13 08:24:39 +08:00
dmchen 4c9763d2c1 mem leak 2023-12-12 13:12:04 +00:00
Benguang Zhao b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
wangmm0220 7ba6135f2c fix:error in split plan 2023-12-12 16:37:22 +08:00
dmchen 7e2ce6381f ci case 2023-12-12 07:24:13 +00:00
Hongze Cheng 613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0 
fix(tsdb/cache): remove malloc zero bytes
 2023-12-12 15:22:38 +08:00
factosea d25275713e ctest 2023-12-12 13:59:56 +08:00
dmchen ea9eba5621 fix ci case 2023-12-12 05:34:41 +00:00
dmchen dad76804e8 mem leak 2023-12-12 12:19:43 +08:00
dmchen 1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen 67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
facetosea 33897447cb ctest on linux exclude 2023-12-12 10:37:39 +08:00
Minglei Jin c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
wangmm0220 2e596c1376 opti:build task logic 2023-12-11 14:19:55 +08:00
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj 
fix(tsdb): opt read stt file
 2023-12-09 21:28:52 +08:00
Haojun Liao 9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao 5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
wangmm0220 d6114f90de feat:add configure for agg cnt 2023-12-08 19:00:10 +08:00
Haojun Liao da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
wangmm0220 2a506b3e5e feat:add multi level agg operator for stream task 2023-12-08 18:48:34 +08:00
Haojun Liao 67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
dmchen e8617812ae update progress rsp 2023-12-08 10:17:04 +00:00
kailixu fe01fb635d feat: support uniq grant 2023-12-08 18:07:17 +08:00
Hongze Cheng 853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0 
fix: little fix
 2023-12-08 17:29:24 +08:00
Hongze Cheng f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
wangmm0220 c3cbc1fbce fix:compile error 2023-12-08 16:52:13 +08:00
Haojun Liao 63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
wangmm0220 d1c2a03dc7 fix:conflicts from 3.0 2023-12-08 15:58:52 +08:00
wangmm0220 acfcfdc8b6 opti:build task logic in stream 2023-12-08 15:51:01 +08:00
wangmm0220 b36665c9d6 opti:build task logic in stream 2023-12-08 15:48:44 +08:00
dmchen 0be39ebe77 mem leak 2023-12-08 07:26:20 +00:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang 638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0 
feat: support tsdb snap replication of raw data mode
 2023-12-08 14:36:16 +08:00
Haojun Liao 9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng 16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707 
fix(tsdb/cache): del from mem with time range
 2023-12-08 14:22:08 +08:00
Hongze Cheng b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen 18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00
Haojun Liao 2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao 9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration 
feat: tsdb output in duration order
 2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
kailixu 2309e577c6 feat: support uniq grant 2023-12-07 19:50:16 +08:00
dmchen 348bef49ec message handle 2023-12-07 11:42:32 +00:00
Hongze Cheng aee070918b more dev 2023-12-07 17:37:47 +08:00
kailixu f850ccbfd4 feat: support uniq grant 2023-12-07 16:00:13 +08:00
Benguang Zhao 1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao 5cdf2b0b04 fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close 2023-12-07 15:29:42 +08:00
Benguang Zhao 28e1d83662 fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData 2023-12-07 15:29:42 +08:00
Benguang Zhao 52672657c1 feat: toggle tsdb snap replication mode by snap info handshake ahead of time 2023-12-07 15:29:42 +08:00
Benguang Zhao ef34176e37 fix: close data file readers in tsbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c4c0242fd refact: adjust logging format in tsdbSnapRAWReaderOpen 2023-12-07 15:29:42 +08:00
Benguang Zhao f136266972 feat: support snap replication by file blocks 2023-12-07 15:29:42 +08:00
Benguang Zhao 1dc9019baa feat: add tsdbSnapRAWRead into vnodeSnapRead 2023-12-07 15:29:42 +08:00
Benguang Zhao ae60e1f810 refact: add tsdbSnapRAWReaderIterNext 2023-12-07 15:29:42 +08:00
Benguang Zhao a504007ade refact: alloc just enough memory for snap data in tsdbSnapRAWReadData 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c419423de feat: impl tsdb snapshot reader and writer for raw files 2023-12-07 15:29:42 +08:00
Benguang Zhao a4c504169d feat: add file tsdbFSetRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao da646b5a5b feat: add file tsdbDataFileRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao e05914119e feat: add file tsdbSnapshotRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao fe258e226d feat: add data type of SNAP_DATA_RAW for snap replication 2023-12-07 15:29:42 +08:00
Benguang Zhao de9c9d4f20 refact: improve code of tsdbPartitionInfoSerialize 2023-12-07 15:28:14 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Benguang Zhao f68804322c refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription 2023-12-07 15:28:14 +08:00
Benguang Zhao ed39c9a572 refact: rename snap range to fset range in tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 3550347f0c refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot 2023-12-07 15:28:14 +08:00
Benguang Zhao 962febef02 refact: rename tsdb snap range to tsdb fset range 2023-12-07 15:28:14 +08:00
Benguang Zhao ed916b1a80 refact: rename tsdb snap partition to fset partition 2023-12-07 15:28:14 +08:00
Benguang Zhao 20b5cf8d49 refact: remove redundent includes from tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 4487eeacb5 refact: improve funcs dealing with SnapInfo for vnode snap reader and writer 2023-12-07 15:28:14 +08:00
Benguang Zhao b8b53a4b0e refact: put source code of snap info into tsdbSnapInfo.c 2023-12-07 15:28:06 +08:00
Benguang Zhao 3ad68bdfea enh: add tsdbSnapInfo.c 2023-12-07 15:20:55 +08:00
Benguang Zhao ddcabcfa4a refact: remove unused fn tSerializeSnapRangeArray 2023-12-07 15:20:55 +08:00
Benguang Zhao e429526789 refact: rename STSnapRange to STFileSetRange 2023-12-07 15:20:55 +08:00
kailixu 4adce7ed52 feat: support uniq grant 2023-12-07 14:11:41 +08:00
dmchen 27a86a6faa debug info and default setting 2023-12-07 03:13:23 +00:00
kailixu 780f3d9cad Merge branch '3.0' into feat/TD-27463-3.0 2023-12-06 19:14:24 +08:00
kailixu b015077120 feat: support uniq grant 2023-12-06 19:13:54 +08:00
dapan1121 30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327 
fix: last/last_row crash with dropped column
 2023-12-06 17:57:24 +08:00
Minglei Jin a9309cb295 fix(tsdb/cache): del from mem with time range 2023-12-06 17:52:15 +08:00
factosea f01241f720 Merge branch 'fix/xsren/TD-22212/taosQueryParam3.0' into enh/xsren/TD-22212/taosQueryParam3.0 2023-12-06 17:39:25 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
kailixu 67fd9993b0 feat: support uniq grant 2023-12-06 15:30:26 +08:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Haojun Liao 85c7dc76e9
Merge pull request #23948 from taosdata/mark/3.0 
fix:offset out of range if poll offset is read from offsetRestored wh…
 2023-12-06 09:12:38 +08:00
wangmm0220 fc9dfc77d0 fix:add plan for multi agg operator in stream 2023-12-05 20:07:20 +08:00
wangmm0220 cc51fd47d0 fix:offset out of range if poll offset is read from offsetRestored while wal is deleted 2023-12-05 19:09:29 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
wangjiaming0909 a6c876bbc1 fix: last/last_row crash with dropped column 2023-12-05 14:16:01 +08:00
Minglei Jin e0a14bd359 fix(tsdb/cache): remove debug log 2023-12-05 14:05:16 +08:00
Haojun Liao 9d451ab56e
Merge pull request #23934 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-05 12:58:18 +08:00
wangmm0220 79c8a1494d fix:disable snode unit test temporary 2023-12-05 11:26:12 +08:00
Haojun Liao cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj 
enh(tsdb): extract rows for the given tables in all stt files.
 2023-12-04 19:21:19 +08:00
Hongze Cheng 26774f87c9
Merge pull request #23920 from taosdata/fix/TD-27619 
fix: bg task memory waste
 2023-12-04 18:10:30 +08:00
Haojun Liao 7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao 6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
Hongze Cheng ac2d9ebc27 fix: memory leak 2023-12-04 16:48:43 +08:00
slzhou 8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao 24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou 07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Hongze Cheng cea4be6f3c fix: bg task memory waste 2023-12-04 13:40:28 +08:00
kailixu e623c9c3c8 feat: support machine id 2023-12-04 11:44:02 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
Haojun Liao 5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao 7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao 29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
kailixu 042291c35b feat: support machine id 2023-12-01 18:15:47 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao 3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj 
fix(stream): merge fix from main to 3.0
 2023-12-01 16:39:38 +08:00
shenglian zhou bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
Haojun Liao 4d9211dcf1
Merge pull request #23899 from taosdata/fix/liaohj 
other: merge the patch of stream from 3.0 branch.
 2023-12-01 15:49:54 +08:00
slzhou 82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao 7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455 
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
 2023-12-01 14:18:58 +08:00
wade zhang 041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0 
enh: limit size of snap replication msg by data length
 2023-12-01 14:06:36 +08:00
Haojun Liao 33ad05e2c8 fix(stream): fix syntax error. 2023-12-01 13:08:25 +08:00
slzhou 4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao 12f32f0ae7 fix(stream): fix syntax error. 2023-12-01 11:57:16 +08:00
Haojun Liao dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao 18273b8d1b fix(stream): ignore the in_progress code. 2023-12-01 10:20:45 +08:00
Haojun Liao 2972f5f420 fix(stream):return the error code if create stream failed. 2023-12-01 10:20:45 +08:00
Haojun Liao e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao 1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
Haojun Liao 86618ffd97 refactor: do some internal refactor. 2023-12-01 10:20:38 +08:00
Haojun Liao 31ae46925d fix(stream): fix invalid free. 2023-12-01 10:20:32 +08:00
Haojun Liao 17d4a22e47 fix(stream): add logs. 2023-12-01 10:19:54 +08:00
Haojun Liao b9c727575d fix(stream): reset the scheduler status. 2023-12-01 10:19:54 +08:00
Haojun Liao c937f42d88 fix(stream): fix deadlock. 2023-12-01 10:19:54 +08:00
Haojun Liao 8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao 9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao 523573844a fix(stream): fix syntax error. 2023-12-01 10:18:24 +08:00
Haojun Liao eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao 60fa7cccbf fix(stream): fix memory leak. 2023-12-01 10:17:14 +08:00
dapan1121 32030ca130
Merge pull request #23886 from taosdata/revert-23730-enh/TD-26976-3.0 
Revert "enh:  grant and active codes"
 2023-11-30 19:04:50 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220 4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
Haojun Liao 999afd97e5 other: merge 3.0 2023-11-30 14:36:18 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Haojun Liao de82aba2e5 fix(stream): ignore the in_progress code. 2023-11-30 14:32:14 +08:00
Haojun Liao 71860bfb46 fix(stream):return the error code if create stream failed. 2023-11-30 13:57:00 +08:00
Hongze Cheng 0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0 
feat: backgroud task priority
 2023-11-30 13:51:57 +08:00
Haojun Liao e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend 
Enh/refactor backend
 2023-11-30 13:48:18 +08:00
Hongze Cheng 8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571 
fix(tsdb/cache): flush dirty lru entries before del
 2023-11-30 13:46:50 +08:00
Cary Xu f96044e09f
Revert "enh: grant and active codes" 2023-11-30 13:39:54 +08:00
slzhou 80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING 9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng 547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
Minglei Jin ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao 28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao 66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng 65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin 2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220 4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou 1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou 09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou 4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou 8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou 765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
kailixu b54f5b47ad fix: reserve enough buffer for user 2023-11-28 17:58:54 +08:00
shenglian zhou 5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou 4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou 89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
yihaoDeng 786383118c fix drop stream case 2023-11-28 10:39:17 +08:00
shenglian zhou cdb7eb462d Revert "Revert "fix: pass compilation"" 
This reverts commit 644dbad920.
 2023-11-28 10:31:18 +08:00
shenglian zhou df4f7d6956 Revert "Revert "enhance: duration notification"" 
This reverts commit 3331e25aaf.
 2023-11-28 10:31:18 +08:00
Haojun Liao 6bb30822c2 refactor: do some internal refactor. 2023-11-28 10:04:22 +08:00
Haojun Liao 9649db9003 fix(stream): fix invalid free. 2023-11-28 10:04:14 +08:00
Haojun Liao 8b406c0a19
Merge pull request #23830 from taosdata/fix/liaohj 
fix(stream): fix invalid free.
 2023-11-28 09:52:28 +08:00
shenglian zhou 3331e25aaf Revert "enhance: duration notification" 
This reverts commit 9dd306e1ef.
 2023-11-28 08:29:05 +08:00
shenglian zhou 644dbad920 Revert "fix: pass compilation" 
This reverts commit 1a7ee3643e.
 2023-11-28 08:28:49 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
Haojun Liao b419650116 refactor: do some internal refactor. 2023-11-27 18:51:30 +08:00
Haojun Liao 91eea02258 fix(stream): fix invalid free. 2023-11-27 18:49:22 +08:00
wangmm0220 02575e0f28 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-27455 2023-11-27 18:15:53 +08:00
wangmm0220 d007d31c4d fix:process snode when drop stream 2023-11-27 18:15:09 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng 630f4f9d80 Merge branch '3.0' into enh/refactorBackend 2023-11-27 13:53:33 +08:00
yihaoDeng e483570cd7 Merge branch '3.0' into enh/refactorBackend 2023-11-27 11:10:56 +08:00
Haojun Liao e85c6349a4
Merge pull request #23818 from taosdata/fix/TD-27455 
fix:add O_CLOSEXEC for .running & process snode when drop stream
 2023-11-27 11:01:24 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121 d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0 
fix: add check in mnode/vnode when alter table col/tag
 2023-11-26 17:31:38 +08:00
Haojun Liao 9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao 30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao 788194c748 fix(stream): fix deadlock. 2023-11-24 22:53:55 +08:00
wangmm0220 ff0828fcc2 fix:add O_CLOSEXEC for .running & process snode when drop stream 2023-11-24 18:30:58 +08:00
wangmm0220 f8477204e1 fix:[TD-27475] send msg to snode wher drop stream to avoid pVgObj is NULL 2023-11-24 18:00:19 +08:00
yihaoDeng 6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
Haojun Liao f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
Haojun Liao d51baab9c2
Merge pull request #23785 from taosdata/fix/liaohj 
other: merge fix from 3.0 to main.
 2023-11-24 14:43:02 +08:00
Haojun Liao d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-11-24 14:42:43 +08:00
yihaoDeng 23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
Hongze Cheng 24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423 
fix(tsdb/skip-row): remove s3 size condition
 2023-11-24 10:48:03 +08:00
dapan1121 26fe05bb30
Merge pull request #23805 from taosdata/fix/slowReport 
fix: slow down report when error occurs
 2023-11-24 09:18:27 +08:00
Minglei Jin b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
wade zhang 95b5fbbb1a
Merge pull request #23801 from taosdata/enh/PI-25-3.0 
enh: trigger vnode commit at exit if meta changed
 2023-11-24 08:59:24 +08:00
kailixu ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu 9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
wangmm0220 55a4181e5e fix:add O_CLOEXEC for .running lock file to prevent inherited by child processes(rsync) 2023-11-23 20:16:54 +08:00
dmchen 522c848489 clean code 2023-11-23 11:53:14 +00:00
dmchen 75810bbdbb audit 2023-11-23 11:26:14 +00:00
dmchen 682ad9dd96 msg epset 2023-11-23 10:16:18 +00:00
Haojun Liao 2e922fefc6 fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-11-23 18:04:09 +08:00
wade zhang 0e8130b195
Merge pull request #23787 from taosdata/FIX/TD-27473-3.0 
enh: skip request to restore a vnode of single replica in failed mode
 2023-11-23 17:54:08 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin 3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin 9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
dapan1121 699c14e781 fix: slow down report when error occurs 2023-11-23 16:51:07 +08:00
kailixu 14f163a795 Merge branch '3.0' into fix/PI-23-3.0 2023-11-23 16:49:19 +08:00
Benguang Zhao f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin 3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Haojun Liao 810eb8e0e3 fix(stream): fix syntax error. 2023-11-23 16:25:12 +08:00
Minglei Jin f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin 460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Haojun Liao de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
dmchen cf4b3ec49f clean code 2023-11-23 08:02:37 +00:00
Minglei Jin c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin 08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
dmchen bbbdec5db7 update progress 2023-11-23 07:36:33 +00:00
Haojun Liao 421a154d2a
Merge pull request #23768 from taosdata/fix/fixChkpRespMemleak 
fix mem leak
 2023-11-23 15:29:30 +08:00
Minglei Jin 023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
wade zhang 45bbf89a19
Merge pull request #23786 from taosdata/FIX/TD-27456-3.0 
enh: not allow to acquire a vnode in failed mode from vmAcquireVnode
 2023-11-23 14:20:23 +08:00
kailixu 6e3a62803c fix: add check in mnd when alter table col/tag 2023-11-23 14:08:31 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Benguang Zhao d35bf6186f enh: skip restoring a vnode of single replica in failed mode from vmProcessCreateVnodeReq 2023-11-23 13:16:37 +08:00
dmchen 4e1a355052 mnode for compact 2023-11-23 04:43:28 +00:00
Haojun Liao 0654b9299a fix(stream): fix memory leak. 2023-11-23 11:44:25 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Benguang Zhao 8d70d023b9 enh: adjust a logging msg in vmRestoreVnodeInThread 2023-11-23 10:12:58 +08:00
Benguang Zhao 917246e236 fix: allow to drop a vnode in failed mode 2023-11-23 10:09:41 +08:00
Benguang Zhao 0a4fac7704 enh: not allow to acquire a vnode in failed mode from vmAcquireVnode 2023-11-23 09:48:42 +08:00
Haojun Liao 630b259d7f fix(stream): fix error in stream. 2023-11-23 09:41:07 +08:00
Haojun Liao ff9c0c0df4 fix(stream): fix error in check trans conflict. 2023-11-23 09:38:11 +08:00