Commit Graph

3759 Commits

Author SHA1 Message Date
Ganlin Zhao 23c1aa2db0 fix: fix multithread issue in destroyTimesliceOperator 2023-05-15 17:55:37 +08:00
liuyao 502efb3d01 op stream selectivity buff 2023-05-15 16:26:24 +08:00
Ganlin Zhao b1ead824f8 fix: fix linear interpolation error 2023-05-15 14:26:09 +08:00
liuyao a6570a4327 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-15 11:19:55 +08:00
liuyao 9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
Haojun Liao 43e06b9132 Merge branch '3.0' into feature/3_liaohj 2023-05-12 13:36:02 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
dapan1121 9394afec68
Merge pull request #21144 from taosdata/feat/TD-19801
feat(query): support interp with super table
2023-05-12 11:37:20 +08:00
Ganlin Zhao 83e049812c fix asan error 2023-05-12 10:21:01 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Ganlin Zhao 3bf9cb2d78 fix 2023-05-11 17:28:46 +08:00
Ganlin Zhao 788b521592 Revert "fix"
This reverts commit 9ce1e8ccf4.
2023-05-11 17:20:58 +08:00
Haojun Liao a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Ganlin Zhao 9ce1e8ccf4 fix 2023-05-11 13:23:40 +08:00
Haojun Liao 28c43f0151 fix(stream): add null check. 2023-05-11 11:36:27 +08:00
Haojun Liao 8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Ganlin Zhao 121564de2f add threshold for group result 2023-05-11 10:04:25 +08:00
Haojun Liao dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
Ganlin Zhao 37d607c820 enh: remove group_key from subsidiaries if multiple select function
presents
2023-05-10 18:51:21 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Ganlin Zhao 523f08fe4b return result after finish processing of each group 2023-05-10 11:18:42 +08:00
liuyao 62ccd4bf16 avoid delete data 2023-05-10 09:11:04 +08:00
yihaoDeng 711c475693 fix invalid free 2023-05-09 10:34:14 +00:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Ganlin Zhao e1140d4c15 optimize duplicate timestamp check 2023-05-09 15:05:41 +08:00
Ganlin Zhao 4693c22970 optimize group key storage 2023-05-09 14:06:09 +08:00
wade zhang ebdc1a3234
Merge pull request #20996 from taosdata/fix/TD-23623
enh(cache/rocks): base for rocks put/get
2023-05-09 13:27:33 +08:00
dapan1121 a1eefd25ea fix: count wrong group number issue 2023-05-09 11:33:47 +08:00
Ganlin Zhao 3b10ac29ce use functionType instead of functionName 2023-05-09 11:09:29 +08:00
liuyao eb52e73305 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-08 09:54:00 +08:00
liuyao fc8cab6fe1 recover setSelectValueColumnInfo 2023-05-08 09:53:27 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121 c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347
fix:[TS-3347]set ver to first version if version stored is smaller th…
2023-05-06 18:51:49 +08:00
dapan1121 1de5f84536
Merge pull request #21184 from taosdata/fix/TD-23898-a
fix: fix taosd not exit when press ctrl+c
2023-05-06 17:46:38 +08:00
liuyao 6ceda68365 opt selectivity function 2023-05-06 17:42:38 +08:00
wangmm0220 ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Minglei Jin 596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Ganlin Zhao 33d4e0cc67 fix: fix taosd not exit when press ctrl+c 2023-05-06 15:03:17 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Shengliang Guan af81f91c0f
Merge pull request #21162 from taosdata/FIX/TD-22103-3.0
enh: unify error msg for disk space checking in doInitAggInfoSup
2023-05-06 11:15:57 +08:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao 08ce790cda fix(query): fix memory leak. 2023-05-05 18:20:27 +08:00
Ganlin Zhao 5a1681d91d fix data block not properly saved 2023-05-05 15:24:15 +08:00
Benguang Zhao 0e6de09353 enh: unify error msg for disk space checking in doInitAggInfoSup 2023-05-05 14:53:32 +08:00
Haojun Liao 9b5c205498 fix(stream): set correct ssdatablock for tqRetrieveDataBlock 2023-05-05 13:41:25 +08:00
yihaoDeng a1b9dcf595 fix mem leak 2023-05-05 02:20:11 +00:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao 39cac9d308 refactor: remove log ; 2023-04-29 14:06:26 +08:00
Haojun Liao 8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main
refactor: remove assert.
2023-04-29 00:44:24 +08:00
Haojun Liao 05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
Ganlin Zhao 42df9f587f fix group_key not set properly 2023-04-28 16:41:36 +08:00
Haojun Liao a0d08b7fe4 fix(query): add null ptr check. 2023-04-28 16:29:09 +08:00
Ganlin Zhao 76eea9f7c4 fix group_key check 2023-04-28 14:59:35 +08:00
Haojun Liao b3da6cb224 fix(query): fix syntax error. 2023-04-28 14:56:50 +08:00
Haojun Liao 03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-28 12:53:31 +08:00
Haojun Liao da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
Haojun Liao f850388ed9
Merge pull request #21116 from taosdata/fix/liaohj_main
fix(query): stop tsdbreade ASAP, and do some internal refactor. TD-23249
2023-04-28 11:42:05 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
Haojun Liao 3ac1ce69b6 fix(query): set correct scan flag. 2023-04-28 10:02:37 +08:00
Haojun Liao 6482ef9ad1 refactor: do some internal refactor. 2023-04-28 09:19:53 +08:00
Haojun Liao 8205168428 fix(query): fix memory leak. 2023-04-28 09:16:11 +08:00
Haojun Liao 7adc21028a refactor: do some internal refactor. 2023-04-28 00:23:38 +08:00
Haojun Liao 25010cb11e fix(query): stop tsdbreade ASAP, and do some internal refactor. 2023-04-27 22:21:18 +08:00
kailixu fa822ff286 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-27 19:11:16 +08:00
Haojun Liao ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao 91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
Haojun Liao 17a5691afb refactor: remove assert. 2023-04-27 15:37:33 +08:00
Haojun Liao d83f29dc23 refactor: remove assert. 2023-04-27 15:33:04 +08:00
Haojun Liao e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
Ganlin Zhao 54d82fce8a add reset when switching groups 2023-04-27 11:28:20 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
Ganlin Zhao c64788ad71 fix group restore 2023-04-26 18:37:23 +08:00
Ganlin Zhao 75f76a62ab fix process next group bug 2023-04-26 18:07:19 +08:00
Minglei Jin a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
dapan1121 5db5205e31 fix: schema/tag version update to int32 2023-04-26 13:41:16 +08:00
Ganlin Zhao fc6ca69afa refactor timeslice operator 2023-04-26 11:30:21 +08:00
dapan1121 919d98d393
Merge pull request #21066 from taosdata/szhou/tag-scan-group-slimit
feature: tag scan group and slimit
2023-04-26 11:17:29 +08:00
Ganlin Zhao c56bb64f1c refactor timeslice operator 2023-04-26 11:04:13 +08:00
Ganlin Zhao d4c783b590 check duplicate timestamps 2023-04-26 09:48:43 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Benguang Zhao 12f28a4a43 enh: unify error msg for no disk space 2023-04-25 15:39:11 +08:00
shenglian zhou 93ab81437f enhance: code refactor and operator full implement slimit 2023-04-25 11:08:58 +08:00
liuyao d429e070da fix fill bug 2023-04-24 18:23:35 +08:00
shenglian zhou 758427b3c4 fix: use slimit to indicate group for tag scan 2023-04-24 15:48:20 +08:00
liuyao eca7b68fa0 ignore update 2023-04-24 15:01:56 +08:00
Minglei Jin f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
kailixu b26842e398 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-24 14:19:49 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
liuyao cb2757f967 fix:fill retrive 2023-04-24 09:52:14 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
dapan1121 9e22bd07a4
Merge pull request #21008 from taosdata/szhou/fix-ts3248
fix: when db_name!=xxx can not be used in systable scan index
2023-04-23 09:50:14 +08:00
chenhaoran 7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
Haojun Liao f1e289e9ce
Merge pull request #21006 from taosdata/fix/TS-3082
fix:[TS-3082] change offset to firstver if offset is smller than firs…
2023-04-21 16:07:32 +08:00
kailixu 77a8e3b213 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-21 16:04:09 +08:00
slzhou c971fe1606 fix: when db_name != xxx can not be optimized by uid index 2023-04-21 15:01:35 +08:00
slzhou 5531775f8e fix: when db_name!=xxx is used in systable scan index 2023-04-21 14:59:35 +08:00
wangmm0220 81b0670bd5 fix:[TS-3082] change offset to firstver if offset is smller than firstVer when wal is removed 2023-04-21 11:43:39 +08:00
Haojun Liao e4199a62de fix(stream): fix memory leak. 2023-04-21 10:37:50 +08:00
Haojun Liao f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Minglei Jin 1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
liuyao f2560fd5e9 opt test 2023-04-20 11:50:42 +08:00
yihaoDeng 83cfd5d8b1 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-19 18:01:03 +08:00
yihaoDeng 5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
liuyao 2a74aa317f inc sleep time 2023-04-19 16:41:53 +08:00
Xiaoyu Wang 7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize
feat: last queries with tags output can be read from cache
2023-04-19 14:34:32 +08:00
54liuyao 5b7ccc42ca inc sleep time 2023-04-19 13:38:30 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
Xiaoyu Wang 6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
liuyao db4f7ca55f fix bug 2023-04-18 14:00:28 +08:00
dapan1121 5becc19c3c fix: add debug info 2023-04-18 11:40:20 +08:00
kailixu 50053fdc01 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-18 11:13:30 +08:00
Haojun Liao 97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
dapan1121 8ef7fa9bf8 fix: add group cache hash 2023-04-17 16:33:55 +08:00
dapan1121 bd71cb8870 fix: group cache save issue 2023-04-17 16:09:54 +08:00
dapan1121 20c9cea5f0 fix: free uid list issue 2023-04-17 15:50:25 +08:00
dapan1121 ed3778dc9f fix: nodes free issue 2023-04-17 15:44:15 +08:00
dapan1121 31d187444e fix: grou cache issue 2023-04-17 15:33:54 +08:00
dapan1121 4506813ddb enh: add group cache 2023-04-17 15:14:06 +08:00
Haojun Liao 4ed26bbc19 fix(stream): update the table list api. 2023-04-17 14:08:54 +08:00
kailixu fd3b552357 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-17 11:42:46 +08:00
Haojun Liao eb7f510ccb fix(query): return correct suid to delete sink. 2023-04-17 10:59:24 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao 3ee3b16ebb fix(query): fix the invalid read. 2023-04-14 19:37:58 +08:00
Haojun Liao d420734971 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 18:03:19 +08:00
Haojun Liao ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
liuyao b8ac811f20 fix bug 2023-04-14 17:35:17 +08:00
dapan1121 423ec923ca enh: reuse tsdb cache reader 2023-04-14 14:30:20 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao 5850a3ab01 Merge remote-tracking branch 'origin/enh/rocksRevert' into enh/rocksRevert 2023-04-14 10:37:17 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
liuyao 4906855a8b delete mark 2023-04-14 09:47:56 +08:00
liuyao cb0b4ffbd3 use interval state 2023-04-14 09:38:35 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
liuyao 34bf638f19 fix bug 2023-04-13 16:21:57 +08:00
dapan1121 48f2e26c79 fix: remove protect 2023-04-13 15:59:52 +08:00
dapan1121 1b47b35c3d fix: memory protect issue 2023-04-13 15:23:35 +08:00
dapan1121 945997f22a fix: add memory protect 2023-04-13 15:18:53 +08:00
Xiaoyu Wang a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
dapan1121 e86ffad8ef fix: add debug info 2023-04-13 14:23:12 +08:00
liuyao 259815fd83 scan multiple range 2023-04-13 10:46:38 +08:00
dapan1121 3493fffa2f
Merge pull request #20863 from taosdata/fix/TD-23556
fix: fix max/min(tag) random result
2023-04-13 09:57:18 +08:00
liuyao 8992721e20 refact child cache 2023-04-13 09:15:50 +08:00
Ganlin Zhao 81610773c5 add test cases 2023-04-12 18:40:56 +08:00
liuyao e42caca9c2 delete some log 2023-04-12 17:39:44 +08:00
liuyao 9be89ce00a delete expired check point 2023-04-12 17:33:58 +08:00
dapan1121 ba1219303b fix: add debug info 2023-04-12 15:48:18 +08:00
dapan1121 23920e10c1 enh: optimize log perf 2023-04-12 13:58:29 +08:00
liuyao 20f7838c8f opt interval final window 2023-04-12 13:32:49 +08:00
kailixu 2daab8e65e Merge branch '3.0' into enh/TD-21161-3.0 2023-04-12 13:10:12 +08:00
kailixu 04fa4d2e87 Merge branch '3.0' into enh/TD-21161-3.0 2023-04-12 13:05:47 +08:00
liuyao 6a98d55c2f add ci test 2023-04-12 11:04:57 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
yihaoDeng 29d80b1c76 fix invalid free 2023-04-11 14:04:39 +00:00
Haojun Liao f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00
yihaoDeng 71d161ae38 Merge branch 'enh/rocksRevert' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-11 11:15:41 +00:00
yihaoDeng 911f08b382 Merge branch 'dev3' into enh/rocksRevert 2023-04-11 11:10:33 +00:00
liuyao 4c2d0b5f63 feat:opt final window 2023-04-11 19:10:10 +08:00
liuyao 34ff1322e4 op final window 2023-04-11 19:10:10 +08:00
Haojun Liao 24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081
fix:optimize log & change the length of tag if tag is null in schemaless
2023-04-11 19:01:07 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Ganlin Zhao 0201348bbe add test cases 2023-04-11 17:58:55 +08:00
liuyao 665fbd1b40 disable encode 2023-04-11 17:15:14 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Ganlin Zhao d163a16f3a fix: fix max/min(tag) random result 2023-04-11 15:46:32 +08:00
liuyao 95d81604c7 feat:encode&&decode stream scan op 2023-04-11 14:34:31 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Ganlin Zhao ea6c96df32 fix memory leak 2023-04-11 11:13:23 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
xinsheng Ren 965af6cc82
fix: handle leak (#20836)
* fix: handle leak

* fix: del unused code

---------

Co-authored-by: facetosea <25808407@qq.com>
2023-04-11 09:46:06 +08:00
Ganlin Zhao 3078e2d487 feat(query): INTERP support boolean type 2023-04-10 18:35:35 +08:00
Haojun Liao 497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
liuyao f236457904 feat:add data version 2023-04-10 17:35:16 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
slzhou af5a16b129 fix: set block allocated to false for each call to downstream operator 2023-04-07 18:54:37 +08:00
liuyao 955f8f9f07 feat:optimize get patitionby name 2023-04-07 18:45:09 +08:00
kailixu e976fcb91d Merge branch '3.0' into enh/TD-21161-3.0 2023-04-07 17:51:35 +08:00
wangmm0220 05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
liuyao 1f63859e21 feat:add buff swap 2023-04-07 12:50:59 +08:00
liuyao 0716a4aee8 feat:add check point 2023-04-06 16:45:22 +08:00
Haojun Liao 7e734e3088 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2023-04-06 15:09:06 +08:00
Haojun Liao 665ba407cf fix: fix syntax error. 2023-04-06 15:08:35 +08:00