Commit Graph

10632 Commits

Author SHA1 Message Date
Shengliang Guan 9914657cb0 refactor: adjust sync hb 2022-11-07 23:31:01 +08:00
Shengliang Guan 70d60a764f Merge branch '3.0' into enh/TD-20043 2022-11-07 23:29:53 +08:00
Shengliang Guan 8c97a5c1f2
Merge pull request #17940 from taosdata/feature/3.0_mhli
refactor(sync): delete assert, add error log
2022-11-07 23:26:24 +08:00
Shengliang Guan 848fd58402 enh: adjust sync propose 2022-11-07 21:12:43 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Shengliang Guan 4ddd25a29c enh: adjust sync propose 2022-11-07 20:31:26 +08:00
Shengliang Guan 46e55ba9fb refact: remove config change codes 2022-11-07 20:19:55 +08:00
yihaoDeng a8bb8373f4 avoid rpc send-recv cpu imbalance 2022-11-07 20:08:14 +08:00
Minghao Li d05f9412eb refactor(sync): delete assert, add error log 2022-11-07 19:40:49 +08:00
Shengliang Guan e060de7059 refact: remove config change codes 2022-11-07 19:34:48 +08:00
Haojun Liao b16853983e fix(query): count the correct number of completed sources. 2022-11-07 19:27:35 +08:00
Shengliang Guan 1ddbeb43bb refact: adjust sync log 2022-11-07 19:19:10 +08:00
Shengliang Guan bc072aa654 Merge branch '3.0' into enh/TD-20043 2022-11-07 18:45:44 +08:00
Shengliang Guan 4baafd3417 refact: adjust sync log 2022-11-07 18:44:29 +08:00
Shengliang Guan 854d840915
Merge pull request #17920 from taosdata/enh/3.0_planner_optimize
enh: insert optimize
2022-11-07 18:38:43 +08:00
Shengliang Guan b0f469adb1
Merge pull request #17931 from taosdata/feature/3.0_mhli
fix(sync): when apply queue not empty, can not read
2022-11-07 18:29:53 +08:00
Haojun Liao d016fc9d47 fix(query): set retrieve completed flag for exchange operator. 2022-11-07 18:27:26 +08:00
yihaoDeng 962ed38676 stmt reqid incr one 2022-11-07 18:15:09 +08:00
Haojun Liao 9932fa6bf0 refactor: refactor to avoid spin operator in exchange operator. 2022-11-07 17:48:27 +08:00
dapan1121 3e3354782c
Merge pull request #17930 from taosdata/enh/showWrite
enh: support grant check in vnode query
2022-11-07 17:42:15 +08:00
gccgdb1234 1102a88ad0 bench 2022-11-07 17:35:45 +08:00
Shengliang Guan a1c8db0f88 refact: adjust sync log 2022-11-07 17:35:24 +08:00
Minglei Jin c17f8244be enh(tdb): new interface of meta prep async commit 2022-11-07 16:45:29 +08:00
Minghao Li b6aea6ae17 fix(sync): when apply queue not empty, can not read 2022-11-07 16:40:53 +08:00
dapan1121 5ab6166efe enh: support grant check in vnode query 2022-11-07 16:23:40 +08:00
Haojun Liao 0e11d344cc fix(query): increase the buffer size to 128Kb. 2022-11-07 16:04:13 +08:00
Haojun Liao 088a61bee5 fix(query): release the handle 2022-11-07 16:02:53 +08:00
yihaoDeng 90fc572394 avoid epset leak 2022-11-07 15:32:48 +08:00
Haojun Liao c86427c771 fix(query): enable update buf. 2022-11-07 15:27:09 +08:00
Xiaoyu Wang 00c0a5634e Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-11-07 14:56:35 +08:00
Haojun Liao fea40da5dc other: merge 3.0 2022-11-07 14:31:01 +08:00
Haojun Liao 2a49fed4ad fix(query): remove invalid free. 2022-11-07 14:02:23 +08:00
Haojun Liao 558cf28ae7 other: add log. 2022-11-07 13:26:10 +08:00
Haojun Liao 8ec132be6e other: add log. 2022-11-07 13:25:09 +08:00
Haojun Liao cd29972a4d enh(query): add cache for table meta. 2022-11-07 11:53:23 +08:00
Xiaoyu Wang 758b4b93a4 enh: insert optimize 2022-11-07 11:31:45 +08:00
Haojun Liao f86bfb433c Merge branch '3.0' into fix/liao_cov 2022-11-07 10:20:05 +08:00
Haojun Liao be5b72b25d enh(query): add cache for table meta entry in table scan. 2022-11-07 10:17:42 +08:00
Haojun Liao c1794e0252 refactor: do some internal refactor. 2022-11-07 09:38:44 +08:00
Haojun Liao 270404318c other: merge 3.0 2022-11-07 09:28:22 +08:00
dapan1121 888616f321
Merge pull request #17876 from taosdata/fix/TD-20140
fix(query): fix countAlwaysReturnValue param not taking effect for count and hyperloglog
2022-11-07 09:25:15 +08:00
Haojun Liao 341112923b fix(query): init filter in group operator. 2022-11-06 23:42:04 +08:00
Haojun Liao 2c4c9e69de fix(query): init filter in sys table scan. 2022-11-06 23:15:23 +08:00
Xiaoyu Wang b7bc828172 enh: insert optimize 2022-11-06 18:42:53 +08:00
Haojun Liao f44dd569cc fix(query): remove the invalid capacity changing. 2022-11-06 16:09:19 +08:00
Haojun Liao 10cd3c0f29 fix(query): remove the invalid capacity changing. 2022-11-06 15:18:33 +08:00
Xiaoyu Wang ac2ce21414 enh: insert optimize 2022-11-06 14:26:19 +08:00
Haojun Liao 9d1998d7d2 fix(query): temporarily disable assert. 2022-11-06 11:53:07 +08:00
Haojun Liao e3d0bc6bf7 other: merge 3.0. 2022-11-06 11:37:21 +08:00
Haojun Liao d200fe5145 refactor: do some internal refactor. 2022-11-06 01:34:04 +08:00
Shengliang Guan 47dfd9d3cb
Merge pull request #17917 from taosdata/fix/TD-19245
fix: coverity issues
2022-11-05 21:00:39 +08:00
Shengliang Guan fc7f62d29d
Merge pull request #17901 from taosdata/fix/TD-20174
fix: fix memory leak
2022-11-05 20:01:30 +08:00
Shengliang Guan adb335467c fix: coverity issues 2022-11-05 19:59:18 +08:00
dapan1121 91ff489813
Merge pull request #17899 from taosdata/fix/TD-20170
fix: fix interval query memory leak
2022-11-05 16:44:15 +08:00
dapan1121 1c78e2b4f8
Merge pull request #17909 from taosdata/fix/TD-20183
fix: fix catalog double free issue
2022-11-05 15:38:49 +08:00
dapan1121 7081ebe9e6
Merge pull request #17877 from taosdata/enh/TD-19920
enh: add show rewrite mask in query msg
2022-11-05 15:35:51 +08:00
Xiaoyu Wang 7484ff430c enh: insert optimize 2022-11-05 12:09:11 +08:00
Minghao Li 28377a9f37 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-11-05 10:56:09 +08:00
Minghao Li ddb815ac42 refactor(sync): optimize advance commit index when one replica 2022-11-05 10:54:59 +08:00
Haojun Liao 8bf01cdecb fix(query): fix error in unit test. 2022-11-05 00:02:25 +08:00
Haojun Liao 8c4be7dc21 refactor: do some internal refactor. 2022-11-04 22:13:40 +08:00
dapan1121 4443c7a9eb fix: fix catalog double free issue 2022-11-04 18:50:59 +08:00
Haojun Liao 03f4918b3b refactor: do some internal refactor. 2022-11-04 18:46:48 +08:00
Shengliang Guan 8ce2e12423
Merge pull request #17886 from taosdata/feature/3_liaohj
fix(query): set the last key of each tablescan info
2022-11-04 18:46:17 +08:00
Xiaoyu Wang 80dc658dbb Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-11-04 18:03:21 +08:00
Xiaoyu Wang 91da143ae5 enh: insert optimize 2022-11-04 18:01:39 +08:00
Hui Li cc3de73708
Merge pull request #17893 from taosdata/feature/3.0_mhli
refactor(sync): delete assert
2022-11-04 16:16:17 +08:00
Ganlin Zhao 1204faefb6 fix: fix memory leak 2022-11-04 16:15:37 +08:00
Shengliang Guan 8886785be1
Merge pull request #17853 from taosdata/fix/liao_cov
refactor(query): do some internal  refactor.
2022-11-04 15:58:11 +08:00
Xiaoyu Wang 9ae008235c enh: insert optimize 2022-11-04 15:45:47 +08:00
Xiaoyu Wang 8513dc1067 enh: insert optimize 2022-11-04 15:21:38 +08:00
Minghao Li 47d9fe6422 fix(sync): do not vote when last-index < my cmt index 2022-11-04 15:10:08 +08:00
dapan1121 69d545fb8d fix: fix interval query memory leak 2022-11-04 13:55:54 +08:00
dapan1121 65636154ea fix: fix msg head issue 2022-11-04 10:47:49 +08:00
Minghao Li 1f329f3025 refactor(sync): delete assert 2022-11-04 10:41:36 +08:00
Ganlin Zhao 85748ce8fd Merge branch '3.0' into fix/TD-20140 2022-11-04 09:44:28 +08:00
Haojun Liao 9c33d10ad9 refactor: remove the unnecessary function. 2022-11-04 09:15:14 +08:00
Shengliang Guan a2692a3d4e
Merge pull request #17878 from taosdata/fix/handleTransExcept
fix: handle trans except
2022-11-04 09:07:36 +08:00
Haojun Liao abfa8c1d87 fix(query): add api to memset buffer for filtering data. 2022-11-03 22:05:08 +08:00
Haojun Liao 0315414623 other: merge 3.0 2022-11-03 19:03:09 +08:00
Haojun Liao 4959529127 fix(query): set the last key of each tablescan info 2022-11-03 19:00:13 +08:00
Ganlin Zhao a0e13e04fe fix(query): add mode with selectivity rows 2022-11-03 18:27:43 +08:00
yihaoDeng 2c4d90aad4 handle trans except 2022-11-03 16:55:48 +08:00
dapan1121 ae5f6ef175 enh: add show rewrite mask in query msg 2022-11-03 16:28:48 +08:00
Shengliang Guan 33d64b67ff
Merge pull request #17865 from taosdata/feature/stream
refactor(stream): stream deploy and state transfer
2022-11-03 15:24:39 +08:00
Shengliang Guan c392abb0ad
Merge pull request #17869 from taosdata/feature/3.0_mhli
refactor(sync): add syncIsReadyForRead
2022-11-03 15:23:34 +08:00
dapan1121 62ca522b80
Merge pull request #17861 from taosdata/fix/TD-20086
fix: fix taosd memory leak issue
2022-11-03 15:05:57 +08:00
Ganlin Zhao 0b3a3aff21 fix hll tsCountAlwaysReturnValue not working 2022-11-03 15:01:52 +08:00
Minghao Li 0838afaa18 refactor(sync): add syncIsReadyForRead, set error code 2022-11-03 14:35:42 +08:00
Minghao Li a4b54c4f0e refactor(sync): add syncIsReadyForRead 2022-11-03 13:57:57 +08:00
Shengliang Guan 6cef3fa4fa
Merge pull request #17856 from taosdata/feature/3.0_mhli
enh(sync): add sync pre stop, local-cmd:follower-commit
2022-11-03 13:40:35 +08:00
Liu Jicong 15ad147c40 Merge branch '3.0' into feature/stream 2022-11-03 13:37:59 +08:00
Liu Jicong 2fbc8e6306 refactor(stream): stream deploy and state transfer 2022-11-03 13:22:23 +08:00
Minghao Li 1fc79e289d refactor(sync): modify leader transfer 2022-11-03 11:50:24 +08:00
dapan1121 499a266daf
Merge pull request #17855 from taosdata/fix/TD-20087
fix: fix tbname in crash issue
2022-11-03 11:48:31 +08:00
dapan1121 d282e511e3 fix: fix taosd memory leak issue 2022-11-03 11:47:15 +08:00
Haojun Liao 7a14bc05ea fix(query): fix some issues about the initialization of SColumnInfoData. 2022-11-03 10:57:05 +08:00
Haojun Liao e83159f0d9 refactor: increase the buffer for each agg operator, and make the pointer attributes in SColumnInfoData to be aligned to 8bit in memory to speedup the execution of memmove & memset. 2022-11-03 10:47:55 +08:00
dapan1121 4039e99d96
Merge pull request #17816 from taosdata/fix/TD-19686
fix: return err code when query fail
2022-11-03 10:45:54 +08:00
Ganlin Zhao 5fffeba2f3 fix(query): fix countAlwaysReturnValue param not taking effect for
count and hyperloglog function

TD-20140
2022-11-03 10:39:53 +08:00
Minghao Li 102969086d refactor(sync): add local-cmd:follower-commit 2022-11-03 10:25:38 +08:00
dapan1121 2bf5b0405d
Merge pull request #17851 from taosdata/enh/TD-19956
enh: optimize submit response message
2022-11-03 10:19:39 +08:00
dapan1121 1eef25620d fix: fix tbname in crash issue 2022-11-03 10:09:36 +08:00
Haojun Liao 9f5a0f01ea Merge branch '3.0' into fix/liao_cov 2022-11-03 10:02:23 +08:00
Haojun Liao 11c4878ca1 refactor(query): do some internal refactor. 2022-11-03 10:01:11 +08:00
Minghao Li 1a4b7622e4 enh(sync): add sync pre stop 2022-11-03 09:39:20 +08:00
Shengliang Guan 794bca7974
Merge pull request #17848 from taosdata/fix/handleTcpExcept
fix: handle tcp except
2022-11-02 21:57:46 +08:00
Shengliang Guan 0d60817268
Merge pull request #17837 from taosdata/feature/3.0_mhli
refactor(sync): add pre snapshot
2022-11-02 21:11:22 +08:00
yihaoDeng fd3ece836a fix invalid copy 2022-11-02 21:05:53 +08:00
yihaoDeng ff16c4368f handle tcp except 2022-11-02 20:12:03 +08:00
54liuyao 43918a27f9 fix(function):if data is null, apercentile function should return null 2022-11-02 16:37:23 +08:00
Shengliang Guan 77a6cf503e
Merge pull request #17824 from taosdata/FIX/TS-1984-3.0
fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer
2022-11-02 15:49:48 +08:00
Shengliang Guan 5276b72e46
Merge pull request #17826 from taosdata/fix/TD-20116
fix: address sanitizer divide by zero error
2022-11-02 15:44:21 +08:00
Minghao Li 70aff8451f refactor(sync): add pre snapshot 2022-11-02 15:38:30 +08:00
Minghao Li f7191d2ffd refactor(sync): add pre snapshot 2022-11-02 15:25:14 +08:00
dapan1121 ecfcf7054c enh: optimize submit response msg 2022-11-02 15:18:32 +08:00
Shengliang Guan 59ae60f223
Merge pull request #17827 from taosdata/fix/sync
fix(sync): delete assert
2022-11-02 13:29:56 +08:00
Shengliang Guan 8009259270
Merge pull request #17829 from taosdata/fix/TD-20117
fix: set output value to null if zero-length
2022-11-02 13:29:28 +08:00
Minglei Jin 451b6a451d fix: set output value to null if zero-length 2022-11-02 11:47:58 +08:00
Minghao Li dccbe25aa9 fix(sync): delete assert 2022-11-02 11:24:42 +08:00
Ganlin Zhao 6667f69146 fix address sanitizer divide by zero error
TD-20116
2022-11-02 10:27:00 +08:00
Shengliang Guan 1c77d5381a Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-02 10:26:19 +08:00
Shengliang Guan 7a537bba09 refact: adjust sync.h and syncState 2022-11-02 10:24:55 +08:00
benguang.zhao 8a5130a88d fix: set firstTrial as false if error encountered in loop of walScanLogGetLastVer 2022-11-02 10:21:40 +08:00
yihaoDeng 7fba18bbbd merge 2022-11-02 09:50:55 +08:00
Shengliang Guan c4d59126d7
Merge pull request #17805 from taosdata/szhou/fixbugs
fix: fix address sanitizer error
2022-11-02 09:09:32 +08:00
dapan1121 c19a915ec3
Merge pull request #17809 from taosdata/feature/TD-20100
fix(executor): Batch Partition Operator memory leak
2022-11-02 09:07:32 +08:00
yihaoDeng 12be1a8b22 merge 2022-11-01 21:47:58 +08:00
Shengliang Guan cec6642700
Merge pull request #17811 from taosdata/feature/stream
fix(tmq): handle adding subtable for subscribing stb
2022-11-01 21:09:43 +08:00
Shengliang Guan fee43064f7
Merge pull request #17812 from taosdata/fix/TD-20052
enh: refact sync callback func
2022-11-01 21:09:00 +08:00
Liu Jicong f0a66602da fix(taosx): set version 2022-11-01 19:28:42 +08:00
yihaoDeng f8695563f0 fix TD-19686 2022-11-01 19:27:35 +08:00
yihaoDeng fafdfc73ca fix TD-19686 2022-11-01 19:13:07 +08:00
Shengliang Guan 871757240a
Merge pull request #17777 from taosdata/FIX/TS-1984-3.0
fix: fsync wal files and meta if data size not synced yet beyond a threshold
2022-11-01 18:53:10 +08:00
Liu Jicong 60bb2c18dc Merge branch '3.0' into feature/stream 2022-11-01 18:19:15 +08:00
Liu Jicong 94e7c79ca0 fix(tmq): handle adding subtable for subscribing stb 2022-11-01 18:18:26 +08:00
benguang.zhao 4e46b78aa0 fix: update info of WAL entry found within loop in walScanLogGetLastVer 2022-11-01 17:56:24 +08:00
benguang.zhao 3c1c95c5e6 enh: turn error on WAL data size to recover exceeding a limit as warn 2022-11-01 17:26:31 +08:00
54liuyao a1c4572ad8 fix(executor): Batch Partition Operator memory leak 2022-11-01 17:25:05 +08:00
benguang.zhao 4237cafb21 enh: rename walRecoverSizeLimit to walFsyncDataSizeLimit 2022-11-01 17:19:33 +08:00
Shengliang Guan ee63b49800 Merge remote-tracking branch 'origin/3.0' into fix/TD-20052 2022-11-01 17:11:27 +08:00
Shengliang Guan 18f7d658d9
Merge pull request #17804 from taosdata/feature/3_liaohj
refactor: add some logs.
2022-11-01 16:46:24 +08:00
Shengliang Guan a71dbd83d2
Merge pull request #17803 from taosdata/fix/TD-20052
enh: refact syncMsg code
2022-11-01 16:45:56 +08:00
Shengliang Guan 68f1641991
Merge pull request #17800 from taosdata/feature/stream
refactor(stream): fill history
2022-11-01 16:15:07 +08:00
Shengliang Guan d35028ae4a enh: refact sync callback func 2022-11-01 16:10:07 +08:00
dapan1121 8f95861d61
Merge pull request #17793 from taosdata/fix/TD-19891
fix(query): leastsquares handles unsigned types
2022-11-01 15:54:35 +08:00
benguang.zhao ffa6906a9f Merge branch 'FIX/TS-1984-3.0' of github.com:taosdata/TDengine into FIX/TS-1984-3.0 2022-11-01 15:52:25 +08:00
Liu Jicong 92804d317e Merge branch '3.0' into feature/stream 2022-11-01 15:47:37 +08:00
Shengliang Guan 7a532284e7
Merge pull request #17784 from taosdata/fix/liao_cov
enh(query): improve the aggregate performance.
2022-11-01 15:41:03 +08:00
Shengliang Guan f4dc7d0766 enh: refact sync callback func 2022-11-01 15:35:10 +08:00