Commit Graph

4827 Commits

Author SHA1 Message Date
Haojun Liao a5165ab5e7 refactor: do some internal refactor. 2022-12-26 10:58:17 +08:00
Minglei Jin 3ea9fadfc8 fix(vnd): save vnode info at the begining of vnode prepare commit 2022-12-26 10:10:49 +08:00
Shengliang Guan 028cc52846
Merge pull request #19116 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-26 09:12:35 +08:00
Haojun Liao 1edf1e1799 refactor: do some internal refactor. 2022-12-23 23:02:40 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Liu Jicong 0d56da7508 fix: skip msg 2022-12-23 19:04:39 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
dapan1121 d39e34ce7c
Merge pull request #19071 from taosdata/fix/TS-2276-main
Fix(tsdb): table block distributed totalSize is zero
2022-12-23 11:54:13 +08:00
Shengliang Guan 3e4125ae07 Merge remote-tracking branch 'origin/main' into fix/TD-21446 2022-12-23 11:04:03 +08:00
Shengliang Guan 0ea1d145d5
Merge pull request #19101 from taosdata/feature/3_liaohj
fix(query): set start row index for desc scan.
2022-12-23 11:02:42 +08:00
Shengliang Guan babe828a4a
Merge pull request #19093 from taosdata/fix/TS-2307
fix(meta/malloc): use new aligned buffer pool malloc
2022-12-23 10:19:59 +08:00
Haojun Liao ff01a0d2b5 fix(query): remove todo 2022-12-23 09:42:55 +08:00
Shengliang Guan 773423a6b6 fix: remove some logs 2022-12-23 09:11:45 +08:00
Haojun Liao 884f9dfee1 fix(query): set start row index for desc scan. 2022-12-23 00:56:03 +08:00
Haojun Liao c2f6d4ab77 fix(query): add some logs. 2022-12-23 00:16:15 +08:00
Shengliang Guan 2668def457
Merge pull request #19076 from taosdata/feature/3_liaohj
fix(query): add lock for cache.
2022-12-22 20:12:50 +08:00
Shengliang Guan 48b6bd438d fix: restart snapshot sender on receiver is restart 2022-12-22 17:30:02 +08:00
Minglei Jin e302cb320f fix(meta/malloc): use new aligned buffer pool malloc 2022-12-22 17:29:29 +08:00
Haojun Liao 8210c49a85 fix(query): fix memory leak. 2022-12-22 15:47:02 +08:00
Haojun Liao 55159a7ceb fix(query): update the mutex. 2022-12-22 15:44:40 +08:00
Minglei Jin 25e3f653ee fix(tdb/abort): invalidate flushed pages in cache not on dirty tree 2022-12-22 10:50:16 +08:00
Shengliang Guan 2454cf0c5d
Merge pull request #19058 from taosdata/release/ver-3.0.2.1
release: build 3.0.2.1
2022-12-21 21:00:33 +08:00
Haojun Liao 71a61c3106 fix(query): add lock for cache. 2022-12-21 19:19:20 +08:00
Alex Duan 950529d148 fix(query): show distributed table modify average calc ++ 2022-12-21 19:03:48 +08:00
Shengliang Guan 46df0e8dd1
Merge pull request #19067 from taosdata/feature/3_liaohj
fix(query): update the blockInfo
2022-12-21 17:57:52 +08:00
Alex Duan 8dfbcc5a83 fix(query): getFileBlockDistInfo totalSize set use index 0 2022-12-21 17:19:00 +08:00
Alex Duan ebf35651f3 fix(query): getFileBlockDistInfo totalSize set 2022-12-21 17:01:59 +08:00
Haojun Liao d5a770c98a fix(query): add comment. 2022-12-21 16:25:18 +08:00
Haojun Liao d1b85f893e fix(query): update the blockInfo 2022-12-21 16:24:37 +08:00
yihaoDeng a68b8fc43e set mergeTree sst trigger to Max 2022-12-20 17:11:22 +08:00
Shengliang Guan 9c8b194c34 refact: set FpSnapshotStopRead return type to void 2022-12-20 15:07:27 +08:00
Shengliang Guan 41dcd32b8e refact: adjust some logs 2022-12-20 15:01:03 +08:00
Shengliang Guan 12b6cf15a0 refact: set FpGetSnapshotInfo return type to void 2022-12-20 14:57:04 +08:00
Minglei Jin ba58185104 Merge branch 'fix/TD-21344-main' of https://github.com/taosdata/TDengine into fix/TD-21344-main 2022-12-20 10:49:34 +08:00
Minglei Jin 93956bbf4f meta/snap: use heap os instead of NIL when openning snap 2022-12-20 10:47:50 +08:00
Shengliang Guan 0b56b4af24 fix: add log for snapshot writer rollback 2022-12-19 20:29:44 +08:00
Shengliang Guan 2e2e227dbe fix: remove invalid assert 2022-12-18 19:59:17 +08:00
Shengliang Guan f24d8433e1 Merge branch 'main' into fix/td-21029 2022-12-17 20:13:53 +08:00
Shengliang Guan 1a99fefa83
Merge pull request #18980 from taosdata/fix/TS-2292-M
fix(tsdb): default value of tsdbPageSize
2022-12-16 21:42:35 +08:00
kailixu 96bfe146d5 fix: default value of tsdbPageSize 2022-12-16 18:28:10 +08:00
kailixu 728cbbac5e fix(tsdb): default value of tsdbPageSize 2022-12-16 16:55:12 +08:00
Liu Jicong be03f7aa8b Merge branch 'main' into feature/stream 2022-12-16 14:42:44 +08:00
Liu Jicong 4402bcef94 enh(stream): forbid source db replica > 1 2022-12-16 08:53:33 +08:00
Shengliang Guan cb8cd5f733 Merge branch 'main' into fix/td-21029 2022-12-15 19:24:16 +08:00
Shengliang Guan 4db6b043c6 fix: reduce the frequency of retry in sync not ready case while alter db 2022-12-14 19:01:31 +08:00
Shengliang Guan 6a7c1d6bea
Merge pull request #18940 from taosdata/enh/TD-21127
refact: post sem in vnode while sync timeout
2022-12-14 18:55:52 +08:00
Shengliang Guan 60bab9ae55 refact: post sem in vnode while sync timeout 2022-12-14 16:09:28 +08:00
Shengliang Guan 2b256542a5 refact: add vnode timer 2022-12-14 09:14:40 +08:00
Shengliang Guan 04750d9078
Merge pull request #18905 from taosdata/feature/3_liaohj
refactor: do multiple refactor and improve some query perf.
2022-12-14 08:01:42 +08:00
Shengliang Guan b89877b4c1 refact: add vnode timer 2022-12-13 13:41:06 +08:00
Haojun Liao e3e42cdfbd fix(query): set update ts flag for stream. 2022-12-13 00:16:40 +08:00
Haojun Liao ba50a7c30d refactor(query): add additional attribute to denote if current block has already loaded data. 2022-12-12 14:25:26 +08:00
Shengliang Guan 37f4d4f4a4
Merge pull request #18880 from taosdata/main
fix(query): does not return error code if queried table does not exists.
2022-12-10 16:00:31 +08:00
Shengliang Guan aa512f1d55
Merge pull request #18874 from taosdata/fix/TD-21117
fix: control rpc qitem memory
2022-12-10 15:58:31 +08:00
Shengliang Guan 9e8f4f5e71
Merge pull request #18862 from taosdata/feature/3_liaohj
fix(query): return with error code if the table does not exist
2022-12-10 15:56:30 +08:00
Haojun Liao eeefd1a4b5 fix(query): does not return error code if queried table does not exists. 2022-12-10 14:35:56 +08:00
Shengliang Guan 50b66df39f fix: control rpc qitem memory 2022-12-10 14:02:57 +08:00
Shengliang Guan 585efa1ffd
Merge pull request #18864 from taosdata/fix/metaCacheMemLeak
fix:fix mem leak
2022-12-10 11:28:29 +08:00
yihaoDeng e7e34456fb fix mem leak 2022-12-09 22:25:26 +08:00
yihaoDeng c5db51f484 fix mem leak 2022-12-09 21:48:48 +08:00
Shengliang Guan 016f7642de
Merge pull request #18854 from taosdata/feature/stream
fix: mem leak
2022-12-09 21:48:20 +08:00
Haojun Liao 44dc2564eb fix(query): return with error code if the table does not exist during creating tsdbReader 2022-12-09 21:07:03 +08:00
Liu Jicong a6fff95795 fix: close wal ref 2022-12-09 17:18:21 +08:00
Hongze Cheng 8bc39b7c90 fix sem wait 2022-12-09 17:14:00 +08:00
Minglei Jin 66fba7ec60 meta/begin: a comment to describe the default heap option 2022-12-09 16:28:26 +08:00
Minglei Jin 5f2b393c0c meta/snapshot: use nil heap and abort tdb when rollback 2022-12-09 16:23:43 +08:00
Hongze Cheng 7b20c09f34 more code 2022-12-09 16:19:49 +08:00
Hongze Cheng 68128bc27c Merge branch 'main' of https://github.com/taosdata/TDengine into fix/td-21029 2022-12-09 15:50:30 +08:00
Hongze Cheng 63cc4e27b1 more code 2022-12-09 15:50:22 +08:00
Minglei Jin c22fa53bc4 fix: release lock and memory in exceptional cases 2022-12-09 10:22:43 +08:00
Hongze Cheng d992b64903 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/td-21076 2022-12-08 21:38:36 +08:00
Hongze Cheng 24ee499670 fix: coredump 2022-12-08 21:38:08 +08:00
Shengliang Guan bff8047835
Merge pull request #18805 from taosdata/fix/TD-19250-7
fix: dismiss coverity issues
2022-12-08 21:17:24 +08:00
Hongze Cheng 1b433cac0c fix tsdb snapshot problem 2022-12-08 17:44:47 +08:00
dapan1121 311365ea6f
Merge pull request #18762 from taosdata/fix/TD-20929
fix:read the deleted data
2022-12-08 17:21:41 +08:00
54liuyao 6c9d6e2aa8 fix:read the deleted data 2022-12-08 15:42:37 +08:00
Shengliang Guan fc0412b69a
Merge pull request #18791 from taosdata/fix/TD-20964-3.0
fix: update diskId when migrate DFileSet
2022-12-08 13:58:29 +08:00
Minglei Jin da31f5e588 fix: dismiss coverity issues 2022-12-08 13:54:41 +08:00
kailixu 399dace80f chore: code format optimization 2022-12-08 12:00:04 +08:00
kailixu 5ca21df5d0 Merge branch '3.0' into fix/TD-20964-3.0 2022-12-08 11:59:21 +08:00
Minglei Jin 1a066d19f7 fix: dismiss coverity issues 2022-12-08 10:55:08 +08:00
dapan1121 5b21a2394c
Merge pull request #18779 from taosdata/fix/TD-20958-3.0
fix(query): ensure the SMA  SArray*  capacity is enough big to save all the columns for scanning
2022-12-08 09:13:04 +08:00
kailixu 2d75447bb2 fix: update diskId when migrate DFileSet 2022-12-08 02:11:39 +08:00
Shengliang Guan 6d94afe48f
Revert "refact: adjust some assert cases" 2022-12-07 21:51:17 +08:00
Shengliang Guan 4172acf95d git lo 2022-12-07 19:39:53 +08:00
Shengliang Guan cc87f99854
Merge pull request #18778 from taosdata/feature/3_liaohj
fix(query):fix the invalid write operation.
2022-12-07 19:34:33 +08:00
Shengliang Guan b286959aed
Merge pull request #18769 from taosdata/FIX/TD-21043-3.0
enh: check contiguousness of indexes applied to vnode
2022-12-07 19:32:31 +08:00
Shengliang Guan d5126d469a refact: replcase ASSERT with tAssert 2022-12-07 18:42:48 +08:00
Shengliang Guan f69a188f7e refact: replcase ASSERT with tAssert 2022-12-07 18:37:40 +08:00
Haojun Liao 2736380b29 fix(query):fix the invalid write operation. 2022-12-07 18:08:34 +08:00
Alex Duan cc285d4900 fix(query): SMA ensure support info pColAgg capacity over column numfor this table 2022-12-07 18:00:32 +08:00
Alex Duan 15b8b28972 fix(query): SMA ensure support info pColAgg capacity over column numfor this table 2022-12-07 17:52:49 +08:00
Benguang Zhao 50883689e7 enh: check contiguousness of indexes applied to vnode tsdb 2022-12-07 17:30:22 +08:00
Hongze Cheng a4549b00de fix: retention 2022-12-07 15:11:37 +08:00
Haojun Liao 68273aef52 Merge branch '3.0' into feature/3_liaohj 2022-12-06 10:36:32 +08:00
Shengliang Guan aad8469e86
Merge pull request #18716 from taosdata/feature/3.0_sync_pipeline
fix(sync): close snapshot receiver in pre-close
2022-12-06 09:47:00 +08:00
Haojun Liao 114943ddb0 fix(query): set the correct flag when no neighbors exist. 2022-12-05 22:28:26 +08:00
Haojun Liao d5b493677b fix(query): set column sma into the correct position. 2022-12-05 20:39:37 +08:00
Haojun Liao 9e04f42635 fix(query): check for neighbor block when merging data block. 2022-12-05 20:20:48 +08:00
Minghao Li a1ed4b334c fix(sync): close snapshot receiver in pre-close 2022-12-05 18:50:19 +08:00
Haojun Liao 136937d69a fix(query): insert null column sma firstly. 2022-12-05 17:05:07 +08:00
Minglei Jin 35b958a1c4 fix: commit tdb in write thread 2022-12-05 11:17:14 +08:00
dapan1121 da74ede563
Merge pull request #18679 from taosdata/fix/TD-20904-3.0
fix: tsdb do retention fix
2022-12-05 09:50:25 +08:00
Shengliang Guan c45001744f
Merge pull request #18674 from taosdata/feat/async_commit
feat: async commit
2022-12-04 22:31:04 +08:00
kailixu cf0995f749 feat: async commit for rsma 2022-12-04 20:26:58 +08:00
Minglei Jin a4adcbbe0d vnode/async-commit: adapter vnode-commit to use txn commit 2022-12-04 18:13:51 +08:00
kailixu 0d68190378 Merge branch '3.0' into fix/TD-20904-3.0 2022-12-04 17:50:35 +08:00
kailixu 9b9ebea6f5 fix: tsdb do retention fix 2022-12-04 17:49:37 +08:00
dapan1121 f9f60a8f39
Merge pull request #18646 from taosdata/fix/TD-20684-3.0
feat(api): add new api int64_t taos_affected_rows64
2022-12-04 16:47:51 +08:00
Hongze Cheng 2a20347210 add more code 2022-12-04 15:14:04 +08:00
Hongze Cheng df6eb27b75 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-04 14:51:05 +08:00
Hongze Cheng f78efdac7e fix asan error 2022-12-04 14:50:58 +08:00
Shengliang Guan af3bd5bc9a
Merge pull request #18670 from taosdata/fix/liao_cov
enh(query): avoid repeatly load del file.
2022-12-04 13:20:14 +08:00
Haojun Liao 0d687a533e fix(query): check for null ptr. 2022-12-04 11:35:54 +08:00
Hongze Cheng 0dce1e1047 async commit 2022-12-04 11:15:15 +08:00
Hongze Cheng 8aad71c928 more code 2022-12-04 10:07:08 +08:00
Hongze Cheng d977929c99 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-04 09:37:29 +08:00
Haojun Liao fca20668f5 fix(query): check for 0 tables in tsdbreader 2022-12-03 23:52:38 +08:00
Haojun Liao 803762c4e0 enh(query): avoid repeatly load del file. 2022-12-03 22:57:00 +08:00
Shengliang Guan cc8e1071ab
Merge pull request #18668 from taosdata/FIX/TD-19334-3.0
fix: synchronize syncPropose for executing blocking msgs in vnodeProposeMsg
2022-12-03 22:06:40 +08:00
Benguang Zhao a7807d3ee4 fix: synchronize syncPropose for executing blocking msgs in vnodeProposeMsg 2022-12-03 20:53:56 +08:00
Shengliang Guan b4cb000634
Merge pull request #18659 from taosdata/refact/TD-20127
refact: remove some error codes
2022-12-03 13:00:24 +08:00
Shengliang Guan d9c261cd13 refact: remove some error codes 2022-12-03 10:17:02 +08:00
Benguang Zhao 7eca212756 Merge branch '3.0' into FIX/TD-19334-3.0 2022-12-03 10:02:59 +08:00
Benguang Zhao 2ce07c6ec1 fix: get result of tmsPutToQueue for FpCommitCb 2022-12-03 09:05:50 +08:00
Alex Duan 213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
Shengliang Guan f3e980de14 enh: remove TSDB_CODE_RPC_REDIRECT 2022-12-02 22:45:11 +08:00
Shengliang Guan 524de026a5 enh: remove TSDB_CODE_RPC_REDIRECT 2022-12-02 22:24:35 +08:00
Shengliang Guan 6d70f48802
Merge pull request #18592 from taosdata/feature/3_liaohj
enh(query): optimize query perf.
2022-12-02 21:00:35 +08:00
Shengliang Guan 14a384e93f
Merge pull request #18640 from taosdata/fix/TS-2189-xx
fix(tsdb/cache): use lru erase to invalidate cache entries
2022-12-02 20:42:13 +08:00
Shengliang Guan 61cd753947 enh: remove sync batch propose in vnode 2022-12-02 18:59:03 +08:00
Minglei Jin 55fb892e70 fix(tsdb/cache): use lru erase to invalidate cache entries 2022-12-02 17:53:16 +08:00
Haojun Liao 27ed740eb5 refactor: do some internal refactor. 2022-12-02 17:52:49 +08:00
Shengliang Guan 24ee4b4289 Merge branch '3.0' into enh/TD-20891 2022-12-02 16:44:46 +08:00
Hongze Cheng e9356fa59d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-02 16:28:53 +08:00
Shengliang Guan 13f36ec20a refact: remove TSDB_CODE_APP_NOT_READY and TSDB_CODE_NODE_NOT_DEPLOYED 2022-12-02 16:06:10 +08:00
Haojun Liao 42a512c39f refactor: do some internal refactor. 2022-12-02 15:52:32 +08:00
Hongze Cheng 1e8b9fdda0 more core 2022-12-02 15:46:36 +08:00
Hongze Cheng 129c692f3e more async commit 2022-12-02 15:44:24 +08:00
Minglei Jin 6cb65f336d Merge branch 'v3.0' into feat/async_commit 2022-12-02 14:49:58 +08:00
Xiaoyu Wang 85ea8bbbb3 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-12-02 14:04:50 +08:00
Shengliang Guan a366696478
Merge pull request #18596 from taosdata/feature/stream
refactor(stream): distributed checkpoint
2022-12-02 07:51:10 +08:00
Liu Jicong 3424b184d3 refactor(stream): distributed checkpoint 2022-12-02 03:48:45 +08:00
Haojun Liao 24614d03bd fix(query): set correct sma retrieve procedure. 2022-12-01 21:35:01 +08:00
Hongze Cheng 043cc1104e more code 2022-12-01 20:26:56 +08:00
Haojun Liao efcc3b06bb fix(query): fix memory leak. 2022-12-01 20:01:09 +08:00
Hongze Cheng 3fc30c991e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/async_commit 2022-12-01 18:59:21 +08:00
Haojun Liao 8c62d5f9fa fix(query): fix bug in tsdbread. 2022-12-01 18:34:26 +08:00
Haojun Liao f8a2ab8338 refactor: do some internal refactor. 2022-12-01 17:24:26 +08:00
Shengliang Guan 806658545a
Merge pull request #18449 from taosdata/FIX/TD-19334-3.0
feat: implement pipelining of sync
2022-12-01 16:40:07 +08:00