Commit Graph

4935 Commits

Author SHA1 Message Date
kailixu 08a5ed4a07 chore: revert the code 2023-01-21 16:11:33 +08:00
kailixu 338a2a74cb chore: revert the code 2023-01-21 16:08:33 +08:00
kailixu 2416d34a80 fix: memory leak for row merge 2023-01-21 16:07:27 +08:00
kailixu 39b69ba39e fix: row schema version for row merger 2023-01-21 13:44:25 +08:00
Hongze Cheng fff4a96bdf more code 2023-01-19 22:18:39 +08:00
Hongze Cheng 7203819888 more code 2023-01-19 21:46:27 +08:00
Hongze Cheng b88327d737 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-21761 2023-01-18 23:32:52 +08:00
Hongze Cheng 516306b598 more code 2023-01-18 17:28:18 +08:00
dapan1121 2d42608813
Merge pull request #19632 from taosdata/fix/TS-2461
fix: rows number exceeds block capacity issue
2023-01-18 16:56:05 +08:00
dapan1121 17bfb8228a fix: rows number exceeds block capacity issue 2023-01-18 15:55:24 +08:00
Hongze Cheng d6028bdde1 some code 2023-01-18 14:59:02 +08:00
kailixu d9ae5a755c fix: tsdb fs head/data/sma nRef 2023-01-18 11:05:39 +08:00
kailixu 70fb18e611 fix: tsdb ReadSnap take/untake 2023-01-17 15:11:11 +08:00
Haojun Liao 49dedc3c3f fix(query): opt perf. 2023-01-17 10:24:19 +08:00
Haojun Liao 7425820c21 refactor: do some internal refactor. 2023-01-16 23:58:45 +08:00
Haojun Liao 82f4db302e refactor: do some internal refactor. 2023-01-14 23:17:57 +08:00
Haojun Liao 7aee35c457 fix(query): init the value. 2023-01-13 15:54:23 +08:00
Haojun Liao 5386fe7cc4 fix(query): init the value. 2023-01-13 14:57:09 +08:00
Haojun Liao cd6532ca7e enh(query): prepare the buffer on the stack, instead of heap. 2023-01-13 14:49:07 +08:00
Haojun Liao 6332c982b5 fix(query): fix invalid read 2023-01-13 14:16:59 +08:00
Haojun Liao bb5fb42c2f refactor: do some internal refactor. 2023-01-13 13:48:20 +08:00
Haojun Liao 7dcad62775 refactor: do some internal refactor. 2023-01-13 10:56:47 +08:00
Haojun Liao 5ff84757fe refactor: do some internal refactor. 2023-01-13 10:53:36 +08:00
Haojun Liao 71ca1d84ef refactor: do some internal refactor. 2023-01-13 10:53:19 +08:00
Haojun Liao 6bffcfaad8 refactor: do some internal refactor. 2023-01-13 10:45:07 +08:00
Haojun Liao 28baef1051 refactor: do some internal refactor. 2023-01-13 10:40:12 +08:00
Haojun Liao a71f029eec refactor: do some internal refactor. 2023-01-13 10:36:05 +08:00
Haojun Liao 8bed2612a6 refactor: do some internal refactor. 2023-01-12 23:24:41 +08:00
Haojun Liao a96de23363 fix(query): add the check of item when putting in cache. 2023-01-12 22:50:02 +08:00
Haojun Liao d36e68bd9b fix(query): add the check of item when putting in cache. 2023-01-12 19:25:28 +08:00
Haojun Liao 96feaaadbe fix(query): add the check of item when putting in cache. 2023-01-12 19:24:23 +08:00
Shengliang Guan cd0404bc25 refact: adjust return value of tmsgUpdateDnodeInfo 2023-01-12 17:08:33 +08:00
Haojun Liao effcfc057d fix(query): fix compare error. 2023-01-12 15:00:07 +08:00
Haojun Liao 53f27901a5 Merge branch 'main' into feature/3_liaohj 2023-01-11 15:42:34 +08:00
Haojun Liao 2d73a50469 enh(query): opt filter check. 2023-01-10 19:31:30 +08:00
dapan1121 c3cb4a52fc
Merge pull request #19425 from taosdata/fix/TD-21778
fix: tsdb read invalid memory read issue
2023-01-10 17:10:19 +08:00
dapan1121 fd0d4bb830
Update tsdb.h
fix: remove tmp field
2023-01-10 15:39:16 +08:00
dapan1121 459d2932b1 fix: memcpy empty value issue 2023-01-10 13:44:24 +08:00
Hui Li 8545bf06e3
Merge pull request #19467 from taosdata/fix/liaohj
fix(query): fix error for retrieve data only in last files.
2023-01-10 13:40:30 +08:00
Haojun Liao 08321f3c6d enh(query): update the log. 2023-01-10 13:35:25 +08:00
Haojun Liao b2a70c0a34 enh(query): jump out of loop once queried tables are all found. 2023-01-10 13:33:27 +08:00
Haojun Liao 1354eac985 Merge branch 'main' into feature/3_liaohj 2023-01-10 13:21:49 +08:00
dapan1121 bfc483aa30 fix: row merge flag issue 2023-01-10 11:32:13 +08:00
Haojun Liao e244a484f8 fix(query): add additional check for imem/mem 2023-01-10 10:49:35 +08:00
Haojun Liao 6a6d53b896
fix(query): fix error for retrieve data only in last files. (#19457)
* fix: add test cases;

* fix(query): fix error for retrieve data only in last files.
2023-01-09 20:55:34 +08:00
dapan1121 df2175087b fix: memory leak and invalid read issue 2023-01-09 19:47:17 +08:00
Haojun Liao 16f0900fe9 fix(query): fix error for retrieve data only in last files. 2023-01-09 19:26:39 +08:00
dapan1121 80586ad997 fix: invalid free issue 2023-01-09 11:33:26 +08:00
Benguang Zhao a2085703bf Merge branch main into FIX/TD-21812-main 2023-01-09 10:08:28 +08:00
Shengliang Guan f2d6ed8635
Merge pull request #19125 from taosdata/FIX/TD-21043-main
enh: vnodeCommit on consensus only
2023-01-09 09:41:34 +08:00
Shengliang Guan 35893eb9b1
Merge pull request #19435 from taosdata/fix/liaohj
fix(query): do not merge rows in last file when no data blocks exist.
2023-01-09 09:41:12 +08:00
Benguang Zhao 90830e5410 fix: use pInfo->info.state.committed instead of the current one for async vnodeCommit 2023-01-09 09:08:59 +08:00
Haojun Liao 95a6720b2a fix(query): do not merge rows in last file when no data blocks exist. 2023-01-08 23:02:16 +08:00
Haojun Liao f90fa07ea9 refactor: add avx support zigzag decode. 2023-01-08 12:34:18 +08:00
Shengliang Guan 42d911bf8e Merge remote-tracking branch 'origin/main' into FIX/TD-21043-main 2023-01-08 09:44:07 +08:00
dapan1121 d70e32e7d3 fix: compile issue 2023-01-07 14:56:43 +08:00
Haojun Liao 972f9b6948 refactor: do some internal refactor. 2023-01-07 00:59:05 +08:00
dapan1121 66e62bb010 fix: tsdb read invalid memory read issue 2023-01-06 19:19:31 +08:00
Minglei Jin 610b5631aa fix(vnd/snap): keep vnode stats transfered from leader 2023-01-06 18:00:01 +08:00
Shengliang Guan a56d28ea57
Merge pull request #19396 from taosdata/fix/TD-21757
fix: tsdb snap wrong suid
2023-01-06 13:28:00 +08:00
Haojun Liao 9dd07cc1e1 other:merge main. 2023-01-06 12:54:26 +08:00
kailixu 9c33f014b1 fix: rsma commit without table 2023-01-06 10:57:04 +08:00
kailixu f3831b54db fix: rsma commit without table 2023-01-06 07:41:07 +08:00
Haojun Liao 4f89bf78d8 enh(query): do some internal refactor. 2023-01-05 19:18:24 +08:00
Haojun Liao 29155ad460 enh(query): disable the file length check. 2023-01-05 19:11:08 +08:00
Hongze Cheng d9d4074377 fix: tsdb snap wrong suid 2023-01-05 17:32:39 +08:00
Shengliang Guan ef3e60c387 Merge branch 'fix/TD-21746' into FIX/TD-21043-main 2023-01-05 15:58:30 +08:00
Shengliang Guan 7e5d97f0da fix: stop snapshot receiver on sync post close 2023-01-05 12:00:35 +08:00
Shengliang Guan 84ec8a7f3d Merge branch 'main' into fix/TD-21353 2023-01-05 11:53:38 +08:00
Minglei Jin 0dd9e4bdee fix(vnode): new vnodePostClose for closing sync module 2023-01-05 11:35:39 +08:00
Benguang Zhao 9d5e74a3ff Merge branch 'main' into FIX/TD-21043-main 2023-01-05 09:47:22 +08:00
Benguang Zhao 442902e5cb fix: send rpc response on closing sync or failing to enqueue 2023-01-04 19:18:46 +08:00
Shengliang Guan e2056ba8fb Merge branch 'main' into FIX/TD-21043-main 2023-01-04 11:48:35 +08:00
Hongze Cheng 0a085da032 enh: use diff atomic op 2023-01-04 09:35:48 +08:00
Shengliang Guan 34260cd397 Merge branch 'main' into FIX/TD-21043-main 2023-01-04 09:29:07 +08:00
Shengliang Guan 3d30466c84
Merge pull request #19344 from taosdata/fix/TD-21689
fix: vnode set the wrong replica info after snapshot transfered
2023-01-03 22:33:02 +08:00
Shengliang Guan 17d9d2852c
Merge pull request #19334 from taosdata/fix/wal_ref
fix: load wal ref when init
2023-01-03 20:06:16 +08:00
Shengliang Guan 70b513c09c fix: vnode set the wrong replica info after snapshot transfered 2023-01-03 19:47:04 +08:00
Hongze Cheng 1567fe2f67 fix: skiplist concurrent access 2023-01-03 17:19:19 +08:00
Liu Jicong 9e71a58675 fix: load wal ref when init 2023-01-03 16:45:45 +08:00
Shengliang Guan 5660199016
Merge pull request #19322 from taosdata/hotfix--add-log
enh: add log
2023-01-03 14:48:53 +08:00
Hongze Cheng 9fd2ac0b4c add log 2023-01-03 11:57:25 +08:00
Liu Jicong 617d8d4013 fix mem leak 2023-01-03 11:18:48 +08:00
Benguang Zhao 4031dc1af4 Merge branch main into FIX/TD-21043-main 2023-01-02 16:41:46 +08:00
Benguang Zhao 3edde0eadf fix: tdbAbort on metaClose or streamMetaClose instead of tdbTxnClose 2023-01-01 21:07:32 +08:00
Shengliang Guan 929be865f1 Merge branch 'main' into fix/TS-2349 2022-12-30 17:42:56 +08:00
Shengliang Guan c2323db00d fix: allow the ip resolved by fqdn different between dnodes 2022-12-30 17:04:14 +08:00
Benguang Zhao ed43aeaa9b enh: add vndCommitMaxInterval cfg param 2022-12-29 19:47:28 +08:00
Shengliang Guan fad687161b
Merge pull request #19255 from taosdata/enh/stream_drop_when_scan
enh: optimize drop when scan exec
2022-12-29 17:17:59 +08:00
Liu Jicong 66b9fa01f7 enh: optimize drop when scan exec 2022-12-29 15:51:12 +08:00
Minglei Jin 7f8d051281 fix(meta/snap): return -1 when decoder meta entry failed 2022-12-29 14:51:55 +08:00
Benguang Zhao d307413c36 Merge branch 'main' into FIX/TD-21043-main 2022-12-29 10:03:17 +08:00
Benguang Zhao 6fc47beb71 enh: streamMetaCommit in sync with vnodeCommit 2022-12-28 14:34:23 +08:00
Benguang Zhao 92e05b8ece enh: schedule vnodeCommit uniformly distributed 2022-12-27 16:28:44 +08:00
Shengliang Guan c844922aef
Merge pull request #19172 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-27 16:07:23 +08:00
Benguang Zhao 8916722dd7 Merge branch main to FIX/TD-21043-main 2022-12-27 14:50:39 +08:00
Liu Jicong b2cec0f1e9 fix: skip msg 2022-12-27 14:02:23 +08:00
Haojun Liao 58b5d2e0aa fix(query): fix race condition. 2022-12-27 11:02:07 +08:00
Benguang Zhao c1c7f2593f enh: initialize commitMs as the time when vnodeOpen 2022-12-27 10:38:56 +08:00
Benguang Zhao 137e7d009d fix: update nextRowIterGet of tsdbCache 2022-12-26 20:52:42 +08:00
Shengliang Guan 794fb5d1b5 fix: handle error if sync buffer is full 2022-12-26 20:40:33 +08:00
Shengliang Guan b381c42c9d enh: adjust log while transfer snapshot 2022-12-26 15:59:45 +08:00
Benguang Zhao fda2f55fe5 Merge branch main to FIX/TD-21043-main 2022-12-26 14:26:25 +08:00
Haojun Liao 8a4fb244fb fix(query): fix coverity issues. 2022-12-26 14:20:05 +08:00
Haojun Liao f54f6201be fix(query): fix coverity issues. 2022-12-26 14:07:22 +08:00
Haojun Liao 1a07451bc3 refactor: do some internal refactor. 2022-12-26 13:45:25 +08:00
Minglei Jin 516cfe5caf Merge branch 'main' into fix/TD-21498 2022-12-26 11:05:00 +08:00
Shengliang Guan 43561bfb8c
Merge pull request #19103 from taosdata/fix/TD-21446
fix: restart snapshot sender on receiver is restart
2022-12-26 10:58:55 +08:00
Haojun Liao a5165ab5e7 refactor: do some internal refactor. 2022-12-26 10:58:17 +08:00
Minglei Jin 3ea9fadfc8 fix(vnd): save vnode info at the begining of vnode prepare commit 2022-12-26 10:10:49 +08:00
Shengliang Guan 028cc52846
Merge pull request #19116 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-12-26 09:12:35 +08:00
Haojun Liao 1edf1e1799 refactor: do some internal refactor. 2022-12-23 23:02:40 +08:00
Benguang Zhao 5159d60f56 enh: vnodeCommit on consensus only 2022-12-23 20:16:32 +08:00
Liu Jicong 0d56da7508 fix: skip msg 2022-12-23 19:04:39 +08:00
Haojun Liao 224f5a72c2 refactor: do some internal refactor. 2022-12-23 17:45:12 +08:00
dapan1121 d39e34ce7c
Merge pull request #19071 from taosdata/fix/TS-2276-main
Fix(tsdb): table block distributed totalSize is zero
2022-12-23 11:54:13 +08:00
Shengliang Guan 3e4125ae07 Merge remote-tracking branch 'origin/main' into fix/TD-21446 2022-12-23 11:04:03 +08:00
Shengliang Guan 0ea1d145d5
Merge pull request #19101 from taosdata/feature/3_liaohj
fix(query): set start row index for desc scan.
2022-12-23 11:02:42 +08:00
Shengliang Guan babe828a4a
Merge pull request #19093 from taosdata/fix/TS-2307
fix(meta/malloc): use new aligned buffer pool malloc
2022-12-23 10:19:59 +08:00
Haojun Liao ff01a0d2b5 fix(query): remove todo 2022-12-23 09:42:55 +08:00
Shengliang Guan 773423a6b6 fix: remove some logs 2022-12-23 09:11:45 +08:00
Haojun Liao 884f9dfee1 fix(query): set start row index for desc scan. 2022-12-23 00:56:03 +08:00
Haojun Liao c2f6d4ab77 fix(query): add some logs. 2022-12-23 00:16:15 +08:00
Shengliang Guan 2668def457
Merge pull request #19076 from taosdata/feature/3_liaohj
fix(query): add lock for cache.
2022-12-22 20:12:50 +08:00
Shengliang Guan 48b6bd438d fix: restart snapshot sender on receiver is restart 2022-12-22 17:30:02 +08:00
Minglei Jin e302cb320f fix(meta/malloc): use new aligned buffer pool malloc 2022-12-22 17:29:29 +08:00
Haojun Liao 8210c49a85 fix(query): fix memory leak. 2022-12-22 15:47:02 +08:00
Haojun Liao 55159a7ceb fix(query): update the mutex. 2022-12-22 15:44:40 +08:00
Minglei Jin 25e3f653ee fix(tdb/abort): invalidate flushed pages in cache not on dirty tree 2022-12-22 10:50:16 +08:00
Shengliang Guan 2454cf0c5d
Merge pull request #19058 from taosdata/release/ver-3.0.2.1
release: build 3.0.2.1
2022-12-21 21:00:33 +08:00
Haojun Liao 71a61c3106 fix(query): add lock for cache. 2022-12-21 19:19:20 +08:00
Alex Duan 950529d148 fix(query): show distributed table modify average calc ++ 2022-12-21 19:03:48 +08:00
Shengliang Guan 46df0e8dd1
Merge pull request #19067 from taosdata/feature/3_liaohj
fix(query): update the blockInfo
2022-12-21 17:57:52 +08:00
Alex Duan 8dfbcc5a83 fix(query): getFileBlockDistInfo totalSize set use index 0 2022-12-21 17:19:00 +08:00
Alex Duan ebf35651f3 fix(query): getFileBlockDistInfo totalSize set 2022-12-21 17:01:59 +08:00
Haojun Liao d5a770c98a fix(query): add comment. 2022-12-21 16:25:18 +08:00
Haojun Liao d1b85f893e fix(query): update the blockInfo 2022-12-21 16:24:37 +08:00
yihaoDeng a68b8fc43e set mergeTree sst trigger to Max 2022-12-20 17:11:22 +08:00
Shengliang Guan 9c8b194c34 refact: set FpSnapshotStopRead return type to void 2022-12-20 15:07:27 +08:00
Shengliang Guan 41dcd32b8e refact: adjust some logs 2022-12-20 15:01:03 +08:00
Shengliang Guan 12b6cf15a0 refact: set FpGetSnapshotInfo return type to void 2022-12-20 14:57:04 +08:00
Minglei Jin ba58185104 Merge branch 'fix/TD-21344-main' of https://github.com/taosdata/TDengine into fix/TD-21344-main 2022-12-20 10:49:34 +08:00
Minglei Jin 93956bbf4f meta/snap: use heap os instead of NIL when openning snap 2022-12-20 10:47:50 +08:00
Shengliang Guan 0b56b4af24 fix: add log for snapshot writer rollback 2022-12-19 20:29:44 +08:00
Shengliang Guan 2e2e227dbe fix: remove invalid assert 2022-12-18 19:59:17 +08:00
Shengliang Guan f24d8433e1 Merge branch 'main' into fix/td-21029 2022-12-17 20:13:53 +08:00
Shengliang Guan 1a99fefa83
Merge pull request #18980 from taosdata/fix/TS-2292-M
fix(tsdb): default value of tsdbPageSize
2022-12-16 21:42:35 +08:00
kailixu 96bfe146d5 fix: default value of tsdbPageSize 2022-12-16 18:28:10 +08:00
kailixu 728cbbac5e fix(tsdb): default value of tsdbPageSize 2022-12-16 16:55:12 +08:00
Liu Jicong be03f7aa8b Merge branch 'main' into feature/stream 2022-12-16 14:42:44 +08:00