Commit Graph

5124 Commits

Author SHA1 Message Date
Cary Xu a1b40283de fix: rsma retention level 2022-07-12 10:26:04 +08:00
Cary Xu 1345685877 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-12 09:37:32 +08:00
Minglei Jin 8ff644ffcf
Merge pull request #14784 from taosdata/fix/tsdb-cache-cfg
tsdbCache: use cachelast & cachelastsize cfg from vnode
2022-07-11 23:22:02 +08:00
Cary Xu 6e4b8ed618 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-11 21:04:31 +08:00
Cary Xu 9b56320859
Merge pull request #14779 from taosdata/feature/TD-11274-3.0
fix: memory leak fix during creation of tsma
2022-07-11 21:03:46 +08:00
Minglei Jin e7a920e430 fix: fix file set index bug 2022-07-11 20:44:55 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Cary Xu 82c4b62cdc enh: rsma code optimization and support drop 2022-07-11 19:44:49 +08:00
Cary Xu 3572520d19 fix: memory leak fix during creation of tsma 2022-07-11 19:34:30 +08:00
Hongze Cheng d459ea6afe make it compile 2022-07-11 11:19:16 +00:00
wangmm0220 f9d5c809c9 fix:conflict from 3.0 2022-07-11 19:06:36 +08:00
Shengliang Guan 943de8bc15 enh: adjust vnode fetch queue number 2022-07-11 17:52:30 +08:00
Hongze Cheng 61fb45af56 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 09:48:43 +00:00
Hongze Cheng be841955ae make retention work 2022-07-11 09:45:04 +00:00
wangmm0220 c54bc76925 feat:get meta ok 2022-07-11 17:36:07 +08:00
Shengliang Guan 6bc68021ba
Merge pull request #14745 from taosdata/fix/valgrind
refactor: adjust threads number
2022-07-11 16:59:18 +08:00
Liu Jicong 6d9727579b
Merge pull request #14761 from taosdata/feature/stream
feat(wal): add append interface
2022-07-11 16:50:28 +08:00
Shengliang Guan 5f4040bd67 enh: create database with cachelast option 2022-07-11 16:30:57 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
Hongze Cheng 9071c650a1 retention code 2022-07-11 08:17:03 +00:00
wangmm0220 0a193cf811 feat:get meta ok 2022-07-11 16:12:07 +08:00
Shengliang Guan a846bb9381 refactor: rename cacheLastRow to cacheLast 2022-07-11 15:45:40 +08:00
Hongze Cheng fe2266af26 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 07:19:10 +00:00
Minglei Jin 34d3816df9
Merge pull request #14758 from taosdata/fix/TD-17142
Fix/td 17142
2022-07-11 15:16:33 +08:00
Shengliang Guan 150489dc98 Merge branch 'feat/tsdb_snapshot' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 15:16:22 +08:00
Shengliang Guan 080f30d014 feat: trim db 2022-07-11 15:16:10 +08:00
Hongze Cheng 4ecf2fd78d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 06:58:54 +00:00
Li Minghao ad3136dd90
Merge pull request #14756 from taosdata/feature/3.0_mhli
refactor(sync): add vnode snapshot test
2022-07-11 14:55:00 +08:00
Cary Xu aa42dfdb91
Merge pull request #14755 from taosdata/feature/TD-11274-3.0
enh: tsma/rsma code optimization
2022-07-11 14:52:35 +08:00
Minglei Jin e0297bbd07 fix: clear decoder when reusing 2022-07-11 14:44:28 +08:00
Minglei Jin 22eb20bb67 tsdbCache: new row iterator for mem/imem/fs 2022-07-11 14:29:10 +08:00
Minghao Li 48fd4d8c33 refactor(sync): add vnode snapshot test 2022-07-11 14:26:18 +08:00
Liu Jicong 004f1e449a
Merge pull request #14753 from taosdata/feature/stream
fix(wal): rollback
2022-07-11 14:21:00 +08:00
Cary Xu c59478ec71 enh: tsma/rsma code optimization 2022-07-11 14:20:57 +08:00
Liu Jicong 9fd5ec9020 fix(wal): rollback 2022-07-11 13:38:50 +08:00
Haojun Liao 9af4cd3165
Merge branch '3.0' into feature/3_liaohj 2022-07-11 11:36:19 +08:00
Hongze Cheng aa016b65d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 03:25:02 +00:00
Haojun Liao 4527447b60 fix(query): handle the indefinit function output with partition by 2022-07-11 11:13:49 +08:00
Minghao Li 2dd7abd47e refactor(sync): add vnode snapshot case 2022-07-11 10:34:02 +08:00
Xiaoyu Wang ed66440c5c Merge remote-tracking branch 'origin/3.0' into feature/3.0_debug_wxy 2022-07-11 10:08:54 +08:00
Hongze Cheng 795a071eb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 01:48:15 +00:00
Liu Jicong f9ba552496
Merge pull request #14739 from taosdata/feature/stream
fix(wal): read after rolling
2022-07-10 21:45:31 +08:00
Liu Jicong 711f960827 Merge branch '3.0' into feature/stream 2022-07-10 21:24:18 +08:00
Liu Jicong 219d966b25 fix(wal): read after rolling 2022-07-10 21:02:25 +08:00
Haojun Liao 5c3c418c7f fix(query): set correct the fill column value for in case of no primary timestamp column exists. 2022-07-10 20:59:56 +08:00
Hongze Cheng 3781db867e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 12:25:25 +00:00
Hongze Cheng be1af580c2 tsdb retention function 2022-07-10 12:25:11 +00:00
Li Minghao 6ae9741e02
Merge pull request #14738 from taosdata/feature/3.0_mhli
refactor(sync): update to SYNC_STRATEGY_WAL_FIRST
2022-07-10 19:43:28 +08:00
Minghao Li 9e4c4c50a0 refactor(sync): update to SYNC_STRATEGY_WAL_FIRST 2022-07-10 19:10:06 +08:00
wangmm0220 2411a1416a fix:conflicts 2022-07-10 19:01:56 +08:00
wangmm0220 b1c290f6dc fix:conflicts 2022-07-10 18:57:34 +08:00
wangmm0220 607f8163d3 feat:add logic for get_tmq_meta_json 2022-07-10 18:54:58 +08:00
Xiaoyu Wang 651adca80f
Merge pull request #14685 from taosdata/feature/3.0_debug_wxy
fix: some problem of parser and planner
2022-07-10 18:17:51 +08:00
Shengliang Guan ffe4453bcc
Merge pull request #14736 from taosdata/feature/3_liaohj
refactor: do some internal refactor and fix some memory leak.
2022-07-10 18:12:42 +08:00
Li Minghao 49954b327f
Merge pull request #14730 from taosdata/feature/3.0_mhli
fix(sync): vnode snapshot sender
2022-07-10 17:52:29 +08:00
Xiaoyu Wang 5f0005a7b7 merge 3.0 2022-07-10 17:47:31 +08:00
Haojun Liao ac8e9d103c other: merge 3.0 2022-07-10 17:40:55 +08:00
Haojun Liao 7dc7f478de refactor: do some internal refactor and fix some memory leak. 2022-07-10 17:34:21 +08:00
Haojun Liao b2a8eec15d
Merge pull request #14718 from taosdata/feature/3_liaohj
fix(query): set correct stddev merge input rows.
2022-07-10 17:25:41 +08:00
Liu Jicong 5478360bef
Merge pull request #14734 from taosdata/feature/stream
feat(tmq): support consume from tsdb then wal
2022-07-10 17:17:19 +08:00
Hongze Cheng 8c45b028c1 finish tsdb snapshot 2022-07-10 08:47:28 +00:00
Xiaoyu Wang bd210bf392 Merge remote-tracking branch 'origin/3.0' into feature/3.0_debug_wxy 2022-07-10 16:45:14 +08:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Liu Jicong 5f36406b7d
Merge pull request #14724 from taosdata/feature/stream
refactor(stream)
2022-07-10 15:53:48 +08:00
Liu Jicong ff5f1aa1a5 refactor(stream) 2022-07-10 15:23:34 +08:00
Shengliang Guan 1d19369710
Merge pull request #14725 from taosdata/feature/TD-13041
feat:write meta from tmq to taosd
2022-07-10 15:16:48 +08:00
Liu Jicong 5640036f66 refactor(stream) 2022-07-10 14:48:16 +08:00
Haojun Liao 69e9a2ad5c
Merge branch '3.0' into feature/3_liaohj 2022-07-10 14:46:53 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Liu Jicong bafa54778a refactor(stream) 2022-07-10 14:10:39 +08:00
Shengliang Guan 77cb2c0b84 feat:write meta from tmq to taosd 2022-07-10 14:07:53 +08:00
Hongze Cheng 53a13db814 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 06:01:55 +00:00
Hongze Cheng 699c9572f5 more 2022-07-10 06:01:30 +00:00
Li Minghao 644963b745
Merge pull request #14722 from taosdata/feature/3.0_mhli
refactor(sync): add snapshot writer
2022-07-10 13:58:47 +08:00
Liu Jicong 2225411edc refactor(stream) 2022-07-10 13:57:17 +08:00
Liu Jicong 9fd1a64557
Merge pull request #14720 from taosdata/feature/stream
refactor(stream)
2022-07-10 13:55:55 +08:00
Liu Jicong 8afb54548f refactor(stream) 2022-07-10 13:21:37 +08:00
Cary Xu cc18aa740a
Merge pull request #14721 from taosdata/feature/TD-11274-3.0
enh: rsma optimization for info item and tmr handle
2022-07-10 13:18:33 +08:00
Shengliang Guan ad3de2d998
Merge pull request #14717 from taosdata/feature/TD-13041
feat:write meta from tmq to taosd
2022-07-10 12:50:50 +08:00
Shengliang Guan b4cadcbef2 fix: unitest of sdb 2022-07-10 11:50:56 +08:00
Shengliang Guan 94f71012ea fix: compile error 2022-07-10 11:49:04 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Cary Xu 76aba6ec34 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-10 11:30:11 +08:00
Cary Xu 833c1ec487 enh: rsma optimization for info item and tmr handle 2022-07-10 11:29:55 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Shengliang Guan 998de54728 feat:write meta from tmq to taosd 2022-07-10 11:17:51 +08:00
Shengliang Guan c6591c3cd3 Merge remote-tracking branch 'origin/3.0' into feature/TD-13041 2022-07-10 10:59:47 +08:00
Shengliang Guan f2f45a1ec7 feat:write meta from tmq to taosd 2022-07-10 10:59:34 +08:00
Minghao Li e1db3eee36 refactor(sync): merge tsdb_snapshot code 2022-07-10 10:55:46 +08:00
Hongze Cheng 4a4018a31f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 02:46:01 +00:00
Xiaoyu Wang 2454298b0b Merge remote-tracking branch 'origin/3.0' into feature/3.0_debug_wxy 2022-07-10 10:24:55 +08:00
WANG MINGMING 30b1af3feb
Merge pull request #14700 from taosdata/feature/TD-13041
feat:write meta from tmq to taosd
2022-07-10 10:22:51 +08:00
Haojun Liao 9738bb4aff Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-10 10:16:41 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00
Cary Xu 5a1d39700d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-09 15:45:00 +08:00
Cary Xu dd81770841 fix: rsma ref fix and add debug logs 2022-07-09 15:44:37 +08:00
Haojun Liao fceee02622
Merge branch '3.0' into feature/3_liaohj 2022-07-09 11:11:11 +08:00
Liu Jicong 0fd4f3b519 fix(tmq): invalid free 2022-07-08 23:05:32 +08:00
Liu Jicong 72d7cc5edf Merge branch '3.0' into feature/stream 2022-07-08 22:00:34 +08:00
Liu Jicong 8d01ae00cb fix(tmq): offset 2022-07-08 21:37:15 +08:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Minglei Jin 236c1d0202
Merge pull request #14698 from taosdata/fix/tsdb-cache-last-delete
fix: release handle to keep refs correct
2022-07-08 20:12:13 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Liu Jicong a9e75c87aa refactor(stream): internal refactor 2022-07-08 19:30:40 +08:00
Minglei Jin e4c45e507f fix: release handle to keep refs correct 2022-07-08 18:51:44 +08:00
wangmm0220 6b46423a97 feat:write meta from tmq to taosd 2022-07-08 18:37:47 +08:00
Shengliang Guan de644c7d43 refactor: adjust logs 2022-07-08 18:33:52 +08:00
Hongze Cheng abbe8fd76e Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 10:20:48 +00:00
Minglei Jin 8209b3a562
Merge pull request #14687 from taosdata/fix/tsdb-cache-last-delete
fix: invalidate last cache when it's covered by delete range
2022-07-08 18:11:39 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Liu Jicong 938868e39f merge from 3.0 2022-07-08 17:57:11 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
Minglei Jin 2ef8cd9a8f fix: invalidate last cache when it's covered by delete range 2022-07-08 17:37:49 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Xiaoyu Wang df06d22cb3 fix: some problem of parser and planner 2022-07-08 17:35:11 +08:00
Haojun Liao 3e81daf578 fix(query): fix memory leak. 2022-07-08 17:28:37 +08:00
Shengliang Guan 361c21a35c refactor: adjust logs 2022-07-08 17:27:06 +08:00
dapan1121 50a6ef7f39
Merge pull request #14635 from taosdata/feature/insertselect
feat: support insert from query res
2022-07-08 16:59:21 +08:00
Shengliang Guan fa77494a72 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 16:58:51 +08:00
Shengliang Guan dca93b18cc refactor: adjust logs 2022-07-08 16:57:54 +08:00
Shengliang Guan 7c39d6076c
Merge pull request #14681 from taosdata/fix/tsim
refactor: delete redundant files
2022-07-08 16:30:00 +08:00
Hongze Cheng 294acc9e00 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 08:26:50 +00:00
Haojun Liao 1711d646c1
Merge pull request #14671 from taosdata/feature/3_liaohj
enh(query): add block sma for int type column data.
2022-07-08 16:23:13 +08:00
Hongze Cheng 1e4f7e3a9c fix: count coredump 2022-07-08 08:23:12 +00:00
Minglei Jin 089285ce3a
Merge pull request #14682 from taosdata/fix/last-ts
tsdbCache/last: save ts info of each column
2022-07-08 16:19:09 +08:00
Cary Xu 236ab7713e
Merge pull request #14680 from taosdata/feature/TD-11274-3.0
fix: set groupId for rsma and comment out rsma test case
2022-07-08 16:03:18 +08:00
Minglei Jin 23fc0f0008 tsdbCache/last: save ts info of each column 2022-07-08 15:54:11 +08:00
Shengliang Guan b7077b7fb3
Merge pull request #14679 from taosdata/fix/valgrind
refactor: change fndebugfalg to udfdebugflag
2022-07-08 15:44:37 +08:00
Shengliang Guan 96db676995 refactor: delete redundant files 2022-07-08 15:37:53 +08:00
Cary Xu 301edfe79b fix: set groupId for rsma and comment out rsma test case 2022-07-08 15:23:11 +08:00
Shengliang Guan 6e12d8e707 refactor: adjust log 2022-07-08 15:20:15 +08:00
Hongze Cheng 57cc359858 more work 2022-07-08 05:31:34 +00:00
Hongze Cheng e5c549b6a7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 05:10:31 +00:00
Shengliang Guan d008e527e3
Merge pull request #14672 from taosdata/fix/valgrind
fix: asan error
2022-07-08 12:35:25 +08:00
Shengliang Guan 09c095a91c fix: asan error 2022-07-08 11:51:35 +08:00
Haojun Liao 91eaba87ef Merge branch '3.0' into feature/3_liaohj 2022-07-08 11:24:28 +08:00
Haojun Liao c339800611 fix(query): handle delete duration generating data block. 2022-07-08 11:02:12 +08:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Hongze Cheng 5fd4452e77 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 01:52:53 +00:00
Yihao Deng d7956b6e14
Merge pull request #14660 from taosdata/enh/rmIdx
enh: rm table idx
2022-07-08 09:31:41 +08:00
Haojun Liao 5c2e98544d fix(query): check if the data block overlaps with the delete skyline 2022-07-07 22:40:20 +08:00
Liu Jicong 7872b16d31
Merge pull request #14657 from taosdata/feature/stream
refactor(stream): internal refactor
2022-07-07 21:42:04 +08:00
Cary Xu 3585629195
Merge pull request #14661 from taosdata/feature/TD-11274-3.0
other: comment out the rsma test case and add debug logs
2022-07-07 21:27:11 +08:00
Cary Xu e0532065f0 other: comment out the test case and add debug logs 2022-07-07 17:58:03 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00