Commit Graph

2757 Commits

Author SHA1 Message Date
Hongze Cheng ec2a069185 more vnode snapshot writer 2022-07-15 06:53:56 +00:00
Minghao Li 5b6c7bc38d refactor(sync): add leader transfer callback 2022-07-15 14:26:18 +08:00
Haojun Liao fd2dec280b fix(query): fix memory leak. 2022-07-15 11:18:26 +08:00
Hongze Cheng 5b5b6a03e2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 02:03:57 +00:00
Yihao Deng a6e71424b4
Merge branch '3.0' into enh/addLRUToIdx 2022-07-15 09:47:35 +08:00
Haojun Liao 159d6c47c8
Merge pull request #14911 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-07-14 20:36:30 +08:00
Haojun Liao 707f0a837a fix(query): set correct fill output object. 2022-07-14 20:11:29 +08:00
Hongze Cheng 947de83fc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 11:17:09 +00:00
Cary Xu edfd4b5175 enh: rsma support async commit 2022-07-14 18:51:34 +08:00
Liu Jicong 41b2595086 fix(sma): fix case 2022-07-14 17:40:32 +08:00
Hongze Cheng b554559889 more vnode snapshot 2022-07-14 09:36:23 +00:00
Liu Jicong 9847abf166 fix(sma): double free 2022-07-14 17:34:06 +08:00
yihaoDeng fe8ccabf7a add lru to index 2022-07-14 17:14:53 +08:00
Liu Jicong a0466d7802 fix(sma): double free 2022-07-14 16:12:57 +08:00
Cary Xu 101b5dd7c7 feat: restrict read/write for grant 2022-07-14 15:58:49 +08:00
Hongze Cheng 5823713185 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 07:38:43 +00:00
Hongze Cheng 25a2d04b85 more vnode snapshot writer 2022-07-14 07:37:53 +00:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
yihaoDeng a9e64f2938 feat: add lru to index 2022-07-14 15:17:05 +08:00
yihaoDeng cace9b6be9 feat: add lru to index 2022-07-14 14:51:39 +08:00
Haojun Liao b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj
fix(query): set correct fill output column index and fix some memory leaks
2022-07-14 14:25:24 +08:00
Cary Xu 1175bda094 Merge branch '3.0' into feature/grant-3.0 2022-07-14 14:10:14 +08:00
Cary Xu 7438f1fed4 feat: read/create restrict when grant expired 2022-07-14 14:09:43 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Hongze Cheng c5133de715 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 05:42:16 +00:00
wangmm0220 3b4c2826b4 Merge branch '3.0' into feature/TD-13041 2022-07-14 10:22:15 +08:00
Hongze Cheng a3864a940b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 01:40:55 +00:00
Haojun Liao 38b395147a Merge branch '3.0' into feature/3_liaohj 2022-07-13 23:27:51 +08:00
Haojun Liao 083de75afc fix(query):fix memory leak. 2022-07-13 23:15:58 +08:00
Haojun Liao 2974d826ef
Merge pull request #14850 from taosdata/feature/3_liaohj
fix(query): support last_row(tags) for super table query.
2022-07-13 23:14:57 +08:00
Hongze Cheng 20fb356388 more vnode snap writer 2022-07-13 12:31:18 +00:00
Hongze Cheng e6e9926d38 more vnode snapshot writer 2022-07-13 12:02:59 +00:00
wangmm0220 d3cdd75b94 Merge branch '3.0' into feature/TD-13041 2022-07-13 19:40:26 +08:00
wangmm0220 8aa04f8e55 fix:error in tmq meta 2022-07-13 18:49:57 +08:00
Hongze Cheng 6c628ef6e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 09:56:07 +00:00
Hongze Cheng a32c147b3b more vnode snapshot writer 2022-07-13 09:55:55 +00:00
Li Minghao 60703bdd05
Merge pull request #14857 from taosdata/feature/3.0_mhli
refactor(sync): add skiplist entry cache
2022-07-13 17:52:45 +08:00
wangmm0220 a015aca162 fix:core dump if stable name is null in SVCreateTbReq 2022-07-13 17:16:34 +08:00
Hongze Cheng 583742089e more vnode snapshot writer 2022-07-13 08:14:20 +00:00
wangmm0220 cd051d40c3 fix:confilct from 3.0 2022-07-13 16:03:39 +08:00
wangmm0220 531dfd4452 fix:error in tmq meta 2022-07-13 16:00:06 +08:00
Minglei Jin 0cd7d1fb13 fix: fix last row reader close memory issues 2022-07-13 15:28:21 +08:00
Hongze Cheng 2fd04241d6 more vnode snapshot reader 2022-07-13 06:26:13 +00:00
Haojun Liao 649cf7e55d fix(query): support last_row(tags) for super table query. 2022-07-13 14:21:44 +08:00
Hongze Cheng b691e76782 more vnode snapshot 2022-07-13 05:51:37 +00:00
wangmm0220 037ea1519c fix:core dump if consumer multi vgroup message with sequence:create/alter/delete/create or create/delete/create 2022-07-13 13:42:55 +08:00
Hongze Cheng 338a763853 more vnode snapshot 2022-07-13 02:41:37 +00:00
Hongze Cheng 6beb221c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 01:28:17 +00:00
Hongze Cheng f977a50e9b more vnode snapshot 2022-07-13 01:11:55 +00:00
Haojun Liao 2c1efc3963 other: merge 3.0 2022-07-12 21:10:10 +08:00
Haojun Liao 6f2ac5ba72 fix(query): always generated results for last_row query if rows exists. 2022-07-12 21:07:12 +08:00
Hongze Cheng e273856769 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:46:42 +00:00
Hongze Cheng 98cb6ae092 more vnode snapshot 2022-07-12 12:46:27 +00:00
Shengliang Guan 148e3a5f97
Merge pull request #14818 from taosdata/fix/mnode
enh: adjust vnode fetch queue number
2022-07-12 20:43:05 +08:00
Hongze Cheng d88c921974 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:17:49 +00:00
Hongze Cheng 1e3fff30e7 more vnode snapshot 2022-07-12 12:16:40 +00:00
Haojun Liao ea5a68046e
Merge pull request #14825 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-07-12 20:13:20 +08:00
Shengliang Guan dad12c24fb refactor: comment out to avoid crash of tmqShow.py 2022-07-12 19:56:38 +08:00
Liu Jicong a34d344225
Merge pull request #14808 from taosdata/feature/stream
refactor(tmq): prepare only needed
2022-07-12 18:09:31 +08:00
Haojun Liao e99231c1c8 fix(query): set correct output buffer. 2022-07-12 17:59:25 +08:00
Haojun Liao 85ddb63e53 fix(query): free resources in tsdbread 2022-07-12 17:44:10 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Liu Jicong 0fccdace56 fix(tmq): reset offset 2022-07-12 16:39:05 +08:00
Haojun Liao 6e709dc2e0 fix(query): check if table exists during creating lastrow reader. 2022-07-12 16:30:34 +08:00
Haojun Liao b253d4a07a refactor: do some internal refactor. 2022-07-12 16:26:55 +08:00
Li Minghao d192abbb32
Merge pull request #14814 from taosdata/feature/3.0_mhli
refactor(sync): do leader transfer
2022-07-12 16:26:35 +08:00
wangmm0220 824d3db96b fix:conflict from 3.0 2022-07-12 16:01:55 +08:00
Shengliang Guan 697bfa1126
Merge pull request #14816 from taosdata/fix/valgrind
enh: transfer leader before close vnode and mnode
2022-07-12 15:23:20 +08:00
Liu Jicong 7cf99d5359 refactor(tmq): prepare only needed 2022-07-12 15:11:14 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Shengliang Guan e9d4948e84 enh: transfer leader before close vnode and mnode 2022-07-12 14:46:52 +08:00
Cary Xu 6c5e8bae55 fix: use correct keep2 when set least ts for query 2022-07-12 14:14:42 +08:00
Liu Jicong ac57956a56 Merge branch '3.0' into feature/stream 2022-07-12 14:12:18 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Minglei Jin 44704ced13
Merge pull request #14798 from taosdata/fix/tsdb-cache-fs-blockidx
fix: skip file set if null pBlockIdx
2022-07-12 11:23:51 +08:00
Minglei Jin d220690d3c fix: skip file set if null pBlockIdx 2022-07-12 10:43:02 +08:00
Cary Xu a1b40283de fix: rsma retention level 2022-07-12 10:26:04 +08:00
Cary Xu 1345685877 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-12 09:37:32 +08:00
Minglei Jin 8ff644ffcf
Merge pull request #14784 from taosdata/fix/tsdb-cache-cfg
tsdbCache: use cachelast & cachelastsize cfg from vnode
2022-07-11 23:22:02 +08:00
Cary Xu 6e4b8ed618 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-11 21:04:31 +08:00
Minglei Jin e7a920e430 fix: fix file set index bug 2022-07-11 20:44:55 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Cary Xu 82c4b62cdc enh: rsma code optimization and support drop 2022-07-11 19:44:49 +08:00
Hongze Cheng d459ea6afe make it compile 2022-07-11 11:19:16 +00:00
wangmm0220 f9d5c809c9 fix:conflict from 3.0 2022-07-11 19:06:36 +08:00
Hongze Cheng 61fb45af56 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 09:48:43 +00:00
Hongze Cheng be841955ae make retention work 2022-07-11 09:45:04 +00:00
Shengliang Guan 6bc68021ba
Merge pull request #14745 from taosdata/fix/valgrind
refactor: adjust threads number
2022-07-11 16:59:18 +08:00
Liu Jicong 6d9727579b
Merge pull request #14761 from taosdata/feature/stream
feat(wal): add append interface
2022-07-11 16:50:28 +08:00
Shengliang Guan 5f4040bd67 enh: create database with cachelast option 2022-07-11 16:30:57 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
Hongze Cheng 9071c650a1 retention code 2022-07-11 08:17:03 +00:00
wangmm0220 0a193cf811 feat:get meta ok 2022-07-11 16:12:07 +08:00
Hongze Cheng fe2266af26 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 07:19:10 +00:00
Minglei Jin 34d3816df9
Merge pull request #14758 from taosdata/fix/TD-17142
Fix/td 17142
2022-07-11 15:16:33 +08:00
Shengliang Guan 150489dc98 Merge branch 'feat/tsdb_snapshot' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 15:16:22 +08:00
Shengliang Guan 080f30d014 feat: trim db 2022-07-11 15:16:10 +08:00
Hongze Cheng 4ecf2fd78d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 06:58:54 +00:00
Minglei Jin e0297bbd07 fix: clear decoder when reusing 2022-07-11 14:44:28 +08:00
Minglei Jin 22eb20bb67 tsdbCache: new row iterator for mem/imem/fs 2022-07-11 14:29:10 +08:00
Minghao Li 48fd4d8c33 refactor(sync): add vnode snapshot test 2022-07-11 14:26:18 +08:00
Liu Jicong 004f1e449a
Merge pull request #14753 from taosdata/feature/stream
fix(wal): rollback
2022-07-11 14:21:00 +08:00
Liu Jicong 9fd5ec9020 fix(wal): rollback 2022-07-11 13:38:50 +08:00
Haojun Liao 9af4cd3165
Merge branch '3.0' into feature/3_liaohj 2022-07-11 11:36:19 +08:00
Hongze Cheng aa016b65d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 03:25:02 +00:00
Haojun Liao 4527447b60 fix(query): handle the indefinit function output with partition by 2022-07-11 11:13:49 +08:00
Minghao Li 2dd7abd47e refactor(sync): add vnode snapshot case 2022-07-11 10:34:02 +08:00
Xiaoyu Wang ed66440c5c Merge remote-tracking branch 'origin/3.0' into feature/3.0_debug_wxy 2022-07-11 10:08:54 +08:00
Hongze Cheng 795a071eb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 01:48:15 +00:00
Liu Jicong f9ba552496
Merge pull request #14739 from taosdata/feature/stream
fix(wal): read after rolling
2022-07-10 21:45:31 +08:00
Liu Jicong 711f960827 Merge branch '3.0' into feature/stream 2022-07-10 21:24:18 +08:00
Liu Jicong 219d966b25 fix(wal): read after rolling 2022-07-10 21:02:25 +08:00
Haojun Liao 5c3c418c7f fix(query): set correct the fill column value for in case of no primary timestamp column exists. 2022-07-10 20:59:56 +08:00
Hongze Cheng 3781db867e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 12:25:25 +00:00
Hongze Cheng be1af580c2 tsdb retention function 2022-07-10 12:25:11 +00:00
Li Minghao 6ae9741e02
Merge pull request #14738 from taosdata/feature/3.0_mhli
refactor(sync): update to SYNC_STRATEGY_WAL_FIRST
2022-07-10 19:43:28 +08:00
Minghao Li 9e4c4c50a0 refactor(sync): update to SYNC_STRATEGY_WAL_FIRST 2022-07-10 19:10:06 +08:00
Shengliang Guan ffe4453bcc
Merge pull request #14736 from taosdata/feature/3_liaohj
refactor: do some internal refactor and fix some memory leak.
2022-07-10 18:12:42 +08:00
Li Minghao 49954b327f
Merge pull request #14730 from taosdata/feature/3.0_mhli
fix(sync): vnode snapshot sender
2022-07-10 17:52:29 +08:00
Haojun Liao ac8e9d103c other: merge 3.0 2022-07-10 17:40:55 +08:00
Haojun Liao 7dc7f478de refactor: do some internal refactor and fix some memory leak. 2022-07-10 17:34:21 +08:00
Haojun Liao b2a8eec15d
Merge pull request #14718 from taosdata/feature/3_liaohj
fix(query): set correct stddev merge input rows.
2022-07-10 17:25:41 +08:00
Liu Jicong 5478360bef
Merge pull request #14734 from taosdata/feature/stream
feat(tmq): support consume from tsdb then wal
2022-07-10 17:17:19 +08:00
Hongze Cheng 8c45b028c1 finish tsdb snapshot 2022-07-10 08:47:28 +00:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Liu Jicong 5f36406b7d
Merge pull request #14724 from taosdata/feature/stream
refactor(stream)
2022-07-10 15:53:48 +08:00
Liu Jicong ff5f1aa1a5 refactor(stream) 2022-07-10 15:23:34 +08:00
Liu Jicong 5640036f66 refactor(stream) 2022-07-10 14:48:16 +08:00
Haojun Liao 69e9a2ad5c
Merge branch '3.0' into feature/3_liaohj 2022-07-10 14:46:53 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Liu Jicong bafa54778a refactor(stream) 2022-07-10 14:10:39 +08:00
Hongze Cheng 53a13db814 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 06:01:55 +00:00
Hongze Cheng 699c9572f5 more 2022-07-10 06:01:30 +00:00
Li Minghao 644963b745
Merge pull request #14722 from taosdata/feature/3.0_mhli
refactor(sync): add snapshot writer
2022-07-10 13:58:47 +08:00
Liu Jicong 2225411edc refactor(stream) 2022-07-10 13:57:17 +08:00
Liu Jicong 9fd1a64557
Merge pull request #14720 from taosdata/feature/stream
refactor(stream)
2022-07-10 13:55:55 +08:00
Liu Jicong 8afb54548f refactor(stream) 2022-07-10 13:21:37 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Cary Xu 76aba6ec34 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-10 11:30:11 +08:00
Cary Xu 833c1ec487 enh: rsma optimization for info item and tmr handle 2022-07-10 11:29:55 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Minghao Li e1db3eee36 refactor(sync): merge tsdb_snapshot code 2022-07-10 10:55:46 +08:00
Haojun Liao 9738bb4aff Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-10 10:16:41 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00