Commit Graph

5293 Commits

Author SHA1 Message Date
Minghao Li 604e5b750c refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-16 18:19:54 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Cary Xu 21a719d3fb
Merge pull request #15000 from taosdata/feature/TD-11274-3.0
enh: rsma async commit support
2022-07-16 17:54:22 +08:00
Hongze Cheng 853e6b50b2 fix vnode snapshot state 2022-07-16 09:50:18 +00:00
Minglei Jin 0c4ea9b379 fix: destroy rsp.pArray after encoding 2022-07-16 17:45:19 +08:00
dapan1121 81c25a1a30 fix: fix mnode close issue 2022-07-16 17:32:10 +08:00
Liu Jicong e4152b433c
Merge pull request #14993 from taosdata/feature/stream
feat(tmq): support background heartbeat
2022-07-16 17:29:14 +08:00
Shengliang Guan c0baae64ba
Merge pull request #14992 from taosdata/fix/valgrind
fix: definite lost while drop db
2022-07-16 17:22:56 +08:00
Cary Xu 0144ef524f other: api rename 2022-07-16 17:16:57 +08:00
Cary Xu 01604d6d1d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 17:12:56 +08:00
Cary Xu 16750e1401 enh: rsma async commit support 2022-07-16 17:12:45 +08:00
Li Minghao 4e18941000
Merge pull request #14990 from taosdata/feat/tsdb_snapshot
feat(tsdb/sync): tsdb snapshot/sync integration
2022-07-16 17:09:08 +08:00
Liu Jicong 01a345a7c1 merge 3.0 2022-07-16 16:47:35 +08:00
Liu Jicong bb58ec1e02 feat(tmq): support background heartbeat 2022-07-16 16:44:07 +08:00
Shengliang Guan 402a65fd73 fix: definite lost while drop db 2022-07-16 16:43:40 +08:00
Minghao Li 49c953fa0c refactor(sync): disable wal cfg 2022-07-16 16:10:50 +08:00
shenglian zhou 96495363d7 feat: add user tags system table 2022-07-16 16:03:45 +08:00
Hongze Cheng 1a9f21c724 fix coredump 2022-07-16 08:02:39 +00:00
dapan1121 320ca85a8f Merge branch '3.0' into fix/fixmsgorder 2022-07-16 15:40:50 +08:00
dapan1121 e0b56ea593 fix: fix query retry issue 2022-07-16 15:38:46 +08:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Cary Xu 5e2776ac2d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 15:12:30 +08:00
Cary Xu 5c76b49391 other: revert the definition 2022-07-16 15:11:50 +08:00
Cary Xu 66f3ed9020 other: make CI pass 2022-07-16 15:06:20 +08:00
Hongze Cheng a760fb8071 fix coredump 2022-07-16 05:48:09 +00:00
Cary Xu 2e9e36d0f8 Merge branch '3.0' into feature/grant-3.0 2022-07-16 11:54:26 +08:00
Xiaoyu Wang 7c585d8ed9 fix: database options 'strict' and 'cachelast' syntax adjustments 2022-07-16 11:47:26 +08:00
Hongze Cheng ff07377fa3 finish vnode snapshot 2022-07-16 03:40:20 +00:00
Hongze Cheng 592c6991a0 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-16 03:13:03 +00:00
Hongze Cheng 8228808a2a more vnode snapshot writer 2022-07-16 03:12:47 +00:00
Liu Jicong 53d8c2d79a
Merge pull request #14972 from taosdata/feature/stream
feat(stream): pipelined exec for recovering
2022-07-16 10:02:00 +08:00
Cary Xu 7d592aee11 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 08:50:03 +08:00
Liu Jicong 280ed4f65d feat(stream): pipelined exec for recovering 2022-07-15 21:29:53 +08:00
Hongze Cheng 989159f0ba vnod snapshot done 2022-07-15 13:02:24 +00:00
dapan1121 dce0f06e31 fix: fix redirect issue 2022-07-15 20:40:48 +08:00
Li Minghao 5a941284a4
Merge pull request #14965 from taosdata/feature/3.0_mhli
refactor(sync): modify elect/heartbeat timer
2022-07-15 19:03:25 +08:00
Shengliang Guan 4bbb1b131a
Merge pull request #14951 from taosdata/fix/dnode
refactor: get retry epset from sync module only when mnode is not ini…
2022-07-15 19:03:10 +08:00
Liu Jicong af0f398121
Merge pull request #14960 from taosdata/feature/stream
feat(stream): recover from failure
2022-07-15 18:32:48 +08:00
Shengliang Guan d02a6090ef fix: the follower of mnode handles transactions incorrectly 2022-07-15 18:08:43 +08:00
Minghao Li b86ec034db refactor(sync): modify elect/heartbeat timer 2022-07-15 18:05:51 +08:00
Hongze Cheng c9b0864e21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 10:03:26 +00:00
Hongze Cheng 7e45878581 more vnode snapshot 2022-07-15 10:03:18 +00:00
Liu Jicong 9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
Shengliang Guan 9da55b39dd Merge branch '3.0' into fix/dnode 2022-07-15 17:05:11 +08:00
Minghao Li 5b1042ce2c Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-07-15 16:57:49 +08:00
Shengliang Guan 61436129ce
Merge pull request #14949 from taosdata/fix/mnode
refactor: let transfer leader msg to be sent even when the dnode exiting
2022-07-15 16:47:45 +08:00
Yihao Deng a5ca6d0ce0
Merge pull request #14942 from taosdata/feat/checkTimeUnSynced
feat: add time unsynced check
2022-07-15 16:36:10 +08:00
Shengliang Guan ca7c115149 refactor: get retry epset from sync module only when mnode is not initialized 2022-07-15 16:13:08 +08:00
Cary Xu 880d7845e6 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-15 16:07:01 +08:00
Cary Xu ed34f490ca enh: async commit api for rsma 2022-07-15 16:06:41 +08:00
Shengliang Guan a12f6a3e3d refactor: let transfer leader msg to be sent even when the dnode exiting 2022-07-15 16:03:16 +08:00
Haojun Liao 505e14892e
Merge pull request #14932 from taosdata/feature/3_liaohj
fix(query): handle multi group last_row query.
2022-07-15 15:03:10 +08:00
yihaoDeng baa21c8398 Merge branch '3.0' of https://github.com/taosdata/TDengine into dev 2022-07-15 14:58:00 +08:00
yihaoDeng 8006ee1d8e feat: add time unsynced check 2022-07-15 14:56:23 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Hongze Cheng 74b31e8c81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 06:55:17 +00:00
Hongze Cheng ec2a069185 more vnode snapshot writer 2022-07-15 06:53:56 +00:00
yihaoDeng 35e8ad2811 feat: add time unsynced check 2022-07-15 14:51:20 +08:00
Minghao Li 95023fd56e refactor(sync): add leader transfer callback 2022-07-15 14:34:58 +08:00
Minghao Li 5b6c7bc38d refactor(sync): add leader transfer callback 2022-07-15 14:26:18 +08:00
Haojun Liao fd2dec280b fix(query): fix memory leak. 2022-07-15 11:18:26 +08:00
Hongze Cheng 5b5b6a03e2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 02:03:57 +00:00
Yihao Deng a6e71424b4
Merge branch '3.0' into enh/addLRUToIdx 2022-07-15 09:47:35 +08:00
Haojun Liao 159d6c47c8
Merge pull request #14911 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-07-14 20:36:30 +08:00
Haojun Liao 707f0a837a fix(query): set correct fill output object. 2022-07-14 20:11:29 +08:00
Hongze Cheng 947de83fc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 11:17:09 +00:00
Cary Xu edfd4b5175 enh: rsma support async commit 2022-07-14 18:51:34 +08:00
Liu Jicong b33d6584c4
Merge pull request #14898 from taosdata/feature/stream
refactor(stream): destroy stream task
2022-07-14 18:36:09 +08:00
Liu Jicong 41b2595086 fix(sma): fix case 2022-07-14 17:40:32 +08:00
Hongze Cheng b554559889 more vnode snapshot 2022-07-14 09:36:23 +00:00
Liu Jicong 9847abf166 fix(sma): double free 2022-07-14 17:34:06 +08:00
yihaoDeng fe8ccabf7a add lru to index 2022-07-14 17:14:53 +08:00
Shengliang Guan f0b8386b63 refactor: adjust the name of stream automatically created by sma 2022-07-14 17:00:46 +08:00
wangmm0220 bb6ecd6913 Merge branch '3.0' into feature/TD-13041 2022-07-14 16:34:04 +08:00
wangmm0220 e711f56027 fix:remove code for resolve the core of amotic_load_n 2022-07-14 16:33:11 +08:00
Liu Jicong a0466d7802 fix(sma): double free 2022-07-14 16:12:57 +08:00
Cary Xu 101b5dd7c7 feat: restrict read/write for grant 2022-07-14 15:58:49 +08:00
Hongze Cheng 5823713185 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 07:38:43 +00:00
Hongze Cheng 25a2d04b85 more vnode snapshot writer 2022-07-14 07:37:53 +00:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
yihaoDeng a9e64f2938 feat: add lru to index 2022-07-14 15:17:05 +08:00
yihaoDeng cace9b6be9 feat: add lru to index 2022-07-14 14:51:39 +08:00
Haojun Liao b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj
fix(query): set correct fill output column index and fix some memory leaks
2022-07-14 14:25:24 +08:00
Cary Xu 1175bda094 Merge branch '3.0' into feature/grant-3.0 2022-07-14 14:10:14 +08:00
Cary Xu 7438f1fed4 feat: read/create restrict when grant expired 2022-07-14 14:09:43 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Hongze Cheng c5133de715 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 05:42:16 +00:00
WANG MINGMING 131f87ffed
Merge pull request #14778 from taosdata/feature/TD-13041
feat: get meta and write meta from tmq
2022-07-14 13:28:57 +08:00
Hongze Cheng e99169023f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 05:28:27 +00:00
Shengliang Guan 59062a9bae fix: memory leak while dnode exiting 2022-07-14 10:41:22 +08:00
wangmm0220 3b4c2826b4 Merge branch '3.0' into feature/TD-13041 2022-07-14 10:22:15 +08:00
Hongze Cheng a3864a940b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 01:40:55 +00:00
Haojun Liao 38b395147a Merge branch '3.0' into feature/3_liaohj 2022-07-13 23:27:51 +08:00
Haojun Liao 083de75afc fix(query):fix memory leak. 2022-07-13 23:15:58 +08:00
Haojun Liao 2974d826ef
Merge pull request #14850 from taosdata/feature/3_liaohj
fix(query): support last_row(tags) for super table query.
2022-07-13 23:14:57 +08:00
Hongze Cheng 20fb356388 more vnode snap writer 2022-07-13 12:31:18 +00:00
Hongze Cheng e6e9926d38 more vnode snapshot writer 2022-07-13 12:02:59 +00:00
Cary Xu 67a5f12ac0 Merge branch '3.0' into feature/grant-3.0 2022-07-13 19:56:03 +08:00
wangmm0220 d3cdd75b94 Merge branch '3.0' into feature/TD-13041 2022-07-13 19:40:26 +08:00
wangmm0220 8aa04f8e55 fix:error in tmq meta 2022-07-13 18:49:57 +08:00
Hongze Cheng 6c628ef6e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 09:56:07 +00:00
Hongze Cheng a32c147b3b more vnode snapshot writer 2022-07-13 09:55:55 +00:00
Shengliang Guan d57dd692cd
Merge pull request #14863 from taosdata/fix/dnode
fix: get mnode epset from sync module
2022-07-13 17:54:00 +08:00
Li Minghao 60703bdd05
Merge pull request #14857 from taosdata/feature/3.0_mhli
refactor(sync): add skiplist entry cache
2022-07-13 17:52:45 +08:00
Liu Jicong b7365fb0c0
Merge pull request #14860 from taosdata/feature/stream
refactor(stream): simple batch
2022-07-13 17:27:27 +08:00
Liu Jicong a717042acf refactor(stream): simple batch 2022-07-13 17:24:36 +08:00
wangmm0220 a015aca162 fix:core dump if stable name is null in SVCreateTbReq 2022-07-13 17:16:34 +08:00
Minglei Jin c719a59de3
Merge pull request #14856 from taosdata/fix/tsdbcacheread-close
fix: fix last row reader close memory issues
2022-07-13 17:08:19 +08:00
Shengliang Guan 699f295aa8
Merge pull request #14859 from taosdata/fix/dnode
enh: add stream queue to vnode
2022-07-13 17:03:38 +08:00
Shengliang Guan c2e2e73cc5 fix: get mnode epset from sync module 2022-07-13 17:03:26 +08:00
Shengliang Guan ce08439014 Merge branch '3.0' into fix/dnode 2022-07-13 17:03:01 +08:00
Haojun Liao dfb0511e17 Merge branch '3.0' into feature/3_liaohj 2022-07-13 16:41:26 +08:00
Shengliang Guan c2aebfa322 enh: add stream queue to vnode 2022-07-13 16:26:22 +08:00
Hongze Cheng 583742089e more vnode snapshot writer 2022-07-13 08:14:20 +00:00
wangmm0220 cd051d40c3 fix:confilct from 3.0 2022-07-13 16:03:39 +08:00
wangmm0220 531dfd4452 fix:error in tmq meta 2022-07-13 16:00:06 +08:00
wangmm0220 0237ccbbb6 fix:error in tmq meta 2022-07-13 15:33:31 +08:00
Minglei Jin 0cd7d1fb13 fix: fix last row reader close memory issues 2022-07-13 15:28:21 +08:00
Hongze Cheng eaa0a4282c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 06:26:29 +00:00
Hongze Cheng 2fd04241d6 more vnode snapshot reader 2022-07-13 06:26:13 +00:00
Haojun Liao 649cf7e55d fix(query): support last_row(tags) for super table query. 2022-07-13 14:21:44 +08:00
Shengliang Guan 480de34a0e enh: support alter debugflag in dnode 2022-07-13 14:13:12 +08:00
Hongze Cheng b691e76782 more vnode snapshot 2022-07-13 05:51:37 +00:00
wangmm0220 037ea1519c fix:core dump if consumer multi vgroup message with sequence:create/alter/delete/create or create/delete/create 2022-07-13 13:42:55 +08:00
wangmm0220 0857ab3531 fix:core dump if consumer multi vgroup message with sequence:create/alter/delete/create or create/delete/create 2022-07-13 11:39:32 +08:00
Hongze Cheng 338a763853 more vnode snapshot 2022-07-13 02:41:37 +00:00
Shengliang Guan 9af7cb1a45 fix: hanlde the error if propose failed 2022-07-13 09:56:27 +08:00
Hongze Cheng 6beb221c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 01:28:17 +00:00
Hongze Cheng f977a50e9b more vnode snapshot 2022-07-13 01:11:55 +00:00
Haojun Liao 2c1efc3963 other: merge 3.0 2022-07-12 21:10:10 +08:00
Haojun Liao 6f2ac5ba72 fix(query): always generated results for last_row query if rows exists. 2022-07-12 21:07:12 +08:00
Hongze Cheng e273856769 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:46:42 +00:00
Hongze Cheng 98cb6ae092 more vnode snapshot 2022-07-12 12:46:27 +00:00
Shengliang Guan 148e3a5f97
Merge pull request #14818 from taosdata/fix/mnode
enh: adjust vnode fetch queue number
2022-07-12 20:43:05 +08:00
Hongze Cheng d88c921974 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:17:49 +00:00
Hongze Cheng 1e3fff30e7 more vnode snapshot 2022-07-12 12:16:40 +00:00
Haojun Liao ea5a68046e
Merge pull request #14825 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-07-12 20:13:20 +08:00
Shengliang Guan dad12c24fb refactor: comment out to avoid crash of tmqShow.py 2022-07-12 19:56:38 +08:00
wangmm0220 2b442621e8 feat:get child table name in tmq meta 2022-07-12 18:58:33 +08:00
Liu Jicong a34d344225
Merge pull request #14808 from taosdata/feature/stream
refactor(tmq): prepare only needed
2022-07-12 18:09:31 +08:00
Haojun Liao e99231c1c8 fix(query): set correct output buffer. 2022-07-12 17:59:25 +08:00
Haojun Liao 85ddb63e53 fix(query): free resources in tsdbread 2022-07-12 17:44:10 +08:00
Shengliang Guan 037f84fafd Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-07-12 17:29:23 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Liu Jicong 0fccdace56 fix(tmq): reset offset 2022-07-12 16:39:05 +08:00
Haojun Liao 6e709dc2e0 fix(query): check if table exists during creating lastrow reader. 2022-07-12 16:30:34 +08:00
Haojun Liao b253d4a07a refactor: do some internal refactor. 2022-07-12 16:26:55 +08:00
Li Minghao d192abbb32
Merge pull request #14814 from taosdata/feature/3.0_mhli
refactor(sync): do leader transfer
2022-07-12 16:26:35 +08:00