Commit Graph

3072 Commits

Author SHA1 Message Date
Hongze Cheng bce29321c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-21 12:40:03 +00:00
Hongze Cheng 15c3945eb7 fix: another concurrency problem 2022-07-21 12:38:49 +00:00
Haojun Liao 8a2fb51129
Merge pull request #15230 from taosdata/feature/3_liaohj
fix(query): add query involved column info
2022-07-21 20:29:25 +08:00
Liu Jicong eaf11ca1ac refactor(tmq): disable parallel 2022-07-21 20:15:52 +08:00
Hongze Cheng 6a7a3da3db fix some crash 2022-07-21 11:56:18 +00:00
Cary Xu ada2eb232e fix: resource cleanup and rsma result build 2022-07-21 19:46:55 +08:00
Hongze Cheng 05da4e16d6 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-21 11:42:53 +00:00
Hongze Cheng 684dd82358 fix read concurrency 2022-07-21 11:42:42 +00:00
Cary Xu f2a3f1591b
Merge pull request #15260 from taosdata/feature/TD-11274-3.0
fix: merge dup rows in client
2022-07-21 19:21:26 +08:00
Liu Jicong 81d8d2b937 feat(stream): add version in stream block 2022-07-21 17:27:44 +08:00
Haojun Liao 8e42bf85e8 fix(query): fix border check. 2022-07-21 15:47:22 +08:00
Hongze Cheng bb2e923ffa Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-21 06:35:44 +00:00
Hongze Cheng f195decac9 more fix 2022-07-21 06:27:32 +00:00
Cary Xu dd6aa40ff5 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-21 12:11:02 +08:00
Haojun Liao 2a437ee38a fix(query): close del handle when successing in read del file content. 2022-07-21 11:35:31 +08:00
Haojun Liao c2d588a118 other:merge 3.0 2022-07-21 11:29:34 +08:00
Haojun Liao ef0d705c5f fix(query): close del file read handle. 2022-07-21 11:27:20 +08:00
Haojun Liao ee34c3bb3e fix(query): add query involved column info 2022-07-21 11:20:30 +08:00
Haojun Liao dae00fd10c
Merge pull request #15221 from taosdata/feature/3_liaohj
refactor(query): do some internal refactor and add some logs.
2022-07-21 11:14:56 +08:00
Cary Xu 65871c2d73 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-21 09:44:20 +08:00
Haojun Liao abfa6d9162 refactor(query): do some internal refactor and add some logs. 2022-07-20 22:38:19 +08:00
Liu Jicong 86611cc08a
Merge pull request #15208 from taosdata/feature/stream
fix(stream): memory error
2022-07-20 21:08:55 +08:00
Cary Xu 0f5983ad88 fix: merge dup rows in client 2022-07-20 20:30:54 +08:00
Minglei Jin 37bb5caf29
Merge pull request #15205 from taosdata/fix/TD-17582
fix: use suid from pReader
2022-07-20 19:44:40 +08:00
Liu Jicong fb52cfa816 fix(stream): memory error 2022-07-20 19:31:56 +08:00
Minglei Jin 5cc829e45f fix: use suid from pReader 2022-07-20 18:47:46 +08:00
Liu Jicong 8a9e729db2
Merge pull request #15195 from taosdata/feature/stream
feat(wal): remove wal log size limitation
2022-07-20 17:59:30 +08:00
Minglei Jin 982b11f6eb
Merge pull request #15184 from taosdata/fix/TD-17582
fix: use Ex version of metaGetTbTSchema to retrieve schema
2022-07-20 16:51:10 +08:00
Liu Jicong b74560537c fix(stream): check task exist 2022-07-20 16:25:20 +08:00
Minglei Jin 527aa3584d fix: get suid from uid to be used to retrieve schema 2022-07-20 15:26:47 +08:00
Minglei Jin eefad2bd9d fix: use Ex version of metaGetTbTSchema to retrieve schema 2022-07-20 14:28:13 +08:00
WANG MINGMING 13c6a1b469
Merge pull request #15164 from taosdata/feature/TD-14761
fix:invalidate in telnet schemaless
2022-07-20 13:45:29 +08:00
Liu Jicong 91583bb2f6
Merge pull request #15168 from taosdata/feature/stream
feat(wal): log applied ver
2022-07-20 11:28:11 +08:00
WANG MINGMING 258f4fb20a
Merge branch '3.0' into feature/TD-14761 2022-07-20 11:20:42 +08:00
Liu Jicong a3133b9f6d feat(wal): log applied ver 2022-07-20 10:55:28 +08:00
Minglei Jin e422d7dbf5 fix: remove assert if schema is null 2022-07-20 10:29:21 +08:00
wangmm0220 bc0e8e3061 fix:invalidate in telnet schemaless 2022-07-20 09:48:57 +08:00
Liu Jicong 414673db57
Merge branch '3.0' into feature/stream 2022-07-19 19:46:36 +08:00
Haojun Liao 88f13276f8
Merge pull request #15121 from taosdata/feature/3_liaohj
fix(query): set the output column number for subscribe.
2022-07-19 19:40:26 +08:00
Cary Xu 5c6987e21f
Merge pull request #15138 from taosdata/feature/TD-11274-3.0
feat: rsma snapshot
2022-07-19 19:21:30 +08:00
Minglei Jin c4ae1d7095
Merge pull request #15107 from taosdata/fix/TD-17495
fix: check super table exists or not when creating child table
2022-07-19 19:17:49 +08:00
Liu Jicong 6362f9e435 refactor: add debug flag 2022-07-19 18:39:14 +08:00
Haojun Liao a0428f5685 fix(query): add null ptr check. 2022-07-19 18:05:26 +08:00
Cary Xu a4493c9d97 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-19 17:58:23 +08:00
Cary Xu afe1633256 feat: rsma snapshot 2022-07-19 17:57:59 +08:00
Haojun Liao 282630a394 Merge branch '3.0' into feature/3_liaohj 2022-07-19 17:42:45 +08:00
Hongze Cheng 024f2221b7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-19 08:31:16 +00:00
Hongze Cheng 706b081f70 fix: r/w concurrency 2022-07-19 08:30:49 +00:00
Haojun Liao cd2eaf0152 fix(query): set the output column number for subscribe. 2022-07-19 16:01:28 +08:00
Haojun Liao 8751bcc0ea
Merge pull request #15109 from taosdata/feature/3_liaohj
fix(query): add check for deleting record
2022-07-19 15:56:41 +08:00
Liu Jicong bc1af6deaf refactor(stream): batch optimization for submit msg 2022-07-19 15:52:08 +08:00
Minglei Jin 91b54a7ff7 tqSink/tdBlockToSubmit: use short name instead of full stb name 2022-07-19 15:23:44 +08:00
Hongze Cheng b6c0719c61 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-19 07:22:36 +00:00
Hongze Cheng 657c2dcaa4 more r/w concurrency 2022-07-19 07:21:15 +00:00
Hongze Cheng 6b454a4dd4 more 2022-07-19 06:26:09 +00:00
Hongze Cheng 58135a1aeb tsdb r/w concurrency 2022-07-19 06:19:01 +00:00
54liuyao 8e41fc912b feat(stream): add num of children 2022-07-19 14:17:53 +08:00
Minglei Jin ab00d5670b fix: check super table exists or not when creating child table 2022-07-19 13:38:38 +08:00
Haojun Liao 5e754a7662 fix(query): add check for deleting record 2022-07-19 14:00:45 +08:00
Hongze Cheng 1663284369
Merge pull request #15089 from taosdata/fix/hzcheng_3.0
fix: delete causes coredump
2022-07-19 09:28:55 +08:00
Liu Jicong 159f1c7bae fix(tmq): drop stb after subscribing database 2022-07-18 22:39:51 +08:00
Cary Xu 8910acc4ba
Merge pull request #15087 from taosdata/feature/TD-11274-3.0
enh: rsma drop and code optimization
2022-07-18 20:58:37 +08:00
Cary Xu cc3967b905 fix: parenthesized expression 2022-07-18 20:12:10 +08:00
Shengliang Guan bb99a40718
Merge pull request #15057 from taosdata/fix/valgrind
fix: let certain type of write messages to be executed sequentially
2022-07-18 19:56:11 +08:00
Hongze Cheng 0adb425f42 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-18 11:45:30 +00:00
Hongze Cheng 322ec02e39 fix: delete causes coredump 2022-07-18 11:45:13 +00:00
Cary Xu 832527e5b6 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-18 19:35:20 +08:00
Cary Xu 156e72b071 enh: rsma drop and code optimization 2022-07-18 19:34:53 +08:00
Liu Jicong d8d32ebc51 fix(tmq): set version after consuming from tsdb 2022-07-18 19:16:19 +08:00
Shengliang Guan 993f5fe9ec fix: let certain type of write messages to be executed sequentially 2022-07-18 18:37:58 +08:00
Liu Jicong 7542fa0b62 fix(tmq): topic name should be lower unless quoted 2022-07-18 16:42:54 +08:00
Liu Jicong f2e9d522a4
Merge pull request #15052 from taosdata/feature/stream
fix(tmq): table not found
2022-07-18 14:43:44 +08:00
Minglei Jin 0ade998702
Merge pull request #15049 from taosdata/fix/TD-17491
fix: free vMetaRsp.pSchemas
2022-07-18 14:41:25 +08:00
Liu Jicong 158c6ae3e4 fix(tmq): table not found 2022-07-18 13:51:31 +08:00
Minglei Jin b52c734f88 fix: free vMetaRsp.pSchemas 2022-07-18 13:31:13 +08:00
Cary Xu 2204a770ab Merge branch '3.0' into feature/TD-11274-3.0 2022-07-18 13:22:41 +08:00
Cary Xu 6460514147 enh: grant refactor and grant check 2022-07-18 13:22:21 +08:00
Liu Jicong 6fb3072b43 Merge branch '3.0' into feature/stream 2022-07-18 11:46:59 +08:00
Liu Jicong 500553d581 refactor: add debug log 2022-07-18 11:41:56 +08:00
Minghao Li 0fa9ce71d8 refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-18 11:03:03 +08:00
Li Minghao 046e784c8c
Merge pull request #15031 from taosdata/feature/3.0_mhli
refactor(sync): add index/term in vnodeSnapWriterClose
2022-07-18 10:59:24 +08:00
Minglei Jin 66d3c489a4
Merge pull request #15030 from taosdata/fix/TD-17479
fix: dismiss memory issues
2022-07-18 10:15:08 +08:00
Minglei Jin 677fd4764f fix: dismiss memory issues 2022-07-18 09:42:40 +08:00
Hongze Cheng b99c6958fa
Merge pull request #15007 from taosdata/feat/tsdb_snapshot
fix: vnode snapshot state
2022-07-18 09:38:14 +08:00
dapan1121 077fbd6787
Merge pull request #15010 from taosdata/fix/TD-17460
fix: fix taosd mem leak
2022-07-18 09:18:43 +08:00
Cary Xu 35d395c418
Merge pull request #15028 from taosdata/feature/grant-3.0
fix: make the ci cases pass
2022-07-17 23:19:25 +08:00
Cary Xu 74bf84fd5a fix: make the ci cases pass 2022-07-17 23:17:24 +08:00
Cary Xu 5ef9239c74
Merge pull request #14979 from taosdata/feature/grant-3.0
feat: support grant
2022-07-17 22:16:00 +08:00
Minglei Jin 2e628dc096
Merge pull request #15005 from taosdata/fix/TD-17469
fix: destroy rsp.pArray after encoding
2022-07-16 19:23:33 +08:00
dapan1121 9ec14ece62 fix: fix taosd mem leak 2022-07-16 18:58:29 +08:00
Minghao Li 604e5b750c refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-16 18:19:54 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Hongze Cheng 853e6b50b2 fix vnode snapshot state 2022-07-16 09:50:18 +00:00
Minglei Jin 0c4ea9b379 fix: destroy rsp.pArray after encoding 2022-07-16 17:45:19 +08:00
Cary Xu 0144ef524f other: api rename 2022-07-16 17:16:57 +08:00
Cary Xu 01604d6d1d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 17:12:56 +08:00
Cary Xu 16750e1401 enh: rsma async commit support 2022-07-16 17:12:45 +08:00
Minghao Li 49c953fa0c refactor(sync): disable wal cfg 2022-07-16 16:10:50 +08:00
Hongze Cheng 1a9f21c724 fix coredump 2022-07-16 08:02:39 +00:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Hongze Cheng a760fb8071 fix coredump 2022-07-16 05:48:09 +00:00
Cary Xu 2e9e36d0f8 Merge branch '3.0' into feature/grant-3.0 2022-07-16 11:54:26 +08:00
Hongze Cheng ff07377fa3 finish vnode snapshot 2022-07-16 03:40:20 +00:00
Hongze Cheng 592c6991a0 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-16 03:13:03 +00:00
Hongze Cheng 8228808a2a more vnode snapshot writer 2022-07-16 03:12:47 +00:00
Cary Xu 7d592aee11 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-16 08:50:03 +08:00
Hongze Cheng 989159f0ba vnod snapshot done 2022-07-15 13:02:24 +00:00
Minghao Li b86ec034db refactor(sync): modify elect/heartbeat timer 2022-07-15 18:05:51 +08:00
Hongze Cheng c9b0864e21 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 10:03:26 +00:00
Hongze Cheng 7e45878581 more vnode snapshot 2022-07-15 10:03:18 +00:00
Minghao Li 5b1042ce2c Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-07-15 16:57:49 +08:00
Cary Xu 880d7845e6 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-15 16:07:01 +08:00
Cary Xu ed34f490ca enh: async commit api for rsma 2022-07-15 16:06:41 +08:00
Haojun Liao 505e14892e
Merge pull request #14932 from taosdata/feature/3_liaohj
fix(query): handle multi group last_row query.
2022-07-15 15:03:10 +08:00
Hongze Cheng 74b31e8c81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 06:55:17 +00:00
Hongze Cheng ec2a069185 more vnode snapshot writer 2022-07-15 06:53:56 +00:00
Minghao Li 5b6c7bc38d refactor(sync): add leader transfer callback 2022-07-15 14:26:18 +08:00
Haojun Liao fd2dec280b fix(query): fix memory leak. 2022-07-15 11:18:26 +08:00
Hongze Cheng 5b5b6a03e2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-15 02:03:57 +00:00
Yihao Deng a6e71424b4
Merge branch '3.0' into enh/addLRUToIdx 2022-07-15 09:47:35 +08:00
Haojun Liao 159d6c47c8
Merge pull request #14911 from taosdata/feature/3_liaohj
fix(query): fix memory leak.
2022-07-14 20:36:30 +08:00
Haojun Liao 707f0a837a fix(query): set correct fill output object. 2022-07-14 20:11:29 +08:00
Hongze Cheng 947de83fc3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 11:17:09 +00:00
Cary Xu edfd4b5175 enh: rsma support async commit 2022-07-14 18:51:34 +08:00
Liu Jicong 41b2595086 fix(sma): fix case 2022-07-14 17:40:32 +08:00
Hongze Cheng b554559889 more vnode snapshot 2022-07-14 09:36:23 +00:00
Liu Jicong 9847abf166 fix(sma): double free 2022-07-14 17:34:06 +08:00
yihaoDeng fe8ccabf7a add lru to index 2022-07-14 17:14:53 +08:00
Liu Jicong a0466d7802 fix(sma): double free 2022-07-14 16:12:57 +08:00
Cary Xu 101b5dd7c7 feat: restrict read/write for grant 2022-07-14 15:58:49 +08:00
Hongze Cheng 5823713185 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 07:38:43 +00:00
Hongze Cheng 25a2d04b85 more vnode snapshot writer 2022-07-14 07:37:53 +00:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
yihaoDeng a9e64f2938 feat: add lru to index 2022-07-14 15:17:05 +08:00
yihaoDeng cace9b6be9 feat: add lru to index 2022-07-14 14:51:39 +08:00
Haojun Liao b23e08db85
Merge pull request #14893 from taosdata/feature/3_liaohj
fix(query): set correct fill output column index and fix some memory leaks
2022-07-14 14:25:24 +08:00
Cary Xu 1175bda094 Merge branch '3.0' into feature/grant-3.0 2022-07-14 14:10:14 +08:00
Cary Xu 7438f1fed4 feat: read/create restrict when grant expired 2022-07-14 14:09:43 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Hongze Cheng c5133de715 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 05:42:16 +00:00
wangmm0220 3b4c2826b4 Merge branch '3.0' into feature/TD-13041 2022-07-14 10:22:15 +08:00
Hongze Cheng a3864a940b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-14 01:40:55 +00:00
Haojun Liao 38b395147a Merge branch '3.0' into feature/3_liaohj 2022-07-13 23:27:51 +08:00
Haojun Liao 083de75afc fix(query):fix memory leak. 2022-07-13 23:15:58 +08:00
Haojun Liao 2974d826ef
Merge pull request #14850 from taosdata/feature/3_liaohj
fix(query): support last_row(tags) for super table query.
2022-07-13 23:14:57 +08:00
Hongze Cheng 20fb356388 more vnode snap writer 2022-07-13 12:31:18 +00:00
Hongze Cheng e6e9926d38 more vnode snapshot writer 2022-07-13 12:02:59 +00:00
wangmm0220 d3cdd75b94 Merge branch '3.0' into feature/TD-13041 2022-07-13 19:40:26 +08:00
wangmm0220 8aa04f8e55 fix:error in tmq meta 2022-07-13 18:49:57 +08:00
Hongze Cheng 6c628ef6e9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 09:56:07 +00:00
Hongze Cheng a32c147b3b more vnode snapshot writer 2022-07-13 09:55:55 +00:00
Li Minghao 60703bdd05
Merge pull request #14857 from taosdata/feature/3.0_mhli
refactor(sync): add skiplist entry cache
2022-07-13 17:52:45 +08:00
wangmm0220 a015aca162 fix:core dump if stable name is null in SVCreateTbReq 2022-07-13 17:16:34 +08:00
Hongze Cheng 583742089e more vnode snapshot writer 2022-07-13 08:14:20 +00:00
wangmm0220 cd051d40c3 fix:confilct from 3.0 2022-07-13 16:03:39 +08:00
wangmm0220 531dfd4452 fix:error in tmq meta 2022-07-13 16:00:06 +08:00
Minglei Jin 0cd7d1fb13 fix: fix last row reader close memory issues 2022-07-13 15:28:21 +08:00
Hongze Cheng 2fd04241d6 more vnode snapshot reader 2022-07-13 06:26:13 +00:00
Haojun Liao 649cf7e55d fix(query): support last_row(tags) for super table query. 2022-07-13 14:21:44 +08:00
Hongze Cheng b691e76782 more vnode snapshot 2022-07-13 05:51:37 +00:00
wangmm0220 037ea1519c fix:core dump if consumer multi vgroup message with sequence:create/alter/delete/create or create/delete/create 2022-07-13 13:42:55 +08:00
Hongze Cheng 338a763853 more vnode snapshot 2022-07-13 02:41:37 +00:00
Hongze Cheng 6beb221c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-13 01:28:17 +00:00
Hongze Cheng f977a50e9b more vnode snapshot 2022-07-13 01:11:55 +00:00
Haojun Liao 2c1efc3963 other: merge 3.0 2022-07-12 21:10:10 +08:00
Haojun Liao 6f2ac5ba72 fix(query): always generated results for last_row query if rows exists. 2022-07-12 21:07:12 +08:00
Hongze Cheng e273856769 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:46:42 +00:00
Hongze Cheng 98cb6ae092 more vnode snapshot 2022-07-12 12:46:27 +00:00
Shengliang Guan 148e3a5f97
Merge pull request #14818 from taosdata/fix/mnode
enh: adjust vnode fetch queue number
2022-07-12 20:43:05 +08:00
Hongze Cheng d88c921974 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-12 12:17:49 +00:00
Hongze Cheng 1e3fff30e7 more vnode snapshot 2022-07-12 12:16:40 +00:00
Haojun Liao ea5a68046e
Merge pull request #14825 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
2022-07-12 20:13:20 +08:00
Shengliang Guan dad12c24fb refactor: comment out to avoid crash of tmqShow.py 2022-07-12 19:56:38 +08:00
Liu Jicong a34d344225
Merge pull request #14808 from taosdata/feature/stream
refactor(tmq): prepare only needed
2022-07-12 18:09:31 +08:00
Haojun Liao e99231c1c8 fix(query): set correct output buffer. 2022-07-12 17:59:25 +08:00
Haojun Liao 85ddb63e53 fix(query): free resources in tsdbread 2022-07-12 17:44:10 +08:00
Liu Jicong 8e3f5135a6 fix(tsdb): close fd 2022-07-12 17:28:14 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Liu Jicong 0fccdace56 fix(tmq): reset offset 2022-07-12 16:39:05 +08:00
Haojun Liao 6e709dc2e0 fix(query): check if table exists during creating lastrow reader. 2022-07-12 16:30:34 +08:00
Haojun Liao b253d4a07a refactor: do some internal refactor. 2022-07-12 16:26:55 +08:00
Li Minghao d192abbb32
Merge pull request #14814 from taosdata/feature/3.0_mhli
refactor(sync): do leader transfer
2022-07-12 16:26:35 +08:00
wangmm0220 824d3db96b fix:conflict from 3.0 2022-07-12 16:01:55 +08:00
Shengliang Guan 697bfa1126
Merge pull request #14816 from taosdata/fix/valgrind
enh: transfer leader before close vnode and mnode
2022-07-12 15:23:20 +08:00
Liu Jicong 7cf99d5359 refactor(tmq): prepare only needed 2022-07-12 15:11:14 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Shengliang Guan e9d4948e84 enh: transfer leader before close vnode and mnode 2022-07-12 14:46:52 +08:00
Cary Xu 6c5e8bae55 fix: use correct keep2 when set least ts for query 2022-07-12 14:14:42 +08:00
Liu Jicong ac57956a56 Merge branch '3.0' into feature/stream 2022-07-12 14:12:18 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Minglei Jin 44704ced13
Merge pull request #14798 from taosdata/fix/tsdb-cache-fs-blockidx
fix: skip file set if null pBlockIdx
2022-07-12 11:23:51 +08:00
Minglei Jin d220690d3c fix: skip file set if null pBlockIdx 2022-07-12 10:43:02 +08:00
Cary Xu a1b40283de fix: rsma retention level 2022-07-12 10:26:04 +08:00
Cary Xu 1345685877 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-12 09:37:32 +08:00
Minglei Jin 8ff644ffcf
Merge pull request #14784 from taosdata/fix/tsdb-cache-cfg
tsdbCache: use cachelast & cachelastsize cfg from vnode
2022-07-11 23:22:02 +08:00
Cary Xu 6e4b8ed618 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-11 21:04:31 +08:00
Minglei Jin e7a920e430 fix: fix file set index bug 2022-07-11 20:44:55 +08:00
Minglei Jin 53f56217f7 tsdbCache: use cachelast & cachelastsize cfg from vnode 2022-07-11 20:16:48 +08:00
Cary Xu 82c4b62cdc enh: rsma code optimization and support drop 2022-07-11 19:44:49 +08:00
Hongze Cheng d459ea6afe make it compile 2022-07-11 11:19:16 +00:00
wangmm0220 f9d5c809c9 fix:conflict from 3.0 2022-07-11 19:06:36 +08:00
Hongze Cheng 61fb45af56 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 09:48:43 +00:00
Hongze Cheng be841955ae make retention work 2022-07-11 09:45:04 +00:00
Shengliang Guan 6bc68021ba
Merge pull request #14745 from taosdata/fix/valgrind
refactor: adjust threads number
2022-07-11 16:59:18 +08:00
Liu Jicong 6d9727579b
Merge pull request #14761 from taosdata/feature/stream
feat(wal): add append interface
2022-07-11 16:50:28 +08:00
Shengliang Guan 5f4040bd67 enh: create database with cachelast option 2022-07-11 16:30:57 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
Hongze Cheng 9071c650a1 retention code 2022-07-11 08:17:03 +00:00
wangmm0220 0a193cf811 feat:get meta ok 2022-07-11 16:12:07 +08:00
Hongze Cheng fe2266af26 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 07:19:10 +00:00
Minglei Jin 34d3816df9
Merge pull request #14758 from taosdata/fix/TD-17142
Fix/td 17142
2022-07-11 15:16:33 +08:00
Shengliang Guan 150489dc98 Merge branch 'feat/tsdb_snapshot' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 15:16:22 +08:00
Shengliang Guan 080f30d014 feat: trim db 2022-07-11 15:16:10 +08:00
Hongze Cheng 4ecf2fd78d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 06:58:54 +00:00
Minglei Jin e0297bbd07 fix: clear decoder when reusing 2022-07-11 14:44:28 +08:00
Minglei Jin 22eb20bb67 tsdbCache: new row iterator for mem/imem/fs 2022-07-11 14:29:10 +08:00
Minghao Li 48fd4d8c33 refactor(sync): add vnode snapshot test 2022-07-11 14:26:18 +08:00
Liu Jicong 004f1e449a
Merge pull request #14753 from taosdata/feature/stream
fix(wal): rollback
2022-07-11 14:21:00 +08:00
Liu Jicong 9fd5ec9020 fix(wal): rollback 2022-07-11 13:38:50 +08:00
Haojun Liao 9af4cd3165
Merge branch '3.0' into feature/3_liaohj 2022-07-11 11:36:19 +08:00
Hongze Cheng aa016b65d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 03:25:02 +00:00
Haojun Liao 4527447b60 fix(query): handle the indefinit function output with partition by 2022-07-11 11:13:49 +08:00
Minghao Li 2dd7abd47e refactor(sync): add vnode snapshot case 2022-07-11 10:34:02 +08:00
Xiaoyu Wang ed66440c5c Merge remote-tracking branch 'origin/3.0' into feature/3.0_debug_wxy 2022-07-11 10:08:54 +08:00
Hongze Cheng 795a071eb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-11 01:48:15 +00:00
Liu Jicong f9ba552496
Merge pull request #14739 from taosdata/feature/stream
fix(wal): read after rolling
2022-07-10 21:45:31 +08:00
Liu Jicong 711f960827 Merge branch '3.0' into feature/stream 2022-07-10 21:24:18 +08:00
Liu Jicong 219d966b25 fix(wal): read after rolling 2022-07-10 21:02:25 +08:00
Haojun Liao 5c3c418c7f fix(query): set correct the fill column value for in case of no primary timestamp column exists. 2022-07-10 20:59:56 +08:00
Hongze Cheng 3781db867e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 12:25:25 +00:00
Hongze Cheng be1af580c2 tsdb retention function 2022-07-10 12:25:11 +00:00
Li Minghao 6ae9741e02
Merge pull request #14738 from taosdata/feature/3.0_mhli
refactor(sync): update to SYNC_STRATEGY_WAL_FIRST
2022-07-10 19:43:28 +08:00
Minghao Li 9e4c4c50a0 refactor(sync): update to SYNC_STRATEGY_WAL_FIRST 2022-07-10 19:10:06 +08:00
Shengliang Guan ffe4453bcc
Merge pull request #14736 from taosdata/feature/3_liaohj
refactor: do some internal refactor and fix some memory leak.
2022-07-10 18:12:42 +08:00
Li Minghao 49954b327f
Merge pull request #14730 from taosdata/feature/3.0_mhli
fix(sync): vnode snapshot sender
2022-07-10 17:52:29 +08:00
Haojun Liao ac8e9d103c other: merge 3.0 2022-07-10 17:40:55 +08:00
Haojun Liao 7dc7f478de refactor: do some internal refactor and fix some memory leak. 2022-07-10 17:34:21 +08:00
Haojun Liao b2a8eec15d
Merge pull request #14718 from taosdata/feature/3_liaohj
fix(query): set correct stddev merge input rows.
2022-07-10 17:25:41 +08:00
Liu Jicong 5478360bef
Merge pull request #14734 from taosdata/feature/stream
feat(tmq): support consume from tsdb then wal
2022-07-10 17:17:19 +08:00
Hongze Cheng 8c45b028c1 finish tsdb snapshot 2022-07-10 08:47:28 +00:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Liu Jicong 5f36406b7d
Merge pull request #14724 from taosdata/feature/stream
refactor(stream)
2022-07-10 15:53:48 +08:00
Liu Jicong ff5f1aa1a5 refactor(stream) 2022-07-10 15:23:34 +08:00
Liu Jicong 5640036f66 refactor(stream) 2022-07-10 14:48:16 +08:00
Haojun Liao 69e9a2ad5c
Merge branch '3.0' into feature/3_liaohj 2022-07-10 14:46:53 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Liu Jicong bafa54778a refactor(stream) 2022-07-10 14:10:39 +08:00
Hongze Cheng 53a13db814 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 06:01:55 +00:00
Hongze Cheng 699c9572f5 more 2022-07-10 06:01:30 +00:00
Li Minghao 644963b745
Merge pull request #14722 from taosdata/feature/3.0_mhli
refactor(sync): add snapshot writer
2022-07-10 13:58:47 +08:00
Liu Jicong 2225411edc refactor(stream) 2022-07-10 13:57:17 +08:00
Liu Jicong 9fd1a64557
Merge pull request #14720 from taosdata/feature/stream
refactor(stream)
2022-07-10 13:55:55 +08:00
Liu Jicong 8afb54548f refactor(stream) 2022-07-10 13:21:37 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Cary Xu 76aba6ec34 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-10 11:30:11 +08:00
Cary Xu 833c1ec487 enh: rsma optimization for info item and tmr handle 2022-07-10 11:29:55 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Minghao Li e1db3eee36 refactor(sync): merge tsdb_snapshot code 2022-07-10 10:55:46 +08:00
Haojun Liao 9738bb4aff Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-10 10:16:41 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00
Cary Xu 5a1d39700d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-09 15:45:00 +08:00
Cary Xu dd81770841 fix: rsma ref fix and add debug logs 2022-07-09 15:44:37 +08:00
Haojun Liao fceee02622
Merge branch '3.0' into feature/3_liaohj 2022-07-09 11:11:11 +08:00
Liu Jicong 0fd4f3b519 fix(tmq): invalid free 2022-07-08 23:05:32 +08:00
Liu Jicong 72d7cc5edf Merge branch '3.0' into feature/stream 2022-07-08 22:00:34 +08:00
Liu Jicong 8d01ae00cb fix(tmq): offset 2022-07-08 21:37:15 +08:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Minglei Jin 236c1d0202
Merge pull request #14698 from taosdata/fix/tsdb-cache-last-delete
fix: release handle to keep refs correct
2022-07-08 20:12:13 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Liu Jicong a9e75c87aa refactor(stream): internal refactor 2022-07-08 19:30:40 +08:00
Minglei Jin e4c45e507f fix: release handle to keep refs correct 2022-07-08 18:51:44 +08:00
Hongze Cheng abbe8fd76e Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 10:20:48 +00:00
Minglei Jin 8209b3a562
Merge pull request #14687 from taosdata/fix/tsdb-cache-last-delete
fix: invalidate last cache when it's covered by delete range
2022-07-08 18:11:39 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Liu Jicong 938868e39f merge from 3.0 2022-07-08 17:57:11 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
Minglei Jin 2ef8cd9a8f fix: invalidate last cache when it's covered by delete range 2022-07-08 17:37:49 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Haojun Liao 3e81daf578 fix(query): fix memory leak. 2022-07-08 17:28:37 +08:00
dapan1121 50a6ef7f39
Merge pull request #14635 from taosdata/feature/insertselect
feat: support insert from query res
2022-07-08 16:59:21 +08:00
Shengliang Guan 7c39d6076c
Merge pull request #14681 from taosdata/fix/tsim
refactor: delete redundant files
2022-07-08 16:30:00 +08:00
Hongze Cheng 294acc9e00 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 08:26:50 +00:00
Haojun Liao 1711d646c1
Merge pull request #14671 from taosdata/feature/3_liaohj
enh(query): add block sma for int type column data.
2022-07-08 16:23:13 +08:00
Hongze Cheng 1e4f7e3a9c fix: count coredump 2022-07-08 08:23:12 +00:00
Minglei Jin 089285ce3a
Merge pull request #14682 from taosdata/fix/last-ts
tsdbCache/last: save ts info of each column
2022-07-08 16:19:09 +08:00
Cary Xu 236ab7713e
Merge pull request #14680 from taosdata/feature/TD-11274-3.0
fix: set groupId for rsma and comment out rsma test case
2022-07-08 16:03:18 +08:00
Minglei Jin 23fc0f0008 tsdbCache/last: save ts info of each column 2022-07-08 15:54:11 +08:00
Shengliang Guan 96db676995 refactor: delete redundant files 2022-07-08 15:37:53 +08:00
Cary Xu 301edfe79b fix: set groupId for rsma and comment out rsma test case 2022-07-08 15:23:11 +08:00
Hongze Cheng 57cc359858 more work 2022-07-08 05:31:34 +00:00
Hongze Cheng e5c549b6a7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 05:10:31 +00:00
Shengliang Guan d008e527e3
Merge pull request #14672 from taosdata/fix/valgrind
fix: asan error
2022-07-08 12:35:25 +08:00
Shengliang Guan 09c095a91c fix: asan error 2022-07-08 11:51:35 +08:00
Haojun Liao 91eaba87ef Merge branch '3.0' into feature/3_liaohj 2022-07-08 11:24:28 +08:00
Haojun Liao c339800611 fix(query): handle delete duration generating data block. 2022-07-08 11:02:12 +08:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Hongze Cheng 5fd4452e77 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 01:52:53 +00:00
Yihao Deng d7956b6e14
Merge pull request #14660 from taosdata/enh/rmIdx
enh: rm table idx
2022-07-08 09:31:41 +08:00
Haojun Liao 5c2e98544d fix(query): check if the data block overlaps with the delete skyline 2022-07-07 22:40:20 +08:00
Liu Jicong 7872b16d31
Merge pull request #14657 from taosdata/feature/stream
refactor(stream): internal refactor
2022-07-07 21:42:04 +08:00
Cary Xu 3585629195
Merge pull request #14661 from taosdata/feature/TD-11274-3.0
other: comment out the rsma test case and add debug logs
2022-07-07 21:27:11 +08:00
Cary Xu e0532065f0 other: comment out the test case and add debug logs 2022-07-07 17:58:03 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
Hongze Cheng 74501e8fd5 fix: merge commit 2022-07-07 09:48:54 +00:00
yihaoDeng 3ed0280025 feat: support del index when drop child table 2022-07-07 17:39:49 +08:00
Haojun Liao 211985f03e refactor: do some internal refactor. 2022-07-07 17:23:54 +08:00
Hongze Cheng 16c1df91eb fix: tsdb commit merge bug 2022-07-07 09:07:14 +00:00
Hongze Cheng 71331d79b7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 09:02:30 +00:00
Hongze Cheng 77f6c41d31 more work 2022-07-07 09:02:07 +00:00
Haojun Liao 92276bfa87 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-07 16:50:14 +08:00
Haojun Liao 557873c1bc other: merge 3.0 2022-07-07 16:50:00 +08:00
Minglei Jin a09d462478 fix: resolve valgrind memory issues 2022-07-07 16:04:12 +08:00
Hongze Cheng 1dd89a44b8 Merge branch 'feature/3_liaohj' of https://github.com/taosdata/TDengine into feature/3_liaohj 2022-07-07 08:01:06 +00:00
Hongze Cheng dd4f67df2f fix: sma read bug 2022-07-07 08:01:01 +00:00
Minglei Jin 5a5c58f86d
Merge pull request #14648 from taosdata/fix/tsdb-cache-delidx
fix: fix tsdb cache del index reading
2022-07-07 15:58:11 +08:00
Haojun Liao 41be3e4d04 refactor: do some internal refactor. 2022-07-07 15:56:43 +08:00
Haojun Liao 57bf509dee refactor: do some internal refactor. 2022-07-07 15:40:04 +08:00
Haojun Liao d9e5172357 fix(query): set the correct sma data 2022-07-07 15:32:56 +08:00
Minglei Jin d2a1d50f5d
Merge pull request #14646 from taosdata/fix/fdel
fix: another delete file commit bug
2022-07-07 15:07:16 +08:00
Minglei Jin 4288ab412e fix: fix tsdb cache del index reading 2022-07-07 14:58:59 +08:00
Hongze Cheng 124125677f fix: another delete file commit bug 2022-07-07 06:41:05 +00:00
Hongze Cheng 5e0b8e2f45
Merge pull request #14643 from taosdata/fix/fdel
fix: delete file commit bug
2022-07-07 14:40:55 +08:00
Liu Jicong 6b479f4a1f
Merge pull request #14592 from taosdata/feature/stream
refactor(stream): stream reader created in scanner
2022-07-07 14:30:39 +08:00
Hongze Cheng 3f2ce5985b fix: delete file commit bug 2022-07-07 06:12:56 +00:00
Liu Jicong 4a648d711f feat(wal): support filter 2022-07-07 13:56:47 +08:00
Hongze Cheng 4edcd7011e more work 2022-07-07 05:40:49 +00:00
Hongze Cheng 9a0e15f1c1 fix coredump 2022-07-07 05:32:24 +00:00
Hongze Cheng 84b70e21d3
Merge pull request #14634 from taosdata/fix/td-17137
Fix:commit assert bug
2022-07-07 11:50:09 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Haojun Liao 4d2bc796e7 enh(query): add block sma for int type column data. 2022-07-07 11:26:58 +08:00
Hongze Cheng 8c72f52648 fix:commit assert bug 2022-07-07 02:56:12 +00:00
Liu Jicong 1e7d9ada19 fix(stream): clean up timer 2022-07-07 10:55:22 +08:00
Liu Jicong 82e0f77715 Merge branch '3.0' into feature/stream 2022-07-07 10:48:09 +08:00
yihaoDeng d9e8329975 support bool tag 2022-07-07 10:05:48 +08:00
Minglei Jin 7ac8e51a75 fix: fix vnode memory issues 2022-07-07 09:58:47 +08:00
Hongze Cheng 089d5e6150 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:37:50 +00:00
Yihao Deng 31655c07d7
Merge pull request #14611 from taosdata/feat/idxFix1
enh: refactor idx code
2022-07-07 09:21:06 +08:00
Hongze Cheng fdf6d22d1b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:17:00 +00:00
dapan1121 d4696ef31f Merge branch '3.0' into feature/insertselect 2022-07-07 09:02:09 +08:00
Minglei Jin ad96ee7630
Merge pull request #14623 from taosdata/fix/TD-17124
fix: dismiss valgrind memory issues
2022-07-06 23:10:04 +08:00
Liu Jicong baa48489b7 merge from 3.0 2022-07-06 21:25:34 +08:00
Liu Jicong db23b07ae1 merge from 3.0 2022-07-06 21:12:46 +08:00
Shengliang Guan c1667cdd84
Merge pull request #14600 from taosdata/fix/dnode
refactor: redirect vnode msg
2022-07-06 21:01:57 +08:00
dapan1121 d625cc2e47 feat: insert from query 2022-07-06 21:00:31 +08:00