Commit Graph

2238 Commits

Author SHA1 Message Date
Haojun Liao b2a8eec15d
Merge pull request #14718 from taosdata/feature/3_liaohj
fix(query): set correct stddev merge input rows.
2022-07-10 17:25:41 +08:00
Liu Jicong 5478360bef
Merge pull request #14734 from taosdata/feature/stream
feat(tmq): support consume from tsdb then wal
2022-07-10 17:17:19 +08:00
Hongze Cheng 8c45b028c1 finish tsdb snapshot 2022-07-10 08:47:28 +00:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Liu Jicong 5f36406b7d
Merge pull request #14724 from taosdata/feature/stream
refactor(stream)
2022-07-10 15:53:48 +08:00
Liu Jicong ff5f1aa1a5 refactor(stream) 2022-07-10 15:23:34 +08:00
Liu Jicong 5640036f66 refactor(stream) 2022-07-10 14:48:16 +08:00
Haojun Liao 69e9a2ad5c
Merge branch '3.0' into feature/3_liaohj 2022-07-10 14:46:53 +08:00
Minghao Li 0521bd5afe refactor(sync): add vnodeSnapWriterClose IsApply 2022-07-10 14:28:46 +08:00
Liu Jicong bafa54778a refactor(stream) 2022-07-10 14:10:39 +08:00
Hongze Cheng 53a13db814 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 06:01:55 +00:00
Hongze Cheng 699c9572f5 more 2022-07-10 06:01:30 +00:00
Li Minghao 644963b745
Merge pull request #14722 from taosdata/feature/3.0_mhli
refactor(sync): add snapshot writer
2022-07-10 13:58:47 +08:00
Liu Jicong 2225411edc refactor(stream) 2022-07-10 13:57:17 +08:00
Liu Jicong 9fd1a64557
Merge pull request #14720 from taosdata/feature/stream
refactor(stream)
2022-07-10 13:55:55 +08:00
Liu Jicong 8afb54548f refactor(stream) 2022-07-10 13:21:37 +08:00
Minghao Li 32c3cecf2a refactor(sync): add snapshot writer 2022-07-10 11:33:28 +08:00
Cary Xu 76aba6ec34 Merge branch '3.0' into feature/TD-11274-3.0 2022-07-10 11:30:11 +08:00
Cary Xu 833c1ec487 enh: rsma optimization for info item and tmr handle 2022-07-10 11:29:55 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Minghao Li e1db3eee36 refactor(sync): merge tsdb_snapshot code 2022-07-10 10:55:46 +08:00
Haojun Liao 9738bb4aff Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-10 10:16:41 +08:00
Haojun Liao 40380ef9c1 refactor: do internal refactor. 2022-07-10 10:15:27 +08:00
Hongze Cheng 668ca4a4fb Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-10 01:51:45 +00:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00
Cary Xu 5a1d39700d Merge branch '3.0' into feature/TD-11274-3.0 2022-07-09 15:45:00 +08:00
Cary Xu dd81770841 fix: rsma ref fix and add debug logs 2022-07-09 15:44:37 +08:00
Haojun Liao fceee02622
Merge branch '3.0' into feature/3_liaohj 2022-07-09 11:11:11 +08:00
Liu Jicong 0fd4f3b519 fix(tmq): invalid free 2022-07-08 23:05:32 +08:00
Liu Jicong 72d7cc5edf Merge branch '3.0' into feature/stream 2022-07-08 22:00:34 +08:00
Liu Jicong 8d01ae00cb fix(tmq): offset 2022-07-08 21:37:15 +08:00
Hongze Cheng 0840affc32 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-08 12:33:12 +00:00
Minglei Jin 236c1d0202
Merge pull request #14698 from taosdata/fix/tsdb-cache-last-delete
fix: release handle to keep refs correct
2022-07-08 20:12:13 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Liu Jicong a9e75c87aa refactor(stream): internal refactor 2022-07-08 19:30:40 +08:00
Minglei Jin e4c45e507f fix: release handle to keep refs correct 2022-07-08 18:51:44 +08:00
Hongze Cheng abbe8fd76e Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 10:20:48 +00:00
Minglei Jin 8209b3a562
Merge pull request #14687 from taosdata/fix/tsdb-cache-last-delete
fix: invalidate last cache when it's covered by delete range
2022-07-08 18:11:39 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Liu Jicong 938868e39f merge from 3.0 2022-07-08 17:57:11 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
Minglei Jin 2ef8cd9a8f fix: invalidate last cache when it's covered by delete range 2022-07-08 17:37:49 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Haojun Liao 3e81daf578 fix(query): fix memory leak. 2022-07-08 17:28:37 +08:00
dapan1121 50a6ef7f39
Merge pull request #14635 from taosdata/feature/insertselect
feat: support insert from query res
2022-07-08 16:59:21 +08:00
Shengliang Guan 7c39d6076c
Merge pull request #14681 from taosdata/fix/tsim
refactor: delete redundant files
2022-07-08 16:30:00 +08:00
Hongze Cheng 294acc9e00 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 08:26:50 +00:00
Haojun Liao 1711d646c1
Merge pull request #14671 from taosdata/feature/3_liaohj
enh(query): add block sma for int type column data.
2022-07-08 16:23:13 +08:00
Hongze Cheng 1e4f7e3a9c fix: count coredump 2022-07-08 08:23:12 +00:00
Minglei Jin 089285ce3a
Merge pull request #14682 from taosdata/fix/last-ts
tsdbCache/last: save ts info of each column
2022-07-08 16:19:09 +08:00
Cary Xu 236ab7713e
Merge pull request #14680 from taosdata/feature/TD-11274-3.0
fix: set groupId for rsma and comment out rsma test case
2022-07-08 16:03:18 +08:00
Minglei Jin 23fc0f0008 tsdbCache/last: save ts info of each column 2022-07-08 15:54:11 +08:00
Shengliang Guan 96db676995 refactor: delete redundant files 2022-07-08 15:37:53 +08:00
Cary Xu 301edfe79b fix: set groupId for rsma and comment out rsma test case 2022-07-08 15:23:11 +08:00
Hongze Cheng 57cc359858 more work 2022-07-08 05:31:34 +00:00
Hongze Cheng e5c549b6a7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 05:10:31 +00:00
Shengliang Guan d008e527e3
Merge pull request #14672 from taosdata/fix/valgrind
fix: asan error
2022-07-08 12:35:25 +08:00
Shengliang Guan 09c095a91c fix: asan error 2022-07-08 11:51:35 +08:00
Haojun Liao 91eaba87ef Merge branch '3.0' into feature/3_liaohj 2022-07-08 11:24:28 +08:00
Haojun Liao c339800611 fix(query): handle delete duration generating data block. 2022-07-08 11:02:12 +08:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Hongze Cheng 5fd4452e77 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/tsdb_merge_bug 2022-07-08 01:52:53 +00:00
Yihao Deng d7956b6e14
Merge pull request #14660 from taosdata/enh/rmIdx
enh: rm table idx
2022-07-08 09:31:41 +08:00
Haojun Liao 5c2e98544d fix(query): check if the data block overlaps with the delete skyline 2022-07-07 22:40:20 +08:00
Liu Jicong 7872b16d31
Merge pull request #14657 from taosdata/feature/stream
refactor(stream): internal refactor
2022-07-07 21:42:04 +08:00
Cary Xu 3585629195
Merge pull request #14661 from taosdata/feature/TD-11274-3.0
other: comment out the rsma test case and add debug logs
2022-07-07 21:27:11 +08:00
Cary Xu e0532065f0 other: comment out the test case and add debug logs 2022-07-07 17:58:03 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
Hongze Cheng 74501e8fd5 fix: merge commit 2022-07-07 09:48:54 +00:00
yihaoDeng 3ed0280025 feat: support del index when drop child table 2022-07-07 17:39:49 +08:00
Haojun Liao 211985f03e refactor: do some internal refactor. 2022-07-07 17:23:54 +08:00
Hongze Cheng 16c1df91eb fix: tsdb commit merge bug 2022-07-07 09:07:14 +00:00
Hongze Cheng 71331d79b7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 09:02:30 +00:00
Hongze Cheng 77f6c41d31 more work 2022-07-07 09:02:07 +00:00
Haojun Liao 92276bfa87 Merge remote-tracking branch 'origin/feature/3_liaohj' into feature/3_liaohj 2022-07-07 16:50:14 +08:00
Haojun Liao 557873c1bc other: merge 3.0 2022-07-07 16:50:00 +08:00
Minglei Jin a09d462478 fix: resolve valgrind memory issues 2022-07-07 16:04:12 +08:00
Hongze Cheng 1dd89a44b8 Merge branch 'feature/3_liaohj' of https://github.com/taosdata/TDengine into feature/3_liaohj 2022-07-07 08:01:06 +00:00
Hongze Cheng dd4f67df2f fix: sma read bug 2022-07-07 08:01:01 +00:00
Minglei Jin 5a5c58f86d
Merge pull request #14648 from taosdata/fix/tsdb-cache-delidx
fix: fix tsdb cache del index reading
2022-07-07 15:58:11 +08:00
Haojun Liao 41be3e4d04 refactor: do some internal refactor. 2022-07-07 15:56:43 +08:00
Haojun Liao 57bf509dee refactor: do some internal refactor. 2022-07-07 15:40:04 +08:00
Haojun Liao d9e5172357 fix(query): set the correct sma data 2022-07-07 15:32:56 +08:00
Minglei Jin d2a1d50f5d
Merge pull request #14646 from taosdata/fix/fdel
fix: another delete file commit bug
2022-07-07 15:07:16 +08:00
Minglei Jin 4288ab412e fix: fix tsdb cache del index reading 2022-07-07 14:58:59 +08:00
Hongze Cheng 124125677f fix: another delete file commit bug 2022-07-07 06:41:05 +00:00
Hongze Cheng 5e0b8e2f45
Merge pull request #14643 from taosdata/fix/fdel
fix: delete file commit bug
2022-07-07 14:40:55 +08:00
Liu Jicong 6b479f4a1f
Merge pull request #14592 from taosdata/feature/stream
refactor(stream): stream reader created in scanner
2022-07-07 14:30:39 +08:00
Hongze Cheng 3f2ce5985b fix: delete file commit bug 2022-07-07 06:12:56 +00:00
Liu Jicong 4a648d711f feat(wal): support filter 2022-07-07 13:56:47 +08:00
Hongze Cheng 4edcd7011e more work 2022-07-07 05:40:49 +00:00
Hongze Cheng 9a0e15f1c1 fix coredump 2022-07-07 05:32:24 +00:00
Hongze Cheng 84b70e21d3
Merge pull request #14634 from taosdata/fix/td-17137
Fix:commit assert bug
2022-07-07 11:50:09 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Haojun Liao 4d2bc796e7 enh(query): add block sma for int type column data. 2022-07-07 11:26:58 +08:00
Hongze Cheng 8c72f52648 fix:commit assert bug 2022-07-07 02:56:12 +00:00
Liu Jicong 1e7d9ada19 fix(stream): clean up timer 2022-07-07 10:55:22 +08:00
Liu Jicong 82e0f77715 Merge branch '3.0' into feature/stream 2022-07-07 10:48:09 +08:00
yihaoDeng d9e8329975 support bool tag 2022-07-07 10:05:48 +08:00
Minglei Jin 7ac8e51a75 fix: fix vnode memory issues 2022-07-07 09:58:47 +08:00
Hongze Cheng 089d5e6150 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:37:50 +00:00
Yihao Deng 31655c07d7
Merge pull request #14611 from taosdata/feat/idxFix1
enh: refactor idx code
2022-07-07 09:21:06 +08:00
Hongze Cheng fdf6d22d1b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-07 01:17:00 +00:00
dapan1121 d4696ef31f Merge branch '3.0' into feature/insertselect 2022-07-07 09:02:09 +08:00
Minglei Jin ad96ee7630
Merge pull request #14623 from taosdata/fix/TD-17124
fix: dismiss valgrind memory issues
2022-07-06 23:10:04 +08:00
Liu Jicong baa48489b7 merge from 3.0 2022-07-06 21:25:34 +08:00
Liu Jicong db23b07ae1 merge from 3.0 2022-07-06 21:12:46 +08:00
Shengliang Guan c1667cdd84
Merge pull request #14600 from taosdata/fix/dnode
refactor: redirect vnode msg
2022-07-06 21:01:57 +08:00
dapan1121 d625cc2e47 feat: insert from query 2022-07-06 21:00:31 +08:00
Minglei Jin 4b4d207c4d fix: dismiss valgrind memory issues 2022-07-06 20:55:56 +08:00
Hongze Cheng 4d943f3030 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 12:53:42 +00:00
Minglei Jin aad0342471
Merge pull request #14609 from taosdata/fix/tsdb-cache-read
fix: use column schema's type
2022-07-06 20:51:59 +08:00
dapan1121 82dbf54719 Merge branch 'fix/dnode' of github.com:taosdata/TDengine into fix/dnode 2022-07-06 20:34:07 +08:00
dapan1121 a3bf5b96c4 fix: fix query redirect issue 2022-07-06 20:33:23 +08:00
Hongze Cheng bf0b37390d Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 12:24:27 +00:00
Hongze Cheng b3da0e2a15 meta snapshot write 2022-07-06 12:21:59 +00:00
yihaoDeng bc29708686 fix json tag value 2022-07-06 20:05:45 +08:00
Hongze Cheng be85e27234 more tsdb snapshot writer 2022-07-06 12:03:08 +00:00
Li Minghao b2f7d70b7e
Merge pull request #14608 from taosdata/feature/3.0_mhli
refactor(sync): add propose batch in no snapshot strategy
2022-07-06 19:22:43 +08:00
WANG MINGMING 73e094d77f
Merge pull request #14505 from taosdata/feature/TD-13041
fix:<TD-16840> meta ttl index core if insert with benchmark
2022-07-06 19:15:43 +08:00
Shengliang Guan 0163ec4d4b Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-06 18:53:26 +08:00
Hongze Cheng 9a90714ecc more work 2022-07-06 10:44:28 +00:00
Hongze Cheng aa27f51dea some retention code 2022-07-06 10:37:26 +00:00
yihaoDeng 1e5ddcb92f merge 3.0 2022-07-06 18:29:11 +08:00
Minglei Jin 1c42970747 fix: use column schema's type 2022-07-06 17:56:05 +08:00
Minghao Li 0e12b29ca9 refactor(sync): add propose batch in no snapshot strategy 2022-07-06 17:51:12 +08:00
Hongze Cheng 0901640ba2 make snapshot compile 2022-07-06 09:46:14 +00:00
Minglei Jin d843a8ac89
Merge pull request #14486 from taosdata/feat/tsdb_refact
Feat/tsdb refact
2022-07-06 17:43:22 +08:00
Hongze Cheng 35fb7bbd31 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 09:36:32 +00:00
Hongze Cheng 409de824a2 more code 2022-07-06 09:36:14 +00:00
Minglei Jin a0f3655f55 fix: fix win CI crash caused by tmp variable 2022-07-06 17:15:58 +08:00
Minglei Jin 220636f6fa Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-06 17:12:53 +08:00
Minglei Jin ce90d228f9 fix: fix win CI crash caused by tmp variable 2022-07-06 17:10:08 +08:00
Minghao Li b73914fb0d refactor(sync): add term in rpcMsg 2022-07-06 16:52:39 +08:00
dapan1121 0d4fb5bb80 feat: support insert from query 2022-07-06 16:29:51 +08:00
Hongze Cheng e6b0271819 more code 2022-07-06 08:28:59 +00:00
Minghao Li fcb2197200 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:27:58 +08:00
Hongze Cheng d4a5d5118a finish del data writer 2022-07-06 08:24:46 +00:00
Hongze Cheng 8d92366ed1 more work 2022-07-06 08:07:02 +00:00
Shengliang Guan 5e18e07a35 refactor: pre process vnode msg 2022-07-06 16:06:55 +08:00
Minghao Li cc9888837e refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 16:05:57 +08:00
Minghao Li 432e1a39b7 refactor(sync): add vnodeSnapshotStopRead into callback 2022-07-06 15:47:24 +08:00
Hongze Cheng c70d2a578a more tsdb del snapshot writer 2022-07-06 07:47:16 +00:00
yihaoDeng 14cfbd7e45 fix tag/json tag error 2022-07-06 15:07:42 +08:00
Hongze Cheng 9720f05491 more tsdb snapshow writer 2022-07-06 06:59:53 +00:00
Liu Jicong 8c5dbde918 refactor(stream): stream reader created in scanner 2022-07-06 14:20:07 +08:00
Hongze Cheng 4d3e313e30 Merge branch 'feat/tsdb_refact' of https://github.com/taosdata/TDengine into feat/tsdb_snapshot 2022-07-06 06:08:12 +00:00