Commit Graph

3455 Commits

Author SHA1 Message Date
Hongze Cheng 3359b8e620 more optimize 2022-08-15 10:16:07 +00:00
Minghao Li 947d90e196 refactor(sync): add syncIsReadyForRead 2022-08-15 17:36:46 +08:00
Cary Xu 313a546b85 other: merge 3.0 2022-08-15 16:25:39 +08:00
Hongze Cheng 563deee127 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-15 08:06:48 +00:00
Minghao Li 22c6d82ded refactor(sync): add syncIsReadyForRead 2022-08-15 14:45:52 +08:00
Minghao Li 6cff4dcfd8 refactor(sync): add syncIsReadyForRead 2022-08-15 14:42:40 +08:00
Liu Jicong b9c9ea5974
Merge pull request #16103 from taosdata/feature/stream
refactor(stream): remove unneccessary param in converting data
2022-08-15 13:26:46 +08:00
Liu Jicong 6f75e03a55 refactor(stream): remove unneccessary param in converting data 2022-08-15 11:06:53 +08:00
Hongze Cheng e1b638aeb5 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-15 03:02:54 +00:00
Cary Xu 34e14f770f enh: rsma batch process 2022-08-15 09:39:55 +08:00
Cary Xu dab6c81769 enh: rsma batch process 2022-08-15 00:16:44 +08:00
Minglei Jin e9d072273f fix: close tbc before returning 2022-08-13 12:05:08 +08:00
wangmm0220 37f6d1195c fix:error in get table list 2022-08-12 21:57:29 +08:00
Cary Xu 8c75274e13 Merge branch '3.0' into feature/3.0_interval_hash_optimize 2022-08-12 21:04:20 +08:00
Cary Xu ae7550eb86 enh: rsma exec in async mode 2022-08-12 21:00:48 +08:00
Shengliang Guan 65fa1e0164 fix: deadlock of mnode if its state changed 2022-08-12 19:20:31 +08:00
Shengliang Guan 2c28cdcbb5 fix: deadlock of mnode if its state changed 2022-08-12 18:49:41 +08:00
Shengliang Guan 646cb378ae fix: deadlock of vnode if its state changed 2022-08-12 17:35:08 +08:00
Shengliang Guan 353109cd53 fix: deadlock of vnode if its state changed 2022-08-12 17:25:08 +08:00
Shengliang Guan 4f90578270 fix: deadlock of vnode if its state changed 2022-08-12 16:32:11 +08:00
wangmm0220 61a19b80d7 Merge branch '3.0' into feature/3.0_query_optimize 2022-08-12 14:41:08 +08:00
wangmm0220 eec58b8ef0 opti:use suid+uid->tags index to optimize time cost 2022-08-12 13:53:24 +08:00
wangmm0220 e102f81f92 opti:use suid+uid->tags index to optimize time cost 2022-08-12 11:33:53 +08:00
Cary Xu a4a7022caf
Merge pull request #15976 from taosdata/feature/3.0_interval_hash_optimize
enh: rsma fetch optimization
2022-08-11 23:20:01 +08:00
Cary Xu cfca841567 fix: comment out tsma debug print 2022-08-11 21:06:17 +08:00
Cary Xu d9c10a2f0f other: rsma submit 2022-08-11 19:59:47 +08:00
Minglei Jin 46bd5e8685
Merge pull request #15982 from taosdata/fix/TD-18147
fix: make grant compile correct
2022-08-11 19:18:58 +08:00
Minglei Jin cc85cc5a96
Merge pull request #16001 from taosdata/fix/TD-18336
fix: return stable not exists
2022-08-11 19:18:39 +08:00
Minglei Jin 6058b8dff5
Merge pull request #16003 from taosdata/fix/TD-18321
fix: use mem schema if pReader->pSchema is null
2022-08-11 19:18:30 +08:00
Haojun Liao 02300b30fa
Merge pull request #15995 from taosdata/feature/3_liaohj
fix(query): add check when invoking sma filter.
2022-08-11 18:52:51 +08:00
wangmm0220 32f9bc0dd0 opti:logic for get table list 2022-08-11 18:29:28 +08:00
Minglei Jin 203a8073ca fix: use mem schema if pReader->pSchema is null 2022-08-11 18:19:44 +08:00
Minglei Jin 8cac647881 fix: return stable not exists 2022-08-11 18:12:32 +08:00
Haojun Liao 3a6285c478 fix(query): add check when invoking sma filter. 2022-08-11 17:40:55 +08:00
Minglei Jin 6537047156 fix: make grant compile correct 2022-08-11 16:16:52 +08:00
Cary Xu 6cd2e52d1a enh: code optimization 2022-08-11 14:43:17 +08:00
Liu Jicong a28c0781be
Merge pull request #15971 from taosdata/feature/stream
feat(stream): session window trigger delete
2022-08-11 14:10:18 +08:00
Liu Jicong b8a3654cd6 enh(stream): show stream 2022-08-11 13:37:32 +08:00
Liu Jicong c191f44b14 feat(stream): session window trigger delete 2022-08-11 12:01:20 +08:00
Cary Xu 15544a2207 enh: rsma fetch 2022-08-11 11:14:31 +08:00
Cary Xu a6a1cfddd5
Merge pull request #15946 from taosdata/feature/3.0_row_optimize
enh: row iter and fetch optimization
2022-08-11 09:46:27 +08:00
Cary Xu a5ef854e87 row: code optimization 2022-08-11 07:45:49 +08:00
Liu Jicong 4352ae4f90
Merge pull request #15950 from taosdata/feature/stream
enh(tmq): enable background heartbeat by default
2022-08-10 22:05:50 +08:00
Liu Jicong 7f4b46e003 feat(stream): session window trigger delete 2022-08-10 21:26:05 +08:00
Li Minghao d59a0b390b
Merge pull request #15944 from taosdata/feature/3.0_mhli
refactor(sync): add leader, follower call back
2022-08-10 17:55:08 +08:00
Cary Xu 1d6d0aa2db enh: row iter and fetch optimization 2022-08-10 17:26:44 +08:00
Liu Jicong 51aa9413d7
Merge pull request #15937 from taosdata/feature/stream
enh(tmq): speed up consumer recover
2022-08-10 17:19:36 +08:00
Minghao Li b4c8685766 refactor(sync): add leader, follower call back 2022-08-10 17:17:30 +08:00
Haojun Liao 6250c1b157
Merge pull request #15851 from taosdata/feature/3.0_query_optimize
ehn(query): optimize the query performance.
2022-08-10 16:51:46 +08:00
shenglian-zhou 6389d32445
Merge pull request #15935 from taosdata/szhou/fixbug
fix: use the pre agg value as double when generate block sma for float column and double column
2022-08-10 16:33:33 +08:00
Liu Jicong e5e82f0cf2 merge 3.0 2022-08-10 16:31:23 +08:00
Ganlin Zhao 685855e3dc
Merge pull request #15931 from taosdata/fix/TD-18115
fix(query): fix interp + fill interpolation after last datablock
2022-08-10 16:24:38 +08:00
Liu Jicong 18f6fb6123 enh(tmq): speed up consumer recover 2022-08-10 16:04:03 +08:00
shenglian zhou 6dfa283671 fix: use the pre agg value as double when generate block sma for float column and double column 2022-08-10 15:35:00 +08:00
Hongze Cheng 465e79258a refact: a little optimize 2022-08-10 14:33:23 +08:00
Ganlin Zhao 249e2b12f6 fix(query): fix interp + fill interpolation after last datablock 2022-08-10 14:21:31 +08:00
Hongze Cheng d242226d1a Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-09 11:59:40 +00:00
Minglei Jin b57e6c15ec
Merge pull request #15910 from taosdata/fix/TD-17954
fix: tdb use sys memory when snapshot writing
2022-08-09 19:54:03 +08:00
Minglei Jin d0416f312f fix: tdb use sys memory when snapshot writing 2022-08-09 19:07:07 +08:00
wangmm0220 c381ffd38c fix:error in tmq for snapshot 2022-08-09 19:06:24 +08:00
Haojun Liao 41d2c92231 fix(query): copy null value. 2022-08-09 16:54:05 +08:00
Liu Jicong 379cdc0566
Merge pull request #15889 from taosdata/feature/stream
fix(stream): memory error
2022-08-09 14:48:01 +08:00
Liu Jicong d9a4ea305d fix(stream): memory error 2022-08-09 14:11:41 +08:00
Haojun Liao b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Xiaoyu Wang 07ef00e89f merge 3.0 2022-08-09 11:36:08 +08:00
Haojun Liao 29c84833d3 fix(query):fix invalid free. 2022-08-09 10:34:01 +08:00
Haojun Liao 30a64bdcd9 fix(query): set correct schema. 2022-08-09 10:16:00 +08:00
Hongze Cheng 4ac14697b7 fix more bug 2022-08-08 13:23:50 +00:00
Hongze Cheng 78985ce4f1 fix more bug 2022-08-08 13:05:21 +00:00
Li Minghao 7722f88093
Merge pull request #15861 from taosdata/feature/3.0_mhli
refactor(sync): speed up replicate
2022-08-08 20:36:49 +08:00
Hongze Cheng 50d03237ed fix more bug 2022-08-08 12:14:16 +00:00
Liu Jicong 87c1656f52
Merge pull request #15859 from taosdata/feature/stream
fix(stream): memory leak
2022-08-08 19:55:13 +08:00
Minghao Li df18cc5f47 refactor(sync): speed up replicate 2022-08-08 19:46:37 +08:00
Hongze Cheng 09d22bfafe Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-08 11:41:12 +00:00
Hongze Cheng 0e06d86f7b fix some bug 2022-08-08 11:40:49 +00:00
Liu Jicong 48449e80c3 fix(stream): memory leak 2022-08-08 19:17:28 +08:00
Liu Jicong e30b74ad5a fix(stream): memory leak 2022-08-08 18:53:49 +08:00
Minglei Jin a6d07527ca
Merge pull request #15854 from taosdata/fix/TD-18112
Fix/td 18112
2022-08-08 18:14:20 +08:00
Liu Jicong c411b9aebb fix(stream): memory leak 2022-08-08 18:09:36 +08:00
Hongze Cheng 2cea8b1c8d Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-08 10:06:58 +00:00
Hongze Cheng f37a072e77 more work 2022-08-08 10:06:07 +00:00
Minglei Jin d3fb552254 fix: excluding ts column from timeseries 2022-08-08 17:23:11 +08:00
Minglei Jin e0521f59b3 fix: counting normal tables in vgroups; 2022-08-08 17:18:15 +08:00
Haojun Liao 4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
Cary Xu 6a833a8d85 Merge branch '3.0' into feature/TD-11274-3.0 2022-08-08 16:18:23 +08:00
Cary Xu 875eabdbf5 fix: send rsma fetch msg to designated vg 2022-08-08 16:18:05 +08:00
Liu Jicong 3d837cf885
Merge pull request #15841 from taosdata/feature/stream
refactor(stream): add stream meta
2022-08-08 16:02:02 +08:00
Hongze Cheng 4f06c4bbdd make it compile 2022-08-08 07:32:02 +00:00
Hongze Cheng 49fde0b1a8 more work 2022-08-08 07:27:44 +00:00
Liu Jicong bb0ce39511 refactor(stream): add stream meta 2022-08-08 15:05:54 +08:00
Hongze Cheng 6baae7d50f more work 2022-08-08 06:43:51 +00:00
Li Minghao ad55155897
Merge pull request #15838 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-08 14:03:33 +08:00
wangmm0220 507adf9e7b fix:error in tmp for snapshot 2022-08-08 13:49:24 +08:00
Hongze Cheng 8ae2ab1c6e more work 2022-08-08 05:34:01 +00:00
Minghao Li 0f63837e69 refactor(sync): make leader life longer 2022-08-08 13:25:02 +08:00
Minglei Jin 819a48a464 fix: skip 0 row blocks to dismiss crashing 2022-08-08 11:46:31 +08:00
Cary Xu 0aac37a45c enh: rsma fetch logic optimization 2022-08-08 11:25:32 +08:00
Hongze Cheng 33c3f34f34 more work 2022-08-08 03:22:24 +00:00
Hongze Cheng b56aedffcb Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-08 02:24:28 +00:00
wangmm0220 9f9788c205 Merge branch '3.0' into feature/TD-14761 2022-08-08 10:04:03 +08:00
Hongze Cheng 7671bfe19e more refact 2022-08-07 15:20:28 +00:00
Hongze Cheng 71691eb7da make code compile 2022-08-07 13:14:43 +00:00
Hongze Cheng 605e89b6a1 more work 2022-08-07 12:50:42 +00:00
Cary Xu c2c7ccf776 enh: rsma info lifecyle mgmt 2022-08-07 20:06:31 +08:00
Cary Xu 963bc989e3 enh: rsma code optimization 2022-08-07 17:45:07 +08:00
Hongze Cheng 3698016ad9 more work 2022-08-07 09:25:50 +00:00
Hongze Cheng 94069ec20a more work 2022-08-07 08:35:57 +00:00
Hongze Cheng 2d50313586 more work 2022-08-07 08:12:59 +00:00
Cary Xu bf9b2ef8f0 enh: rsma fetch trigger 2022-08-07 14:59:17 +08:00
Hongze Cheng 85556a3c90 more work 2022-08-07 06:13:51 +00:00
Hongze Cheng 7c32e099d0 more work 2022-08-06 14:20:30 +00:00
Hongze Cheng 43dec55fd7 more work 2022-08-06 12:48:58 +00:00
Hongze Cheng 04804e384a more 2022-08-06 12:24:46 +00:00
Hongze Cheng 3436d52316 more refact 2022-08-06 12:23:29 +00:00
Hongze Cheng e1881185c3 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-06 12:07:16 +00:00
Hongze Cheng 3324f4e5b7 more work 2022-08-06 12:04:42 +00:00
wangmm0220 1309c489e2 fix:error in tmq for snapshot 2022-08-06 19:31:53 +08:00
Cary Xu 8ad88bc0fb Merge branch '3.0' into feature/TD-11274-3.0 2022-08-06 18:06:14 +08:00
Cary Xu 0beed37cfd fix: insert tsma data 2022-08-06 18:06:02 +08:00
Minglei Jin 34046014df
Merge pull request #15808 from taosdata/fix/TD-17988
fix: update vnode's commitTerm
2022-08-06 18:02:58 +08:00
Minglei Jin d44bce1c6f fix: update vnode's commitTerm 2022-08-06 17:20:15 +08:00
dapan1121 bcce0d1aac
Merge pull request #15771 from taosdata/enh/ctgPerf
enh: improve catalog performance
2022-08-06 16:54:22 +08:00
Hongze Cheng 44d6b1f7dc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-06 07:45:40 +00:00
Hongze Cheng 04386a3003 more work 2022-08-06 07:45:24 +00:00
Li Minghao 3e26cbbb61
Merge pull request #15800 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-06 14:13:09 +08:00
Minghao Li 05229b6650 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-08-06 13:18:03 +08:00
Minghao Li e628b70726 refactor(sync): make leader life longer 2022-08-06 13:17:08 +08:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
Hongze Cheng 85907bc269 more work 2022-08-06 02:03:20 +00:00
Hongze Cheng 16f556354a more work 2022-08-05 15:22:05 +00:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
Liu Jicong b3fa64a060
Merge pull request #15782 from taosdata/feature/stream
refactor(stream): unify sink and dispatch
2022-08-05 21:09:33 +08:00
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
Hongze Cheng 6befe4ec7f Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-05 10:02:09 +00:00
Hongze Cheng 51538a1710 more work 2022-08-05 09:47:26 +00:00
Cary Xu 55016293df Merge branch '3.0' into feature/TD-11274-3.0 2022-08-05 16:28:45 +08:00
Cary Xu 14d396b081 fix: memory leaks in taosd when use metaGetTableEntryByUid 2022-08-05 16:22:57 +08:00
Haojun Liao 52173e14e1 fix(query): add check for null ptr. 2022-08-05 16:10:45 +08:00
dapan1121 c1c3513b08 Merge branch '3.0' into enh/ctgPerf 2022-08-05 16:09:30 +08:00
Hongze Cheng e7d177a479 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-05 06:17:46 +00:00
Haojun Liao 0e4748771a enh(query): support combine multi datablock to pass to upstream operators 2022-08-05 14:10:45 +08:00
Hongze Cheng d5c2d5941f more work 2022-08-05 05:23:50 +00:00
Li Minghao 8069066ae0
Merge pull request #15765 from taosdata/feature/3.0_mhli
refactor(sync): make leader life longer
2022-08-05 11:52:55 +08:00
Cary Xu 88a500a95b fix: memory leak for stream input data block 2022-08-05 10:34:41 +08:00
Cary Xu 8f30e653a9 fix: revert the memory leak 2022-08-05 08:41:59 +08:00
Cary Xu a179b6e64d fix: solve stream input data block leak 2022-08-05 01:37:54 +08:00
Cary Xu f0dff1f039 Merge branch '3.0' into feature/TD-11274-3.0 2022-08-04 21:27:17 +08:00
Cary Xu 1231c8014b fix: solve rsma memory leak 2022-08-04 21:27:01 +08:00
Liu Jicong 7f926dd7e5
Merge pull request #15754 from taosdata/feature/stream
enh(tmq): retry consumer close
2022-08-04 21:13:39 +08:00
Minghao Li 32830ca9c0 refactor(sync): make leader life longer 2022-08-04 20:44:10 +08:00
Liu Jicong 6f8683de7e enh(tmq): retry consumer close 2022-08-04 20:37:02 +08:00
Minghao Li 9be864a6be refactor(sync): make leader life longer 2022-08-04 20:36:12 +08:00
Liu Jicong d755ad67aa
Merge pull request #15745 from taosdata/feature/stream
refactor(stream): exec scheduler
2022-08-04 18:36:46 +08:00
Hongze Cheng 2cb114caad more work 2022-08-04 10:15:51 +00:00
Haojun Liao 271528f4e2 refactor: opt tsdb performance. 2022-08-04 18:12:44 +08:00
Liu Jicong 031414001d fix schedule 2022-08-04 17:46:13 +08:00
Haojun Liao 3a5fcefc8d other: merge 3.0 2022-08-04 17:24:51 +08:00
Liu Jicong e64e41679e fix schedule 2022-08-04 17:00:45 +08:00
Liu Jicong 56156ef2b1 Merge branch '3.0' into feature/stream 2022-08-04 16:20:55 +08:00
Liu Jicong d6cc88ed4b refactor(stream): exec scheduler 2022-08-04 16:19:53 +08:00
Hongze Cheng 03a615c01a more 2022-08-04 08:04:34 +00:00
Hongze Cheng 67db73b560 more last refact work 2022-08-04 07:58:53 +00:00
Cary Xu c89967d091 enh: memory optimization 2022-08-04 15:40:29 +08:00
wangmm0220 c3cd858a63 feat:add snapshot for tmq in stable and db 2022-08-04 15:01:59 +08:00
Hongze Cheng d1c7e3a531 more last refact 2022-08-04 05:42:15 +00:00
Hongze Cheng f84f88371b Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-04 03:03:07 +00:00
Li Minghao 57a0fcd86d
Merge pull request #15720 from taosdata/feature/3.0_mhli
refactor(sync): change wal fsync flag to false
2022-08-04 10:14:20 +08:00
Cary Xu 76c6f47ede fix: par insert test update 2022-08-04 08:50:15 +08:00
dapan1121 bd81d9b5fc enh: improve catalog performance 2022-08-03 21:08:52 +08:00
Cary Xu f1790b2776 enh: adjust numOfRows in SubmitBlk from int16_t to int32_t 2022-08-03 21:03:27 +08:00
Hongze Cheng 7d1f2b76cf Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-03 12:19:28 +00:00
Hongze Cheng e6d374b006 make it compile 2022-08-03 12:19:13 +00:00
Hongze Cheng 7075244183 more last file refact 2022-08-03 12:16:57 +00:00
Shengliang Guan 72b8e0eb20 refactor: adjust logs 2022-08-03 19:17:42 +08:00
Haojun Liao 4cd7af0ecf other: merge 3.0 2022-08-03 19:02:43 +08:00
Hongze Cheng e827d0bb7a more last file refact 2022-08-03 08:50:36 +00:00
Liu Jicong 70e806b0d2
Merge pull request #15705 from taosdata/feature/stream
enh(stream): keep thread from blocking
2022-08-03 16:14:24 +08:00
Cary Xu a3166507a5 enh: don't read bitmap when all col is normal 2022-08-03 15:58:28 +08:00
Liu Jicong e345023dfd enh(stream): keep thread from blocking 2022-08-03 15:31:10 +08:00
Cary Xu 71419d330d other: adjust rsma debug logs 2022-08-03 14:58:54 +08:00
Cary Xu 335da8fc65 other: add tsma debug log 2022-08-03 14:33:29 +08:00
Haojun Liao bc600a4942 refactor: do some internal refactor optimize the building block performance. 2022-08-03 14:08:03 +08:00
Cary Xu 3b3dc1977a
Merge pull request #15698 from taosdata/feature/TD-11274-3.0
other: rsma replica restore and memory leak
2022-08-03 13:00:45 +08:00
Shengliang Guan 1ea8820775
Merge pull request #15697 from taosdata/fix/dnode
fix: adjust logs
2022-08-03 11:36:47 +08:00
Cary Xu 2f19c2d0a5 other: rsma replica restore and memory leak 2022-08-03 10:58:01 +08:00
Shengliang Guan f7e8341457 fix: adjust logs 2022-08-03 10:56:37 +08:00
Haojun Liao 64db9afeb7 refactor: do some internal refactor. 2022-08-03 10:52:06 +08:00
Hongze Cheng e996bb4542 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-03 01:52:17 +00:00
Hongze Cheng f24317fbff more last file refact 2022-08-03 01:45:56 +00:00
afwerar 108c3a1137 feat: add stable create limit 2022-08-03 09:18:36 +08:00
Zhiqiang Wang 087d431088
Merge pull request #15688 from taosdata/fix/ZhiqiangWang/TD-17383-add-table-create-limit
feat: add table create limit
2022-08-03 08:27:06 +08:00
Liu Jicong d6ce40ea3a
Merge pull request #15693 from taosdata/feature/stream
enh(stream): directly dispatch
2022-08-03 00:23:01 +08:00
Liu Jicong c089d3ba08 merge 3.0 2022-08-02 22:53:49 +08:00
Liu Jicong d43eec5d16 enh(stream): directly dispatch 2022-08-02 22:23:33 +08:00
Shengliang Guan edce4b070e Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-08-02 21:03:57 +08:00
Shengliang Guan d5ff7c3207 fix: remove redundant syncNodeReplicate calls 2022-08-02 21:02:26 +08:00
Cary Xu 99cb9bb60e
Merge pull request #15687 from taosdata/feature/TD-11274-3.0
fix: handle rsma resource leak
2022-08-02 20:42:38 +08:00
Minglei Jin 52e2b71de5
Merge pull request #15675 from taosdata/fix/TD-18080
fix: new API tdbAbort for tdb txn aborting
2022-08-02 20:22:08 +08:00
afwerar ac592b073b feat: add table create limit 2022-08-02 20:03:45 +08:00
Shengliang Guan 590266067b
Merge pull request #15680 from taosdata/fix/dnode
refactor: adjust logs
2022-08-02 19:37:07 +08:00
Minglei Jin ea032a7660 Merge branch 'v3.0' into fix/TD-18080 2022-08-02 19:30:02 +08:00
Cary Xu cecec01b75 fix: handle rsma resource leak 2022-08-02 19:21:27 +08:00
Shengliang Guan 0e29a23a30
Merge pull request #15679 from taosdata/fix/dnode
refactor: adjust sync log
2022-08-02 17:38:56 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
Hongze Cheng 2d0882edba more last file refact 2022-08-02 09:06:18 +00:00
Shengliang Guan efb0127fbf refactor: adjust logs 2022-08-02 16:48:49 +08:00
Shengliang Guan bc8c7f6ea6 refactor: minor changes 2022-08-02 16:40:05 +08:00
Shengliang Guan d5aea7dac2 refactor: adjust sync log 2022-08-02 16:39:12 +08:00
Cary Xu 602d2aa377 other: rsma snapshot and misc update 2022-08-02 16:13:36 +08:00
Minglei Jin ad466ec7a9 fix: new API tdbAbort for tdb txn aborting 2022-08-02 15:40:06 +08:00
Hongze Cheng c2db42f115 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-02 06:23:59 +00:00
Minglei Jin 711c75652c
Merge pull request #15671 from taosdata/fix/TD-18074
fix: new pSchema if reader's schema is null
2022-08-02 14:12:30 +08:00
Hongze Cheng 418166cd92 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-02 05:37:33 +00:00
Haojun Liao bb869800f6
Merge pull request #15661 from taosdata/feature/3_liaohj
refactor: optimize the build block perf.
2022-08-02 13:04:00 +08:00
Minglei Jin 5cf4dac071 fix: new pSchema if reader's schema is null 2022-08-02 12:56:33 +08:00
Li Minghao b0746d9a0b
Merge pull request #15660 from taosdata/feature/3.0_mhli
feat(sync): set batch-size 1
2022-08-02 09:57:55 +08:00
Hongze Cheng 2de5cf1155 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-02 01:55:05 +00:00
Minglei Jin 7d0d87f0b1
Merge pull request #15648 from taosdata/fix/TD-17593
fix: first round number of chile tables and timeseries
2022-08-01 23:03:37 +08:00
Minghao Li 2c1846214d feat(sync): set batch-size 1 2022-08-01 20:26:45 +08:00
Shengliang Guan bd31c9da5a
Merge pull request #15657 from taosdata/fix/dnode
fix: write snapshot after apply queue is empty
2022-08-01 20:13:08 +08:00
Haojun Liao bbcba1855d Merge branch '3.0' into feature/3_liaohj 2022-08-01 20:09:42 +08:00
Liu Jicong de582a924a
Merge pull request #15655 from taosdata/feature/stream
feat(tq): transport snapshot
2022-08-01 19:48:57 +08:00
Shengliang Guan 2b2e1c79c9 fix: write snapshot after apply queue is empty 2022-08-01 19:40:38 +08:00
Liu Jicong b084dd8ee6 feat(tq): transport snapshot 2022-08-01 19:12:37 +08:00
Hongze Cheng e0900aad8d Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/tsdb_last 2022-08-01 10:03:19 +00:00
Hongze Cheng ebd60a968c refact: tsdb last file optimize 1 2022-08-01 10:03:00 +00:00
Minglei Jin cfab6c9b20 fix: first round number of chile tables and timeseries 2022-08-01 18:01:44 +08:00
liuyao a01ebbbf45
Merge pull request #15644 from taosdata/feature/TD-17811
feat(stream):optimize stream update scan
2022-08-01 17:51:17 +08:00
Liu Jicong 16bf52bf8f
Merge pull request #15611 from taosdata/feature/stream
refactor(stream): use vnode meta
2022-08-01 17:41:19 +08:00
Shengliang Guan 99f29f6455 refactor: adjust log 2022-08-01 17:23:52 +08:00
54liuyao b3d104349f feat(stream):optimize stream update scan 2022-08-01 17:09:46 +08:00
Haojun Liao 7db6497d28 refactor: update some logs. 2022-08-01 11:19:06 +08:00
Hongze Cheng d4308489c1
Merge pull request #15610 from taosdata/refact/tsdb_last
refact: prepare for last optimize
2022-07-31 17:44:39 +08:00
Yihao Deng 043776caab
Merge pull request #15574 from taosdata/fix/idxSimBug
fix: idx sim bug
2022-07-31 10:19:16 +08:00
Minglei Jin a8176b6493
Merge pull request #15603 from taosdata/fix/TD-17592
fix: new alter keep[012], walLevel, walFsyncPeriod, cacheLast
2022-07-30 20:33:31 +08:00
Liu Jicong bb6fabcc11 refactor(stream): use vnode meta 2022-07-30 20:20:12 +08:00
Hongze Cheng 5e2a498660 refact: prepare last refact 2022-07-30 12:08:04 +00:00
Minglei Jin 734ffb583e fix: fix assignment typos 2022-07-30 20:00:39 +08:00
Minglei Jin bd473f7eb0 fix: dismiss compiling issues 2022-07-30 19:26:10 +08:00
Minglei Jin f8be648626 fix: new alter keep[012], walLevel, walFsyncPeriod, cacheLast 2022-07-30 18:17:17 +08:00
wenzhouwww facf2d5718
Merge branch '3.0' into test/cluster_case 2022-07-30 17:58:18 +08:00
wenzhouwww ed557fdc2a
Update metaSnapshot.c 2022-07-30 17:48:39 +08:00
Liu Jicong c67f5f10a2
Merge pull request #15595 from taosdata/feature/stream
enh(wal): add lock to guarantee read behaviour
2022-07-30 17:09:20 +08:00
Liu Jicong 6d67b17113 enh(wal): add lock to guarantee read behaviour 2022-07-30 16:35:49 +08:00
yihaoDeng eccc590d07 fix index bugf 2022-07-30 16:12:02 +08:00
Minglei Jin c2faef7377
Merge pull request #15555 from taosdata/fix/TD-17968
fix: update schema to newest version to parsing rows
2022-07-30 16:04:04 +08:00
yihaoDeng d0d9526d44 Merge branch 'dv' into 3 2022-07-30 15:45:57 +08:00
Minglei Jin e57f12d581 fix: use colId to merge rows 2022-07-30 15:23:28 +08:00
Hongze Cheng ac0a32d9e4 fix: multi-level storage coredump 2022-07-30 07:20:38 +00:00
yihaoDeng d2f57b4ad7 fix alter tag 2022-07-30 15:09:53 +08:00
Minglei Jin 56d2697308 fix: new tRowMergerInit2 for ts row merging 2022-07-30 12:46:40 +08:00
Cary Xu e12b2b1c53 fix: invalid free when process create table 2022-07-30 12:44:46 +08:00
Cary Xu 0bf681662d
Merge pull request #15569 from taosdata/feature/TD-11274-3.0
feat: rsma1/rsma2 support replication
2022-07-30 11:24:38 +08:00
wenzhouwww@live.cn 4ae58ec7e2 Merge remote-tracking branch 'origin/3.0' into test/cluster_case 2022-07-30 10:46:04 +08:00
yihaoDeng ac169b8d90 fix index bugf 2022-07-30 10:30:58 +08:00
Hongze Cheng 2a09e0039a
Merge pull request #15560 from taosdata/fix/hzcheng_3.0
refact: do some insert optimization
2022-07-30 10:13:29 +08:00
Cary Xu 466e7965ed feat: rsma1/rsma2 support replication 2022-07-30 00:38:11 +08:00
Haojun Liao d29a60499a
Merge pull request #15554 from taosdata/feature/3_liaohj
refactor: do some internal refactor and opt query performance.
2022-07-29 22:34:37 +08:00
Haojun Liao 2261d689e4 fix(query): opt read data from file block. 2022-07-29 21:09:33 +08:00
Hongze Cheng 87d0bf7d3c fix: tsdb dat seprate even on level 0 2022-07-29 12:01:45 +00:00
Hongze Cheng 1543e241d3 refact: do some insert optimization 2022-07-29 19:49:54 +08:00
Haojun Liao 0c1e30dc56 fix(query): step forward index 2022-07-29 19:34:13 +08:00
Minglei Jin 0c111cd2bf fix: update schema to newest version to parsing rows 2022-07-29 18:15:44 +08:00
Haojun Liao 9ee13ca254 other: merge 3.0 2022-07-29 18:03:42 +08:00
Haojun Liao 60c5b2beac fix(query): optimize the row merge procedure for files. 2022-07-29 17:53:30 +08:00
Hongze Cheng 8cadcd151d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-29 09:51:32 +00:00
Minglei Jin d67f8c3837
Merge pull request #15548 from taosdata/fix/TD-17961
fix: init mergedRow to NULL
2022-07-29 17:45:23 +08:00
Hongze Cheng 2af6f2fc3a fix: replica bug 2022-07-29 09:43:54 +00:00
wenzhouwww@live.cn 563d4880bf fix crash of snapshot 2022-07-29 17:28:19 +08:00
Minglei Jin 8cee6817ca fix: init mergedRow to NULL 2022-07-29 16:23:20 +08:00
Hongze Cheng 9c87967a11 fix: another replica coredump 2022-07-29 02:45:41 +00:00
Hongze Cheng fde0db680f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-29 02:29:03 +00:00
Li Minghao 82cc51a341
Merge pull request #15533 from taosdata/feature/3.0_mhli
refactor(sync): add propose batch
2022-07-28 21:30:17 +08:00
Minghao Li 5ad0ac9500 refactor(sync): add propose batch 2022-07-28 20:24:31 +08:00
Hongze Cheng a1120d4c20 fix: compile error 2022-07-28 10:49:07 +00:00
Cary Xu f7b0476c89
Merge pull request #15519 from taosdata/feature/TD-11274-3.0
fix: assign uid for rsma by physical plan
2022-07-28 18:31:30 +08:00
Liu Jicong e71375f1ec
Merge pull request #15516 from taosdata/feature/stream
enh(stream): recover
2022-07-28 17:25:00 +08:00
Hongze Cheng be79253d0f Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-28 09:19:26 +00:00
Cary Xu 21fba3cb1f other: revert the walWrite.c 2022-07-28 17:15:31 +08:00
Minglei Jin 6724ec5bd2
Merge pull request #15513 from taosdata/fix/TD-17930
fix: return stable not exist instead of assert(0)
2022-07-28 17:12:19 +08:00
Cary Xu 0dcb3a5da1 fix: assign uid for rsma by physical plan 2022-07-28 17:07:47 +08:00
Liu Jicong a9d11b58ad enh(stream): recover 2022-07-28 16:19:50 +08:00
Minglei Jin 9d0a32f14c
Merge pull request #15508 from taosdata/fix/TD-17925
refact: tsdbCache/cleanup, remove tsRowFromTsdbRow
2022-07-28 16:15:52 +08:00
Minglei Jin 5a82a04264 fix: return stable not exist instead of assert(0) 2022-07-28 15:55:47 +08:00
Minglei Jin 34b0208f14 refact: tsdbCache/cleanup, remove tsRowFromTsdbRow 2022-07-28 15:29:22 +08:00
Hongze Cheng a3245a1e26 fix: another replica coredump 2022-07-28 07:03:46 +00:00
Hongze Cheng 49c6ba55c4 fix: vnode snapshot problem 2022-07-28 06:56:20 +00:00
Minglei Jin 2c52b31614
Merge pull request #15502 from taosdata/fix/TD-17925
fix: cleanup tsdbCache, removing unused functions
2022-07-28 14:46:33 +08:00
Hongze Cheng fdba84b3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/hzcheng_3.0 2022-07-28 06:36:10 +00:00
Hongze Cheng 1840d8d812 fix: replica coredump debug 2022-07-28 06:35:56 +00:00
Minglei Jin 6e92950a4d fix: cleanup tsdbCache, removing unused functions 2022-07-28 14:06:44 +08:00
Li Minghao e0f0e92622
Merge pull request #15499 from taosdata/feature/3.0_mhli
refactor(sync): add trace log
2022-07-28 13:55:02 +08:00
Minghao Li df26c5f21a refactor(sync): add trace log 2022-07-28 10:54:11 +08:00
Minghao Li a93c346f24 refactor(sync): add trace log 2022-07-28 10:49:36 +08:00
dapan1121 e836437e19 Merge branch '3.0' into feature/catalogBatchFetch 2022-07-28 08:41:34 +08:00
Liu Jicong ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
Minghao Li d1068ceaf5 refactor(sync): add trace log 2022-07-27 19:37:32 +08:00
Liu Jicong 5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
Liu Jicong 00acf4520c refactor(stream): remove option 2022-07-27 16:49:03 +08:00
Haojun Liao 089f045817
Merge pull request #15444 from taosdata/feature/3_liaohj
fix(query):fix memory leak.
2022-07-27 15:49:52 +08:00
dapan1121 648a7a12b0 feat: support mnd meta batch fetching 2022-07-27 14:02:05 +08:00
WANG MINGMING 98fb54bf02
Merge pull request #15439 from taosdata/feature/TD-14761
feat:add tmq get data interface
2022-07-27 11:05:06 +08:00
dapan1121 602d2197fb feat: support vnode meta batch fetching 2022-07-27 08:27:24 +08:00
Haojun Liao aeed234b2e fix(query):fix memory leak. 2022-07-26 20:40:39 +08:00
Li Minghao 6207eef28c
Merge pull request #15436 from taosdata/feature/3.0_mhli
refactor(sync): pre-commit integration
2022-07-26 19:05:44 +08:00
dapan1121 4cf20418cd feat: support batch fetch in catalog 2022-07-26 18:00:50 +08:00
wangmm0220 915d3c4203 fix:conflicts from 3.0 2022-07-26 17:47:10 +08:00
wangmm0220 ba1962cacf feat:add tmq get data interface 2022-07-26 17:43:22 +08:00
Minghao Li 9a540919b9 refactor(sync): pre-commit integration 2022-07-26 17:23:26 +08:00
Haojun Liao 97e3946a98
Merge pull request #15421 from taosdata/feature/3_liaohj
refactor: optimize the memory consumption in tsdbread
2022-07-26 16:49:14 +08:00
Minglei Jin 9c8055c479
Merge pull request #15430 from taosdata/fix/TD-17830
fix: handle both null tag values
2022-07-26 16:40:10 +08:00
Liu Jicong ad9c3cbd8c
Merge pull request #15427 from taosdata/fix/wal
enh: add wal options to db
2022-07-26 16:38:20 +08:00
Haojun Liao bd8fa53371 fix(query): set current SBlock before move to next block. 2022-07-26 15:52:47 +08:00
Minglei Jin bb80e5c64f fix: handle both null tag values 2022-07-26 15:38:18 +08:00
Liu Jicong c2164dd8aa fix(wal): snapshot end with no deleting 2022-07-26 14:13:03 +08:00
Haojun Liao 4532bcdf4e fix(query):set ptr to be null after releasing resources. 2022-07-26 13:26:29 +08:00
Haojun Liao 6600540fd9 refactor: optimize the memory consumption during tsdbread 2022-07-26 11:43:45 +08:00
Minghao Li 0addf09996 refactor(sync): add pre-commit interface 2022-07-26 11:24:39 +08:00
Haojun Liao 231f439979 refactor: opt memory consumption for tsdbread. 2022-07-26 10:19:12 +08:00
Shengliang Guan be39c5ea9d Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-07-25 21:42:46 +08:00
Shengliang Guan 23f3fb509e
Merge pull request #15400 from taosdata/fix/tsim
fix: the message cannot be processed until the vnode recovery is complete
2022-07-25 20:28:12 +08:00
Shengliang Guan 049f713b3a Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-07-25 20:26:43 +08:00
Shengliang Guan 7296bf1658 fix: failed to create stb in 3 replica db 2022-07-25 20:26:25 +08:00
Haojun Liao b4bb80ba9d
Merge pull request #15389 from taosdata/feature/3_liaohj
fix(query):disable merge for project operator in stream processing.
2022-07-25 20:16:18 +08:00
Shengliang Guan bc9a553db0 fix: the message cannot be processed until the vnode recovery is complete 2022-07-25 19:08:08 +08:00
Shengliang Guan d726c2a982 Merge remote-tracking branch 'origin/3.0' into fix/batch 2022-07-25 18:28:06 +08:00
Liu Jicong 4e965b314d
Merge pull request #15388 from taosdata/feature/stream
feat(wal): ref
2022-07-25 17:23:39 +08:00
Shengliang Guan 3bceeef439 enh: add batch processing method to vnode 2022-07-25 17:16:26 +08:00
Shengliang Guan 8dacdd57c5 enh: add batch processing method to vnode 2022-07-25 17:10:04 +08:00
Liu Jicong 222e925644 feat(wal): ref 2022-07-25 16:40:19 +08:00
Haojun Liao 90b3e77698 fix(query):disable merge for project operator in stream processing. 2022-07-25 16:02:49 +08:00
Shengliang Guan 5b654779ba Merge pull request #15372 from taosdata/fix/tsim
test: regression case
2022-07-25 15:23:41 +08:00
Haojun Liao 6d86ef0c33 other: merge 3.0 2022-07-25 11:22:09 +08:00
Haojun Liao 93af7aaaf7 fix(query):fix limit/offset bug. 2022-07-25 11:18:30 +08:00
Haojun Liao 9bddf99d7d refactor(query): do some internal refactor. 2022-07-25 11:17:45 +08:00
Minglei Jin 4291a627ac
Merge pull request #15362 from taosdata/fix/TD-17760
fix: use default cmp func
2022-07-23 22:01:51 +08:00
Cary Xu 87b9a7542f
Merge pull request #15360 from taosdata/feature/grant-3.0
fix: grant check for create table
2022-07-23 20:40:29 +08:00
Liu Jicong 072fe10013
Merge pull request #15361 from taosdata/feature/tq
fix(tmq): correctly set reader status
2022-07-23 20:40:14 +08:00
Minglei Jin e3f7c6dff7 fix: use default cmp func 2022-07-23 20:39:27 +08:00
Liu Jicong 095f6aa4e0 fix(tmq): correctly set reader status 2022-07-23 20:07:16 +08:00
Cary Xu 381d378b58 fix: grant check for create table 2022-07-23 19:38:41 +08:00
WANG MINGMING cf665cdbc8
Merge pull request #15346 from taosdata/feature/TD-14761
feat: add interface for tmq writing raw data
2022-07-23 17:57:17 +08:00
Minglei Jin 80a88605b1
Merge pull request #15351 from taosdata/fix/TD-17683
fix: super table not exists if suid expired
2022-07-23 17:32:53 +08:00
Minglei Jin dbdee1152c fix: super table not exists if suid expired 2022-07-23 16:56:26 +08:00
Xiaoyu Wang 8a7d8147f9
Merge pull request #15333 from taosdata/feature/3.0_debug_wxy
fix: semantic check when last(*) and column are together
2022-07-23 16:53:07 +08:00
Yihao Deng ca7fe4e9b5
Merge pull request #15345 from taosdata/fix/indexMemleak
fix: avoid mem leak
2022-07-23 16:38:49 +08:00
WANG MINGMING b40325705d
Merge branch '3.0' into feature/TD-14761 2022-07-23 16:03:19 +08:00
wangmm0220 d6399cafc3 feat: add interface for tmq writing raw data 2022-07-23 15:59:29 +08:00
dapan1121 4bf6eac58c
Merge pull request #15340 from taosdata/fix/removeFilterUt
fix: remove filter ut temporarily
2022-07-23 15:53:18 +08:00