Commit Graph

384 Commits

Author SHA1 Message Date
Cary Xu 95d30b7f5d enh: code format optimization 2022-05-08 17:09:00 +08:00
Cary Xu b603e798c6 feat: rsma config optimization 2022-05-08 17:04:19 +08:00
Cary Xu 215613f4cd feat: set tsdb cfg for rollup sma 2022-05-07 22:33:19 +08:00
Hongze Cheng 323ce214b6 refact encode APIs 2022-05-07 10:03:06 +00:00
Hongze Cheng 5d150204dd more refact 2022-05-07 06:57:31 +00:00
Haojun Liao 2b803d8b93 enh(query): set uid for the result datablock of stream scanner when handling the submit block. 2022-05-06 23:40:26 +08:00
Cary Xu c7ca57f557 feat: rollup data submit 2022-05-02 00:30:47 +08:00
Haojun Liao ca786a9251
Merge pull request #12065 from taosdata/feature/3.0_liaohj
enh(query): enable check sma status for each column in query.
2022-04-29 20:49:46 +08:00
Haojun Liao c71c88a719 enh(query): enable check sma status for each column in query. 2022-04-29 20:07:33 +08:00
Cary Xu da4f86f368
Merge branch '3.0' into feature/TD-14481-3.0 2022-04-29 18:41:33 +08:00
Cary Xu 341e3a022c feat: rollup vnode refactor 2022-04-29 18:07:50 +08:00
Hongze Cheng ab0e435d81 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/vnode_refact1 2022-04-29 10:02:58 +00:00
Cary Xu 5afaaaf4a9 feat: migrate tsdb read interface to vnode 2022-04-28 21:22:40 +08:00
Shengliang Guan 2d7ccc3b21 enh: refactor db options 2022-04-28 15:30:23 +08:00
Hongze Cheng 7ff3183a70 refact TDB 2022-04-28 07:02:49 +00:00
Hongze Cheng 624a2b564e Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/vnode_refact1 2022-04-28 02:04:07 +00:00
Hongze Cheng 4e9007e338 refactor: vnode 2022-04-27 10:04:56 +00:00
Haojun Liao 68f7c0ec94 Merge remote-tracking branch 'origin/feature/vnode_refact1' into feature/3.0_liaohj 2022-04-27 15:19:54 +08:00
Haojun Liao d62ddcf2db enh(query): add more information for the result of show tables. 2022-04-27 15:17:15 +08:00
Hongze Cheng 09ff7f6aa0 refactor: vnode 2022-04-27 07:04:56 +00:00
Hongze Cheng 0b0bdf2f7a refactor: tsdb 2022-04-27 06:15:05 +00:00
Hongze Cheng 42c6f01980 refact vnode includes 2022-04-26 11:04:26 +00:00
Hongze Cheng 15127f3a97 Merge branch '3.0' of https://github.com/taosdata/TDengine into vnode_refact_merge 2022-04-26 09:19:30 +00:00
Haojun Liao 842b75cd9d Merge remote-tracking branch 'origin/3.0' into feature/3.0_liaohj 2022-04-26 14:10:45 +08:00
Hongze Cheng 6fe299cdcd Merge branch '3.0' of https://github.com/taosdata/TDengine into vnode_refact_merge 2022-04-26 05:49:42 +00:00
Haojun Liao 9b40ec72d6 fix(query): handle the optimized order by in tablescan operator. 2022-04-26 13:09:29 +08:00
Shengliang Guan 8864a9ed59 fix(raft): crash while start vnode 2022-04-25 15:39:52 +08:00
Hongze Cheng 588fd84853 refact meta 2022-04-24 06:19:12 +00:00
Hongze Cheng cc9496e5a0 refact vnode 2022-04-24 05:38:56 +00:00
Hongze Cheng 44dc05f38f more refact meta 2022-04-23 10:50:26 +00:00
Minghao Li 64dfc1da1c merge 3.0 code 2022-04-22 17:11:56 +08:00
Hongze Cheng 57d642b9b4 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/vnode_refact1 2022-04-22 05:33:29 +00:00
Liu Jicong 9a3365e1f1 fix pointer type 2022-04-22 10:59:09 +08:00
Liu Jicong d51336384f feat(tmq): add db subscribe 2022-04-22 10:55:17 +08:00
Hongze Cheng 055e0516fa Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/vnode_refact1 2022-04-21 11:22:43 +00:00
Liu Jicong 3dd3ad1e05 refactor(tmq): rewrite tq read function 2022-04-21 14:30:37 +08:00
Hongze Cheng 6953688761 add commit snapshot 2022-04-20 11:30:18 +00:00
Hongze Cheng a7941cf2f5 refact meta 2 2022-04-20 06:56:34 +00:00
Hongze Cheng 3cc66adcb7 refact meta 1 2022-04-19 13:10:03 +00:00
Minghao Li f7fb9b023f sync integration 2022-04-19 20:14:55 +08:00
Hongze Cheng 167657c192 refactor: sync 2022-04-19 09:07:42 +00:00
Hongze Cheng eeb45f210a Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/sync-vnode-merge-3.0 2022-04-19 09:03:39 +00:00
Minghao Li 9a7924049f sync integration 2022-04-19 15:43:24 +08:00
Hongze Cheng f8d1f5a813 refact vnode 2022-04-19 03:17:23 +00:00
Hongze Cheng 7895c492ba refact vnod3 2022-04-19 02:37:45 +00:00
Hongze Cheng 261037f341 add dbname on vnode cfg 2022-04-19 01:57:46 +00:00
Haojun Liao 30602b8cfb Merge remote-tracking branch 'origin/3.0' into feature/3.0_liaohj 2022-04-16 19:02:08 +08:00
Hongze Cheng 6e7ab6ca4d refact vnode 2022-04-16 08:19:21 +00:00
Hongze Cheng fe368d0ffe refact vnode 2022-04-16 08:03:19 +00:00
Hongze Cheng cb585812f1 refact 1 2022-04-16 07:16:10 +00:00
Hongze Cheng c1fef8c445 refact 2022-04-16 07:04:25 +00:00
Haojun Liao fd9e520865 other: merge 3.0 branch to resolve conflict. 2022-04-16 10:07:28 +08:00
Haojun Liao 774e4ad62c enh(query): add more load conditions check before load data block from file. 2022-04-15 20:06:27 +08:00
Hongze Cheng aa266dea41 refact vnode 2022-04-15 06:47:39 +00:00
Hongze Cheng 83c8be3088 refact 2022-04-15 06:38:18 +00:00
Hongze Cheng 2b6c03bc24 more 2022-04-14 12:44:25 +00:00
Hongze Cheng e048acfe76 refact vnode 2022-04-14 12:36:35 +00:00
Hongze Cheng c032e89af6 refact vnode 2022-04-14 10:21:06 +00:00
Hongze Cheng 6dab6153a8 refact vnode 2022-04-14 05:28:11 +00:00
Hongze Cheng f80768efb3 refact vnode 2022-04-14 02:53:10 +00:00
Hongze Cheng bb6806b59e refact vnode 2022-04-14 02:25:49 +00:00
Hongze Cheng 10b8756c6b refact vnode 2022-04-14 02:13:47 +00:00
Hongze Cheng 272d0ec74a refact vnode 2022-04-14 02:10:56 +00:00
Hongze Cheng b932b5bca6 refact header file 2022-04-14 02:01:04 +00:00
Cary Xu 744a198906 add version for tsma expired window updating 2022-04-13 20:02:11 +08:00
Cary Xu f9d162bae2 tsma use TDB 2022-04-13 16:02:55 +08:00
Hongze Cheng 6faaafb7a2 remove tsdb.h and meta.h 2022-04-08 06:09:15 +00:00
Cary Xu c3b5f435b0 tsma integration with stream computing 2022-04-07 17:13:55 +08:00
Haojun Liao 6863999ec5 [td-14493] support having in group by 2022-04-06 17:59:08 +08:00
Cary Xu 192060ebb8 Merge branch '3.0' into feature/TD-11463-3.0 2022-04-02 17:44:50 +08:00
Cary Xu 1165368642 retentions param bug fix and deliver to vnode 2022-04-02 15:39:20 +08:00
Haojun Liao cf25aca809 [td-13039] refactor. 2022-04-02 15:08:48 +08:00
Cary Xu cf06c16379 Merge branch '3.0' into feature/TD-11463-3.0 2022-03-30 15:49:53 +08:00
Cary Xu 8627b593d5 insert tSma by SSDataBlock 2022-03-30 15:48:51 +08:00
Liu Jicong a9ad7ebd10 merge from 3.0 2022-03-29 18:58:15 +08:00
Cary Xu 1fbd79bafb add updateExpiredWindow test case 2022-03-25 16:40:59 +08:00
Cary Xu 585ae95d0d expired window/tsma msg adaption 2022-03-25 07:50:28 +08:00
Cary Xu 6bd84f7fb2 drop tSma logic of tsdb 2022-03-23 21:06:17 +08:00
Liu Jicong 7fce1e4c93 Merge branch 'feature/tq' of github.com:taosdata/TDengine into feature/tq 2022-03-22 19:48:59 +08:00
Liu Jicong c74b88afbb put tq header input vnd 2022-03-22 19:47:57 +08:00
Xiaoyu Wang ef125eaa40 merge 3.0 2022-03-22 04:29:54 -04:00
Shengliang Guan 220fdfabe2 refact dnode queue 2022-03-21 19:08:25 +08:00
Haojun Liao 1c1c95edee [td-13039] merge 3.0 2022-03-21 18:34:42 +08:00
Shengliang Guan 50229512d3 refact vnode write queue 2022-03-21 14:39:35 +08:00
Shengliang Guan 90e9447370 adjust vnode queue 2022-03-21 14:12:58 +08:00
Xiaoyu Wang 9ca80596e4 merge 3.0 2022-03-21 02:00:30 -04:00
Shengliang Guan 0f45064d8d Merge remote-tracking branch 'origin/feature/tq' into feature/shm 2022-03-21 10:15:17 +08:00
Shengliang Guan 1363021f43 shm 2022-03-19 09:48:29 +08:00
Liu Jicong cc0c0293ea vnode process task exec 2022-03-18 17:55:39 +08:00
Shengliang Guan 41880bac8e Merge remote-tracking branch 'origin/3.0' into feature/shm 2022-03-18 11:27:06 +08:00
Liu Jicong 07a80c5bab
Merge pull request #10798 from taosdata/feature/tq
add tmq_get_row
2022-03-17 18:09:16 +08:00
Liu Jicong 1c40afc67c add tmq_get_row 2022-03-17 17:55:13 +08:00
Shengliang Guan b16e686809 Merge remote-tracking branch 'origin/3.0' into feature/shm 2022-03-17 13:28:15 +08:00
Cary Xu 91df290152 add REF for SSmaStat in case of delete SSmaStatItem when drop sma index 2022-03-17 11:46:34 +08:00
Shengliang Guan 5832b6772c shm 2022-03-16 21:18:54 +08:00
Shengliang Guan 58b64fcff2 shm 2022-03-16 14:32:02 +08:00
dapan1121 440b0b8682 Merge remote-tracking branch 'origin/3.0' into feature/scheduler 2022-03-15 15:42:05 +08:00
dapan1121 43d7912987 feature/scheduler 2022-03-15 15:34:17 +08:00
Cary Xu 65870538fd test insert and query 2022-03-14 17:38:10 +08:00
dapan1121 9b0f5df93a Merge remote-tracking branch 'origin/3.0' into feature/scheduler 2022-03-14 09:26:15 +08:00
Cary Xu 421d087a8f add tsdbBDBImpl files 2022-03-12 19:19:21 +08:00
dapan1121 260aad808b feature/scheduler 2022-03-11 19:45:34 +08:00
Cary Xu 0c307568e4 code refactor 2022-03-11 19:38:13 +08:00
dapan1121 9f140ceca4 Merge remote-tracking branch 'origin/3.0_query_integrate' into feature/scheduler 2022-03-10 19:11:14 +08:00
dapan1121 763eccf8aa feature/scheduler 2022-03-10 19:05:58 +08:00
Liu Jicong 913e8d70d8 define stream token 2022-03-09 19:51:08 +08:00
Liu Jicong 255d795442 add tq push 2022-03-08 17:22:21 +08:00
Cary Xu 8eaa5ec501 add SVCreateSmaReq/metaGetSmaTbUids 2022-03-07 20:14:01 +08:00
Cary Xu b64bfa979f
Feature/td 11463 3.0 (#10573)
* Block-wise SMA extraction

* refactor the SBlock

* add method tsdbLoadBlockOffset

* set method tsdbLoadBlockOffset static

* refactor

* trigger CI

* minor change

* trigger CI

* add STSma defintion

* add STSma schema encode/decode

* restore

* code optimization

* put/get sma schema from bdb

* add/check tSma schema methods

* code optimization

* code optimization
2022-03-06 20:05:41 +08:00
Cary Xu 192b07fe49
Feature/td 11463 3.0 (#10571)
* Block-wise SMA extraction

* refactor the SBlock

* add method tsdbLoadBlockOffset

* set method tsdbLoadBlockOffset static

* refactor

* trigger CI

* minor change

* trigger CI

* add STSma defintion

* add STSma schema encode/decode

* restore

* code optimization

* put/get sma schema from bdb
2022-03-06 14:43:49 +08:00
Liu Jicong 01cac6b06e fix multiple polling 2022-03-04 17:14:26 +08:00
dapan1121 e6d510997b
Merge pull request #10513 from taosdata/feature/qnode
Feature/qnode
2022-03-03 15:21:14 +08:00
Cary Xu db0c47cc1f
Feature/td 11463 3.0 - block-wise SMA (#10510)
* Block-wise SMA extraction

* refactor the SBlock

* add method tsdbLoadBlockOffset

* set method tsdbLoadBlockOffset static

* refactor

* trigger CI

* minor change

* trigger CI
2022-03-03 12:39:27 +08:00
dapan1121 09e6462c5f feature/qnode 2022-03-03 09:09:11 +08:00
Liu Jicong b7788aca04 fix 2022-03-02 16:22:43 +08:00
Shengliang Guan 10fd86209d minor changes 2022-03-02 14:10:27 +08:00
Liu Jicong 2cb89fe8c1 Merge branch '3.0' into feature/tq 2022-03-01 15:49:26 +08:00
Liu Jicong 21e5ddbb8d refactor tmq msg handle 2022-02-28 20:46:23 +08:00
Shengliang Guan 5891779fe1 common 2022-02-28 17:55:07 +08:00
Shengliang Guan e5606ccf38 Merge remote-tracking branch 'origin/3.0' into feature/config 2022-02-28 16:35:36 +08:00
Shengliang Guan 6889e19bf9 rename file 2022-02-28 10:23:16 +08:00
Haojun Liao 84fedfba09 Merge remote-tracking branch 'origin/3.0' into feature/3.0_liaohj 2022-02-24 17:56:58 +08:00
Liu Jicong 7ee6657cf7 extract convert to set msg 2022-02-21 10:48:23 +08:00
Liu Jicong 82bcecc4ff add stream mode config 2022-02-18 16:59:33 +08:00
Haojun Liao 36aedfbb7c [td-11818] create streamscan operator when no tables created. 2022-02-17 15:24:00 +08:00
Shengliang Guan 246311d4fc minor changes 2022-02-16 15:27:19 +08:00
Liu Jicong 643843f1c2
Merge pull request #10256 from taosdata/feature/tq
Feature/tq
2022-02-15 11:09:29 +08:00
Liu Jicong a038c46607 refactor tq meta store 2022-02-15 10:11:34 +08:00
Liu Jicong 4f81a33889 extract tqRead out of tq 2022-02-14 14:11:32 +08:00
Liu Jicong b579a5bf4d
Merge pull request #10239 from taosdata/feature/tq
refactor tq
2022-02-14 13:52:14 +08:00
Liu Jicong 8d243f7758 refactor tq 2022-02-14 13:43:26 +08:00
Liu Jicong 29bc056abf refactor tq 2022-02-14 13:35:04 +08:00
dapan1121 32459c4ca2
Merge pull request #10236 from taosdata/feature/qnode
Feature/qnode
2022-02-14 13:29:12 +08:00
dapan1121 5f2dc1401f feature/qnode 2022-02-11 19:52:07 +08:00
Liu Jicong f0d7d1b323 mq rebalance 2022-02-11 18:09:25 +08:00
Liu Jicong 2da85fb9dc clear unused code in tq 2022-01-29 20:14:33 +08:00
Liu Jicong 5bb010ef4a refactor: move tmq out of clientImpl 2022-01-28 15:24:09 +08:00
Liu Jicong 610c812ed7 mq support stable subscribe 2022-01-28 14:33:17 +08:00
Liu Jicong 60a1ae8ce4 merge from 3.0 2022-01-28 13:31:46 +08:00
Haojun Liao afd1ce63db [td-11818] Refactor API. 2022-01-28 10:44:02 +08:00
Liu Jicong 39ad804246 Merge branch 'feature/3.0_liaohj' into feature/tq 2022-01-27 19:04:43 +08:00
Haojun Liao 699b37cc18 [td-11818] fix bug in topic . 2022-01-27 19:03:58 +08:00
Liu Jicong add5ff5bdf Merge branch 'feature/3.0_liaohj' into feature/tq 2022-01-27 18:42:50 +08:00
Haojun Liao 02a50b50e0 [td-11818] Update the API in topic-related function. 2022-01-27 18:27:26 +08:00
Liu Jicong 963fb9b9f6 fix mq rebalance 2022-01-27 18:05:23 +08:00
Liu Jicong 5ea4eba3f1 fix query crash 2022-01-26 17:03:29 +08:00
Shengliang Guan 3edc534d87 Merge remote-tracking branch 'origin/3.0' into feature/fetch 2022-01-26 01:20:53 +00:00
Haojun Liao 36cbe6ad34
Merge pull request #10020 from taosdata/feature/3.0_liaohj
Feature/3.0 liaohj
2022-01-25 23:24:02 +08:00
Haojun Liao 8ee8785dd6 [td-11818] refactor, fix bug in select 2022-01-25 23:08:22 +08:00
Haojun Liao b97ab5db3f [td-11818]Update log and remove unused code. 2022-01-25 19:11:22 +08:00
Haojun Liao fdf97248da
Merge pull request #10008 from taosdata/feature/3.0_liaohj
[td-11818] update log.
2022-01-25 16:58:46 +08:00
Shengliang c37fbd1a53 for fetch rpc client 2022-01-25 15:18:56 +08:00
Shengliang 808efe8069 adjust func paras 2022-01-25 14:20:52 +08:00
Haojun Liao ac2609594d [td-11818] update log. 2022-01-25 13:42:33 +08:00
Liu Jicong fd90848ec3 add mq msg type 2022-01-24 21:39:00 +08:00
Liu Jicong 02e454a0d1 expose interfaces of mq 2022-01-24 10:46:55 +08:00
Shengliang Guan 36df7def76
Merge pull request #9969 from taosdata/feature/warning
Remove warnings and adjust dependencies
2022-01-22 10:31:03 +08:00
Liu Jicong fc99fe53de consume skip ununsed table 2022-01-21 23:19:54 +08:00
Liu Jicong a1c6c94c0b consume skip ununsed table 2022-01-21 19:00:09 +08:00
Shengliang Guan fab317226f Merge remote-tracking branch 'origin/3.0' into feature/warning 2022-01-21 02:20:01 -08:00
Shengliang Guan 2e14f63453 Remove warnings 2022-01-21 02:19:40 -08:00
Liu Jicong 35749cb374 fix dependency for vnode 2022-01-21 16:12:02 +08:00
Liu Jicong 4c4be3c575 put createStreamExecTaskInfo into right place 2022-01-21 14:21:13 +08:00
Liu Jicong 7361019e94 put createStreamExecTaskInfo into right place 2022-01-21 13:45:24 +08:00
Liu Jicong cc80848b56
Merge pull request #9935 from taosdata/feature/tq
refine tqRead interface
2022-01-20 18:20:09 +08:00
Liu Jicong 6a3d98cda4 refine tqRead interface 2022-01-20 18:09:28 +08:00
Shengliang Guan e2534b6a63
Merge pull request #9929 from taosdata/feature/3.0_liaohj
Feature/3.0 liaohj
2022-01-20 17:33:56 +08:00
Haojun Liao b45da2b208 [td-11818] refactor. 2022-01-20 16:02:09 +08:00
Liu Jicong 5b51229577 integrating wal with tq 2022-01-20 15:39:28 +08:00
Liu Jicong 3203e8fe42 try integrating allocator 2022-01-20 15:18:33 +08:00
Liu Jicong fa73f1d497 fix compile error 2022-01-20 15:04:40 +08:00
Liu Jicong 51f02913f4 tq handle multiple topic 2022-01-20 14:53:09 +08:00
Liu Jicong f7726ce8a4 add tq process consumer msg 2022-01-20 14:38:55 +08:00
Liu Jicong 5d77fab535 add msg for vnode consume 2022-01-20 10:45:15 +08:00
Haojun Liao f1e7dade17 Merge remote-tracking branch 'origin/3.0' into feature/3.0_liaohj 2022-01-19 18:53:53 +08:00
Shengliang Guan b86bda4b41 refact tfs module 2022-01-18 22:40:28 -08:00
Shengliang Guan cc5563716c minor changes 2022-01-18 22:04:10 -08:00
Shengliang Guan ed9709c3f0 refact tfs module 2022-01-18 21:39:32 -08:00
Haojun Liao 6d9ae1af99 [td-11818]Support select * from super_table. 2022-01-18 19:08:07 +08:00
Hongze Cheng 9d50c907cf more 2022-01-18 06:31:44 +00:00
Liu Jicong b6e826df6c add tq support for submitblk scanner 2022-01-18 09:53:11 +08:00
Hongze Cheng 7dbc861b4c more tdb 2022-01-13 08:57:18 +00:00
Hongze Cheng c9118a52e6 more tkv and refact 2022-01-13 06:13:10 +00:00
Hongze Cheng c78f3e357f refact vnode code 2022-01-12 09:26:42 +00:00