Commit Graph

7577 Commits

Author SHA1 Message Date
wangjiaming0909 7fad1de841 Revert "feat: show create table, desc table with col comments"
This reverts commit 16754b5ac1.
2023-08-24 13:38:41 +08:00
wade zhang 0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new
enh/TD-25445: ttl split flush and drop table
2023-08-24 13:57:07 +08:00
Shungang Li 171cf049bc fix: new msg should be appended to segment tail 2023-08-24 11:03:06 +08:00
yihaoDeng 3afea998ac refactor log 2023-08-24 10:15:15 +08:00
Ganlin Zhao 962a0cd403 fix 2023-08-23 23:34:02 +08:00
Ganlin Zhao 1190442936 fix: use MD5 hash to fix aliasname not enough to hold dbname.tbname 2023-08-23 22:58:11 +08:00
Hongze Cheng 6a20420f07 feat: add minDiskFreeSize cfg 2023-08-23 16:41:29 +08:00
Shungang Li 458fd07976 enh: ttl split flush and drop table
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
dapan1121 cb70861986 fix: memory leak issue 2023-08-22 18:40:42 +08:00
Haojun Liao af80d94a88 refactor: do some internal refactor. 2023-08-22 15:43:50 +08:00
Haojun Liao cc8b2263cb fix(stream): fix error in heartbeat from vnode. 2023-08-22 13:37:38 +08:00
Haojun Liao def0877980 fix(stream): add timer to check stream task status. 2023-08-22 10:46:49 +08:00
dm chen dda51d8019
Merge branch '3.0' into feat/TD-22970 2023-08-21 10:50:45 +08:00
yihaoDeng 6fe649c458 Merge branch 'enh/3.0' into enh/triggerCheckPoint2 2023-08-21 09:12:40 +08:00
Haojun Liao 8290344349
Merge pull request #22484 from taosdata/fix/liaohj
fix(stream): fix memory leak and do some internal refactor.
2023-08-19 11:02:57 +08:00
Haojun Liao b8101afbe2 fix(stream): refactor the tasks restart mechanism. 2023-08-18 22:36:38 +08:00
Haojun Liao 4b10393c81 fix(stream): fix memory leak and do some internal refactor. 2023-08-18 18:02:08 +08:00
liuyao 87c65f3b68 Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2 2023-08-18 15:27:02 +08:00
dapan1121 efc5589aa2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-18 14:11:26 +08:00
dapan1121 daf91648fe fix: invalid read memory issue 2023-08-18 13:57:17 +08:00
dm chen e393a98ee9
Merge branch '3.0' into feat/TD-22970 2023-08-18 13:37:18 +08:00
slzhou 4e2a26e8be Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-18 08:46:17 +08:00
dapan1121 adcd1a2df2 fix: join error msg 2023-08-17 19:20:09 +08:00
Haojun Liao a18989df88 fix(stream): add lost codes caused by merge 3.0. 2023-08-17 18:51:39 +08:00
slzhou 85d1dbe00a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-17 16:27:37 +08:00
dapan1121 1b038d2dcd Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 16:08:39 +08:00
dapan1121 d750950594 fix: rebuild sql.c 2023-08-17 16:04:30 +08:00
Benguang Zhao 7735e6f388 Merge branch 3.0 to FEAT/TD-25699-3.0 2023-08-17 16:04:23 +08:00
shenglian zhou 4a9391929c fix: select tags - ctb cursor pause/unlock and lock/resume 2023-08-17 14:59:17 +08:00
dapan1121 0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
feat: support column comment
2023-08-17 14:23:54 +08:00
dapan1121 3045a623e1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-17 14:16:05 +08:00
dapan1121 e8fa9aa633 fix: join blockId and target issues 2023-08-17 13:50:26 +08:00
wangjiaming0909 16754b5ac1 feat: show create table, desc table with col comments 2023-08-17 11:39:34 +08:00
liuyao 5ce7688a93 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-17 09:06:46 +08:00
Haojun Liao 6746339609 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
wangmm0220 dbc1b35d44 feat:support varbinary type 2023-08-16 19:57:01 +08:00
wangmm0220 b3f945c4c5 fix:conflict 2023-08-16 19:35:05 +08:00
wangmm0220 f266d51764 feat:support varbinary type 2023-08-16 19:05:07 +08:00
dmchen fee4b875d1 error code 2023-08-16 17:49:17 +08:00
yihaoDeng ab7e2b3122 Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2 2023-08-16 09:00:30 +00:00
dm chen e020c4e8c5
Merge pull request #22456 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
other: merge main.
2023-08-16 16:48:33 +08:00
Haojun Liao d63758a1c5 fix(stream): fix error in execute task on a tranferred node. 2023-08-16 15:24:24 +08:00
dapan1121 143c657571 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-16 14:50:31 +08:00
dapan1121 b113d02476
Merge pull request #22438 from taosdata/feat/TD-23299
feat: add irate distributed execution
2023-08-16 14:44:33 +08:00
dapan1121 91d6734b34 fix: join condition push down issue 2023-08-16 14:28:39 +08:00
dapan1121 a6ecb7253e
Merge pull request #22390 from taosdata/feat/3.0/TD-25365
feat: optimize select agg_func partition by tag slimit
2023-08-16 13:32:58 +08:00
dapan1121 39ae880597
Merge pull request #22445 from taosdata/enh/TD-25708-3.0
enh: disable stream/udf on windows
2023-08-16 13:20:01 +08:00
wangjiaming0909 e587cc50e6 feat: optimize select agg_func partition by tag slimit 2023-08-16 11:20:56 +08:00
wangjiaming0909 cb027cc5c5 feat: support alter table add column with comment 2023-08-16 11:07:40 +08:00
dmchen de5aedd8f3 vnode.json 2023-08-16 10:20:48 +08:00
liuyao 919ffbaf72 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 10:04:07 +08:00
Haojun Liao 63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0
rebuild index at tag0
2023-08-16 09:47:43 +08:00
liuyao fc09f8ef1e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-16 09:36:28 +08:00
Haojun Liao ad9f3cbc43 other: merge main. 2023-08-16 09:14:10 +08:00
slzhou 1c9611ea51 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan 2023-08-16 09:14:04 +08:00
dapan1121 df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
enhance: tag scan optimization
2023-08-16 08:58:17 +08:00
wade zhang 1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
Haojun Liao fdcc6d3446
Merge pull request #22442 from taosdata/mark/doc
fix:tmq interface & remove snapshot code
2023-08-15 17:56:55 +08:00
slzhou 4fdaaba3ce Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-15 17:18:25 +08:00
Benguang Zhao 239a79d405 enh: add some vnode info in SStatusReq 2023-08-15 17:06:33 +08:00
wangjiaming0909 dcbef83dea feat: support column comment 2023-08-15 16:30:02 +08:00
kailixu 242bf77f4c chore: code optimization 2023-08-15 16:13:51 +08:00
shenglian zhou 84e472ad03 enhance: tag cond col list only once and tag scan derive from scan 2023-08-15 16:10:54 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
wangmm0220 beb84b2355 fix:tmq interface & remove snapshot code 2023-08-15 15:37:39 +08:00
slzhou 514da6e1b0 fix: select tags and set tag scan execution mode 2023-08-15 15:16:57 +08:00
wade zhang 778b88a1fb
Merge pull request #22440 from taosdata/fix/retry_resolve_fqdn
merge fix/retry_resolve_fqdn to main
2023-08-15 14:58:52 +08:00
liuyao 1b4e51ee4a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor 2023-08-15 14:20:49 +08:00
wangmm0220 7441801e9d feat:support varbinary type 2023-08-15 13:57:05 +08:00
kailixu f7a5bef17d enh: disable stream/udf on windows 2023-08-15 13:02:32 +08:00
Ganlin Zhao 01a7dfbc34 feat: add irate distributed execution 2023-08-15 12:59:30 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
dapan1121 8fc0f1bbd6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-15 09:00:53 +08:00
dapan1121 31b0bcd716 fix: taosd crash issue 2023-08-15 08:51:23 +08:00
dapan1121 f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684
fix: remove ins_modules table
2023-08-15 08:42:08 +08:00
yihaoDeng 1447d1d55c rebuild index at tag0 2023-08-15 00:40:12 +00:00
slzhou 012248b681 fix: move the only ctb idx flag to logical plan 2023-08-14 19:26:53 +08:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
dapan1121 6a78053b51 feat: add hint supporting 2023-08-14 17:21:15 +08:00
wangmm0220 60191bef9e fix:tmq interface & remove snapshot code 2023-08-14 16:24:56 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao 03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao 0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao dea30255ec fix(stream): add new datablock type. 2023-08-11 23:51:52 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220 f1baed79b4 opti:rm useless code 2023-08-11 20:22:51 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121 8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
shenglian zhou 1c7f854a71 enhance: add only meta ctb index to tag scan physi node 2023-08-11 14:47:28 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0
enh: check if disk space sufficient at primary dir with tfs
2023-08-09 18:32:07 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626
fix taosd cannot quit
2023-08-09 15:46:14 +08:00
yihaoDeng bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121 1d0624bbf1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-09 10:32:13 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
jiacy-jcy 6fd2ae138e fix: taosMktime on windows platform 2023-08-07 17:32:20 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Haojun Liao e1e5e9bb0f enh(stream): check stream tasks dag. 2023-08-02 09:44:39 +08:00
Haojun Liao 6b09566549
Merge pull request #22275 from taosdata/enh/addKeepAliveParam
add keep alive parameter
2023-08-02 09:23:03 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
yihaoDeng 2caaae392a add keep alive parameter 2023-08-01 06:38:30 +00:00
dmchen 8a0e9ff0e0 fix/retry_resolve_fqdn 2023-08-01 14:24:28 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00