Commit Graph

10359 Commits

Author SHA1 Message Date
wangmm0220 a641a07085 fix:[TD-25071] pSub is null & return wal not exist if no data 2023-07-04 11:13:03 +08:00
Shungang Li dbf47f5fc1 fix: ttl fill cache only in initialization 2023-07-03 21:30:53 -04:00
wangmm0220 dbcd33a402 fix:memory leak 2023-07-03 18:43:12 +08:00
Benguang Zhao ddaba463c0 enh: check failure of tfsMkdirRecurAt 2023-07-03 16:16:27 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
dapan1121 a36dac2008
Merge pull request #21893 from taosdata/fix/TS-3551-M
enh: update of user auth version
2023-07-03 14:58:09 +08:00
Hongze Cheng 5390732f42 fix: coverity scan 2023-07-03 14:13:01 +08:00
liuyao bc5e709d31 set task status of ins_stream_tasks 2023-07-03 14:00:30 +08:00
liuyao 863da2ae05 set task status of ins_stream_tasks 2023-07-03 11:10:38 +08:00
wangmm0220 136bc379d1 feat:ignore delete info 2023-07-03 11:02:08 +08:00
wade zhang 1a069970c0
Merge pull request #21911 from taosdata/fix/TD-25052
fix/TD-25052
2023-07-03 09:37:01 +08:00
wade zhang e9022f24ee
Merge pull request #21904 from taosdata/fix/TS-3589
fix/TS-3589
2023-07-03 09:33:48 +08:00
Ganlin Zhao e1c62d17bc Merge branch '3.0' into fix/TD-25064 2023-07-03 09:08:53 +08:00
kailixu c16088fffa chore: remove obsolete code 2023-06-30 19:31:56 +08:00
kailixu c81ecb1771 chore: make jenkins happy 2023-06-30 19:22:14 +08:00
Ganlin Zhao e14a0e154f fix asan error 2023-06-30 17:37:06 +08:00
wade zhang 84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for main
2023-06-30 16:47:25 +08:00
wade zhang 617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit
fix: ttl compatibility for 3.0
2023-06-30 16:45:58 +08:00
kailixu 067a8334fd chore: code optimization 2023-06-30 16:30:04 +08:00
yihaoDeng 93391f73e5 vnode snapshot read 2023-06-30 07:46:56 +00:00
Shungang Li 8f164a7922 fix: ttl compatibility 2023-06-30 14:57:34 +08:00
kailixu 387d611179 chore: passVer and authVer refact 2023-06-30 14:52:20 +08:00
dmchen 99192b2998 fix/TD-25052 2023-06-30 12:38:52 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
yihaoDeng e25df41536 vnode snapshot read 2023-06-30 03:11:55 +00:00
yihaoDeng 60a0b1e1bd vnode snapshot read 2023-06-29 11:52:34 +00:00
dmchen 1b68bfb473 fix/TS-3589 2023-06-29 18:14:35 +08:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
yihaoDeng b377fcffad fix:show subscriptions error 2023-06-29 16:04:02 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
yihaoDeng 5cebd36c1c add checkpoint 2023-06-29 06:56:14 +00:00
yihaoDeng 0b3fbfd87f fix:compile error 2023-06-29 14:40:32 +08:00
dapan1121 c8435de64a
Merge branch '3.0' into fix/m23.0 2023-06-29 14:03:56 +08:00
dapan1121 5ee1fbee7e fix: code merge issue 2023-06-29 14:01:19 +08:00
dapan1121 bb1e24dda4 Merge remote-tracking branch 'origin/main' into fix/m23.0 2023-06-29 13:59:56 +08:00
dapan1121 edf5b8c936 fix: code merge issue 2023-06-29 13:59:39 +08:00
wangmm0220 b264640ca1 fix:error in limit for tmq group 2023-06-29 11:15:53 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
wangmm0220 4c39629d3c Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-29 10:48:41 +08:00
wangmm0220 64d8d63f3d fix:error in limit for tmq group 2023-06-29 10:47:55 +08:00
kailixu 1e9b85545b chore: more code 2023-06-28 20:57:05 +08:00
kailixu aefebfca7f enh: update of user auth version 2023-06-28 20:49:29 +08:00
yihaoDeng 3d532a54a8 add checkpoint 2023-06-28 12:22:27 +00:00
yihaoDeng 0bf6675f39 add checkpoint 2023-06-28 09:58:29 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao d0542f99e2
Merge pull request #21744 from taosdata/mark/tmq
opti:tmq logic
2023-06-28 17:23:56 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
wangmm0220 4ead47bcbd fix:add rows to pSub if rebalance 2023-06-28 16:43:30 +08:00
wangmm0220 865a3b2509 fix:add rows to pSub if rebalance 2023-06-28 16:37:57 +08:00
dapan1121 27a201441a
Merge pull request #21821 from taosdata/fix/ts-3572
fix: udfd can not connect to taosd since authentification failure
2023-06-28 16:31:59 +08:00
wangmm0220 ce0b71c634 fix:add rows to pSub if rebalance 2023-06-28 15:57:30 +08:00
yihaoDeng 871f66565d add checkpoint 2023-06-28 07:02:20 +00:00
wangmm0220 4a17f4b9f5 fix:add rows to pSub if rebalance 2023-06-28 14:57:31 +08:00
Haojun Liao 8867a57262 fix(stream): fix syntax error. 2023-06-28 14:48:59 +08:00
slzhou fc3fe9dff8 fix: remove connect to mnode 2023-06-28 13:49:13 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
wangmm0220 1fc664693e fix:continue consume if wal is dropped 2023-06-28 11:54:48 +08:00
yihaoDeng f6d5d0c8ca add checkpoint 2023-06-28 02:39:01 +00:00
wangmm0220 fb82b61d2f fix:pSub is null 2023-06-28 10:35:38 +08:00
wangmm0220 d34dc1242f fix:memory leak 2023-06-28 09:41:20 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
yihaoDeng 9adccf5715 add checkpoint 2023-06-27 14:31:50 +00:00
yihaoDeng 977d6b7803 add checkpoint 2023-06-27 12:52:27 +00:00
yihaoDeng 74764108fd add checkpoint 2023-06-27 12:46:08 +00:00
yihaoDeng f2b96fb4b3 add checkpoint 2023-06-27 12:28:28 +00:00
yihaoDeng 9d69b284db add checkpoint 2023-06-27 12:03:29 +00:00
wangmm0220 18b7042a45 Merge branch 'mark/tmq' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-27 18:35:39 +08:00
wangmm0220 7d15958509 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-27 18:18:27 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
yihaoDeng 0a0410cd09 add checkpoint 2023-06-27 09:56:14 +00:00
wangmm0220 7e38ef7091 fix:add limit for topic and group num 2023-06-27 17:44:51 +08:00
wangmm0220 4b95ea9cad fix:clear consumer if normal close 2023-06-27 17:11:20 +08:00
Haojun Liao 4bb78df27c fix(stream): reduce the sleep time. 2023-06-27 16:44:35 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
yihaoDeng a824db4fd5 add checkpoint 2023-06-27 07:46:30 +00:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
wade zhang d7e9eda6bc
Merge pull request #21844 from taosdata/FIX/TD-24924-3.0
enh:  change trans conflict scope of create topic
2023-06-27 10:47:53 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Benguang Zhao 69d451db26 enh: check trans conflict in mndCreateTopic ahead of time 2023-06-26 19:49:47 +08:00
Benguang Zhao 9e2062f54a fix: resolve memory leak on exceptions in mndCreateTopic 2023-06-26 19:49:47 +08:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Benguang Zhao 14e2e1e574 fix: change conflict scope of create topic to be DB inside 2023-06-26 18:23:19 +08:00
wangmm0220 0ae6cd7a89 fix:memory leak 2023-06-26 17:27:13 +08:00
Haojun Liao 01c0bbb3f8
Merge pull request #21827 from taosdata/feature/TS-3495
fear:fix error for report offset & rows in tmq
2023-06-26 16:54:42 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
Benguang Zhao e8649670aa enh: not allow to split vgroup when streams or topics exist 2023-06-26 11:57:24 +08:00
wangmm0220 7c9168f4b4 Merge branch 'mark/tmq' of https://github.com/taosdata/TDengine into mark/tmq 2023-06-26 11:42:52 +08:00
Minglei Jin 020678391c fix(tsdb/cache): refine del locks 2023-06-26 11:19:31 +08:00
Minglei Jin 5eb57f2e6e enh(tsdb/cache): writebatch with rcache locked 2023-06-26 08:41:14 +08:00
shenglian zhou 2f9c8417b6 fix: use appname to see whether it is udfd 2023-06-26 07:53:00 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
Haojun Liao 9d8f6f37fe Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-25 19:30:34 +08:00
Haojun Liao 000325f716 fix(stream): fix memory leak. 2023-06-25 19:30:21 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
wangmm0220 7a49d67078 Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495 2023-06-25 14:54:16 +08:00
Haojun Liao 7e7feeffdf fix: fix memory leak. 2023-06-25 14:38:31 +08:00
shenglian zhou fd754eaa08 fix: udfd can not connect to taosd since authentification failure 2023-06-25 11:31:33 +08:00
liuyao c950c7379d Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory 2023-06-25 10:58:43 +08:00
liuyao e9d3198e05 mem leak 2023-06-25 10:57:10 +08:00
Haojun Liao 6ac179501a fix: fix syntax error. 2023-06-25 10:46:21 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Haojun Liao 7c23630fe4 fix(stream): set correct stream error code. 2023-06-25 09:26:37 +08:00
wade zhang 254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao a8de3694fa Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-06-24 18:55:03 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
yihaoDeng c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
Haojun Liao 92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain
Enh/static lib main
2023-06-21 17:46:30 +08:00
yihaoDeng ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
wade zhang e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao ea7b8e91d3 fix(stream): fix memory leak. 2023-06-21 12:03:26 +08:00
yihaoDeng daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
liuyao 74bea44300 stream op transform 2023-06-20 17:30:59 +08:00
Benguang Zhao 424086e324 enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange 2023-06-20 15:40:09 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
Shungang Li aa3dd2bbe8 fix for compile 2023-06-20 09:06:23 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
Benguang Zhao e1d9e44fcd enh: add a field toVgId in vnodes.json for prepare alter-hashrange 2023-06-19 17:59:42 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Benguang Zhao 090a1a1595 enh: rename dir at the end in vnodeRenameVgroupId 2023-06-19 15:48:32 +08:00
Benguang Zhao 20a55c3412 fix: make vmProcessAlterHashRangeReq idempotent 2023-06-19 15:09:00 +08:00
yihaoDeng 0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
dapan1121 f31240d4b5
Merge pull request #21762 from wangjiaming0909/fix/m/TD-24819
fix: show queries returned less rows when one conn has more than 100 queries
2023-06-19 09:13:32 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
kailixu b40069c0e1 chore: log optimization 2023-06-17 05:05:43 +08:00
wangmm0220 c5dfe169a6 fix:error 2023-06-16 19:33:03 +08:00
kailixu 4097b860d3 enh: support delete tsma interval 2023-06-16 19:04:12 +08:00
wangjiaming0909 bc2cc64873 fix: show queries returned less rows when one conn has more than 100 queries 2023-06-16 18:17:56 +08:00
yihaoDeng 8937192799 refactor checkpoint 2023-06-16 18:04:57 +08:00
dapan1121 1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484
fix: fix order by ts desc error
2023-06-16 18:01:16 +08:00
yihaoDeng 5cd35cc18c refactor checkpoint 2023-06-16 17:28:54 +08:00
yihaoDeng b0a3a8d619 refactor checkpoint 2023-06-16 17:28:50 +08:00
wade zhang 72cdca8570
Merge pull request #21750 from taosdata/FIX/TD-24828-3.0
fix: return error from vmPutMsgToQueue while vnode-write is disabled
2023-06-16 16:59:56 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
wangmm0220 779e35b679 fix:drop consumer wher drop topic or group 2023-06-16 13:52:08 +08:00
wade zhang 01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715
enh(vnd/svr): convert msyType to string
2023-06-16 12:06:47 +08:00
Haojun Liao 910e0aae97
Merge pull request #21746 from taosdata/fix/TS-3540
fix:null pointer error if restore from file
2023-06-16 11:57:51 +08:00
wade zhang d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin 968e3cf1ea lru/applyF: fix ret value 2023-06-16 10:00:17 +08:00
Haojun Liao 4c82558eab Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory 2023-06-16 09:55:24 +08:00
Haojun Liao 933801269a fix(stream): fix memory leak and failed to close vnode. 2023-06-16 09:55:11 +08:00
Benguang Zhao 8663148d6c fix: return error from vmPutMsgToQueue while vnode-write is disabled 2023-06-16 09:20:34 +08:00
Yihao Deng 97fa74ae2e
Merge branch 'main' into enh/staticLibMain 2023-06-15 21:37:01 +08:00
yihaoDeng 9f9171719a support fill history 2023-06-15 21:29:52 +08:00
wangmm0220 38dc8e2107 Merge branch 'fix/TS-3540' of https://github.com/taosdata/TDengine into fix/TS-3540 2023-06-15 19:45:15 +08:00
wangmm0220 c243e470c9 fix:null pointer error if restore from file 2023-06-15 19:44:58 +08:00
wangmm0220 e019ed2cc3 fix:conflict 2023-06-15 18:50:44 +08:00
wangmm0220 5de4600739 fix:remove lost_reb status 2023-06-15 18:48:45 +08:00
liuyao 0aa141ec77 use stream task state 2023-06-15 18:24:40 +08:00
Haojun Liao a3e1882fb2 fix: fix dead lock. 2023-06-15 18:17:38 +08:00
Haojun Liao f3df37bf28 fix(stream): fix memory leak. 2023-06-15 17:56:58 +08:00
Minglei Jin 2cb6c7af16 cache/commit: use outter lock 2023-06-15 17:16:14 +08:00
Minglei Jin 9d6a22e35e cache/apply: use tsdb's flushState as ud 2023-06-15 17:07:56 +08:00
Minglei Jin c56f29c031 cache/flushState: init flush state when open cache 2023-06-15 17:01:27 +08:00
yihaoDeng a17a8cc192 fix:null pointer error 2023-06-15 16:35:53 +08:00
Minglei Jin 158ae209bf cache/lru: new applyF API for tlrucache 2023-06-15 16:34:51 +08:00
wangmm0220 a7a518aaed opti:tmq logic 2023-06-15 15:44:52 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
wangmm0220 22776e60d5 fix:control memory size if consumer group is too much 2023-06-15 14:51:04 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 5fdfe98696 fix: fix syntax error. 2023-06-15 13:31:30 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
wade zhang cffbed79ae
Merge pull request #21733 from taosdata/FIX/TD-24810-3.0
fix: vnodeRenameVgroupId correctly
2023-06-15 10:44:34 +08:00
Haojun Liao 55724157c4 refactor: remove one function. 2023-06-15 10:40:25 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
dapan1121 0c2bfde7fe
Merge pull request #21706 from taosdata/szhou/version-not-compatible-log
enhance: version not compatible log
2023-06-15 09:05:47 +08:00
Minglei Jin 6d23ea93ea cache/update: fix memory leak 2023-06-15 08:40:36 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
yihaoDeng bd0168e562 trigger checkpoint 2023-06-14 21:43:47 +08:00
Benguang Zhao b86fc3a697 fix: vnodeRenameVgroupId correctly 2023-06-14 21:38:25 +08:00
yihaoDeng 551cd7cdc8 trigger checkpoint 2023-06-14 21:14:00 +08:00
dmchen 92a9d4b26e fix/TS-3524 2023-06-14 20:53:27 +08:00
Haojun Liao 03413314d9
Merge pull request #21716 from taosdata/feature/TS-3495
fix:open info log in tmq client & modify parametes in show consumers
2023-06-14 16:33:42 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng 52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Minglei Jin d04a33f349 fix(tsdb/cache): rewrite cache update to fix cpu usage 2023-06-14 15:35:21 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Benguang Zhao 05393d9053 fix: make vmProcessCreateVnodeReq idempotent 2023-06-14 13:05:47 +08:00
yihaoDeng 30ea3aa419 add static lib 2023-06-14 12:15:02 +08:00
yihaoDeng ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
wangmm0220 864236a8dc fix:conflicts 2023-06-14 12:05:10 +08:00
wangmm0220 c28d7d9bf8 fix:open info log in tmq client & modify parametes in show consumers 2023-06-14 12:01:54 +08:00
wade zhang 5612f7ff93
Merge pull request #21708 from taosdata/fix/TS-3524-main
fix/TS-3524
2023-06-14 10:54:19 +08:00
Haojun Liao 11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 844a23225a
Merge pull request #21600 from taosdata/mark/tmq
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Haojun Liao 4fac83ecf2
Merge pull request #21709 from taosdata/feature/TD-24749
feat:control memory size if consumer group is too much
2023-06-14 10:15:20 +08:00
Ganlin Zhao 4bd1ae90fa fix: fix order by ts desc error 2023-06-14 09:52:41 +08:00
wangmm0220 8070223aba fix:lock error 2023-06-13 18:27:06 +08:00
Ganlin Zhao 647ddaad97 fix: fix order by ts desc error 2023-06-13 17:28:31 +08:00
wangmm0220 827e84b1a5 fix:memory leak 2023-06-13 17:10:23 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00