xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
58,952 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

12410 Commits

Author SHA1 Message Date
wangmm0220 c0068abc9a fix:merge from 3.0 2023-11-07 18:55:46 +08:00
Haojun Liao 2674698b36 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-07 18:51:46 +08:00
Haojun Liao 1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
wade zhang 4e70df5856
Merge pull request #23560 from taosdata/fix/TS-4187 
fix(cache/reader): use int64 max instead of uint
 2023-11-07 14:56:47 +08:00
kailixu ac62714492 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-07 14:20:38 +08:00
Benguang Zhao c851774a02 enh: improve user error of redistribute vgroup with TSDB_CODE_MND_REQ_REJECTED 2023-11-07 12:04:42 +08:00
wade zhang 9a342efd85
Merge pull request #23513 from taosdata/feat/TS-4094 
feat: add dynamic configuration
 2023-11-07 11:23:21 +08:00
kailixu f5d796a081 chore: print stream state 2023-11-06 19:53:09 +08:00
kailixu dc5284a19c chore: add debug info 2023-11-06 17:27:36 +08:00
Minglei Jin ec908fa4d0 fix(cache/reader): use int64 max instead of uint 2023-11-06 15:34:28 +08:00
wangmm0220 dffaac55ea fix:move cos from util to common 2023-11-06 14:57:32 +08:00
Minglei Jin 31ce6453c2 fix(cmake/s3): make cmake config portable 2023-11-06 14:17:27 +08:00
kailixu 7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
Haojun Liao d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu 411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
kailixu 77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao de5c4d8d5d other(tsdb): adjust some log info. 2023-11-03 15:07:40 +08:00
kailixu c95fc014a8 enh: rsma checkpoint 2023-11-03 14:57:36 +08:00
kailixu a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Shungang Li c6f5e2a9bd enh: add dynamic configuration 2023-11-03 14:28:02 +08:00
Haojun Liao 34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
Haojun Liao b4d14d3847 fix(tsdb): fix error during add on-demand opening stt file reader. 2023-11-03 13:51:18 +08:00
Haojun Liao 675c9ca613 enh(tsdb): on-demand open stt file reader. 2023-11-03 13:51:18 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
Hongze Cheng 1ff3f96b08
Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write 
enh(tsdb/retention): enable last tier write
 2023-11-02 21:21:38 -05:00
Haojun Liao ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj 
fix(stream): add unsupport trans.
 2023-11-03 09:07:33 +08:00
kailixu d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
kailixu 6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
wade zhang a3723b74ed
Merge pull request #23497 from taosdata/FIX/audit-db-resource-3.0 
db and resource
 2023-11-02 19:33:40 +08:00
Haojun Liao 7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
kailixu fa5d896787 enh: rsma checkpoint 2023-11-02 18:56:36 +08:00
Haojun Liao c4079332ff fix(stream):update the log level. 2023-11-02 18:18:04 +08:00
Haojun Liao 0a227e807f refactor: set different tq level. 2023-11-02 18:18:04 +08:00
Hongze Cheng 4cf97ef6ae
Merge pull request #23520 from taosdata/fix/TD-27057 
fix: invalid read when file is deleted
 2023-11-02 04:49:49 -05:00
Hongze Cheng faea18c38f fix: invalid read when file is deleted 2023-11-02 16:59:11 +08:00
kailixu 2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
dapan1121 e0f49f8000 fix: remove user table/view privilege issue 2023-11-02 14:14:26 +08:00
kailixu 722777f8c9 enh: rsma checkpoint 2023-11-02 13:15:31 +08:00
kailixu 96b5024347 enh: rsma checkpoint 2023-11-02 13:05:36 +08:00
kailixu 698fb804f9 enh: disable update tbUidList during reboot 2023-11-02 12:54:23 +08:00
kailixu 76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao 95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Minglei Jin 46d3be1f08 config/page-cache-size: new parameter for pcache size 2023-11-02 10:10:03 +08:00
kailixu 9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Minglei Jin d0327e07b8 tsdb/pg-cache: use pgno for cache key instead of blkno 2023-11-02 09:42:19 +08:00
Hongze Cheng a6ee7c4685 fix: possible coredump 2023-11-01 20:34:47 +08:00
kailixu 3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao 7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao 9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Minglei Jin 52fd71ce13 config/block-size: default to -1 to enable page cache 2023-11-01 18:00:31 +08:00
dm chen 14eb345c8c
Update mndUser.c 2023-11-01 16:37:45 +08:00
kailixu c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
kailixu 59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Haojun Liao f76417535c
Merge pull request #23451 from taosdata/fix/TD-26685-3.0 
fix:print log if assert & check epoch when update epoch
 2023-11-01 15:32:25 +08:00
dmchen 0ab4e809c5 db and resource 2023-11-01 15:12:45 +08:00
Minglei Jin f10d1ebdc5 Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 15:06:22 +08:00
Minglei Jin 6f0fa5d47e tsdb/retention: remove incorrect right brace 2023-11-01 14:56:57 +08:00
kailixu ab266c712f chore: checkpoint for rsma stream state 2023-11-01 12:29:54 +08:00
Haojun Liao 3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
Minglei Jin 0f5a124cb1 config/block-size: enable dynamic config for debugging 2023-11-01 11:08:39 +08:00
Minglei Jin 221afff9ee vnode/write: remove keep modify code block 2023-11-01 11:00:47 +08:00
Minglei Jin 64644d673b
Merge branch '3.0' into fix/TD-26189-last-tier-write 2023-11-01 10:53:55 +08:00
Minglei Jin a61502411d tsdb/pg-cache: new page cache for tsdb s3 read file page 2023-11-01 10:49:05 +08:00
dapan1121 6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu 1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao 7359f98eca
Merge pull request #23428 from taosdata/fix/3_liaohj 
other: merge refactor into 3.0
 2023-11-01 09:44:31 +08:00
kailixu e6684fa5de enh: rsma retetion and stream state 2023-10-31 20:26:42 +08:00
wade zhang b7ea04bdf4
Merge pull request #23475 from taosdata/enh/TD-26910 
enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES
 2023-10-31 20:05:34 +08:00
Shungang Li c98228eff9 enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES 2023-10-31 20:03:52 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
dapan1121 d40cc27abc
Merge pull request #23464 from taosdata/enh/TD-26638-3.0 
enh: use placeholder '-' for interval of 1st retention level
 2023-10-31 18:36:43 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
wangmm0220 fc228d65f2 fix:print log if assert & check epoch when update epoch 2023-10-31 15:36:40 +08:00
wade zhang 76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 
feat: support pipelining of snap replication
 2023-10-31 15:19:07 +08:00
wade zhang 25b09b467f
Merge pull request #23439 from taosdata/feat/TD-26971-3.0 
TD-26971
 2023-10-31 13:53:49 +08:00
kailixu 28cd8f4915 enh: file duration for rsma 2023-10-31 11:38:33 +08:00
Hongze Cheng ac3df85d8a Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684 2023-10-31 11:23:23 +08:00
Haojun Liao fc70fa053c fix(tsdb): fix syntax error. 2023-10-31 10:45:14 +08:00
Haojun Liao 6a7ba0f5f5 fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1. 2023-10-31 10:45:14 +08:00
Haojun Liao 00626de6e4 fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files. 2023-10-31 10:45:13 +08:00
Haojun Liao cb43299faa fix(tsdb): avoid to read duplicated rows in buf. 2023-10-31 10:45:13 +08:00
Haojun Liao 635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao 6e2240a3d1 fix(stream): fix the deadlock. 2023-10-31 10:45:12 +08:00
Haojun Liao 0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
kailixu b03baaed2c chore: revert the code change 2023-10-30 19:49:50 +08:00
kailixu 89651626e3 chore: reopen rsma stream commit 2023-10-30 19:45:18 +08:00
dmchen fe044051c8 memory leak 2023-10-30 19:36:27 +08:00
Minglei Jin 867ce92dcc tsdb/file-rw: fix log msg 2023-10-30 19:28:18 +08:00
kailixu 4a5b4b51e2 chore: remove obsolete codes 2023-10-30 17:51:42 +08:00
Minglei Jin 800cbfbb05 tsdb/file: new s3flag in mem 2023-10-30 17:36:49 +08:00
Haojun Liao 6e118c7963 fix(stream): fix memory leak. 2023-10-30 17:28:57 +08:00
dmchen 0f40e1dbb9 memory leak 2023-10-30 16:59:12 +08:00
dmchen be0a85a0ff memory leak 2023-10-30 15:22:54 +08:00
Minglei Jin 84d2f9c379 tsdb/upload: delay data file uploading 2023-10-30 15:22:34 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao 15d217fc3e fix(stream): fix memory leak. 2023-10-30 13:29:35 +08:00
Haojun Liao b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
dapan1121 6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
dapan1121 53e9c483c9
Merge pull request #23422 from taosdata/enh/TD-25879-3.0x 
enh: dmodule API dependence and grant process
 2023-10-30 10:13:28 +08:00
dapan1121 1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0 
enh: only float/double allowed for sum/avg of rsma
 2023-10-30 10:08:55 +08:00
Minglei Jin 4fede02da4 tsdb/retention: remove s3 evict cache hook 2023-10-30 10:06:42 +08:00
Haojun Liao 1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao 91121974d7 fix(stream): do nodeUpdate trans only after check if vnodes are all ready. 2023-10-30 09:32:40 +08:00
Haojun Liao 48202a1e45 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
Haojun Liao 1a1b9f5ea3 fix(stream): set the trans exec sequentially. 2023-10-30 09:32:40 +08:00
dapan1121 972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
kailixu 22d6b95585 enh: dm init API 2023-10-29 21:13:18 +08:00
kailixu 3f65773222 enh: send grant to dnodes online and in async mode 2023-10-29 02:18:47 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Hongze Cheng a7f3041ff3 more fix 2023-10-27 17:59:27 +08:00
Benguang Zhao 4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
Hongze Cheng cdb1d8296d feat: concurrency on fileset 2023-10-27 17:48:19 +08:00
dmchen 43e6dec6c2 TD-26971 2023-10-27 17:39:50 +08:00
Minglei Jin 8c6f452f09 tsdb/write: make last tier writable to mem 2023-10-27 15:51:52 +08:00
kailixu dc8cb7a99e fix: memory leak 2023-10-27 14:36:01 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
Haojun Liao 29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao 38eb5d2f89 refactor(stream): do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao b4992a8506 other: add some logs. 2023-10-27 09:59:52 +08:00
Haojun Liao 9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao fa670a93f3 fix(stream): set the retrycode for checkpoint source transaction. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao 2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao 7cce53f7e5 fix(stream): ignore the check status when is ready. 2023-10-27 09:58:52 +08:00
Haojun Liao c99f434706 fix(stream): set checkpoint failure when in pause status. 2023-10-27 09:58:52 +08:00
Haojun Liao 2c1af8dad8 refactor: do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao 1ad2c3029a refactor(stream): do some internal refactor. 2023-10-27 09:58:52 +08:00
Haojun Liao 7311f9d2fe fix(sma): fix bugs in sma and do some internal refactor. 2023-10-27 09:58:51 +08:00
Haojun Liao 3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao 47d4bac57a fix(stream): remove invalid assert. 2023-10-27 09:55:07 +08:00
Haojun Liao 4845474ea4 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 5313543a9e refactor: do some internal refactor. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao 8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00