Commit Graph

25289 Commits

Author SHA1 Message Date
Hongze Cheng 8582e0c71a fix: important fix for compact file corruption 2023-08-17 18:13:37 +08:00
kailixu 49efb4ae72 fix: modify column length for super table 2023-08-17 11:43:07 +08:00
wade zhang e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug
fix: tsdb snapshot bug
2023-08-17 08:25:32 +08:00
Haojun Liao 80506b564b
Merge pull request #22461 from taosdata/fix/liaohj
refactor: do some internal refactcor
2023-08-16 19:26:39 +08:00
Hongze Cheng 32c5b6a947 fix: tsdb snapshot bug 2023-08-16 18:21:02 +08:00
Haojun Liao cbd24bb254 refactor: do some internal refactor 2023-08-16 18:20:34 +08:00
wangmm0220 5c5721571f fix:set terrno = 0 to avoid affect next fetch msg 2023-08-16 17:45:18 +08:00
Ganlin Zhao 89ff78d99c fix: fix non-root users cannot create log files even if they have write
permission of the directory
2023-08-16 17:32:08 +08:00
Hongze Cheng cedc7bf1b6 fix: memory leak when commit 2023-08-16 17:21:51 +08:00
Haojun Liao 4ea58e5682 refactor: do some internal refactor. 2023-08-16 11:44:05 +08:00
Haojun Liao 6609882f9f fix(tsdb): add stt statistics block buffer, and do some internal refactor. 2023-08-16 10:55:07 +08:00
Haojun Liao cfe2cf0ebd
Merge pull request #22439 from taosdata/fix/liaohj
fix(stream): continue process when met with trans-state msg.
2023-08-16 08:54:03 +08:00
wade zhang 778b88a1fb
Merge pull request #22440 from taosdata/fix/retry_resolve_fqdn
merge fix/retry_resolve_fqdn to main
2023-08-15 14:58:52 +08:00
Haojun Liao 71c3c710e6 fix(stream): continue process when met with trans-state msg. 2023-08-15 14:23:20 +08:00
Haojun Liao 0acb00c516 fix(stream): add log. 2023-08-15 11:48:56 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
Haojun Liao a334547726 fix(stream): fix an syntax error. 2023-08-14 19:28:36 +08:00
Haojun Liao 1a08ffc79f fix(stream): check error. 2023-08-14 19:27:09 +08:00
Haojun Liao 5d3232d275 fix(stream): fix an syntax error. 2023-08-14 18:14:32 +08:00
Haojun Liao 2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
Haojun Liao a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Haojun Liao 91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao 5ec6b64aab fix(stream): add logs. 2023-08-14 13:12:41 +08:00
Haojun Liao ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
wade zhang f63d1f98b2
Merge pull request #22150 from taosdata/test/toolsBuild
test: add build
2023-08-14 11:22:30 +08:00
Haojun Liao 2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
wade zhang 1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671
fix: infinite tomb data sync loop
2023-08-14 09:25:47 +08:00
Haojun Liao 01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
Haojun Liao 98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
Haojun Liao a81cc9aebf fix(stream): fix the error when no agg tasks exist. 2023-08-13 17:31:09 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao 0e189f70a1 refactor 2023-08-12 19:44:44 +08:00
Haojun Liao 03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 075b5e9481 refactor: do some internal refactor. 2023-08-12 18:41:54 +08:00
Haojun Liao a0534ee715 refactor: do some internal refactor. 2023-08-12 18:40:09 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao 30c2a9c619 refactor: do some internal refactor. 2023-08-12 18:27:51 +08:00
Haojun Liao 0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
Hongze Cheng 847bc0da08 fix: infinite tomb data sync loop 2023-08-11 18:10:16 +08:00
dapan1121 20b3f8c1aa
Merge pull request #22402 from taosdata/fix/TS-3799
fix: add time window boundary check before interpolation
2023-08-11 17:59:55 +08:00
Ganlin Zhao 1afbde7d2f fix: add time window boundary check before interpolation 2023-08-11 10:19:32 +08:00
Haojun Liao d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq
fix:offset error in tmq & add test cases
2023-08-11 10:00:08 +08:00
Haojun Liao 8341fa6878
Merge pull request #22395 from taosdata/fix/liaohj
fix(stream): execute the stream task directly
2023-08-10 16:21:49 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
dapan1121 791e453219
Merge pull request #22392 from taosdata/fix/TS-3811-m
fix: sma option for show create table
2023-08-10 15:21:31 +08:00
Haojun Liao 8890fa5781 fix(stream): execute the stream task directly, instead of executing it in a asynchronized way. 2023-08-10 15:13:49 +08:00
liuyao e2481599b0 fix mem leak 2023-08-10 13:58:46 +08:00
kailixu 700d9a6d68 fix: sma option for show create table 2023-08-10 13:02:34 +08:00
Haojun Liao 4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao 0757e88ced fix(stream): set the correct hash keys. 2023-08-09 23:52:14 +08:00
Haojun Liao 0cf8144952 fix(stream): fix the invalid key used by remove data in stream meta hash table. 2023-08-09 22:28:23 +08:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220 1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626
fix taosd cannot quit
2023-08-09 15:46:14 +08:00
Hui Li 584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main
fix: restore stt/block merge back
2023-08-09 14:40:03 +08:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
shenglian zhou e9e06d1eae fix: restore stt block/data block merge back 2023-08-09 10:36:54 +08:00
shenglian zhou 2b1478f46e Revert "fix(tsdb/read2): reset stt reader when suspended"
This reverts commit 079d7ff69e.
2023-08-09 10:36:26 +08:00
yihaoDeng 50bf8c948a change default session val 2023-08-09 02:11:27 +00:00
Haojun Liao bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj
other: merge fix from 3.0 to main.
2023-08-09 09:05:54 +08:00
dapan1121 5c918006b3
Merge pull request #22362 from taosdata/szhou/fix-ts3795
fix: reset rowsize since it is set during blockDataAppendColInfo
2023-08-09 08:46:34 +08:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
yihaoDeng bcc7df2dda fix taosd cannot quit 2023-08-08 10:04:41 +00:00
Haojun Liao db92546cf7 fix(stream): remove invalid filter. 2023-08-08 16:09:33 +08:00
Haojun Liao 17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
Hongze Cheng c8f106106a fix: update assert issue 2023-08-08 14:49:05 +08:00
slzhou ff36f5f6ca fix: reset rowsize since it is set during blockDataAppendColInfo 2023-08-08 13:23:35 +08:00
Hui Li 4f03ae2c65
Merge pull request #22335 from taosdata/temp/open_case
open split vgroup case
2023-08-08 11:49:28 +08:00
Haojun Liao db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao 327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao d6d63ec54c fix(stream): add more check. 2023-08-08 09:54:49 +08:00
Haojun Liao e89d3c18d6 fix(stream): remove invalid check. 2023-08-08 09:54:46 +08:00
Haojun Liao ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao 0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
Haojun Liao 1e680d4df1 fix(stream): ignore the sink task transfer state. 2023-08-08 09:52:19 +08:00
Haojun Liao 3bcc7ed83e fix(stream): transfer the state for agg tasks. 2023-08-08 09:52:04 +08:00
Haojun Liao d43cb3fcdf fix(stream): kill task when pause the stream execution. 2023-08-08 09:51:21 +08:00
Haojun Liao ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao 143f39b6f7 fix(stream): set the correct end key of delete block. 2023-08-08 09:49:43 +08:00
Haojun Liao 82ab81810b refactor: do some internal refactor. 2023-08-08 09:40:21 +08:00
Haojun Liao 51e0b903b0 refactor: do some internal refactor. 2023-08-08 09:36:42 +08:00
Hui Li 05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612
fix: snapshot invalid read
2023-08-08 09:19:55 +08:00
Haojun Liao 85756e4404
Merge pull request #22353 from taosdata/fix/liaohj
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
2023-08-07 22:57:08 +08:00
Haojun Liao fb1e017363 Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj 2023-08-07 19:30:37 +08:00
Haojun Liao 2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
dapan1121 11f6f203ed
Merge pull request #22331 from taosdata/fix/TD-25515
fix: ins_indexes vgroup_id using null value instead of -1 for invalid
2023-08-07 19:03:01 +08:00
dapan1121 443c6ef318
Merge pull request #22333 from taosdata/fix/TD-25546
fix: fix tsort crash caused by not enough disk space
2023-08-07 19:02:11 +08:00
Hongze Cheng a545d45b5e fix: snapshot invalid read 2023-08-07 16:12:03 +08:00
Hongze Cheng 661f2aca98 fix: memory leak 2023-08-07 14:13:44 +08:00
Benguang Zhao 0e4f1942f1 fix: resolve Vgroup refcount leak in drop topic 2023-08-07 11:13:52 +08:00
Haojun Liao 76288f311f
Merge pull request #22311 from taosdata/fix/TD-25543
delete atomic_exchange_64
2023-08-07 10:34:50 +08:00
Hui Li f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer
add stream verion
2023-08-04 17:36:21 +08:00
liuyao 944c1f68d2 delete atomic_exchange_64 2023-08-04 16:49:02 +08:00
wade zhang 40b87a2d55
Merge pull request #22320 from taosdata/fix/TS-3311
fix: fix _wstart,_wennd not matching with interval for ns/us databases
2023-08-04 16:34:07 +08:00
Ganlin Zhao 9f3af66ae0 fix: fix tsort crash caused by not enough disk space 2023-08-04 16:03:06 +08:00
yihaoDeng a4da6e9a88 fix mem leak 2023-08-04 15:59:34 +08:00
Ganlin Zhao f7a2e0cdab fix: ins_indexes vgroup_id using null value instead of -1 for invalid
value
2023-08-04 15:21:23 +08:00
yihaoDeng 56ed422f88 add stream ver 2023-08-04 14:09:00 +08:00
yihaoDeng 81908be32f add stream ver 2023-08-04 14:02:03 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
liuyao 9cb481dd6e use stream task 2023-08-04 11:01:36 +08:00
Ganlin Zhao d9ef9c4584 fix: fix _wstart,_wennd not matching with interval for ns/us databases 2023-08-04 10:15:15 +08:00
wade zhang abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main
fix: keep stt iterator valid in the list
2023-08-04 08:02:16 +08:00
wade zhang b13fdd49b6
Merge pull request #22314 from taosdata/szhou/fix-ts3769-main
fix: make statekey of state window node not a target node
2023-08-04 08:01:57 +08:00
slzhou fef091b13d fix: keep the stt iterator valid 2023-08-03 21:50:50 +08:00
shenglian zhou b85c1ae8a1 fix: remove the core 2023-08-03 21:50:50 +08:00
shenglian zhou 5322e38dfe fix: add init add check it 2023-08-03 21:50:50 +08:00
shenglian zhou 97b15ed718 fix: delete SLDataItem if stt level files num is smaller 2023-08-03 21:50:50 +08:00
slzhou cb9c6c1256 fix: compilation error 2023-08-03 21:47:33 +08:00
slzhou 2deeec93bf fix: explain with state window 2023-08-03 21:43:08 +08:00
slzhou 7676afff19 fix: stream use column node 2023-08-03 21:43:08 +08:00
slzhou 658c64f16f fix: make statekey of state window operator not target node 2023-08-03 21:43:08 +08:00
yihaoDeng f7dc9497ef add stream verion 2023-08-03 20:28:34 +08:00
slzhou 1cb1451e41 fix: set nextIndex when get neighbouring index 2023-08-03 18:26:29 +08:00
wade zhang 211af11f39
Merge pull request #22303 from taosdata/fix/TD-25538
reset state window end key
2023-08-03 14:03:54 +08:00
liuyao 74c69bbb6e reset state window end key 2023-08-03 11:23:46 +08:00
liuyao 3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
wade zhang 13c713d33b
Merge pull request #22290 from taosdata/3.0_main
merge 3.0 into branch main
2023-08-02 16:04:08 +08:00
Hongze Cheng f90f0b7047 disable infinite count loop 2023-08-02 15:51:51 +08:00
wade zhang 12ac393fb0
Merge pull request #22287 from taosdata/fix/3_liaohj
other: merge 3.0
2023-08-02 15:10:04 +08:00
Minglei Jin cff85550f9 Merge branch '3.0' into 3.0_main 2023-08-02 14:10:45 +08:00
wade zhang c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-02 14:08:43 +08:00
Haojun Liao 0feffc687b fix(tsdb): check uid in multiple stt statistics blocks. 2023-08-02 12:44:45 +08:00
Minglei Jin 0e51277521 cache/reader: cleanup contiue nex row 2023-08-02 12:43:57 +08:00
Haojun Liao 2c357f1958 fix(stream): enable filter table based on table statistics. 2023-08-02 11:18:35 +08:00
Minglei Jin 7fca057a81 cache/reader: move pLastCols into single block 2023-08-02 11:10:12 +08:00
Minglei Jin 95cc540d9b cache/reader: clean uid in all loop 2023-08-02 10:48:55 +08:00
Minglei Jin ed76525c4f cache/reader: cleanup uid in signle loop 2023-08-02 10:28:13 +08:00
Minglei Jin 29b2f32821 cache reader: cleanup stt init 2023-08-02 09:49:41 +08:00
Haojun Liao 53aefa531f Merge branch '3.0' into fix/3_liaohj 2023-08-02 09:45:21 +08:00
Haojun Liao 6b09566549
Merge pull request #22275 from taosdata/enh/addKeepAliveParam
add keep alive parameter
2023-08-02 09:23:03 +08:00
wade zhang d673643aff
Merge pull request #22284 from taosdata/fix/TD-25138-3.0
fix: null pointer check for mutex on windows
2023-08-01 23:04:57 +08:00
Hongze Cheng 4ba4e83b5b fix: retention file corruption 2023-08-01 20:19:13 +08:00
kailixu 42da90e459 chore: code revert 2023-08-01 19:45:14 +08:00
kailixu 2a22e55705 fix: null pointer check for mutex on windows 2023-08-01 19:42:05 +08:00
Haojun Liao 3296aecf06 Merge branch '3.0' into fix/3_liaohj 2023-08-01 19:24:29 +08:00
Minglei Jin 7d294cac5f tsdb/cache: load current fileset's brinblk once 2023-08-01 18:56:10 +08:00
Minglei Jin a593e887fa cache: remove nFileset from fs state 2023-08-01 18:37:23 +08:00
liuyao 71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Minglei Jin 7ad628417a fix mem issue: stack-use-after-scope 2023-08-01 17:57:38 +08:00