xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
44,184 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

956 Commits

Author SHA1 Message Date
Minghao Li da2686ce69 refactor(sync): add log tools 2022-07-21 16:43:56 +08:00
Minghao Li ee237b091d refactor(sync): add log tools 2022-07-21 15:43:55 +08:00
Minghao Li c4bb5a1a52 refactor(sync): add log tools 2022-07-21 15:25:46 +08:00
Minghao Li 8915486ec1 fix(sync): raft store persist 2022-07-21 14:51:02 +08:00
Minghao Li ac51192084 refactor(sync): add trace log 2022-07-21 13:54:24 +08:00
Minghao Li 3eff1f03e0 refactor(sync): add trace log 2022-07-21 10:57:14 +08:00
Minghao Li 540f519ad7 refactor(sync): add trace log 2022-07-20 20:24:49 +08:00
Minghao Li b77e0a6750 refactor(sync): add trace log 2022-07-20 19:58:26 +08:00
Minghao Li 3491896b7a refactor(sync): add trace log 2022-07-20 19:12:02 +08:00
Minghao Li 94b3e9d2f0 refactor(sync): add trace log 2022-07-20 19:00:55 +08:00
Minghao Li 7808fdfccb refactor(sync): add trace log 2022-07-20 17:19:42 +08:00
Minghao Li c2b348bec5 refactor(sync): add trace log 2022-07-20 15:34:09 +08:00
Minghao Li 90e7d794f3 fix(sync): reset commit index by snapshot when open sync 2022-07-20 13:32:38 +08:00
Minghao Li 11b473fe9e refactor(sync): add trace log 2022-07-20 11:56:46 +08:00
Minghao Li 4c3e1fdaa9 refactor(sync): add trace log 2022-07-20 11:34:51 +08:00
Minghao Li 54be75ff13 refactor(sync): add trace log 2022-07-20 11:18:43 +08:00
Minghao Li 322bbc493e refactor(sync): add trace log 2022-07-20 11:09:54 +08:00
Minghao Li 30bf78af96 refactor(sync): restart heartbeat timer after replicate 2022-07-19 19:04:11 +08:00
Minghao Li 991d6fd8a1 refactor(sync): add trace log 2022-07-19 17:20:59 +08:00
Minghao Li 329ba3cee8 refactor(sync): add trace log 2022-07-19 14:34:39 +08:00
Minghao Li fc08a35fbf refactor(sync): update sync-timeout to 10s 2022-07-19 13:52:02 +08:00
Minghao Li 651ae5832e refactor(sync): delete not exist log 2022-07-19 10:46:47 +08:00
Minghao Li 7187c87d35 refactor(sync): add restart heartbeat timer 2022-07-18 16:55:24 +08:00
Minghao Li 9f94dcb384 refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-18 09:45:33 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li c978bd10ec fix(sync): do not sender snapshot when there's wal 2022-07-16 16:23:56 +08:00
Minghao Li 5cefb68dde fix(sync): snapshot end index 2022-07-16 16:00:16 +08:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Minghao Li 59c7348c94 refactor(sync): add leader transfer callback 2022-07-15 16:07:45 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Li Minghao e3eaddac0d
Merge pull request #14869 from taosdata/feature/3.0_mhli 
refactor(sync): optimized replication
 2022-07-15 13:12:37 +08:00
Minghao Li 3769e07708 refactor(sync): optimized replication 2022-07-13 18:13:22 +08:00
Li Minghao 60703bdd05
Merge pull request #14857 from taosdata/feature/3.0_mhli 
refactor(sync): add skiplist entry cache
 2022-07-13 17:52:45 +08:00
Minghao Li 511c39a0cf refactor(sync): add skiplist entry cache 2022-07-13 15:55:38 +08:00
Shengliang Guan 480de34a0e enh: support alter debugflag in dnode 2022-07-13 14:13:12 +08:00
Minghao Li e91ca30b19 refactor(sync): add resp ttl clean 2022-07-12 20:23:31 +08:00
Shengliang Guan 037f84fafd Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-07-12 17:29:23 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li 129b289bdf refactor(sync): do leader transfer 2022-07-12 14:34:18 +08:00
Shengliang Guan 75804db990 Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-12 14:22:10 +08:00
Shengliang Guan b9165a9503 fix: reset queueSize after the queueItem is consumed and executed by the worker 2022-07-12 13:56:54 +08:00
Shengliang Guan 52b63db905 fix: invalid vnode ref while drop stream 2022-07-12 13:26:55 +08:00
Minghao Li 03fe08a890 refactor(sync): modify trace log 2022-07-12 11:15:58 +08:00
Minghao Li d7d8d82eec refactor(sync): modify log to index 2022-07-12 11:08:01 +08:00
Minghao Li ded3224471 refactor(sync): modify log to index 2022-07-12 11:07:07 +08:00
Minghao Li df63225b74 refactor(sync): modify append log 2022-07-11 17:26:45 +08:00
Liu Jicong 6d9727579b
Merge pull request #14761 from taosdata/feature/stream 
feat(wal): add append interface
 2022-07-11 16:50:28 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
Minghao Li 27d06cae30 refactor(sync): add syncEntryCacheTest 2022-07-11 14:54:40 +08:00
Minghao Li 9e1b9fe64c refactor(sync): add syncEntryCacheTest 2022-07-11 14:21:36 +08:00
Minghao Li 2dd7abd47e refactor(sync): add vnode snapshot case 2022-07-11 10:34:02 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli 
refactor(sync): add fake syncRestoreFromSnapshot
 2022-07-08 19:46:51 +08:00
Shengliang Guan 6bb8a9ad8a refactor: adjust logs 2022-07-08 19:41:23 +08:00
Shengliang Guan de644c7d43 refactor: adjust logs 2022-07-08 18:33:52 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Shengliang Guan 361c21a35c refactor: adjust logs 2022-07-08 17:27:06 +08:00
Li Minghao d94680c3c4
Merge pull request #14676 from taosdata/feature/3.0_mhli 
fix(sync): append entries batch
 2022-07-08 16:07:22 +08:00
Shengliang Guan b7077b7fb3
Merge pull request #14679 from taosdata/fix/valgrind 
refactor: change fndebugfalg to udfdebugflag
 2022-07-08 15:44:37 +08:00
Minghao Li cc31a7c3c3 refactor(sync): add syncRestoreFromSnapshot 2022-07-08 15:38:40 +08:00
Minghao Li ed6001d5ca refactor(sync): add syncRestoreFromSnapshot 2022-07-08 15:31:50 +08:00
Minghao Li a39de34984 refactor(sync): rm syncOnMessage 2022-07-08 15:21:44 +08:00
Shengliang Guan 6e12d8e707 refactor: adjust log 2022-07-08 15:20:15 +08:00
Minghao Li 1ee5468411 fix(sync): append entries batch 2022-07-08 14:47:00 +08:00
Li Minghao 1e1e373220
Merge pull request #14654 from taosdata/feature/3.0_mhli 
fix(sync): snapshot strategy wal first
 2022-07-07 17:45:17 +08:00
Minghao Li 1c3c270307 fix(sync): snapshot strategy wal first 2022-07-07 17:00:01 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Liu Jicong baa48489b7 merge from 3.0 2022-07-06 21:25:34 +08:00
Minghao Li b73914fb0d refactor(sync): add term in rpcMsg 2022-07-06 16:52:39 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 83b639ae8f refactor(sync): persist batch size 2022-07-06 14:58:38 +08:00
Minghao Li 6ec47a7a60 fix(sync): propose batch 2022-07-06 13:17:16 +08:00
Minghao Li 730a7a4a58 refactor(sync): snapshot strategy 2022-07-06 11:44:28 +08:00
Minghao Li cd4bc6e30b refactor(sync): snapshot strategy 2022-07-06 11:12:45 +08:00
Minghao Li 8a4e251be7 fix(sync): batch propose 2022-07-06 10:32:17 +08:00
Minghao Li 103a9cd9e8 fix(sync): release SyncNode ref 2022-07-05 17:39:01 +08:00
Minghao Li 88b0ab5458 fix(sync): release SyncNode ref 2022-07-05 17:32:51 +08:00
Minghao Li e8160342c3 refactor(sync): snapshot sender, receiver 2022-07-05 14:38:44 +08:00
Shengliang Guan 2daef4ba58 fix: add ref log to sync 2022-07-05 11:36:41 +08:00
Minghao Li 6437d20cda refactor(sync): add resp syncRespCleanByTTL 2022-07-04 21:28:52 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 4fc500c91c refactor(sync): add SyncAppendEntriesBatch 2022-07-02 16:01:47 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 376bf46a64 refactor(sync): add SyncClientRequestBatch 2022-06-30 15:28:23 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li c3b2b98454 refactor(sync): delete some asserts 2022-06-29 19:18:15 +08:00
Minghao Li 3440822ebf refactor(sync): add some comments 2022-06-29 16:40:36 +08:00
Minghao Li 41f24314d0 refactor(sync): add SYNC_TERM_INVALID 2022-06-29 15:44:30 +08:00
Minghao Li 18b78f2450 refactor(sync): add return code restore from snapshot 2022-06-29 14:50:59 +08:00
Minghao Li 4bd650609d refactor(sync): delete old functions 2022-06-29 14:02:40 +08:00
Minghao Li aded474d5b refactor(sync): adjust trace log 2022-06-28 16:19:15 +08:00
Minghao Li 33d1440e7b refactor(sync): adjust trace log 2022-06-28 14:23:45 +08:00
Minghao Li 4c410bd5ec refactor(sync): refactor snapshot code 2022-06-28 11:33:14 +08:00
Minghao Li 2647ec21e0 refactor(sync): add comments in snapshot 2022-06-27 20:23:08 +08:00
Minghao Li 5e7b7cb449 refactor(sync): add entries cache 2022-06-27 16:56:36 +08:00
Minghao Li 49ff32cda5 refactor(sync): add entries cache 2022-06-27 16:53:02 +08:00
Minghao Li a22814a5a7 refactor(sync): optimized one replica 2022-06-27 10:36:28 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 77b365f0cc refactor(sync): do not replicate when one replica 2022-06-25 16:27:05 +08:00
Minghao Li 0df1415caf refactor(sync): add trace log 2022-06-25 11:30:34 +08:00
Minghao Li 58296f6a5a refactor(sync): adjust log buf size 2022-06-24 16:44:45 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Minghao Li 8a8e42a923 refactor(sync): set error code in syncIsReady 2022-06-24 14:04:58 +08:00
Minghao Li 8060108585 refactor(sync): add trace log 2022-06-24 13:50:23 +08:00
Minghao Li b3fa103cb9 refactor(sync): add trace log 2022-06-24 11:36:26 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li f140a5ad1b refactor(sync): add trace log 2022-06-23 16:57:18 +08:00
Minghao Li 4fdc62a27f refactor(sync): delete fake match branch 2022-06-23 16:32:06 +08:00
Minghao Li 00c0926c44 refactor(sync): hold wal handle with log store 2022-06-23 14:58:52 +08:00
Minghao Li cdb6b2429a refactor(sync): update election timer range 2022-06-23 14:37:29 +08:00
Minghao Li e18329ac19 refactor(sync): update election timer range 2022-06-23 14:22:53 +08:00
Minghao Li ca4d7329ce refactor(sync): modify wal error log 2022-06-23 14:07:18 +08:00
Minghao Li 81eae2a9af refactor(sync): modify wal error log 2022-06-23 11:59:28 +08:00
Minghao Li e051bc51db refactor(sync): add trace log 2022-06-23 11:23:44 +08:00
Minghao Li a701451a27 refactor(sync): add trace log 2022-06-23 11:09:01 +08:00
Minghao Li 9786ba2fbe fix(sync): update nextindex, matchindex when backto nolog 2022-06-23 10:10:57 +08:00
Minghao Li 2f2715aca4 fix(sync): save saveErr 2022-06-22 20:23:49 +08:00
Minghao Li 13c916f5cb fix(sync): update lcindex to -1, when get error 2022-06-22 19:48:36 +08:00
Minghao Li 7b5a3eff3f refactor(sync): add syncLogStoreCheck tool 2022-06-22 10:42:54 +08:00
Minghao Li 0ba3326b99 fix(sync): update commit index when apply snapshot 2022-06-22 10:35:39 +08:00
Minghao Li 1f0d7807ac fix(sync): sender get config from local 2022-06-21 19:27:52 +08:00
Minghao Li 4381c3620d refactor(sync): calculate index after append entry 2022-06-21 19:00:24 +08:00
Minghao Li 363c98e9ed refactor(sync): abstract for log store 2022-06-21 17:45:08 +08:00
Minghao Li ecc43b6697 refactor(sync): delete some assert 2022-06-21 16:02:36 +08:00
Minghao Li b61a5cd126 refactor(sync) add trace log 2022-06-21 15:30:24 +08:00
Minghao Li 0fb64add90 refactor(sync) add trace log 2022-06-21 15:09:23 +08:00
Minghao Li 6c71ae8985 fix(sync): config change when set index-mgr 2022-06-21 13:23:35 +08:00
Shengliang Guan e87baa8df7 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-06-21 11:42:11 +08:00
Shengliang Guan 714c599fd7 fix: deadlock while set standby 2022-06-21 11:40:27 +08:00
Minghao Li 50e3527f2b refactor(sync): set ranmdom seed by ns 2022-06-21 11:11:16 +08:00
Minghao Li 3b7e0bfdcc fix(sync): set standby when not follower 2022-06-20 20:55:40 +08:00
Minghao Li 9f76504830 refactor(sync): propose fail when changing 2022-06-20 20:10:13 +08:00
Minghao Li 3573ae1564 refactor(sync): block when changing 2022-06-20 20:07:36 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li 16930ac3aa refactor(sync): adjust log buf size 2022-06-18 18:42:40 +08:00
Minghao Li f5366425ed refactor(sync): append noop in become leader 2022-06-18 17:02:29 +08:00
Minghao Li b247762931 refactor(sync) refactor trace log 2022-06-18 15:17:58 +08:00
Shengliang Guan db4e02c7c7 fix: add log to debug mnode sync 2022-06-17 15:23:17 +08:00
Shengliang Guan ab2f268601 Merge branch 'fix/tsim' into fix/dnode 2022-06-17 14:53:04 +08:00
Shengliang Guan 43f8f34b0f refactor: adjust logs 2022-06-17 14:24:17 +08:00
Shengliang Guan 6e6f559f9c Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-17 14:06:44 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00
Shengliang Guan ce08a98149 Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-17 13:09:19 +08:00
Minghao Li 455a8da0ad refactor(sync): add config index to json 2022-06-17 13:08:41 +08:00
Shengliang Guan 7e0ad8781b refactor(sync) add raft cfg test 2022-06-17 11:46:19 +08:00
Shengliang Guan 28b3268224 fix(sync) add trace log 2022-06-17 11:40:18 +08:00
Minghao Li f5db109e61 fix(sync): get last max snapshot index 2022-06-17 11:37:10 +08:00
Shengliang Guan 793e6fa7d9 fix: rollback to avoid tsim/basic.sim failure 2022-06-17 09:26:25 +08:00
Shengliang Guan e241fc0979 Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-16 21:13:35 +08:00
Minghao Li d71027ac35 fix(sync): fake match2, need truncate log 2022-06-16 20:43:49 +08:00
Shengliang Guan 2dc41e86cb Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-16 20:10:11 +08:00
Minghao Li b42c963a5f fix(sync): fake match when prevLogIndex less than commitIndex 2022-06-16 20:08:27 +08:00
Shengliang Guan 5d64fcb117 Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-16 19:47:40 +08:00
Minghao Li d3f6f07902 fix(sync): fake match when prevLogIndex less than commitIndex 2022-06-16 19:40:08 +08:00
Shengliang Guan dd024941b7 Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-16 19:10:52 +08:00
Minghao Li 3fdd0c30ac refactor(sync): add trace log 2022-06-16 19:08:44 +08:00
Shengliang Guan 5d9a3850d2 Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-16 18:09:30 +08:00
Minghao Li 46c09f2c84 refactor(sync): add trace log 2022-06-16 18:08:01 +08:00
Shengliang Guan 34b6ecafba Merge remote-tracking branch 'origin/feature/3.0_mhli' into test/chr/TD-14699 2022-06-16 17:42:27 +08:00
Minghao Li 15ac89590c refactor(sync): add trace log 2022-06-16 17:41:01 +08:00
Shengliang Guan fe9f8bfe98 Merge remote-tracking branch 'origin/3.0' into test/chr/TD-14699 2022-06-16 17:39:39 +08:00
Shengliang Guan 26ca03af4f fix: crash while mnode sync 2022-06-16 17:24:42 +08:00
Shengliang Guan 35c47cee55 Merge remote-tracking branch 'origin/feature/3.0_mhli' into test/chr/TD-14699 2022-06-16 16:17:20 +08:00
Minghao Li 2f81a41f98 refactor(sync): add syncIsReady 2022-06-16 16:16:40 +08:00
Shengliang Guan 6ad87b9383 Merge remote-tracking branch 'origin/feature/3.0_mhli' into test/chr/TD-14699 2022-06-16 15:57:20 +08:00
Minghao Li 9a9200d28b refactor(sync): add restore finish when become leader again 2022-06-16 15:38:40 +08:00
Shengliang Guan 7aa087a48d feat: redistribute vgroup 2022-06-16 15:25:04 +08:00
Minghao Li 77b03ac821 refactor(sync): add restore finish when become leader again 2022-06-16 14:40:42 +08:00
Minghao Li 58051169d2 refactor(sync): add trace log 2022-06-16 10:54:13 +08:00
Shengliang Guan 19439c8b58 fix: adjust log 2022-06-15 19:55:36 +08:00
Minghao Li dcd65e6dea refactor(sync): do not heartbeat when 1 replica 2022-06-15 17:17:15 +08:00
Minghao Li 4b18bd718e refactor(sync): adjust errno 2022-06-15 16:14:17 +08:00
Minghao Li c9f6c20410 refactor(sync): if eqmsg error, return 2022-06-15 11:42:04 +08:00
Minghao Li 6c7072286d refactor(sync): if eqmsg error, return 2022-06-15 11:06:06 +08:00
Li Minghao c156d964b6
Merge pull request #13841 from taosdata/feature/3.0_mhli 
refactor(sync): add respMgr trace log
 2022-06-14 22:56:42 +08:00
Minghao Li a51eee06eb refactor(sync): add trace log 2022-06-14 20:39:53 +08:00
Minghao Li b60fde8f73 refactor(sync): add trace log 2022-06-14 20:33:57 +08:00
Minghao Li b25840ebd4 refactor(sync): add test syncRaftIdCheck 2022-06-14 20:19:56 +08:00
Minghao Li e4da993c15 refactor(sync): add test syncRaftIdCheck 2022-06-14 17:19:54 +08:00
Minghao Li 71dad1ea78 refactor(sync): add test syncRaftIdCheck 2022-06-14 15:50:44 +08:00
Li Minghao 41a285a3f6
Merge pull request #13807 from taosdata/feature/3.0_mhli 
refactor(sync): update replica index in snapshot sender
 2022-06-14 15:21:09 +08:00
Minghao Li fa25fa32e0 refactor(sync): add test syncRaftIdChec 2022-06-14 14:54:11 +08:00
Minghao Li 5268b5233a refactor(sync): update replica index in snapshot sender 2022-06-14 14:40:06 +08:00
Minghao Li a2039d8bb2 fix(sync) if FpEqMsg return error, do not enqueue msg 2022-06-14 13:16:49 +08:00
Minghao Li 979420801e fix(sync) if FpEqMsg return error, do not enqueue msg 2022-06-14 13:07:27 +08:00
Minghao Li 9cd54c5cc9 refactor(sync): update replica index in snapshot sender 2022-06-14 11:16:32 +08:00
Minghao Li 3887e940f1 fix(sync): when receive snapshot rsp from a dropped replica 2022-06-14 10:24:05 +08:00
Shengliang Guan 82112e8d4a
Merge pull request #13786 from taosdata/fix/mnode 
fix(sync): send snapshot to multi nodes at the same time
 2022-06-14 09:54:21 +08:00
Shengliang Guan 318f2771ea fix(sync): close detail log 2022-06-13 22:36:54 +08:00
Shengliang Guan be3de7b7df fix(sync): send snapshot to multi nodes at the same time 2022-06-13 22:20:53 +08:00
Minghao Li e4897e5f46 enh(sync): add leader transfer 2022-06-13 15:52:43 +08:00
Minghao Li f47a28fe8a enh(sync): add leader transfer 2022-06-13 15:47:43 +08:00
Xiaoyu Wang 1863bbee9a merge 3.0 2022-06-13 15:01:29 +08:00
Xiaoyu Wang 380a071551 fix: handle the memory leak of parser 2022-06-13 14:54:38 +08:00
Minghao Li b1093b4a79 fix(sync): use fqdn instead of raftId 2022-06-13 12:13:35 +08:00
Shengliang Guan 95e4b79091 feat: redistribute vgroup 2022-06-13 11:55:38 +08:00
Minghao Li 34c906a1e1 refactor(sync): add debug log 2022-06-13 10:39:32 +08:00
Minghao Li aad288ab17 refactor(sync): add debug log 2022-06-12 15:21:56 +08:00
Minghao Li 6a4cdadef6 refactor(sync): add debug log 2022-06-11 21:56:44 +08:00
Minghao Li f92f1bbcc0 fix(sync): snapshot overwrite config change 2022-06-11 16:20:15 +08:00
Minghao Li 104a1bb59b fix(sync): snapshot overwrite config change 2022-06-11 16:11:18 +08:00
Minghao Li dffbec29c7 refactor(sync): add last config index z 2022-06-11 15:31:49 +08:00
Minghao Li fa54663871 refactor(sync): add last config index 2022-06-11 13:52:17 +08:00
Minghao Li 4af9d14457 refactor(sync): add last config index 2022-06-11 13:08:30 +08:00
Minghao Li 6adadc0b26 refactor(sync): add last config index 2022-06-11 13:03:58 +08:00
Minghao Li 6586f78599 refactor(sync): add last config index 2022-06-11 12:44:58 +08:00
Minghao Li ae5219dd6e refactor(sync): add heartbeat log 2022-06-10 22:29:28 +08:00
Minghao Li 972fee7fbc refactor(sync): add rpcMsg to reconfig callback 2022-06-10 17:39:30 +08:00
Minghao Li e9d466ec82 refactor(sync) delete some trace log 2022-06-10 16:51:17 +08:00
Minghao Li 736862541e fix(sync): restart with config change 2022-06-10 15:19:11 +08:00
Minghao Li b351fd8261 refactor(sync): add log 2022-06-10 13:15:43 +08:00
Minghao Li 2c38692258 refactor(sync): add log 2022-06-10 11:28:41 +08:00
Minghao Li 3148df2107 fix(sync): compatibility for both mnode(use snapshot) and vnode(no snapshot) 2022-06-09 17:16:06 +08:00
Shengliang Guan 81e431b16a Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-09 16:33:43 +08:00
Minghao Li 9a61a567c5 refactor(sync): set gRaftDetailLog false 2022-06-09 16:32:37 +08:00
Shengliang Guan 0beb323653 Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-09 16:16:13 +08:00
Minghao Li 7ae6d8f77d refactor(sync): set gRaftDetailLog true 2022-06-09 14:18:57 +08:00
Minghao Li ee32302101 refactor(sync): add detail log flag 2022-06-09 14:14:45 +08:00
Shengliang Guan 65f65b53b3 Merge remote-tracking branch 'origin/3.0' into feature/sync-refactor 2022-06-09 13:49:43 +08:00
Minghao Li 4f7dc62433 refactor(sync): add detail log flag 2022-06-09 12:56:52 +08:00
Minghao Li d81f5e9f77 fix(sync): add detail log flag 2022-06-09 11:18:48 +08:00
Minghao Li 89e2c2d47a fix(sync): update sender when become leader 2022-06-09 11:00:28 +08:00
Minghao Li e070657778 refactor(sync): add syncGetSnapshotMeta 2022-06-08 23:20:07 +08:00
Minghao Li 61cc736ca0 fix(sync): create db core due to snapshot 2022-06-08 23:08:40 +08:00
Minghao Li e86ee68f8b refactor(sync): sync snapshot 2022-06-08 22:43:58 +08:00
Minghao Li 98a2451c15 refactor(sync): sync snapshot 2022-06-08 21:55:36 +08:00
Shengliang Guan bc8e6b7fd7 refactor: adjust vnode sync 2022-06-08 21:17:17 +08:00
Minghao Li 29b97fa0ad refactor(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-06-08 19:53:07 +08:00
Minghao Li aa107d03c3 refactor(sync): SSyncSnapshotReceiver 2022-06-08 18:17:17 +08:00
Minghao Li 76185e1742 refactor(sync): SSyncSnapshotSender 2022-06-08 18:07:50 +08:00
Minghao Li d72d2d698c refactor(sync): SyncAppendEntries 2022-06-08 17:44:32 +08:00
Minghao Li 39d0b652ba refactor(sync): add raft log test 2022-06-08 17:18:26 +08:00
Minghao Li 687caac2bf refactor(sync): add raft log test 2022-06-08 16:45:40 +08:00
Minghao Li f6aed44076 refactor(sync): syncNodeSendMsgById to one line 2022-06-08 13:52:33 +08:00
Minghao Li 77cd6f44f4 refactor(sync): syncUtilJson2Line 2022-06-08 11:25:24 +08:00
Minghao Li 2547e8d02e refactor: sync index 2022-06-08 11:03:28 +08:00
Minghao Li eba8f2b543 fix(sync) send snapshot multi-times 2022-06-07 19:20:05 +08:00
Minghao Li 0e41ab7f99 Merge branch 'feature/sync-refactor' of https://github.com/taosdata/TDengine into feature/sync-refactor 2022-06-07 18:34:07 +08:00
Minghao Li 31b54e7462 enh(sync): add privateTerm into SyncSnapshotRsp, SyncSnapshotSend, SSyncSnapshotReceiver 2022-06-07 18:33:06 +08:00
Shengliang Guan 4e99992cff fix: change quorum on sync reconfig successed 2022-06-07 18:00:50 +08:00
Shengliang Guan 9efa68ab96 Merge branch 'fix/mnode' into feature/sync-refactor 2022-06-07 17:11:52 +08:00
Minghao Li 7852188394 enh(sync): add privateTerm into SSyncSnapshotSender, SyncAppendEntries, SyncAppendEntriesReply 2022-06-07 16:49:07 +08:00
Shengliang Guan a047d4a559 Merge remote-tracking branch 'origin/feature/sync-refactor' into fix/mnode 2022-06-07 16:37:50 +08:00
Minghao Li 305f4a8580 enh(sync): add term into index mgr 2022-06-07 16:33:37 +08:00
Minghao Li 8680da282a fix(sync): snapshot maybe change when sending 2022-06-07 15:36:41 +08:00
Minghao Li 326714a077 fix(sync): snapshot maybe change when sending 2022-06-07 14:35:20 +08:00
Minghao Li 44a893a1c1 fix(sync): snapshot maybe change when sending 2022-06-07 13:48:40 +08:00
Minghao Li a89e455267 fix(sync): delete some assert temporary 2022-06-07 09:55:18 +08:00
Minghao Li 9baaf2cd0c enh(sync): add log index manager 2022-06-06 20:55:59 +08:00
Minghao Li 2071c5a74e fix(sync): sending snapshot 2022-06-06 20:02:27 +08:00
Minghao Li 0d7272a369 fix(sync): sending snapshot 2022-06-06 18:23:37 +08:00
Minghao Li 84a67e850e fix(sync): sending snapshot 2022-06-06 17:23:59 +08:00
Minghao Li 6b329f791b enh(sync): update raft core functions 2022-06-06 16:35:44 +08:00
Minghao Li af27303a4c enh(sync): update raft core functions 2022-06-06 16:02:25 +08:00
Minghao Li 01b04e03d9 enh(sync): forbid elect for this round 2022-06-06 11:46:59 +08:00
Minghao Li 4b87154b0e enh(sync): forbid elect for this round 2022-06-06 11:40:37 +08:00
Minghao Li 9c1e1b2f96 enh(sync): add log index manager 2022-06-06 11:31:59 +08:00
Minghao Li 5009b7822f enh(sync): add log index manager 2022-06-06 11:24:25 +08:00
Minghao Li fb4d372255 enh(sync): add log index manager 2022-06-05 22:51:15 +08:00
Minghao Li 2adc0b8a76 enh(sync): add log index manager 2022-06-05 21:48:50 +08:00
Minghao Li 5908631ec3 enh(sync): add log store2 2022-06-05 19:47:54 +08:00
Minghao Li ba8adb73cb refactor(sync): restart elect timer when vote for 2022-06-04 15:49:42 +08:00
Shengliang Guan 30da7560f8 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-06-04 11:50:47 +08:00
Minghao Li eea343c5a6 enh(sync): add syncTestTool 2022-06-04 11:25:03 +08:00
Minghao Li 44994201b6 fix(sync): sending snapshot 2022-06-02 19:47:06 +08:00
Shengliang Guan e35ebdadac refactor: rename LEADER to leader 2022-06-02 14:35:59 +08:00
Minghao Li ac90f61b63 fix(sync): wal write from middle 2022-06-02 13:53:19 +08:00
Minghao Li 1ff40068e7 fix: send snapshot 2022-06-02 11:57:06 +08:00
Minghao Li d04c12713a fix: send snapshot 2022-06-02 11:36:26 +08:00
Minghao Li 48a331fd2c refactor: print msg type 2022-06-02 00:00:27 +08:00
Minghao Li c3bf3cc97c fix: send snapshot 2022-06-01 21:57:30 +08:00
Minghao Li 757a1248dc fix: send snapshot 2022-06-01 21:23:39 +08:00
Minghao Li ae06cc3696 refactor: after review raft 6 cb 2022-06-01 19:11:31 +08:00
Minghao Li df4787eff1 refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:08:03 +08:00
Minghao Li 80c4e77b0b refactor: modify syncNodeAppendEntriesPeersSnapshot 2022-06-01 17:07:14 +08:00
Minghao Li 78db753a64 refactor: review syncNodeAppendEntriesPeersSnapshot 2022-06-01 16:30:04 +08:00
Minghao Li 403f6085d5 refactor: review syncNodeRequestVotePeersSnapshot 2022-06-01 15:52:09 +08:00
Minghao Li 320f21820b add snapshot test 2022-06-01 15:25:06 +08:00
Minghao Li 13b336d569 add snapshot test 2022-06-01 15:03:01 +08:00
Minghao Li 4453ebab3a add snapshot recv log 2022-06-01 14:40:20 +08:00
Minghao Li c706c6d0ce add snapshot recv log 2022-06-01 14:35:20 +08:00
Minghao Li 295caad7c1 refactor: add snapshot send log 2022-06-01 14:12:11 +08:00
Minghao Li 2e840969c8 refactor: snapshotReSend 2022-06-01 13:53:21 +08:00
Minghao Li 56253aedc9 refactor: snapshotReSend 2022-06-01 13:40:43 +08:00
Minghao Li 5f0d23426d refactor: snapshotReSend 2022-06-01 13:35:23 +08:00
Minghao Li 060f8224f4 refactor: snapshotReSend 2022-06-01 13:32:52 +08:00
Minghao Li 71c57d7769 refactor: sender code 2022-06-01 11:28:33 +08:00
Minghao Li 9988e85f85 add test sender, receiver 2022-05-31 21:31:07 +08:00
Minghao Li 7922997806 enh(sync): add test syncSnapshotRspTest.cpp 2022-05-31 20:54:39 +08:00
Minghao Li 995317bf9c enh(sync): add test syncSnapshotSendTest.cpp 2022-05-31 20:38:59 +08:00
Minghao Li 057fda21ce enh(sync): syncNodeOnAppendEntriesSnapshotCb 2022-05-31 19:46:49 +08:00
Minghao Li 7917716b4f enh(sync): syncNodeOnAppendEntriesReplySnapshotCb 2022-05-31 19:06:55 +08:00
Minghao Li fd823c8670 enh(sync): syncNodeOnRequestVoteReplySnapshotCb 2022-05-31 18:12:17 +08:00
Minghao Li a20cac89cc enh(sync): syncNodeOnRequestVoteSnapshotCb 2022-05-31 18:04:49 +08:00
Minghao Li b9472dc386 enh(sync): syncNodeAppendEntriesPeersSnapshot 2022-05-31 17:53:38 +08:00
Minghao Li ba212ce396 enh(sync): syncNodeRequestVotePeersSnapshot 2022-05-31 17:37:57 +08:00
Minghao Li ee9cdb2967 enh(sync): syncNodeOnSnapshotSendCb, syncNodeOnSnapshotRspCb 2022-05-31 17:23:36 +08:00
Minghao Li 21191ae2a8 enh(sync): add SSyncSnapshotReceiver 2022-05-31 16:48:47 +08:00
Minghao Li 6d8733a232 enh(sync): add SSyncSnapshotSender 2022-05-31 16:14:19 +08:00
Minghao Li cdc0dc487f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-30 21:24:05 +08:00
Minghao Li b9e4543a40 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:21:51 +08:00
Minghao Li c5526ef915 enh(sync): add SyncSnapshotRsp SyncSnapshotSend 2022-05-30 21:11:14 +08:00
Minghao Li 6be4119fe7 add syncNodeIsIndexInSnapshot syncNodeGetLastIndexTerm syncNodeGetPreIndexTerm 2022-05-30 18:45:09 +08:00
Minghao Li 79ae770a0b enh(sync): add snapshotEnable2 2022-05-30 17:31:55 +08:00
Minghao Li 43c383dcbc enh(sync): add snapshotEnable2 2022-05-30 17:19:31 +08:00
Minghao Li d6c57bd372 enh(sync): add snapshotEnable2 2022-05-30 13:14:48 +08:00
Minghao Li bdc9acbf2e enh(sync): add snapshotEnable 2022-05-30 12:26:15 +08:00
Li Minghao e3068a60ee
Merge pull request #13180 from taosdata/feature/3.0_mhli 
enh(sync): add SSnapshot callback: reader, writer
 2022-05-29 07:37:54 +08:00
Minghao Li cd2e8fe730 enh(sync): add SSnapshot callback: reader, writer 2022-05-29 07:15:29 +08:00
Cary Xu f2b4cca23d fix: init buffer to avoid invalid write 2022-05-29 01:10:32 +08:00
Cary Xu 890075ef4a fix: init buf to avoid invalid write 2022-05-29 00:59:23 +08:00
Cary Xu 5374680649 fix: init buffer to avoid invalid write 2022-05-29 00:37:18 +08:00
Minghao Li 3327a0692f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/3.0_mhli 2022-05-27 21:34:54 +08:00
Minghao Li b10f8e4aa2 fix(sync) raftCfgPersist 2022-05-27 21:32:28 +08:00
Li Minghao aa691d137f
Merge pull request #13096 from taosdata/feature/3.0_mhli 
enh(sync) snapshot sender, receiver
 2022-05-27 18:55:51 +08:00
Minghao Li 3a1be0c58a refactor: make logStore static 2022-05-27 18:00:09 +08:00
Minghao Li 5a754023f5 refactor: make logStore static 2022-05-27 16:36:44 +08:00
Minghao Li 5471792549 refactor: make logStoreGetLastEntry static 2022-05-27 16:13:02 +08:00
Minghao Li d45221c863 enh(sync) logStoreGetEntry -> pLogStore->getEntry 2022-05-27 15:41:19 +08:00
Minghao Li b7be03898c enh(sync) snapshot sender, receiver 2022-05-27 15:35:26 +08:00
Minghao Li 8141c430bc enh(sync) snapshot sender, receiver 2022-05-27 15:09:17 +08:00
Minghao Li 17ed7e0747 fix(sync) delete assert, due to config change 2022-05-27 00:00:24 +08:00
Minghao Li 1a22de765c fix(sync) add multi mnodes 2022-05-26 18:03:38 +08:00
Minghao Li f078f5b300 fix(sync): syncSetStandby 2022-05-26 15:08:20 +08:00
Minghao Li 4e1aa6b5c5 refactor: config change 2022-05-26 14:21:24 +08:00
Minghao Li 9a2eddda4c fix(sync), call FpCommitCb twice when FOLLOWER 2022-05-26 11:02:35 +08:00
Minghao Li 8c5f6b6849 fix(sync): persist isStandby 2022-05-25 18:32:34 +08:00
Minghao Li 104a207579 FpReConfigCb 2022-05-25 14:43:45 +08:00
Minghao Li 81d0798f5f refactor: update config when there's one locally 2022-05-25 14:27:59 +08:00
Minghao Li cb20717ce6 refactor: votesRespondUpdate 2022-05-24 20:23:11 +08:00
Minghao Li 94438de0ec enh(sync): syncStartStandBy 2022-05-24 19:45:09 +08:00
Minghao Li aa85781560 enh(sync): add mndSnapshotRead mndSnapshotApply 2022-05-24 15:28:12 +08:00
Minghao Li 800ef42a26 Merge branch 'feature/sync-mnode-integration' of https://github.com/taosdata/TDengine into feature/sync-mnode-integration 2022-05-24 14:47:11 +08:00
Minghao Li aa1de8b34a enh(sync): add FpSnapshotRead FpSnapshotApply 2022-05-24 14:46:22 +08:00
Shengliang Guan 077ea4a14f fix: avoid memory leak in mnode sync 2022-05-24 11:58:50 +08:00
Shengliang Guan 07fee01d1c fix: avoid memory leak in mnode sync 2022-05-24 11:26:17 +08:00
Shengliang Guan 0e8e04805a fix: avoid memory leak 2022-05-24 09:46:54 +08:00