Commit Graph

751 Commits

Author SHA1 Message Date
Minghao Li 3eff1f03e0 refactor(sync): add trace log 2022-07-21 10:57:14 +08:00
Minghao Li 540f519ad7 refactor(sync): add trace log 2022-07-20 20:24:49 +08:00
Minghao Li b77e0a6750 refactor(sync): add trace log 2022-07-20 19:58:26 +08:00
Minghao Li 3491896b7a refactor(sync): add trace log 2022-07-20 19:12:02 +08:00
Minghao Li 94b3e9d2f0 refactor(sync): add trace log 2022-07-20 19:00:55 +08:00
Minghao Li 7808fdfccb refactor(sync): add trace log 2022-07-20 17:19:42 +08:00
Minghao Li c2b348bec5 refactor(sync): add trace log 2022-07-20 15:34:09 +08:00
Minghao Li 90e7d794f3 fix(sync): reset commit index by snapshot when open sync 2022-07-20 13:32:38 +08:00
Minghao Li 11b473fe9e refactor(sync): add trace log 2022-07-20 11:56:46 +08:00
Minghao Li 4c3e1fdaa9 refactor(sync): add trace log 2022-07-20 11:34:51 +08:00
Minghao Li 54be75ff13 refactor(sync): add trace log 2022-07-20 11:18:43 +08:00
Minghao Li 322bbc493e refactor(sync): add trace log 2022-07-20 11:09:54 +08:00
Minghao Li 30bf78af96 refactor(sync): restart heartbeat timer after replicate 2022-07-19 19:04:11 +08:00
Minghao Li 991d6fd8a1 refactor(sync): add trace log 2022-07-19 17:20:59 +08:00
Minghao Li 329ba3cee8 refactor(sync): add trace log 2022-07-19 14:34:39 +08:00
Minghao Li fc08a35fbf refactor(sync): update sync-timeout to 10s 2022-07-19 13:52:02 +08:00
Minghao Li 651ae5832e refactor(sync): delete not exist log 2022-07-19 10:46:47 +08:00
Minghao Li 7187c87d35 refactor(sync): add restart heartbeat timer 2022-07-18 16:55:24 +08:00
Minghao Li 9f94dcb384 refactor(sync): add index/term in vnodeSnapWriterClose 2022-07-18 09:45:33 +08:00
Minghao Li fdf7930702 refactor(sync): add index/term in snapshot write 2022-07-16 18:09:36 +08:00
Minghao Li c978bd10ec fix(sync): do not sender snapshot when there's wal 2022-07-16 16:23:56 +08:00
Minghao Li 5cefb68dde fix(sync): snapshot end index 2022-07-16 16:00:16 +08:00
Minghao Li 6f29fd4020 fix(sync): snapshot begin index 2022-07-16 15:34:22 +08:00
Minghao Li 59c7348c94 refactor(sync): add leader transfer callback 2022-07-15 16:07:45 +08:00
Minghao Li 681993884f refactor(sync): add leader transfer callback 2022-07-15 14:55:33 +08:00
Li Minghao e3eaddac0d
Merge pull request #14869 from taosdata/feature/3.0_mhli
refactor(sync): optimized replication
2022-07-15 13:12:37 +08:00
Minghao Li 3769e07708 refactor(sync): optimized replication 2022-07-13 18:13:22 +08:00
Li Minghao 60703bdd05
Merge pull request #14857 from taosdata/feature/3.0_mhli
refactor(sync): add skiplist entry cache
2022-07-13 17:52:45 +08:00
Minghao Li 511c39a0cf refactor(sync): add skiplist entry cache 2022-07-13 15:55:38 +08:00
Shengliang Guan 480de34a0e enh: support alter debugflag in dnode 2022-07-13 14:13:12 +08:00
Minghao Li e91ca30b19 refactor(sync): add resp ttl clean 2022-07-12 20:23:31 +08:00
Shengliang Guan 037f84fafd Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-07-12 17:29:23 +08:00
Minghao Li 473e134f31 refactor(sync): add resp ttl clean 2022-07-12 16:57:19 +08:00
Minghao Li 96f9274fef refactor(sync): add timer routines 2022-07-12 15:04:32 +08:00
Minghao Li 129b289bdf refactor(sync): do leader transfer 2022-07-12 14:34:18 +08:00
Shengliang Guan 75804db990 Merge remote-tracking branch 'origin/3.0' into fix/dnode 2022-07-12 14:22:10 +08:00
Shengliang Guan b9165a9503 fix: reset queueSize after the queueItem is consumed and executed by the worker 2022-07-12 13:56:54 +08:00
Shengliang Guan 52b63db905 fix: invalid vnode ref while drop stream 2022-07-12 13:26:55 +08:00
Minghao Li 03fe08a890 refactor(sync): modify trace log 2022-07-12 11:15:58 +08:00
Minghao Li d7d8d82eec refactor(sync): modify log to index 2022-07-12 11:08:01 +08:00
Minghao Li ded3224471 refactor(sync): modify log to index 2022-07-12 11:07:07 +08:00
Minghao Li df63225b74 refactor(sync): modify append log 2022-07-11 17:26:45 +08:00
Liu Jicong 6d9727579b
Merge pull request #14761 from taosdata/feature/stream
feat(wal): add append interface
2022-07-11 16:50:28 +08:00
Liu Jicong c6052fadba feat(wal): add append interface 2022-07-11 16:22:51 +08:00
Minghao Li 27d06cae30 refactor(sync): add syncEntryCacheTest 2022-07-11 14:54:40 +08:00
Minghao Li 9e1b9fe64c refactor(sync): add syncEntryCacheTest 2022-07-11 14:21:36 +08:00
Minghao Li 2dd7abd47e refactor(sync): add vnode snapshot case 2022-07-11 10:34:02 +08:00
Minghao Li ee3ceccb0a fix(sync): vnode snapshot sender 2022-07-10 16:05:21 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Li Minghao 94cc3af08f
Merge pull request #14686 from taosdata/feature/3.0_mhli
refactor(sync): add fake syncRestoreFromSnapshot
2022-07-08 19:46:51 +08:00
Shengliang Guan 6bb8a9ad8a refactor: adjust logs 2022-07-08 19:41:23 +08:00
Shengliang Guan de644c7d43 refactor: adjust logs 2022-07-08 18:33:52 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Minghao Li 56e65d13d1 refactor(sync): add fake syncRestoreFromSnapshot 2022-07-08 17:37:25 +08:00
Shengliang Guan 361c21a35c refactor: adjust logs 2022-07-08 17:27:06 +08:00
Li Minghao d94680c3c4
Merge pull request #14676 from taosdata/feature/3.0_mhli
fix(sync): append entries batch
2022-07-08 16:07:22 +08:00
Shengliang Guan b7077b7fb3
Merge pull request #14679 from taosdata/fix/valgrind
refactor: change fndebugfalg to udfdebugflag
2022-07-08 15:44:37 +08:00
Minghao Li cc31a7c3c3 refactor(sync): add syncRestoreFromSnapshot 2022-07-08 15:38:40 +08:00
Minghao Li ed6001d5ca refactor(sync): add syncRestoreFromSnapshot 2022-07-08 15:31:50 +08:00
Minghao Li a39de34984 refactor(sync): rm syncOnMessage 2022-07-08 15:21:44 +08:00
Shengliang Guan 6e12d8e707 refactor: adjust log 2022-07-08 15:20:15 +08:00
Minghao Li 1ee5468411 fix(sync): append entries batch 2022-07-08 14:47:00 +08:00
Li Minghao 1e1e373220
Merge pull request #14654 from taosdata/feature/3.0_mhli
fix(sync): snapshot strategy wal first
2022-07-07 17:45:17 +08:00
Minghao Li 1c3c270307 fix(sync): snapshot strategy wal first 2022-07-07 17:00:01 +08:00
Liu Jicong 1ec57798d2 ci: remove unstable case 2022-07-07 11:45:28 +08:00
Liu Jicong baa48489b7 merge from 3.0 2022-07-06 21:25:34 +08:00
Minghao Li b73914fb0d refactor(sync): add term in rpcMsg 2022-07-06 16:52:39 +08:00
Minghao Li 78efbaabe1 refactor(sync): add syncGetSnapshotByIndex 2022-07-06 15:16:52 +08:00
Minghao Li 83b639ae8f refactor(sync): persist batch size 2022-07-06 14:58:38 +08:00
Minghao Li 6ec47a7a60 fix(sync): propose batch 2022-07-06 13:17:16 +08:00
Minghao Li 730a7a4a58 refactor(sync): snapshot strategy 2022-07-06 11:44:28 +08:00
Minghao Li cd4bc6e30b refactor(sync): snapshot strategy 2022-07-06 11:12:45 +08:00
Minghao Li 8a4e251be7 fix(sync): batch propose 2022-07-06 10:32:17 +08:00
Minghao Li 103a9cd9e8 fix(sync): release SyncNode ref 2022-07-05 17:39:01 +08:00
Minghao Li 88b0ab5458 fix(sync): release SyncNode ref 2022-07-05 17:32:51 +08:00
Minghao Li e8160342c3 refactor(sync): snapshot sender, receiver 2022-07-05 14:38:44 +08:00
Shengliang Guan 2daef4ba58 fix: add ref log to sync 2022-07-05 11:36:41 +08:00
Minghao Li 6437d20cda refactor(sync): add resp syncRespCleanByTTL 2022-07-04 21:28:52 +08:00
Minghao Li 6e59c13cbd refactor(sync): add sync strategy 2022-07-04 15:57:28 +08:00
Minghao Li ded4616074 refactor(sync): add sync strategy 2022-07-04 14:55:26 +08:00
Minghao Li a5d3b7033a refactor(sync): add snapshot writer param 2022-07-04 14:18:06 +08:00
Minghao Li 856806bb22 refactor(sync): add snapshot2 interface 2022-07-04 13:33:49 +08:00
Minghao Li 4fc500c91c refactor(sync): add SyncAppendEntriesBatch 2022-07-02 16:01:47 +08:00
Minghao Li 086ec29ca0 refactor(sync): add SyncClientRequestBatch 2022-07-02 14:41:54 +08:00
Minghao Li d4ab134645 refactor(sync): add snapshot2 interface 2022-07-01 17:30:52 +08:00
Minghao Li 0ffc6c46f3 refactor(sync): add snapshot2 interface 2022-07-01 14:47:12 +08:00
Minghao Li 91238e823e refactor(sync): add snapshot2 interface 2022-07-01 14:22:14 +08:00
Minghao Li 4f39cd31b0 refactor(sync): add snapshot2 interface 2022-07-01 09:50:20 +08:00
Minghao Li 24a3c817a4 refactor(sync): add batch propose 2022-06-30 16:44:49 +08:00
Minghao Li 376bf46a64 refactor(sync): add SyncClientRequestBatch 2022-06-30 15:28:23 +08:00
Minghao Li 1a8cf049b7 refactor(sync): add syncAppendEntriesBatch 2022-06-30 13:39:13 +08:00
Minghao Li c3b2b98454 refactor(sync): delete some asserts 2022-06-29 19:18:15 +08:00
Minghao Li 3440822ebf refactor(sync): add some comments 2022-06-29 16:40:36 +08:00
Minghao Li 41f24314d0 refactor(sync): add SYNC_TERM_INVALID 2022-06-29 15:44:30 +08:00
Minghao Li 18b78f2450 refactor(sync): add return code restore from snapshot 2022-06-29 14:50:59 +08:00
Minghao Li 4bd650609d refactor(sync): delete old functions 2022-06-29 14:02:40 +08:00
Minghao Li aded474d5b refactor(sync): adjust trace log 2022-06-28 16:19:15 +08:00
Minghao Li 33d1440e7b refactor(sync): adjust trace log 2022-06-28 14:23:45 +08:00
Minghao Li 4c410bd5ec refactor(sync): refactor snapshot code 2022-06-28 11:33:14 +08:00
Minghao Li 2647ec21e0 refactor(sync): add comments in snapshot 2022-06-27 20:23:08 +08:00
Minghao Li 5e7b7cb449 refactor(sync): add entries cache 2022-06-27 16:56:36 +08:00
Minghao Li 49ff32cda5 refactor(sync): add entries cache 2022-06-27 16:53:02 +08:00
Minghao Li a22814a5a7 refactor(sync): optimized one replica 2022-06-27 10:36:28 +08:00
Minghao Li 6eecbcd1a6 refactor(sync): optimized one replica 2022-06-26 01:16:11 +08:00
Minghao Li a6f33ba01c refactor(sync): optimized one replica 2022-06-25 20:31:42 +08:00
Minghao Li 77b365f0cc refactor(sync): do not replicate when one replica 2022-06-25 16:27:05 +08:00
Minghao Li 0df1415caf refactor(sync): add trace log 2022-06-25 11:30:34 +08:00
Minghao Li 58296f6a5a refactor(sync): adjust log buf size 2022-06-24 16:44:45 +08:00
Minghao Li 87defc2790 refactor(sync): add interface: get retry epset 2022-06-24 14:26:31 +08:00
Minghao Li 8a8e42a923 refactor(sync): set error code in syncIsReady 2022-06-24 14:04:58 +08:00
Minghao Li 8060108585 refactor(sync): add trace log 2022-06-24 13:50:23 +08:00
Minghao Li b3fa103cb9 refactor(sync): add trace log 2022-06-24 11:36:26 +08:00
Minghao Li 3d9ffc42e8 refactor(sync): refactor wal abstraction 2022-06-23 21:16:16 +08:00
Minghao Li f140a5ad1b refactor(sync): add trace log 2022-06-23 16:57:18 +08:00
Minghao Li 4fdc62a27f refactor(sync): delete fake match branch 2022-06-23 16:32:06 +08:00
Minghao Li 00c0926c44 refactor(sync): hold wal handle with log store 2022-06-23 14:58:52 +08:00
Minghao Li cdb6b2429a refactor(sync): update election timer range 2022-06-23 14:37:29 +08:00
Minghao Li e18329ac19 refactor(sync): update election timer range 2022-06-23 14:22:53 +08:00
Minghao Li ca4d7329ce refactor(sync): modify wal error log 2022-06-23 14:07:18 +08:00
Minghao Li 81eae2a9af refactor(sync): modify wal error log 2022-06-23 11:59:28 +08:00
Minghao Li e051bc51db refactor(sync): add trace log 2022-06-23 11:23:44 +08:00
Minghao Li a701451a27 refactor(sync): add trace log 2022-06-23 11:09:01 +08:00
Minghao Li 9786ba2fbe fix(sync): update nextindex, matchindex when backto nolog 2022-06-23 10:10:57 +08:00
Minghao Li 2f2715aca4 fix(sync): save saveErr 2022-06-22 20:23:49 +08:00
Minghao Li 13c916f5cb fix(sync): update lcindex to -1, when get error 2022-06-22 19:48:36 +08:00
Minghao Li 7b5a3eff3f refactor(sync): add syncLogStoreCheck tool 2022-06-22 10:42:54 +08:00
Minghao Li 0ba3326b99 fix(sync): update commit index when apply snapshot 2022-06-22 10:35:39 +08:00
Minghao Li 1f0d7807ac fix(sync): sender get config from local 2022-06-21 19:27:52 +08:00
Minghao Li 4381c3620d refactor(sync): calculate index after append entry 2022-06-21 19:00:24 +08:00
Minghao Li 363c98e9ed refactor(sync): abstract for log store 2022-06-21 17:45:08 +08:00
Minghao Li ecc43b6697 refactor(sync): delete some assert 2022-06-21 16:02:36 +08:00
Minghao Li b61a5cd126 refactor(sync) add trace log 2022-06-21 15:30:24 +08:00
Minghao Li 0fb64add90 refactor(sync) add trace log 2022-06-21 15:09:23 +08:00
Minghao Li 6c71ae8985 fix(sync): config change when set index-mgr 2022-06-21 13:23:35 +08:00
Shengliang Guan e87baa8df7 Merge remote-tracking branch 'origin/3.0' into fix/mnode 2022-06-21 11:42:11 +08:00
Shengliang Guan 714c599fd7 fix: deadlock while set standby 2022-06-21 11:40:27 +08:00
Minghao Li 50e3527f2b refactor(sync): set ranmdom seed by ns 2022-06-21 11:11:16 +08:00
Minghao Li 3b7e0bfdcc fix(sync): set standby when not follower 2022-06-20 20:55:40 +08:00
Minghao Li 9f76504830 refactor(sync): propose fail when changing 2022-06-20 20:10:13 +08:00
Minghao Li 3573ae1564 refactor(sync): block when changing 2022-06-20 20:07:36 +08:00
Minghao Li e441bd266b refactor(sync): add changing state 2022-06-20 17:48:56 +08:00
Minghao Li 5968c6353f refactor(sync): get snapshot and create reader 2022-06-20 10:58:59 +08:00
Minghao Li 16930ac3aa refactor(sync): adjust log buf size 2022-06-18 18:42:40 +08:00
Minghao Li f5366425ed refactor(sync): append noop in become leader 2022-06-18 17:02:29 +08:00
Minghao Li b247762931 refactor(sync) refactor trace log 2022-06-18 15:17:58 +08:00
Shengliang Guan db4e02c7c7 fix: add log to debug mnode sync 2022-06-17 15:23:17 +08:00
Shengliang Guan ab2f268601 Merge branch 'fix/tsim' into fix/dnode 2022-06-17 14:53:04 +08:00
Shengliang Guan 43f8f34b0f refactor: adjust logs 2022-06-17 14:24:17 +08:00
Shengliang Guan 6e6f559f9c Merge remote-tracking branch 'origin/feature/3.0_mhli' into fix/dnode 2022-06-17 14:06:44 +08:00
Minghao Li 9ab28e0b88 refactor(sync): add last config index in fsm cbMeta 2022-06-17 14:05:52 +08:00