grpc-go 鏈接backoff協議

當咱們鏈接到一個失敗的後端時,一般但願不要當即重試(以免氾濫的網絡或服務器的請求),而是作某種形式的指數backoff。golang

咱們有幾個參數:算法

  1. INITIAL_BACKOFF (第一次失敗重試先後需等待多久)
  2. MULTIPLIER (在失敗的重試後乘以的倍數)
  3. JITTER (隨機抖動因子).
  4. MAX_BACKOFF (backoff上限)
  5. MIN_CONNECT_TIMEOUT (最短重試間隔)

建議backoff算法

以指數形式返回鏈接嘗試的起始時間,達到MAX_BACKOFF的極限,並帶有抖動。後端

1
2
3
4
5
6
7
ConnectWithBackoff()
current_backoff = INITIAL_BACKOFF
current_deadline = now() + INITIAL_BACKOFF
while (TryConnect(Max(current_deadline, now() + MIN_CONNECT_TIMEOUT))!= SUCCESS)
SleepUntil(current_deadline)
current_backoff = Min(current_backoff * MULTIPLIER, MAX_BACKOFF)
current_deadline = now() + current_backoff + UniformRandom(-JITTER * current_backoff, JITTER * current_backoff)

 

參數默認值MIN_CONNECT_TIMEOUT=20sec INITIAL_BACKOFF=1sec MULTIPLIER=1.6 MAX_BACKOFF=120sec JITTER=0.2服務器

根據的確切的關注點實現(例如最小化手機的喚醒次數)可能但願使用不一樣的算法,特別是不一樣的抖動邏輯。網絡

備用的實現必須確保鏈接退避在同一時間開始分散,而且不得比上述算法更頻繁地嘗試鏈接。dom

重置backoff

backoff應在某個時間點重置爲INITIAL_BACKOFF,以便從新鏈接行爲是一致的,無論鏈接的是新開始的仍是先前斷開的鏈接。google

當接收到SETTINGS幀時重置backoff,在那個時候,咱們肯定這個鏈接被服務器已經接受了。spa


grpc-go

源碼位於google.golang.org/grpc/backoff,代碼很少,直接在代碼上分析。code

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57

import (
"math/rand"
"time"
)

// 對應上面的默認值可是沒有實現MIN_CONNECT_TIMEOUT參數
var DefaultBackoffConfig = BackoffConfig{
MaxDelay: 120 * time.Second,
baseDelay: 1.0 * time.Second,
factor: 1.6,
jitter: 0.2,
}

// backoffStrategy是backoff算法的接口
type backoffStrategy interface {
// 經過重試次數返回在下一次重試以前等待的時間量
backoff(retries int) time.Duration
}

type BackoffConfig struct {
MaxDelay time.Duration
baseDelay time.Duration
factor float64
jitter float64
}

func setDefaults(bc *BackoffConfig) {
md := bc.MaxDelay
*bc = DefaultBackoffConfig

if md > 0 {
bc.MaxDelay = md
}
}

// backoff算法的基礎實現
func (bc BackoffConfig) backoff(retries int) time.Duration {
if retries == 0 {
return bc.baseDelay
}
backoff, max := float64(bc.baseDelay), float64(bc.MaxDelay)
for backoff < max && retries > 0 {
backoff *= bc.factor
retries--
}
if backoff > max {
backoff = max
}
// Randomize backoff delays so that if a cluster of requests start at
// the same time, they won't operate in lockstep.
backoff *= 1 + bc.jitter*(rand.Float64()*2-1)
if backoff < 0 {
return 0
}
return time.Duration(backoff)
}

 

若是默認的backoff算法不知足需求的時候,還能夠自定義backoff算法,經過實現backoffStrategy接口。orm

1
2
3
4
5
6
7
func withBackoff(bs backoffStrategy) DialOption {
return func(o *dialOptions) {
o.bs = bs
}
}

grpc.Dial(addr, grpc.withBackoff(mybackoff))
相關文章
相關標籤/搜索