聊聊rocketmq的LatencyFaultTolerance

時間 2020-01-01

標籤聊聊 rocketmq latencyfaulttolerance 简体版

原文原文鏈接

序

本文主要研究一下rocketmq的LatencyFaultTolerancejava

LatencyFaultTolerance

rocketmq-client-4.6.0-sources.jar!/org/apache/rocketmq/client/latency/LatencyFaultTolerance.javagit

public interface LatencyFaultTolerance<T> {
    void updateFaultItem(final T name, final long currentLatency, final long notAvailableDuration);

    boolean isAvailable(final T name);

    void remove(final T name);

    T pickOneAtLeast();
}

LatencyFaultTolerance接口定義了updateFaultItem、isAvailable、remove、pickOneAtLeast方法

LatencyFaultToleranceImpl

rocketmq-client-4.6.0-sources.jar!/org/apache/rocketmq/client/latency/LatencyFaultToleranceImpl.javagithub

public class LatencyFaultToleranceImpl implements LatencyFaultTolerance<String> {
    private final ConcurrentHashMap<String, FaultItem> faultItemTable = new ConcurrentHashMap<String, FaultItem>(16);

    private final ThreadLocalIndex whichItemWorst = new ThreadLocalIndex();

    @Override
    public void updateFaultItem(final String name, final long currentLatency, final long notAvailableDuration) {
        FaultItem old = this.faultItemTable.get(name);
        if (null == old) {
            final FaultItem faultItem = new FaultItem(name);
            faultItem.setCurrentLatency(currentLatency);
            faultItem.setStartTimestamp(System.currentTimeMillis() + notAvailableDuration);

            old = this.faultItemTable.putIfAbsent(name, faultItem);
            if (old != null) {
                old.setCurrentLatency(currentLatency);
                old.setStartTimestamp(System.currentTimeMillis() + notAvailableDuration);
            }
        } else {
            old.setCurrentLatency(currentLatency);
            old.setStartTimestamp(System.currentTimeMillis() + notAvailableDuration);
        }
    }

    @Override
    public boolean isAvailable(final String name) {
        final FaultItem faultItem = this.faultItemTable.get(name);
        if (faultItem != null) {
            return faultItem.isAvailable();
        }
        return true;
    }

    @Override
    public void remove(final String name) {
        this.faultItemTable.remove(name);
    }

    @Override
    public String pickOneAtLeast() {
        final Enumeration<FaultItem> elements = this.faultItemTable.elements();
        List<FaultItem> tmpList = new LinkedList<FaultItem>();
        while (elements.hasMoreElements()) {
            final FaultItem faultItem = elements.nextElement();
            tmpList.add(faultItem);
        }

        if (!tmpList.isEmpty()) {
            Collections.shuffle(tmpList);

            Collections.sort(tmpList);

            final int half = tmpList.size() / 2;
            if (half <= 0) {
                return tmpList.get(0).getName();
            } else {
                final int i = this.whichItemWorst.getAndIncrement() % half;
                return tmpList.get(i).getName();
            }
        }

        return null;
    }

    @Override
    public String toString() {
        return "LatencyFaultToleranceImpl{" +
            "faultItemTable=" + faultItemTable +
            ", whichItemWorst=" + whichItemWorst +
            '}';
    }

    //......
}

LatencyFaultToleranceImpl實現了LatencyFaultTolerance接口；它維護了一個faultItemTable，其key爲name，value爲FaultItem；其updateFaultItem方法會將對應name的currentLatency及notAvailableDuration更新到對應的FaultItem中，沒有則建立
isAvailable方法則先從faultItemTable獲取faultItem，不爲null則返回faultItem.isAvailable()，爲null則返回true；remove方法則執行faultItemTable.remove(name)
pickOneAtLeast方法首先拷貝一份faultItemTable的FaultItem的列表，若該列表爲空則返回null；不爲空則對tmpList進行shuffle以及sort，而後取half值(tmpList.size() / 2)，若half小於等於0則返回tmpList.get(0).getName()，不然取tmpList.get(i).getName()，其中i由whichItemWorst.getAndIncrement() % half計算而來

FaultItem

rocketmq-client-4.6.0-sources.jar!/org/apache/rocketmq/client/latency/LatencyFaultToleranceImpl.javaapache

class FaultItem implements Comparable<FaultItem> {
        private final String name;
        private volatile long currentLatency;
        private volatile long startTimestamp;

        public FaultItem(final String name) {
            this.name = name;
        }

        @Override
        public int compareTo(final FaultItem other) {
            if (this.isAvailable() != other.isAvailable()) {
                if (this.isAvailable())
                    return -1;

                if (other.isAvailable())
                    return 1;
            }

            if (this.currentLatency < other.currentLatency)
                return -1;
            else if (this.currentLatency > other.currentLatency) {
                return 1;
            }

            if (this.startTimestamp < other.startTimestamp)
                return -1;
            else if (this.startTimestamp > other.startTimestamp) {
                return 1;
            }

            return 0;
        }

        public boolean isAvailable() {
            return (System.currentTimeMillis() - startTimestamp) >= 0;
        }

        @Override
        public int hashCode() {
            int result = getName() != null ? getName().hashCode() : 0;
            result = 31 * result + (int) (getCurrentLatency() ^ (getCurrentLatency() >>> 32));
            result = 31 * result + (int) (getStartTimestamp() ^ (getStartTimestamp() >>> 32));
            return result;
        }

        @Override
        public boolean equals(final Object o) {
            if (this == o)
                return true;
            if (!(o instanceof FaultItem))
                return false;

            final FaultItem faultItem = (FaultItem) o;

            if (getCurrentLatency() != faultItem.getCurrentLatency())
                return false;
            if (getStartTimestamp() != faultItem.getStartTimestamp())
                return false;
            return getName() != null ? getName().equals(faultItem.getName()) : faultItem.getName() == null;

        }

        @Override
        public String toString() {
            return "FaultItem{" +
                "name='" + name + '\'' +
                ", currentLatency=" + currentLatency +
                ", startTimestamp=" + startTimestamp +
                '}';
        }

        public String getName() {
            return name;
        }

        public long getCurrentLatency() {
            return currentLatency;
        }

        public void setCurrentLatency(final long currentLatency) {
            this.currentLatency = currentLatency;
        }

        public long getStartTimestamp() {
            return startTimestamp;
        }

        public void setStartTimestamp(final long startTimestamp) {
            this.startTimestamp = startTimestamp;
        }

    }

FaultItem首先了Comparable<FaultItem>接口，它定義了name、currentLatency、startTimestamp屬性，其isAvailable方法的計算公式爲(System.currentTimeMillis() - startTimestamp) >= 0；其compareTo方法依次根據isAvailable()、currentLatency、startTimestamp來排序

ThreadLocalIndex

rocketmq-client-4.6.0-sources.jar!/org/apache/rocketmq/client/common/ThreadLocalIndex.javadom

public class ThreadLocalIndex {
    private final ThreadLocal<Integer> threadLocalIndex = new ThreadLocal<Integer>();
    private final Random random = new Random();

    public int getAndIncrement() {
        Integer index = this.threadLocalIndex.get();
        if (null == index) {
            index = Math.abs(random.nextInt());
            if (index < 0)
                index = 0;
            this.threadLocalIndex.set(index);
        }

        index = Math.abs(index + 1);
        if (index < 0)
            index = 0;

        this.threadLocalIndex.set(index);
        return index;
    }

    @Override
    public String toString() {
        return "ThreadLocalIndex{" +
            "threadLocalIndex=" + threadLocalIndex.get() +
            '}';
    }
}

ThreadLocalIndex定義了threadLocalIndex及random屬性，其getAndIncrement方法先從threadLocalIndex.get()獲取index，若爲null則使用Math.abs(random.nextInt())初始化，若結果小於0則重置爲0；以後使用Math.abs(index + 1)來threadLocalIndex.set(index)，若index小於0也重置爲0

小結

LatencyFaultTolerance接口定義了updateFaultItem、isAvailable、remove、pickOneAtLeast方法；LatencyFaultToleranceImpl實現了LatencyFaultTolerance接口；它維護了一個faultItemTable，其key爲name，value爲FaultItem；其updateFaultItem方法會將對應name的currentLatency及notAvailableDuration更新到對應的FaultItem中，沒有則建立
isAvailable方法則先從faultItemTable獲取faultItem，不爲null則返回faultItem.isAvailable()，爲null則返回true；remove方法則執行faultItemTable.remove(name)
pickOneAtLeast方法首先拷貝一份faultItemTable的FaultItem的列表，若該列表爲空則返回null；不爲空則對tmpList進行shuffle以及sort，而後取half值(tmpList.size() / 2)，若half小於等於0則返回tmpList.get(0).getName()，不然取tmpList.get(i).getName()，其中i由whichItemWorst.getAndIncrement() % half計算而來

doc

LatencyFaultTolerance

相關標籤/搜索

每日一句

每一个你不满意的现在，都有一个你没有努力的曾经。