億級流量架構第二彈：你的系統真的無懈可擊嗎？【石杉的架構筆記】

歡迎關注微信公衆號：石杉的架構筆記（id：shishan100）

個人新課**《C2C 電商系統微服務架構120天實戰訓練營》在公衆號儒猿技術窩**上線了，感興趣的同窗，能夠點擊下方連接瞭解詳情：

《C2C 電商系統微服務架構120天實戰訓練營》

在《億級流量系統架構》系列第一階段中，咱們從零開始，講述了一個大型數據平臺的幾個方面的構建，包括：

• 如何承載百億級數據的存儲挑戰
• 如何承載設計高容錯的分佈式架構
• 如何設計高性能架構，使之能承載百億級流量
• 如何設計高併發架構，可以支撐住每秒數十萬的併發查詢
• 如何設計全鏈路99.99%的高可用架構

好！架構演進到這個時候，系統是否無懈可擊了呢？

固然不是！

自古以來，可以瓦解一個軍隊戰鬥力的，不只有外力衝擊，還有內部因素。

一樣，對於我們的億級流量系統，外部的衝擊咱們抗住了，如今的考驗，來自於系統自身。而首當其衝的，就是系統的可擴展性帶來的嚴重挑戰。。。

所以在第二階段，我們用了大量的篇幅，分爲上中下三篇，詳細的討論了該架構在可擴展性方面的痛點和改進。

跨過了2018年，你是否還記得這些痛點以及針對的技術方案呢？

若是忘了，不要緊，跟着本文，溫故知新。筆者但願各位在重拾記憶的同時，能有新的收穫，而且能把文中的某些技術方案在本身公司中實際落地實踐。

一樣，對於可擴展性方案的複習，也是爲後面系統在其餘方面的改進打下基礎，這樣大夥兒讀後面的文章時，不至於由於中間知識的斷層而一臉懵逼。。。

一

對億級流量架構可擴展性的討論，我們分紅了上中下三篇。其中上篇，開門見山，發現問題：實時計算平臺與數據查詢平臺之間耦合嚴重，並形成了諸多痛點：

• 數據查詢團隊被動承擔了本不應他們承擔的高併發寫入壓力

• 數據庫運維操做致使的線上系統性能劇烈抖動

• 實時計算平臺團隊由於自身寫入機制的bug致使數據丟失，結果讓數據查詢團隊來進行排查，典型的甩鍋！

• 實時計算平臺團隊，居然須要本身來實現雙寫一致性的保障機制，直接致使代碼裏混合了大量不屬於本身團隊業務邏輯的代碼

• 數據查詢平臺作了分庫分表的操做，須要實時計算平臺team一塊兒修改配置，一塊兒測試部署上線

總之，這些痛點，致使的結果是兩個團隊的同窗每天膩在一塊兒，並且是被迫的。。。

對於上面這些系統痛點的成因，你還有印象嗎？若是忘了，猛戳下面連接，先趕忙去複習一波吧，知道了病症，纔好對症下藥！

猛戳下方連接：

億級流量系統架構之如何在上萬併發場景下設計可擴展架構（上）？

二

好，經過了上篇文章，咱們已經知道了系統耦合形成的各類痛點，真的很痛！

那麼如今，就該針對這些痛點，對症下藥。看看下面的內容，你還能記起嗎？

• 相似於中醫的「望聞問切」，解決問題的第一步，就是找到病因。而到我們這裏，解決耦合的第一步，則是清晰的劃分出系統邊界。

• 劃分出邊界以後，第二件事，固然就是解耦。如何解耦：利用消息中間件

• 好！如今咱們引入了消息中間件解耦，你是否還記得上篇文章中的一個痛點：實時計算平臺高併發寫入時，數據查詢平臺要無辜承受高併發的寫入壓力

• 那咱們引入了中間件以後，經過消息中間件進行削峯填谷，就能解決這個問題了，關於什麼是削峯填谷，以及如何實行，還記得嗎？

• 解耦事後，咱們經過手動流量開關來配合數據庫運維，直接本身團隊的同窗在某個低鋒時段關閉流量開關，迅速完成數據庫運維操做。這不又解決了一大痛點嗎！

• 好處還不止這些，好比，咱們引入中間件解耦以後，其餘系統不也能夠按需去MQ裏，訂閱實時計算平臺計算好的數據嗎！再不用看其餘平臺的臉色了

整體來說，解耦以後，各個團隊各司其職，不用每天被迫膩在一塊兒。而沒有了人爲的各類干預，系統也運轉的更加流暢高效。

關於這些針對性的解決方案，筆者建議你們再仔細看看，這都是真實線上生產總結出的經驗，也許裏面的某些方案可以幫到你！

猛戳下方連接：

億級流量系統架構之如何在上萬併發場景下設計可擴展架構（中）？

三

講完了實際的落地方案，咱們來到了億級流量架構可擴展性的下篇。

在可擴展性中篇的討論中，咱們提到了解耦的好處之一，是能夠實現消息的「Pub/Sub」模型，即不一樣平臺均可以根據自身須要去訂閱同一份數據。

那麼下篇，咱們討論的主題就是基於消息中間件的「Pub/Sub」模型，並以RabbitMQ爲例，詳細闡述了其在代碼層面的落地實踐。

什麼是exchange？默認的exchange是啥？如何綁定本身的隊列到exchange上去消費？這些還記得嗎？若是忘了，猛戳下面的連接，趕忙的回顧一下！

整體來說，解耦以後，各個團隊各司其職，不用每天被迫膩在一塊兒。而沒有了人爲的各類干預，系統也運轉的更加流暢高效。

關於這些針對性的解決方案，筆者建議你們再仔細看看，這都是真實線上生產總結出的經驗，也許裏面的某些方案可以幫到你！

猛戳下方連接：

億級流量系統架構之如何在上萬併發場景下設計可擴展架構（下）？

以上就是關於億級流量可擴展性作的一個階段性小結，重構之路漫無止境，且環環相扣。筆者但願經過這個總結，在我們繼續上路以前，打牢基礎，加深理解，磨刀不誤砍柴工。

若有收穫，請幫忙轉發，您的鼓勵是做者最大的動力，謝謝！

一大波微服務、分佈式、高併發、高可用的原創系列文章正在路上

歡迎掃描下方二維碼，持續關注：

石杉的架構筆記（id:shishan100）

十餘年BAT架構經驗傾囊相授

**> **推薦閱讀：** > > 一、[拜託！面試請不要再問我Spring Cloud底層原理](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5be13b83f265da6116393fc7) > > 二、[【雙11狂歡的背後】微服務註冊中心如何承載大型系統的千萬級訪問？](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5be3f8dcf265da613a5382ca) > > 三、[【性能優化之道】每秒上萬併發下的Spring Cloud參數優化實戰](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5be83e166fb9a049a7115580) > > 四、[微服務架構如何保障雙11狂歡下的99.99%高可用](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5be99a68e51d4511a8090440) > > 五、[兄弟，用大白話告訴你小白都能聽懂的Hadoop架構原理](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5beaf02ce51d457e90196069) > > 六、[大規模集羣下Hadoop NameNode如何承載每秒上千次的高併發訪問](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5bec278c5188253e64332c76) > > 七、【[性能優化的祕密】Hadoop如何將TB級大文件的上傳性能優化上百倍](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Flink.juejin.im%2525252525252F%2525252525253Ftarget%2525252525253Dhttps%252525252525253A%252525252525252F%252525252525252Flink.juejin.im%252525252525252F%252525252525253Ftarget%252525252525253Dhttps%25252525252525253A%25252525252525252F%25252525252525252Fjuejin.im%25252525252525252Fpost%25252525252525252F5bed82a9e51d450f9461cfc7) > > [八、](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fjuejin.im%2525252525252Fpost%2525252525252F5bf2c6b6e51d456693549af4)[拜託，面試請不要再問我TCC分佈式事務的實現原理坑爹呀！](https://juejin.cn/post/6844903716089233416) [](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fjuejin.im%2525252525252Fpost%2525252525252F5bf2c6b6e51d456693549af4) > > 九、[【坑爹呀！】最終一致性分佈式事務如何保障實際生產中99.99%高可用？](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fjuejin.im%2525252525252Fpost%2525252525252F5bf2c6b6e51d456693549af4) > > 十、[拜託，面試請不要再問我Redis分佈式鎖的實現原理！](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fjuejin.im%2525252525252Fpost%2525252525252F5bf3f15851882526a643e207) > > **十一、****[【眼前一亮！】看Hadoop底層算法如何優雅的將大規模集羣性能提高10倍以上？](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Flink.juejin.im%25252525253Ftarget%25252525253Dhttps%2525252525253A%2525252525252F%2525252525252Fjuejin.im%2525252525252Fpost%2525252525252F5bf5396f51882509a768067e)** > > **十二、****[億級流量系統架構之如何支撐百億級數據的存儲與計算](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Flink.juejin.im%252525252F%252525253Ftarget%252525253Dhttps%25252525253A%25252525252F%25252525252Fjuejin.im%25252525252Fpost%25252525252F5bfab59fe51d4551584c7bcf)** > > 1三、[億級流量系統架構之如何設計高容錯分佈式計算系統](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Flink.juejin.im%2525253Ftarget%2525253Dhttps%252525253A%252525252F%252525252Fjuejin.im%252525252Fpost%252525252F5bfbeeb9f265da61407e9679) > > 1四、[億級流量系統架構之如何設計承載百億流量的高性能架構](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Flink.juejin.im%25253Ftarget%25253Dhttps%2525253A%2525252F%2525252Fjuejin.im%2525252Fpost%2525252F5bfd2df1e51d4574b133dd3a) > > 1五、[億級流量系統架構之如何設計每秒十萬查詢的高併發架構](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Flink.juejin.im%252F%253Ftarget%253Dhttps%25253A%25252F%25252Fjuejin.im%25252Fpost%25252F5bfe771251882509a7681b3a) > > 1六、[億級流量系統架構之如何設計全鏈路99.99%高可用架構](https://link.juejin.im/?target=https%3A%2F%2Flink.juejin.im%3Ftarget%3Dhttps%253A%252F%252Fjuejin.im%252Fpost%252F5bffab686fb9a04a102f0022) > > 1七、[七張圖完全講清楚ZooKeeper分佈式鎖的實現原理](https://link.juejin.im/?target=https%3A%2F%2Fjuejin.im%2Fpost%2F5c01532ef265da61362232ed) > > 1八、[大白話聊聊Java併發面試問題之volatile究竟是什麼？](https://juejin.cn/post/6844903730303746061) > > 1九、[大白話聊聊Java併發面試問題之Java 8如何優化CAS性能？](https://juejin.cn/post/6844903731234865160) > > 20、[大白話聊聊Java併發面試問題之談談你對AQS的理解？](https://juejin.cn/post/6844903732061159437) > > 2一、[大白話聊聊Java併發面試問題之公平鎖與非公平鎖是啥？](https://juejin.cn/post/6844903732883226637) > > 2二、[大白話聊聊Java併發面試問題之微服務註冊中心的讀寫鎖優化](https://juejin.cn/post/6844903734267510798) > > 2三、[互聯網公司的面試官是如何360°無死角考察候選人的？（上篇）](https://juejin.cn/post/6844903734930046989) > > 2四、[互聯網公司面試官是如何360°無死角考察候選人的？（下篇）](https://juejin.cn/post/6844903735655661581) > > 2五、[Java進階面試系列之一：哥們，大家的系統架構中爲何要引入消息中間件？](https://juejin.cn/post/6844903736444207117) > > 2六、[【Java進階面試系列之二】：哥們，那你說說系統架構引入消息中間件有什麼缺點？](https://juejin.cn/post/6844903737123667975) > > 2七、[【行走的Offer收割機】記一位朋友斬獲BAT技術專家Offer的面試經歷](https://juejin.cn/post/6844903741213130765) > > 2八、[【Java進階面試系列之三】哥們，消息中間件在大家項目裏是如何落地的？](https://juejin.cn/post/6844903742114906125) > > 2九、[【Java進階面試系列之四】扎心！線上服務宕機時，如何保證數據100%不丟失？](https://juejin.cn/post/6844903742928601095) > > 30、[一次JVM FullGC的背後，竟隱藏着驚心動魄的線上生產事故！](https://juejin.cn/post/6844903743712935944) > > 3一、[【高併發優化實踐】10倍請求壓力來襲，你的系統會被擊垮嗎？](https://juejin.cn/post/6844903744514031624) > > 3二、[【Java進階面試系列之五】消息中間件集羣崩潰，如何保證百萬生產數據不丟失？](https://juejin.cn/post/6844903746636349453) > > 3三、[億級流量系統架構之如何在上萬併發場景下設計可擴展架構（上）？](https://juejin.cn/post/6844903747345219598) > > 3四、[億級流量系統架構之如何在上萬併發場景下設計可擴展架構（中）？](https://juejin.cn/post/6844903747903029261) > > 3五、[億級流量系統架構之如何在上萬併發場景下設計可擴展架構（下）？](https://juejin.cn/post/6844903748565745678)**

做者：石杉的架構筆記
連接：juejin.cn/post/684490… 來源：掘金 著做權歸做者全部，轉載請聯繫做者得到受權！