對象存儲論文

Facebook

Haystack 是Facebook設計來存儲其小文件(圖片)的系統,系統設計思想爲小文件合併爲一個大文件來存儲,減小文件個數以及訪問文件時的io次數。spring

Beaver, Doug, et al. "Finding a Needle in Haystack: Facebook's Photo
Storage." OSDI. Vol. 10. 2010.apache

http://static.usenix.org/legacy/events/osdi10/tech/full_papers/Beaver.pdfwindows

F4 是 Haystack 的替代者。架構

Muralidhar, Subramanian, et al. "f4: Facebook's warm BLOB storage
system." 11th USENIX Symposium on Operating Systems Design and
Implementation (OSDI 14). 2014.學習

https://www.usenix.org/system/files/conference/osdi14/osdi14-paper-muralidhar.pdfui

Windows Azure Storage

Windows Azure Storage 使用一套架構的基礎上,同時提供了 queue, blob, table 服務,架構精巧,值的學習。WAS 也發表了一些相關論文,介紹了整個架構。另外,WAS還單獨發表了一篇論文介紹其對 Erasure Coding 的實踐。scala

Calder, Brad, et al. "Windows Azure Storage: a highly available cloud
storage service with strong consistency." Proceedings of the
Twenty-Third ACM Symposium on Operating Systems Principles. ACM, 2011.設計

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.231.6486&rep=rep1&type=pdf#page=153orm

Huang, Cheng, et al. "Erasure coding in windows azure storage."
Presented as part of the 2012 USENIX Annual Technical Conference
(USENIX ATC 12). 2012.對象

https://www.usenix.org/system/files/conference/atc12/atc12-final181_0.pdf

LinkedIn Ambry

LinkedIn 開源了它的對象存儲系統 ambry,而且在 SIGMOD2016 上發表了論文,詳細介紹了整個系統的架構實現。

Noghabi, Shadi A., et al. "Ambry: LinkedIn’s Scalable Geo-Distributed
Object Store."

http://dprg.cs.uiuc.edu/docs/SIGMOD2016-a/ambry.pdf

Ozone: The object store on HDFS

Ozone 的 jira issue,能夠看到開發進度與文檔

https://issues.apache.org/jira/browse/HDFS-7240

hortonworks 對其的介紹

http://zh.hortonworks.com/blog/ozone-object-store-hdfs/

Ceph

Weil, Sage A., et al. "Ceph: A scalable, high-performance distributed
file system." Proceedings of the 7th symposium on Operating systems
design and implementation. USENIX Association, 2006.

http://www3.nd.edu/~dthain/courses/cse40771/spring2007/psnowber-ceph.pdf

相關文章
相關標籤/搜索