(轉載)OpenStack Hacker養成指南

OpenStack Hacker養成指南

朱 榮澤     |     2013. 8. 8

[toc wrapping="right"]

0 閱讀指南

• 但願本文可以解開你心中縈繞已久的心結，假如是死結，請移步到 https://wiki.openstack.org/wiki/Main_Page
• 學習OpenStack其實就是學習各類Python庫的過程。
• 把OpenStack的設計原則貼在你的牆上。 https://wiki.openstack.org/wiki/BasicDesignTenets

1 OpenStack Hacker

• 態度：開放、主動、溝通
• 影響力：能說、能寫、能分享
• 四化：自動化、流程化、系統化、文檔化

2 基礎技能

Python

• 書籍:
  • 《python參考手冊》
  • 《python基礎教程》
• 教程:  Codecademy
• 挑戰:  Python Challenge
• 文檔:  Python v2.7.3 documentation
• 高階:
  • The Hitchhiker's Guide to Python!
  • Python Module of the Week

Linux

• 書籍:
  • 鳥哥的Linux私房菜
  • 《Unix環境高級編程》
  • 《UNIX系統編程》

Git

• 書籍：
  • Pro Git
  • GotGitHub
• 教程：
  • tryGit
  • GitImmersion
• 進階：
  • visual-git-guide
  • a-successful-git-branching-model
• 最經常使用的git命令：  Everyday GIT With 20 Commands Or So

Unittest

• 教程:  python unittest

3 OpenStack 基礎

The 5-minute Overview

OpenStack is a global collaboration of developers and cloud computing technologists producing the ubiquitous open source cloud computing platform for  public and private clouds. The project aims to deliver solutions for all types of clouds by being simple to implement, massively scalable, and feature rich. The technology consists of a series of  interrelated projects delivering various components for a cloud infrastructure solution.  OpenStackcontrols  large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.

OpenStack 基本概念

• 介紹：  https://www.openstack.org/software/
• Compute管理員手冊(必看)： http://docs.openstack.org/trunk/openstack-compute/admin/content/ch_getting-started-with-openstack.html
• OpenStack End User Guide(必看):  http://docs.openstack.org/user-guide/content/
• Network管理員手冊： http://docs.openstack.org/folsom/openstack-network/admin/content/
• Object Storage管理員手冊： http://docs.openstack.org/folsom/openstack-object-storage/admin/content/
• OpenStack文檔： http://docs.openstack.org/
• OpenStack詞彙表： http://docs.openstack.org/glossary/content/glossary.html
• 使用命令行管理openstack:  http://docs.openstack.org/cli/quick-start/content/index.html
• OpenStack Wiki:  https://wiki.openstack.org/wiki/Main_Page

簡單安裝 OpenStack

環境設置

爲了快速安裝OpenStack,你要設置最快的apt源(或者設置yum源)和pypi源。

• 設置apt源： http://blog.ubuntusoft.com/ubuntu-update-source.html
• 設置pypi源： http://www.v2ex.com/t/75316

你也能夠搭建本身的apt源和pypi源：

• 搭建apt源：
  • http://blog.ef.net/2012/10/26/unbutu-release-upgrade-with-local-apt-mirror.html
  • http://www.cnblogs.com/kulin/archive/2012/08/08/2628400.html
• 搭建pypi源：
  • https://pypi.python.org/pypi/bandersnatch

devstack 安裝

• 使用devstack安裝  http://devstack.org
• 閱讀devstack.sh腳本  http://devstack.org
• screen的使用： http://www.9usb.net/201002/linux-screen-mingling.html

devstack使用screen管理OpenStack各個服務，因此你要用screen調試OpenStack。

packstack(RHEL,CentOS) 安裝

• git倉庫:  https://github.com/stackforge/packstack
• quickstart:  http://openstack.redhat.com/Quickstart

deb包安裝

• 使用VirtualBox安裝OpenStack
• 在Ubuntu 12.04上安裝OpenStack Folsom版(FlatDHCP+Multihost)
• Ubuntu12.04.2 OpenStack Grizzly 安裝（Bridge）

 

調戲 OpenStack

• pdb：
  • http://docs.python.org/2/library/pdb.html
  • http://blog.csdn.net/hackerain/article/details/8373597
  • http://www.ibm.com/developerworks/cn/linux/l-cn-pythondebugger/

Python基本庫

WSGI

• eventlet.wsgi:  http://eventlet.net/doc/examples.html#wsgi-server
• webob:  http://webob.org/
• pecan:  http://pecanpy.org/
• wsme:  http://pythonhosted.org/WSME/
• paste:  http://pythonpaste.org/
• routes:  http://routes.readthedocs.org/en/latest/

重要的庫

• SQLAlchemy: http://www.sqlalchemy.org/
• libvirt:  http://libvirt.org/index.html
• logging:  http://docs.python.org/2/howto/logging-cookbook.html
• greenlet:  http://greenlet.readthedocs.org/en/latest/
• eventlet:  http://eventlet.net/
• kombu:  http://kombu.readthedocs.org/en/latest/
• oslo.config:  https://wiki.openstack.org/wiki/Oslo#oslo.config
• stevedore:  http://stevedore.readthedocs.org/en/latest/

TESTING

• PythonTestingToolsTaxonomy:  http://wiki.python.org/moin/PythonTestingToolsTaxonomy (all in one)
• testtools： https://readthedocs.org/projects/testtools/
• mox： http://code.google.com/p/pymox/wiki/MoxDocumentation
• mock： http://www.voidspace.org.uk/python/mock/
• tox： http://tox.readthedocs.org/en/latest/
• fixtures： https://pypi.python.org/pypi/fixtures
• testscenarios： https://pypi.python.org/pypi/testscenarios/
• nose： https://nose.readthedocs.org/en/latest/
• testrepository： https://testrepository.readthedocs.org/en/latest/MANUAL.html

OpenStack基礎組件

在OpenStack中，有一個重要的項目叫作Oslo(原名是openstack-common),給OpenStack其餘項目提供基礎組件。

• https://wiki.openstack.org/wiki/Oslo

RPC組件

• RPC組件
• http://blog.ftofficer.com/2010/03/translation-rabbitmq-python-rabbits-and-warrens/
• http://www.rabbitmq.com/tutorials/tutorial-six-python.html
• http://docs.openstack.org/developer/nova/devref/rpc.html

WSGI

• http://archimedeanco.com/wsgi-tutorial/

OpenStack 代碼規範

• Python PEP8 規範:  http://www.python.org/dev/peps/pep-0008/

• OpenStack HACKING 規範:  https://github.com/openstack-dev/hacking/blob/master/HACKING.rst

Python 深刻學習

理解python中optparse.OptionParser類。 http://docs.python.org/library/optparse.html 理解collections.Mapping類。 http://docs.python.org/library/collections.html 分析淺拷貝，深拷貝 http://blog.csdn.net/winterttr/article/details/2590741 http://longmans1985.blog.163.com/blog/static/70605475200991603624942/ http://book.51cto.com/art/200806/77233.htm LoggerAdapter類 http://docs.python.org/howto/logging-cookbook.html#context-info中。 介紹rabbitmq http://blog.ftofficer.com/2010/03/translation-rabbitmq-python-rabbits-and-warrens/ http://kombu.readthedocs.org/en/latest/introduction.html#synopsis Python Decorators入門 http://blog.csdn.net/beckel/article/details/3585352 Python @classmethod @staticmethod的區別。 http://www.libaoyin.com/2013/08/06/pyhton-staticmethod-classmethod/ 五分鐘理解元類（Metaclasses） http://www.cnblogs.com/coderzh/archive/2008/12/07/1349735.html nova中用到的python知識 http://canx.me/2011/12/%E4%B8%80%E4%BA%9Bpython/ python中類的總結 http://ipseek.blog.51cto.com/1041109/802243 with的總結 http://effbot.org/zone/python-with-statement.htm Pool類 http://nullege.com/codes/search/eventlet.pools.Pool paste模塊 http://pythonpaste.org/ python魔術方法 http://pycoders-weekly-chinese.readthedocs.org/en/latest/issue6/a-guide-to-pythons-magic-methods.html Routes模塊 http://routes.readthedocs.org/en/latest/index.html yield學習

• http://www.pythonclub.org/python-basic/yield
• http://blog.donews.com/limodou/archive/2006/09/04/1028747.aspx
• http://www.ibm.com/developerworks/cn/opensource/os-cn-python-yield/
• http://www.jeffknupp.com/blog/2013/04/07/improve-your-python-yield-and-generators-explained/

4 OpenStack 總體架構

架構圖

必看：

• http://ken.pepple.info/openstack/2012/09/25/openstack-folsom-architecture/
• http://www.solinea.com/2013/06/15/openstack-grizzly-architecture-revisited/
• http://www.slideshare.net/mirantis/open-stack-architecture-overviewmeetup662013

OpenStack架構圖，你能夠點擊放大。

工做流

Keystone Workflow

必看：

• https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_keystone_workflow_token_scoping?lang=zh
• http://docs.openstack.org/trunk/openstack-compute/admin/content/keystone-concepts.html

點擊可看大圖。

Nova Workflow

必看：

• https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_api?lang=en
• http://ilearnstack.com/2013/04/26/request-flow-for-provisioning-instance-in-openstack/comment-page-1/

nova-api處理 REST 請求。 nova建立虛擬機的工做流。

OpenStack 核心項目

對各個項目簡要分析： http://www.slideshare.net/randybias/state-of-the-stack-april-2013 核心項目的分析：

• Keystone：
  • http://docs.openstack.org/developer/keystone/
  • http://www.slideshare.net/openstackindia/openstack-keystone-identity-service
• Glance：
  • http://docs.openstack.org/developer/glance/
• Nova：
  • http://docs.openstack.org/developer/nova/
  • https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_scheduler_and_its_algorithm27?lang=en
• Cinder：
  • http://docs.openstack.org/developer/cinder/
  • Cinder grizzly deep dive pub
• Neutron：
  • http://docs.openstack.org/developer/neutron/
  • http://www.slideshare.net/openstackindia/openstack-quantum-16710792
  • http://www.slideshare.net/lewtucker/openstack-quantum-network-service
  • http://www.slideshare.net/openstackindia/openstack-quantum-18418306
• Horizon：
  • http://docs.openstack.org/developer/horizon/
• Swift：
  • http://docs.openstack.org/developer/swift/
  • http://blog.csdn.net/alex890714/article/details/7314780
  • Swift架構與實踐
• Oslo：

通用機制的分析：

• quota:  http://blog.csdn.net/hackerain/article/details/8223125
• policy:  http://blog.csdn.net/hackerain/article/details/8241691

5 OpenStack 部署/管理

OpenStack 自動化部署

Puppet:

• https://wiki.openstack.org/wiki/Puppet-openstack
• https://github.com/stackforge/puppet-openstack
• https://puppetlabs.com/solutions/openstack/

Fule: Mirantis出品的部署工具，從裸機到OpenStack組件再到HA所有搞定

• https://fuel.mirantis.com/

OpenStack 監控

• OpenStack 監控:  http://www.mirantis.com/blog/openstack-monitoring/

6 參與 OpenStack 社區

都在這裏: https://wiki.openstack.org/wiki/Main_Page

• 山頭：  https://review.openstack.org/#/admin/groups
• 向社區提交Patch： https://wiki.openstack.org/wiki/How_To_Contribute
• gerrit的使用： https://wiki.openstack.org/wiki/Gerrit_Workflow
• Review別人的Patch： https://review.openstack.org
• 參與IRC Meeting：
  • https://wiki.openstack.org/wiki/Meetings
  • https://wiki.openstack.org/wiki/Mailing_Lists
  • https://wiki.openstack.org/wiki/People
• 參與郵件列表討論： https://wiki.openstack.org/wiki/Mailing_Lists
• 跟蹤OpenStack項目的發展：
  • http://www.openstack.org/blog/
  • http://planet.openstack.org/
  • https://wiki.openstack.org/wiki/Special:RecentChanges
  • http://github.com/openstack
  • https://github.com/stackforge/ (You will like it)
  • https://github.com/openstack-dev/
  • https://github.com/openstack-infra
• 學習CI： http://ci.openstack.org/

7 OpenStack 二次開發

• 開發Nova的擴展API：
  • https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_api?lang=zh
  • https://wiki.openstack.org/wiki/WritingRequestExtensions
  • http://stephanfr.com/2013/04/07/creating-an-openstack-keystone-helloworld-extension/
  • http://www.cnblogs.com/willier/archive/2013/05/22/3092961.html
• 開發Cinder的driver：
  • 新的driver必須知足  Minimum Features,參考同類型的driver，依葫蘆畫瓢。

8 OpenStack 生態圈

• OpenStack幕後的公司： http://www.chenshake.com/behind-the-openstack-company
• State of The Stack： http://www.slideshare.net/randybias/state-of-the-stack-april-2013 (一針見血)
• OpenStack貢獻排行榜： http://stackalytics.com/
• OpenStack實踐分享： http://www.mirantis.com/blog/ (mirantis是目前最成功的OpenStack系統集成商)