別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點(2)
2、nova-api
步驟3：nova-api接收請求
nova-api接收請求，也不是隨便怎麼來都接收的，而是須要設定rate limits，默認的實現是在ratelimit的middleware裏面實現的。html
然而有時候，咱們但願實現distributed rate-limiting，從而Turnstile是一個不錯的選擇。node
https://github.com/klmitch/turnstile
http://pypi.python.org/pypi/turnstilepython
步驟4：對Token的驗證
步驟5：查看Policy
這兩步已經在keystone的時候研究過mysql
步驟6：檢查quota
nova, neutron, Cinder各有各的quota，而且能夠從命令行進行管理git
# nova -h | grep quota
quota-class-show List the quotas for a quota class.
quota-class-update Update the quotas for a quota class.
quota-defaults List the default quotas for a tenant.
quota-delete Delete quota for a tenant/user so their quota will
quota-show List the quotas for a tenant/user.
quota-update Update the quotas for a tenant/user.github
# nova quota-show
+-----------------------------+-------+
| Quota | Limit |
+-----------------------------+-------+
| instances | 10 |
| cores | 20 |
| ram | 51200 |
| floating_ips | 10 |
| fixed_ips | -1 |
| metadata_items | 128 |
| injected_files | 5 |
| injected_file_content_bytes | 10240 |
| injected_file_path_bytes | 255 |
| key_pairs | 100 |
| security_groups | 10 |
| security_group_rules | 20 |
+-----------------------------+-------+sql
# cinder -h | grep quota
quota-class-show List the quotas for a quota class.
quota-class-update Update the quotas for a quota class.
quota-defaults List the default quotas for a tenant.
quota-show List the quotas for a tenant.
quota-update Update the quotas for a tenant.
quota-usage List the quota usage for a tenant.shell
# cinder quota-show 1779b3bc725b44b98726fb0cbdc617b1
+-----------+-------+
| Property | Value |
+-----------+-------+
| gigabytes | 1000 |
| snapshots | 10 |
| volumes | 10 |
+-----------+-------+數據庫
# neutron -h | grep quota
quota-delete Delete defined quotas of a given tenant.
quota-list List quotas of all tenants who have non-default quota values.
quota-show Show quotas of a given tenant
quota-update Define tenant's quotas not to use defaults.json
# neutron quota-show 1779b3bc725b44b98726fb0cbdc617b1
+---------------------+-------+
| Field | Value |
+---------------------+-------+
| floatingip | 50 |
| network | 10 |
| port | 50 |
| router | 10 |
| security_group | 10 |
| security_group_rule | 100 |
| subnet | 10 |
+---------------------+-------+
推薦下面的文章
openstack nova 基礎知識——Quota（配額管理）
http://www.sebastien-han.fr/blog/2012/09/19/openstack-play-with-quota/
步驟7：在數據庫中建立Instance實例
有關nova的database schema參考下面的文章
http://www.prestonlee.com/2012/05/03/openstack-nova-essex-mysql-database-schema-diagram-and-sql/
MySQL是Openstack中最重要的組件之一，因此在生產環境中High Availability是必須的。
MySQL的HA有下面幾種方式：
http://dev.mysql.com/doc/mysql-ha-scalability/en/index.html
| Requirement | MySQL Replication | MySQL with DRBD with Corosync and Pacemaker | MySQL Cluster |
| Availability | |||
| Platform Support | All Supported by MySQL Server | Linux | All Supported by MySQL Cluster |
| Automated IP Failover | No | Yes | Depends on Connector and Configuration |
| Automated Database Failover | No | Yes | Yes |
| Automatic Data Resynchronization | No | Yes | Yes |
| Typical Failover Time | User / Script Dependent | Configuration Dependent, 60 seconds and Above | 1 Second and Less |
| Synchronous Replication | No, Asynchronous and Semisynchronous | Yes | Yes |
| Shared Storage | No, Distributed | No, Distributed | No, Distributed |
| Geographic redundancy support | Yes | Yes, via MySQL Replication | Yes, via MySQL Replication |
| Update Schema On-Line | No | No | Yes |
| Scalability | |||
| Number of Nodes | One Master, Multiple Slaves | One Active (primary), one Passive (secondary) Node | 255 |
| Built-in Load Balancing | Reads, via MySQL Replication | Reads, via MySQL Replication | Yes, Reads and Writes |
| Supports Read-Intensive Workloads | Yes | Yes | Yes |
| Supports Write-Intensive Workloads | Yes, via Application-Level Sharding | Yes, via Application-Level Sharding to Multiple Active/Passive Pairs | Yes, via Auto-Sharding |
| Scale On-Line (add nodes, repartition, etc.) | No | No | Yes |
要想系統的學習Mysql replication，推薦下面的這本書
《MySQL High Availability Tools for Building Robust Data Centers》
還有一種方式是Mysql + galera，能夠搭建Active + Active的Mysql應用
參考下面的兩篇文章
http://www.sebastien-han.fr/blog/2012/04/08/mysql-galera-cluster-with-haproxy/
http://www.sebastien-han.fr/blog/2012/04/01/mysql-multi-master-replication-with-galera/
還有一種常見的HA的技術，就是pacemaker
最底層是通訊層corosync/openais
負責cluster中node之間的通訊
上一層是Resource Allocation Layer，包含下面的組件：
CRM Cluster Resouce Manager
是總管，對於resource作的任何操做都是經過它。每一個機器上都有一個CRM。
CIB Cluster Information Base
CIB由CRM管理，是在內存中的XML數據庫，保存了cluster的配置和狀態。咱們查詢出來的configuration都是保存在CIB裏面的。nodes, resources, constraints, relationship.
DC Designated Coordinator
每一個node都有CRM，會有一個被選爲DC，是整個Cluster的大腦，這個DC控制的CIB是master CIB，其餘的CIB都是副本。
PE Policy Engine
當DC須要進行一些全局配置的時候，首先由PE根據當前的狀態和配置，計算出未來的狀態，並生成一系列的action，使得cluster從初始狀態變爲結果狀態。PE僅僅在DC上運行。
LRM Local Resource Manager
本地的resource管理，調用resource agent完成操做，啓停resource，將結果返回給CRM
再上一層是Resource Layer
包含多個resource agent。resource agent每每是一些shell script，用來啓動，中止，監控resource的狀態。
要弄懂Pacemaker，推薦讀《SUSE high availability guide》
https://www.suse.com/documentation/sle_ha/singlehtml/book_sleha/book_sleha.html
本人作了一些筆記和實驗，請參考
步驟8：建立filter_properties，用於nova scheduler
步驟9：發送RPC給nova-conductor
有關nova-conductor的文章
http://cloudystuffhappens.blogspot.com/2013/04/understanding-nova-conductor-in.html
在Openstack中，RPC的發送是經過RabbitMQ
RabbitMQ能夠經過Pacemaker進行HA，固然也能夠搭建本身的RabbitMQ Cluster
學習RabbitMQ固然首推《RabbitMQ in Action》
本人也作了一些筆記
RabbitMQ in Action (1): Understanding messaging
RabbitMQ in Action (2): Running and administering Rabbit
RabbitMQ in Action(5): Clustering and dealing with failure
還沒徹底讀完，敬請諒解
固然Openstack中對於RabbitMQ的使用，一篇很好的文章是
本人也對RPC的調用過程進行了代碼分析
步驟10：nova-condutor建立request_spec，用於scheduler
步驟11：nova-conductor發送RPC給nova-scheduler
3、nova-scheduler
選擇一個物理機來建立虛擬機，咱們稱爲schedule的過程
nova scheduler的一個經典的圖以下
就是先Filter再Weighting，其實scheduler的過程在很早就參與了。
步驟13：對Host進行Filtering
Filtering主要經過兩個變量進行，request_spec和filter_properties，而這些變量在前面的步驟，都已經準備好了。
而不一樣的Filter只是利用這些信息，而後再根據從HostManager統計上來的HostState信息，選出匹配的Host。
request_spec中的第一個信息就是image的properties信息，尤爲是當你想支持多種Hypervisor的時候，Xen的image, KVM的image, Hyper-V的image各不相同，如何保證image跑在正確的Hypervisor上？在image裏面這種hypervisor_type property就很必要。
請閱讀下面的文章
http://www.cloudbase.it/filtering-glance-images-for-hyper-v/
image properties還會有min_ram, min_disk，只有內存和硬盤夠大才能夠。
Flavor裏面能夠設置extra_specs，這是一系列key-value值，在數據結構中，以instance_type變量實現，能夠在裏面輸入這個Flavor除了資源需求的其餘參數，從而在Filter的時候，可使用。
host aggregates將全部的Host分紅多個Group，固然不一樣的Group能夠根據不一樣的屬性Metadata劃分，一種是高性能和低性能。
在Openstack文檔中，這個例子很好的展現了host aggregates和Flavor extra_specs的配合使用
http://docs.openstack.org/trunk/config-reference/content/section_compute-scheduler.html
Example: Specify compute hosts with SSDs
This example configures the Compute service to enable users to request nodes that have solid-state drives (SSDs). You create a fast-io host aggregate in the nova availability zone and you add the ssd=true key-value pair to the aggregate. Then, you add the node1, and node2 compute nodes to it.
$ nova aggregate-create fast-io nova
+----+---------+-------------------+-------+----------+
| Id | Name | Availability Zone | Hosts | Metadata |
+----+---------+-------------------+-------+----------+
| 1 | fast-io | nova | | |
+----+---------+-------------------+-------+----------+
$ nova aggregate-set-metadata 1 ssd=true
+----+---------+-------------------+-------+-------------------+
| Id | Name | Availability Zone | Hosts | Metadata |
+----+---------+-------------------+-------+-------------------+
| 1 | fast-io | nova | [] | {u'ssd': u'true'} |
+----+---------+-------------------+-------+-------------------+
$ nova aggregate-add-host 1 node1
+----+---------+-------------------+-----------+-------------------+
| Id | Name | Availability Zone | Hosts | Metadata |
+----+---------+-------------------+------------+-------------------+
| 1 | fast-io | nova | [u'node1'] | {u'ssd': u'true'} |
+----+---------+-------------------+------------+-------------------+
$ nova aggregate-add-host 1 node2
+----+---------+-------------------+---------------------+-------------------+
| Id | Name | Availability Zone | Hosts | Metadata |
+----+---------+-------------------+----------------------+-------------------+
| 1 | fast-io | nova | [u'node1', u'node2'] | {u'ssd': u'true'} |
+----+---------+-------------------+----------------------+-------------------+
Use the nova flavor-create command to create the ssd.large flavor called with an ID of 6, 8 GB of RAM, 80 GB root disk, and four vCPUs.
$ nova flavor-create
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public | extra_specs |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+-------------+
| 6 | ssd.large | 8192 | 80 | 0 | | 4 | 1 | True | {} |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+-------------+ssd.large68192804
Once the flavor is created, specify one or more key-value pairs that match the key-value pairs on the host aggregates. In this case, that is the ssd=true key-value pair. Setting a key-value pair on a flavor is done using the nova flavor-key command.
$ nova flavor-key ssd.large set ssd=true
Once it is set, you should see the extra_specs property of the ssd.large flavor populated with a key of ssd and a corresponding value of true.
$ nova flavor-show ssd.large
+----------------------------+-------------------+
| Property | Value |
+----------------------------+-------------------+
| OS-FLV-DISABLED:disabled | False |
| OS-FLV-EXT-DATA:ephemeral | 0 |
| disk | 80 |
| extra_specs | {u'ssd': u'true'} |
| id | 6 |
| name | ssd.large |
| os-flavor-access:is_public | True |
| ram | 8192 |
| rxtx_factor | 1.0 |
| swap | |
| vcpus | 4 |
+----------------------------+-------------------+
Now, when a user requests an instance with the ssd.large flavor, the scheduler only considers hosts with the ssd=true key-value pair. In this example, these are node1 and node2.
另外一個做用是Xen和KVM的POOL分開，有利於XEN進行Live Migration
另外一個做用是Windows和Linux的POOL分開，由於Windows是須要收費的，而Linux大多不須要，Windows的收費是按照物理機，而非虛擬機來收費的，全部須要儘可能的將windows的虛擬機放到一個物理機上。
Filter_properties的裏面scheduler_hints是一個json，裏面能夠設置任何值，用於Filter的時候使用。
例如JsonFilter
The JsonFilter allows a user to construct a custom filter by passing a scheduler hint in JSON format. The following operators are supported:
- =
- <
- >
- in
- <=
- >=
- not
- or
- and
The filter supports the following variables:
- $free_ram_mb
- $free_disk_mb
- $total_usable_ram_mb
- $vcpus_total
- $vcpus_used
Using the nova command-line tool, use the --hint flag:
$ nova boot --image 827d564a-e636-4fc4-a376-d36f7ebe1747 --flavor 1 --hint query='[">=","$free_ram_mb",1024]' server1
With the API, use the os:scheduler_hints key:
{
"server": {
"name": "server-1",
"imageRef": "cedef40a-ed67-4d10-800e-17455edce175",
"flavorRef": "1"
},
"os:scheduler_hints": {
"query": "[>=,$free_ram_mb,1024]"
}
}
咱們能夠指定某個物理機，用下面的命令--availability-zone <zone-name>:<host-name>
步驟14：對合適的Hosts進行weighting而且排序
選出了Hosts，接下來就是進行Weighting的操做
Weighting能夠根據不少變量來，通常來講Memory和disk是最早須要知足的，CPU和network io則須要次要考慮，通常來講，對於付錢較少的Flavor，能知足memory和disk就能夠了，對於付錢較多的Flavor，則須要保證其CPU和network io.
步驟15：nova-scheduler想選出的Host發送RPC
- 1. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點
- 2. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點(3)
- 3. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點(4)
- 4. 別以爲真懂Openstack: 虛擬機創建的50個步驟和100個知識點(1)
- 5. 用OpenStack界面輕鬆建立虛擬機的你，看得懂虛擬機啓動的這24個參數麼？
- 6. 構建知識體系(3)：建立體系6個步驟
- 7. openstack建立一個虛擬機的過程
- 8. 創建虛擬機步驟
- 9. 搭建虛擬機步驟
- 10. openstack kvm 虛擬機掛載虛擬光驅的操作步驟
- 更多相關文章...
- • 第一個Hibernate程序 - Hibernate教程
- • 第一個MyBatis程序 - MyBatis教程
- • 適用於PHP初學者的學習線路和建議
- • 漫談MySQL的鎖機制
-
每一个你不满意的现在，都有一个你没有努力的曾经。
- 1. 外部其他進程嵌入到qt FindWindow獲得窗口句柄 報錯無法鏈接的外部符號 [email protected] 無法被([email protected]@[email protected]@@引用
- 2. UVa 11524 - InCircle
- 3. The Monocycle（bfs）
- 4. VEC-C滑窗
- 5. 堆排序的應用-TOPK問題
- 6. 實例演示ElasticSearch索引查詢term,match,match_phase,query_string之間的區別
- 7. 數學基礎知識 集合
- 8. amazeUI 復擇框問題解決
- 9. 揹包問題理解
- 10. 算數平均-幾何平均不等式的證明,從麥克勞林到柯西
- 1. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點
- 2. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點(3)
- 3. 別覺得真懂Openstack: 虛擬機建立的50個步驟和100個知識點(4)
- 4. 別以爲真懂Openstack: 虛擬機創建的50個步驟和100個知識點(1)
- 5. 用OpenStack界面輕鬆建立虛擬機的你，看得懂虛擬機啓動的這24個參數麼？
- 6. 構建知識體系(3)：建立體系6個步驟
- 7. openstack建立一個虛擬機的過程
- 8. 創建虛擬機步驟
- 9. 搭建虛擬機步驟
- 10. openstack kvm 虛擬機掛載虛擬光驅的操作步驟