【云计算】ansible安装部署openstack平台（很全！亲测有效）

ansible安装部署openstack平台

1. 规划节点

Ansible服务的节点规划，见表2。

表2 规划节点

IP	主机名	节点
172.128.11.33	ansible	Ansible节点
172.128.11.39	controller	Controller控制节点
172.128.11.21	compute	Compute计算节点
172.128.11.22		桌面化测试节点

2. 基础准备

现平台已提供三台云主机进行实验，云主机镜像使用提供的CentOS_7.9.qcow2镜像，云主机类型均为4vcpu、12G内存，40G磁盘+20G临时磁盘，另平台还提供了一台桌面化测试节点，用于访问OpenStack云平台。节点规划表中的IP地址为作者的IP地址，在进行实操案例的时候，按照自己的环境规划网络与IP地址（虚拟机需要使用两块网卡）。Ansible节点安装好Ansible服务。然后做好Ansible节点对Controller和Compute节点的无秘钥访问操作。

案例实施

1. 环境准备

该实战案例为使用Ansible工具部署一个单控制单计算的OpenStack平台。

（1）配置IP并连接

连接三台云主机，并修改主机名分别为ansible、controller、compute。修改完成后刷新页面或者执行bash命令，以生效新主机名。

[root@localhost opt]# hostnamectl set-hostname ansible[root@localhost opt]# hostnamectl set-hostname controller[root@localhost opt]# hostnamectl set-hostname compute

需要使用fdisk /dev/vdb命令在第compute节点进行分区，三个大小为6G的分区。

[root@compute ~]# fdisk /dev/vdbWelcome to fdisk (util-linux 2.23.2).Changes will remain in memory only, until you decide to write them.Be careful before using the write command.Device does not contain a recognized partition tableBuilding a new DOS disklabel with disk identifier 0x0ae2cbd1.Command (m for help): pDisk /dev/vdb: 21.5 GB, 21474836480 bytes, 41943040 sectorsUnits = sectors of 1 * 512 = 512 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk label type: dosDisk identifier: 0x0ae2cbd1   Device Boot      Start         End      Blocks   Id  SystemCommand (m for help): nPartition type:   p   primary (0 primary, 0 extended, 4 free)   e   extendedSelect (default p): pPartition number (1-4, default 1): First sector (2048-41943039, default 2048): Using default value 2048Last sector, +sectors or +size{K,M,G} (2048-41943039, default 41943039): +6GPartition 1 of type Linux and of size 6 GiB is setCommand (m for help): nPartition type:   p   primary (1 primary, 0 extended, 3 free)   e   extendedSelect (default p): pPartition number (2-4, default 2): First sector (12584960-41943039, default 12584960): Using default value 12584960Last sector, +sectors or +size{K,M,G} (12584960-41943039, default 41943039): +6GPartition 2 of type Linux and of size 6 GiB is setCommand (m for help): nPartition type:   p   primary (2 primary, 0 extended, 2 free)   e   extendedSelect (default p): pPartition number (3,4, default 3): First sector (25167872-41943039, default 25167872): Using default value 25167872Last sector, +sectors or +size{K,M,G} (25167872-41943039, default 41943039): +6GPartition 3 of type Linux and of size 6 GiB is setCommand (m for help): pDisk /dev/vdb: 21.5 GB, 21474836480 bytes, 41943040 sectorsUnits = sectors of 1 * 512 = 512 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk label type: dosDisk identifier: 0x0ae2cbd1   Device Boot      Start         End      Blocks   Id  System/dev/vdb1            2048    12584959     6291456   83  Linux/dev/vdb2        12584960    25167871     6291456   83  Linux/dev/vdb3        25167872    37750783     6291456   83  LinuxCommand (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.[root@compute ~]# lsblk NAME   MAJ:MIN RM SIZE RO TYPE MOUNTPOINTvda    253:0    0  40G  0 disk └─vda1 253:1    0  40G  0 part /vdb    253:16   0  20G  0 disk ├─vdb1 253:17   0   6G  0 part ├─vdb2 253:18   0   6G  0 part └─vdb3 253:19   0   6G  0 part vdc    253:32   0   1M  0 disk

（2）Ansible安装FTP、Ansible服务

在Ansible节点下载CentOS-7-x86_64-DVD-2009.iso、chinaskills_cloud_iaas_v2.0.1.iso、openstack_ansible_train.tar.gz、ansible.tar.gz软件包，配置本地镜像源，安装Ansible服务。把Ansible节点的防火墙和SELinux关闭。

[root@ansible ~]# curl -O #下载地址，可以本地上传[root@ansible ~]# curl -O #下载地址，可以本地上传[root@ansible ~]# curl -O #下载地址，可以本地上传[root@ansible ~]# curl -O #下载地址，可以本地上传[root@ansible ~]# mkdir /opt/{centos,iaas}[root@ansible ~]# mount -o loop CentOS-7-x86_64-DVD-2009.iso /opt/centos/[root@ansible ~]# mount -o loop chinaskills_cloud_iaas_v2.0.1.iso /opt/iaas/[root@ansible ~]# tar -zxvf ansible.tar.gz -C /opt/[root@ansible ~]# mv /etc/yum.repos.d/* /home/[root@ansible ~]# vi /etc/yum.repos.d/ansible.repo[ansible]name=ansiblebaseurl=file:///opt/ansiblegpgcheck=0enabled=1[centos]name=centosbaseurl=file:///opt/centosgpgcheck=0enabled=1[root@ansible ~]# yum install vsftpd -y[root@ansible ~]# echo "anon_root=/opt" >> /etc/vsftpd/vsftpd.conf[root@ansible ~]# systemctl  restart vsftpd[root@ansible ~]# setenforce 0[root@ansible ~]# yum install ansible -y

（3）配置无秘钥登录

配置Ansible节点无秘钥登录Controller和Compute节点。配置完无秘钥登录后，使用Ansible节点SSH连接测试。（若云主机已是无秘钥访问的，则不用配置无秘钥）

[root@ansible ~]# ssh-keygen Generating public/private rsa key pair.Enter file in which to save the key (/root/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /root/.ssh/id_rsa.Your public key has been saved in /root/.ssh/id_rsa.pub.The key fingerprint is:SHA256:zOl0NDjrN697yRTmHmLXYpj2n4ijS+yxHUS3OhRG3ew root@ansibleThe key's randomart image is:+---[RSA 2048]----+|          .. o   ||         o  . o  ||        o * ..   ||       o B +o.E  ||        S +=.o   ||       = +*.B .  ||        *o*O +   ||       o =.**. . ||        =o==o.o  |+----[SHA256]-----+[root@ansible ~]# scp -p .ssh/id_rsa.pub 172.128.11.21:/root/.ssh/authorized_keys     //输入密码Abc@1234[root@ansible ~]# scp -p .ssh/id_rsa.pub 172.128.11.20:/root/.ssh/authorized_keys     //输入密码Abc@1234

2. 目录结构

（1）项目目录

首先在/opt目录下创建一个项目目录openstack_ansible，命令如下：

[root@ansible ~]# mkdir /opt/openstack_ansible

（2）创建角色

在创建roles角色目录之前，考虑将OpenStack云平台的安装步骤拆分为多个roles执行，这样的话，Playbook易于编写和读懂。

安装私有云平台，使用init（基础环境）、mariadb（数据库）、keystone（认证服务）、glance（镜像服务）、placement、nova-controller（计算服务）、nova-compute（计算服务）、neutron-controller（网络服务）、neutron-compute（网络服务）、dashboard（界面服务）、cinder-controller（块存储服务）、cinder-compute（块存储服务）、swift-controller（对象存储服务）、swift-compute（对象存储服务）、heat（编排服务）这些roles来完成。下面创建这些roles和相应的项目目录，具体命令如下：

[root@ansible ~]# mkdir -p /opt/openstack_ansible/roles/{init,mariadb,keystone,glance,nova-controller,nova-compute,neutron-controller,neutron-compute,dashboard,cinder-controller,cinder-compute,swift-controller,swift-compute,heat}/{tasks,files,templates,meta,handlers,vars}

在每个角色目录下面都有一样的目录，这些目录中的task目录一般是一定会用到的，其他的目录视情况而定来使用。

（3）创建group_vars目录

在项目目录/opt/openstack_ansible下创建group_vars目录，并在该目录下创建all文件，该目录用来存放变量声明文件all。命令如下：

[root@ansible ~]# cd /opt/openstack_ansible/[root@ansible openstack_ansible]# mkdir group_vars[root@ansible openstack_ansible]# cd group_vars/[root@ansible group_vars]# touch all

（4）创建安装入口文件

进入/opt/openstack_ansible目录，创建“install_openstack.yaml”文件，该文件是安装动作的入口文件。命令如下：

[root@ansible openstack_ansible]#cd /opt/openstack_ansible[root@ansible openstack_ansible]# touch install_openstack.yaml[root@ansible openstack_ansible]# lltotal 0drwxr-xr-x. 2 root root 17 Aug 26 21:31 group_vars-rw-r--r--. 1 root root  0 Aug 26 21:33 install_openstack.yamldrwxr-xr-x. 10 root root 114 Aug 26 21:18 roles

到目前为止，ansible的目录结构与文件创建完毕。接下来对每一个role角色进行剧本的编写。

3. 编写Playbook剧本

配置完成后，如图9所示：

图9 配置完成结果

（1）init角色

该角色执行的任务是用来部署Controller节点和Compute的基础环境，包括配置Yum源，安装iaas-xiandian脚本，安装iaas-pre-host脚本。在roles/init/tasks目录下，创建main.yaml文件，按“i”建进入编辑模式进行配置，按ESC键输入:wq保存退出，文件的内容如下：

[root@ansible ~]# vi /opt/openstack_ansible/roles/init/tasks/main.yaml- name: move repos  shell: mv /etc/yum.repos.d/* /media- name: create local.repo  copy: src=local.repo dest=/etc/yum.repos.d/- name: install openstack-iaas  yum: name=openstack-iaas state=present- name: openrc.sh  template: src=openrc.sh.j2 dest=/etc/openstack/openrc.sh- name: install pre-host  shell: iaas-pre-host.sh

该剧本用到了copy和template模块，copy模块使用的文件及镜像包，放入tasks同级目录的files目录下；template模块使用的Jinja2文件，放入tasks同级目录的templates目录下。

在该init角色剧本中，创建local.repo文件到init/files目录下，创建openrc.sh.j2文件至init/templates目录下。下面贴出local.repo和host.j2的文件内容：

local.repo内容：

[root@ansible opt]# vi /opt/openstack_ansible/roles/init/files/local.repo[centos]name=centosbaseurl=ftp://172.128.11.33/centosgpgcheck=0enabled=1[iaas]name=iaasbaseurl=ftp://172.128.11.33/iaas/iaas-repogpgcheck=0enabled=1

openrc.sh.j2内容如下：

[root@ansible opt]# vi /opt/openstack_ansible/roles/init/templates/openrc.sh.j2#--------------------system Config--------------------###Controller Server Manager IP. example:x.x.x.xHOST_IP={{controller_ip}}#Controller HOST Password. example:000000 HOST_PASS={{PASSWD}}#Controller Server hostname. example:controllerHOST_NAME={{controller_name}}#Compute Node Manager IP. example:x.x.x.xHOST_IP_NODE={{compute_ip}}#Compute HOST Password. example:000000 HOST_PASS_NODE={{PASSWD}}#Compute Node hostname. example:computeHOST_NAME_NODE={{compute_name}}#--------------------Chrony Config-------------------###Controller network segment IP.  example:x.x.0.0/16(x.x.x.0/24)network_segment_IP={{network_segment_IP}}/24#--------------------Rabbit Config ------------------###user for rabbit. example:openstackRABBIT_USER=openstack#Password for rabbit user .example:000000RABBIT_PASS={{PASSWD}}#--------------------MySQL Config---------------------###Password for MySQL root user . exmaple:000000DB_PASS={{PASSWD}}#--------------------Keystone Config------------------###Password for Keystore admin user. exmaple:000000DOMAIN_NAME=demoADMIN_PASS={{PASSWD}}DEMO_PASS={{PASSWD}}#Password for Mysql keystore user. exmaple:000000KEYSTONE_DBPASS={{PASSWD}}#--------------------Glance Config--------------------###Password for Mysql glance user. exmaple:000000GLANCE_DBPASS={{PASSWD}}#Password for Keystore glance user. exmaple:000000GLANCE_PASS={{PASSWD}}#--------------------Placement Config----------------------###Password for Mysql placement user. exmaple:000000PLACEMENT_DBPASS={{PASSWD}}#Password for Keystore placement user. exmaple:000000PLACEMENT_PASS={{PASSWD}}#--------------------Nova Config----------------------###Password for Mysql nova user. exmaple:000000NOVA_DBPASS={{PASSWD}}#Password for Keystore nova user. exmaple:000000NOVA_PASS={{PASSWD}}#--------------------Neutron Config-------------------###Password for Mysql neutron user. exmaple:000000NEUTRON_DBPASS={{PASSWD}}#Password for Keystore neutron user. exmaple:000000NEUTRON_PASS={{PASSWD}}#metadata secret for neutron. exmaple:000000METADATA_SECRET={{PASSWD}}#External Network Interface. example:eth1INTERFACE_NAME={{External_Network}}#External Network The Physical Adapter. example:providerPhysical_NAME={{Physical_NAME}}#First Vlan ID in VLAN RANGE for VLAN Network. exmaple:101minvlan=1#Last Vlan ID in VLAN RANGE for VLAN Network. example:200maxvlan=1000#--------------------Cinder Config--------------------###Password for Mysql cinder user. exmaple:000000CINDER_DBPASS={{PASSWD}}#Password for Keystore cinder user. exmaple:000000CINDER_PASS={{PASSWD}}#Cinder Block Disk. example:md126p3BLOCK_DISK={{cinder_disk}}#--------------------Swift Config---------------------###Password for Keystore swift user. exmaple:000000SWIFT_PASS={{PASSWD}}#The NODE Object Disk for Swift. example:md126p4.OBJECT_DISK={{swift_disk}}#The NODE IP for Swift Storage Network. example:x.x.x.x.STORAGE_LOCAL_NET_IP={{STORAGE_LOCAL_NET_IP}}#--------------------Trove Config----------------------###Password for Mysql trove user. exmaple:000000TROVE_DBPASS={{PASSWD}}#Password for Keystore trove user. exmaple:000000TROVE_PASS={{PASSWD}}#--------------------Heat Config----------------------###Password for Mysql heat user. exmaple:000000HEAT_DBPASS={{PASSWD}}#Password for Keystore heat user. exmaple:000000HEAT_PASS={{PASSWD}}#--------------------Ceilometer Config----------------###Password for Gnocchi ceilometer user. exmaple:000000CEILOMETER_DBPASS={{PASSWD}}#Password for Keystore ceilometer user. exmaple:000000CEILOMETER_PASS={{PASSWD}}#--------------------AODH Config----------------###Password for Mysql AODH user. exmaple:000000AODH_DBPASS={{PASSWD}}#Password for Keystore AODH user. exmaple:000000AODH_PASS={{PASSWD}}#--------------------ZUN Config----------------###Password for Mysql ZUN user. exmaple:000000ZUN_DBPASS={{PASSWD}}#Password for Keystore ZUN user. exmaple:000000ZUN_PASS={{PASSWD}}#Password for Keystore KURYR user. exmaple:000000KURYR_PASS={{PASSWD}}#--------------------OCTAVIA Config----------------###Password for Mysql OCTAVIA user. exmaple:000000OCTAVIA_DBPASS={{PASSWD}}#Password for Keystore OCTAVIA user. exmaple:000000OCTAVIA_PASS={{PASSWD}}#--------------------Manila Config----------------###Password for Mysql Manila user. exmaple:000000MANILA_DBPASS={{PASSWD}}#Password for Keystore Manila user. exmaple:000000MANILA_PASS={{PASSWD}}#The NODE Object Disk for Manila. example:md126p5.SHARE_DISK={{manila_disk}}#--------------------Cloudkitty Config----------------###Password for Mysql Cloudkitty user. exmaple:000000CLOUDKITTY_DBPASS={{PASSWD}}#Password for Keystore Cloudkitty user. exmaple:000000CLOUDKITTY_PASS={{PASSWD}}#--------------------Barbican Config----------------###Password for Mysql Barbican user. exmaple:000000BARBICAN_DBPASS={{PASSWD}}#Password for Keystore Barbican user. exmaple:000000BARBICAN_PASS={{PASSWD}}

因为设置的变量，所以需要在/opt/openstack_ansible/group_vars/all中声明变量，all文件内容如下：

[root@ansible opt]# vi /opt/openstack_ansible/group_vars/all controller_ip: 172.128.11.21controller_name: controllercompute_ip: 172.128.11.20compute_name: computePASSWD: 'Abc@1234'cinder_disk: vdb1swift_disk: vdb2manila_disk: vdb3network_segment_IP: 172.128.11.0External_Network: eth1Physical_NAME: providerSTORAGE_LOCAL_NET_IP: 172.128.11.20

至此，init角色剧本编写完成。

（2）其他角色

其他角色的作用是执行安装OpenStack的脚本，可以自行参考提供的案例文档，其他main.yaml文件可使用提供的软件包openstack_ansible_train.tar.gz，替换之后需要更改以下文件：

[root@ansible openstack_ansible]# tar -zxvf /root/openstack_ansible_train.tar.gz -C /root/[root@ansible openstack_ansible]# cp -rvf /root/openstack_ansible_train/* /opt/openstack_ansible/cp: overwrite ‘/opt/openstack_ansible/group_vars/all’? ncp: overwrite ‘/opt/openstack_ansible/install_openstack.yaml’? n‘/root/openstack_ansible_train/roles/cinder-compute/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/cinder-compute/tasks/main.yaml’‘/root/openstack_ansible_train/roles/cinder-controller/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/cinder-controller/tasks/main.yaml’‘/root/openstack_ansible_train/roles/dashboard/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/dashboard/tasks/main.yaml’‘/root/openstack_ansible_train/roles/glance/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/glance/tasks/main.yaml’‘/root/openstack_ansible_train/roles/heat/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/heat/tasks/main.yaml’cp: overwrite ‘/opt/openstack_ansible/roles/init/files/local.repo’? ncp: overwrite ‘/opt/openstack_ansible/roles/init/tasks/main.yaml’? ncp: overwrite ‘/opt/openstack_ansible/roles/init/templates/openrc.sh.j2’? n‘/root/openstack_ansible_train/roles/keystone/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/keystone/tasks/main.yaml’‘/root/openstack_ansible_train/roles/mariadb/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/mariadb/tasks/main.yaml’‘/root/openstack_ansible_train/roles/neutron-compute/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/neutron-compute/tasks/main.yaml’‘/root/openstack_ansible_train/roles/neutron-controller/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/neutron-controller/tasks/main.yaml’‘/root/openstack_ansible_train/roles/nova-compute/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/nova-compute/tasks/main.yaml’‘/root/openstack_ansible_train/roles/nova-controller/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/nova-controller/tasks/main.yaml’‘/root/openstack_ansible_train/roles/swift-compute/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/swift-compute/tasks/main.yaml’‘/root/openstack_ansible_train/roles/swift-controller/tasks/main.yaml’ -> ‘/opt/openstack_ansible/roles/swift-controller/tasks/main.yaml’[root@ansible opt]# cat /opt/openstack_ansible/roles/init/files/local.repo[centos]name=centosbaseurl=ftp://172.128.11.33/centosgpgcheck=0enabled=1[iaas]name=iaasbaseurl=ftp://172.128.11.33/iaas/iaas-repogpgcheck=0enabled=1[root@ansible opt]# cat /opt/openstack_ansible/group_vars/allcontroller_ip: 172.128.11.21controller_name: controllercompute_ip: 172.128.11.20compute_name: computePASSWD: 'Abc@1234'cinder_disk: vdb1swift_disk: vdb2manila_disk: vdb3network_segment_IP: 172.128.11.0External_Network: eth1Physical_NAME: providerSTORAGE_LOCAL_NET_IP: 172.128.11.20

4. 执行Playbook

在执行剧本之前，还有一些工作需要完成，具体任务如下：

（1）修改hosts文件

此处需要修改的hosts文件并不只是/etc/hosts，还有一个/etc/ansible/hosts文件，编辑/etc/ansible/hosts，在文件的最后添加需要执行剧本的目标主机组，添加的内容如下：

[root@ansible ~]# vi /etc/ansible/hosts## db-[99:101]-node.example.com[controller]172.128.11.21[compute]172.128.11.20

编辑/etc/hosts文件，添加IP与主机名的映射，如下所示：

[root@ansible ~]# vi /etc/hosts172.128.11.21 controller172.128.11.20 compute

（2）编辑剧本入口文件

install_openstack.yaml文件为执行剧本的入口文件，需要将调用roles的顺序及哪些主机调用哪些roles在这个文件中体现出来，install_openstack.yaml文件的具体内容如下（如果以选择替换软件包里的内容无需修改一下内容）：

[root@ansible ~]# vi /opt/openstack_ansible/install_openstack.yaml┅  \三短横请手打- hosts: controller  remote_user: root   roles:     - init    - mariadb    - keystone    - glance    - nova-controller    - neutron-controller    - dashboard    - cinder-controller    - swift-controller    - heat- hosts: compute  remote_user: root    roles:    - init    - nova-compute    - neutron-compute    - cinder-compute    - swift-compute

（3）执行剧本

当所有准备工作都完成之后，使用ansible-playbook命令执行剧本，首先使用–syntax-check参数检测脚本的语法，命令如下：

[root@ansible opestack_ansible]# ansible-playbook install_openstack.yaml --syntax-check playbook: install_openstack.yaml

直接返回文件名，表示脚本没有语法错误。执行剧本，命令如下（注意需要写完所有main.yaml文件才会完整安装）：

[root@ansible openstack_ansible]# ansible-playbook install_openstack.yaml PLAY RECAP ****************************************************************************************************************************************172.128.11.21              : ok=10   changed=9    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   172.128.11.39              : ok=16   changed=14   unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   ......

在等待一段时间之后，剧本执行完毕，若没有报错，访问Controller节点的IP地址/dashboard，可以访问OpenStack界面。访问OpenStack界面如图所示：

图OpenStack登录界面

至此，使用Ansible一键部署OpenStack完成。关于更多组件的安装，用户可以自行编写role执行安装。