**項目說明**前端
14個JAVA spring cloud 微服務項目java
5個Node項目node
1個Node項目VUE生成靜態頁面作前端+nginxnginx
pgsqlgit
redisgithub
rabbitmqredis
emqxspring
項目思惟導圖sql
**構建流程:**docker
1、項目軟件搭建
1,K8S搭建(參考阿良部署文檔:kubeadmin安裝單主K8S集羣)
2,jenkins搭建
https://jenkins.io/doc/book/installing/#fedora
3,Harbor搭建
https://github.com/goharbor/harbor/blob/master/docs/installation_guide.md
4,Sonarqube搭建
sonarqube檢測java項目:https://docs.sonarqube.org/display/SCAN/Analyzing+with+SonarQube+Scanner+for+Maven
sonarqube檢測node項目:https://www.npmjs.com/package/sonarqube-scanner
2、CICD系統中使用的資料
1,jenkins pipeline(JAVA服務的)
node { def mvnHome = tool 'Maven' REGISTRY = 'hb.shubing.vip/k12soft' //environment { //REGISTRY = 'hb.shubing.vip/k12soft' //} stage('Pull Code from Gitlab.') { git branch: 'test_4', credentialsId: '1', url: 'http://10.0.0.82:9999/k12soft/xxx.git' } stage('Maven Package and Sonar.') { withMaven(jdk:'JDK'){ // def JAVA_HOME = "/usr/lib/jdk1.8.0_121" sh "'${mvnHome}/bin/mvn' clean package -e -U -Dmaven.test.skip=true sonar:sonar" //sh "'${mvnHome}/bin/mvn' -f ebase-api/pom.xml clean package sonar:sonar" } } stage('Build Docker Image.') { sh "sudo docker build -t $REGISTRY/${JOB_BASE_NAME}:${BUILD_ID} ." } stage('Push Docker Image to Harbor.') { sh "sudo docker push $REGISTRY/${JOB_BASE_NAME}:${BUILD_ID}" } stage('Deploy K8S Service.') { sh "sudo ssh 'root@10.0.0.102' 'cd /root/xtcloud && sh apply-config.sh ${BUILD_ID} ${JOB_BASE_NAME}'" dingTalk accessToken: 'https://oapi.dingtalk.com/robot/send?access_token=8241e530e0f2e68f74da6b78f893e2f526db4086a88e76de7348ddda101f13xx', imageUrl: '', jenkinsUrl: '', message: " 構建& K8S發佈成功!", notifyPeople: '' } }
2,jenkins pipeline(Node服務的)
node { REGISTRY = 'hb.shubing.vip/k12soft' stage('Pull Code from Gitlab.') { git branch: 'zangyunji', credentialsId: '1', url: 'http://10.0.0.82:9999/k12soft/xxx.git' } //stage('Node Install Modules.') { // sh "source /etc/profile.d/node.sh && npm i" //} stage('Node Build and Sonar.') { sh "source /etc/profile.d/node.sh && sonar-scanner" sh "source /etc/profile.d/node.sh && npm run tsc" } stage('Build Docker Image.') { sh "sudo docker build -t $REGISTRY/${JOB_BASE_NAME}:${BUILD_ID} ." } stage('Push Docker Image to Harbor.') { sh "sudo docker push $REGISTRY/${JOB_BASE_NAME}:${BUILD_ID}" } stage('Deploy K8S Service.') { sh "sudo ssh 'root@10.0.0.102' 'cd /root/xtcloud && sh apply-config.sh ${BUILD_ID} ${JOB_BASE_NAME}'" dingTalk accessToken: 'https://oapi.dingtalk.com/robot/send?access_token=8241e530e0f2e68f74da6b78f893e2f526db4086a88e76de7348ddda101f13xx', imageUrl: '', jenkinsUrl: '', message: " 構建& K8S發佈成功!", notifyPeople: '' } }
3,dockerfile (JAVA服務的)
FROM java:8u111 MAINTAINER gongshubing@weds.com.cn # 定義變量 ENV WORK_DIR /opt ENV LOG_DIR /data/logs EXPOSE 8086 # 從主機 copy 到容器裏面 COPY target/bepf_archives.jar $WORK_DIR WORKDIR $WORK_DIR ENTRYPOINT ["sh", "-c"] CMD ["java -server -Dspring.profiles.active=ops -Xmx512m -Xms256m -Xmn256m -XX:+UseG1GC -XX:+DisableExplicitGC -Duser.timezone=GMT+8 -jar *.jar > /dev/null" ]
4,dockerfile(NODE服務的)
FROM node:10.15.3 MAINTAINER gongshubing@weds.com.cn # 定義變量 ENV WORK_DIR /opt ENV LOG_DIR /data/logs ENV EGG_SERVER_ENV ops EXPOSE 8086 # 從主機 copy 到容器裏面 COPY ./ $WORK_DIR/ RUN sed -i 's/\-\-daemon//g' $WORK_DIR/package.json WORKDIR $WORK_DIR ENTRYPOINT ["sh", "-c"] CMD ["npm start"]
5,K8S 編排yaml文件(全部項目編排文件同樣,不一樣之處只有鏡像URL/IP/PORT):pod中的日誌文件寫入nfs
# deployment --- apiVersion: apps/v1 kind: Deployment metadata: name: xtcloud-appgateway-deployment labels: app: xtcloud-appgateway spec: replicas: 1 selector: matchLabels: app: xtcloud-appgateway template: metadata: labels: app: xtcloud-appgateway spec: containers: - name: xtcloud-appgateway image: hb.shubing.vip/k12soft/xtcloud-appgateway:latest ports: - containerPort: 8097 volumeMounts: - name: xtcloud-logs-persistent-storage mountPath: /data/logs volumes: - name: xtcloud-logs-persistent-storage nfs: path: /nfs server: 10.0.60.67 imagePullSecrets: - name: weds-harbor-secret # service --- kind: Service apiVersion: v1 metadata: name: xtcloud-appgateway-service spec: clusterIP: 192.168.1.15 selector: app: xtcloud-appgateway ports: - protocol: TCP port: 8097 targetPort: 8097
6,jenkins調用編排K8s腳本
#!/bin/bash TAG=$1 JOB_NAME=$2 #sed "s/latest/$TAG/" ${JOB_NAME}.yml | kubectl apply -f - sed "s/latest/$TAG/" ${JOB_NAME}.yml | kubectl replace --force -f -
2、效果圖