Logging 설치 가이드

1. 문서 개요

1.1. 목적

본 문서는 Logging 서비스 Release를 Bosh2.0을 이용하여 설치 하는 방법을 기술하였다.

1.2. 범위

설치 범위는 Logging 서비스 Release를 검증하기 위한 기본 설치를 기준으로 작성하였다.

1.3. 시스템 구성

본 장에서는 Logging 서비스의 시스템 구성에 대해 기술하였다. Logging 서비스 시스템은 Router, Collector, Queue, Parser, Elasticsearch, Visualization의 최소사항을 구성하였다.
VM명
인스턴스 수
vCPU수
메모리(GB)
디스크(GB)
Router
1
1
1
Root 8G
Collector
1
1
2
Root 10G
Queue
1
1
2
Root 10G + Persistent disk 10G
Parser
N
1
2
Root 10G
Elasticsearch Master
1
1
2
Root 10G + Persistent disk 10G
Elasticsearch Data
N
2
4
Root 20G + Persistent disk 30G
Visualization
1
1
2
Root 10G
maintenance
1
1
1
Root 8G

1.4. 참고자료

2. Logging 서비스 설치

2.1. 설치 전 준비 사항

본 설치 가이드는 Linux 환경에서 설치하는 것을 기준으로 하였다. Logging 서비스 설치를 위해서는 먼저 BOSH CLI v2 가 설치 되어 있어야 하고 BOSH 에 로그인 되어 있어야 한다. BOSH CLI v2 가 설치 되어 있지 않을 경우 먼저 BOSH2.0 설치 가이드 문서를 참고 하여 BOSH CLI v2를 설치해야 한다.
※ 설치 전 확인 사항
uaac client에 "firehose-to-syslog"가 등록되어 있는지 확인 하여, 등록되어 있는 경우에는 "authorities"를 확인하여 "cloud_controller.admin" 권한을 부여한다.
1
# endpoint 설정
2
$ uaac target https://uaa.<DOMAIN> --skip-ssl-validation
3
4
# target 확인
5
$ uaac target
6
Target: https://uaa.<DOMAIN>
7
Context: uaa_admin, from client uaa_admin
8
9
# uaac 로그인
10
$ uaac token client get <UAA_ADMIN_CLIENT_ID> -s <UAA_ADMIN_CLIENT_SECRET>
11
12
# "firehose-to-syslog" uaac client 확인
13
$ uaac client get firehose-to-syslog
14
scope: cloud_controller.admin_read_only cloud_controller.global_auditor openid routing.router_groups.write network.write scim.read cloud_controller.admin uaa.user cloud_controller.read
15
password.write routing.router_groups.read cloud_controller.write network.admin doppler.firehose scim.write
16
client_id: firehose-to-syslog
17
resource_ids: none
18
authorized_grant_types: client_credentials
19
autoapprove:
20
authorities: uaa.none doppler.firehose >>>>>>>> cloud_controller.admin 권한 여부 확인
21
lastmodified: 1552530293656
22
23
# "firehose-to-syslog" uaac client 변경
24
$ uaac client update firehose-to-syslog --authorities "doppler.firehose, uaa.none, cloud_controller.admin"
25
26
# "firehose-to-syslog" uaac client 확인
27
$ uaac client get firehose-to-syslog
28
scope: cloud_controller.admin_read_only cloud_controller.global_auditor openid routing.router_groups.write network.write scim.read cloud_controller.admin uaa.user cloud_controller.read
29
password.write routing.router_groups.read cloud_controller.write network.admin doppler.firehose scim.write
30
client_id: firehose-to-syslog
31
resource_ids: none
32
authorized_grant_types: client_credentials
33
autoapprove:
34
authorities: uaa.none doppler.firehose cloud_controller.admin
35
lastmodified: 1552530293656
Copied!

2.1.1 Logging 서비스 설치 파일 다운로드

Logging 서비스 설치에 필요한 Deployment 및 릴리즈 파일을 다운로드 받아 서비스 설치 작업 경로로 위치시킨다.
  • 설치 파일 다운로드 위치 : https://paas-ta.kr/download/package = Deployment : paasta-logging-service-2.0 = 릴리즈 파일 : paasta-logging-service-release.tgz
  • 설치 작업 경로 생성 및 파일 다운로드
1
# Deployment 다운로드 파일 위치 경로 생성
2
$ mkdir -p ~/workspace/paasta-4.0/deployment/service-deployment
3
4
# Deployment 다운로드(paasta-logging-service-2.0) 및 파일 경로 확인
5
$ ls ~/workspace/paasta-4.0/deployment/service-deployment/paasta-logging-service-2.0
6
logging-service-deploy.sh remove-logging-service-deployment.sh manifests
7
8
# 릴리즈 다운로드 파일 위치 경로 생성
9
$ mkdir -p ~/workspace/paasta-4.0/release/service
10
11
# 릴리즈 파일 다운로드(paasta-logging-service-release.tgz) 및 파일 경로 확인
12
$ ls ~/workspace/paasta-4.0/release/service
13
paasta-logging-service-release.tgz
Copied!

2.2.2 Stemcell 다운로드

Logging 서비스 설치에 필요한 을 확인하여 존재하지 않을 경우 BOSH 설치 가이드 문서를 참고 하여 Stemcell을 업로드 한다. (Logging 서비스는 Stemcell 3445.2/3468.51 버전을 사용, PaaSTA-Stemcell.zip)
1
# Stemcell 목록 확인
2
$ bosh -e micro-bosh stemcells
3
Using environment '10.30.40.111' as user 'admin' (openid, bosh.admin)
4
5
Name Version OS CPI CID
6
bosh-vsphere-esxi-ubuntu-trusty-go_agent 3586.26* ubuntu-trusty - sc-109fbdb0-f663-49e8-9c30-8dbdd2e5b9b9
7
~ 3468.51* ubuntu-trusty - sc-bd8fadf2-92f2-495b-b172-d571a388abf5
8
~ 3445.2* ubuntu-trusty - sc-025c70b5-7d6e-4ba3-a12b-7e71c33dad24
9
~ 3309* ubuntu-trusty - sc-22429dba-e5cc-4469-ab3a-882091573277
10
11
(*) Currently deployed
12
13
4 stemcells
14
15
Succeeded
Copied!

2.2. Logging 서비스 릴리즈 업로드

  • 릴리즈 목록을 확인하여 Logging 서비스 릴리즈(paasta-logging-service-release)가 업로드 되어 있지 않은 것을 확인한다.
1
# 릴리즈 목록 확인
2
$ bosh -e micro-bosh releases
3
4
Using environment '10.30.40.111' as user 'admin' (openid, bosh.admin)
5
6
Name Version Commit Hash
7
paas-ta-portal-release 2.1* 3a5494a9+
8
9
(*) Currently deployed
10
(+) Uncommitted changes
11
12
1 releases
13
14
Succeeded
Copied!
  • Logging 서비스 릴리즈 파일을 업로드한다.
1
# 릴리즈 파일 업로드
2
$ bosh -e micro-bosh upload-release ~/workspace/paasta-4.0/release/service/paasta-logging-service-release.tgz
3
Using environment '10.30.40.111' as client 'admin'
4
5
######################################################### 100.00% 92.74 MiB/s 0s
6
Task 60178
7
8
Task 60178 | 09:21:15 | Extracting release: Extracting release (00:00:01)
9
Task 60178 | 09:21:16 | Verifying manifest: Verifying manifest (00:00:00)
10
Task 60178 | 09:21:17 | Resolving package dependencies: Resolving package dependencies (00:00:00)
11
Task 60178 | 09:21:17 | Creating new packages: cerebro/278996853981243e3b921d18e255d55d998dcc7f (00:00:05)
12
Task 60178 | 09:21:22 | Creating new packages: curator/27ee549a38ebcef009bb0e63ac716d544dc8caa2 (00:00:01)
13
Task 60178 | 09:21:23 | Creating new packages: elasticsearch/cb154811849156850a88023c3dd1fd46698a09da (00:00:02)
14
Task 60178 | 09:21:25 | Creating new packages: firehose-to-syslog/57480e93d19cefa2f26dfa787419d378b2104b13 (00:00:00)
15
Task 60178 | 09:21:25 | Creating new packages: golang/fb3379fa5b3afb2e6e515657a33f2145ba4bd076 (00:00:08)
16
Task 60178 | 09:21:33 | Creating new packages: haproxy/1d59aa8ae61da532ade4e9f5129428bbc101be64 (00:00:00)
17
Task 60178 | 09:21:33 | Creating new packages: java8/ae41eecf1175fb16c678940d4d6e31af10405b6e (00:00:05)
18
Task 60178 | 09:21:38 | Creating new packages: kibana/0761dbc496f63511e66971283aca8ce6a329184d (00:00:00)
19
Task 60178 | 09:21:38 | Creating new packages: logsearch-config/4cd3b3efcb7ea642badd77ff3b5189ae1d324734 (00:00:00)
20
Task 60178 | 09:21:38 | Creating new packages: logstash/a5bc4ac7fb0f561db9b9e03833510b866236af8e (00:00:09)
21
Task 60178 | 09:21:47 | Creating new packages: nats_to_syslog/f3267716fa78721e65fc1b804684dd6c4bd3de9d (00:00:00)
22
Task 60178 | 09:21:47 | Creating new packages: python3/2a00051b1a0f02d70453c75e9036d41cb960ebfc (00:00:00)
23
Task 60178 | 09:21:47 | Creating new packages: redis/ff3e314387f91116dd8906cd656ecd0476b4c7b5 (00:00:01)
24
Task 60178 | 09:21:48 | Creating new packages: ruby2.3/613589acad7ddafc74fd12316e3d9cf5346f612e (00:00:00)
25
Task 60178 | 09:21:48 | Creating new jobs: archiver/5a7d857eb183097dcc7ea30625833ef3954f3752 (00:00:00)
26
Task 60178 | 09:21:48 | Creating new jobs: cerebro/299ff8638f7a21bc91724c0178a794304b54677e (00:00:00)
27
Task 60178 | 09:21:48 | Creating new jobs: curator/5c1a54bf651dbe118cd5b30699ae632539f60f5c (00:00:00)
28
Task 60178 | 09:21:48 | Creating new jobs: elasticsearch/7ad0042f72431c91b792dd14ca73825000f19e5c (00:00:00)
29
Task 60178 | 09:21:48 | Creating new jobs: elasticsearch_config/26db3d1920ec89bc31abb89213ec5b22bf0d7d53 (00:00:01)
30
Task 60178 | 09:21:49 | Creating new jobs: enable_shard_allocation/73b25c5ebb749d4599c2b7301d7955a4ba825ed5 (00:00:00
31
Task 60178 | 09:21:49 | Creating new jobs: haproxy/a4457814c0d587a54fcdd98b4a589971beb76dae (00:00:00)
32
Task 60178 | 09:21:49 | Creating new jobs: ingestor_archiver/8f02f568ef4642da6ea22288249e08c55623b42e (00:00:00)
33
Task 60178 | 09:21:49 | Creating new jobs: ingestor_cloudfoundry-firehose/5d99bea992d0116b0c746c3ddb96e6522e227492 (0
34
Task 60178 | 09:21:49 | Creating new jobs: ingestor_syslog/599509fad62f7a665d9403f6260bf7658b1d3271 (00:00:00)
35
Task 60178 | 09:21:49 | Creating new jobs: kibana/3b9fe3747baf507022c19c68b73c2ec65cf938d2 (00:00:00)
36
Task 60178 | 09:21:49 | Creating new jobs: nats_to_syslog/c7c59d33f131fb3c5f8e91d87512f7499d9ca176 (00:00:00)
37
Task 60178 | 09:21:49 | Creating new jobs: parser/c7c15e32ef7a09d68b76f836b7d3925ba3e7f8de (00:00:00)
38
Task 60178 | 09:21:49 | Creating new jobs: queue/fdad522d4253adbe4cb15c4739a9801ff2f69e17 (00:00:00)
39
Task 60178 | 09:21:49 | Creating new jobs: smoke_tests/71cc53e522099218784e2bb5b703e971417e8fc6 (00:00:01)
40
Task 60178 | 09:21:50 | Creating new jobs: syslog_forwarder/96d6bb20fbd03bcbe7b5019bc5dd3347d0ebd3e7 (00:00:00)
41
Task 60178 | 09:21:50 | Release has been created: paasta-logging-service-release/1.0 (00:00:00)
42
43
Task 60178 Started Fri Nov 2 09:21:15 UTC 2018
44
Task 60178 Finished Fri Nov 2 09:21:50 UTC 2018
45
Task 60178 Duration 00:00:35
46
Task 60178 done
47
48
Succeeded
Copied!
  • 릴리즈 목록을 확인하여 Logging 서비스 릴리즈(paasta-logging-service-release)가 업로드 되어 있는 것을 확인한다.
1
# 릴리즈 목록 확인
2
$ bosh -e micro-bosh releases
3
Using environment '10.30.40.111' as user 'admin' (openid, bosh.admin)
4
5
Name Version Commit Hash
6
paas-ta-portal-release 2.1* 3a5494a9+
7
paasta-logging-service-release 1.0 ede7603+
8
9
(*) Currently deployed
10
(+) Uncommitted changes
11
12
2 releases
13
14
Succeeded
Copied!

2.3. Logging 서비스 Deployment 파일 수정 및 배포

BOSH Deployment manifest는 Components 요소 및 배포의 속성을 정의한 YAML 파일이다. Deployment 파일에서 사용하는 network, vm_type, disk_type 등은 Cloud config를 활용하고, 활용 방법은 BOSH 2.0 가이드를 참고한다.
  • Cloud config 설정 내용을 확인한다.
1
# Cloud config 조회
2
$ bosh -e micro-bosh cloud-config
3
Using environment '10.30.40.111' as client 'admin'
4
5
azs:
6
- cloud_properties:
7
datacenters:
8
- clusters:
9
- BD-HA:
10
resource_pool: CF_BOSH2_Pool
11
name: BD-HA
12
name: z1
13
- cloud_properties:
14
datacenters:
15
- clusters:
16
- BD-HA:
17
resource_pool: CF_BOSH2_Pool
18
name: BD-HA
19
name: z2
20
- cloud_properties:
21
datacenters:
22
- clusters:
23
- BD-HA:
24
resource_pool: CF_BOSH2_Pool
25
name: BD-HA
26
name: z3
27
- cloud_properties:
28
datacenters:
29
- clusters:
30
- BD-HA:
31
resource_pool: CF_BOSH2_Pool
32
name: BD-HA
33
name: z4
34
- cloud_properties:
35
datacenters:
36
- clusters:
37
- BD-HA:
38
resource_pool: CF_BOSH2_Pool
39
name: BD-HA
40
name: z5
41
- cloud_properties:
42
datacenters:
43
- clusters:
44
- BD-HA:
45
resource_pool: CF_BOSH2_Pool
46
name: BD-HA
47
name: z6
48
compilation:
49
az: z1
50
network: default
51
reuse_compilation_vms: true
52
vm_type: large
53
workers: 5
54
disk_types:
55
- disk_size: 1024
56
name: default
57
- disk_size: 1024
58
name: 1GB
59
- disk_size: 2048
60
name: 2GB
61
- disk_size: 4096
62
name: 4GB
63
- disk_size: 5120
64
name: 5GB
65
- disk_size: 8192
66
name: 8GB
67
- disk_size: 10240
68
name: 10GB
69
- disk_size: 20480
70
name: 20GB
71
- disk_size: 30720
72
name: 30GB
73
- disk_size: 51200
74
name: 50GB
75
- disk_size: 102400
76
name: 100GB
77
- disk_size: 1048576
78
name: 1TB
79
networks:
80
- name: default
81
subnets:
82
- azs:
83
- z1
84
- z2
85
- z3
86
- z4
87
- z5
88
- z6
89
cloud_properties:
90
name: Internal
91
dns:
92
- 8.8.8.8
93
gateway: 10.30.20.23
94
range: 10.30.0.0/16
95
reserved:
96
- 10.30.0.0 - 10.30.111.40
97
- name: public
98
subnets:
99
- azs:
100
- z1
101
- z2
102
- z3
103
- z4
104
- z5
105
- z6
106
cloud_properties:
107
name: External
108
dns:
109
- 8.8.8.8
110
gateway: 115.68.46.177
111
range: 115.68.46.176/28
112
reserved:
113
- 115.68.46.176 - 115.68.46.188
114
static:
115
- 115.68.46.189 - 115.68.46.190
116
type: manual
117
- name: service_private
118
subnets:
119
- azs:
120
- z1
121
- z2
122
- z3
123
- z4
124
- z5
125
- z6
126
cloud_properties:
127
name: Internal
128
dns:
129
- 8.8.8.8
130
gateway: 10.30.20.23
131
range: 10.30.0.0/16
132
reserved:
133
- 10.30.0.0 - 10.30.106.255
134
static:
135
- 10.30.107.1 - 10.30.107.255
136
- name: service_public
137
subnets:
138
- azs:
139
- z1
140
- z2
141
- z3
142
- z4
143
- z5
144
- z6
145
cloud_properties:
146
name: External
147
dns:
148
- 8.8.8.8
149
gateway: 115.68.47.161
150
range: 115.68.47.160/24
151
reserved:
152
- 115.68.47.161 - 115.68.47.174
153
static:
154
- 115.68.47.175 - 115.68.47.185
155
type: manual
156
- name: portal_service_public
157
subnets:
158
- azs:
159
- z1
160
- z2
161
- z3
162
- z4
163
- z5
164
- z6
165
cloud_properties:
166
name: External
167
dns:
168
- 8.8.8.8
169
gateway: 115.68.46.209
170
range: 115.68.46.208/28
171
reserved:
172
- 115.68.46.217 - 115.68.46.222
173
static:
174
- 115.68.46.214 - 115.68.46.216
175
type: manual
176
vm_extensions:
177
- cloud_properties:
178
ports:
179
- host: 3306
180
name: mysql-proxy-lb
181
- name: cf-router-network-properties
182
- name: cf-tcp-router-network-properties
183
- name: diego-ssh-proxy-network-properties
184
- name: cf-haproxy-network-properties
185
- cloud_properties:
186
disk: 51200
187
name: small-50GB
188
- cloud_properties:
189
disk: 102400
190
name: small-highmem-100GB
191
vm_types:
192
- cloud_properties:
193
cpu: 1
194
disk: 8192
195
ram: 1024
196
name: minimal
197
- cloud_properties:
198
cpu: 1
199
disk: 10240
200
ram: 2048
201
name: default
202
- cloud_properties:
203
cpu: 1
204
disk: 30720
205
ram: 4096
206
name: small
207
- cloud_properties:
208
cpu: 2
209
disk: 20480
210
ram: 4096
211
name: medium
212
- cloud_properties:
213
cpu: 2
214
disk: 20480
215
ram: 8192
216
name: medium-memory-8GB
217
- cloud_properties:
218
cpu: 4
219
disk: 20480
220
ram: 8192
221
name: large
222
- cloud_properties:
223
cpu: 8
224
disk: 20480
225
ram: 16384
226
name: xlarge
227
- cloud_properties:
228
cpu: 2
229
disk: 51200
230
ram: 4096
231
name: small-50GB
232
- cloud_properties:
233
cpu: 2
234
disk: 51200
235
ram: 4096
236
name: small-50GB-ephemeral-disk
237
- cloud_properties:
238
cpu: 4
239
disk: 102400
240
ram: 8192
241
name: small-100GB-ephemeral-disk
242
- cloud_properties:
243
cpu: 4
244
disk: 102400
245
ram: 8192
246
name: small-highmem-100GB-ephemeral-disk
247
- cloud_properties:
248
cpu: 8
249
disk: 20480
250
ram: 16384
251
name: small-highmem-16GB
252
- cloud_properties:
253
cpu: 1
254
disk: 4096
255
ram: 2048
256
name: caas_small
257
- cloud_properties:
258
cpu: 1
259
disk: 4096
260
ram: 1024
261
name: caas_small_api
262
- cloud_properties:
263
cpu: 1
264
disk: 4096
265
ram: 4096
266
name: caas_medium
267
- cloud_properties:
268
cpu: 1
269
disk: 4096
270
ram: 256
271
name: service_tiny
272
- cloud_properties:
273
cpu: 1
274
disk: 4096
275
ram: 512
276
name: service_small
277
- cloud_properties:
278
cpu: 1
279
disk: 4096
280
ram: 1024
281
name: service_medium
282
- cloud_properties:
283
cpu: 1
284
disk: 4096
285
ram: 2048
286
name: service_medium_1CPU_2G
287
- cloud_properties:
288
cpu: 2
289
disk: 8192
290
ram: 4096
291
name: service_medium_4G
292
- cloud_properties:
293
cpu: 2
294
disk: 10240
295
ram: 2048
296
name: service_medium_2G
297
- cloud_properties:
298
cpu: 1
299
disk: 4096
300
ram: 256
301
name: portal_tiny
302
- cloud_properties:
303
cpu: 1
304
disk: 4096
305
ram: 512
306
name: portal_small
307
- cloud_properties:
308
cpu: 1
309
disk: 4096
310
ram: 1024
311
name: portal_medium
312
- cloud_properties:
313
cpu: 1
314
disk: 4096
315
ram: 2048
316
name: portal_large
317
318
Succeeded
Copied!
  • Deployment YAML에서 사용하는 변수들을 서버 환경에 맞게 수정한다.
1
# 변수 설정
2
$ vi ~/workspace/paasta-4.0/deployment/service-deployment/paasta-logging-service-2.0/manifests/vars.yml
3
# RELEASE
4
logging_service_release_name: "paasta-logging-service-release"
5
logging_service_release_version: "1.0"
6
7
# STEMCELL
8
stemcell_os: "ubuntu-trusty"
9
stemcell_version: "3468.51"
10
11
# VM_TYPE
12
vm_type_minimal: "minimal"
13
vm_type_default: "default"
14
vm_type_medium: "medium"
15
16
# NETWORK
17
private_network_name: "service_private"
18
public_network_name: "service_public"
19
private_nat_network_name: "default" # AWS의 경우 nat network
20
21
# ELASTICSEARCH_MASTER
22
es_master_azs: [z5]
23
es_master_instances: 1
24
es_master_persistent_disk_type: "10GB"
25
es_master_private_ips: ["10.30.107.135"]
26
es_master_private_url: "10.30.107.135"
27
28
# QUEUE
29
queue_azs: [z5]
30
queue_instances: 1
31
queue_persistent_disk_type: "10GB"
32
queue_private_ips: ["10.30.107.139"]
33
queue_private_url: "10.30.107.139"
34
35
# MAINTENANCE
36
maintenance_azs: [z5]
37
maintenance_instances: 1
38
maintenance_private_ips: ["10.30.107.136"]
39
40
# ELASTICSEARCH_DATA
41
es_data_azs: [z5]
42
es_data_instances: 2
43
es_data_persistent_disk_type: "20GB"
44
es_data_private_ips: ["10.30.107.133", "10.30.107.134"]
45
46
# VISUALIZATION
47
visualization_azs: [z5]
48
visualization_instances: 1
49
visualization_private_ips: ["10.30.107.143"]
50
visualization_version: "5.3.0"
51
52
# COLLECTOR
53
collector_azs: [z5]
54
collector_instances: 1
55
collector_private_ips: ["10.30.107.131"]
56
57
# PARSER
58
parser_azs: [z5]
59
parser_instances: 2
60
parser_private_ips: ["10.30.107.137", "10.30.107.138"]
61
parser_es_index: "%{[@metadata][index]}-%{+YYYY.MM.dd.HH}"
62
parser_es_index_type: '%{[@metadata][type]}'
63
64
65
# ROUTER
66
router_azs: [z5]
67
router_instances: 1
68
router_private_ips: ["10.30.107.140"]
69
router_public_ips: "115.68.47.181"
70
router_private_url: "10.30.107.140"
71
72
# CF
73
cf_client_id : "laasclient"
74
cf_client_secret : "clientsecret”
75
system_domain: "<DOMAIN>"
76
77
# LOGGING SERVICE
78
es_config_index_prefix: "laas-"
79
retention_period: 7
80
laas_logo: "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAALQAAABGCAYAAABll74gAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAA3FpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuNi1jMTQyIDc5LjE2MDkyNCwgMjAxNy8wNy8xMy0wMTowNjozOSAgICAgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wTU09Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9tbS8iIHhtbG5zOnN0UmVmPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvc1R5cGUvUmVzb3VyY2VSZWYjIiB4bWxuczp4bXA9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC8iIHhtcE1NOk9yaWdpbmFsRG9jdW1lbnRJRD0ieG1wLmRpZDpkYzhkNmI4YS1kZWNkLThkNGItOThiNC0zMjRjZjU1OTE0NmYiIHhtcE1NOkRvY3VtZW50SUQ9InhtcC5kaWQ6MkRBNUQ0REMyQ0EwMTFFOEI2QkZBQUY2QUYwM0UzRjkiIHhtcE1NOkluc3RhbmNlSUQ9InhtcC5paWQ6MkRBNUQ0REIyQ0EwMTFFOEI2QkZBQUY2QUYwM0UzRjkiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENDIChXaW5kb3dzKSI+IDx4bXBNTTpEZXJpdmVkRnJvbSBzdFJlZjppbnN0YW5jZUlEPSJ4bXAuaWlkOjQ5YzFjOTUyLWE2MDEtZTI0NC1iMzIzLTMzYTIyNzI1NDcxYiIgc3RSZWY6ZG9jdW1lbnRJRD0ieG1wLmRpZDpkYzhkNmI4YS1kZWNkLThkNGItOThiNC0zMjRjZjU1OTE0NmYiLz4gPC9yZGY6RGVzY3JpcHRpb24+IDwvcmRmOlJERj4gPC94OnhtcG1ldGE+IDw/eHBhY2tldCBlbmQ9InIiPz7OZxN8AAAHtUlEQVR42uyde4hUZRjGz6y7W+stMl0LFbtJ/VGZFogabAptZZrrrSKzBBMsDKysWBF210IzK0VNy+yiXcxbec1Q3FwoJUKxMJDQLLG8lWSuKevi9Ly779jH8czMN2fOzJxZnwcezpzb55nv/M573vf7ZjESjUYdimopKmAXUASaogg0RRFoiiLQFIGmKAJNUQSaogg0RRFoikBTFIGmqNCo0PbASCSS1QtrXFM2EIvP4LNweWFF3V5j3xAsWsMrsf18vDb4wysCHQopzBvgEt00DJ6B7fJULYAn6PZr4Dm8jVRogfaA+Qz8pX42YRaV6jnFWMyF+8BTELU38dZemorYvpazkXLEgXkwAK3FvsH4vN44fA9cBtfDq+Ahun03ju/FlINFYRgjcxPMun6ZC+aB2HcCy/cMmEXf8bYyQuc0QseDuXLx0a+xHA/3KCqMzJ42tnQ4PneGZyvMcu5fWHTQ8ySCj8S+BkZo5tC5isy9E8B8IWc+1xjtDlAfks8vDL45Al+Lj4fgmfBLmmePi8FMMeXIlR5MBrOxT2CWAnA1fADegWPfBMRXwWOw3hYPyHR4Euznu70igd3Skrtvh5+QF5hF21Efrk6hzdctr6PKsi/MthfCRZbnVWWoL2rzBeiV8GH4qJEzT3XBLDnzZIVZCsBhuv1OuKtG+k5Y1MGVkpLAo3xci/y70yyPbQP3hT+E37eEKRXVWABt6nn4I7g4yXHVKUAdk9yLLXBHi2P9tG/bH+FMOc7M79pXO2kjAF4BGLs0XUxFXSzpHeYuAOGTrtEM0Rfwbzi/gz7Btxj7/vV5eVUWN+RqeLTCLxM8Y+Ft8BLb2iVDXSvXJA/2CH2DJILOGhKVjCh9Dw+Ff7SA2rb9QPuiIAcwC5xb4cfhT7FeKiCLAWY/+HZsn69AfpMAZikAH5m1Ya88BM+6YH4b7a1PA+hkOgK/AU8yto3P8Ztusr6ay/Xh6mwJnY2ekjIGlrrlW3i4ZaRu2aMcCrNZAAqo3Yq63lCvED+t2+8FkJuNnNkL5pGAuUHTjYlYzIvBLO3IA+JzlCOWu9pElzZGJDwtOXySdoOOSu42R2v6I322D74P3u/zOtzHlel96Kj7avQNFfXRfib6IrtAe8DcVAACZq8C8DkAOTsRzPAVWgiVFBVGJk0bWyppzFmct/FCr/kH2rGE+kr4hA+gg3oNe4FRrkVzW61LHoB3BgC0oxF6LXybrq/WdKs+DaADTUmyAnQ8mEsmHpIZwMe0mDFz5v6Vi4+e0hx5aByYzZx5FqL1ixqte2IxSM5tNXTb3gCiXiJJmrFIP8uIR/8QAC26Q+oTTTtOaZ9tDgBoRx+UJUba8QNcAf8aBqAznkMnglnXu7gLQETZf7DsaQmzo6/X2ATNDni6cQMzIbmGMfqGiOndFG9SIqcrich3abrRTvvu0YC+e73ehxoFs6cWi2V+s4Qg+6IgxzA7mm7M1dx3AGA+rtt/cZonThx9zcVy5hXuAlBg8phtvDygr1HtXDwm+je8FG6vxyxNYYQjW9qnb4ydmlN/rEN7QeXu0i+jFPCOOqw3IddfOqMpB4A+YlTbTTDDkjO/Cj8Dr5FCBoBHNcIWa3HXD56CtEPGla+X15qOZkiReFqHyi4UgDOe7DzA68FBylHr82a5X3fVHqMfp3X4apHCHPXRbhAPW1WSNttpHVKe4uvcpm1HI/Qaza9t28/PohBAS5S9zgWzuwDsDqAPKsxmAbgH0fpWBV0i4Tj4J0AuEykyqrFOXnvxYJYJmjSLwqA728/F2EyuxMBLdK3Stx94pB2RANp2NEKv8kg7IgH2hQS3u5MdlOmJlXv0tbRJo5kb5l3w70YOao5mbFeYO5k5MwDuBVh7Gzlzol/o5bNsZwptjpFUTYrvwymmHdWWx/2p93puBtMOq2vJ1ihHxAPmpgIQ0fm4wnnMaZ7lMgvA9hrVzZy5P4DdjuMHaCUfF+aQRWgqC8rGKEdSmFUyMnFch/BiPwF92QXzAoVZ2lzWQiMzlYYKcwUzfBL7X8PyRrgSMMrfBs7xeFWaoxkTjfXzGYK5xsnMj2uofAY6GczOxTOAw/W8Vk7zL+gOOs2/fvtD8+xPzh3a3xb7SwDvMUTpWH6+Duu7MpCrEWoC7RvmfXqe5NBfwVL0LQOoUpXP1H1y7uewQD0a+5bLqEcuCxDqEsihfcAsBeBUhblWYRZVGG3GRjNkhk4i+P1Z6BtCfakD7RPmeNPZ81wwmwXgO7x1lJcCG7YLGOamGUDYc9LENXUeV/wjWUbodDQrTDBTjNC+IzSiszwYDZrfhgZmRmhGaF8CaDImvEVXdzMyU7lSkMN2Am4P5/8/+SHMVP4WhUb6URwWmJlyMOVIS2GCmWKETitCpwHzTU7zz0gDh5kRmhE6q5FZ/1KlDyMzFRqg04RZtFaP+RkeRJipnKUcAcCcUTHlYITOZmSmqHAAnQTm1oSZyhugE8EMYBt05IIwU+EH2gJm0QFj30LCTIWyKDz7VjcbmGPgy0RJAbZvzeWXY1FIoBMBLf+r68PJYA6TCDRTjkQakU8wUwQ6maS4a4SXE2Yq71MOimppEZqiCDRFEWiKItAURaApAk1RBJqiCDRFEWiKQFMUgaaoEOo/AQYAt8WQmU5T9v8AAAAASUVORK5CYII="
Copied!
  • Deploy 스크립트 파일을 서버 환경에 맞게 수정한다.
    • vSphere : -o manifests/ops-files/vsphere-network.yml
    • AWS : -o manifests/ops-files/aws-network.yml
    • OpenStack : -o manifests/ops-files/openstack-network.yml
1
# Deploy 스크립트 수정
2
$ vi ~/workspace/paasta-4.0/deployment/service-deployment/paasta-logging-service-2.0/logging-service-deploy.sh
3
#!/bin/bash
4
5
# SET VARIABLES
6
export LOGGING_SERVICE_DEPLOYMENT_NAME='paasta-logging-service'
7
export BOSH2_NAME='micro-bosh'
8
9
bosh -e ${BOSH2_NAME} -d ${LOGGING_SERVICE_DEPLOYMENT_NAME} deploy --no-redact manifests/paasta_logging_service.yml \
10
-l manifests/vars.yml \
11
-o manifests/ops-files/vsphere-network.yml \
12
-v uaa_admin_client_id=<UAA_ADMIN_CLIENT_ID> \
13
-v uaa_admin_client_secret=<UAA_ADMIN_CLIENT_SECRET>
Copied!
  • Logging 서비스를 배포한다.
1
# Logging 서비스 Deploy (e.g vSphere)
2
$ cd ~/workspace/paasta-4.0/deployment/service-deployment/paasta-logging-service-2.0
3
$ ./logging-service-deploy.sh
4
Using environment '10.30.40.111' as client 'admin'
5
6
Using deployment 'paasta-logging-service'
7
8
+ azs:
9
+ - cloud_properties:
10
+ datacenters:
11
+ - clusters:
12
+ - BD-HA:
13
+ resource_pool: CF_BOSH2_Pool
14
+ name: BD-HA
15
+ name: z1
16
+ - cloud_properties:
17
+ datacenters:
18
+ - clusters:
19
+ - BD-HA:
20
+ resource_pool: CF_BOSH2_Pool
21
+ name: BD-HA
22
+ name: z2
23
+ - cloud_properties:
24
+ datacenters:
25
+ - clusters:
26
+ - BD-HA:
27
+ resource_pool: CF_BOSH2_Pool
28
+ name: BD-HA
29
+ name: z3
30
+ - cloud_properties:
31
+ datacenters:
32
+ - clusters:
33
+ - BD-HA:
34
+ resource_pool: CF_BOSH2_Pool
35
+ name: BD-HA
36
+ name: z4
37
+ - cloud_properties:
38
+ datacenters:
39
+ - clusters:
40
+ - BD-HA:
41
+ resource_pool: CF_BOSH2_Pool
42
+ name: BD-HA
43
+ name: z5
44
+ - cloud_properties:
45
+ datacenters:
46
+ - clusters:
47
+ - BD-HA:
48
+ resource_pool: CF_BOSH2_Pool
49
+ name: BD-HA
50
+ name: z6
51
52
+ vm_types:
53
+ - cloud_properties:
54
+ cpu: 1
55
+ disk: 8192
56
+ ram: 1024
57
+ name: minimal
58
+ - cloud_properties:
59
+ cpu: 1
60
+ disk: 10240
61
+ ram: 2048
62
+ name: default
63
+ - cloud_properties:
64
+ cpu: 1
65
+ disk: 30720
66
+ ram: 4096
67
+ name: small
68
+ - cloud_properties:
69
+ cpu: 2
70
+ disk: 20480
71
+ ram: 4096
72
+ name: medium
73
+ - cloud_properties:
74
+ cpu: 2
75
+ disk: 20480
76
+ ram: 8192
77
+ name: medium-memory-8GB
78
+ - cloud_properties:
79
+ cpu: 4
80
+ disk: 20480
81
+ ram: 8192
82
+ name: large
83
+ - cloud_properties:
84
+ cpu: 8
85
+ disk: 20480
86
+ ram: 16384
87
+ name: xlarge
88
+ - cloud_properties:
89
+ cpu: 2
90
+ disk: 51200
91
+ ram: 4096
92
+ name: small-50GB
93
+ - cloud_properties:
94
+ cpu: 2
95
+ disk: 51200
96
+ ram: 4096
97
+ name: small-50GB-ephemeral-disk
98
+ - cloud_properties:
99
+ cpu: 4
100
+ disk: 102400
101
+ ram: 8192
102
+ name: small-100GB-ephemeral-disk
103
+ - cloud_properties:
104
+ cpu: 4
105
+ disk: 102400
106
+ ram: 8192
107
+ name: small-highmem-100GB-ephemeral-disk
108
+ - cloud_properties:
109
+ cpu: 8
110
+ disk: 20480
111
+ ram: 16384
112
+ name: small-highmem-16GB
113
+ - cloud_properties:
114
+ cpu: 1
115
+ disk: 4096
116
+ ram: 2048
117
+ name: caas_small
118
+ - cloud_properties:
119
+ cpu: 1
120
+ disk: 4096
121
+ ram: 1024
122
+ name: caas_small_api
123
+ - cloud_properties:
124
+ cpu: 1
125
+ disk: 4096
126
+ ram: 4096
127
+ name: caas_medium
128
+ - cloud_properties:
129
+ cpu: 1
130
+ disk: 4096
131
+ ram: 256
132
+ name: service_tiny
133
+ - cloud_properties:
134
+ cpu: 1
135
+ disk: 4096
136
+ ram: 512
137
+ name: service_small
138
+ - cloud_properties:
139
+ cpu: 1
140
+ disk: 4096
141
+ ram: 1024
142
+ name: service_medium
143
+ - cloud_properties:
144
+ cpu: 1
145
+ disk: 4096
146
+ ram: 2048
147
+ name: service_medium_1CPU_2G
148
+ - cloud_properties:
149
+ cpu: 2
150
+ disk: 8192
151
+ ram: 4096
152
+ name: service_medium_4G
153
+ - cloud_properties:
154
+ cpu: 2
155
+ disk: 10240
156
+ ram: 2048
157
+ name: service_medium_2G
158
+ - cloud_properties:
159
+ cpu: 1
160
+ disk: 4096
161
+ ram: 256
162
+ name: portal_tiny
163
+ - cloud_properties:
164
+ cpu: 1
165
+ disk: 4096
166
+ ram: 512
167
+ name: portal_small
168
+ - cloud_properties:
169
+ cpu: 1
170
+ disk: 4096
171
+ ram: 1024
172
+ name: portal_medium
173
+ - cloud_properties:
174
+ cpu: 1
175
+ disk: 4096
176
+ ram: 2048
177
+ name: portal_large
178
179
+ vm_extensions:
180
+ - cloud_properties:
181
+ ports:
182
+ - host: 3306
183
+ name: mysql-proxy-lb
184
+ - name: cf-router-network-properties
185
+ - name: cf-tcp-router-network-properties
186
+ - name: diego-ssh-proxy-network-properties
187
+ - name: cf-haproxy-network-properties
188
+ - cloud_properties:
189
+ disk: 51200
190
+ name: small-50GB
191
+ - cloud_properties:
192
+ disk: 102400
193
+ name: small-highmem-100GB
194
195
+ compilation:
196
+ az: z1
197
+ network: default
198
+ reuse_compilation_vms: true
199
+ vm_type: large
200
+ workers: 5
201
202
+ networks:
203
+ - name: default
204
+ subnets:
205
+ - azs:
206
+ - z1
207
+ - z2
208
+ - z3
209
+ - z4
210
+ - z5
211
+ - z6
212
+ cloud_properties:
213
+ name: Internal
214
+ dns:
215
+ - 8.8.8.8
216
+ gateway: 10.30.20.23
217
+ range: 10.30.0.0/16
218
+ reserved:
219
+ - 10.30.0.0 - 10.30.111.40
220
+ - name: public
221
+ subnets:
222
+ - azs:
223
+ - z1
224
+ - z2
225
+ - z3
226
+ - z4
227
+ - z5
228
+ - z6
229
+ cloud_properties:
230
+ name: External
231
+ dns:
232
+ - 8.8.8.8
233
+ gateway: 115.68.46.177
234
+ range: 115.68.46.176/28
235
+ reserved:
236
+ - 115.68.46.176 - 115.68.46.188
237
+ static:
238
+ - 115.68.46.189 - 115.68.46.190
239
+ type: manual
240
+ - name: service_private
241
+ subnets:
242
+ - azs:
243
+ - z1
244
+ - z2
245
+ - z3
246
+ - z4
247
+ - z5
248
+ - z6
249
+ cloud_properties:
250
+ name: Internal
251
+ dns:
252
+ - 8.8.8.8
253
+ gateway: 10.30.20.23
254
+ range: 10.30.0.0/16
255
+ reserved:
256
+ - 10.30.0.0 - 10.30.106.255
257
+ static:
258
+ - 10.30.107.1 - 10.30.107.255
259
+ - name: service_public
260
+ subnets:
261
+ - azs:
262
+ - z1
263
+ - z2
264
+ - z3
265
+ - z4
266
+ - z5
267
+ - z6
268
+ cloud_properties:
269
+ name: External
270
+ dns:
271
+ - 8.8.8.8
272
+ gateway: 115.68.47.161
273
+ range: 115.68.47.160/24
274
+ reserved:
275
+ - 115.68.47.161 - 115.68.47.174
276
+ static:
277
+ - 115.68.47.175 - 115.68.47.190
278
+ type: manual
279
+ - name: portal_service_public
280
+ subnets:
281
+ - azs:
282
+ - z1
283
+ - z2
284
+ - z3
285
+ - z4
286
+ - z5
287
+ - z6
288
+ cloud_properties:
289
+ name: External
290
+ dns:
291
+ - 8.8.8.8
292
+ gateway: 115.68.46.209
293
+ range: 115.68.46.208/28
294
+ reserved:
295
+ - 115.68.46.217 - 115.68.46.222
296
+ static:
297
+ - 115.68.46.214 - 115.68.46.216
298
+ type: manual
299
300
+ disk_types:
301
+ - disk_size: 1024
302
+ name: default
303
+ - disk_size: 1024
304
+ name: 1GB
305
+ - disk_size: 2048
306
+ name: 2GB
307
+ - disk_size: 4096
308
+ name: 4GB
309
+ - disk_size: 5120
310
+ name: 5GB
311
+ - disk_size: 8192
312
+ name: 8GB
313
+ - disk_size: 10240
314
+ name: 10GB
315
+ - disk_size: 20480
316
+ name: 20GB
317
+ - disk_size: 30720
318
+ name: 30GB
319
+ - disk_size: 51200
320
+ name: 50GB
321
+ - disk_size: 102400
322
+ name: 100GB
323
+ - disk_size: 1048576
324
+ name: 1TB
325
326
+ stemcells:
327
+ - alias: default
328
+ os: ubuntu-trusty
329
+ version: '3468.51'
330
331
+ releases:
332
+ - name: paasta-logging-service-release
333
+ version: '1.0'
334
335
+ update:
336
+ canaries: 1
337
+ canary_watch_time: 30000-600000
338
+ max_in_flight: 1
339
+ serial: false
340
+ update_watch_time: 5000-600000
341
342
+ instance_groups:
343
+ - azs:
344
+ - z5
345
+ instances: 1
346
+ jobs:
347
+ - name: elasticsearch
348
+ properties:
349
+ elasticsearch:
350
+ cluster_name: logsearch
351
+ exec:
352
+ master_hosts:
353
+ - 10.30.107.135
354
+ node:
355
+ allow_data: false
356
+ allow_master: true
357
+ release: paasta-logging-service-release
358
+ - name: cerebro
359
+ properties:
360
+ elasticsearch:
361
+ cluster_name: logsearch
362
+ release: paasta-logging-service-release
363
+ name: elasticsearch_master
364
+ networks:
365
+ - name: service_private
366
+ static_ips:
367
+ - 10.30.107.135
368
+ persistent_disk_type: 10GB
369
+ stemcell: default
370
+ update:
371
+ max_in_flight: 1
372
+ vm_type: default
373
+ - azs:
374
+ - z5
375
+ instances: 1
376
+ jobs:
377
+ - name: queue
378
+ properties:
379
+ redis:
380
+ host: 10.30.107.139
381
+ release: paasta-logging-service-release
382
+ name: queue
383
+ networks:
384
+ - name: service_private
385
+ static_ips:
386
+ - 10.30.107.139
387
+ persistent_disk_type: 10GB
388
+ stemcell: default
389
+ vm_type: default
390
+ - azs:
391
+ - z5
392
+ instances: 1
393
+ jobs:
394
+ - name: elasticsearch_config
395
+ properties:
396
+ elasticsearch_config:
397
+ elasticsearch:
398
+ host: 10.30.107.135
399
+ index_prefix: laas-
400
+ templates:
401
+ - shards-and-replicas: "/var/vcap/jobs/elasticsearch_config/index-templates/shards-and-replicas.json"
402
+ - index-settings: "/var/vcap/jobs/elasticsearch_config/index-templates/index-settings.json"
403
+ - index-mappings: "/var/vcap/jobs/elasticsearch_config/index-templates/index-mappings.json"
404
+ - index-mappings-laas: "/var/vcap/jobs/elasticsearch_config/index-templates/index-mappings-laas.json"
405
+ - index-mappings-app: "/var/vcap/jobs/elasticsearch_config/index-templates/index-mappings-app.json"
406
+ - index-mappings-platform: "/var/vcap/jobs/elasticsearch_config/index-templates/index-mappings-platform.json"
407
+ release: paasta-logging-service-release
408
+ - name: curator
409
+ properties:
410
+ curator:
411
+ elasticsearch:
412
+ host: 10.30.107.135
413
+ port: 9200
414
+ purge_logs:
415
+ retention_period: 7
416
+ unit: days
417
+ elasticsearch_config:
418
+ index_prefix: laas-
419
+ release: paasta-logging-service-release
420
+ name: maintenance
421
+ networks:
422
+ - name: service_private
423
+ static_ips:
424
+ - 10.30.107.136
425
+ stemcell: default
426
+ update:
427
+ serial: true
428
+ vm_type: minimal
429
+ - azs:
430
+ - z5
431
+ instances: 2
432
+ jobs:
433
+ - name: elasticsearch
434
+ properties:
435
+ elasticsearch:
436
+ cluster_name: logsearch
437
+ exec:
438
+ master_hosts:
439
+ - 10.30.107.135
440
+ node:
441
+ allow_data: true
442
+ allow_master: false
443
+ release: paasta-logging-service-release
444
+ name: elasticsearch_data
445
+ networks:
446
+ - name: service_private
447
+ static_ips:
448
+ - 10.30.107.133
449
+ - 10.30.107.134
450
+ persistent_disk_type: 20GB
451
+ stemcell: default
452
+ update:
453
+ max_in_flight: 1
454
+ serial: true
455
+ vm_type: medium
456
+ - azs:
457
+ - z5
458
+ instances: 1
459
+ jobs:
460
+ - name: kibana
461
+ properties:
462
+ kibana:
463
+ elasticsearch:
464
+ host: 10.30.107.135
465
+ port: 9200
466
+ version: 5.3.0
467
+ laas:
468
+ cf_api_url: https://api.<DOMAIN>
469
+ cf_client_id: laasclient
470
+ cf_client_secret: clientsecret
471
+ cf_uaa_callback_url: http://115.68.47.181/app/laas/callback
472
+ cf_uaa_scope: cloud_controller.read&openid
473
+ cf_uaa_url: https://uaa.<DOMAIN>
474
+ elasticsearch_index_prefix: laas-
475
+ top_left_logo_image: data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAALQAAABGCAYAAABll74gAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5cclCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuNgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnMHhtbG5zOnN0UmVmPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvc1R5cGUvUmVzb3VyY2VSZWYjIiB4bWxuczp4bXA9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC8iIHhtcE1NOkLThkNGItOThiNC0zMjRjZjU1OTE0NmYiIHhtcE1NOkRvY3VtZW50SUQ9InhtcC5kaWQ6MkRBNUQ0REMyQ0EwMTFFOEI2QkZBQUY2QUYwM0UzRjkiIHhtcE1NOkluc3RhbmNlSUQ9InhtcC5DpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENDIChXaW5kb3dzKSI+IDx4bXBNTTpEZXJpdmVkRnJvbSBzdFJlZjppbnN0YW5jZUlEPSJ4bXAuaWlkOjQ5YzFjOTUyLWE2MDEtZTI0NwLmRpZDpkYzhkNmI4YS1kZWNkLThkNGItOThiNC0zMjRjZjU1OTE0NmYiLz4gPC9yZGY6RGVzY3JpcHRpb24+IDwvcmRmOlJERj4gPC94OnhtcG1ldGE+IDw/eHBhY2tldCBlbmQ9InIiPz7AptZZrrrSKzBBMsDKysWBF210IzK0VNy+yiXcxbec1Q3FwoJUKxMJDQLLG8lWSuKevi9Ly779jH8czMN2fOzJxZnwcezpzb55nv/M573vf7ZjESjUYdimopKmAXUASaogg0RRFoiiLQFIGmKF3V5j3xAsWsMrsf18vDb4wysCHQopzBvgEt00DJ6B7fJULYAn6PZr4Dm8jVRogfaA+Qz8pX42YRaV6jnFWMyF+8BTELU38dZemorYvpazkXLEgXkwAK3FvsH4vN44fA9cBtfDq+Ahun03ju/A/3KCqMzJ42tnQ4PneGZyvMcu5fWHTQ8ySCj8S+BkZo5tC5isy9E8B8IWc+1xjtDlAfks8vDL45Al+Lj4fgmfBLmmePi8FMMeXIlR5MBrOxT2CWAnA1fADegWPfBMRXwWOw3hYPyHR4EuznuzBeiV8GH4qJEzT3XBLDnzZIVZCsBhuv1OuKtG+k5Y1MGVkpLAo3xci/y70yyPbQP3hT+E37eEKRXVWABt6nn4I7g4yXHVKUAdk9yLLXBHi2P9tG/bH+FMOc7M79pXO2kjAF4BGLs0XUxFXSzBLb2iVDXSvXJA/2CH2DJILOGhKVjCh9Dw+Ff7SA2rb9QPuiIAcwC5xb4cfhT7FeKiCLAWY/+HZsn69AfpMAZikAH5m1Ya88BM+6YH4b7a1PA+hkOgK/AU8yto3P8Ztusr6ay/Xh6mwJnY2ekAuUHTjYlYzIvBLO3IA+JzlCOWu9pElzZGJDwtOXySdoOOSu42R2v6I322D74P3u/zOtzHlel96Kj7avQNFfXRfib6IrtAe8DcVAACZq8C8DkAOTsRzPAVWgiVFBVGJk0bWyppzFmct/FCr/kaADTUmyAnQ8mEsmHpIZwMe0mDFz5v6Vi4+e0hx5aByYzZx5FqL1ixqte2IxSM5tNXTb3gCiXiJJmrFIP8uIR/8QAC26Q+oTTTtOaZ9tDgBoRx+UJUba8QNcAf8aBqAznkMnglnXu7gLQETZfu0YC+e73ehxoFs6cWi2V+s4Qg+6IgxzA7mm7M1dx3AGA+rtt/cZonThx9zcVy5hXuAlBg8phtvDygr1HtXDwm+je8FG6vxyxNYYQjW9qnb4ydmlN/rEN7QeXu0i+jFPCOOqw3IddfOqMpB4AFqHyi4UgDOe7DzA68FBylHr82a5X3fVHqMfp3X4apHCHPXRbhAPW1WSNttpHVKe4uvcpm1HI/Qaza9t28/PohBAS5S9zgWzuwDsDqAPKsxmAbgH0fpWBV0i4Tj4J0AuEykyqrFOXnvxYJYJmdlOmJlXv0tbRJo5kb5l3w70YOao5mbFeYO5k5MwDuBVh7Gzlzol/o5bNsZwptjpFUTYrvwymmHdWWx/2p93puBtMOq2vJ1ihHxAPmpgIQ0fm4wnnMaZ7lMgvA9hrVzZy5P4DdjuMHaCUfF+aBL7X8PyRrgSMMrfBs7xeFWaoxkTjfXzGYK5xsnMj2uofAY6GczOxTOAw/W8Vk7zL+gOOs2/fvtD8+xPzh3a3xb7SwDvMUTpWH6+Duu7MpCrEWoC7RvmfXqe5NBfwVL0LQOoUpXP1H1y7uewQCfakD7RPmeNPZ81wwmwXgO7x1lJcCG7YLGOamGUDYc9LENXUeV/wjWUbodDQrTDBTjNC+IzSiszwYDZrfhgZmRmhGaF8CaDImvEVXdzMyU7lSkMN2Am4P5/8/+SHMVP4WhUb6URwWmJlyMOVFaP+RkeRJipnKUcAcCcUTHlYITOZmSmqHAAnQTm1oSZyhugE8EMYBt05IIwU+EH2gJm0QFj30LCTIWyKDz7VjcbmGPgy0RJAbZvzeWXY1FIoBMBLf+r68PJYA6TCDRTjkQakU8wUwQ6maS4aUgaaoEOo/AQYAt8WQmU5T9v8AAAAASUVORK5CYII=
476
+ release: paasta-logging-service-release
477
+ name: visualization
478
+ networks:
479
+ - name: service_private
480
+ static_ips:
481
+ - 10.30.107.143
482
+ stemcell: default
483
+ vm_type: default
484
+ - azs:
485
+ - z5
486
+ instances: 1
487
+ jobs:
488
+ - name: ingestor_syslog
489
+ properties:
490
+ logstash_ingestor:
491
+ debug: false
492
+ relp:
493
+ port:
494
+ redis:
495
+ host: 10.30.107.139
496
+ release: paasta-logging-service-release
497
+ - name: ingestor_cloudfoundry-firehose
498
+ properties:
499
+ cloudfoundry:
500
+ api_endpoint: https://api.<DOMAIN>
501
+ firehose_client_id: firehose-to-syslog
502
+ firehose_client_secret: firehose-secret
503
+ firehose_events: LogMessage
504
+ skip_ssl_validation: true
505
+ create-uaa-client:
506
+ cloudfoundry:
507
+ system_domain: <DOMAIN>
508
+ uaa_admin_client_id: <UAA_ADMIN_CLIENT_ID>
509
+ uaa_admin_client_secret: <UAA_ADMIN_CLIENT_SECRET>
510
+ syslog:
511
+ host: 10.30.107.140
512
+ port: 5514
513
+ release: paasta-logging-service-release
514
+ name: collector
515
+ networks:
516
+ - name: service_private
517
+ static_ips:
518
+ - 10.30.107.131
519
+ stemcell: default
520
+ vm_type: default
521
+ - azs:
522
+ - z5
523
+ instances: 2
524
+ jobs:
525
+ - name: parser
526
+ properties:
527
+ logstash_parser:
528
+ debug: false
529
+ elasticsearch:
530
+ index: laas-%{[@metadata][index]}-%{+YYYY.MM.dd.HH}
531
+ index_type: "%{[@metadata][type]}"
532
+ redis:
533
+ host: 10.30.107.139
534
+ release: paasta-logging-service-release
535
+ - name: elasticsearch
536
+ properties:
537
+ elasticsearch:
538
+ cluster_name: logsearch
539
+ exec:
540
+ master_hosts:
541
+ - 10.30.107.135
542
+ release: paasta-logging-service-release
543
+ name: parser
544
+ networks:
545
+ - name: service_private
546
+ static_ips:
547
+ - 10.30.107.137
548
+ - 10.30.107.138
549
+ stemcell: default
550
+ update:
551
+ max_in_flight: 4
552
+ serial: false
553
+ vm_type: default
554
+ - azs:
555
+ - z5
556
+ instances: 1
557
+ jobs:
558
+ - name: haproxy
559
+ properties:
560
+ haproxy:
561
+ cluster_monitor:
562
+ ingestor:
563
+ backend_servers:
564
+ - 10.30.107.131
565
+ kibana:
566
+ backend_servers:
567
+ - 10.30.107.143
568
+ release: paasta-logging-service-release
569
+ name: router
570
+ networks:
571
+ - name: service_private
572
+ static_ips:
573
+ - 10.30.107.140
574
+ - default:
575
+ - dns
576
+ - gateway
577
+ name: service_public
578
+ static_ips: 115.68.47.181
579
+ stemcell: default
580
+ vm_type: minimal
581
582
+ name: paasta-logging-service
583
584
Continue? [yN]: y
585
586
Task 68414
587
588
Task 68414 | 02:06:49 | Preparing deployment: Preparing deployment (00:00:02)
589
Task 68414 | 02:06:54 | Preparing package compilation: Finding packages to compile (00:00:00)
590
Task 68414 | 02:06:54 | Compiling packages: haproxy/1d59aa8ae61da532ade4e9f5129428bbc101be64
591
Task 68414 | 02:06:54 | Compiling packages: kibana/4bf52faddc3486d0f81857ddba1d5a617e52cc5b
592
Task 68414 | 02:06:54 | Compiling packages: python3/2a00051b1a0f02d70453c75e9036d41cb960ebfc
593
Task 68414 | 02:06:54 | Compiling packages: golang/fb3379fa5b3afb2e6e515657a33f2145ba4bd076
594
Task 68414 | 02:06:54 | Compiling packages: ruby2.3/613589acad7ddafc74fd12316e3d9cf5346f612e
595
Task 68414 | 02:09:51 | Compiling packages: kibana/4bf52faddc3486d0f81857ddba1d5a617e52cc5b (00:02:57)
596
Task 68414 | 02:09:51 | Compiling packages: redis/ff3e314387f91116dd8906cd656ecd0476b4c7b5
597
Task 68414 | 02:10:00 | Compiling packages: golang/fb3379fa5b3afb2e6e515657a33f2145ba4bd076 (00:03:06)
598
Task 68414 | 02:10:00 | Compiling packages: cerebro/278996853981243e3b921d18e255d55d998dcc7f
599
Task 68414 | 02:10:11 | Compiling packages: haproxy/1d59aa8ae61da532ade4e9f5129428bbc101be64 (00:03:17)
600
Task 68414 | 02:10:11 | Compiling packages: java8/ae41eecf1175fb16c678940d4d6e31af10405b6e
601
Task 68414 | 02:10:30 | Compiling packages: cerebro/278996853981243e3b921d18e255d55d998dcc7f (00:00:30)
602
Task 68414 | 02:10:30 | Compiling packages: elasticsearch/cb154811849156850a88023c3dd1fd46698a09da
603
Task 68414 | 02:10:33 | Compiling packages: redis/ff3e314387f91116dd8906cd656ecd0476b4c7b5 (00:00:42)
604
Task 68414 | 02:10:33 | Compiling packages: firehose-to-syslog/57480e93d19cefa2f26dfa787419d378b2104b13
605
Task 68414 | 02:10:47 | Compiling packages: java8/ae41eecf1175fb16c678940d4d6e31af10405b6e (00:00:36)
606
Task 68414 | 02:10:47 | Compiling packages: logstash/a5bc4ac7fb0f561db9b9e03833510b866236af8e
607
Task 68414 | 02:10:57 | Compiling packages: elasticsearch/cb154811849156850a88023c3dd1fd46698a09da (00:00:27)
608
Task 68414 | 02:11:09 | Compiling packages: firehose-to-syslog/57480e93d19cefa2f26dfa787419d378b2104b13 (00:00:36)
609
Task 68414 | 02:12:09 | Compiling packages: python3/2a00051b1a0f02d70453c75e9036d41cb960ebfc (00:05:15)
610
Task 68414 | 02:12:09 | Compiling packages: curator/27ee549a38ebcef009bb0e63ac716d544dc8caa2
611
Task 68414 | 02:12:16 | Compiling packages: logstash/a5bc4ac7fb0f561db9b9e03833510b866236af8e (00:01:29)
612
Task 68414 | 02:12:48 | Compiling packages: curator/27ee549a38ebcef009bb0e63ac716d544dc8caa2 (00:00:39)
613
Task 68414 | 02:16:41 | Compiling packages: ruby2.3/613589acad7ddafc74fd12316e3d9cf5346f612e (00:09:47)
614
Task 68414 | 02:16:41 | Compiling packages: logsearch-config/4cd3b3efcb7ea642badd77ff3b5189ae1d324734 (00:00:21)
615
Task 68414 | 02:17:50 | Creating missing vms: elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 (0)
616
Task 68414 | 02:17:50 | Creating missing vms: elasticsearch_data/d779c528-8f75-4b4c-b2d9-ac367c1e5ece (0)
617
Task 68414 | 02:17:50 | Creating missing vms: maintenance/dba09e1e-06c0-42bf-a30d-d97a62c536bc (0)
618
Task 68414 | 02:17:50 | Creating missing vms: queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf (0)
619
Task 68414 | 02:17:50 | Creating missing vms: visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a (0)
620
Task 68414 | 02:17:50 | Creating missing vms: elasticsearch_data/fa38698e-913c-4296-aac8-c0b56c84a71e (1)
621
Task 68414 | 02:17:50 | Creating missing vms: collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 (0)
622
Task 68414 | 02:17:50 | Creating missing vms: parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 (0)
623
Task 68414 | 02:17:50 | Creating missing vms: parser/3dfdc7bc-8dde-4ed1-95d0-eb638d4900fa (1)
624
Task 68414 | 02:17:50 | Creating missing vms: router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 (0)
625
Task 68414 | 02:21:00 | Creating missing vms: visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a (0) (00:03:10)
626
Task 68414 | 02:21:07 | Creating missing vms: elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 (0) (00:03:17)
627
Task 68414 | 02:21:20 | Creating missing vms: parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 (0) (00:03:30)
628
Task 68414 | 02:21:20 | Creating missing vms: elasticsearch_data/fa38698e-913c-4296-aac8-c0b56c84a71e (1) (00:03:30)
629
Task 68414 | 02:21:22 | Creating missing vms: queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf (0) (00:03:32)
630
Task 68414 | 02:21:22 | Creating missing vms: elasticsearch_data/d779c528-8f75-4b4c-b2d9-ac367c1e5ece (0) (00:03:32)
631
Task 68414 | 02:21:24 | Creating missing vms: collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 (0) (00:03:34)
632
Task 68414 | 02:21:24 | Creating missing vms: maintenance/dba09e1e-06c0-42bf-a30d-d97a62c536bc (0) (00:03:34)
633
Task 68414 | 02:21:24 | Creating missing vms: router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 (0) (00:03:34)
634
Task 68414 | 02:21:25 | Creating missing vms: parser/3dfdc7bc-8dde-4ed1-95d0-eb638d4900fa (1) (00:03:35)
635
Task 68414 | 02:21:28 | Updating instance elasticsearch_master: elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 (0) (canary)
636
Task 68414 | 02:21:28 | Updating instance queue: queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf (0) (canary)
637
Task 68414 | 02:25:25 | Updating instance elasticsearch_master: elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 (0) (canary) (00:03:57
638
Task 68414 | 02:25:43 | Updating instance queue: queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf (0) (canary) (00:04:15)
639
Task 68414 | 02:25:43 | Updating instance maintenance: maintenance/dba09e1e-06c0-42bf-a30d-d97a62c536bc (0) (canary) (00:01:06)
640
Task 68414 | 02:26:49 | Updating instance elasticsearch_data: elasticsearch_data/d779c528-8f75-4b4c-b2d9-ac367c1e5ece (0) (canary) (00:02:10)
641
Task 68414 | 02:28:59 | Updating instance elasticsearch_data: elasticsearch_data/fa38698e-913c-4296-aac8-c0b56c84a71e (1) (00:01:54)
642
Task 68414 | 02:30:53 | Updating instance collector: collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 (0) (canary)
643
Task 68414 | 02:30:53 | Updating instance visualization: visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a (0) (canary)
644
Task 68414 | 02:30:53 | Updating instance router: router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 (0) (canary)
645
Task 68414 | 02:30:53 | Updating instance parser: parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 (0) (canary)
646
Task 68414 | 02:31:45 | Updating instance router: router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 (0) (canary) (00:00:52)
647
Task 68414 | 02:31:55 | Updating instance visualization: visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a (0) (canary) (00:01:02)
648
Task 68414 | 02:32:10 | Updating instance parser: parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 (0) (canary) (00:01:17)
649
Task 68414 | 02:32:10 | Updating instance parser: parser/3dfdc7bc-8dde-4ed1-95d0-eb638d4900fa (1) (00:01:06)
650
Task 68414 | 02:33:54 | Updating instance collector: collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 (0) (canary) (00:03:01)
651
652
Task 68414 Started Wed Nov 28 02:06:49 UTC 2018
653
Task 68414 Finished Wed Nov 28 02:33:54 UTC 2018
654
Task 68414 Duration 00:27:05
655
Task 68414 done
656
657
Succeeded
Copied!
  • 배포된 Logging 서비스를 확인한다.
1
$ bosh -e micro-bosh -d paasta-logging-service vms
2
Using environment '10.30.40.111' as client 'admin'
3
4
Task 68432. Done
5
6
Deployment 'paasta-logging-service'
7
8
Instance Process State AZ IPs VM CID VM Type Active
9
collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 running z5 10.30.107.131 vm-e73085ec-e336-4c54-a842-37989dc4fe1d default true
10
elasticsearch_data/d779c528-8f75-4b4c-b2d9-ac367c1e5ece running z5 10.30.107.133 vm-5b1fed2f-774f-47cf-9a14-edc015e790f1 medium true
11
elasticsearch_data/fa38698e-913c-4296-aac8-c0b56c84a71e running z5 10.30.107.134 vm-36a47dab-8d09-4daa-bb8c-0394f4d83fd7 medium true
12
elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 running z5 10.30.107.135 vm-46152b8f-d660-413c-9396-8b4068a4a454 default true
13
maintenance/dba09e1e-06c0-42bf-a30d-d97a62c536bc running z5 10.30.107.136 vm-780e1595-9aa9-445c-b056-27ff4e844017 minimal true
14
parser/3dfdc7bc-8dde-4ed1-95d0-eb638d4900fa running z5 10.30.107.138 vm-44210be7-0dab-46db-8cb6-d71a2c29d3c8 default true
15
parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 running z5 10.30.107.137 vm-1eb78459-3050-4ab2-8f49-78f0ddb795b0 default true
16
queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf running z5 10.30.107.139 vm-f11ec996-5c1e-46a0-972a-8b1415267df0 default true
17
router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 running z5 10.30.107.140 vm-32ebc53c-6bef-48d7-854e-4b09a4dd9d01 minimal true
18
115.68.47.181
19
visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a running z5 10.30.107.143 vm-75fdb6a6-e77f-4adb-8336-ec77254c82fa default true
Copied!

3. Logging 서비스 관리

Logging 서비스 배포가 완료 되면, PaaS-TA 포탈에서 서비스를 사용하기 위해 Logging 서비스 UAA Client 등록 및 Logging 서비스 활성화 코드 등록을 해 주어야 한다.

3.1. Logging 서비스 UAA Client 등록

  • Logging 서비스 접근이 가능한 IP를 확인한다.
1
$ bosh -e micro-bosh -d paasta-logging-service vms
2
Using environment '10.30.40.111' as client 'admin'
3
4
Task 68432. Done
5
6
Deployment 'paasta-logging-service'
7
8
Instance Process State AZ IPs VM CID VM Type Active
9
collector/d2a1aed9-d10f-42df-91ec-e21f1baecfb8 running z5 10.30.107.131 vm-e73085ec-e336-4c54-a842-37989dc4fe1d default true
10
elasticsearch_data/d779c528-8f75-4b4c-b2d9-ac367c1e5ece running z5 10.30.107.133 vm-5b1fed2f-774f-47cf-9a14-edc015e790f1 medium true
11
elasticsearch_data/fa38698e-913c-4296-aac8-c0b56c84a71e running z5 10.30.107.134 vm-36a47dab-8d09-4daa-bb8c-0394f4d83fd7 medium true
12
elasticsearch_master/4698c36b-413d-4370-b671-44ee075a0cf0 running z5 10.30.107.135 vm-46152b8f-d660-413c-9396-8b4068a4a454 default true
13
maintenance/dba09e1e-06c0-42bf-a30d-d97a62c536bc running z5 10.30.107.136 vm-780e1595-9aa9-445c-b056-27ff4e844017 minimal true
14
parser/3dfdc7bc-8dde-4ed1-95d0-eb638d4900fa running z5 10.30.107.138 vm-44210be7-0dab-46db-8cb6-d71a2c29d3c8 default true
15
parser/7ef8ffd6-7d8b-4ae0-bd8c-17f5e7092ca2 running z5 10.30.107.137 vm-1eb78459-3050-4ab2-8f49-78f0ddb795b0 default true
16
queue/cc986003-b6c1-4570-b2d7-32ecfd40eedf running z5 10.30.107.139 vm-f11ec996-5c1e-46a0-972a-8b1415267df0 default true
17
router/c64e9519-713c-4f24-9b04-4bbf2d0ac457 running z5 10.30.107.140 vm-32ebc53c-6bef-48d7-854e-4b09a4dd9d01 minimal true
18
115.68.47.181
19
visualization/d1ac0c78-aa4c-465d-9193-64f2e2de269a running z5 10.30.107.143 vm-75fdb6a6-e77f-4adb-8336-ec77254c82fa default true
Copied!
  • uaac server의 endpoint를 설정한다.
1
# endpoint 설정
2
$ uaac target https://uaa.<DOMAIN> --skip-ssl-validation
3
4
# target 확인
5
$ uaac target
6
Target: https://uaa.<DOMAIN>
7
Context: uaa_admin, from client uaa_admin
Copied!
  • uaac 로그인을 한다.
1
$ uaac token client get <UAA_ADMIN_CLIENT_ID> -s <UAA_ADMIN_CLIENT_SECRET>
2
Successfully fetched token via client credentials grant.
3
Target: https://uaa.<DOMAIN>
4
Context: admin, from client admin
Copied!
  • Logging 서비스 계정을 생성 한다. $ uaac client add -s --redirect_uri --scope <퍼미션 범위> --authorized_grant_types <권한 타입> --authorities=<권한 퍼미션> --autoapprove=<자동승인권한>
    • : uaac 클라이언트 id
    • : uaac 클라이언트 secret