"upload s3 object: Access Denied" Thanos (https://github.com/thanos-io/thanos/issues/2954)

297 views
Skip to first unread message

Madhu Cherukuri

unread,
Aug 7, 2020, 11:13:02 AM8/7/20
to Prometheus Users

I have to take prometheus backup by thanos sidecar but getting access denied below the config file

type: S3
config:
  bucket: "*******"
  endpoint: "s3-us-west-2.amazonaws.com"
  region: "us-west-2"
  access_key: "*********************"
  insecure: false
  signature_version2: false
  encrypt_sse: false
  secret_key: "**********************"
  put_user_metadata: {}
  http_config:
    idle_conn_timeout: 90s
    response_header_timeout: 2m
    insecure_skip_verify: false
  trace:
    enable: false
  part_size: 134217728

And belo is the error log

msg="shipping failed" block=01EECWSM3QX0VNZ3HS092DM0SD err="upload meta file to debug dir: upload file /var/prometheus/thanos/upload/01EECWSM3QX0VNZ3HS092DM0SD/meta.json as debug/metas/01EECWSM3QX0VNZ3HS092DM0SD.json: upload s3 object: Access Denied"
level=warn ts=2020-07-29T09:41:15.251756448Z caller=sidecar.go:339 err="failed to sync 53 blocks" uploaded=0

and the docker commands as below

docker run -d --name "prometheus" \
  -p 9090:9090 \
  -u="root" \
  --network "thanos-network" \
  --volume "/home/ubuntu/prometheus/conf:/etc/prometheus" \
  --volume "/home/ubuntu/prometheus/data:/prometheus" \
   prom/prometheus:latest \
  --config.file "/etc/prometheus/prometheus.yml" \
  --storage.tsdb.path=/prometheus \
  --storage.tsdb.retention=180d \
  --storage.tsdb.max-block-duration=2h \
  --storage.tsdb.min-block-duration=2h \
  --web.enable-lifecycle \
  --web.enable-admin-api 

docker run -d --name "thanos-sidecar" \
  -u="root" \
  --network "thanos-network" \
  --volume "/home/ubuntu/prometheus/data:/var/prometheus" \
  --volume "/home/ubuntu/sidecar/values.yaml:/prometheus/values.yaml" \
   quay.io/thanos/thanos:v0.14.0 sidecar \
   --tsdb.path="/var/prometheus" \
   --prometheus.url=http://**.**.***.**:9090 \
   --grpc-address=0.0.0.0:10901 \
   --objstore.config-file  "/prometheus/values.yaml"

can anyone help out. Thanks in advance

Reply all
Reply to author
Forward
0 new messages