🛠 Botify’s LogAnalyzer requires information from your CDN or web server logs. This document explains how to delivery your log data from an AWS S3 bucket.
When integrating your web server log data, Botify can obtain your logs from an AWS S3 bucket. To use this method:
Create a dedicated AWS user and a corresponding key pair (AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY).
Give authorizations on your bucket's "s3:List" and "s3:Get_" actions and all the useful subfolders.
Example of a corresponding IAM policy:
{
"Id": "Policy1488876114416",
"Version": "2012-10-17",
"Statement": [
{
"Sid": "Stmt1488875932621",
"Effect": "Allow",
"Action": [
"s3:List*",
"s3:Get*"
],
"Resource": [
"arn:aws:s3:::my-bucket/*",
"arn:aws:s3:::my-bucket"
]
}
]
}
Once the authorization is in place, provide Botify with the following information, which we will use to fetch the logs regularly:
The key pair AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY of the newly created account.
The name of the AWS region where the bucket is located.
The name of the bucket.
The time of the day to retrieve the logs.
Any other useful information to determine what files to fetch (e.g., subfolder, filter to apply on the first characters of the filename).
👉 If the bucket or subfolder contains many files and it is impossible to target the files to fetch based on their prefix, Botify will be unable to fetch them.
Refer to Delivering Recurring Log Files for additional information.