Skip to main content

Integrating CloudFront Log Data

Updated today

📘 Botify LogAnalyzer requires information from your web server's daily logs and your website's crawl report. This document describes the integration process when CloudFront hosts the logs.

Overview

CloudFront customers configure an automated export to an AWS S3 bucket they own. Botify fetches the logs from this S3 bucket.

Configuring an Automated Export

  1. In the CloudFront administration console, find the distribution or distributions corresponding to the website you need to integrate with Botify.

  2. Referring to the AWS guide to configure logging, edit each distribution to:

    • Enable logging.

    • Configure an AWS S3 bucket you own, where CloudFront will save the logs. If you group logs from several distributions in the same S3 bucket, add a prefix to organize logfiles by distribution:
      ​

      463

  3. Choose a method for granting Botify access to your S3 bucket:

  4. After configuration, Botify will download the logs directly from the AWS S3 bucket daily.

Granting Access by an AWS User

To grant Botify access through a dedicated AWS user:

  1. Create a dedicated AWS user and a corresponding key pair (AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY).

  2. Grant authorizations on the "s3:List*" and "s3:Get*" actions on your bucket and all useful subfolders.

  3. Provide Botify Support with the name of the AWS S3 bucket, optionally the prefixes to fetch, and the account keypair AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY.

Granting Access by IAM Role Authentication

To grant Botify access through an IAM role:

  1. Create an IAM role with the ListBuckets and GetObject permissions for the bucket where your logs are located.

  2. Change the policy to allow Botify’s ARN to assume this role.

  3. Provide Botify Support with the name of the AWS S3 bucket and the new role’s ARN.

Example of an IAM policy:

{ "Id": "Policy1488876114416", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1488875932621", "Effect": "Allow", "Action": [ "s3:List*", "s3:Get*" ], "Resource": [ "arn:aws:s3:::my-bucket/*", "arn:aws:s3:::my-bucket" ] } ] }

Contact Support

If you need any assistance, please contact Support.

Did this answer your question?