Integrating Fastly Log Data
Updated over a week ago

๐Ÿ›  Botify LogAnalyzer requires information from your web server's daily logs and your website's crawl report. This document describes the integration process when Fastly hosts the logs.

Overview

Botify supports the following methods of exporting Fastly logs:

  • FTP: Fastly sends logs to Botify through plain FTP.

  • AWS S3 Export: Fastly sends logs to an AWS S3 bucket, and Botify fetches the logs.

FTP

Please refer to the FTP reference documentation from Fastly for information on setting up the configuration. Botify provides you with an FTP folder and the following credentials:

  • Host

  • Login

  • Password

The following are the recommended settings when you configure the Fastly export to FTP:

  • Log format: %t %v %h %l %u "%r" %>s %b "%{Referer}i" "%{User-agent}i"

  • Timestamp format: %Y-%m-%dT%H:%M:%S.000

  • Address, user, and password: fill in the information provided by Botify

  • Path: /logs

  • Period: 3600

  • Compression: None

AWS S3

You can use the Botify-provided AWS S3 credentials and bucket or your own AWS S3 bucket. Please refer to Fastly's AWS S3 reference documentation for information on setting up the configuration. The following credentials are required:

  • AWS Access Key Id

  • AWS Secret Access Key

  • Bucket name

  • Path

  • Domain

The following are the recommended settings when you configure Fastly exports to AWS S3:

  • Log format: %t %v %h %l %u "%r" %>s %b "%{Referer}i" "%{User-agent}i"

  • Timestamp format: %Y-%m-%dT%H:%M:%S.000

  • Bucket name, Access Key, Secret Key: fill in the information provided by Botify

  • Period: 3600

  • Compression: Gzip


Contact Support

If you need any assistance, please contact Support using the email address for your region:

Did this answer your question?