🛠 Botify LogAnalyzer requires information from your web server's daily logs and your website's crawl report. This document describes the integration process when Fastly hosts the logs.
Overview
Botify supports the following methods of exporting Fastly logs:
FTP: Fastly sends logs to Botify through plain FTP.
AWS S3 Export: Fastly sends logs to an AWS S3 bucket, and Botify fetches the logs.
FTP
Please refer to the FTP reference documentation from Fastly for information on setting up the configuration. Botify provides you with an FTP folder and the following credentials:
Host
Login
Password
The following are the recommended settings when you configure the Fastly export to FTP:
Log format: %t %v %h %l %u "%r" %>s %b "%{Referer}i" "%{User-agent}i"
Timestamp format: %Y-%m-%dT%H:%M:%S.000
Address, user, and password: fill in the information provided by Botify
Path: /logs
Period: 3600
Compression: None
AWS S3
Please refer to Fastly's AWS S3 reference documentation for information on setting up the configuration. The following credentials are required:
AWS Access Key Id
AWS Secret Access Key
Bucket name
Path
Domain
The following are the recommended settings when you configure Fastly exports to AWS S3:
Log format: %t %v %h %l %u "%r" %>s %b "%{Referer}i" "%{User-agent}i"
Timestamp format: %Y-%m-%dT%H:%M:%S.000
Bucket name, Access Key, Secret Key: fill in the information provided by Botify
Period: 3600
Compression: Gzip
Contact Support
If you need any assistance, please contact Support.