🛠 This article explains how to set up an auto-export of your Botify reports to an AWS S3 bucket.
Overview
While you can export sample SiteCrawler data directly as a CSV file, this may be insufficient for large crawls and exports of links. Exporting the complete file to an Amazon S3 bucket allows you to export your complete file.
Configuring the AWS S3 Bucket
Configure an Amazon S3 bucket to allow Botify access.
Adapt the following example policy by replacing the bucket name with your own S3 bucket name:
{
"Version": "2012-10-17"
"Id": "PolicyBotify",
"Statement": [
{
"Sid": "StmtBotify",
"Effect": "Allow",
"Principal": {
"AWS": [ "arn:aws:iam::688073096776:root"
}
"Action": [
"s3:AbortMultipartUpload",
"s3:DeleteObject",
"s3:GetBucketAcl",
"s3:GetBucketLocation",
"s3:GetObject",
"s3:GetObjectAcl",
"s3:ListBucket",
"s3:ListMultipartUploadParts",
"s3:PutObject",
"s3:PutObjectAcl"
],
"Resource": [
"arn:aws:s3:::<BUCKET_NAME>/*",
"arn:aws:s3:::<BUCKET_NAME>"
]
}
]Apply the policy to the selected bucket.
Log in to the AWS S3 interface.
Select the bucket where Botify data will be exported.
Navigate to the Authorization > Bucket Policy tab.
Paste the policy, then save.
Contact Support
Once your bucket is set up, email Support, and we will configure this bucket on the Botify side to enable your exports. Include the following information in your request:
Your bucket name
The bucket host name