> ## Documentation Index
> Fetch the complete documentation index at: https://docs.togai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# AWS S3

Amazon S3 is an object storage service that offers industry-leading scalability, data availability, security, and performance.

The integration between **Amazon S3** and **Togai** requires only a one-time setup. Follow the steps below:

## Install

* Navigate to the Integrations section from the left navigation bar in Togai
* Click on `Apps` to access the list of apps with integration support
* Select `S3` from the available apps
* Click on the `+Add connection` button
* Provide a name for the connection and paste your:
  * `AWS Access Key ID`
  * `AWS Secret Access Key`

### AWS Access Key ID and AWS Secret Access Key

Create a new IAM user in your AWS account with access to S3 bucket that is going to act as your events object store and copy the `AWS Access Key ID` and `AWS Secret Access Key` from the `Security credentials` section of the user with following policy:

```json theme={null}
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": "s3:GetObject",
            "Resource": "arn:aws:s3:::<S3_BUCKET_NAME>/*"
        }
    ]
}
```

## Flows

### Import events from S3 Bucket

#### Install

* Provide `Event Schema Name` corresponding to the events that are going to be imported from S3 bucket using this flow
* Provide `Schema Mapping` as a JSON for the CSV files with default column names as the key and the corresponding CSV header as the value. The following is a sample schema mapping for reference:
  ```json theme={null}
  {
      "accountId": "User Identifier",
      "id": "Event Id",
      "timestamp": "Event Time",
      "attributes.messageCount": "SMS Count",
      "attributes.mailCount": "Email Count",
      "dimensions.region": "Region"
  }
  ```
* On installation, the a webhook URL will be generated that needs to be configured as the S3 bucket notification destination for `s3:ObjectCreated:*` events. Refer to the [AWS documentation](https://docs.aws.amazon.com/AmazonS3/latest/userguide/NotificationHowTo.html) for more details on how to configure S3 bucket notifications.

#### Working

<img src="https://mintcdn.com/zuora-togai/gpDI_SmUijp8C7vA/docs/integrations/images/s3-bucket-list-objects-screen.png?fit=max&auto=format&n=gpDI_SmUijp8C7vA&q=85&s=2a8f08ba3faaf79d203a65b9ae14e377" alt="S3 Bucket List Objects Screen" width="1677" height="1060" data-path="docs/integrations/images/s3-bucket-list-objects-screen.png" />

* The flow will be triggered when a new file is uploaded to the S3 bucket
* The new file created event will be used to generate a pre-signed URL for the file which will be used to download the file
* The pre-signed URL will be used to import the events from the file into Togai using the **Bulk Imports** feature which will be used to import the events into the corresponding event schema
* The imported events will be available in the **Events** section of Togai
* The status of the import will be available in the **Bulk Imports** section of Togai