Skip to main content

AWS S3

AWS S3 Connector Setup Guide

The connector allows Ai12z to ingest content directly from a client’s AWS S3 storage. By connecting your S3 bucket, Ai12z can securely access, read, and process files stored in your AWS S3 account, enabling automated data integration and content updates from your cloud storage into the Ai12z platform.

Enable Connector

  1. Log in to the Ai12z portal using admin credentials.
  2. In the organization settings, verify that the connectors are enabled. Organization settings screen showing enabled connectors
  3. Navigate to your Agent.
  4. Select Agent Settings.
  5. Click on the edit button next to Connectors and enable ai12z (Custom). aws s3 Connector

Step 1: Configure AWS S3 Connector

  1. Select Connectors from the Agent left navigation.

  2. From the connector list, click on AWS S3

  3. Copy the account Id and SNS Topic ARN for Step 2 aws account id and sns topic arn

  4. Fill out the information

    • Name:
      Enter a name for your connector (e.g., AWS S3). This will appear in your document list.

    • Description:
      Provide a brief description of your connector (e.g., Connector for AWS S3).

    • Bucket ARN:
      Enter the ARN of your S3 bucket (e.g., arn:aws:s3:::example-bucket).

    • Cloudfront URL:
      If applicable, provide the URL for your CloudFront distribution. Otherwise, leave it blank.

    • Private Bucket:
      Check this box if your bucket is privately accessible.

    • Click on Save button Refresh screen for the next step.

  5. Click on the Create / Manage Keys button from top right

  6. Generate Key 1 and copy it for Step 3 AWS IAM Role

Step 2: Configure S3 Event Notification with SNS Topic

Follow these steps to configure an event notification on your S3 bucket using the SNS Topic ARN copied from Step 1, item 3:

  1. Go to the S3 Console
    In the AWS Console, search for and select S3.

  2. Select Your Bucket
    Click on the bucket you want Ai12z to ingest content from.

  3. Go to the Properties Tab
    In the bucket details, select the Properties tab.

  4. Scroll to Event Notifications
    Find the Event notifications section and click Create event notification.

  5. Configure Event Name
    Enter a name for your event notification (e.g., ai12z-ingest-event).

  6. Set Event Types
    Choose the event types All object create events and All object removal events.

  7. Specify Prefix/Suffix (Optional)
    If you want to limit notifications to specific objects, set a prefix (folder path) or suffix (file extension).

  8. Select Destination

    • For Destination, select SNS topic.
    • In the SNS topic dropdown, choose Enter SNS topic ARN.
    • Paste the SNS Topic ARN you copied from Step 1, item 3.
  9. Save Notification
    Click Save changes or Create event notification to finish.

Note: This configuration ensures that whenever the specified event occurs in your S3 bucket, a notification will be sent to the SNS topic, allowing Ai12z to process the new or updated content automatically.

Step 3: Create an AWS IAM Role for Ai12z Access

Follow these steps to create an IAM Role that allows Ai12z to access your S3 bucket:

  1. Log in to your AWS Console
    Use an account with permissions to manage IAM roles.

  2. Navigate to IAM
    In the AWS Console, search for and select IAM (Identity and Access Management).

  3. Select Roles
    In the left sidebar under "Access management," click on Roles.

  4. Create Role
    Click the Create role button.

  5. Select Trusted Entity Type

    • Choose AWS account as the trusted entity type.
  6. Specify Account ID

    • Select Another AWS account.
    • Enter the Account ID you copied from Step 1, item 3 (from the Ai12z portal).
    • Expand the Options section.
    • In the External ID field, enter the key generated in Step 1, item 6
  7. Click Next
    Proceed to the next step to set permissions (you will attach policies in the following steps).

  8. Attach Permissions

    • On the permissions page, search for and select the AmazonS3ReadOnlyAccess policy.
    • Click Next to continue.
  9. Review and Create Role

    • Review the role details and permissions.
    • Click Create role to finish.

Note: This role will allow Ai12z to access your S3 bucket securely with read-only permissions. Make sure to follow the next steps to complete 10. Copy the newly created Role Arn.

Step 4: Fill Out the AWS S3 Connector Form in Ai12z Portal

  1. Select Connectors from the Agent left navigation.

  2. From the connector list, click on AWS S3.

  3. Finish the connector configuration as follows:

    • Private Bucket:
      Check this box if your bucket is privately accessible.
    • Role ARN:
      Enter the Role ARN you created in Step 2 (e.g., arn:aws:iam::<AWS_YOUR_ACCOUNT_ID>:role/<ROLE_ARN>).
  4. Click Save to complete the connector setup.