Automated Data Exports

How to Create and Manage Automated Data Exports in the Console

Automated Data Exports allow users to export MAIDs derived from exposures to a pre-configured S3 bucket, to a DSP via LiveRamp, or to push Brand Survey or Retargeting MAIDs to LoopMe.

🚧

Get Started

All S3 Destination Buckets will need to be pre-configured. Please see the Bucket Setup section for more information. All LoopMe and LiveRamp destinations will need to be configured by our support team, so please reach out to get started.

S3 Bucket Setup

  • Before a S3 Destination or Export can be created, an AWS S3 bucket must be configured.
    • Select an existing AWS S3 bucket or create a new one. The bucket must be in the us-east-1 region.
    • After bucket creation, implement our standard S3 data sharing policy to give the export process the needed access to the S3 bucket.
      • See this AWS User Guide for more information on adding an S3 bucket policy.
    • Please send the following information to your support team after bucket creation:
      • Bucket Name: The display name that will be shown in the Console for this delivery bucket. ex: Test Bucket
      • Bucket: The delivery bucket. ex: test-bucket
      • Prefix: The delivery path within the bucket. ex: export/test/path
    • Your support team will let you know once the bucket has been successfully configured and added to your account.

Creating A S3 Destination

Only S3 destinations can be created via the Console. If you would like to setup a LoopMe or LiveRamp destination, please reach out to our support team.

  • To get started with creating an S3 Destination, travel to any existing campaign and click on the export tab or travel to the Destinations page found in the navigation side bar and click the + Create Destination button.
  • Enter the Destination name and an optional description.
  • Select the S3 bucket where the exported data will be delivered. If a Delivery Bucket has not been configured previously, please see the Bucket Setup section for more information.
  • Select the desired file format of the delivery files from the dropdown. Note: When selecting CSV or LiveRamp, one file per ongoing delivery will be dropped. When selecting Partitioned CSV, Parquet, or JSON multiple files will be dropped for each ongoing delivery.
  • Enter an optional delivery path within the bucket where files will be placed. Please see the Delivery Example section for more information on how this is used.

Creating An Export

  • To get started with creating a data export, travel to any existing campaign and click on the export tab or to the Exports page found in the navigation side bar and click the + Create Export button.
  • If a Destination has been configured previously, there will be an option to select an existing destination. If an expected LoopMe or LiveRamp Destination is not visible, please reach out to your account manager or support team to have it configured.
  • If creating a new Destination, refer to the Destination Setup section.
  • When creating exports from the New Export Page, an existing Campaign must be selected.
  • The default delivery cadence is On Change. If daily deliveries are preferred, change the default cadence value in the dropdown from On Change to Daily.
    • If Daily is selected, one delivery per day for each active export is expected.
    • If On Change is selected, new deliveries will be created each time our system detects updates to source or event data.
  • Enter an optional segment name for this export. This entered value will be included as a separate column in the exported file. Note: LiveRamp exports require a segment name.
  • If extra columns should be included in the export file, select them from the dropdown. Users can either select an existing option, if available, or add their own columns. Note: When extra columns are included, those columns will be considered when deduping events.
  • Once the form has been completed, click Create Export button to create the export.
📘

Export Backfills

When creating an export for a campaign that has already begun, the initial delivery will include all exposed MAIDs going back to the start of the campaign.

Managing Data Exports

  • Data exports can be paused or resumed from the Exports table found on the Exports page or the Exports tab of any associated Campaign. A backfill file will be created once resumed.
  • Data exports can be deleted. Note: This deletion is permanent and can not be reversed.

S3 Data Export Delivery Location Examples

  • S3 Exports can only be delivered to pre-configured S3 buckets. Please see the Bucket Setup section for more information.
  • When files are delivered to the preconfigured bucket, the supplied bucket prefix, file path, export ID, and format are used to place the files within that bucket. See examples in the table below.
BucketBucket PrefixFile PathFormatFormat SpecificFinal Location
delivery_bucket/example/testCSV/<export_id>/export_<unique_timestamp>.csvs3://delivery_bucket/example/test/<export_id>/export_<unique_timestamp>.csv
delivery_bucketCSV/<export_id>/export_<unique_timestamp>.csvs3://delivery_bucket/<export_id>/export_<unique_timestamp>.csv
delivery_bucket/example/testPartitioned CSV/export_id=<export_id>/run_time=<run_time>/part-*.csvs3://delivery_bucket/example/test/export_id=<export_id>/run_time=<run_time>/part-*.csv
delivery_bucketParquet/export_id=<export_id>/run_time=<run_time>/part-*.parquets3://delivery_bucket/export_id=<export_id>/run_time=<run_time>/part-*.parquet
delivery_bucket/exampleJSON/export_id=<export_id>/run_time=<run_time>/part-*.jsons3://delivery_bucket/example/export_id=<export_id>/run_time=<run_time>/part-*.json
delivery_bucketLiveRamp/export_<export_id>_<unique_timestamp>.csvs3://delivery_bucket/export_<export_id>_<unique_timestamp>.csv

LoopMe Setup Specifics

  • To Push Brand Survey or Retargeting MAIDs to LoopMe
    • Select the pre-configured LoopMe Destination from the destination dropdown when creating the export. If the LoopMe Destination is not available, please reach out to your support team to have it configured.
    • All files are delivered to a pre-configured LoopMe bucket.
    • We will communicate the Export ID to the LoopMe account manager.

LiveRamp Setup Specifics

  • To Push MAIDs to a DSP via LiveRamp Delivery
    • Select the pre-configured LiveRamp Destination from the destination dropdown when creating the export. If the LiveRamp Destination is not available, please reach out to your support team to have it configured.
    • Select the LiveRamp format option from the File Format dropdown.
    • Enter the LiveRamp required Segment Name. This name will be included in the export to LiveRamp.
    • All files are delivered to a pre-configured LiveRamp bucket.