Skip to main content

​
What is Amazon S3 Integration?

The Amazon S3 integration is a data warehouse destination that allows you to export customer data, events, and transactions from Masivo to your Amazon S3 bucket. This integration enables you to store and analyze your loyalty program data using AWS services and third-party analytics tools. It supports historical data backfill, making it ideal for comprehensive data warehousing and analytics use cases.

​
Key Features

Data Warehouse

Warehouse destination that supports historical data export and backfill

Selective Data Export

Choose exactly which data types to export: customers, events, purchases, transactions, rewards, wallets, tiers, and audiences

Flexible Format

Export data in JSON or Parquet format for different use cases

Export Frequencies

Configure export frequency: daily, weekly, or monthly based on your needs

Historical Backfill

Automatically backfills historical data based on your selected frequency

Secure Access

Uses IAM roles for secure, programmatic access to your S3 bucket

​
Integration Type

​
Amazon S3 as Warehouse Destination

Amazon S3 is configured as a warehouse destination that exports data to your S3 bucket. You have full control over which data types are exported, and the integration supports historical data backfill based on your configured export frequency.

​
Data Flow

1

Data Collection

Customer data, events, and transactions are collected in Masivo
2

Processing

Data is validated and transformed for S3 export
3

Batch Export

Data is batched and compressed for efficient S3 upload
4

S3 Storage

Data is stored in organized folders within your S3 bucket

​
Supported Data Types

You can selectively enable or disable each data type for export. The following data types are available:
  • Customer profiles and attributes - User lifecycle events (create, update, delete) - Customer tags (optional) - Profile information and metadata
  • Customer behavior events - Engagement tracking - Custom event properties - Event timestamps and metadata
  • Purchase events and transaction data - Purchase details and metadata
  • Detailed transaction records - Financial transaction data - Transaction history
  • Reward records and redemption history - Reward program data
  • Wallet balance information - Wallet transaction history
  • Tier assignments - Tier change events - Tier membership data
  • Audience calculation events (when audiences are calculated) - Audience deletion events (when audiences are deleted)

​
File Organization

Data is automatically organized in your S3 bucket based on the data type and export frequency you configure:

S3 Folder Structure

Files organized by day: {DATA_TYPE}/YYYY/MM/DD/ - Example: CUSTOMER/2024/01/15/
Files organized by week: {DATA_TYPE}/YYYY/MM/week-N/ - Example: EVENT/2024/01/week-2/
Files organized by month: {DATA_TYPE}/YYYY/MM/ - Example: TRANSACTION/2024/01/

​
Export Formats

Choose between two file formats based on your analytics needs:

JSON Format

  • Human-readable format - Larger file sizes - Easy to process with any tool
  • Default format - Best for: Quick data inspection, simple integrations

Parquet Format

  • Columnar storage format - Smaller file sizes (better compression) - Optimized for analytics and big data processing - Best for: Data warehouses, analytics platforms, cost optimization

​
Export Frequencies

Configure how often data is exported to S3:

Daily

  • Exports data every day - Files organized by day (YYYY/MM/DD) - Best for: Daily reporting and analytics - Default frequency

Weekly

  • Exports data once per week - Files organized by week (YYYY/MM/week-N) - Best for: Weekly reporting, batch processing

Monthly

  • Exports data once per month - Files organized by month (YYYY/MM) - Best for: Monthly reporting, long-term storage optimization
The export frequency determines when historical data backfill occurs. Historical data is automatically synced based on your selected frequency.

​
Benefits

Data Warehouse

Complete data warehouse solution with historical backfill support

Selective Export

Export only the data types you need, reducing storage costs and processing time

Data Analytics

Use AWS analytics services like Athena, Redshift, or third-party tools

Flexible Configuration

Choose your preferred format (JSON/Parquet) and frequency (daily/weekly/monthly)

Data Backup

Secure backup of all customer and loyalty program data

Compliance

Meet data retention and compliance requirements

​
Next Step

Setup Guide

Learn how to configure your S3 integration