Firestore to Amazon S3

Automatically Export & Sync Firestore Data to Amazon S3

Firestore
a black arrow pointing to the right
Amazon S3
Full data sets
No instructions needed
No code
No complicated flow charts
No triggers
Set up in under 3 minutes
Flat pricing starting at $19 /month

Data sets

Uniform JSON Objects
Filterable
Varied JSON Objects
Filterable

Built for Synchronization

This service is designed to help anyone continuously export (i.e. "sync") bulk data from Firestore.

If you only need to export your data one time, check the website of Firestore to see if their service offers a one-time export feature natively. Sometimes a Data Source's native export feature may provide not as much data as its API does, in which case Flatly is the solution.

Additional Information

Flatly uses official API channels to provide an integration with Firestore.
Cloud Firestore is a flexible, scalable database for mobile, web, and server development from Firebase and Google Cloud.
Connection

There are no scripts, downloads or extensions required for this integration. Flatly uses Service Account authorization for Firestore. Bring your own Service Account key and then simply enter a path to your Collection.

Project Data versus Database Data

Flatly syncs Firestore Database data, namely the contents of Documents in specific Collections. It does not sync Project Data like Crashlytics or A/B Testing. Behind the scenes the service first converts Firestore Documents to JSON and then efficiently flattens that JSON into flat files for spreadsheets or storage, or newline JSON for BigQuery.


Data Volume

If you expect your Firestore Collection to contain more than 10 million cells worth of data, do not attempt to sync Firestore to Google Sheets, as Google Sheets is limited to 10 million cells. Instead, use any cloud storage or BigQuery.

Scopes

Flatly's access to Plaid and Plaid's downstream connected financial institutions is read-only access to text. It is limited to account data (words, numbers, dates). It does not include any money-movement, transfer capabilities or account holder profiles/identities.

Plaid alone interfaces directly with financial institutions, caches data from those institutions on Plaid infrastructure, and then makes the appropriate scoped subset of that data available to partners like Flatly using secure connections called client libraries.

Amazon S3 storage buckets.

File Formats

XLSX (Parsed)
XLSX (Raw)
CSV File

Integration Flow

Setup

Step 1

Select Firestore from the Data Source dropdown and Amazon S3 from the Data Destination dropdown.

Step 2

Authorize Firestore with your credentials using the Service Account flow.

Step 3

Authorize Amazon S3 with your credentials using the Access Key flow.

Step 4

Select your Data Set from the 2 Data Sets available using the dropdown.

Step 5

Click Flatten to sync your data.

Walkthrough Video

Extended Data Sources

Get started with your data pipelines

Connect your data with our turnkey data integration solution so you can focus on running your business.