Skip to main content

Analytics / Data Lake

Run analytics directly against data in Aurora buckets.

Select S3 Endpoint
Choose preferred region.

Apache Spark (S3A)​

Distributed compute engine widely used for ETL and analytics. The S3A connector reads/writes datasets on S3‑compatible storage.

spark-defaults.conf
fs.s3a.endpoint https://
fs.s3a.access.key <YOUR_ACCESS_KEY>
fs.s3a.secret.key <YOUR_SECRET_KEY>
fs.s3a.path.style.access true
fs.s3a.connection.ssl.enabled true
fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem

Trino / Presto (Hive connector)​

Distributed SQL query engine for data lake analytics. Configure the Hive/Delta connectors to query data directly in S3 buckets.

catalog/hive.properties
connector.name=hive
hive.s3.endpoint=https://
hive.s3.aws-access-key=<YOUR_ACCESS_KEY>
hive.s3.aws-secret-key=<YOUR_SECRET_KEY>
hive.s3.path-style-access=true
hive.s3.ssl.enabled=true

DuckDB​

In‑process analytics database. Can read Parquet/CSV over S3 URLs for quick interactive queries and data exploration.

SET s3_endpoint='https://';
SET s3_access_key_id='<YOUR_ACCESS_KEY>';
SET s3_secret_access_key='<YOUR_SECRET_KEY>';
SET s3_url_style='path';

SELECT count(*)
FROM read_parquet('s3://my-bucket/lake/data/*.parquet');