# Analytics / Data Lake

Run analytics directly against data in Aurora buckets.

> Available S3 endpoint: `a-s3.aur.lu` (France, Albi).

## Apache Spark (S3A)

Distributed compute engine widely used for ETL and analytics. The S3A connector reads/writes datasets on S3‑compatible storage.

- Homepage: [Apache Spark](https://spark.apache.org/)
- Hadoop/S3A: [Docs](https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html)
```properties title="spark-defaults.conf"
fs.s3a.endpoint https://a-s3.aur.lu
fs.s3a.access.key <YOUR_ACCESS_KEY>
fs.s3a.secret.key <YOUR_SECRET_KEY>
fs.s3a.path.style.access true
fs.s3a.connection.ssl.enabled true
fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem
```

## Trino / Presto (Hive connector)

Distributed SQL query engine for data lake analytics. Configure the Hive/Delta connectors to query data directly in S3 buckets.

- Trino: [Homepage](https://trino.io/) · [Docs](https://trino.io/docs/current/)
- Presto: [Homepage](https://prestodb.io/) · [Docs](https://prestodb.io/docs/current/)
```properties title="catalog/hive.properties"
connector.name=hive
hive.s3.endpoint=https://a-s3.aur.lu
hive.s3.aws-access-key=<YOUR_ACCESS_KEY>
hive.s3.aws-secret-key=<YOUR_SECRET_KEY>
hive.s3.path-style-access=true
hive.s3.ssl.enabled=true
```

## DuckDB

In‑process analytics database. Can read Parquet/CSV over S3 URLs for quick interactive queries and data exploration.

- Homepage: [DuckDB](https://duckdb.org/)
- Docs: [DuckDB Documentation](https://duckdb.org/docs/)
```sql
SET s3_endpoint='https://a-s3.aur.lu';
SET s3_access_key_id='<YOUR_ACCESS_KEY>';
SET s3_secret_access_key='<YOUR_SECRET_KEY>';
SET s3_url_style='path';

SELECT count(*)
FROM read_parquet('s3://my-bucket/lake/data/*.parquet');
```
