AWS Athena : Partition
Par Arnaud Charlier, vendredi 28 juin 2019 à 11:46 :: Linux et Debian :: #65 :: rss
Quick Tips AWS athena
In order to reduce the amount of data parsed by query, it's important to organize your S3 bucket in separated folder.
When you are using time based log files, it makes sense to create partition based on folder created by your log system, for example the ALB/ELB log : Year, Month, Day.
Obviously, you can create partation according your own project structure.
First create a partitioned Table
Query Here
Then Add your Partition when needed (through Lambda)
https://docs.aws.amazon.com/athena/latest/ug/partitions.html
Commentaires
1. Le lundi 10 février 2020 à 16:25, par Arnaud Charlier
Ajouter un commentaire
Les commentaires pour ce billet sont fermés.