I am continuously add parquet data sets to an S3 folder with a structure like this: s3:::my-bucket/public/data/set1 s3:::my-bucket/public/data/set2 s3:::my-bucket/public/data/set3 At the beginning I only have set1 and my crawler is configured to run on the whole bucket s3:::my-bucket. This leads to the creation of a partitioned tabled named my-bucket with partitions named public, data and… Read More Force Glue Crawler to create separate tables