Data Engineer – PySpark, Apache Airflow - AWS Redshift – SQL - dimensional modelling (Kimball) – CI/CD – DBT (data build tool) Hybrid - Stockholm
Empiric has received an exciting opportunity for a Data Engineer with strong experience PySpark and Apache Airflow.
Proven expertise in AWS Redshift, internals, WLM, distribution/sort keys, query execution plan analysis, optimization techniques. Plus strong SQL skills and very good understanding of query performance tuning in Redshift. Good knowledge of monitoring tools (CloudWatch, Redshift Console) is a big asset.
Strong SQL skills and deep understanding of query performance tuning in Redshift.
Also, the client is looking for Data Engineers with hands-on experience with dbt (data build tool) for data transformation and model building. Together with familiarity with data versioning, CI/CD, and collaborative development practices in dbt.
Skills/experience:
• PySpark
• Apache Airflow
• dbt (data build tool) for transformation and model building.
• AWS Redshift
• SQL / query performance tuning in Redshift.
• Dimensional modelling
• Monitoring tools (CloudWatch, Redshift Console)
• Data versioning, CI/CD, and collaborative development practices in dbt.
Other
- Term: 6 to 12 months plus extensions
- Rate: Excellent day rate + Starter Bonus + Free Lunch Club experience
- Fancy free a lunch club ... on Empiric? Don't miss this opportunity.
For more details about rates etc and more information about the project, please contact Woody on [email protected] +44 7887 416338 whatsApp +44 203 597 4475