We are looking for a Data Engineer for our organization.
Responsibilities:
Responsibilities:
- Take end-to-end responsibility to build, optimize, and support existing and new data products toward the defined target vision
- Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform).
- Ensure that our built data products work as independent units of deployment and that non-functional aspects of the data products follow the defined standards for security, scalability, observability, and performance.
- Work closely with the Product Owner and other stakeholders around a vision for existing data products and identifying new data products to support our customer needs
- Work with product teams within and outside our domain around topics that relate to the data mesh concept.
- Evaluate and drive continuous improvement and reduce technical debt in the teams
- Maintain expertise in the latest data/analytics and cloud technologies
- GCP service – (BigQuery, cloud run, cloud functions, pubsub, dataflow, cloud composer, etc.)
- SQL
- Python
- DBT
- Terraform
- Basics of Azure (optional depending on which migration team needs)
- Good to have Informatica or other ETL background (optional depending on which migration team needs)
- GitHub
- DevOps
- CI/CD
- Communication skills
- Agile methodologies