Working with business stakeholders to understand high value business problems that can be solved through the application of data processing and analytical systems.
Helping to design, build and support a new cloud-based analytics platform for the business.
Being a core and professional member of the Data Engineering Team
Understand business requirements and help refine into development tasks and estimate their complexity.
Quick progression of projects from proof-of-concept to post-production stage
Communication and presentation of ideas to colleagues in all parts of the wider tech team
Participating in code reviews for the Data Engineering Team
Requirements and Experience
Strong knowledge of, or ability to rapidly adopt our core languages for data engineering – Python, SQL and Terraform.
Knowledge of analytics platform like Snowflake.
Knowledge of data transformation tool like Dbt.
Knowledge of Data science workbench tools like Dataiku
A good understanding of CI/CD and experience with one of the CI/CD tools – Azure DevOps, GitLab or Jenkins.
A robust understanding of core data engineering topics – ETL vs ELT, structured and unstructured data, data quality and data governance.
Ability to contribute to all aspects of a solution – design, infrastructure, development, testing and maintenance.
Effective collaboration with technical and non-technical team members through agile ceremonies – roadmap planning, feature workshops, backlog elaboration, code review.
A good understanding of traditional data warehousing and modern warehousing techniques and services.