Senior Data Engineer
We are seeking a skilled Senior Data Engineer to join a well recognised organization playing a significant part in community engagement and economic development in Auckland. In this role your expertise in data can drive impactful change and shape the future of community engagement. You will oversee the design, development, and enhancement of enterprise data assets, systems, and integration pipelines.
In this role you will:
- Collaborate with data analysts and architects to create tools and programs that enable smarter decision-making.
- Prepare data for prescriptive and predictive modeling, while developing algorithms to enhance data quality.
- Conduct complex data analysis to interpret trends and build robust data systems and pipelines.
- Utilize Azure Data Lake Gen2 and Synapse Analytics to create data ingestion pipelines.
- Engage with business stakeholders to align on data governance and strategy.
- Implement medallion architecture in your projects, demonstrating a solid understanding of Azure Blob Storage.
- Leverage Azure Machine Learning to drive insights and refine data strategies.
- Analyze and organize raw data with a focus on the bigger picture to extract valuable insights.
Key skill required:
- Python / PySpark
- SQL / PySQL
- Azure Data Factory (Synapse Pipeline)
- Azure Synapse (Apache Spark/Delta lake), Azure SQL DB, or Databricks
- Azure Data-lake Storage, Gen 2
- Azure Service Bus, Azure Function, Logic Apps.
- JSON Knowledge
- Rest API Knowledge
- Understanding of Medallion Architecture & Kimball Methodology
- *Exposure to Snowflake is a bonus*
About You:
We're seeking a data-driven professional who possesses excellent analytical and communication skills. A solid grasp of data strategy and governance is essential, along with the ability to transform business data into actionable insights. If you have aspirations to become a data architect and expertise with Azure technologies, we encourage you to apply!
At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.
...
