As an Azure Data Engineer you will build and maintain the required data infrastructure for the Group's digital projects. You will ensure that Group data, stored on-premise or in the cloud, are used optimally and efficiently, leveraging modern technologies. Your responsibilities will be the following:
- Developing, testing, and maintaining scalable and reliable data pipelines and architectures that collect, transform, and integrate data from various sources and formats.
- Applying best practices and standards for data engineering, ensuring data quality, security, privacy, and compliance.
- Designing and optimizing data models and schemas for different data storage systems, such as relational databases, NoSQL databases, data lakes, or data warehouses.
- Supporting the deployment and operation of data products and solutions in production environments, using cloud technologies and tools such as Azure and Kubernetes in line with Group’s policies and the relevant use case requirements.
- Collaborating with data scientists, analysts, and other stakeholders to understand their data needs and requirements, and providing them with easy access to the relevant data sets and analytics platforms.
- Helping improve ongoing reporting and analytics processes automating or simplifying data management procedures.
- Staying up to date with the latest trends and innovations in data engineering and related fields, and exploring new tools and methods to improve data efficiency and quality.