data engineer.

As a Data Engineer you will join a team of talented professionals and your duties will be the following:

• Utilize data management and processing capabilities in PySpark/SparkSQL/SQLto design, build, and optimize scalable data pipelines
• Leverage the big data platforms for large-scale data processing, ensuring efficient data workflows and integration
• Implement robust ETL processes to extract, transform, and load data from various sources into data lakes and warehouses
• Identify, troubleshoot, and resolve data quality issues, ensuring the integrity and reliability of data across all pipelines
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning models through well-engineered data pipelines
• Optimize data storage and retrieval for both batch and real-time data processing
• Work with diverse datasets, ensuring data availability and consistency for stakeholders

.

• 3+ years of hands-on experience in data engineering and data pipeline development
• Proficiency in PySpark/SparkSQL/SQL for big data processing and optimization
• Familiarity with cloud platforms for deploying and managing data infrastructure
• Solid understanding of ETL processes, data warehousing, and data lake architectures
• Degree in IT or related field
• Military obligations fulfilled, if applicable
• Experience with version control systems (e.g. Git) and CI/CD pipelines for dataengineering
• Cluster Tuning experience, for optimization of performance
• Experience in banking industry