Job Description

The role:

• Developing and maintaining the team´s Data Lake services.
• Build large-scale batch and real-time data pipelines with data processing frameworks in AWS.
• Create and manage environments for advanced analytics/machine/deep learning and AI.
• Leverages best practices in continuous integration and delivery.
• Pre-process, clean and structures data to facilitate data exploration and advanced analytics/Machine Learning activities.
• Learns and uses modern data preparation, integration and AI-enabled metadata management tools and techniques.
• Perform intelligent sampling and caching.
• Recommend and implement automation in existing and future integration flows.
• Help improving data quality by driving advancements in data acquisition, testing and tooling.
• Ensuring a solid operation and maintenance of our clients platform.
• Automation of system installation and configuration.
• Contributing to Roadmap and other improvements.
• Providing Runtime support for services.

Your profile:

• Minimum 5 years’ experience in the Data Engineer role
• Degree in Computer Science or similar
• Experience in data analysis and data presentations.
• Good analytical and conceptual thinking skills.
• Experienced in AWS lake formation, AWS Glue, AWS Step Function and other AWS analytical Services
• Experience in Python Programming language
• Experience in PySpark

Good-to-have experience:

• Microservice architecture.
• 24/7 Service delivery environment.
• Experience from the Connected Vehicle Industry is a plus.

Required skills - Data lakes, AWS, PySpark, AWS Lake Formation, AWS Glue, Python