Data Engineer : Kafka, Nifi, SPARK, Scala/PySpark/Java/Python, Docker, DevOps – Ariana

Description de l’annonce:

Our IT Department – Group Information Systems (GIS) is looking for a Data Engineer for our Digital Services Factory in Tunis, Tunisia.

Main duties and responsibilities

We are looking for a Data Engineer that will work on the collecting, storing, processing, analyzing of huge sets of data, and help us make smarter decisions

• Develop data solutions
• Contribute to functional analysis with the business users and translate user’s needs into structured “Data Pipeline”
• Prepare data for predictive and prescriptive modeling and Develop data set processes
• Mock-up the solution in agile manner together with the key-user
• Develop and test each solution component until its industrialization Develop and automate continuous deployment pipeline and DevOps
• Support users

• Contribute to the evolution of the DSF Data platform and ability to contribute in system improvements and innovations
• Work with Agile and DevOps techniques and implementation approaches in delivery 
• Continuous improvement actor
• Keep constant track of open source market evolutions (assess new tools, anticipate obsolete ones)
• Contribute to platform industrialization initiatives and actions plan
• Share his expertise with other team members to facilitate knowledge transfer

Qualifications:

• Minimum of 2 years of experience in a similar position
• Hadoop ecosystem/stack and proficient understanding of distributed computing principles
• Kafka, Nifi
• Framework SPARK
• Scala/PySpark/Java/Python
• Open source skills, Linux and Docker technologies
• Knowledge of at least one industry standard orchestration tool (Jenkins, GitLab CI, Azure DevOps)
• Agile and DevOps delivery practices, experience with continuous integration, automated code reviews and regression testing using tool
• Communication skills
• Excellent English skills

Postuler ici