Azure Data Engineer

Primary skills: Databricks, ADF
Years of experience: 2 – 4 Years

Mandatory Skills:

• 2+ years’ experience in software development with Big data technologies
• Proficiency in Python programming languages
• Experience of development and deployment of at least one end-to-end data storage/processing pipeline
• Basic understanding of RDBMS
• Intermediate level expertise in Apache Spark, HDFS and ADLS
• Good communication skills and logical skills

Must Have:

• Prior experience of writing Spark jobs using Python is highly appreciated.
• Prior experience of working with Databricks
• Experience of using maven and git.
• Agile scrum methodologies