Primary skills: Databricks, ADF
Years of experience: 2 – 4 Years
- 2+ years’ experience in software development with Big data technologies
- Proficiency in Python programming languages
- Experience of development and deployment of at least one end-to-end data storage/processing pipeline
- Basic understanding of RDBMS
- Intermediate level expertise in Apache Spark, HDFS and ADLS
- Good communication skills and logical skills
- Prior experience of writing Spark jobs using Python is highly appreciated.
- Prior experience of working with Databricks
- Experience of using maven and git.
- Agile scrum methodologies