Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) at Primus Connect

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog)
3 - 6 months
Remote (UK Candidates Only)

£550 - £600 per day 
Outside IR35

We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts.

As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with responsibilities of end-to-end design, build and deployment of industry-leading big data and AI applications.

Your work will be varied and your responsibilities will include:

• Designing, developing, and managing end-to-end data pipelines
• Data processing and transformation using Spark
• Providing technical governance to enhance ways of working
• Champion DevOps and CI/CD methodologies to ensure agile collaboration and robust data solutions
• Engineer and orchestrate data models and pipelines 
• Lead development activities using Python, PySpark and other technologies
• Write high-quality code that contributes to a scalable and maintainable data platform
   

To be successful in this role, you will need to have the following qualifications:

• Experience with Big Data Technologies such as Spark, Kafka in a customer-facing post-sales, technical architecture or consulting role
• Experience working on Big Data Architectures independently
• Comfortable writing code in Python
• Experience working across Azure including Azure Data Factory, Azure Synapse, Azure Delta Lake Storage, Delta Lake etc
• Experience with Purview, Unity Catalog etc
• Experience with streaming Data in Kakfa/Event Hubs/Stream Analytics etc
• Experience working in the Databricks ecosystem
• MLOps
   

This is an exciting contract opportunity working at the cutting edge of technologies.

To be considered, please click apply