Azure Data Engineer (mwd) - Köln

Project Description

Are you passionate about the ever-evolving technological landscape in IT? Are you a self-employed, proven expert in your field with a strong focus on customer satisfaction? Join us in shaping the digital future through engaging and diverse client projects that require your expertise in modern IT. We are an open, straightforward, and entirely IT-focused team where successful project completion is our main priority. Collaboration with us is essential to effectively tackle the digital challenges of the future. We are currently seeking an Azure Data Engineer (m/f/d) on a freelance basis for a major client project running from September 2024 to December 2024, with a part-time commitment of 3-4 days per week and potential for extension. Your tasks will include developing and implementing scalable ETL pipelines using Apache Spark and Databricks, building efficient data processing workflows in Scala and SQL, orchestrating complex data pipelines with Databricks Workflows, setting up CI/CD pipelines in Azure DevOps for automated testing and deployment, managing cloud infrastructure in Azure using Infrastructure as Code (Terraform), and integrating various data sources and targets like MS SQL Server and Azure Synapse Analytics. The project requires in-depth knowledge of ETL processes development with Apache Spark and Databricks, excellent programming skills in Scala and SQL, experience with Azure DevOps and CI/CD pipelines, familiarity with Azure services (especially MS SQL Server and Synapse Analytics), hands-on experience with Infrastructure as Code (preferably Terraform), and strong analytical abilities with a solution-oriented mindset. Enjoy simplified billing through our online credit portal, timely and reliable payments, a range of project opportunities with reputable clients in the public sector, constructive collaboration with our consulting team regarding your project needs, and established compliance processes. Feel free to reach out for more details on this opportunity or others, and to ensure a speedy response, kindly provide the reference number.

Skills