Data Engineering (Fokus Daten) (mwd)

Posted

8/14/2024

Role

Data Engineer

Location

Unknown

Remote

Discuss with client

Project Description

We are currently seeking external consultation for one of our projects in the automotive industry, specifically focusing on operational advisory tasks aligned with the role of a Data Backend Engineer (Data focus). The main project tasks include ensuring reliable data delivery from Azure Synapse to PowerBI, creating various ETL pipelines to gather data from different local sources and query endpoints (REST APIs and GraphQL queries), developing Python scripts for integration using different client types, and utilizing SQL skills for data transformation from various databases into reports. The required skills for this role include strong programming knowledge in Python and SQL, the ability to set up ETL processes and conduct the development and maintenance of data pipelines, familiarity with Big Data technologies, particularly Apache Spark, expertise in data modeling and best practices, optional knowledge of IT architecture for solution and system design coordination with existing solutions, and proficiency in a range of technologies such as Azure Services, Synapse Analytics, Python, Apache Spark, and more. Experience in the automotive industry is preferred, and fluency in both German and English is required. The project duration is immediate until at least the end of the year, with a possibility of extension, and the workload is full-time with a remote working location. If you are interested in this project, please send your current profile along with your remote hourly rate. Further insights into the project environment will be provided during discussions. Thank you and we look forward to hearing from you.

Skills

PythonSqlAutomobilindustrieMicrosoft AzureInformation EngineeringEtlDatenmodellApache SparkGraphqlApisData AnalysisBig DataBeratungProjektauftragPower BiSystem DesignDaten- / DatensatzprotokollierungBackendPytestData LakePysparkDatenlieferung
Go to Project Page