Junior Data Engineer mit DevOps Anteil (Apache Nifi, Pulsar, AirFlow, Grafana, JupyterLab, Python, Linux, SQL, Azure, AWS) (mwd) RemoteFrankfurt

Posted

9/25/2024

Role

Data Engineer

Location

Unknown

Remote

Discuss with client

Project Description

Our client, a project in Frankfurt, is seeking a Junior Data Engineer with a DevOps focus for their project focusing on Automatic Damage Detection on Freight Cars. The project involves exploring the use of Artificial Intelligence to analyze image data of freight cars for damages and determine its operational feasibility. The selected candidate will be involved in migrating MLOps pipelines to Azure/BuildIT platforms, developing ETL processes in a Big Data environment, and supporting the operational testing of AI use cases. The ideal candidate must have a strong foundation in Big Data tools such as Apache Nifi, Pulsar, AirFlow, Grafana, JupyterLab, as well as advanced skills in Python, Linux, SQL databases, and basic knowledge of Azure. Additionally, familiarity with Apache Hadoop/HDFS, Apache Drill, AWS Cloud, agile project environments, and a proactive, flexible, and open communication approach are desired attributes for this role.

Skills

AirflowAmazon Web ServicesMicrosoft AzureBig DataLinuxPythonSqlGrafanaApache NifiApache Http ServerDevopsKünstliche IntelligenzCloud ComputingDatenbankenBeratungEtlVertriebApache HadoopHadoop Distributed File SystemOpen SourceProduktionsmanagementSpeditionSensorik
Go to Project Page