Data Engineer (mwd) 90% remote ID00912

Posted

9/25/2024

Role

Data Engineer

Location

Unknown

Remote

Discuss with client

Project Description

A freelance professional with expertise in Big Data tools such as Apache Nifi, Apache Pulsar, Apache AirFlow, Grafana, JupyterLab, and advanced Python knowledge is sought for an engaging role in the transportation sector. The project involves participating in the migration of MLOps pipelines to Azure / BuildIT, with a thorough understanding of the current system required for operational management (approximately 2 hours per day). The focus will be on identifying weaknesses and opportunities for optimization before the prospective migration from AWS to Azure takes place (expected in Q4 2024 and H1 2025). Proficiency in Linux, SQL, and Azure is essential, while knowledge of Apache Hadoop and Apache Drill would be advantageous. Interested candidates are invited to apply with their CV and hourly rate.

Skills

Apache Http ServerMicrosoft AzureAirflowAmazon Web ServicesBig DataBeratungLinuxApache HadoopPythonProduktionsmanagementSqlVulnerabilitätGrafanaApache Nifi
Go to Project Page