DataOps Engineer (mfd)

Posted

9/23/2024

Role

Data Engineer

Location

Unknown

Remote

Discuss with client

Project Description

Our client in Bavaria is seeking a DataOps Engineer (m/f/d) starting in November to architect and develop automated data pipelines on Azure, implement data ingestion processes using Azure Data Factory, and set up CI/CD pipelines for data workflows with Azure DevOps. The ideal candidate will optimize ETL/ELT processes for performance and scalability, implement monitoring solutions using New Relic and Azure Monitor, and ensure data governance compliance with Azure Purview. Experience with Data Vault 2.0 architectures, Lighthouse architecture, and data observability solutions on Azure is required. Strong skills in Python, SQL, and Azure services, along with a background in data engineering, relational and NoSQL databases, and cloud storage, are essential. Excellent communication, problem-solving abilities, and collaboration skills are key for this position.

Skills

Microsoft AzureArchitekturDataopsAzure Data FactoryData GovernanceData VaultSql AzureWorkflowsCosmos DbAzure Synapse AnalyticsNew RelicCloud-SpeicherDatenbankenContinuous IntegrationInformation EngineeringEtlDatenqualitätRelationale DatenbankenSteuerungHipaaPythonPostgresqlNosqlParallel ComputingSqlTestenDatenschutzIndexerDatabricksProgramming Languages
Go to Project Page