Data Engineer

Posted

7/18/2024

Role

Data Engineer

Location

Germany

Remote

Discuss with client

Project Description

Looking for a skilled software developer with at least 3 years of experience in setting up and optimizing Enterprise Data Warehouse and Data Lake structures, Data Engineering, OLAP databases, Python programming, ETL tools (e.g. Airflow), data modeling/architecture (3NF, Kimball, Inmon, DataVault 2.0), interfaces, APIs (Rest, Soap, as well as crawlers, scrapers), databases, data storage systems, data modeling, search engine technologies (preferably Elastic Search), building data pipelines and streaming processes, extensive experience in interface technologies, especially HTTP, REST, and JSON. The role involves developing barrier-free IT applications using Java technologies, operating a Data/Analytics platform consisting of Data Lake and Datawarehouse, ensuring compliance with Data Engineering standards, optimizing current solutions, developing project documentation, integrating and monitoring heterogeneous data sources, and providing data to consumers through interfaces while ensuring data consistency and timeliness. Proficiency in both German and English is required. The position starts on February 15, 2022, with a duration of weeks.

Skills

JavaAgile developmentScrumKanbanData LakeDatawarehouseData EngineeringOLAP databasesPython programmingETL tools (e.g. Airflow)Data modelingAPI (RestSoapCrawlerScraper)Database systemsSearch engine technologies (Elastic Search)Data pipelinesStreaming processesInterface technologies (HTTPRESTJSON)
Go to Project Page