Posted
8/14/2024
Role
Data Engineer
Location
Germany
Remote
Discuss with client
Project Description
We are looking for a highly experienced Data Engineer to join our team and take on the responsibility of developing data pipelines for data ingestion and processing, creating data models for data storage, integrating data from various sources, optimizing databases and data processing processes, automating data processes, developing solutions to scale the Data Lake infrastructure, integrating data into applications, testing, troubleshooting, and testing Data Lake operations, providing innovation insights and testing new technologies and tools, and maintaining technical documentation in Confluence and Jira projects. The ideal candidate should have a minimum of 7 years of extensive experience in database systems such as PostgreSQL, MSSQL, MySQL, Oracle, operating systems like Linux and Windows, programming languages including Scala, Java, Python, Shell, SQL, version control systems like Gitlab and GIT, AWS cloud and Big Data technologies like AWS S3, Glue, Athena, Quicksight, EC2, RDS, EMR, RDS PostgreSQL, Lambda, Apache Spark, Apache Airflow, React, Springboot, SOAP/REST, as well as proven leadership in implementing new processes and tools to enhance productivity and quality in data processing operations, ad-hoc software development within recognized frameworks such as Gitlab, XML, HTML, JSON, SOAP, REST, experience with agile methodologies like SCRUM, SaFe, DevOps, and agile frameworks, and at least 3 years of experience with IVU Traffic Technologies (IVU.suite), RBL and ITCS systems, passenger counting systems, revenue management systems, and certifications in Software Engineering, Data Engineering, and Big Data from recognized certification bodies like AWS, iSAQB, Cloudera, or equivalent.
Skills