Posted
7/12/2024
Role
Data Engineer
Location
Estonia
Remote
Discuss with client
Project Description
A client is seeking a Data Engineer proficient in ETL pipelines, Apache Airflow, data extraction, DevOps, Amazon Web Services, and Amazon Redshift to set up an ETL pipeline for scraped data from various websites of consumable goods. The goal is to clean and transfer the data from different databases and S3 files into a Data Warehouse. The client will be using this data for creating machine learning models and real-time analysis through dashboards. The setup will likely involve AWS services, specifically Redshift and AWS Glue, although alternative solutions can be proposed. The project offers an hourly rate ranging from $30.00 to $60.00 and is based in Estonia.
Skills