Hiring Experienced Data Engineer for AWS-Based Data Pipeline Development

Project Description

We are in need of a skilled Data Engineer to join our team on a freelance basis, with a focus on managing data flow, designing data pipelines, and utilizing AWS services for both batch and real-time data processing. The ideal candidate should have a strong background in AWS, experience in orchestrating data pipeline processes, and managing API integrations. Responsibilities include handling data flow management, creating robust data pipelines, leveraging AWS services like S3, DynamoDB, and RDS, and employing services such as Data Stream, Firehose, Kinesis, ECS, Fargate, Lambda, and API Gateway. The candidate should have proven experience with batch and real-time data processing, be detail-oriented, possess excellent communication skills, and work collaboratively within a team. Preferred qualifications include experience with large-scale data processing and familiarity with financial data APIs like EDGAR. Applicants should submit a proposal and cover letter showcasing their experience in data engineering and AWS.

Skills