Featured

Data Engineer

Posted 14 December 2024
Salary £400 - £600 per day, Benefits: Negotiable
LocationGreater London
Job type Contract
Discipline Data
ReferenceBH-112119
Contact NameNathan Peters

Job description

Data Engineer – Hiring ASAP


Start date: ASAP
Duration: 6 Months
Location: 100% Remote or if you want, 2 days in the London office
Rate: £400-£600 per day
Interview Process: 2 stages, virtual
 
Summary:
 
This role will play a crucial part in improving the business intelligence capabilities of our client. The main goal for this role is to migrate our clients’ existing data infrastructure from basic ETL jobs to streaming infrastructure where possible and to improve the code quality and extensibility of ETL systems. This will be a project focused contract with potential to extend based on business requirements.

Responsibilities:

Collaborate with the team to:
- Understand and analyse the reported issues, tickets, and challenges.
- Assist other team members with Pull Requests & Pair programming where required.
- Refine technical specifications for new features and project.

Implement effective solutions to project:
- Using AWS technologies such as MSK, S3, Glue, Redshift
- Using tools such as Flink or Spark

Communicate effectively with the wider team
- Provide updates on the progress of issue resolution.
- Document solutions in Jira ticket comments and Confluence pages.
- Show and tell new features on completion.

Participate in whiteboarding and workshops alongside the team to build technical plans.

Collaborate with cross-functional teams to enhance product features and functionalities based on client requirements and feedback.
 
Skills:
 
  • 5+ years of experience in software engineering
  • Experience working with data infrastructure on AWS.
  • Experience working with Flink or Spark streaming.
  • Familiarity with version control systems (e.g., Git) and package managers (e.g., npm).
  • Strong SQL / Analytical skills for understanding aggregations.