Data Engineer

Data Engineer

Posted 2 weeks ago by Job Board - Jobserve on JobServe

£450 Per day
Outside
Onsite
Edinburgh, Scotland, UK
p>Data Engineer - Datawarehouse - Python - Postgres - RestAPI - Modern DevOps - 6 month contract outside IR35

Are you a Data Engineer available for new Datawarehousing projects?

Our public sector client, based in Edinburgh, is embarking on an exciting initiative to enhance their data analytics capability by establishing a new Datawarehouse.

I am therefore looking for a skilled and motivated Data Engineer to play a pivotal role in the development and implementation of this major transformation project. As part of a cross-functional team you will employ modern technologies to build a robust and scalable data infrastructure.

Key Responsibilities:

  1. Python and PostgreSQL Development:
    • Use your expertise in Python and PostgreSQL to develop robust and efficient data solutions.
  2. REST APIs:
    • Design and implement REST APIs to facilitate seamless data integration.
  3. DevOps and CI/CD Practices:
    • Employ modern DevOps practices and tools, including Docker, GitLab CI, AWS CodePipeline, AWS CDK, and AWS CloudFormation, to ensure efficient and continuous delivery.
  4. SQL, Data Transformation, and Analysis:
    • Demonstrate expertise in SQL, data transformation, and analysis to derive actionable insights.
  5. Collaborative Software Development:
    • Work collaboratively in high-performing, cross-functional development teams to deliver high-quality software.
  6. ETLs, Data Streaming, and Integration:
    • Implement data ETLs, data streaming systems, and data integration solutions to ensure a seamless flow of data.
  7. Agile Delivery Models:
    • Apply experience in Agile delivery models, such as Scrum and/or Kanban frameworks, to contribute to the iterative development process.

I am therefore keen to speak with candidates who have

  • Prior experience in designing and implementing data warehousing solutions, ideally within public sector environments
  • Familiarity with developing hybrid on-premises/cloud data solutions
  • Knowledge of AWS services including Glue, Lambda functions, S3, RDS, Comprehend, SageMaker, and Data Migration Service
  • Familiarity with Openshift, PostGIS for PostgreSQL, and designing solutions using service and event-based architectures
  • Familiarity with human-centred, research-driven, and inclusive design practices as well as experience of Digital First or GDS quality standards
  • Knowledge and experience of human-centred, research-driven, and inclusive design practices would also be desirable.

Interested? Apply now for immediate consideration!