Data Engineer

Data Engineer

Ref: 273Thursday 22 September 2022

Job description

Work on an advanced data analytics platform at the forefront of the FreightTech wave digitising global supply chains. Working with some of the world’s largest freight companies helping them optimise their operations.

You will help develop, maintain, and improve solutions that extract raw data from multiple sources, combine and enrich that data and ultimately, deliver reliable datasets to our advanced analytics product.

The solution has been created using serverless technology running on Google Cloud and a combination of Dataflow and Cloud Functions.

You will:

  • work with Solution Engineers to understand customer requirements
  • extract data from third-party sources, via database or API integration
  • analyze raw data
  • build and maintain data pipelines
  • work with front-end engineers to develop back-end services used by the client application

Requirements:

  • Have 1 – 3 years experience as a Data Engineer or Software Engineer
  • Hands-on knowledge of Python
  • Experience with database design and writing SQL scripts
  • Git

Desirable Skills:

  • Apache Beam (or similar), Elasticsearch ,Serverless , Nodejs ,GraphQL