Return to Opportunities Apply Now View Team Opportunities

Data

Engineer

  • London

  • £

    450 Per Day

  • Contract

Reference: 37263

Description

twentyAI are currently partnered with a major player within the energy industry specialising in refining, trading and distributing crude oil and petroleum products. The business hosts a diverse team including experts in refining, trading, logistics, safety and various other fields. They play a crucial role in enhancing energy security for the UK and Europe.  

With the launch of a new global tech, they are looking for a Data Engineer to join the team to assist with BAU tasks and communicating all things data to front office teams. The company initiated a multi-year Digitalisation Program, to transform how data is managed and utilised within the business. The vision is to deliver the next generation of big data infrastructure supported by cloud technologies.

Role Responsibilities:
  • Develop, construct, test and maintain data pipelines
  • Assist users of the big data platform navigate the platform, ingest new data, and help debug any issues they are facing
  • Solve challenging data integration problems, utilizing optimal ETL and ELT patterns, frameworks, query techniques, sourcing from structured and unstructured data sources
  • Cleansing, Pre-Processing, and delivery of data for prescriptive and predictive modelling
  • Working with data scientists to build out scalable AI and ML models
  • Develop Data visualisation and Business Intelligence dashboards
  • Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts
Role Requirements:
  • Experience within the Oil/Gas and Commodities industries.
  • Experienced writing data pipelines (ETL and ELT)
  • Good hands-on experience with Python and Python related data tools such as Pandas
  • Proficient experience with PySpark or similarly distributed data processing tools
  • Must have experience with Spark 
  • Experience with SQL (TSQL, ANSI SQL, Spark SQL etc)
  • Good understanding of data and being able to dive into datasets, understand the structure and explain data concepts to stakeholders
  • Experience in developing and supporting analytical models/tools.
Up to £550 per day and 3 days a week in London based office. 
 
Apply Now Return to Opportunities View Team Opportunities

Consultant

Sabrina Patel