Jobs in London - Big Data Lead Engineer • Central London

Company: RED Global

Central London

Red are currently supporting an IT Consulting Giant who are currently looking for Big Data Lead Engineer. This a fantastic opportunity to work on a long term freelance project in London and will require someone who can travel to the London office 3 days per week. Details of the role are as followed: * Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively.* Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytic techniques.* Develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.* Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.* Build observably into our solutions, monitor production health, help to resolve incidents, and re mediate the root cause of risks and issues.* Understand, represent, and advocate for client needs.* Codify best practices, methodology and share knowledge with other engineers in shape the Data and Distribution architecture and technology stack within our new cloud-based data lake-house.be a hands-on contributor, senior lead in the big data and data lake space, capable to collaborate and influence architectural and design principles across batch and real time flows* Have a continuous improvement mindset, who is always on the look out for ways to automate and reduce time to market for deliveries.