Our client, a leading financial institution, is looking for good senior data engineers for their upcoming real-time big data projects. The selected candidate will be responsible for the new development and design of the cloud-based data platform. Great opportunity for data engineers to grow in a data-driven financial institution.
Responsibilities:
Design, develop and maintain data pipelines for the real-time data platform
Understand and review project requirements with business and technology stakeholders
Evaluate the existing data models and plan new best solutions
Coach the junior team members on data technology
Requirements:
Ideally 6+ years of experience in data engineering
Strong experience in Python with relevant frameworks, such as PySpark, Pandas, Keras, etc.
Experience with Apache Kafka or other real-time streaming technology will be a huge advantage
Solid experience in working on cloud-based data platforms (AWS, Azure, GCP)
Working experience in a financial institution/tech-driven company is preferred