Our client is a leading Investment Banking, they are seeking an experienced and dedicated Java Spark Big Data Software Engineer to join the fast-growing technology team. As a member of the Data Tech team, you will be responsible for designing, developing, and implementing scalable big data solutions using Java and Spark. Your expertise in handling large, complex datasets and implementing efficient data processing solutions will be crucial in driving the success of our investment banking operations.
Responsibilities:
Design, implement, and optimize distributed big data systems using Java and Spark to handle large volumes of structured and unstructured data.
Collaborate with cross-functional teams to understand business requirements and translate them into technical designs and data models.
Develop and maintain highly efficient data processing pipelines, ensuring data quality, accuracy, and overall system performance.
Conduct thorough testing and debugging of developed software to ensure it meets functional and performance requirements.
Continuously monitor and optimize the performance of big data applications, identifying areas of improvement and implementing necessary changes.
Stay updated with the latest trends and advancements in big data technologies, and provide insights and recommendations for their adoption to enhance system capabilities.
Work closely with internal stakeholders, including traders, data scientists, and analysts, to understand their needs and shape the development of data-driven solutions.
Collaborate with DevOps teams to ensure seamless deployment and operation of big data applications in production environments.
Contribute to the documentation and provide technical support to end-users, assisting with troubleshooting and issue resolution.
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field. Advanced degree preferred.
Extensive experience (5+ years) in software development, with a focus on Java and Spark for big data processing.
Strong understanding of large-scale distributed systems and concepts; experience with systems such as Hadoop, Cassandra, and Kafka is highly desirable.
Proficiency in SQL and data modeling techniques, with hands-on experience working on complex data analysis and transformation projects.
Solid understanding of software development best practices, including agile methodologies, unit testing, and version control (GIT).
Strong problem-solving skills and ability to quickly grasp and troubleshoot complex issues.
Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and present technical concepts to non-technical stakeholders.
Solid understanding of the financial industry, preferably with experience in investment banking or related sectors.