Lead Hadoop Developer
Allegis Global Solutions Singapore Pte LtdJob Description
• Perform hands on development to build the data extraction, movement and integration, leveraging state of the art tools and practices, including both streaming and batched data ingestion techniques.
• Create data integration pipelines to extract, transform, and integrate data from a variety of sources and formats for analysis and use across use cases.
• Perform data profiling, discovery, and analysis to identify/determine the suitability and coverage of data, and identify the various data types, formats, and data quality which exist within a given data source.
• Analyse, Design, Develop, Test, Document and Implement solutions.
• Work with source system and business SME’s to develop an understanding of the data requirements and options available within data sources to meet the data and business requirements.
• Create re-usable data extraction/ingestion pipelines and templates to demonstrate the logical flow and manipulation of data required to move data from source systems into the target data lake and/or sandbox.
• Assist in creation of data requirements and data model design as necessary and appropriate.
• Help maintain code quality, organization, and automatization
• Plans and tracks implementations
• Ensures bugs are tracked to a satisfactory closure during all stages of test
• Undertakes continuous improvement for the current Infrastructure
Our Ideal Candidate
• Minimum 8+ years of hands-on working experience in Big Data platform.
• Should be good in Java/Scala and Unix Shell Scripting.
• Knowledge in Integrated Development Environment (IDE) such as Eclipse and IntelliJ.
• Strong query language skills (SQL, Hive, ETL, Hadoop, Spark).
• Strong data analysis skills using Hive, Spark, R, Microstrategy and Tableau.
• Experience in scheduling tools like Control-M, Oozie.
• Data Integration, Data Security on Hadoop ecosystem.
• Documentation - Requirements/Use Cases/Business Rules/User Stories/Test Cases/Design/Architecture/Data Dictionary, Etc.
• Knowledge in DevOps technologies will be an added advantage.
• Proven problem-solving skills.
• Self-starter with the ability to work independently or as a team.
• Should have an attitude to adopt quickly to the changes.
• Excellent written, communication and presentation skills.
• Experience of working in Agile environment.
Diversity and Inclusion
Standard Chartered is committed to diversity and inclusion. We believe that a work environment which embraces diversity will enable us to get the best out of the broadest spectrum of people to sustain strong business performance and competitive advantage. By building an inclusive culture, each employee can develop a sense of belonging, and have the opportunity to maximise their personal potential.
Job Details
Employment Types:
Industry:
Function:
Roles:
Skills:
Education:
Allegis Global Solutions is the exclusive Contingent HR services provider for one of the world’s leading banks.
At Allegis Global Solutions we’re proud to be the leader in global talent solutions. We draw upon decades of industry expertise to develop innovative tools, products, processes and strategies focused on outcome. Moreover, we’re incredibly proud to have built a culture that empowers our people to make their mark while making deep connections that will last a lifetime. With our passion and culture for talent, we are truly transforming the way the World acquires talent.
Our Client is one of the world's most international banks with over 1,100 branches, offices and outlets in 67 countries. They operate in some of the world's most dynamic markets and have been for over 150 years. More than 90 per cent of their income and profits are derived from Asia, Africa and the Middle East. Their brand promise, Here for good, underlines their distinctive approach.
Similar Jobs
People Also Considered
Career Advice to Find Better
-
Job Search Strategy
-
Interview Tips
-
Resume & Cover Letters
-
Salary Negotiation
Simple body text this will replace with orginal content