ETL Developer (Hadoop)

Job Title: ETL Developer (Hadoop)
Contract Type: Permanent
Location: Selangor
Salary: RM10,000-RM15,000
Contact Name: Priya Supramaniam
Contact Email:
Job Published: November 21, 2019 14:30

Job Description

About our client

A world-wide prominent entertainment & media industry, expanding their Global Technology team.


About the role

This role is responsible for developing and supporting various global enterprise applications from onsite premise to cloud-based Data Warehouse, Business Intelligence and Data Analytic solutions. These solutions integrate closely with our new core Music Publishing application, hosted on AWS (Amazon Web Services) for internal employees and an external portal for our contractual parties.


Your responsibilities

  • Responsible for advising and applying technical best practices for data modelling, data movement, data quality, data cleansing and other ETL-related activities to meet business and data requirements.

  • Review overall data solution particularly from data loading and performance perspective and perform thorough root cause analysis to take appropriate improvement actions.

  • Perform unit tests on all ETL processes and prepare required programs and scripts.

  • Produce and maintain technical specification documentations related to both system and data for all ETL processes.

  • Provide technical support and troubleshooting services on need basis for production matters.

  • Collaborate with local Technology Team on a day-to-day basis and with Los Angeles technical team on need basis. When required, must be flexible in schedule to facilitate real time communication with offshore team via Skype, phone, or other tools.

  • Share knowledge and mentor team members.


You will have


  • Min 3 years solid experiences in ETL development using preferably Hadoop, Microsoft SQL Server Integration Services or any other ETL tools.

  • Hands on in Java.

  • Hands on and proficient in NoSQL, RDBMS, CQL, PL/SQL, T-SQL or any other DB technologies.

  • N-Tier enterprise application development in a distributed environment.

  • Multi-threaded programming knowledge.

  • Completed at least 2 full Agile development life cycles.

  • Knowledge of logical and physical data modelling concepts (relational and dimensional).


  • Min Bachelor Degree in Computer related field or equivalent work experiences.


  • Databases – Amazon Redshift, Cassandra, Ms SQL Server, Oracle.

  • ETL Tools – Hadoop, Ms SQL Server Integration Services.

  • Scripting - CQL, PL/SQL, T-SQL, SQL, Java, Unix/Linux Shell.

  • Data Modelling – Star schema, Snowflake schema, Galaxy schema.

  • Good troubleshooting and analytical skills.

  • Excellent communication in English and inter-personal skills.

  • Experience with rapid release software (continuous delivery) development practices (Agile/Scrum).


  • Able to work independently with minimal supervision.

  • Excellent team player contributing to the team success.

  • Ability to work and collaborate with remote team.

  • Ability to communicate difficult technical concepts in a straight-forward, simple manner.

  • Passion for innovation and technology.