MENU
   
Welcome!! Register or Login

    Job details


Offer: Data Engineer:

Job description:

JOB DESCRIPTION

Data Engineer
 
Data Engineer job in Kuala Lumpur.
 
Our client, a global organization is currently seeking for a Data Engineer who will work on collecting, storing, processing and analysing huge sets of data. Main responsibility will be to design technologies that will wrangle, standardize and enhance the master data and transactional date repositories, then build operational and monitoring processes to govern that data.
 
Other Job responsibilities:
- Build infrastructure required for optimal ETL of data from wide variety of data sourcing using pySpark, AWS and other big data tech
- Create and maintain enterprise-wide integration pipeline leveraging Kafka, Spark Streaming, Microservices, Microbatch architectures
- Identify, design and implement internal process improvements: automating manual
- Processes, optimizing data delivery, redesigning infrastructure for greater scalcapability
- Work with stakeholders including the executive, DataOps and business teams to assist with data-related technical issues and support related data infrastructure needs
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our enterprise data hub into an innovative industry leader
- Manage database running on postgreSQL, Snowflake, Redis, Redshift, dtabricks
- Monitor performance and advice on necessary infrastructure changes as needed
 
Requirements:
- 4-6 years practice implementing production systems in the cloud(preferably AWS)
- practice with multiple Apache ecosystem application like: Spark, Hadoop, Hive, Kafka
- practice with object oriented/ object function scripting Required languages java, Python, pySpark, Pandas
- practice with stream-processing systems: Spark Streaming, Kafka, Kinesis
- Data Intergration practice- Kafka, Spark Streaming, microservices, microbatches
- practice with AWS Cloud Services
- practice with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, Streamsets
- practice with relational SQL and NoSQL databases including PostgreSQL, MSSQL, Redis, MangoDB
- practice with buid systems: github, bitbucket, Jenkins, jira, Terraform
- BS/MS in Computer Science, Math or equivalent
 
If you are keen for this opportunity, click on the “apply now” button or you may also want to directly reach out to Theresa at [email protected] for further discussion and enquiries.

 

WORK LOCATION

Address

The Gardens South Tower, Mid Valley City, Lingkaran Syed Putra, 59200 Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

RECRUITMENT FIRM SNAPSHOT

Average Processing Time

More Than 2 Weeks

Registration No.

604061-V  

Industry

Human Resources Management/Consulting

Website

http://www.malaysia.rgf-executive.com

Telephone No.

603-22871828

Company Size

501 - 1000 Employees

COMPANY OVERVIEW

RGF Executive Search provides talent acquisition from C-suites to a wide variety of managerial positions on both a retained and contingent basis across all industries and functions by covering 26 cities in 11 countries and markets in Asia. We have tenured consultants working in every major city, anchored by regional practice teams that bring deep specialization, know-how, cross-border market insights, and talent that other agencies and in-house teams find hard to match.
 
We see executive search as much more than filling a function— Information technology is about bringing impactful leadership abilities to every company we work with to fulfill organizational goals, strategic planning development and overall decision making that affects the entire business organization. We also enable talent to find the best career growth path to unleash their potential.

 

Skills:

Job Category: Creative Arts/Media [ View All Creative Arts/Media Jobs ]
Language requirements:
Employment type:
Salary: Unspecified
Degree: Unspecified
Experience (year): Unspecified
Job Location: Kuala Lumpur Kuala Lumpur
Address: Kuala Lumpur
Company Type Employer
Post Date: 11/18/2018 / Viewed 32 times
Contact Information
Company:


Apply Online

Job Category:
Job Location:   
Enter Keywords (e.g. Consultant, IT):