Data Engineer at Revent Technologies Limited

• As a Data Engineer, you will be accountable for designing, developing and deploying ETL jobs to process petabytes of data through our big data platform, to enable analytics initiatives and data science.
• You will be passionate about big data, working daily on data extraction, load and transformation in big data environments to ensure the successful, on-time, delivery of high-quality data.

ACCOUNTABILITIES

• Design and develop ETL jobs in big data environments to process petabytes of data.
• Build reusable frameworks or jobs which can be used in different projects.
• Developing code to automate jobs using real-time services, and flexible coding to remove dependencies.
• Manage Data Services and Data Quality transformations using SQL: Analyzing redundant and inconsistent data.
• Own continuous improvement and performance testing: Document ETL-related issues and perform RCA, identify long running jobs and optimization opportunities.

QUALIFICATIONS, EXPERIENCE & SKILLS

• 3 - 4 years’ experience
• Development experience in EITHER: Talend Big Data Edition on Hadoop or BODS
• Hands on experience in ETL design, source-target mapping, developing and performance tuning complex ETL code
• Experience with Infrastructure automation, build automation and deployment automation
• Experience in working with GIT, SVN or VSTS
• Experience in connecting to heterogeneous sources including SAP ECC, Hadoop, Hive, Amazon, Azure, Salesforce, SAP among others
• Experience with multiple file formats and file location objects including SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3
• Good understanding of HDInsight cluster, Microsoft SQL Servers as well as RDBMS databases & No-SQL databases
• Knowledge of Slowly Changing Dimension, ABAP Data flow Extractions, Star Schema, Snowflake Schema, OLTP and OLAP
• Hands on experience of cloud platforms, especially Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP)
• BA/BS in Computer Science, Computer Engineering. Engineering, Statistics/Mathematics or similar
• Proficient in English, other languages beneficial

COMPETENCIES

• A true self-starter, who dreams big, and is motivated by a challenging and fast-paced environment
• Ability to manage conflicting priorities under pressure
• Strong relationship management, communication and collaboration skills: effectively working with technical audiences