HOME
Data Engineer
Thanks for submitting your CV. We’ll be in contact should your application be short-listed
Something went wrong, please try again.
Job Description
- Perform analyses on data using SQL as well as Data Mining Algorithms
- Collaborate with data stewards, data architects, and data engineers to design, implement and deliver successful data solutions
- Drive engineering best practices, set standards and propose larger projects which may require cross-team collaboration
- Define technical requirements and implementation details for the underlying data lake, data warehouse and data marts
- Involved in the design and implementation of full cycle of data services, from data ingestion, data processing, ETL to data delivery for reporting
- Identify, troubleshoot and resolve production data integrity and performance issues
- Design, develop and support various data platform applications
- Design and develop applications to process large amounts of critical information in batch and near real-time to power business insights
- Experience in managed services for data ingestion/processing
- Experience with Presto, Hive, Impala or similar SQL based engine for Big Data
- Experience with Cassandra, MongoDB or similar NoSQL databases.
- A solid understanding of NoSQL data stores with extensive experience in working with SQL, script languages (Python, shell etc.)
- Proven experience of distributed systems driving large-scale data processing and analytics
- Expertise with RDMS and Data Warehousing (Strong SQL)
- Experience working with BI and data warehousing tools building data pipelines and real-time data streams.
- Expertise in Python, pySpark or similar programming languages
Proficient in writing technical specifications and documentation
Ref: 9338 | Published: 21 Jun 2019