Associate Data Engineer

The SpringCube team curated the following job opportunity to help you in your

job search. Explore the position below to find your next career move.

Company Overview

This global gaming lifestyle brand is on a mission to revolutionize the way the world games. It offers a dynamic environment where individuals can make a global impact while collaborating with teams across five continents. The company fosters a unique, gamer-centric culture that promotes accelerated personal and professional growth.

Job Title: Associate Data Engineer

Job Description:

This role involves building and maintaining high-volume big data processing systems that enable the organization to collect, manage, and convert raw data into usable information for data scientists and business analysts, ultimately enabling the use of Artificial Intelligence (AI) capabilities. The individual will be responsible for developing and maintaining data pipelines, data storage systems, and cloud infrastructure, while working closely with data scientists, data analysts, and internal stakeholders to utilize data for analytics and AI capabilities.

Essential Duties and Responsibilities:

• Develop and maintain data systems and data pipelines that enable the organization to store, process, and analyze large volumes of data. This includes developing data pipelines, implementing data storage systems, and ensuring effective data integration to support AI applications.
• Manage data lakes and data warehouses by populating and operationalizing them. This involves creating and managing table schemas, views, materialized views, including tokenization and vectorization techniques for Gen AI.
• Develop template data pipelines that enable extract, transform, and load operations from various sources. This involves using cloud computing tools to build streaming and batch processing pipelines that handle large volumes of data, which can also be used for AI applications.
• Monitor and troubleshoot data workflows, ensuring timely resolution of failures and rerunning failed jobs to ensure data completeness.
• Leverage modern build tools to enhance automation, data quality, testing, and deployment of data pipelines.
• Develop and implement cloud infrastructure that aligns with the company’s security policies and practices, as well as cost optimization practices.
• Collaborate with data scientists, data analysts, and business users to understand the data needs of various stakeholders across the organization and implement appropriate solutions.

Pre-Requisites:

Requirements:

• Bachelor’s or Master’s degree in computer science, engineering, mathematics, or a similar discipline.
• Ability to write clean, maintainable, scalable, and robust code using Python, SQL, and Java.
• Experience in building and maintaining ETL/ELT pipelines using Python and optimizing SQL.
• Exposure to cloud data services such as AWS Redshift, Snowflake, BigQuery, or Azure Data Lake.
• Experience using pipeline orchestration tools like Airflow and containerization tools like Docker.
• Excellent understanding of various data processing techniques (streaming, batch, event-based) and optimizing data storage (Data Lake, Data Warehouse, Vector Data Stores, and Database, SQL, and NoSQL).
• Experience using data transformation tools like Data Build Tool (DBT).
• Experience with version control (Git) and CI/CD pipelines for data engineering workflows.
• Experience using Infrastructure As Code tools such as Terraform and container orchestration platforms like Kubernetes.
• Excellent problem-solving and analytical skills, with an understanding of AI technologies and their applications.
• Excellent written and verbal communication skills for collaboration across teams.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals in Singapore.

1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
2. No Client Relationship: This company is not a client of SpringCube unless stated.
3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
4. No Liability: SpringCube is not liable for inaccuracies.