The SpringCube team curated the following job opportunity to help you in your
job search. Explore the position below to find your next career move.
Company Overview
This global organization is revolutionizing the way the world games. It offers a dynamic and impactful environment with opportunities to collaborate across continents. The company fosters a unique, gamer-centric culture that promotes accelerated personal and professional growth.
Senior Data Engineer
Job Description :
This role involves designing, building, and maintaining high-volume big data processing systems that enable the organization to collect, manage, and transform raw data into actionable insights for data scientists and business analysts, facilitating the use of Artificial Intelligence (AI) capabilities. The individual will be responsible for developing and maintaining data pipelines, data storage systems, and cloud infrastructure, while collaborating closely with data scientists, data analysts, and internal stakeholders to leverage data for analytics and AI applications.
Essential Duties and Responsibilities
- Own and improve the data stack used by the team to enhance data processing capabilities.
- Design, develop, and maintain data systems and data pipelines that enable the organization to store, process, and analyze large volumes of data. This includes developing data pipelines, designing data storage systems, and ensuring effective data integration to support AI applications.
- Manage data lakes and data warehouses by populating and operationalizing them. This involves creating and managing table schemas, views, materialized views, including tokenization and vectorization techniques for Gen AI.
- Monitor and troubleshoot data workflows, ensuring timely resolution of failures and rerunning failed jobs to ensure data completeness.
- Leverage modern build tools to enhance automation, data quality, testing, and deployment of data pipelines.
- Design and build AI-Powered and GenAI applications collaboratively with data scientists, data analysts, product managers, and business users.
- Develop and implement cloud infrastructure that aligns with the company’s security policies and practices, as well as cost optimization practices.
- Manage and scope projects that involve collaboration with data scientists, data analysts, and business users to understand the data needs of various stakeholders across the organization and implement appropriate solutions.
- Mentor interns and junior engineers on the team.
Pre-Requisites :
Qualifications and Skills
- Degree in computer science, engineering, mathematics, or equivalent experience.
- 5+ years of relevant professional experience.
- Ability to scope projects and effectively lead and mentor more junior colleagues.
- Ability to write clean, maintainable, scalable, and robust code using Python, SQL, Java.
- Proven experience in building and maintaining pipelines in production for advanced analytics use cases.
- Experience with cloud data services such as AWS Redshift, Snowflake, BigQuery, or Azure Data Lake.
- Experience using Infrastructure As Code tools such as Terraform, containerization tools like Dockers, and container orchestration platforms like Kubernetes.
- Experience using orchestration tools like Airflow, distributed computing frameworks like Spark or Dask, and data transformation tools like Data Build Tool (DBT).
- Experience with CI/CD pipelines for data engineering workflows.
- Experience with various data processing techniques (streaming, batch, event-based), managing and optimizing data storage (Data Lake, Data Warehouse, Vector Data Stores, and Databases, both SQL and NoSQL) is essential.
- Excellent problem-solving and analytical skills, with an understanding of AI technologies and their applications.
- Excellent written and verbal communication skills for coordinating across teams.
Are you game?
Disclaimer
SpringCube curates tech job listings from various company websites to support tech professionals in Singapore.
- No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
- No Client Relationship: This company is not a client of SpringCube unless stated.
- To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
- No Liability: SpringCube is not liable for inaccuracies.
