Back to Job Listings

Big Data Engineer, Data Ingestion

SpringCube

Full time - Senior Associate/ Asst Manager

Social Networking & Media

Singapore ( Onsite )

Published 2 weeks ago

Salary: SGD5,000 - SGD10,000

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

The SpringCube team curated the following job opportunity to help you in your job search. Explore the position below to find your next career move.

Company Overview

This innovative technology company is at the forefront of leveraging data to drive impactful solutions. They are committed to building robust and scalable data infrastructure that empowers informed decision-making and delivers exceptional user experiences. Their dynamic environment fosters collaboration, continuous learning, and the opportunity to work on challenging, high-impact projects. They are seeking talented individuals passionate about big data and real-time systems to join their growing team.

Big Data Engineer, Data Ingestion

This organization is looking for a Big Data Engineer specializing in Data Ingestion to join their team. This role is crucial for building and maintaining the foundational systems that enable the efficient and reliable flow of data within the company’s infrastructure.

Responsibilities

The successful candidate will be responsible for designing, developing, and optimizing the architecture of large-scale data ingestion systems. This includes creating real-time data pipelines that ensure high throughput, low latency, and fault tolerance. They will focus on enhancing the overall performance, scalability, and reliability of these critical pipelines. A key aspect of the role involves developing and implementing automated and intelligent operation and maintenance systems to monitor, diagnose, and guarantee the stability of data ingestion processes. This individual will also collaborate closely with cross-functional teams to deliver comprehensive event data ingestion, transformation, and storage solutions that align with diverse business requirements. Furthermore, they will be expected to troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.

Qualifications

Minimum Qualifications

Applicants should possess a Bachelor’s degree in Computer Science or have equivalent practical experience. A minimum of 2 years of experience in software development is required, with demonstrated proficiency in one or more programming languages such as Java, Scala, Python, or Go. Candidates must have a strong understanding of data structures, algorithms, and distributed systems principles. Hands-on experience with big data technologies, including Hadoop, Flink, Kafka, or similar frameworks, is essential.

Preferred Qualifications

Ideal candidates will bring 2 or more years of experience with real-time data processing frameworks like Flink, and any contributions to open-source projects would be a significant plus. Experience in the event tracking domain, encompassing event collection, real-time processing, governance, quality assurance, and cost optimization, is highly valued. A deep understanding of data lakehouse architectures and the seamless integration of stream and batch processing is also preferred. Finally, strong problem-solving skills and the ability to thrive in a fast-paced, collaborative environment are important attributes for this role.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals in Singapore.

  1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
  2. No Client Relationship: This company is not a client of SpringCube unless stated.
  3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
  4. No Liability: SpringCube is not liable for inaccuracies.