Back to Job Listings

Senior AWS Data Engineer (6 Months Contract)

SpringCube

Contract - Senior Associate/ Asst Manager

IT Services & Consulting

Singapore ( Onsite )

Published 2 weeks ago

Salary: SGD5,000 - SGD10,000

Contact Employer
  • Share:
Send Feedback
Report This Job

Job Description

The SpringCube team curated the following job opportunity to help you in your job search. Explore the position below to find your next career move.

Company Overview

A global technology consultancy specializing in designing, developing, and scaling digital and sustainable products and services.

Job Title: Senior AWS Data Engineer (6 Months Contract)

YOUR RESPONSIBILITIES:

The project involves the enhancement of an existing data pipeline, currently on an on-premises server, which handles data download, decryption, quality checking, cleaning, processing, and prediction, including robust error handling, error reporting, and self-recovery mechanisms. The goal is to leverage industry-standard tools and mechanisms to improve this pipeline.

  • Experience with migrating data pipelines to the AWS Cloud using AWS managed components.
  • Proficient in Python, SQL Knowledge, and Shell scripts (Linux).
  • Proficient in Airflow or similar tools for creating pipelines.
  • Proficient in AWS tools such as S3, Glue, AWS EMR, Lambda, Step Functions, Fargate, and AWS Batch.
  • Familiar with tools like AWS Batch, Athena, file formats like Parquet, NoSQL knowledge, and tools like AWS OpenSearch.

WHO YOU ARE:

  • You hold a Bachelor’s, Master’s, or Ph.D. degree in IT, Information Management, and/or Computer Science with at least 7 years of experience.
  • Good knowledge of the big data technology landscape and concepts related to distributed storage/computing.
  • Experience with big data frameworks (e.g., Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR).
  • Experience with batch & ETL jobs to ingest and process data from multiple data sources.
  • Experience with NoSQL databases (e.g., Cassandra, MongoDB, Neo4J, ElasticSearch).
  • Experience with querying tools (e.g., Hive, Spark SQL, Impala).
  • Experience with Power BI.
  • Experience or willingness to engage in real-time stream processing using solutions such as Kafka, AWS Kinesis, Flume, and/or Spark Streaming.
  • Experience or willingness to learn about DevOps and DataOps principles (e.g., Infrastructure as Code, automating different parts of the data pipeline).
  • High-level understanding of Data Science concepts and methodologies (how models are built, trained, and deployed).
  • You are passionate about technology, and continuous learning comes naturally to you.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals in Singapore.

  1. No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
  2. No Client Relationship: This company is not a client of SpringCube unless stated.
  3. To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
  4. No Liability: SpringCube is not liable for inaccuracies.