Data Engineer

This job was selected by the SpringCube team to help AI, Data and Cloud Engineers discover relevant San Francisco Bay Area employers. Sign up to view the full employer details and apply directly with the hiring company.

Company Overview

A data-driven real estate technology company is focused on helping people make smarter decisions during one of life’s most important moments: buying or selling a home. By analyzing more than 40 million real estate transactions involving approximately 2.5 million agents across the country, the organization uses data, algorithms, and marketplace solutions to connect clients with high-performing real estate professionals and improve the home buying and selling experience.

The organization is building its first dedicated Data Engineering team to address diverse data challenges and develop scalable infrastructure that supports products, algorithms, and internal teams.

The organization is seeking a Data Engineer to own the development, optimization, and operation of data pipelines that collect, process, and distribute data across products and teams. This role will provide mission-critical data for algorithms and internal users while helping refine products, identify new markets, and improve data-driven decision-making.

The successful candidate will combine strong software engineering and data engineering skills with experience in scalable systems, APIs, data pipelines, and modern AI-assisted development. The position offers an opportunity to work with LLMs, prompt engineering, automation, and data infrastructure in a fast-paced environment.

Key Responsibilities

• Optimize and execute requests to pull, analyze, interpret, and visualize data.
• Partner with team leaders across the organization to develop and improve team and individual performance metrics.
• Optimize data release processes and collaborate with team leads to improve existing data pipelines.
• Design and develop systems that ingest and transform data streams using modern data engineering tools.
• Design, build, and integrate new databases and data warehouses.
• Develop and maintain data schemas and identify innovative approaches to storing and representing data.
• Research, architect, build, and test robust, highly available, and scalable systems, software, and services.
• Develop and operate reliable data pipelines that support a wide range of products and internal teams.
• Apply automation to improve data workflows, engineering processes, and operational efficiency.
• Use LLMs and prompt engineering to improve real-world engineering and data workflows.
• Collaborate with cross-functional teams to deliver scalable, data-driven solutions.

Required Qualifications

• 2+ years of experience in data engineering, software engineering, or backend engineering roles.
• Experience applying LLMs and prompt engineering to real-world workflows.
• Strong proficiency in Python for building services, data pipelines, and backend systems.
• Experience designing, building, and operating service-oriented architectures and APIs.
• Strong understanding of data modeling, system design, and scalable architecture patterns.
• Hands-on experience with data pipelines and ETL workflows, including Airflow or similar technologies.
• Experience with AI-assisted development tools such as Cursor, Codex, or Claude Code.
• Strong analytical and problem-solving skills.
• A strong focus on automation and building scalable systems.
• Ability to take ownership of projects and work effectively in a fast-paced environment.

Nice to Have

• Experience building and scaling product features using frameworks such as Ruby on Rails or Django.
• Familiarity with AWS and cloud infrastructure for production applications.
• Familiarity with Elasticsearch or other search technologies used for user-facing features.
• Experience with LLM-powered product use cases, including ChatGPT, conversational interfaces, and automation.
• Experience working in a startup or fast-paced technology environment with a high degree of ownership.

Disclaimer

SpringCube curates tech job listings from various company websites to support tech professionals globally.

1.No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.

2.No Client Relationship: This company is not a client of SpringCube unless stated.

3.To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.

4.No Liability: SpringCube is not liable for inaccuracies.**