This job was selected by the SpringCube team to help AI, Data and Cloud Engineers discover relevant San Francisco Bay Area employers. Sign up to view the full employer details and apply directly with the hiring company.
Company Overview
A technology company is transforming K–12 education by bringing high-quality curriculum, instructional tools, and student analytics together in one coherent system. Its Learning Intelligence Technology (LIT) provides educators with infrastructure to plan, teach, assess, and respond to student needs while reducing administrative burden and supporting more equitable, effective, and adaptive learning experiences.
The organization is seeking a Senior Data Engineer to join its Content & AI Systems team and build the data layer supporting next-generation AI-assisted curriculum authoring and content delivery.
The role will own pipelines, schemas, and validation frameworks that transform complex, domain-specific curriculum content into structured, AI-ready data products. The successful candidate will work closely with Instructional Designers, AI engineers, and Content Agents teams and should be comfortable defining data requirements and infrastructure in a developing data engineering environment.
Key Responsibilities
- Design and own schemas and data models representing curriculum content, including lessons, activities, and standards alignments, for downstream applications.
- Build ingestion pipelines capable of processing varied and inconsistent source formats, including XML, JSON, PDF-derived content, and API-delivered data.
- Develop Python-based parsers, transformers, and validation scripts to enforce schema conformance and content quality at scale.
- Collaborate directly with Instructional Designers and product teams to translate content authoring workflows into data engineering requirements.
- Build and maintain embedding and vector database pipelines that support AI-powered content features as they scale.
- Work within Git-based workflows, treating data artifacts with the same rigor as software through versioning, review, and documentation.
- Provision and monitor infrastructure supporting data systems.
- Work with infrastructure including ECS, EKS clusters, Lambda functions, and S3 buckets.
- Support scalable and reliable data infrastructure through infrastructure-as-code practices.
Required Qualifications
- 4+ years of experience in data engineering.
- Strong Python programming skills, including experience developing parsers, validators, and transformation scripts for complex real-world data.
- Strong schema design and data modeling skills with an understanding of how data structures support downstream applications.
- A strong data quality mindset with experience implementing validation, completeness checks, and quality controls.
- Ability to collaborate with non-engineering stakeholders to define requirements and translate domain knowledge into effective data structures.
- Experience provisioning and monitoring infrastructure for data systems.
- Familiarity with infrastructure-as-code tools such as Terraform and Terragrunt.
- Experience working with cloud-based data infrastructure, including ECS, EKS, Lambda, and S3.
- Bachelor’s or Master’s degree in Computer Science or equivalent professional experience.
Nice to Have
- Background in education, curriculum design, or educational technology.
- Understanding of how instructional content is authored, organized, and structured.
- Experience with vector databases such as Pinecone, Weaviate, or pgvector.
- Experience with embedding pipeline development and related tooling.
- Familiarity with agentic AI patterns or Model Context Protocol (MCP).
Benefits
Full-time permanent employees are eligible for benefits from their first day of employment, including:
- Competitive salary.
- Meaningful equity.
- Medical, dental, vision, disability, and life insurance plans.
- 401(k) plan.
- One Medical membership in participating locations.
- Flexible vacation time policy, subject to internal approval.
- Average vacation usage of approximately four weeks per year.
- 10 paid sick days per year, prorated depending on start date.
- Paid holidays.
- Paid bereavement leave.
- Paid family leave following birth or adoption, including a minimum of 16 paid weeks for birthing parents and 10 weeks for caretaker parents, intended to supplement applicable state benefits.
- Commuter and FSA plans.
Disclaimer
SpringCube curates tech job listings from various company websites to support tech professionals globally.
1.No Endorsement: Job ads on SpringCube do not imply endorsement of their authenticity or quality.
2.No Client Relationship: This company is not a client of SpringCube unless stated.
3.To Apply: Click the “Apply” button to be redirected to the hiring company’s application page for this job.
4.No Liability: SpringCube is not liable for inaccuracies.
