Note: The job is a remote job and is open to candidates in USA. Climb is a Data and AI consultancy that partners with enterprises to design, build, and operationalize modern data platforms and production AI systems. The Senior Data Engineer will own complete data engineering workstreams, designing and implementing data platforms that power analytics and AI, while collaborating directly with client stakeholders to deliver reliable and cost-efficient solutions.
Responsibilities
- Own one or more data engineering workstreams, from technical design through production deployment and handoff
- Design and implement scalable data models and lakehouse architectures, including medallion patterns where appropriate
- Optimize performance and cost across Databricks and the underlying cloud: you treat compute spend as your problem, not someone else's
- Orchestrate workflows using Databricks Workflows, Delta Live Tables, or equivalent tooling
- Implement governance, security, observability, and lineage with Unity Catalog, and stand up CI/CD for data
- Design and build AI-ready data platforms that enable reliable analytics, machine learning, and agentic applications
- Work directly with client stakeholders to gather requirements and translate them into technical solutions
- Review code, mentor junior engineers, and maintain high engineering standards across your workstreams
- Contribute reusable accelerators, frameworks, and best practices back to the practice
Skills
- 6+ years in data engineering or analytics engineering
- Advanced experience building production data pipelines with Apache Spark (PySpark and SQL), including performance optimization
- Hands-on production experience with Databricks (Delta Lake, Jobs, Workflows, Unity Catalog)
- Deep experience with at least one major cloud (AWS, Azure, or GCP)
- Strong SQL and data modeling fundamentals
- A track record of building and operating production-grade data pipelines, not just prototypes
- Comfortable working directly with client stakeholders to translate business requirements into technical solutions
- Demonstrated ability to independently own a data engineering workstream from design through production
- Experience with Delta Live Tables, structured streaming, or real-time pipelines
- Familiarity with dbt, Airflow, or other modern data stack tooling
- A demonstrated performance- and cost-optimization mindset (cluster sizing, Photon, file layout, partitioning)
- Exposure to governed or regulated environments (e.g., financial services, healthcare)
- Prior consulting, systems integrator, or professional services experience
- Existing Databricks certifications are a plus. Where not already held, Databricks certification (e.g., Data Engineer Associate/Professional) is expected to be obtained post-hire
Benefits
- Competitive base salary with performance-based bonuses
- MacBook Pro and swag kit so you can do your best work
- Comprehensive health, dental, and vision insurance
- Generous holidays, flexible PTO, and remote-first work environment
- Professional development budget including Databricks and cloud certifications
- Spot bonuses for relevant certifications
- Conference attendance and thought leadership opportunities
- Collaborative, low-ego culture with direct access to leadership
- Opportunity to shape a growing practice from the ground floor
Company Overview