WEX Inc. Logo

WEX Inc.

Staff Data Lake Engineer

Posted 6 Days Ago
In-Office or Remote
13 Locations
Senior level
In-Office or Remote
13 Locations
Senior level
As a Staff Data Lake Engineer, lead the development of an enterprise data platform, mentor junior engineers, and ensure technical execution in data architecture and strategy while collaborating across teams.
The summary above was generated by AI

This is a remote position; however, the candidate must reside within 30 miles of one of the following locations: Portland, ME; Boston, MA; Chicago, IL; Dallas, TX; San Francisco Bay Area, CA; and Seattle/WA.

About the role/Team

As a Staff Software Engineer on the Data Lake Engineering team, you will be a key technical leader in developing our enterprise data platform. Your mission is to build a unified, intelligent data infrastructure using a data lakehouse architecture that boosts developer productivity and establishes standardization across the organization.
In this role, you will be a vital link between the Data Engineering community and our strategic solutions. You will manage stakeholder relationships, translating their business requirements into technical roadmaps and guiding execution. This is a hands-on position where you'll not only drive the development of scalable, secure, and high-performing systems, but also provide technical mentorship to junior engineers.
Your work will directly impact the business by enabling crucial self-service capabilities for data engineers, building a robust business catalog for strong data and AI governance, and implementing systems for data quality and lineage that empower business analysts. This is an opportunity to solve complex, large-scale problems and make a significant impact on both the team and the business.

How you’ll make an impact

  • Platform Strategy & Leadership: Lead the technical vision, architecture, and strategy for the Data Lake platform. Drive the development roadmap to deliver a platform that meets both near-term business needs and long-term strategic goals.

  • Technical Execution & Innovation: Design and lead the implementation of our data lake platform and services. Challenge the status quo, championing innovative technical solutions that leverage data, AI, and modern engineering practices.

  • Cross-Functional Partnership: Partner closely with solutions architecture, product, and engineering teams to deeply understand business needs and design effective solutions. Collaborate with information security to ensure data privacy and access controls are a core part of the platform's design.

  • Mentorship & Team Development: Serve as a technical mentor to engineers, providing guidance on engineering principles, best practices, and skills. Foster a culture of continuous learning, innovation, and accountability for quality results.

  • Stakeholder Communication: Report on the status of development, quality, and system performance to management and partners. Advise senior leadership on complex technical initiatives and drive projects to achieve defined OKRs.

Experience you’ll bring

Experience: 8+ years of experience in software design and development, with a focus on building large-scale, distributed systems.

Technical Depth:

  • Strong hands-on experience in software development, architecture, deployment, and production operations, preferably with Java / J2EE (Spring/Spring Boot).

  • Proficiency in languages like Python is highly desirable.

  • Deep expertise in building and operating Big Data platforms and large-scale data lakes.

  • Experience with Data Lakehouse formats such as Apache Iceberg, Apache Hudi, or Delta Lake is a significant plus.

  • Strong understanding of modern data processing tools and services (e.g., Spark, AWS Glue, dbt, Apache Polaris).

Cloud & Infrastructure:

  • Extensive experience with cloud architecture and services, including AWS (S3, EMR, Kubernetes, Lambda) and Azure.

  • Deep understanding of CI/CD automation, modern development tools, and frameworks.

Leadership & Soft Skills:

  • Proven ability to lead and guide engineering teams, acting as a technical mentor and thought leader.

  • Excellent analytical skills with a proven ability to identify and resolve complex technical problems.

  • Strong written and verbal communication skills, with a philosophy of continuous improvement.

Education: Bachelor's degree in Computer Science or a related technical field. A higher degree is a plus.

Domain: Experience within the payments industry is a plus.

The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of WEX's total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan. Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. WEX's comprehensive and market competitive benefits are designed to support your personal and professional well-being. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the "About Us" section.Pay Range: $135,000.00 - $180,000.00

Top Skills

Apache Hudi
Apache Iceberg
Apache Polaris
AWS
Aws Glue
Azure
Dbt
Delta Lake
Emr
J2Ee
Java
Kubernetes
Lambda
Python
S3
Spark
Spring
Spring Boot

Similar Jobs

3 Hours Ago
Remote or Hybrid
6 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Backend Engineer, you will work on high volume services within a cybersecurity platform, focusing on scalability and distributed systems.
Top Skills: AWSAzureCassandraElasticsearchGCPGoKafka
3 Hours Ago
Remote
Ontario, ON, CAN
Junior
Junior
Fintech • Financial Services
As a Business Development Representative, you will develop client relationships, generate new business, and maintain effective customer engagement while achieving sales targets.
Top Skills: Crm Software
3 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
The Senior Software Engineer will optimize cloud infrastructure, manage distributed systems, and lead team collaboration to ensure system resilience and performance.
Top Skills: AWSKotlinKubernetesLocustMySQLPython

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account