Hybrid Lead Data Engineer

Posted 17 minutes ago

Apply now

About the role

  • Senior Data Engineer with AWS expertise leading financial data architecture and scalable solutions. Collaborating in wealth management to enhance data quality and systems.

Responsibilities

  • Design and build scalable data pipelines using Python (PySpark, Pandas, Airflow)
  • Architect data lakes / warehouses (Snowflake, Redshift, or similar)
  • Implement real-time and batch data processing frameworks
  • Optimize data models for analytics, reporting, and ML use cases
  • Work with datasets across:
  • Portfolio & asset management
  • Trade lifecycle & transaction data
  • Client onboarding & KYC
  • Performance reporting & attribution
  • Build systems supporting investment analytics, risk, and regulatory reporting
  • Lead a team of data engineers; provide technical guidance and code reviews
  • Define data engineering best practices, governance, and standards
  • Collaborate with Product, Analytics, and Business teams
  • Drive data quality, lineage, and observability frameworks
  • Develop solutions on AWS:
  • S3, Glue, Lambda, EMR, Redshift
  • Implement CI/CD pipelines and infrastructure-as-code (Terraform/CloudFormation)
  • Ensure security and compliance (FINRA, SEC considerations)

Requirements

  • 10+ years of experience in data engineering / data platform development
  • 3+ years in a lead or architect role
  • Strong programming expertise in Python
  • Hands-on experience with:
  • PySpark / Spark
  • SQL & data modeling
  • Workflow orchestration (Airflow, Prefect)
  • Experience in wealth management / asset management / financial services
  • Strong understanding of:
  • Investment data models
  • Market data & financial instruments
  • Experience with cloud-native data platforms (AWS)

Job title

Lead Data Engineer

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job