Data Engineer creating clean, reliable data pipelines for Plenti, a fintech lender. Collaborating with modern tools like AWS and Databricks to enhance data quality and analytics.
About the role
- Senior Data Engineer developing scalable data pipelines at Enable Data Incorporated. Collaborating with analytics and stakeholders to ensure well-modeled data solutions and maintain data quality.
Responsibilities
- Design, develop, and maintain scalable **data pipelines** using **Apache Spark** (PySpark and/or Scala)
- Build and optimize data workflows on **Databricks**, including Delta Lake, notebooks, and scheduled jobs
- Ingest, transform, and curate large-scale structured and semi-structured datasets
- Perform performance tuning and cost optimization of Spark workloads and Databricks clusters
- Implement data quality checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, security, and version control
Requirements
- 5+ years of experience in **Data Engineering** or related roles
- Strong hands-on experience with **Apache Spark** (PySpark or Scala)
- Proven experience working in **Databricks** environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining **ETL/ELT pipelines** at scale
- Familiarity with modern data lake architectures (Delta Lake preferred)
- Experience with Git-based version control
- **Must be a U.S. Citizen**
- **Must be currently located in Minnesota (MN), or willing to relocate **
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Platform Specialist overseeing data quality and platform operations at Stackgini. Collaborating with teams to enhance data management solutions and improve system performance.
Staff Data Engineer at PPRO transforming data ecosystem into a self - service platform. Leading technical vision for data engineering and building scalable infrastructures.
SSIS Data Engineer at iKnowHow Group focusing on data migration projects. Involves data modeling, integration, and using T - SQL/SQL alongside SSIS packages.
Principal Data Engineer designing and implementing data solutions that ensure trust and transparency in supply chains. Collaborating with global teams and mentoring fellow engineers in data practices.
Data Analyst supporting data - driven decisions through data collection, cleaning, and analysis at an operations team in Hyderabad, India.
Senior Data Engineer role at Dun & Bradstreet focused on data analytics and visualization. Collaborating with teams to optimize data processes and deliver actionable insights.
Senior Data Engineer with AWS expertise leading financial data architecture and scalable solutions. Collaborating in wealth management to enhance data quality and systems.
Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.