Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
About the role
- Data Engineer creating advanced data solutions for Mastercard, a global payments technology company. Collaborate cross-functionally to implement robust data pipelines and architectures.
Responsibilities
- Gather and understand the data engineering requirements based on the product and Engineering specifications
- Conduct data discovery to build data models, schemas, tables, view, schemas deployment and many more
- Building appropriate data pipelines in the application to support ETL and automate the pipelines
- Build or use existing tools to execute one time ad-hoc data engineering asks
- Implement and manage CI/CD pipelines using GitLab and Jenkins, enabling automated testing, deployment, and monitoring of data workflows
- Build fact tables, conduct analysis and reporting as per needs
- Conduct data analysis and perform data operations to support business decisions
- Provide architecture guidelines and support from Data engineering aspects in product development
- Apply exceptional problem-solving and analytical skills to troubleshoot complex data and system issues
- Support Data Science team in building model deployment, data pipelines, serving etc
- Document pipeline architecture, processes, and standards, promoting consistency and transparency across the team
- Learn latest trends in data engineering concepts, tools and share with wider organization in brown bags etc
- Provide thought leadership within this area for the entire department
- Work with TPMs, product and relevant stakeholders while executing Data engineering assignments by leading the plan
Requirements
- Expert in SQL development with hands-on experience in Databricks, Snowflake, Python, and PySpark for designing and implementing advanced data engineering solutions
- Proven experience collaborating with stakeholders and cross-functional teams to understand business requirements and deliver reliable, high-impact cloud data solutions across Azure, AWS, and Cloud Data Warehouse platforms
- Strong leadership and communication skills, with the ability to guide and mentor data engineering teams, ensuring effective collaboration between technical and non-technical stakeholders
- Skilled in architecting and developing scalable, reusable data models, pipelines, and frameworks leveraging Hadoop, NiFi, and modern cloud Data Lake architectures
- Experienced in planning and executing end-to-end deployments, upgrades, and migrations with minimal disruption to operations, ensuring adherence to best practices in cloud-native and distributed systems
- Holds a Bachelor’s degree in Computer Science
- Good understanding of payment networks
- Skill in identifying new product ideas from data
- Experience publishing and protecting scientific intellectual property work
Benefits
- insurance (including medical, prescription drug, dental, vision, disability, life insurance)
- flexible spending account and health savings account
- paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave)
- 80 hours of Paid Sick and Safe Time
- 25 days of vacation time and 5 personal days, pro-rated based on date of hire
- 10 annual paid U.S. observed holidays
- 401k with a best-in-class company match
- deferred compensation for eligible roles
- fitness reimbursement or on-site fitness facilities
- eligibility for tuition reimbursement
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Data Engineer focusing on secure ETL/ELT data pipelines and compliance in healthcare. Designing scalable ingestion frameworks and ensuring alignment with federal standards.