Senior PySpark Developer managing data processing pipelines for a data project focusing on cloud integration and governance. Collaborating with teams to ensure data quality and efficiency.
Responsibilities
Develop and maintain data pipelines using PySpark
Perform transformations on large volumes of data in distributed environments
Integrate data flows with Object Storage solutions
Work with Oracle databases for ingestion, querying, and data persistence
Ensure quality, consistency, and integrity of processed data
Optimize Spark job performance and processing routines
Collaborate with data, architecture, and business teams to understand requirements
Document processes, data flows, and technical decisions
Requirements
Strong experience with Python applied to data engineering
Advanced experience with Apache Spark and PySpark
Experience in large-scale data transformation and processing projects
Experience with Object Storage (reading, writing, and organizing data)
Knowledge of Oracle Database (queries, basic modeling, integration)
Experience building end-to-end data pipelines
Benefits
Availability to work on weekends, occasionally for go-lives
Lead Developer at KDG creating software solutions to unlock value for clients. Manage projects and ensure excellent customer experience through effective communication and technical proficiency.
Analytics Engineer focusing on data storytelling and data quality evaluation. Transforming insights into actions, supporting strategic decisions for tech solutions in the evolving landscape.
Manage Clinical Engineering site operations, ensuring service excellence and regulatory compliance across multiple healthcare facilities. Foster team development and collaboration to meet operational objectives.
AI Developer building and deploying AI solutions using Python and Azure Cloud. Involves end - to - end development of scalable and secure AI applications.
Application Developer focused on Java Backend development, specializing in microservices and RESTful API at Atos. Seeking candidates with strong Java, J2EE, and SQL skills.
Salesforce developer with extensive experience in Salesforce application development. Focus on end to end solutions and collaboration with teams for functional areas in Bangalore.
Intern supporting water - related engineering projects at Hazen, enhancing skills through mentorship. Engaging in design and process teams while learning about environmental infrastructure.
Full - stack developer responsible for application development across the stack and agile collaboration. Working at Newrez to enhance services for mortgage borrowers and partners.