Hybrid Lead Software Engineer, Python

Posted last week

Apply now

About the role

  • Provide Technical Leadership: Guide the development team in implementing Python-based solutions, ensuring alignment with business requirements, performance standards, and scalability best practices.
  • Design, build, and maintain scalable Python applications for data processing, transformation, and analytics.
  • Utilize SQL and relational database concepts to design efficient data models, optimize queries, and manage data quality.
  • Implement and uphold best practices in Python software development, testing, and CI/CD pipelines.
  • Leverage Apache Spark, PySpark, and related big data technologies to develop distributed data processing pipelines.
  • Design and optimize Spark/Databricks ETL pipelines written in PySpark for high performance and scalability.
  • Build core Python FastAPI services to expose data from Databricks and graph databases to downstream applications.
  • Contribute to building a knowledge graph interconnecting healthcare and life science data domains.
  • Work on backend of AI assistant leveraging LLMs and machine learning to expose platform data and extract insights.
  • Mentor junior developers, facilitate knowledge sharing, and foster a culture of continuous learning.
  • Collaborate within a cross-functional C3 Data Platform Team in a startup-like environment inside Clarivate.

Requirements

  • 5+ years of hands-on Python software development experience.
  • Advanced proficiency in SQL, database design, and relational database systems.
  • Experience developing and deploying solutions on cloud platforms, particularly AWS (S3, ECS, EMR, Glue, RDS).
  • Expertise in Apache Spark and PySpark for building scalable data solutions.
  • Familiarity with orchestration tools like Apache Airflow.
  • Knowledge of graph databases like Neo4j or AWS Neptune.
  • Solid grasp of CI/CD principles and experience implementing automated pipelines.
  • Practical experience with Databricks and Snowflake (desirable).
  • Exposure to Cassandra, Hadoop, Apache Hive (desirable).
  • Experience mentoring or providing technical leadership.

Job title

Lead Software Engineer, Python

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job