Hybrid Lead Data Engineer

at Tiger Analytics

• Job title: Lead Data Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Amazon Redshift, AWS, Azure, Cassandra, Cloud, Hadoop, Java, Kafka, Linux, MapReduce, Microservices, MySQL, NoSQL, Open Source, Python, RDBMS, Scala, Shell Scripting, Spark, Unix
• Location requirements: Hybrid, McLean, United States

About the role

• Data Engineer collaborating on data pipelines for analytics consulting firm, enhancing data flow and supporting decision-making. Work with Agile teams in a hybrid environment.

Responsibilities

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
• Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
• Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
• Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.
• Strong problem-solving skills and attention to detail.

Requirements

• What You’ll Do:
• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
• Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
• Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
• Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.
• Strong problem-solving skills and attention to detail.
• Preferred Qualifications:
• 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.
• Hands-on experience in designing and building data pipelines
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 4+ year experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 4+ years of data warehousing experience (Redshift or Snowflake)
• 4+ years of experience with UNIX/Linux including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices

Benefits

• Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.
• ***Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.***