Senior Data Engineer at Goodwin enhancing data platforms and fostering data - driven culture across teams. Collaborating with IT and Finance on technology solutions and data governance practices.
About the role
- AWS Data Architect at Fractal designing and operationalizing AWS data solutions at enterprise scale. Collaborating with clients and mentoring engineers in best practices.
Responsibilities
- Consult, Design, build and operationalize large scale enterprise data solutions using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake and Databricks.
- Analyze, re-architect and re-platform on-premises data stores/ Databases to modern data platforms on AWS cloud using AWS or 3rd party services.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
- Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, DynamoDB, RDS, S3
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud as part of customer consultation and business proposals.
- Participate in client design workshops and provide trade-offs and recommendations towards building solutions.
- Mentor other engineers in coding best practices and problem solving
Requirements
- 9 to 15 years’ experience in the industry
- Bachelor’s Degree in computer science, Information Technology or other relevant fields
- Experience and knowledge of Big Data Architectures, on cloud and on premise
- Proficiency in AWS Collection Services: Kinesis, Kafka, Database Migration Service
- Proficiency in AWS main Storage Service: S3, EBS, EFS
- Proficiency in AWS main Compute Service: EC2, Lambda, ECS, EKS
- Proven experience in: Java, Scala, Python, and shell scripting.
- Working experience with: AWS Athena and Glue Pyspark, EMR, DynamoDB, Redshift, Kinesis, Lambda, Apache Spark, Databricks on AWS, Snowflake on AWS
- AWS Certification: AWS Certified Solutions Architect and/or AWS Certified Data Analytics
- Working experience with Agile Methodology and Kanban
- Good knowledge of SQL
- Experience in building and delivering proofs-of-concept, in order to address specific business needs, using the most appropriate techniques, data sources and technologies
- Experience partnering with executive stakeholders as a trusted advisor as well as enabling technical implementers
- Working experience in migrating workloads from on premise to cloud environment
- Experience in monitoring distributed infrastructure, using AWS tools or open-source ones
- Experience in monitoring distributed infrastructure, using AWS tools or open-source ones such as CloudWatch, Prometheus, and the ELK stack would be big advantage.
Benefits
- Health insurance
- Flexible working arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Director, Data Platform Design and Strategy at MedImpact leading data platform and AI innovations to enhance healthcare services. Overseeing enterprise projects and managing teams to meet strategic goals.
Data Engineer delivering AI - and data - driven solutions for Honeywell’s industrial customers. Architecting and implementing scalable data pipelines and platforms focused on IoT and real - time data processing.
Data Engineering Associate focusing on data quality control and management for distribution platform. Collaborates on large scale data projects to ensure data accuracy and availability for users.
Data Architect managing enterprise data platform built on Microsoft Fabric at Johnstone Supply. Leading architectural standards and collaborating with business and IT leaders for strategic data - driven insights.
Data Engineer at Studyportals responsible for data pipelines and infrastructure. Join a team ensuring accurate and trustworthy data for analytics and business decisions.
AI/ML Engineer designing and refining prompts and workflows using large language models. Responsible for developing data pipelines and delivering scalable AI solutions in a hybrid work environment.
Senior Data Engineer driving data - driven success at Pacific Life. Collaborating with a team to build scalable and secure data solutions in Newport Beach, CA or Charlotte, NC.
Data Architect managing Commercial Data architecture initiatives for Valmet's sales and service team. Leading AI - driven data integrity and quality efforts in a global context.
Data Solutions Architect leading business intelligence solutions and analytics at Crowe. Overseeing data pipelines and analytics frameworks to drive decision - making and compliance.