Hybrid Micro Strategy Engineer

at Ness Digital Engineering

• Job title: Micro Strategy Engineer
• Job type: Full Time
• Experience level: Senior, Lead
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: AWS, Cloud, Cyber Security, ETL, Java, Kafka, Linux, Oracle, Python, Scala, Spark, SQL, Tableau
• Location requirements: Hybrid, Hyderabad, India

About the role

• Lead Big Data Developer on the Content Externalization team at S&P Ratings. Responsibilities include designing, developing, and supporting ETL pipelines using Spark framework in Databricks.

Responsibilities

• Responsible for analysis, design, architecture, development, and support of ETL pipelines using Spark framework in Databricks platform.
• Demonstrate a strong sense of ownership and responsibility with release goals.
• Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards.
• Build and maintain the environment for speed, accuracy, consistency and ‘up’ time.
• Hands-on position requiring strong analytical, architecture, development and debugging skills that includes both development and operations.
• Attaint in-depth Functional knowledge of the domain that we are working on. S&P Global Public
• Understand Incident Management, Change Management and Problem Management, root cause analysis.
• Ensure data governance principles adopted, data quality checks and data lineage implemented in each hop of the Data.
• Be in tune with emerging trends cloud technologies & Big Data.
• Should drive and execute complex technical requirements.
• Demonstrate excellent verbal and written communication skills.
• Collaborate with team members across the globe.
• Interface with cross functional teams and downstream applications as needed.
• Be a self-starter that is also an excellent team player.
• Follow agile best practices.
• Regularly evaluate cloud applications, hardware, and software.
• Work closely with cyber security team to monitor the organization’s cloud policy.
• Focus on building a team culture that is based on trust. Inspire your team member so that they focus on continuous growth.

Requirements

• Minimum 8+ years of working experience in Technology (application development and production support).
• 5+ years of experience in development of pipeline that extract, transform, and load data into an information product that helps the organization reach its strategic goals.
• Minimum 3+ years of experience in developing & supporting ETLs and using Python/Scala in Databricks/Spark platform.
• Having experience in creating visualizations on Power BI/ Tableau/ MicroStrategy preferably Micro Strategy
• Experience with Python, Spark, and Hive and Understanding of data-warehousing and datamodeling techniques.
• Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
• Strong data engineering skills with AWS cloud platform
• Experience with streaming frameworks such as Kafka
• Knowledge of Core Java, Linux, SQL, and any scripting language
• Experience working with any relational Databases preferably Oracle.
• Experience in continuous delivery through CI/CD pipelines, containers, and orchestration technologies.
• Experience working in an Agile development environment.
• Experience working with cross functional teams, with strong interpersonal and written communication skills.
• Candidate must have the desire and ability to quickly understand and work within new technologies.

Benefits

• Exposure to work on Latest cutting-edge Technologies.
• Opportunity to grow personally and professionally.
• Exposure to cutover legacy ETL pipelines to Spark framework.