Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
SG
Hybrid Vice President, Data Engineer
Posted yesterday
About the role
- VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Responsibilities
- Design, develop, testing & support of cloud data solutions for the CyberDW catalogue focusing on insider risk data ingestion, data quality, data tuning and performance of upstream cybersecurity and other data sources.
- Indirect leadership and mentorship of junior team members.
- Able to lead data feed development efforts and design initiatives.
- Participate in development meetings to align development priorities and objectives, assign tasks, and share experiences and challenges with applications under development.
- Consult with other technology and development teams as needed to coordinate on the integration of applications with the larger company software ecosystem.
- Capture and document metadata for identified Key Data Elements (KDEs) to ensure accuracy and completeness for Data Quality (DQ) rules and processing of daily datasets.
- Work with the data architecture team to align KDEs to the logical data models, develop physical data structures, and document physical data names, definitions, and data types.
- Partner with the data owners and stakeholders to create technical requirements and DQ rules around the data elements needed in the CyberDW.
- Partner with the Business Management team and Data Owners to understand what critical metrics and data fields are needed for Metric Dashboards.
- Establish CyberDW views to encapsulate the data so that it is fit for downstream consumption.
- Ensure that the data aligns with DQ rules established on that metadata, so it is fit for daily use.
- Identify and resolve DQ issues including inaccuracies and incomplete information.
- Enhance data quality efforts by implementing improved procedures and processes.
Requirements
- Bachelor’s degree in Computer Science, Information Security, Data Management, or related field
- 10+ years’ experience in IT development, data governance, data architecture or related roles, preferably in a highly regulated environment such as financial services.
- Strong knowledge of CI/CD and DevOps tooling (i.e., Git, Jenkins, Azure DevOps)
- Strong knowledge of Azure Databricks, Azure Data Factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Unity catalog repository configuration
- Proficient in data management & data modeling tools (e.g., Collibra DQIM/DQE, IBM Infosphere DA).
- Proficient in SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures
- Proficient in Python, Java or similar high-level server-side languages
- Strong knowledge of enterprise Information Security data (i.e., Phishing, Identity Management, Privileged Access, Cloud Security, Incident Response, Vulnerability Management, Threat Detection).
- Data knowledge of PaaS/SaaS products (i.e., ServiceNow, Crowdstrike, MS Purview, Proofpoint, WIZ.IO, JIRA, SharePoint, Azure Active Directory, SAI360).
- Knowledge of Microsoft Sentinel for security information and event management (SIEM) is a plus.
- Understanding of information security frameworks (i.e., NIST, CIS, CRI Profile) and regulatory compliance (i.e., NYSDFS, GDPR, CCPA).
- Experience with REST API web services and microservice architecture.
- Strong understanding of ETL/ELT.
- Knowledge of IBM Tivoli Workload Scheduler a plus.
- Exposure to PowerBI for data visualization and reporting is a plus.
- Problem solving and analytical skills, with an initiative-taking and results oriented approach.
Benefits
- SMBC provides reasonable accommodations during candidacy for applicants with disabilities consistent with applicable federal, state, and local law.
- Prospective candidates will learn more about their specific hybrid work schedule during their interview process.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.