Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
About the role
- Data Engineer 3 maintaining Comcast's audit data platform architecture while supporting advanced analytics and automation. Involves project management, designing data pipelines, and ensuring data quality and security.
Responsibilities
- Maintaining the data platform architecture and environments, including but not limited to patching, monitoring, tuning, etc.
- Reviewing and supporting data pipelines and queries running through the data platform providing feedback regarding performance tuning and scalable query best practices
- Upgrading and maintaining systems and tools used by the audit team (i.e. TeamMate+)
- Demonstrates project management skills for data platform maintenance / upgrades, including proposing project plans, scheduling deliverables across CGA teams, executing per plan, and messaging status/issues to management.
- Designs, builds, and maintains resilient, automated data pipelines.
- Introduces and maintains data quality checks and observability tooling (e.g., Monte Carlo, Great Expectations) to ensure data accuracy, lineage, and pipeline reliability.
- Builds end-to-end pipeline monitoring: logging, alerting, and traceability from source ingestion to report-ready datasets.
- Supports CI/CD pipelines (e.g., GitHub Actions) for secure, auditable deployments of infrastructure and code.
- Manages data integration across diverse sources (APIs, SFTP, databases) using secure, repeatable patterns with version control and infrastructure-as-code practices.
- Independently delivers robust data engineering solutions with minimal supervision, including root-cause analysis and long-term fixes.
- Leads code reviews and contributes to evolving team-wide engineering standards, documentation, and architecture, championing best practices.
- Maintains strong operational rigor in maintaining cyber compliance, patching, resiliency, upgrades, etc.
- Ensures all data is secure and follows company policies regarding data classification.
- Analyzes data to assess compliance with established policies/procedures, best practices, US GAAP, and legal/governmental requirements.
- Uses data concepts, tools, and programming techniques including SQL, dbt, Snowflake, Airflow, Tableau, AWS, MS SQL Server, Oracle BI, Teradata, Databricks, Alteryx, Spark, Python, and R to perform ETL and data analysis activities.
- Develops process flows, prototypes, and requirements documentation to accelerate stakeholder understanding and guide solution development.
- Creates, documents, and executes support process steps and test procedures to ensure data deliverables are accurate and sustainable.
- Facilitates discussions that lead to decision-making throughout the lifecycle of creating and enhancing data solutions.
- Prepares clear and well-organized analysis workpapers, documenting root-cause (as applicable), work performed, findings, and recommendations.
- Creates graphical reports and executive presentations to effectively summarize analysis and findings.
- Consistently exercises independent judgment and discretion in matters of significance.
- Assists with managing, scheduling, monitoring, and maintaining automated processes in production.
- Supports department objectives and performs other duties and responsibilities, as assigned.
Requirements
- Bachelor's Degree
- 5-7 Years Relevant Work Experience
- AWS
- Devops
- Cybersecurity
- Data Engineering
- Snowflake Data Warehouse
- System Operations
Benefits
- array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.