Distributed Systems Engineer at Cloudflare contributing to logs and audit logs management within the Data Platform. Engage in the development of scalable systems for efficient data handling and delivery.
Responsibilities
Design, build, and operate a robust logging platform, ensuring reliable logging, and secure data transfer to a wide array of customer destinations and third-party integrations.
Develop and maintain high-performance data connectors and integrations for our log-shipping products, focusing on usability, scalability and data integrity.
Create and manage systems for handling comprehensive audit logs, ensuring they are delivered securely and adhere to strict compliance and performance standards.
Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing.
Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations.
Maintain the operational health of our log delivery platform through comprehensive monitoring and participation in an on-call rotation (with flexibility for out-of-hours technical issue resolution).
Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability.
Requirements
3+ years of experience working in software development covering distributed systems and data pipelines.
Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems.
Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
Strong knowledge of SQL, including experience with query optimisation.
A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.
Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus.
Experience with Infrastructure as Code tools like SALT or Terraform is a plus.
Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.
Benefits
Competitive salary
Flexible work arrangements
Professional development opportunities
Paid time off
Job title
Distributed Systems Engineer – Data Platform, Logs and Audit Logs
Director of Digital Assets Risk overseeing risk management for digital asset investment products. Defining frameworks and providing expertise across investment, trading, and compliance groups.
Corporate Technology Strategy Senior Associate driving digital transformation at PwC. Advising on complex technology strategy problems and mentoring junior team members while delivering client outcomes.
Marketing Manager for a blockchain - focused organization developing next - generation digital asset products and marketing strategy. Responsible for strengthening brand visibility and building partnerships in the global ecosystem.
Lead Protocol Engineer architecting blockchain applications at Wells Fargo. Focused on compliance and cryptographic solutions for institutional finance while challenging privacy issues.
Supply Chain Developer in Wells Fargo's Software Engineering team, optimizing and maintaining applications in COTS solutions. Leading technical initiatives and collaborating for strategic goals.
Financial Crime Analyst responsible for transaction monitoring and compliance at ClearBank. Engaging with junior team members and raising concerns in financial crime matters.
Architect Specialist leading Blockchain and DID/VC initiatives from discovery to production at Vivo. Transforming digital identity and ensuring robust solutions in technology.
Senior Analyst developing decentralized identity solutions supported by blockchain for Vivo. Collaborating on integrations and implementations that align with corporate architecture strategy.
Design and implement scalable DID/VC architectures on public or permissioned blockchains. Lead integrations with identity services, corporate systems, ZKP frameworks and operational practices.
Senior Protocol Engineer at Wells Fargo architecting a custom blockchain application. Work on privacy/compliance in institutional finance leveraging advanced cryptography and distributed systems.