Principal Software Engineer developing secure crypto platform for Fidelity Digital Assets while mentoring fellow engineers. Collaborating with technical leaders and adopting modern software development practices.
CL
Hybrid Distributed Systems Engineer – Data Platform, Logs and Audit Logs
Posted 6 months ago
About the role
- Distributed Systems Engineer at Cloudflare contributing to logs and audit logs management within the Data Platform. Engage in the development of scalable systems for efficient data handling and delivery.
Responsibilities
- Design, build, and operate a robust logging platform, ensuring reliable logging, and secure data transfer to a wide array of customer destinations and third-party integrations.
- Develop and maintain high-performance data connectors and integrations for our log-shipping products, focusing on usability, scalability and data integrity.
- Create and manage systems for handling comprehensive audit logs, ensuring they are delivered securely and adhere to strict compliance and performance standards.
- Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing.
- Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations.
- Maintain the operational health of our log delivery platform through comprehensive monitoring and participation in an on-call rotation (with flexibility for out-of-hours technical issue resolution).
- Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability.
Requirements
- 3+ years of experience working in software development covering distributed systems and data pipelines.
- Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems.
- Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
- Strong knowledge of SQL, including experience with query optimisation.
- A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
- Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
- Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
- Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.
- Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus.
- Experience with Infrastructure as Code tools like SALT or Terraform is a plus.
- Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.
Benefits
- Competitive salary
- Flexible work arrangements
- Professional development opportunities
- Paid time off
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Blockchain Data Solutions Associate at CBIZ assisting with digital asset research and audits. Analyzing blockchain data and collaborating with teams for audit readiness and deliverables.
Associate supporting audit processes related to digital assets and blockchain technologies at CBIZ. Contributing to client engagements and maintaining high professional standards in service delivery.
Head of Partnerships at Cosmos Labs guiding strategic partnerships in blockchain ecosystem development. Fostering relationships with system integrators and consulting firms for enterprise implementations.
Lead Distributed Systems Engineer developing a high - scale, low - latency platform at Salesforce. Managing real - time data ingestion and streaming for Sales Cloud AI agents.
Blockchain & Fraud Models Analyst at ClearBank developing monitoring controls for blockchain - based products. Collaborating with multiple teams to enhance financial crime analytics capabilities.
Distributed Systems Engineer responsible for building Rust - based rollup nodes and sequencers. Designing efficient and secure systems for zero - knowledge proof based products within a fintech startup.
Responsible Officer overseeing virtual asset licensing and compliance within Hong Kong. Requires extensive experience in blockchain, financial markets, and regulatory environments.
Senior Software Engineer focused on designing and maintaining supply chain software solutions. Involving technical leadership and solving complex software challenges within a team.
Blockchain Senior Associate at RSM developing blockchain applications and supporting innovation initiatives across multiple platforms and business partners.