Process Mining Data Engineer implementing Celonis across business units at LSEG. Collaborating with executives and teams to optimize operations and drive business outcomes.
About the role
- Engineering team at Crypto.com responsible for designing and developing software for various ventures projects. Focused on scalable applications and innovative solutions.
Responsibilities
- Manage the daily operations of Hadoop, Spark, Flink, Clickhouse, and other big data platforms to ensure system stability and data security;
- Operate and administer Linux systems, proficient in common commands, with scripting skills in Shell, Python, or similar languages;
- Maintain and operate big data components on cloud platforms (AWS/GCP/Azure), with hands-on experience in container technologies such as Kubernetes and Docker;
- Build and maintain monitoring systems to track platform performance, optimize configurations and resource allocation, and troubleshoot performance issues (tools such as Datadog, Prometheus, Grafana, Zabbix, etc.);
- Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala,Clickhouse and Kudu;
- Write and maintain technical documentation for operations, and support in platform solution design and upgrades;
- Explore and adopt new technologies to optimize operation processes and provide technical guidance to help client teams improve their capabilities.
- Preferred: Experience on the development of n8n workflow
Requirements
- Familiarity with CDH/CDP/HDP or similar Hadoop distributions, with proven experience in big data platform operations preferred;
- Proficiency in Linux administration and scripting (Shell, Python, or equivalent);
- Experience with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker);
- Strong knowledge of big data components and performance tuning, able to resolve stability and scalability issues independently;
- Strong technical writing and communication skills to support documentation and solution delivery;
- Self-motivated with a passion for new technologies, able to apply innovative approaches to optimize operations and drive efficiency.
Benefits
- Competitive salary
- Attractive annual leave entitlement including: birthday, work anniversary
- Work Flexibility Adoption. Flexi-work hour and hybrid or remote set-up
- Aspire career alternatives through us. Our internal mobility program can offer employees a diverse scope.
- Work Perks: crypto.com visa card provided upon joining
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer focusing on Retrieval - Augmented Generation (RAG) and AI solutions at LexisNexis. Collaborating with teams to integrate AI into existing systems and optimizing models for performance.
Senior Data Engineer on CNN's AI Enablement & Machine Learning team optimizing ML and AI experiences. Collaborating with engineers to enhance data pipelines and integrate features into platforms.
Data Engineer at Sand Cherry Associates with expertise in ETL, Python, and SQL. Responsible for designing data structures and maintaining accuracy for client projects.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates. Requires strong expertise in Redshift SQL, Python, and DBT with hybrid work structure.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates with expertise in Redshift SQL, Python, and DBT.
Data Engineer responsible for the end - to - end data infrastructure at AVK. Designing ETL pipelines and collaborating with teams on data solutions.
Migration Engineer leading data migrations to GiG’s CoreX platform with a focus on data integrity and collaboration.
Data Platforms Manager overseeing technical delivery of engineering initiatives for Disney's data solutions. Leading project teams, innovation, and multi - stakeholder collaborations in a fast - paced environment.
Senior Data Engineer with expert - level database skills at FreedomPay. Collaborating on data pipelines and products across SQL Server and Snowflake.