Browse
···
Log in / Register
Job Summary: We are seeking a proactive Big Data Administrator to manage, monitor, and optimize a Big Data platform on AWS, taking ownership of its stability and performance. Key Highlights: 1. Proactive focus on Big Data platform stability and performance. 2. Incident management with clear processes and on-call support. 3. Ownership mindset and continuous improvement in administration. Vienna, Austria \| Hybrid work model \| Full-time (38.5 hours per week) \+ scheduled on-call shifts Our client operates a large-scale Big Data platform on AWS cloud and is expanding its Data Operations team. We seek a Big Data Administrator with a practical and proactive approach who treats the platform as their own, continuously driving its stability and performance—rather than merely reacting to incidents or tickets. This role also includes incident management during regular working hours and under a scheduled on-call availability scheme, following clearly defined communication and resolution processes. Mandatory Requirements Candidates failing to meet these requirements will not be considered. * Solid Linux expertise and hands-on experience with Hadoop ecosystem services (e.g., HDFS, ZooKeeper, YARN, Impala, Spark, Kafka, etc.). * Experience automating infrastructure using Terraform. * Programming knowledge in Spark and Python. * Demonstrable experience with on-call shift schemes, structured incident resolution, and troubleshooting. * Ownership mindset and commitment to continuous improvement, with ability to proactively manage the platform. * Fluent professional-level English. Responsibilities * Administer, monitor, and optimize the Big Data platform on AWS. * Manage and maintain services on Cloudera Cloud PaaS and native AWS services such as Kafka, Flink, NiFi, Iceberg Tables, and DynamoDB. * Implement Infrastructure-as-Code (IaC) on AWS using Terraform and ArgoCD. * Execute upgrades, enhancements, and incident management across all platform components. * Advise data platform developers on selecting appropriate services for various business use cases. * Provide Level 3 (L3) support, including monitoring, error analysis, and incident resolution to ensure high system availability—including 24/7 support under an on-call scheme. * Support workload optimization, including: o Memory management in Flink processes. o Query optimization in Impala and Trino. * Evaluate and implement cloud-native services aligned with the organization’s technology architecture. Additional Assets * Kubernetes experience (highly desirable). * Knowledge and experience with Cloudera services: HDFS; ZooKeeper; YARN; Impala; Hue; Spark; Kafka; Flink; Knox; Ranger Raz; Streams Messaging Manager: NiFi; Kudu. * Experience managing rolling restarts. Conditions * Annual gross salary up to EUR 85\.000, depending on experience and qualifications. * Working hours: 38.5 hours per week. * Participation in a structured scheduled on-call shift scheme. * Integration into a specialized 7-member Data Operations team, including a team lead. Benefits: Financial \- Meal allowance (EUR 3 per working day). \- Childcare allowance. \- Corporate discounts via Corporate Benefits and Corplife. \- Referral bonus. \- Employee gifts for special occasions (Christmas, anniversaries, etc.). \- Free beverages and fruit basket. Teamwork Benefits Corporate and integration events: * Summer party (family-friendly). * Christmas party. * After-office gatherings. * Baby-and-family meetings. Participation in specialized engineering communities: * DevOps * Artificial Intelligence (AI) * Backend * Frontend Application Questions: * Do you have fluent English language skills? At what level? * How many years of experience do you have with Linux and Hadoop ecosystem services (HDFS, ZooKeeper, YARN, Impala, Spark, Kafka, etc.)? Please specify which Hadoop components you handle. * Do you have experience automating infrastructure using Terraform? * Do you have programming knowledge in Spark and Python? * How many years of experience do you have with on-call shift schemes, structured incident resolution, and troubleshooting? Workplace: On-site employment
