Bilingual Data Engineer (AWS & Databricks)

Description

Job Summary: We are seeking a Data Engineer passionate about modern engineering, with expertise in AWS, Databricks, and PySpark, who integrates AI to solve complex problems and build Data Lake architectures. Key Highlights: 1. Continuous technical and personal growth 2. Culture of continuous improvement and well-being 3. AI integration to accelerate engineering Are you **looking for new challenges** and a place where you can enjoy a close-knit environment while continuously **learning**? Welcome to a team with a clear purpose: **"TRANSFORMING** people's lives by being the most trusted **TECHNOLOGICAL** partner"! ### **Get ready and join this adventure!** **What will you find?** --------------------- * **Technical and personal challenges** that will keep you growing constantly. * A connected team focused on **your physical and mental well-being**. * A **culture of continuous improvement**, fresh and collaborative, with learning opportunities and colleagues eager to support you. * **KaizenHub**, a program designed to enhance your talents, offering **feedback**, mentoring, and coaching through **Sofka U**. It will be both a challenge and a game! * Programs such as **Happy Kaizen** and **WeSofka**, which care for your physical and emotional well-being. **What are we looking for?** ------------------ A passionate professional in modern engineering who combines solid expertise in **AWS, Databricks, and PySpark** with cutting-edge AI tools such as **Claude Code, Copilot, and Cursor AI**. If you are motivated to solve complex *Change Data Capture* (CDC) problems, design resilient *Data Lake* architectures, and automate pipelines with AI support to accelerate data product development, this is your place. ### **Your Challenges and Impact** * **Build and optimize data pipelines:** You will design and implement highly scalable ingestion and processing workflows on AWS and Databricks infrastructures. * **Lead CDC and deduplication strategies:** You will define data refresh mechanisms using audit keys, *hash* comparisons, and *merge* strategies in Delta Lake to ensure data integrity and freshness. * **Accelerate engineering with AI:** You will integrate assistants like Cursor AI, Copilot, and Claude Code into your daily work to speed up delivery of data products, *dashboards*, and high-performance code. * **Strategic modeling and ingestion:** You will interpret complex data models to design efficient ingestion cycles aligned with *Data Governance* best practices. * **Evolve the Data Lake architecture:** You will work alongside modern frameworks (Delta Lake, Hudi, or Iceberg), ensuring a governed, fast, and secure environment. **What do you need?** ------------------- * **Solid experience:** 4–6 years of proven track record in Data Engineering and ETL process development. * **Primary stack:** Deep proficiency in **Python, SQL, and PySpark**. * **Cloud ecosystem (AWS):** Demonstrated hands-on experience with **Lambda, RDS, EC2, and SQS**. * **Modern Data Lake architecture:** Solid experience working with **Delta Lake** (or alternatives such as Apache Hudi / Iceberg). * **Expert-level CDC concepts:** Clear ability to explain and implement *Change Data Capture* cycles, *hash*-value comparison for deduplication, and *merge* strategies. * **AI-assisted engineering:** Active and comfortable use of AI-powered development tools (Claude Code, Co\-Pilot, Cursor AI) to optimize your deliverables. * **Languages:** Fluent English (C1 / 100%), capable of communicating with technical precision in global environments. * Advanced proficiency in the **Databricks** platform. * Prior experience designing and building **ETL frameworks** from scratch. * Familiarity with AI-driven Data Governance tools (e.g., Data Galaxy, Databricks AI). ### **APPLY NOW and become part of this story!** **Conditions** --------------- * **Contract type: Contractor**/Freelance * **Seeking professional growth?** At Sofka, we offer a **learning ecosystem** with multiple tools to bridge skill gaps and boost your capabilities. You decide how you want to grow!