Middle Data Engineer

Description

Summary: Seeking a Data Engineer passionate about building reliable batch and real-time data pipelines, optimizing workflows, and working with modern big data and cloud technologies in an Agile environment. Highlights: 1. Design, develop, and maintain scalable ETL processes and data pipelines 2. Collaborate with stakeholders to deliver high-quality data solutions 3. Stay updated on emerging trends and technologies in data engineering Hybrid, Remote Colombia Medellín We’re looking for a Data Engineer to join a collaborative banking technology team working on scalable data platforms and modern data integration solutions. This role is ideal for someone passionate about building reliable batch and real\-time data pipelines, optimizing data workflows, and working with modern big data and cloud technologies in a fast\-paced Agile environment. **Key Responsibilities** ------------------------ * Design, develop, and maintain scalable **ETL processes and data pipelines** * Build batch and event\-driven pipelines using modern cloud and hybrid data platforms * Collaborate with business stakeholders, architects, and engineering teams to deliver high\-quality data solutions * Optimize data integration workflows for performance, scalability, and reliability * Implement and maintain **data quality and governance standards** * Troubleshoot and resolve data processing and integration issues * Follow **DataOps and CI/CD best practices** for deployment and automation * Contribute to Agile initiatives and continuous improvement efforts * Stay updated on emerging trends and technologies in data engineering **Requirements** ---------------- * 3–5 years of experience in **data engineering** and big data environments * Hands\-on experience with: * Spark * Hadoop * Kafka * Airflow * NiFi * Strong experience building **ETL pipelines and distributed data processing systems** * Proficiency in **Python and/or Scala** * Strong SQL and data modeling skills * Experience with cloud platforms such as: * Snowflake * Databricks * AWS * Azure * GCP * Familiarity with **Docker, Kubernetes, and CI/CD workflows** * Understanding of **DataOps, monitoring, and performance optimization** * Knowledge of data governance and data quality principles **Nice to Have** ---------------- * Experience with OpenShift, Trino, Ranger, or Hive * Exposure to BI tools such as Tableau or Superset * Familiarity with machine learning or data science workflows **We offer:** ------------- **Well\-being:** * 10 working days of Paid Day Off within an individual year. * Up to 15 working days of Unpaid days off within an individual year. **Professional Growth:** * Mentorship program – available on request. * Platzi online course platform – stay up\-to\-date with the latest technologies and programming languages. * English courses and Speaking Club – attend English classes twice a week in small groups. **Added advantages:** * Work equipment (Laptop, monitor, and small devices compensation). * If you know someone you believe is a good fit for our cooperation, you can recommend them and get a reward. * Public Holidays – celebrate 18 statutory holidays in Colombia. * Sombra events – Join Sombra’s traditional events (both online and offline).