We are seeking a motivated and self\-driven **Lead Data Engineer** with a strong technical background in data processing and manipulation. The ideal candidate will be responsible for working with data ingestion from various sources, transforming it into robust datasets, and managing it effectively — primarily in cloud storage environments. If you have expertise in Python\-based data processing, a keen interest in working with cutting\-edge tools like Databricks, and a passion for working with complex, large\-scale data, we want to hear from you! *We accept* *CVs in English only.* **Responsibilities** * Develop and maintain reliable data pipelines for ingesting, transforming, and storing data from multiple sources * Manipulate complex datasets and preprocess large\-scale logs and time\-series data using state\-of\-the\-art tools and frameworks * Leverage your knowledge of Python (Pandas, NumPy, etc.) to perform exploratory data analysis (EDA) and prepare data for business and analytical use cases * Work collaboratively with cloud\-based tools and infrastructure, focusing on scalability and performance optimization * Utilize tools like Databricks, if experienced, or demonstrate a willingness to quickly ramp up on Databricks’ Lakehouse, Workflow, and ETL functionalities **Requirements** * Proven experience of over 5 years as a Data Engineer or in a similar role, demonstrating a self\-driven and problem\-solving mindset * At least 1 year of relevant leadership experience * Expertise in Python for data processing, analysis, and manipulation (e.g., Pandas, NumPy, and advanced libraries) * Proven experience working with large\-scale logs, time\-series data, and structured/unstructured data in diverse formats, preferably hardware/device data logs * Knowledge of Databricks, including workflows, ETL processes, and working with Lakehouse architecture, is highly desirable * Experience working with device data manipulation, such as medical data, IoT device data, hardware data, or similar * Excellent command of written and spoken English (B2\+ level) **Nice to have** * Exposure to PyTorch or TensorFlow for advanced data processing and AI/ML tasks * Understanding of or experience with AI/ML models, along with the ability to apply predefined machine learning models to datasets **We offer** * Learning Culture \- We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally * Health Coverage \- Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family * Visual Benefit \- Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200\.000 COP for any visual health expenses * Life Insurance Plan \- We have partnered with MetLife to offer a full\-coverage Ife insurance plan. So, your family is covered, even if you are gone. * Medical Leave Coverage \- We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us * Professional Growth Opportunities \- We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally * Stock Option Purchase Plan \- As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization * Additional Income \- Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways * Community Benefit \- You will be part of a worldwide community of over 50,000 employees, where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams! *Please note that even though you are applying for this position, you may be offered other projects to join within EPAM.* EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi\-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting\-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.