We are looking for a skilled **Lead Data Engineer** to join our team and drive innovative data solutions. The ideal candidate will have a solid foundation in software engineering, preferably within contact center solutions, and possess strong expertise in project management, stakeholder engagement, and leadership. *We accept* *CVs in English only.* **Responsibilities** * Collaborate with peers and leaders across the organization to foster effective communication and build strong partnerships * Establish credibility as a technical expert and leader, driving collaboration with architects, principal engineers, and other technical specialists * Promote the use of advanced techniques and technologies, such as process automation and innovative engineering practices, to enhance business value and reduce operational complexity * Create and manage cloud\-based resources in AWS * Design and implement data ingestion pipelines from various sources, including RDBMS, REST APIs, flat files, streams, and time\-series data * Utilize Big Data technologies to implement data ingestion and processing workflows * Process and transform data using technologies like Spark and cloud services * Apply business logic to data processing using programming languages supported by the data platform * Develop automated data quality checks to ensure the accuracy and integrity of ingested data * Build infrastructure to collect, transform, combine, and distribute customer data * Identify opportunities for process improvement to optimize data collection, insights, and reporting * Ensure data accessibility, scalability, and accuracy while maintaining flexibility and efficiency in data solutions * Analyze complex data sets to identify trends and patterns * Create frameworks and utilize data visualization tools to present actionable insights to stakeholders * Actively participate in Scrum ceremonies with agile teams * Develop queries, generate reports, and present findings clearly to stakeholders * Mentor and guide junior team members, sharing best practices and industry standards **Requirements** * Bachelor’s or Master’s degree in math, statistics, computer science, data science, or a related discipline * A minimum of 5 years of experience as a Data Engineer in industries such as consumer finance, consumer loans, collections, servicing, optional products, or insurance sales * At least 1 year of experience leading and managing development teams * Advanced knowledge of at least one programming language: Snowflake, Java, Scala, Python, or C\# * Hands\-on experience with HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, AWS, Docker, Kubernetes, and Snowflake * Proficiency with data mining and programming tools such as SAS, SQL, R, or Python * Expertise in database technologies such as PostgreSQL, Snowflake, and Greenplum * Willingness to learn and deploy new technologies and tools * Strong organizational skills to manage multiple projects and meet deadlines effectively * Excellent written and verbal communication skills with the ability to present technical results to non\-technical stakeholders * Knowledge of business intelligence and analytical tools, technologies, and methodologies * Fluent English skills, both written and spoken, at a B2\+ level or higher **Nice to have** * AWS certification * Experience with Spark Streaming * Knowledge of Kafka Streaming or Kafka Connect * Familiarity with ELK Stack * Experience with Cassandra or MongoDB * Hands\-on experience with CI/CD tools such as Jenkins, GitLab, Jira, or Confluence * Knowledge of database technologies like Redshift **We offer** * Learning Culture \- We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally * Health Coverage \- Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family * Visual Benefit \- Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200\.000 COP for any visual health expenses * Life Insurance Plan \- We have partnered with MetLife to offer a full\-coverage Ife insurance plan. So, your family is covered, even if you are gone. * Medical Leave Coverage \- We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us * Professional Growth Opportunities \- We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally * Stock Option Purchase Plan \- As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization * Additional Income \- Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways * Community Benefit \- You will be part of a worldwide community of over 50,000 employees, where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams! *Please note that even though you are applying for this position, you may be offered other projects to join within EPAM.* EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi\-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting\-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.