Senior Data Engineer

Description

Job Summary: We are seeking a Senior Data Engineer to design and develop modern data solutions, including Data Lake/Data Mesh architectures on AWS. Key Highlights: 1. Design and development of Data Lake/Data Mesh architectures on AWS 2. Usage of AWS Glue, PySpark, Spark SQL, Redshift, and Athena 3. Participation in data product development projects Senior Data Engineer Data Lake / ETL / AWS (Medellín) · Accenture is a global leader in professional services, offering solutions in strategy and consulting, technology, operations, and digital capabilities that empower our clients to achieve their full potential. Within our Technology team, we design and develop modern data solutions that enable analytics, scalability, and better decision-making for our clients. We are currently seeking a Senior Data Engineer to participate in data product development projects and Data Lake / Data Mesh architecture implementation on AWS. · Role Responsibilities: · - Design and develop data ingestion, ETL/ELT processes, and data products within Data Lake / Data Mesh architectures. - Develop data processing workflows using AWS Glue, Python, PySpark, Spark SQL, AWS Redshift, and AWS Athena. - Optimize data loading and distributed processing with Apache Spark. - Apply best practices in programming, modularization, and use of libraries such as PySpark and Pandas. - Build advanced SQL queries for data transformation, validation, reconciliation, and exploitation. - Design ingestion pipelines from structured, semi-structured, and file-based sources into Amazon S3. - Manage metadata and cataloging using AWS Glue Data Catalog. - Orchestrate data pipelines with Apache Airflow / MWAA. - Develop unit tests and data quality controls. - Manage versioning and collaboration in Git repositories. · Position Requirements: · - Solid experience in data engineering on AWS. - Proficiency in AWS Glue, PySpark, Spark SQL, Redshift, and Athena. - Experience in pipeline design and distributed processing. - Advanced SQL expertise and process transformation modeling. - Experience working with catalogs, orchestration, and data quality. - Git proficiency and adherence to software development best practices. - Analytical mindset and results-oriented profile. - Residence in Medellín · Key Benefits 100% prepaid health insurance for the employee International medical coverage and dental insurance Optical allowance Agreements with banks, gyms, and many more benefits Desirable Certification: · AWS Certified Data Engineer – Associate. -Requirements- Minimum Education: University / Professional Degree 3 years of experience Keywords: engineers, ingeniera, ing, engineer, data, senior, sr