Data Engineer - Standard

Description

Job Summary: Design, develop, and maintain scalable and efficient data pipelines, collaborating with cross-functional teams and leveraging generative AI tools for digital transformation. Key Highlights: 1. Design and development of scalable and efficient data pipelines 2. Collaboration in dynamic environments with a results-oriented approach 3. Use of generative AI to accelerate development and analysis **Company Description** Inetum is a global technology and digital innovation services company present in more than 26 countries. In Colombia, Inetum delivers advanced technological solutions that drive the digital transformation of enterprises across diverse sectors, providing services in consulting, software development, systems integration, outsourcing, and technical support. With a focus on agility and adaptability, Inetum Colombia aims to create value for its clients by implementing innovative technologies that enhance efficiency and productivity. Our team consists of experts across various technological domains, working in a collaborative, dynamic, and results-driven environment. Join Inetum and become part of a company transforming the future of businesses through technology. **Job Description** **Responsibilities** * Design, develop, and maintain **scalable and efficient data pipelines**. * Build and optimize **ETL/ELT processes** for ingestion, transformation, and loading of data from multiple sources. * Ensure **data quality, consistency, traceability, and availability**. * Process large volumes of structured and unstructured data. * Collaborate with analytics, data science, and business teams to understand requirements and translate them into technical solutions. * Participate in defining cloud-based data architectures. * Leverage **generative AI tools and intelligent agents** to accelerate development, analysis, and problem resolution. * Document implementations, workflows, and best practices. * Interact directly with clients, understanding their needs and proposing high-value solutions. **Requirements** **Requirements** * Solid experience with **SQL databases**. * Knowledge and experience with **relational and non-relational databases** (PostgreSQL, MySQL, SQL Server, MongoDB, DynamoDB, or others). * Proficiency in **Python** and **Scala** for data manipulation and processing. * Practical experience with **Apache Spark** (Spark SQL, DataFrames, job optimization). * Knowledge of **data transformation, cleaning, validation, and enrichment**. * Familiarity with **ETL/ELT tools and frameworks** (Airflow, AWS Glue, DBT, or others). * Understanding of storage architectures such as **Data Lake / Lakehouse**. * Experience with **AWS cloud services** (S3, EMR, Glue, Lambda, Redshift, Athena, etc.). * Knowledge of Control M and Data X. * Proficiency in **version control (Git / GitHub)** and software development best practices. * **Knowledge of AI agents and use of generative AI tools** to support technical work and productivity, including: + **GitHub Copilot** for code assistance and refactoring. + **GPT (OpenAI)** for code generation, data analysis, documentation, and troubleshooting. + **Gemini (Google)** or other large language model platforms for technical exploration and support. + Basic understanding of how to integrate or consume **LLMs via APIs** for analytical or automation use cases. * Java experience or knowledge is a plus. **Additional Information** * Strong **analytical capability**, with emphasis on data accuracy and quality. * **Clear and effective communication**, both with technical and non-technical stakeholders. * Experience working **directly with clients**, gathering requirements and managing expectations. * Proactivity and orientation toward continuous improvement. * Ability to work collaboratively in multidisciplinary environments. * Autonomy, organization, and accountability in delivering results. * Adaptability to dynamic environments and emerging technologies.