**What are we looking for?** Data Engineer **Your main responsibilities:** Lead data discovery to define the strategy and target design for ingestion, transformation, and governance in Azure, integrating operational sources from applications in AWS. Ensure the future solution includes traceability, data quality, and analytical exploitation. **Responsibilities** * Assessment of current state o Map end\-to\-end data flows: sources, interfaces, frequencies, latencies, volumes, dependencies, and failure points. o Review Data Lake (ADLS) usage: current zoning (bronze/silver/gold), formats (Parquet/Delta), partitioning, costs, and operational practices. o MDM diagnosis: sources of truth, reconciliation, Golden Record, synchronization processes, and responsible parties. o Identify gaps in quality, lineage, security, and access for analytics/reporting. * Design of future solution (high level) o Define target data architecture in Azure (lakehouse) and ingestion mechanisms from AWS (CDC, streaming, batch). o Propose data contracts and canonical schemas by domain; dataset versioning policies and SLAs. o Traceability and quality strategy: technical/business lineage (Purview), quality rules/thresholds, automated testing, and scorecards. o Access and analytical exploitation: gold/semantic layers, data products, performance, access governance (Entra ID/RBAC). * Transition plan and quick wins o Roadmap by waves: prioritization of sources, migrations, standardization, and automation. o Quick wins: enable priority CDC, correct partitioning and compaction, enable lineage in Purview, implement critical quality controls. o Define KPIs and OKRs for the data stream (e.g., % datasets with lineage, % automated quality rules, reduction in pipeline failures). * Facilitation and coordination o Workshops with business/BI/architecture/dev teams to gather analytics and operational requirements. o Documented decisions (ADRs), initial catalogs, and data governance agreements. o Alignment with Solution Architect on data contracts and AWS-Azure synchronization. **Mandatory Requirements** * 4\+ years in data engineering; experience leading assessments/discovery in Azure. * ADLS, Databricks/Spark or Synapse, Data Factory; integration from AWS (S3/Kinesis/DMS) via CDC/streaming/batch. * Lakehouse modeling, columnar formats (Parquet/Delta), partitioning, and performance. * Governance and security: Purview (catalog/lineage), RBAC/Entra ID, Key Vault, encryption. * Data Quality and testing (Great Expectations/Deequ or equivalent) and CI/CD practices for data. * Collaboration with Architecture/Apps teams on data contracts and synchronization. **Desirable** * Experience in MDM/Golden Record and data product design. * Cost optimization (Data FinOps) and pipeline observability. * Certifications: DP\-203 (Azure Data Engineer), Databricks. **Soft skills:** * Clear mapping and synthesis of complex environments; impeccable documentation. * Technical facilitation with multiple stakeholders; effective communication. * Outcome-oriented mindset, prioritization, and problem-solving. *\-In compliance with our personal data protection policies, we inform you that the information you provide will be processed in accordance with the Privacy Notice available on our website, under the section: Privacy Notice for Personal Data Processing\- Candidate\-* As an IT consulting and software development partner, we specialize in digital transformation for clients in finance, insurance, and industry. Our 700 talents in Germany develop sustainable solutions using cutting-edge technologies. **What we offer** ----------------- * **Work-life balance and flexibility:** Hybrid/remote work options, flexible hours, and intensive Fridays. * **Training and Development:** Personalized plans, training programs. * **Social Benefits:** Life insurance, remote work support. * **Flexible Benefits "à la carte":** Corporate allowance for food, transportation, health insurance, childcare, and training, tailored to your needs and combined with flexible compensation. * **Relocation Package (if applicable):** Financial support, advisory services, visa sponsorship. * **Employee Referral Program.** * **Wellness Program:** Nutrition, physical, mental health. Discounts with Wellhub. Free psychological support service. * **Life at GFT:** Smart offices, events, value awards, inspiring talks. * **International corporate culture.**