




Summary: We are seeking a Lead Python Data Engineer to architect high-performance data solutions and lead innovation in pipeline design, background processing, and reporting within an Azure cloud ecosystem. Highlights: 1. Lead innovation in pipeline design and background processing 2. Architect and deliver web services and background workflows using FastAPI 3. Shape advanced data systems within an Azure cloud ecosystem We are seeking a **Lead Python Data Engineer** to architect high\-performance data solutions and lead innovation in pipeline design, background processing, and reporting within an Azure cloud ecosystem. You will collaborate closely with cross\-functional teams, leveraging FastAPI, modern data lakehouse approaches, and scalable infrastructure to deliver impactful services. Join us and bring your expertise to shape advanced data systems—apply today. **Responsibilities** * Architect and deliver web services along with background workflows using FastAPI * Create and refine data transformation and reporting pipelines with Pandas, Polars, openpyxl and DuckDB * Design and oversee data pipeline architecture leveraging data lakes, medallion architecture, and star schema * Implement and manage CI/CD automation with GitHub Actions * Lead development of Azure\-based solutions using Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure setup with Bicep on Azure or transferable expertise from AWS CDK or Terraform * Adopt specification\-driven approaches with AI\-assisted tools like GitHub Copilot and Claude Code * Integrate orchestration frameworks into data pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record in Python development for data engineering with at least 5 years of experience * Hands\-on proficiency with Pandas, Polars, openpyxl or DuckDB for structuring, analyzing, and reporting data * Solid background in creating web services and background jobs using FastAPI * Deep understanding of data lakes, medallion architecture, or star schema for designing robust pipelines * Experience implementing CI/CD workflows through GitHub Actions * Extensive experience in Azure development with Container Apps, Azure Storage, Service Bus, or SignalR * Competency in Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise covering stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience in front\-end frameworks such as Angular or Next.js


