Summary: Seeking a Lead Python Data Engineer to modernize Azure lakehouse infrastructure, leading pipeline development, background processing, and reporting services. Highlights: 1. Lead architecture for FastAPI web services and background workflows 2. Shape pipeline architecture leveraging data lakes and medallion architecture 3. Automate infrastructure setup with Bicep or transferable IaC experience We are modernizing our Azure lakehouse and need a Lead Python Data Engineer to lead how we build pipelines, background processing, and reporting services. You will coordinate with multiple teams to deliver FastAPI services, strengthen CI/CD via GitHub Actions, and manage IaC with Bicep while using proven data modeling patterns. Apply today to make a measurable impact. **Responsibilities** * Own architecture for FastAPI web services and background workflows * Create and improve transformation and reporting pipelines with Pandas, Polars, openpyxl, and DuckDB * Shape pipeline architecture leveraging data lakes, medallion architecture, and star schema * Operate and enhance CI/CD automation using GitHub Actions * Lead Azure implementation with Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure setup with Bicep or apply transferable AWS CDK or Terraform experience * Use specification\-driven development with AI\-assisted tools like GitHub Copilot and Claude Code * Connect orchestration frameworks to pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record delivering Python data engineering solutions with 5\+ years of experience * Hands\-on proficiency using Pandas, Polars, openpyxl, or DuckDB for data structuring, analysis, and reporting * Solid background implementing web services and background jobs with FastAPI * Deep understanding of data lakes, medallion architecture, or star schema to guide pipeline design decisions * Experience setting up CI/CD workflows through GitHub Actions * Extensive experience building on Azure with Container Apps, Azure Storage, Service Bus, or SignalR * Competency with Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise including stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience with front\-end frameworks such as Angular or Next.js