




Summary: Steer architecture for Azure-based data pipelines and deliver dependable data products as a Lead Python Data Engineer. Highlights: 1. Lead architecture for Azure-based data pipelines and processing 2. Build FastAPI services and apply lakehouse design patterns 3. Ensure reliable delivery with GitHub Actions CI/CD and Bicep IaC We are delivering new Azure\-based data capabilities and seek a Lead Python Data Engineer to steer architecture for pipelines, background processing, and reporting. You will build FastAPI services, apply lakehouse design patterns, and ensure reliable delivery through GitHub Actions CI/CD and Bicep IaC. Apply now and help us scale dependable data products. **Responsibilities** * Architect and deliver web services along with background workflows using FastAPI * Create and refine data transformation and reporting pipelines with Pandas, Polars, openpyxl, and DuckDB * Design and oversee data pipeline architecture leveraging data lakes, medallion architecture, and star schema * Implement and manage CI/CD automation with GitHub Actions * Lead development of Azure\-based solutions using Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure setup with Bicep on Azure or transferable expertise from AWS CDK or Terraform * Adopt specification\-driven approaches with AI\-assisted tools like GitHub Copilot and Claude Code * Integrate orchestration frameworks into data pipelines using Airflow, dbt, or Streamlit **Requirements** * Proven track record in Python development for data engineering with at least 5 years of experience * Hands\-on proficiency with Pandas, Polars, openpyxl, or DuckDB for structuring, analyzing, and reporting data * Solid background in creating web services and background jobs using FastAPI * Deep understanding of data lakes, medallion architecture, or star schema for designing robust pipelines * Experience implementing CI/CD workflows through GitHub Actions * Extensive experience in Azure development with Container Apps, Azure Storage, Service Bus, or SignalR * Competency in Infrastructure as Code using Bicep or equivalent experience with AWS CDK or Terraform * Familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Knowledge of orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise covering stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience in front\-end frameworks such as Angular or Next.js


