




Summary: Seeking a Lead Python Data Engineer to drive high-performance data pipelines and web services, advancing automation in a cloud-first environment on Azure. Highlights: 1. Spearhead high-performance data pipelines and web services 2. Lead design and execution of data pipelines with modern tools 3. Take ownership of innovative projects with direct impact We are looking for a **Lead Python Data Engineer** to spearhead the creation of high\-performance data pipelines and web services while advancing automation in a cloud\-first environment. You will guide the team in applying Python expertise, leveraging modern data tools, and architecting scalable solutions on Azure. Join us and take ownership of innovative projects where your skills make a direct impact. **Responsibilities** * Architect and deliver web services and background processing jobs using FastAPI * Lead the design and execution of data pipelines utilizing data lakes, medallion architecture, and star schema models * Manage data processing and reporting with Pandas, Polars, openpyxl, and DuckDB * Oversee CI/CD processes by configuring and maintaining GitHub Actions workflows * Direct the development and upkeep of Azure\-based solutions including Container Apps, Azure Storage, Service Bus, and SignalR * Automate infrastructure provisioning through Bicep for Azure, or adapt AWS CDK and Terraform expertise * Implement specification\-driven development using AI\-assisted tools like GitHub Copilot and Claude Code * Incorporate Airflow, dbt, or Streamlit functionalities as needed **Requirements** * 5\+ years of experience in Python development and data engineering, with relevant leadership experience * Proficiency with data processing libraries such as Pandas, Polars, openpyxl, and DuckDB * In\-depth knowledge of FastAPI for delivering web services and background jobs * Hands\-on expertise with CI/CD using GitHub Actions and IaC automation with Bicep * Advanced skills in engineering Azure solutions leveraging Container Apps, Azure Storage, Service Bus, or SignalR * Comprehensive understanding of data lakes, medallion architecture, and star schema design * Proven capability with AI\-assisted development using GitHub Copilot and Claude Code * Awareness of tools such as Airflow, dbt, or Streamlit * Ability to transfer AWS CDK or Terraform experience for Azure implementation **Nice to have** * Understanding of distributed processing, asynchronous workflows, and enterprise messaging patterns * Experience with Snowflake features including stored procedures, streams, tasks, pipes, and time travel * Background in .NET Core web development * Knowledge of Angular or Next.js for modern web applications


