···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Lead Python Data Engineer to define scalable pipelines, services, and reporting standards for an expanding Azure data platform. Highlights: 1. Lead delivery of FastAPI APIs and background jobs 2. Apply lakehouse concepts, CI/CD with GitHub Actions, and IaC with Bicep 3. Elevate data systems with advanced Azure skills and AI-assisted tooling We are expanding our Azure data platform and are looking for a Lead Python Data Engineer to define scalable pipelines, services, and reporting standards. You will lead delivery of FastAPI APIs and background jobs while applying lakehouse concepts, CI/CD with GitHub Actions, and IaC with Bicep. Submit your application to help elevate our data systems. **Responsibilities** * Design and deliver FastAPI\-based web services and background workflows * Develop data transformation and reporting pipelines using Pandas, Polars, openpyxl, and DuckDB * Define pipeline architecture around data lakes, medallion architecture, and star schema patterns * Maintain and improve CI/CD automation with GitHub Actions * Drive Azure development using Container Apps, Azure Storage, Service Bus, and SignalR * Provision and manage infrastructure using Bicep on Azure or equivalent AWS CDK or Terraform skills * Apply specification\-driven approaches with AI\-assisted tooling like GitHub Copilot and Claude Code * Embed orchestration frameworks into pipelines using Airflow, dbt, or Streamlit **Requirements** * Demonstrated success in Python development for data engineering with 5\+ years of experience * Practical experience with Pandas, Polars, openpyxl, or DuckDB to prepare, analyze, and report on data * Strong experience creating web services and background jobs with FastAPI * Thorough knowledge of data lakes, medallion architecture, or star schema for end\-to\-end pipeline design * Proven ability to implement CI/CD using GitHub Actions * Advanced Azure skills with Container Apps, Azure Storage, Service Bus, or SignalR * Hands\-on Infrastructure as Code capability using Bicep or comparable experience with AWS CDK or Terraform * Working familiarity with AI\-assisted coding tools such as GitHub Copilot or Claude Code * Exposure to orchestration and reporting tools including Airflow, dbt, or Streamlit **Nice to have** * Understanding of distributed data processing, async task execution, or enterprise messaging * Snowflake expertise covering stored procedures, streams, tasks, pipes, and time travel features * Background in .NET Core web development * Experience in front\-end frameworks such as Angular or Next.js

Source:  indeed View original post
Valentina Rodríguez
Indeed · HR

Company

Indeed
Valentina Rodríguez
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.