···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: We are seeking a Lead Python Data Engineer to guide the design of data platforms on Microsoft Azure, strengthen CI/CD, and partner with teams to improve reliability and performance. Highlights: 1. Lead and improve Python backend services and background jobs 2. Architect and maintain data lakes, medallion layers, and star schemas 3. Champion the adoption of GitHub Copilot and Claude Code We are building scalable Python data platforms on Microsoft Azure, combining web services, background processing, and modern lakehouse architecture. As a Lead Python Data Engineer, you will guide the design of data lakes, medallion layers, and star schemas, and strengthen CI/CD with GitHub Actions. Partner with teams to improve reliability and performance—apply now. **Responsibilities** * Lead and improve Python backend services and background jobs, including FastAPI\-based components * Design and optimize data processing workflows with Pandas, Polars, openpyxl, and DuckDB * Architect and maintain data lakes, medallion layers, and star schemas to support evolving needs * Implement and refine CI/CD pipelines using GitHub Actions * Manage deployments on Azure using Container Apps, Azure Storage, Service Bus, and SignalR * Define infrastructure configurations with Bicep and, when appropriate, AWS CDK or Terraform * Champion the adoption of GitHub Copilot and Claude Code to raise delivery efficiency * Collaborate with cross\-functional teams to improve scalability and system performance * Solve high\-level architectural and engineering challenges using advanced best practices * Monitor production health and drive resolution of critical issues to preserve system fidelity **Requirements** * Extensive Python experience (5\+ years) building web services and running background jobs with FastAPI * Demonstrated leadership experience for 1\+ years in a related role * Deep knowledge of Pandas, Polars, openpyxl, and DuckDB for data processing * Proficiency designing data architectures such as medallion layers, data lakes, and star schemas * Expertise using GitHub Actions to implement and scale CI/CD workflows * Proven track record with Azure Container Apps, Azure Storage, Service Bus, and SignalR * Mastery of infrastructure\-as\-code tools such as Bicep, AWS CDK, or Terraform * Proven ability to use GitHub Copilot and Claude Code to improve development practices * English proficiency at B2\+ (Upper\-Intermediate) for clear communication **Nice to have** * Hands\-on experience with orchestration and transformation tools like Airflow, dbt, and Streamlit * Knowledge of distributed processing, asynchronous workflows, and enterprise messaging patterns * Experience with Snowflake features such as streams, tasks, pipes, stored procedures, and time travel * Exposure to .NET web development, including legacy front\-end solutions built in .NET Core * Familiarity with web frameworks such as Angular or Next.js

Source:  indeed View original post
Valentina Rodríguez
Indeed · HR

Company

Indeed
Valentina Rodríguez
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.