···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: This Lead Python Data Engineer role focuses on creating robust data solutions, shaping lakehouse-oriented architectures, and standardizing delivery through CI/CD and IaC. Highlights: 1. Shape lakehouse-oriented architectures and standardize delivery 2. Oversee Python web services and background job execution with FastAPI 3. Drive architectural decisions and resolve complex engineering challenges We are creating robust data solutions in Python with Azure\-native services, focusing on dependable pipelines, web services, and background jobs at scale. In this Lead Python Data Engineer role, you will shape lakehouse\-oriented architectures and standardize delivery through GitHub Actions and IaC. Work closely with engineering peers to keep systems fast and stable—apply now. **Responsibilities** * Oversee Python web services and background job execution, with emphasis on FastAPI * Build and refine data processing pipelines using Pandas, Polars, openpyxl, and DuckDB * Own the design and upkeep of data lakes, medallion layers, and star schema models * Improve delivery workflows by expanding CI/CD with GitHub Actions * Operate and scale Azure deployments across Container Apps, Azure Storage, Service Bus, and SignalR * Create and maintain IaC definitions using Bicep or alternatives like AWS CDK and Terraform * Encourage effective use of GitHub Copilot and Claude Code to accelerate development * Coordinate with teams to ensure systems scale smoothly and perform efficiently * Drive architectural decisions and resolve complex engineering challenges using best practices * Ensure monitoring is in place and lead remediation of critical incidents to protect system fidelity **Requirements** * Extensive Python experience (5\+ years) delivering web services and background processing with FastAPI * Leadership experience for 1\+ years driving technical direction in a similar capacity * Strong command of Pandas, Polars, openpyxl, and DuckDB for data transformation * Solid background in medallion layers, data lakes, and star schemas for analytics\-ready design * Proven expertise implementing CI/CD automation with GitHub Actions * Hands\-on experience with Azure services including Container Apps, Azure Storage, Service Bus, and SignalR * Deep understanding of infrastructure as code using Bicep, AWS CDK, or Terraform * Proven ability to leverage GitHub Copilot and Claude Code to improve coding practices * English proficiency at B2\+ (Upper\-Intermediate) for effective collaboration **Nice to have** * Experience with Airflow, dbt, and Streamlit for orchestration and transformation * Understanding of distributed processing, async workflows, and enterprise messaging patterns * Working knowledge of Snowflake, including streams, tasks, pipes, stored procedures, and time travel scenarios * Ability to support legacy .NET Core front\-end solutions through .NET web development * Familiarity with Angular or Next.js for web development

Source:  indeed View original post
Valentina Rodríguez
Indeed · HR

Company

Indeed
Valentina Rodríguez
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.