···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: Seeking a highly skilled Lead Python Data Engineer to design and execute scalable data solutions, oversee innovative projects, and develop resilient data architectures. Highlights: 1. Oversee innovative projects utilizing advanced tools 2. Develop resilient data architectures and pipelines 3. Collaborate cross-functionally to optimize system scalability We are searching for a highly skilled **Lead Python Data Engineer** to join our team and take ownership of designing and executing scalable data solutions. You will oversee innovative projects, utilizing advanced tools and collaborating cross\-functionally to develop resilient data architectures and pipelines that align with evolving business needs. **Responsibilities** * Oversee, improve, and manage backend services and background jobs in Python, particularly with frameworks like FastAPI * Architect and refine data processing workflows leveraging Pandas, Polars, openpyxl, and DuckDB * Spearhead the design and maintenance of complex data architectures, including data lakes, medallion layers, and star schemas * Develop and enhance CI/CD processes with tools like GitHub Actions * Oversee the deployment and management of scalable solutions on Azure, using Container Apps, Azure Storage, Service Bus, and SignalR * Define infrastructure configurations using Bicep or alternative tools such as AWS CDK or Terraform * Promote the use of GitHub Copilot and Claude Code to optimize development efficiency * Collaborate across teams to ensure optimized system scalability and streamlined performance * Address high\-level architectural and engineering challenges, adhering to advanced best practices * Oversee the monitoring and resolution of critical issues to maintain overall system fidelity **Requirements** * Extensive Python experience (5\+ years) in designing web services and managing background jobs via FastAPI * At least 1 year of relevant leadership experience * Deep understanding of libraries and tools like Pandas, Polars, openpyxl, and DuckDB * Proficiency in developing advanced data architectures such as medallion layers, data lakes, and star schemas * Advanced expertise in GitHub Actions to implement and scale CI/CD workflows * Proven track record with Azure services, including Container Apps, Service Bus, SignalR, and Azure Storage * Mastery of infrastructure\-as\-code tools, with extensive experience in solutions like Bicep, AWS CDK, or Terraform * Proven ability to leverage tools like GitHub Copilot and Claude Code to enhance development practices * English proficiency equivalent to B2\+ for clear and effective communication **Nice to have** * Experience with advanced orchestration and transformation tools such as Airflow, dbt, and Streamlit * Deep knowledge of distributed processing, asynchronous workflows, and enterprise messaging patterns * Advanced experience with Snowflake, including streams, tasks, pipes, stored procedures, and time travel use cases * Significant experience with .NET web development for legacy front\-end solutions built in .NET Core * Proven track record in web development using frameworks like Angular or Next.js

Source:  indeed View original post
Valentina Rodríguez
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.