···
Log in / Register
Lead Python Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Description

Summary: We are seeking a Lead Python Data Engineer to lead the design and execution of scalable data solutions, overseeing innovative initiatives and collaborating across teams to build robust data architectures. Highlights: 1. Lead design and execution of scalable data solutions 2. Oversee innovative initiatives and build robust data architectures 3. Collaborate across teams for optimized system scalability We are seeking a highly skilled **Lead Python Data Engineer** to join our team and lead the design and execution of scalable data solutions. This role involves overseeing innovative initiatives, leveraging advanced tools, and collaborating across teams to build robust data architectures and pipelines that meet shifting business demands. **Responsibilities** * Oversee, improve, and manage backend services and background jobs in Python, particularly with frameworks like FastAPI * Architect and refine data processing workflows leveraging Pandas, Polars, openpyxl, and DuckDB * Spearhead the design and maintenance of complex data architectures, including data lakes, medallion layers, and star schemas * Develop and enhance CI/CD processes with tools like GitHub Actions * Oversee the deployment and management of scalable solutions on Azure, using Container Apps, Azure Storage, Service Bus, and SignalR * Define infrastructure configurations using Bicep or alternative tools such as AWS CDK or Terraform * Promote the use of GitHub Copilot and Claude Code to optimize development efficiency * Collaborate across teams to ensure optimized system scalability and streamlined performance * Address high\-level architectural and engineering challenges, adhering to advanced best practices * Oversee the monitoring and resolution of critical issues to maintain overall system fidelity **Requirements** * Extensive Python experience (5\+ years) in designing web services and managing background jobs via FastAPI * Leadership experience for 1\+ years in a related capacity * Deep understanding of libraries and tools like Pandas, Polars, openpyxl, and DuckDB * Proficiency in developing advanced data architectures such as medallion layers, data lakes, and star schemas * Expertise in GitHub Actions to implement and scale CI/CD workflows * Proven track record with Azure services, including Container Apps, Service Bus, SignalR, and Azure Storage * Mastery of infrastructure\-as\-code tools, with extensive background in solutions like Bicep, AWS CDK, or Terraform * Proven ability to leverage tools like GitHub Copilot and Claude Code to enhance development practices * English proficiency equivalent to B2\+ for clear and effective communication **Nice to have** * Expertise in advanced orchestration and transformation tools such as Airflow, dbt, and Streamlit * Knowledge of distributed processing, asynchronous workflows, and enterprise messaging patterns * Proficiency in Snowflake, including streams, tasks, pipes, stored procedures, and time travel use cases * Competency in .NET web development for legacy front\-end solutions built in .NET Core * Skills in web development using frameworks like Angular or Next.js

Source:  indeed View original post
Valentina Rodríguez
Indeed · HR

Company

Indeed
Valentina Rodríguez
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.