Back-End Engineer (Python)

About Partao

Partao is a Luxembourg-based e-commerce startup specializing in heavy machinery parts. We aim to provide a comprehensive marketplace for parts, simplifying the process for businesses to find, buy, and manage machinery components. As we expand our capabilities, we're building a highly scalable infrastructure and data pipeline to manage millions of SKUs, vendor feeds, and competitive catalog information.

Position Overview

We are seeking a talented and motivated Back-End Engineer with a proven track record in Python and data engineering. You will play a key role in building our data generation and processing pipeline, focusing on data ingestion, deduplication, normalization, and large-scale input file processing. You will work closely with a dynamic team of engineers to design and implement systems that support real-time and batch processing of millions of data points from various sources.

Key Responsibilities

• Develop and maintain data generation pipelines to gather data from multiple sources, including web scrapers, vendor feeds, and catalog PDF data.
• Design and implement scalable solutions for data ingestion, processing, deduplication, normalization, and reconciliation.
• Work with large input files, breaking them down into manageable datasets, and ensuring accurate processing.
• Collaborate with the team to improve the performance and efficiency of our data pipelines.
• Build automation and tooling to support data analysis, quality control, and monitoring of the data pipeline.
• Contribute to the design of the catalog database and ensure data consistency, integrity, and quality.
• Optimize data processing for speed, scalability, and cost-effectiveness.

Basic Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field or equivalent years of experience.
• 3+ years of experience as a back-end engineer or in a similar role.
• Proficiency in Python, with experience in building and managing large-scale data pipelines.
• Solid understanding of data structures, algorithms, and software design principles.
• Experience working with SQL databases, data processing frameworks, and RESTful APIs.
• Familiarity with cloud platforms such as AWS, including services like S3, Lambda, and RDS.
• Strong problem-solving skills, attention to detail, and the ability to work in a fast-paced environment.

Preferred Qualifications

• Experience working with large-scale data scraping projects.
• Experience in building and managing ETL/ELT pipelines.
• Familiarity with distributed data processing frameworks (e.g., Apache Spark, AWS Glue, Kafka).
• Experience leading a team or mentoring junior engineers.
• Familiarity with containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes).
• Knowledge of e-commerce platforms, specifically Magento, is a plus.

What We Offer

• An opportunity to work on challenging, high-impact problems in the e-commerce space.
• A collaborative, innovative, and supportive work environment.
• Competitive salary and benefits package.
• Opportunities for career growth and leadership development.

Join Us!

Join us and be a part of building the future of heavy machinery e-commerce!

Please contact [email protected] with a link to your LinkedIn page and a resume if available.