Senior Data Engineer (Python / AWS / ML Pipelines)

About the role

This position is listed on behalf of a partner company and is based in Nigeria. As a Senior Data Engineer you will build and operate large‑scale data and machine‑learning pipelines in production, working across data engineering, cloud infrastructure and ML operations to turn models into reliable workflows. The role emphasizes Python, AWS, ETL, workflow orchestration and scalable ML infrastructure while collaborating closely with Data Scientists and ML Engineers.

Key responsibilities

• Build, maintain and improve production‑grade data and machine‑learning pipelines supporting forecasting and data‑driven decision‑making.
• Develop scalable, reliable ETL and data‑processing workflows using Python.
• Design and orchestrate workflows with Apache Airflow, AWS Step Functions and AWS Glue.
• Support deployment and operationalisation of ML models using AWS SageMaker.
• Monitor pipeline health, troubleshoot issues and implement reliability, scalability and efficiency improvements.
• Contribute to architectural and technical decisions for the data platform and ML infrastructure.
• Collaborate with distributed, cross‑functional Agile teams and share ideas to improve engineering practices.

Required profile

• Strong professional experience with Python applied to data engineering and production systems.
• Proven track record building and maintaining data or ML pipelines at scale.
• Hands‑on experience with Apache Airflow, AWS Step Functions, AWS Glue and AWS SageMaker.
• Experience working with large‑scale cloud‑based production environments and a solid understanding of reliability and performance considerations.
• Excellent written and verbal English communication skills and ability to work independently or collaboratively in distributed teams.
• Experience collaborating closely with Data Scientists, ML Engineers and other technical stakeholders.

Required skills

• Python
• Apache Airflow
• AWS Step Functions
• AWS Glue
• AWS SageMaker
• General AWS cloud services
• GCP (optional)

What we offer

• Collegial environment with shared responsibility and decision‑making.
• Agile culture encouraging ideas and influence on technical direction.
• Supportive approach to learning from mistakes and continuous improvement.
• Opportunities to work on diverse projects and broaden technical experience.
• Ongoing training, mentoring and professional development.
• Career growth exposure to new technologies and challenges.
• Possibility of business travel and flexible working arrangements for distributed teams.
• Additional salary, healthcare and other benefits may vary according to local terms in Slovenia.