Job Summary:

We are seeking a skilled and experienced Data Engineering Expert to design, build and manage scalable  data pipelines and infrastructure. As a Data Engineering Expert, you will collaborate with data scientists, analysts and other related stakeholders to ensure data quality and availability to support business 
insights, reporting platforms and decision-making.

Key responsibilities:

• Data Pipeline Development: Design, construct, install and maintain scalable data pipelines and systems.
• Data Integration: Strategically obtain and integrate data from various sources (databases, APIs, 3rd party platforms) into centralized systems.
• Data Modelling: Create and optimize data models for structured and unstructured data.
• ETL/ELT Processes: Design, build and maintain optimized data pipelines and ETL solutions as business support tools in providing analysis and real time analytics platform for critical decisionmaking.
• Data Quality and Governance: Ensure high data quality, implement data validation rules to keep operations running at high performance, 
• Data Compliance and Security: Ensure data infrastructure complies with Government Decrees and Bank regulations.
• Performance Optimization: Monitor and improve performance of data infrastructure and queries.
• Documentation: Maintain documentation of data pipelines, systems and processes.
• Collaboration: Work closely with data scientists and business stakeholders to understand data needs and deliver solutions.

Required skills and Qualifications

• Bachelor‘s or Master’s degree in Computer Science, Computer Engineering or related field.
• Strong programming skills in Python, Scala
• Proficient in SQL and database management systems
• Familiar with big data frameworks, e.g., Hadoop, Spark
• Knowledge of data modelling, schema design and data governance best practices
• Experience with workflow orchestration tools, e.g., Airflow, Luigi
• Understanding of machine learning processes and tools

Success Characteristics

• Strong problem-solving skill and attention to detail
• Effective communication and collaboration abilities
• Ability to work in fast-paced
• Straight-forward and integrity