Data Engineer Associate

Role Purpose

• Develop pipeline from several data sources to Datalake and Datawarehouse to help BI team develop dashboards and reports.
• Create dashboard for Internal Engineering or Data Engineering needs.
• Help prepare documentation and perform Data Quality checks for pipelines made by Senior Data Engineer.
• Deliverables / Outcomes
• Help Data Engineering & Reporting Unit Head assist Data Manager in project implementation and documentation activities.
• Act as Data Engineer to help BI team and internal Data Engineering in gathering data from all sources within ALTO.
• Act as Data Engineer to help Reporting in IT Engineering team.
• Act as BI Engineer to create dashboards for internal Data Engineering needs.
• Actively communicate with Dev to gain knowledge of data or new products.
• Actively look for newly released products.
• Develop pipelines to get data from several sources into Datalake and Datawarehouse in BigQuery.
• Develop dashboards for internal Data Engineering needs.
• Ensure Risk/Findings audit requirements are fulfilled.
• Ensure staff are informed and trained to support good corporate governance in their specific areas of work.
  

Qualifications

Knowledge

• Basic understanding of data architecture, data modeling, and ETL/ELT processes.
• Knowledge of data pipeline orchestration and workflow automation tools.
• Proficiency in relational databases.
• Knowledge of cloud-based big data tools (e.g., Google BigQuery, AWS Redshift, Azure Data Lake).
• Understanding of Python and SQL.
• Understanding of data quality, data security, compliance (GDPR, CCPA), and best practices.
• Experience with dashboard tools (e.g., Tableau, Looker, Metabase, etc.).
• Knowledge of how to create dashboards for operational or helicopter-view reporting for Unit Head.
  

Qualifications

• Bachelor's degree in Information Technology, Information System, Data Science, Computer Science, Mathematics, Statistics, or related fields.
• Experienced with data pipeline orchestrators/tools and experienced in coding from scratch to build pipelines.
• Proven experience in Data Engineering, Business Intelligence, or similar position with at least 1 year of experience or internship.
  

Non-Technical Skills

• Problem-Solving
• Communication
• Team Leadership
• Adaptability
• Detail-Oriented
  

Technical Skills

• Programming: Advanced in Python and expert in writing SQL queries.
• Data Pipelines: Experienced with ELT/ETL tools.
• Expert in cloud platforms and Big Data frameworks.
• Proficiency in CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).
• High knowledge of creating dashboards using dashboard tools.