Mô tả công việc
Data Engineering & Integration
- Design, develop, test, and maintain scalable ETL/ELT pipelines across multiple enterprise systems and data platforms.
- Build and support data integration solutions for customer, account, product, and reference master data domains.
- Develop and optimize data ingestion, transformation, and orchestration processes for batch and near-real-time workloads.
- Implement robust error handling, monitoring, and recovery processes to ensure reliable data delivery.
- Troubleshoot and resolve data integration, transformation, and performance issues.
- Extend existing pipelines, matching, and reconciliation to bring new scope into the Foundational Account Master, including Retail, while maintaining current SMDD Local and SMDD/CVS loads.
Data Quality & Master Data
- Develop and maintain data cleansing, standardization, validation, and enrichment processes.
- Implement data matching, reconciliation, and survivorship logic to support golden record creation and master data management initiatives.
- Build and maintain data quality controls, exception reporting, and remediation workflows based on business requirements and governance standards.
- Partner with Business Systems Analysts and Data Stewards to implement business rules, data definitions, and quality requirements.
- Support ongoing data quality improvement initiatives through root-cause analysis and corrective actions.
Cloud Data Platform & Data Warehousing
- Develop and support solutions on Azure-based data platforms and Snowflake data environments.
- Extend data models, implement transformation logic, and produce curated datasets that support analytics and reporting needs.
- Monitor, maintain, and improve performance, scalability, reliability, and cost efficiency of data workloads.
- Handover of deliverables to support and operations support teams.
Collaboration & Delivery
- Collaborate with Business Systems Analysts, Product Owners, Data Architects, Data Stewards, and business stakeholders to translate requirements into technical solutions.
- Support the delivery of data products and reporting solutions across customer, commercial, supply chain, finance, and other business domains.
Governance, Security & Compliance
- Adhere to enterprise data governance, security, and privacy policies.
- Ensure solutions meet data quality, auditability, and lineage requirements.
Requirements
Experience
- 3~5+ years of experience in Data Engineering, Data Warehousing, Analytics Engineering, or a related field.
- Good Japanese speaking skill (N2+)
- Hands‑on experience designing, developing, and supporting enterprise ETL/ELT pipelines.
- Experience integrating data from multiple source systems, including databases, files, APIs, and enterprise applications.
- Experience implementing data transformation, cleansing, validation, and reconciliation processes.
- Experience working with cloud‑based data platforms and modern data architectures.
- Experience supporting data quality, master data, or data governance initiatives in a business environment.
Technical Skills
Required
- Advanced SQL development and query optimization
- Python for data engineering and automation
- Azure Data Factory (ADF) or equivalent orchestration platform
- Snowflake or comparable cloud data warehouse technologies
- Data modeling and data transformation design
- Git‑based source control and version management
- CI/CD concepts and deployment practices
- Experience developing and troubleshooting ETL/ELT processes
- Experience working with structured and semi‑structured data formats (CSV, JSON, XML, Parquet, etc.)
Preferred
- REST API integration and data ingestion
- Master Data Management and reference data management
- Data matching, survivorship, and reconciliation techniques
- Data quality frameworks, monitoring, and exception reporting
- Experience with Dynamics 365, Salesforce, SAP, or other enterprise business applications
- Experience working with Agile delivery teams
Knowledge & Skills
- Strong analytical and problem‑solving skills.
- Ability to understand business requirements and translate them into technical solutions.
- Strong attention to detail and commitment to data quality.
- Ability to work effectively in cross‑functional teams with Business Systems Analysts, Data Stewards, Architects, and business stakeholders.
- Effective communication skills with the ability to explain technical concepts to non‑technical audiences.
Benefits
At SmartOSC, we offer the best to your values:
- Attractive salary package
- Salary review twice a year
- Flexible working hours (between 7:30am – 7:30pm on staff’s preference)
- Premium health care
- Working in one of the largest digital transformation agencies in Asia – Professional English environment
- Firm’s Certified Qualifications Sponsorship for career development
- Annual company trip inside or outside Vietnam