Data Engineer - MCNB
Mô tả công việc
Platform Construction: Build, operate, and define the strategic architecture for the Big Data and Lakehouse platform using Delta Lake, Apache Iceberg, and Medallion architectures (Bronze/Silver/Gold).
- Infrastructure Management: Manage, monitor, and scale data infrastructure across On-Prem and OpenShift/Kubernetes container platforms.
- Data Integration & Pipelines: Design, develop, and optimize robust batch and real-time data pipelines using Airflow, Kafka Streaming, and low-latency CDC models.
- Advanced Processing (PySpark/Spark): Develop, tune, and maximize the performance of processing jobs using Apache Spark and PySpark at the cluster level for massive datasets.
- Performance & Cost Optimization: Continuous tuning of system performance (Spark, Presto, …) and cloud resource utilization to reduce overall operational costs.
- Data Governance & Security: Enforce data quality, security policies, lineage, and catalogs (OpenMetadata) in compliance with strict Banking & Finance regulations.
- 24/7 Operations: Establish real-time monitoring/alerting dashboards, handle incident management, lead root-cause analysis, and ensure system availability and SLAs.
- Technical Leadership: Lead, mentor, review code, and set engineering standards/best practices for the team of Data, Platform, and Cloud Engineers.
- Cross-Functional Collaboration: Partner closely with BA, BI, Data Science, and Source IT teams to evaluate integration feasibility and deliver data solutions.
Yêu cầu công việc
Education: Bachelor’s degree or higher in IT, Computer Science, Data Science, Management Information Systems, or related fields.
- Core Experience: Minimum 3+ years of professional experience in Data Engineering, Big Data, or Data Platform roles, including senior or technical leadership capacity.
- Technical Ecosystem (Must-Have): Deep expertise in Apache Spark, PySpark, Presto, Apache Kafka, Storage, and Airflow orchestration.
- K8s & DevOps Expertise: Strong hands-on experience in Kubernetes/OpenShift administration, containerizing big data workloads, configuring K8s networking/storage, and building automated CI/CD pipelines (GitLab CI, Jenkins, or ArgoCD) for data applications.
- Architecture & Coding: Strong command of Lakehouse architecture, open table formats (Delta/Iceberg), complex SQL optimization, and Python / Scala / Java.
- Cloud & Containers: Proven practical experience with AWS cloud services and OpenShift or Kubernetes container environments.
- Production Operations: Experience operating 24/7 production data systems, handling pipelines failure, data replay, backfilling, and ensuring idempotency.
- Preferred Tools: Familiarity with Git, CI/CD, Infrastructure as Code (Terraform), OpenMetadata, IBM Cloud Pak for Data (CP4D), IBM CDC, watsonx, or Databricks.
- Certifications (Plus): Professional certifications in Data Engineering (AWS/GCP, Databricks, Cloudera, IBM) or Kubernetes (CKA/CKAD) are a major advantage.
- Soft Skills & Attributes:o Strong systems thinking, change management capability, and a passion for driving a data-centric culture.
o Calm under pressure, proactive, meticulous, and highly responsible for 24/7 production environments.
o Excellent communication skills to mentor team members and collaborate effectively in complex cross-functional setups.
- Industry Background: Prior experience working in Banking, FinTech, or large financial institutions is a significant asset.
BENEFITS OF JOINING MSB
1. Attractive Salary and Bonuses:
- Competitive salary aligned with the market and commensurate with individual capabilities; to be negotiated after candidates pass the interview stage.
- Attractive incentive/KPI bonus schemes and commissions, paid monthly, with unlimited income potential (for sales roles and certain specialized positions).
- Year-end performance bonus ranging from 2 to 5 months of the average annual salary, depending on performance evaluation results.
2. Comprehensive Benefits Policy:
- Mandatory insurance in accordance with the law, along with additional health insurance for MSB employees.
- Diverse benefits including flexible working hours, company trips, birthday leave, back-to-school leave for employees’ children, etc.
- Preferential loan programs available for employees.
3. Training and Career Development:
- In-depth, structured training programs focused on transformation (Re-skill, Up-skill, New-skill), tailored to each job function.
- Dedicated guidance and mentorship from leaders, direct managers, and industry experts.
- Management development programs for high-potential employees, preparing them for future leadership roles.
- Priority given to internal candidates for management positions, creating clear career advancement opportunities.
4. Professional Working Environment and Dynamic Corporate Culture:
- Open, friendly workplace emphasizing responsibility and mutual support.
- Dynamic and creative environment that encourages innovation and continuous learning.
- Respect for diversity, with a strong focus on teamwork and effective collaboration.
- Numerous cultural, sports, and entertainment activities that foster engagement and a positive work atmosphere.
- Recognized for multiple consecutive years by HR Asia as “Best Companies to Work for in Asia” and by Anphabe as “Companies with Happy Workforce.”