Tóm lược
Mô tả công việc
Tóm tắt công việc
- Design and implement a customer data platform using Google Cloud technologies (BigQuery, Cloud Storage, Cloud Functions, etc.)
- Development of data pipelines to ingest, process, and store customer data.
- Collaborate with cross-functional teams (data science, product, analytics) to understand business requirements and design solutions that meet those needs.
- Develop and maintain ETL processes using Google Cloud Dataflow or Apache Beam
- Design and implement data warehousing and data mart architectures in BigQuery
- Implement data quality checks and data validation processes to ensure high-quality customer data.
- Ensure the data platform is scalable, secure, and highly available, with a focus on reliability and performance.
- Work closely with DevOps team to ensure seamless integration with our CI/CD pipeline
- Develop and maintain technical documentation for the data platform.
Yêu cầu công việc
- Bachelor’s degree Computer Science, Information Technology, or a related field.
- 3+ years of experience as a Data Engineer or similar role. Expertise in Google Cloud technologies (BigQuery, Cloud Storage, Cloud Functions, etc.) is a plus.
- Strong understanding of data engineering concepts and best practices.
- Experience designing and implementing data platforms using cloud technologies.
- Proficiency in programming languages such as Java, Python, or Scala.
- Experience with Apache Beam, Google Cloud Dataflow, or similar stream processing frameworks.
- Knowledge of data warehousing and data mart architectures.
- Strong analytical skills and ability to debug complex data engineering issues.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a distributed team
Ngôn ngữ
-
English
Nói: Intermediate - Đọc: Intermediate - Viết: Intermediate
Yêu cầu kỹ thuật
- Google BigQuery
- Cloud storage
- Cloud Functions
- Java
- Python
- Scala
- Data Warehouse
- Dataflow
- Apache Beam
NĂNG LỰC
- Analytic Skills
- Communication Skills
- Teamwork
- Working Independently
Thông tin doanh nghiệp
VinBigdata is in the direction of becoming a world-class Technology - Industry - Trade and Service Group.
VinBigdata's vision is to become a leading research center in science, technology and data in Vietnam, with an international level.
With the mission of "Vietnamese Technology - For the Future of Vietnam, VinBigdata focuses on promoting research and development activities around 3 main areas:
1) Promote fundamental research through 4 research areas: Computational Biomedical, Natural Language Processing, Computer Vision, Medical Image Processing, creating a premise for sustainable development of society.
2) Changing the way of scientific research and training thinking of the future scientific generation in Vietnam through the activities of the VinIF Innovation Fund;
3) Research new technologies with high applicability, increase user experience, improve quality of life and optimize production and business activities.