ByteDance
Singapore, SGBig Data Engineer, Recommendation Architecture
Responsibilities
- Design and implement a reasonable offline data architecture for large-scale recommendation systems
- Design and implement flexible, scalable, stable and high-performance storage and computing systems
- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
Qualifications
- Bachelor's degree or above in computer science, software engineering, or a related field
- Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
- Familiar with Java, C ++ and other programming languages
- Strong coding and trouble shooting ability
- Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies
- Experience of Peta Byte level data processing is a plus