ByteDance

ByteDance

Singapore, SG

Big Data Engineer, Recommendation Architecture

Responsibilities

  1. Design and implement a reasonable offline data architecture for large-scale recommendation systems
  2. Design and implement flexible, scalable, stable and high-performance storage and computing systems
  3. Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
  4. Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems

Qualifications

  1. Bachelor's degree or above in computer science, software engineering, or a related field
  2. Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
  3. Familiar with Java, C ++ and other programming languages
  4. Strong coding and trouble shooting ability
  5. Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies
  6. Experience of Peta Byte level data processing is a plus