Machine Learning Engineer – Model Serving Infrastructure Full-time

Responsibilities

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
Creation is the core of TikTok’s purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy – a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That’s how we drive impact – for ourselves, our company, and the communities we serve.
Join us.

The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company. We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer – Model Serving Infrastructure to join our team to support and advance that mission.

Responsibilities:
– Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
– Responsible for building monitoring/managing tools to oversee the reliability and scalability of online inference servers
– Responsible for triaging system inefficiency and bottlenecks and improving system performance
– Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions
– Responsible for collaboration with product teams and providing general solutions to meet their requirements

Qualifications

Minimum Qualifications
– Proficient in C/C++/CUDA, and have solid programming skills.
– Familiar with deep learning serving frameworks (TensorFlow Serving/TorchScript).
– Experience in GPU performance optimization
– Good communication and teamwork skills to clearly communicate technical concepts with other teammates.

Preferred Qualifications
– Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt).
– Experience in developing and deploying large-scale systems.
– Strong background in one of the following fields: Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU/RDMA) or ML for Systems.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at dataecommerce.accommodation@tiktok.com