Research Scientist (AutoResearch on LLM)

Our client is a Singapore-based automotive tech company, building AI-powered computing platforms for software-defined vehicles. They specialize in intelligent cockpit systems and autonomous driving computation, combining custom automotive SoCs with advanced software to help automakers deliver safer, smarter, more personalized in-car experiences. Research Scientist Role Overview: As a Research Scientist (AutoResearch on LLM), you will focus on cutting edge AI-Driven AI development using Autoresearch(Automated Machine Learning) for Large Language Models (LLM). You will design and deploy automated research frameworks that autonomously discover. optimize, and train the next-generation LLM architectures. You will bridge the gap between hardware constraints and model design ensuring that the automatically optimized architectures achieve or exceed the pre-training efficiency and downstream performance of state of the art established base models Key Responsibilities: ·       Design, build and scale automated search and optimization systems (Such as Neural Architecture Search, evolutionary algorithms, or LLM-driven research agents) to autonomously discover optimal LLM architectures ·       Analyze and integrate hardware level constraints (e.g. tensor parallel limits, memory bandwidths, latency, cache hierarchies, FLOPs, and energy efficiency of target silicon) into the optimization loop ·       Scale up discovered architectures to perform large-scale pre-training. Ensure the final models meet to exceed the performance, training efficiency, and convergence rate of existing top-tier foundation models ·       Develop accurate, cost effective proxy task, evaluation protocols, and scaling laws to predict full-scale LLM performance from early-stage automated search limits ·       Collaborate closely with chip architects, system/compiler engineers, and foundation model researchers to co-optimize hardware execution efficiency and model training algorithms ·       Stay at the forefront of AutoML, hardware-software co-design, and LLM pre-training literature, contributing to peer-reviewed publications and IP generation where applicable Qualifications & Requirements: ·       Master's or PhD degree in Computer Science, Electrical Engineering, Applied Mathematics, or a related quantitative field with a focus on Deep Learning ·       Strong research background in LLM pre-training, Transformer architectures, and scaling dynamics ·       Hands-on experience with AutoResearch, AutoML, automated optimization algorithms, or using AI agents/LLMs for automated scientific discovery ·       Solid understanding of GPU/accelerator architectures, memory hierarchies, parallel training strategies(tensor, pipeline, data parallel) and hardware performance profiling ·       Production grade coding skills in Python and deep learning frameworks (e.g. Pytorch, JAX, Megatron-LM, Deepspeed). ·       Demonstrated experience in training, scaling and evaluating large scaling models from scratch ·       Having first author publications in top tier machine learning or system conferences (e.g. NeurIPS, ICML, ICLR, ASPLOS, ISCA, MLSys) is preferred ·       Experience writing custom kernels (e.g. Triton, CUDA) or working with machine learning compilers are preferred ·       Direct experience working with silicon/chip design teams to customize model architectures for specific ASIC/GPU/FPGA constraints. ·       Experience building self improving AI Loops or automated coding research assistants EA Personnel Registration No: R1106329 EA License No: 12C6254