Job details
Basic Qualifications
- Ph.D. plus at least 6 years of experience in Applied Research or M.S. plus at least 8 years of experience in Applied Research
- At least 5 years of people leadership experience
- PhD in Computer Science, Machine Learning, Computer Engineering, Applied Mathematics, Electrical Engineering or related fields
- LLM
- PhD focus on NLP or Masters with 10 years of industrial NLP research experience
- Core contributor to team that has trained a large language model from scratch (10B + parameters, 500B+ tokens)
- Numerous publications at ACL, NAACL, EMNLP, Neurips, ICML or ICLR on topics related to the pre-training of large language models (e.g. technical reports of pre-trained LLMs, SSL techniques, model pre-training optimization)
- Has worked on an LLM (open source or commercial) that is currently available for use
- Demonstrated ability to guide the technical direction of a large-scale model training team
- Experience working with 500+ node clusters of GPUs
- Has worked on LLM scaled to 70B parameters and 1T+ tokens
- Experience with common training optimization frameworks (deep speed, nemo)
- Behavioral Models
- PhD focus on topics in geometric deep learning (Graph Neural Networks, Sequential Models, Multivariate Time Series)
- Member of technical leadership for model deployment for a very large user behavior model
- Multiple papers on topics relevant to training models on graph and sequential data structures at KDD, ICML, NeurIPs, ICLR
- Worked on scaling graph models to greater than 50m nodes
- Experience with large scale deep learning based recommender systems
- Experience with production real-time and streaming environments
- Contributions to common open source frameworks (pytorch-geometric, DGL)
- Proposed new methods for inference or representation learning on graphs or sequences
- Worked with datasets with 100m+ users
- Optimization (Training & Inference)
- PhD focused on topics related to optimizing training of very large language models
- 5+ years of experience and/or publications on one of the following topics: Model Sparsification, Quantization, Training Parallelism/Partitioning Design, Gradient Checkpointing, Model Compression
- Finetuning
- PhD focused on topics related to guiding LLMs with further tasks (Supervised Finetuning, Instruction-Tuning, Dialogue-Finetuning, Parameter Tuning)
- Demonstrated knowledge of principles of transfer learning, model adaptation and model guidance
- Experience deploying a fine-tuned large language model
- Data Preparation
- Numerous Publications studying tokenization, data quality, dataset curation, or labeling
- Leading contributions to one or more large open source corpus (1 Trillion + tokens)
- Core contributor to open source libraries for data quality, dataset curation, or labeling
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
Hiring company
SimplyApply
-
Facilities Management Diploma New Skills AcademyAED 129
AED 1,098Duration: Upto 14 Hours -
Management and Leadership Development for Managers Adams AcademyAED 91
AED 955Duration: Upto 26 Hours
Similiar Jobs that might interest you
Senior RBI Engineer (Fixed Term - 24 Months)
Oceaneering... s) where applicable. The Senior RBI Engineer will lead complex projects, ... Client short- and long-term plans in accordance ...
UAE - Abu Dhabi 24 hours ago
Senior HVAC Designer
NES Fircroft... Senior HVAC Designer Location: Dubai (UAE) Contract: 10 Months ... our clients with the engineering and technical expertise ...
UAE - Dubai 24 hours ago
Senior Civil Designer
NES Fircroft... Senior HVAC Designer Location: Dubai (UAE) Contract: 10 Months ... our clients with the engineering and technical expertise ...
UAE - Dubai 24 hours ago
Senior Architectural Engineer
NES Fircroft... in Dubai, UAE. Position: Senior Revit Architectural Engineer Qualifications: 12 Year's ...
UAE - Dubai 24 hours ago
Senior Project Controls Engineer
NES Fircroft... Dhabi, UAE. Position: Senior Project Controls Engineer Duration: 6 months Extendable Location: Abu ...
UAE - Abu Dhabi 24 hours ago
... UAE. Position: Senior Instrument Designer ... per month: - Expected Salary per month: With ... with the engineering and ...
UAE - Abu Dhabi 24 hours ago
... in UAE. Position: Senior QAQC Engineer (Mechanical) Location: ... Salary per month: - Expected Salary per month: With over ...
UAE - Dubai 24 hours ago
Senior Reservoir Engineer
International Development Company Manpower Supply... : Bachelor's degree in reservoir engineering, petroleum engineering, geology, geophysics, and/or ...
UAE - Abu Dhabi 24 hours ago
Senior, ESP Engineer
International Development Company Manpower Supply... Months) 2 - ESP Operational Best Practice (within 6 Months ... Enhancement) (within 6 Months) Key Requirement / Scope ...
UAE - Abu Dhabi 24 hours ago
Senior, Reservoir Management Engineer
International Development Company Manpower Supply... Degree in Sciences (Petroleum/ Reservoir Engineering) • Minimum 10 years of technical ...
UAE - Abu Dhabi 24 hours ago
Senior, Reservoir Management Engineer
International Development Company Manpower Supply... Degree in Sciences (Petroleum/ Reservoir Engineering) • Minimum 10 years of technical ...
UAE - Abu Dhabi 24 hours ago
T&I Senior Engineer - Offshore
NES Fircroft... Offshore T&I Senior Engineer Duration: Long-term, ... Current / Latest Monthly Salary Total Monthly ...
UAE - Abu Dhabi 24 hours ago
AUT Level 3
Oceaneering... global provider of engineered services and products, ... . • Degree in Mechanical Engineering (or equivalent) • Offshore ...
UAE - Abu Dhabi 24 hours ago
Rope Access NDT Technician
Oceaneering... a global provider of engineered services and products, ... 2 (E) • Degree in Engineering (or equivalent) • Offshore medical, ...
UAE - Dubai 24 hours ago
RBI Team Lead (Fixed Term - 24 Months)
Oceaneering... Engineering discipline in a relevant subject (e.g., Metallurgical/Corrosion Engineering) Certifications: • Senior ...
UAE - Abu Dhabi 24 hours ago
... and activities based on RBI outcomes, ensuring all ... scopes • Assist the Senior Inspection/Integrity Engineer in the ...
UAE - Dubai 24 hours ago
Sr. Accounts Payable and Inter Company Accountant
NES Fircroft... : 6 months, renewable - exclusive basis As a Senior AP and ... our clients with the engineering and technical expertise they ...
UAE - Dubai 24 hours ago
Quantity Surveyor Electrical
Saipem... Duration: 6 months renewable contract ... leader in engineering services for ... experience and seniority, shall effectively ...
UAE 24 hours ago
Toolpusher
Nabors Drilling International Gulf FZE... the rig, and acts as Senior Toolpusher in his or her ... deck operations when the Barge engineer is off tour (jack-ups ...
UAE - Dubai 24 hours ago
Why are you reporting this job?
Job has expired Cannot view this pageAlternatively, you may click on the link below or copy/paste it into your browser.
https://ae.jooble.org/external/-2030573185840591509?cpc=d0FU&utm_source=affiliate&utm_medium=laimoon_organic_ae&extra_ars_request_id=172928b321fbd36154caf4f8a743a5d4