Lokesh Jain
Dublin
Summary
Machine Learning and MLOps Engineer with 10+ years of experience designing and building scalable software systems, with a strong focus on ML platform architecture and AI-driven solutions. Proven expertise in leading the end-to-end design and implementation of model training, inference, and deployment pipelines, enabling robust and production-grade ML systems. Experienced in architecting enterprise-scale ML platforms, driving automation across the ML lifecycle, and integrating modern frameworks and tooling to accelerate experimentation and delivery. Combines deep technical problem-solving with a strong understanding of the evolving ML ecosystem, consistently delivering high-impact solutions in complex environments.
Overview
11
11
years of professional experience
Work History
Senior Machine Learning Operations Engineer
Integral Ad Science
Dublin
08.2023 - Current
- Developed proof of concepts (POCs) leveraging ML frameworks such as Ray, MLflow, and vector databases to evaluate scalable model training and retrieval architectures.
- Designed and implemented high-performance inference pipelines for classification models, optimising latency, and throughput in production environments.
- Automated end-to-end ML lifecycle workflows including data preprocessing, model training, evaluation, and deployment using modern ML frameworks.
- Built an in-house ML platform to streamline and automate model training workflows, improving developer productivity, and standardising experimentation.
- Integrated text embedding models for sentence classification tasks, enhancing semantic understanding and model performance.
- Led the migration of data pipelines from Airflow to Databricks, improving scalability, reliability, and maintainability of data workflows.
- Built an LLM-powered automatic labelling framework, enabling scalable and efficient dataset annotation for downstream machine learning tasks.
Senior MLOps Engineer
Blackswan Technologies
07.2022 - 07.2023
- Designed and implemented the Kernel Execution Engine (KEE), a scalable Dataflow Engine, showcasing my ability to develop high-level data management solutions.
- KEE's functionalities include:
- Dynamically constructing a runtime Direct Acyclic Graph (DAG) based on the composition of an insight, which encapsulates the data flow between kernels.
- Effectively managing computational resources by allocating available threads and machines to run each node in the DAG, highlighting my expertise in resource management in data-intensive contexts.
- Facilitating the instantiation of each insight component and executing the DAG, thereby achieving the final result ensuring stakeholders make optimal data-driven decision-making.
- Leveraging Ray, a scalable and distributed computing framework in order to achieve enhanced performance and scalability in MLOps pipelines.
Principal Software Engineer- ML
Noodle.ai
04.2019 - 07.2022
- Pioneered the design and implementation of 'Atlas', an in-house ML Framework, which empowers Data Scientists and Engineers to swiftly develop, evaluate, and deploy scalable ML Pipelines in a production environment.
- Atlas is adept at functioning in diverse environments such as Airflow, Mlflow, Kubeflow, and local environments, demonstrating its versatility and integration with wide range of ML tools.
- Conducted meticulous feature evaluations and proofs of concept on Sagemaker, Kubeflow, Mlflow, Ray exhibiting my proficiency in ML tool assessment and selection.
- Oversaw feature and output data ingestion utilizing Apache Druid, exemplifying my skills in managing significant datasets crucial for ML pipeline deployment.
- Operated as both a Technology Lead and Individual Contributor, in which I engineered crucial services including an Auth Management system, configs & secrets management system, and an application deployment system on Docker and Kubernetes, all of which were packaged as a Python SDK. These versatile services have been effectively integrated into numerous applications at Noodle, reinforcing my capacity to create and implement comprehensive software development standards.
Software Engineer
Infinite Computer Solutions
10.2018 - 03.2019
- Part of product called BMC (Broadcast Message Center) which provides solutions that enables simultaneous delivery of emergency alerts and messages from govt. and public safety agencies to multiple mobile users in a geographic area.
- Feature development in Java that enables delivery of alerts based on static alerting zones.
Member of Technical Staff
Oracle India
06.2015 - 02.2018
- Software Development for User Data Repository (UDR) - A Product that provides highly scalable, consolidated database backend for subscriber and profile data that can be leveraged across the product portfolio.
- Implemented RESTful web APIs using Spring MVC to create, retrieve, modify customer data in data repository.
- Backend Developer for Oracle Communication Session Monitor family of products - The product provides solution for end- to-end call monitoring, detecting, and troubleshooting IP Multimedia Subsystem (IMS), Voice over Long-Term Evolution (VoLTE), SIP.
- Worked on fraud detection and prevention feature which is a self-learning, scalable solution to help network operators detect phone fraud and prevent it before damage is done. Used Spring and hibernate frameworks along with Java in development.
Education
M.Tech - Data Science
Birla Institute of Technology and Science
Pilani10.2022
B.E - Information Science & Engineering
PES Institute of Technology
05.2015
Skills
- Python
- Docker
- Kubernetes
- Flask
- Kubeflow
- Airflow
- Druid
- Postgres
- Jenkins
- AWS
- Apache Kafka
- Ansible
- Linux
- System Design
- Java
- Data Modeling
- GraphDB
- MLOps
- CI/CD
- Databricks
- Streamlit
- Ray
Languages
English
Hindi
Timeline
Senior Machine Learning Operations Engineer
Integral Ad Science
08.2023 - Current
Senior MLOps Engineer
Blackswan Technologies
07.2022 - 07.2023
Principal Software Engineer- ML
Noodle.ai
04.2019 - 07.2022
Software Engineer
Infinite Computer Solutions
10.2018 - 03.2019
Member of Technical Staff
Oracle India
06.2015 - 02.2018
M.Tech - Data Science
Birla Institute of Technology and Science
B.E - Information Science & Engineering
PES Institute of Technology