Foundation Models
Pre-training, post-training, long context, multimodal reasoning, and task-balanced VLM curricula.
Senior Research Engineer · Vision-Language Models Team Lead
I build sovereign vision-language foundation models from scratch — spanning data, pre-training, post-training, evaluation, and the ML systems that make them scale.
My work sits where multimodal modeling, document intelligence, and large-scale ML infrastructure meet.
Pre-training, post-training, long context, multimodal reasoning, and task-balanced VLM curricula.
OCR, parsing, layout understanding, grounding, VQA, reconstruction, and structured extraction.
Distributed training, large-scale generation, data systems, efficient storage, and multimodal evaluation.
A family of sovereign document VLMs, agents, evaluation systems, and infrastructure — from task-specialists to multi-task foundation models.
The common thread: build the models, agents, evals, and systems needed for sovereign multimodal intelligence end-to-end.
Explore Patram →I started by trying very different corners of ML. That breadth eventually converged into multimodal foundation models and systems.
Institute Gold Medal for Excellence in Academics and Co-curricular Activities · Rank 1 / 1103.
Speech, quantum optimization, autonomous driving, neuromorphic AI, vision, motion, and compiler representations.
Bosch, ISRO, DevRev, MPhasis, and Milan — rapid prototyping, competition ML, and a lot of late-night debugging.
Research spanning document understanding, visual grounding, layout analysis, reconstruction, and multimodal evaluation.
Building sovereign VLMs from scratch across data, training, post-training, evaluation, inference, and deployment systems.
Before document VLMs became the center of my work, I explored problems across speech, vision, quantum ML, neuromorphic AI, compilers, motion, and rapid-build competitions.
Motion-as-language modeling and training with in-house yoga MoCap data.
Open project → Neuromorphic AIFrom Hebbian learning and Hopfield networks to SNNs and cellular neural networks.
Open project → Quantum MLQiskit-based spherical q-means applied to multi-depot vehicle routing.
Open project → Optimization · ClusteringANN reformulations of EM and neuro-fuzzy clustering for Gaussian mixtures.
Open project → SpeechFar-field speaker recognition for noisy robotic environments · IEEE SP Cup winner.
Open project → 3D VisionSemantic segmentation and upsampling pipelines for autonomous-driving point clouds.
Open project → Quantum OptimizationD-Wave CQM and QUBO formulations for vehicle-routing problems and variants.
Open project → Computer VisionThree-stage CNN reconstruction for clipping, non-linearity, and quantization reversal.
Open project → Compilers · RobustnessAdversarial training and program-level attacks for learned compiler representations.
Open project →Tool-selecting LLM agent with retrieval, ranking, and open-model generation.
Open project → Inter-IIT Tech Meet 12.0D-Wave DQM business-rules engine for airline schedule-change optimization.
Open project → Silver · Inter-IIT 11.0GAN-based super-resolution for Chandrayaan TMC-2 imagery and lunar-atlas generation.
Open project → Silver · Inter-IIT 10.0Age and gender estimation from low-resolution surveillance feeds.
Open project → Gold · MilanFull-stack movie platform with opinion summarization and sentiment-based review clustering.
Open project →I enjoy explaining difficult ideas, helping people build, and contributing back to research communities.
Models are fun. So are cricket, concerts, films, travel, and disappearing into a topic until I understand it properly.
I like understanding how intelligent systems work all the way down—and then building them all the way up.