Riya Gupta

I am a Machine Learning Engineer in the Central R&D department, Silicon Laboratories Inc. where I work on ASR and voice recoginition. I graduated from Columbia University NYC, with the MS in Electrical & Computer Engineering Department with the focus on Machine Learning Research, where I was lucky to be advised by Prof. Shih-Fu Chang. I have also worked with Prof. Julia Hirschberg on intent analysis using Generative AI and LLMs.

Prior to Columbia, I was a part of GREYC Lab (UNICAEN-CNRS-ENSICAEN), advised by Prof. Gaƫl Dias working on Neural Text Style Transfer and Natural Language Processing. I was also very fortunate to work with Prof. C.V. Jawahar on computer vision, NLP & IRE.

On the job market! DM me on linkedin :)

Google Scholar  /  Twitter  /  Github  /  LinkedIn

profile photo

Research

I am extremely intrigued about mulitmodal and representation learning. Most of my prior research has been mulitmodal learning involving Computer Vision and NLP majorly. I picked up interest in Reinforcement Learning & Speech domain during my time at Columbia. in the past I have also worked onInformation Retrieval & Extraction, and applied Computer Vision. I love to indulge in the mathematics behind the machine learning algorithms and models.

Decision Making and Reinforcement Learning
Riya Gupta, Akshay Sharma, Tony Dear
Coursera, 2023
Coursera

An introduction to sequential decision making and reinforcement learning, with a discussion of utility theory to learn how preferences can be represented and modeled for decision making.

Information Retrieval from the Digitized Books
Riya Gupta, CV Jawahar
ILTR book Chapter, 2022
arXiv / video

OCR (Optical Character Recognition) based Search Engine to make an Information Retrieval & Extraction (IRE) system for low resource Indic languages.

DGAZE: Driver Gaze Mapping on Road
Isha Dua, Thrupthi Ann John, Riya Gupta, CV Jawahar
International Conference on Intelligent Robots and Systems, 2020
project page / bibtex

A novel and large-scale dataset along with the 3D CNN architecture for driver eye gaze prediction on the road for Indian Road Systems.

More Stuff

cucs TA, Computer Vision-II by Prof. Carl Vondrick, Columbia University
CA, Decision Making in Reinforcement Learning (CVN) by Prof. Tony Dear, Columbia University
TA, Analysis of Algorithms I by Prof. Mihalis Yannakakis, Columbia University

Talks & Presentations

Tutorial - Computer Vision II, Columbia University, 2022 - Optimisers
RnD, IIIT Hyderabad, 2020 - Multimodal Information Retrieval
Summer School ,IIIT Hyderabad, 2019 - TensorflowLite

DE&I and PoR

WTM at Google NYC (Current)
Social chair at EGSC, Columbia University (Spring 22, Fall 22)