About ME
I am a Ph.D. candidate at the department of Computer Science at Brown University. I am advised by Professor Iris Bahar. Previously, I was at Drexel University where I earned an integrated BS and MS in Electrical Engineering, and a minor in Computer Science.
My research interest lies in embedding robots with a causal understanding of the world to facilitate smarter decision making under uncertainty. Human decision making is guided by causal-reasoning. Transferring human causal knowledge to robots can pave the way for generalizable autonomous planning in unknown environments.
In my free time, I like to time-travel (aka read fiction), scout for cafes, explore New England small towns and live the slow life.
Semanti Basu
- We developed a model to embed human-generated causal reasoning into Partially Observable Markov Decision Processes (POMDPs) to allow robots to plan better under uncertainty. We built an interface to allow seamless transfer of human causal understanding to robots in the form of causal graphs. We demonstrated a 2X improvement in robot planning performance in object assembly when it is causally informed. We are exploring several directions on how to aid autonomous decision making through human-generated causal models.
- Embedding causal models in autonomous decision making
(funded by ONR)
3D Point
Left Image
Right Image
- Designed and prototyped a stereo-depth estimation algorithm to strike a balance between compute time, compute power and accuracy. Recent developments in stereo depth estimation show great performance on optics-limited scenes (ex: transparent/ translucent objects, texture less regions etc). However, they are often much more time consuming and resource intensive than traditional methods. Developed a hybrid approach to leverage the strengths of traditional optimization with the power of learning to improve performance by 2X
- Depth Estimation in time and resource constrained environments (Amazon Science internship)
- Developed a method to segment heterogeneous lipid nanoparticles
in noisy, low-SNR cryoEm images. We adapted a cell-segmentation
tool and added an optimization pipeline to enable accurate
segmentation of particles with non-uniform size distribution. We
released a dataset of labeled images created iteratively through our
method. The process of labeling masks was accelerated by 5X using
our method.
- Lipid Nanoparticle (LNP) Segmentation in cryoEM images
(funded by NIST)
Causal reasoning based interaction modeling for
trajectory prediction in autonomous driving (Gatik AI internship - patent pending)
Developed an algorithm to allow a self-driving car to plan
trajectories under uncertainty of surrounding cars’ intentions. A
data-driven approach was used for unsupervised intention
prediction. Causal reasoning allowed us to model potential
interactions for smarter predictions.
- Developed an architecture of Convolutional neural networks to predict anthropometric points on human silhouettes. Developed a biometric-reidentification method (96% accuracy) that leveraged the points predicted for 3D human body classification.
- Salient point detection and 3D human body classification
- Problems that require planning under uncertainty are often modeled as Partially Observable Markov Decision Processes (POMDPs). Its intractable to solve POMDPs exactly, so Monte Carlo sampling based methods are often used. These become increasingly slow with increased domain size. We are looked into several ways to accelerate planning and achieved upto 2X improvement over serial POMCP.
- Performance aware POMDP planning
Publications
Semanti Basu, Peter Bajcsy, Thomas Cleveland, Manuel Carrasco, R. Bahar
- Proceedings of the 16th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 2: BIOIMAGING, 2023
Semanti Basu, Chenxi Li, Fernand Cohen
- Multimedia Tools and Applications, 2022
- Semir Tatlidil*, Semanti Basu*, Kaishuo Zhang, F. Tao Burga Montoya, R. Iris Bahar, Steven Sloman.In Cognitive Modeling in Robot Learning for Adaptive Human-Robot Interactions Workshop @ ICRA 2023.
- Semanti Basu*, Semir Tatlidil*, Kaishuo Zhang, F. Tao Burga Montoya, Steven Sloman ,R. Iris Bahar. In Communicating Robot Learning Across Human-Robot Interaction, a workshop at the International Conference on Robotics and Automation (ICRA) 2023. (Won 550$ award from DeepMind).
Robot Planning under Uncertainty for Object Assembly and Troubleshooting using Human Causal Models
Semanti Basu*, Semir Tatlidil, Moon Hwan Kim, Tiffany Tran, Serena Saxena, Tom Williams, Steven Sloman, R. Iris Bahar. In IEEE International
Conference on Robotics and Automation (ICRA) 2025.
Using Causal Information to Enable More Efficient Robot Operation
Semanti Basu*, Semir Tatlidil, Moon Hwan Kim, Steven Sloman, R Iris Bahar. In Proceedings of the 61st ACM/IEEE Design Automation Conference 2024
Human causal reasoning guided autonomous object assembly under uncertainty.
Semanti Basu*, Semir Tatlidil, Moon Hwan Kim, Steven Sloman, R. Iris Bahar. In Causal-HRI: Causal Learning for Human-Robot Interaction, Workshop at ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2024.
- Feel free to reach out with any questions!
- semanti_basu@brown.edu
Semanti Basu
- Undergraduate thesis, Drexel University, 2020
Semanti Basu, Sreshtaa Rajesh, Kaiyu Zheng, Stefanie Tellex, R Iris Bahar
- Rss workshop on software tools for real-time optimal control, 2021
Semanti Basu, Semir Tatlidil, Kaishuo Zhang, F. Tao Burga Montoya, R. Iris Bahar, Steven Sloman
- Workshop YOUR Study Design!, A Workshop at the ACM/IEEE International Conference on Human-Robot Interaction, 2023