Raj Sangani

Selected Publications

1. IEEE Xplore

   Comparing Deep Sentiment Models using Quantified Local Explanations

   Raj Bharat Sangani, Apratim Shukla, and Radhika B. Selvamani

   Nov 2021

   Abs Bib PDF

   Online judge systems that enable the automatic evaluation of predictive models face the problem of choosing the best model among those with near equal accuracy measures. In such scenarios, interpreting competitive models may provide a better insight towards robustness. Sentiment analysis is a well- explored domain with many available approaches and libraries. Despite this, it is context-sensitive and poses many challenges to the research community and thus deems fit to our analysis. Selecting a model with the highest accuracy may not be satisfactory, especially when the decision margins are too narrow. Our comparative study on models with similar accuracies and f1-scores but distinct underlying architectures incorporate custom metrics and evaluation methods to assess their performance on a sentiment analysis task. We have proposed to include human judgment in an online judge system using a feedback acquisition mechanism, presenting explanations for model decisions on selected test cases. Our initial experimental findings indicate that evaluating model robustness by incorporating a well-defined human feedback mechanism, using model agnostic approaches encourages online judge systems to make explainable decisions. The p-value associated with a paired t-Test on the feedback collected for model preference indicates a significant preference for the model supported by our metrics.

   @article{9588834,
     author = {Sangani, Raj Bharat and Shukla, Apratim and Selvamani, Radhika B.},
     booktitle = {2021 Smart Technologies, Communication and Robotics (STCR)},
     title = {Comparing Deep Sentiment Models using Quantified Local Explanations},
     year = {2021},
     volume = {},
     number = {},
     pages = {1-6},
     month = nov,
     doi = {https://doi.org/10.1109/STCR51658.2021.9588834},
     publisher = {IEEE Xplore},
   }

2. IEEE

   Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documents

   Shreya Saxena, Raj Sangani, Siva Prasad, and 4 more authors

   Dec 2022

   Abs

   Recent advances in the healthcare industry have led to an abundance of unstructured data, making it challenging to perform tasks such as efficient and accurate information retrieval at scale. Our work offers an all-in-one scalable solution for extracting and exploring complex information from large-scale research documents, which would otherwise be tedious. First, we briefly explain our knowledge synthesis process to extract helpful information from unstructured text data of research documents. Then, on top of the knowledge extracted from the documents, we perform complex information retrieval using three major components- Paragraph Retrieval, Triplet Retrieval from Knowledge Graphs, and Complex Question Answering (QA). These components combine lexical and semantic-based methods to retrieve paragraphs and triplets and perform faceted refinement for filtering these search results. The complexity of biomedical queries and documents necessitates using a QA system capable of handling queries more complex than factoid queries, which we evaluate qualitatively on the COVID-19 Open Research Dataset (CORD-19) to demonstrate the effectiveness and value- add.