The medical domain is vast and diverse, with many existing embedding models focused on general healthcare applications. However, these models often struggle to capture a deep understanding of diseases due to their broad generalization across the entire medical field. To address this gap, I present DisEmbed, a disease-focused embedding model. DisEmbed is trained on a synthetic dataset specifically curated to include disease descriptions, symptoms, and disease-related Q&A pairs, making it uniquely suited for disease-related tasks. For evaluation, I benchmarked DisEmbed against existing medical models using disease-specific datasets and the triplet evaluation method. My results demonstrate that DisEmbed outperforms other models, particularly in identifying disease-related contexts and distinguishing between similar diseases. This makes DisEmbed highly valuable for disease-specific use cases, including retrieval-augmented generation (RAG) tasks, where its performance is particularly robust.
Gradients can be employed for sensitivity analysis. Here, we leverage the advantages of the Loss Landscape to comprehend which independent variables impact the dependent variable. We seek to grasp the loss landscape by utilizing first, second, and third derivatives through automatic differentiation. we know that Spearman’s rank correlation coefficient can detect the monotonic relationship between two variables. However, I have found that second-order gradients, with certain configurations and parameters, provide information that can be visualized similarly to Spearman results, In this approach, we incorporate a loss function with an activation function, resulting in a non-linear pattern. Each exploration of the loss landscape through retraining yields new valuable information. Furthermore, the first and third derivatives are also beneficial, as they indicate the extent to which independent variables influence the dependent variable.
@inproceedings{10.48550/arXiv.2403.01128,author={Faroz, Salman},booktitle={this paper. Using gradients for sensitivity analysis, exploring the loss landscape through first, second, and third derivatives},month=mar,publisher={Arxiv},title={Sensitivity Analysis On Loss Landscape},year={2024}}
In this research, deep learning-based system is proposed for early detection of diseases like pneumonia and diabetic retinopathy, enabling patients and hospitals to predict disease severity and improve diagnosis accuracy. This system builds on successful existing models, promising advancements in disease diagnosis and patient outcomes., Aug 2023
Annually, approximately 12 million people worldwide suffer due to the misdiagnosis of diseases. To tackle this critical issue, a novel approach for early disease detection is proposed, encompassing conditions such as pneumonia, diabetic retinopathy, and more. Patients can assess disease severity based on the provided medical reports, enabling predictions of mild, moderate, severe, or proliferative stages. Leveraging deep learning models, this system empowers individuals to accurately predict the likelihood of these diseases. The primary targets of this model are patients and hospitals, benefitting from unique image processing techniques that ensure higher accuracy. Building upon the success of existing deep learning models for diabetic retinopathy and pneumonia, the proposed system holds promising potential for advancing disease diagnosis and improving patient outcomes.
@inproceedings{10.55041/IJSREM17431,author={Faroz, Salman},booktitle={this research, deep learning-based system is proposed for early detection of diseases like pneumonia and diabetic retinopathy, enabling patients and hospitals to predict disease severity and improve diagnosis accuracy. This system builds on successful existing models, promising advancements in disease diagnosis and patient outcomes.},doi={https://www.doi.org/10.55041/IJSREM17431},month=aug,publisher={International Journal of Scientific Research in Engineering and Management (IJSREM)},title={Health Care Prediction System Using Deep Learning},year={2023}}
