Summary
We propose a Multimodal Medical Information Fusion framework (MMIF) using a Category Constrained-Parallel ViT model (CCPViT) for multimodal learning . CCPViT addresses misalignment between modalities. We add a cross-attention-based image-text joint component to CCPViT, creating a Multimodal Representation Alignment Network model (MRAN). MRAN explores interactions between modalities and aids multimodal learning. We make a simple Fetal Distress Diagnosis (FDD) model using the aligned MMIF. It trains on images and text, then diagnoses from images. We show our models outperform others and are effective.
Computer-aided interpretation of fetal heart rate and uterine contraction has not been developed well enough for wide use. The main challenges still lie in the lack of unclear and nonstandard labels for cardiotocography recordings, and timely prediction of fetal state during monitoring.
Published By:
Liu Yang - IEEE International Conference on Acoustics, Speech, and Signal Processing
2022
Cited By:
2
Cardiotocography used for fetal monitoring;new features developed using clinical expertise and system control theory characterise fetal heart rate response to contractions.
Published By:
M. o'Sullivan - European Signal Processing Conference
2021
Cited By:
2
New machine learning models to predict Intrauterine Growth Restriction developed;Random Forest model had highest accuracy,but Support Vector Machine had better specificity.
Published By:
N. Aslam - Electronics
2022
Cited By:
8
Monitoring expectant mothers' health is important.Computerized fetal heart rate analysis helps assess heart rate variability.
Published By:
Prakriti Dwivedi - European Conference on Artificial Intelligence
2021
Cited By:
6
Cardiotocography monitors fetal health. Machine learning models classify CTG in stages; SVM and RF had high accuracy.
Published By:
Sahana Das - Diagnostics
2023
Cited By:
3
Pathological fetal heart rate during labor associated with increased risk of neonatal acidosis.Repeated fetal monitoring and team training may reduce incidence of neonatal acidosis.
Published By:
A. Faivre - undefined
2020
Cited By:
1
The study analyzes fetal heart rate categorization using decision trees with highest 98.7% accuracy and proves their viability for prediction according to classification .
Published By:
Md Zannatul Arif - Journal of Advanced Engineering and Computation
2020
Cited By:
12
The study provides doctors fetal heart rate indicators to reduce misdiagnosis. The algorithm analyzed 552 FHR signals and extracted 21 features. A model classifies FHR into categories based on features.
Published By:
Y. Que - undefined
2020
Cited By:
0
The electronic fetal heart monitor detects hypoxia; an algorithm analyzed heart data from 132 fetuses, identifying 22 parameters indicating abnormalities with 93.75% accuracy.
Published By:
Jianli Liu - Journal of Mechanics in Medicine and Biology
2021
Cited By:
0
Intrapartum electronic fetal monitoring is used to monitor the fetus. Early uses led to more C-sections but issues were with interpretation, not the technology itself. Computerized FHR analysis systems were developed to address this.
Published By:
George G. Georgoulas - undefined
2004
Cited By:
37