Abstract
Industrial equipment, devices and patients typically undergo change from a healthy state to an unhealthy state. We develop a novel approach to detect unhealthy entities and also discover the time of change to enable deeper investigation into the cause for change. In the absence of an engineering or medical intervention, health degradation only happens in one direction — healthy to unhealthy. Our transductive learning framework, known as max-margin temporal transduction (MMTT), leverages this chronology of observations for learning a superior model with minimal supervision. Temporal Transduction is achieved by incorporating chronological constraints in the conventional max-margin classifier — Support Vector Machines (SVM). We utilize stochastic gradient descent to solve the resulting optimization problem. We prove that with high probability, an \(\epsilon \)-accurate solution for the proposed model can be achieved in \({\text {O}}\left( \frac{1}{\lambda \epsilon }\right) \) iterations. The runtime is \({\text {O}}\left( \frac{1}{\lambda \epsilon }\right) \) for the linear kernel and \({\text {O}}\left( \frac{n}{\lambda \epsilon }\right) \) for a non-linear Mercer kernel, where n is the number of observations from all entities — labeled and unlabeled. Our experiments on publicly available benchmark datasets demonstrate the effectiveness of our approach in accurately detecting unhealthy entities with less supervision as compared to other strong baselines — conventional and transductive SVM.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We have ignored the bias b in this work, although it is likely to only further improve the results beyond those presented here. Detailed discussion on the bias term appears in [10].
- 2.
Uses: \(\frac{\partial |u|}{\partial v} = \frac{u}{|u|}\frac{\partial u}{\partial v}; u \ne 0\).
- 3.
A function \(f(\mathbf {w})\) is called \(\lambda \)-strongly convex if \(f(\mathbf {w}) - \frac{\lambda }{2}\Vert \mathbf {w}\Vert ^2\) is a convex function.
- 4.
\(\Vert \phi (\mathbf {x})\Vert ^2 = \langle \phi (x)\phi (x) \rangle = \exp \left( \frac{-|\phi (\mathbf {x}) - \phi (\mathbf {x})\Vert ^2}{2\sigma ^2}\right) = 1\).
- 5.
- 6.
- 7.
References
Bordes, A., Ertekin, S., Weston, J., Bottou, L.: Fast kernel classifiers with online and active learning. J. Mach. Learn. Res. 6, 1579–1619 (2005). http://leon.bottou.org/papers/bordes-ertekin-weston-bottou-2005
Chapelle, O., Vapnik, V., Weston, J.: Transductive inference for estimating values of functions. In: Advances in Neural Information Processing Systems (1999)
Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, pp. 57–64 (2005)
Collobert, R., Sinz, F., Weston, J., Bottou, L.: Large scale transductive SVMs. J. Mach. Learn. Res. 7, 1687–1712 (2006). http://dl.acm.org/citation.cfm?id=1248547.1248609
Petricoin, E.F., et al.: Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359, 572–577 (2002). https://doi.org/10.1016/S0140-6736(02)07746-2
Joachims, T.: Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning, ICML’99, pp. 200–209. Morgan Kaufmann Publishers Inc., San Francisco (1999). http://dl.acm.org/citation.cfm?id=645528.657646
Kakade, S.M., Tewari, A.: On the generalization ability of online strongly convex programming algorithms. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) NIPS, pp. 801–808. Curran Associates, Inc. (2008). http://dblp.uni-trier.de/db/conf/nips/nips2008.html#KakadeT08
Little, M., McSharry, P., Roberts, S., Costello, D., Moroz, I.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. Online 6(1), 23 (2007)
Saxena, A., Goebel, K., Simon, D., Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: International Conference on Prognostics and Health Management, PHM 2008, pp. 1–9, October 2008. https://doi.org/10.1109/PHM.2008.4711414
Shalev-Shwartz, S., Singer, Y., Srebro, N., Cotter, A.: Pegasos: Primal Estimated sub-GrAdient SOlver for SVM. Math. Program. 127(1), 3–30 (2011)
Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C., Johannes, R.S.: Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. J. Hopkins APL Tech. Dig. 10, 262–266 (1988)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Harpale, A. (2022). Health Change Detection Using Temporal Transductive Learning. In: Nicosia, G., et al. Machine Learning, Optimization, and Data Science. LOD 2021. Lecture Notes in Computer Science(), vol 13164. Springer, Cham. https://doi.org/10.1007/978-3-030-95470-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-95470-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95469-7
Online ISBN: 978-3-030-95470-3
eBook Packages: Computer ScienceComputer Science (R0)