[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Few-shot partial multi-label learning with synthetic features network

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

In partial multi-label learning (PML) problems, each training sample is partially annotated with a candidate label set, among which only a subset of labels are valid. The major hardship for PML is that its training procedure is prone to be misled by false positive labels concealed in the candidate label set. To train a noise-robust multi-label predictor for PML problem, most existing methods hold the assumption that sufficient training samples are available. However, in actual fact, especially when dealing with new tasks, we more often only have a few PML samples for the target task. In this paper, we propose a unified model called FsPML-SF (Few-shot Partial Multi-Label Learning with Synthetic Features Network). FsPML-SF includes three modules: label disambiguation, data augmentation and classifier induction. Specifically, FsPML-SF attempts to update the label credibility of each PML sample by leveraging the feature and semantic similarities, the label credibility of other samples and label co-occurrence in a unified objective function. Next, FsPML-SF introduces a synthetic feature network to generate more training samples from pairs of given samples with corresponding label credibility values. FsPML-SF then utilizes the original and synthesized samples to induce a noise-tolerant multi-label classifier. We conducted extensive experiments on benchmark datasets, FsPML-SF outperforms recent competitive PML baselines and few-shot solutions. Both the label denoising and data augmentation improve the performance of PML on few-shot data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. An implementation of FsPML-SF can be found at the following link: https://www.sdu-idea.cn/codes.php?name=FsPML-DA.

References

  1. Xie M-K, Huang S-J (2018) Partial multi-label learning, in: AAAI, pp 4302–4309

  2. Yu G, Chen X, Domeniconi C, Wang J, Li Z, Zhang ZJ, Wu X (2018) Feature-induced partial multi-label learning, in: ICDM, pp 1398–1403

  3. Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. TKDE 26(8):1819–1837

    Google Scholar 

  4. Yu G, Tu J, Wang J, Domeniconi C, Zhang X (2020) Active multilabel crowd consensus. TNNLS 32(4):1448–1459

    Google Scholar 

  5. Chen T, Pu T, Wu H, Xie Y, Lin L (2021) Structured semantic transfer for multi-label recognition with partial labels, arXiv: abs/2112.10941

  6. Fang X, Yan P (2020) Multi-organ segmentation over partially labeled datasets with multi-scale feature abstraction. TMI 39:3619–3629

    Google Scholar 

  7. Modi S, Dey S, Singh A (2019) Proportional and derivative controllers for buffering noisy gene expression, in: CDC, pp 2832–2837

  8. Fang J-P, Zhang M-L (2019) Partial multi-label learning via credible label elicitation, in: AAAI, pp 3518–3525

  9. Wang H, Liu W, Zhao Y, Zhang C, Hu T, Chen G (2019) Discriminative and correlative partial multi-label learning., in: IJCAI, pp 3691–3697

  10. Sun L, Feng S, Wang T, Lang C, Jin Y (2019) Partial multi-label learning by low-rank and sparse decomposition, in: AAAI, pp 5016–5023

  11. Yu T, Yu G, Wang J, Domeniconi C, Zhang X (2020) Partial multi-label learning using label compression, in: ICDM, pp 761–770

  12. Xu N, Liu Y-P, Geng X (2020) Partial multi-label learning with label distribution, in: AAAI, pp 6510–6517

  13. Lyu G, Feng S, Li Y (2021) Noisy label tolerance: a new perspective of partial multi-label learning. Inf Sci 543:454–466

    Article  MathSciNet  Google Scholar 

  14. Xie M, Sun F, Huang S (2021) Partial multi-label learning with meta disambiguation, in: KDD, pp 1904–1912

  15. Alfassy A, Karlinsky L, Aides A, Shtok J, Harary S, Feris RS, Giryes R, Bronstein AM (2019) Laso: label-set operations networks for multi-label few-shot learning, CVPR 6541–6550

  16. Chen T, Lin L, Chen R, Hui X, Wu H (2022) Knowledge-guided multi-label few-shot learning for general image recognition. TPAMI 44:1371–1384

    Article  Google Scholar 

  17. Lee C-W, Fang W, Yeh C-K, Wang Y-CF (2018) Multi-label zero-shot learning with structured knowledge graphs, in: CVPR, pp 1576–1585

  18. Ou G, Yu G, Domeniconi C, Lu X, Zhang X (2020) Multi-label zero-shot learning with graph convolutional networks. Neural Netw 132:333–341

    Article  Google Scholar 

  19. Zhao Y, Yu G, Liu L, Yan Z, Domeniconi C, Cui L (2021) Few-shot partial multi-label learning, ICDM, pp 926–935

  20. Snell J, Swersky K, Zemel RS (2017) Prototypical networks for few-shot learning, in: NeurIPS, pp 4077–4087

  21. Liu J, Song L, Qin Y (2020) Prototype rectification for few-shot learning, in: ECCV, pp 741–756

  22. Sun Y, Zhao Y, Yu G, Yan Z, Domeniconi C (2022) Few-shot partial multi-label learning with data augmentation. In: 2022 IEEE international conference on data mining (ICDM), pp 478–487

  23. Xie M-K, Huang S-J (2022) Partial multi-label learning with noisy label identification. TPAMI 44(7):3676–3687

    Google Scholar 

  24. Cour T, Sapp B, Taskar B (2011) Learning from partial labels. JMLR 12:1501–1536

    MathSciNet  Google Scholar 

  25. Zhang M-L, Yu F, Tang C-Z (2017) Disambiguation-free partial label learning. TKDE 29(10):2155–2167

    Google Scholar 

  26. Tu J, Yu G, Domeniconi C, Wang J, Xiao G, Guo M (2018) Multi-label answer aggregation based on joint matrix factorization, in: ICDM, pp 517–526

  27. Yu T, Yu G, Wang J, Guo M (2020) Partial multi-label learning with label and feature collaboration, in: DASFAA, pp 621–637

  28. Li Z, Lyu G, Feng S (2020) Partial multi-label learning via multi-subspace representation, in: IJCAI, pp 2612–2618

  29. Lyu G, Feng S, Li Y (2020) Partial multi-label learning via probabilistic graph matching mechanism. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining

  30. Xie M-K, Huang S-J (2020) Semi-supervised partial multi-label learning. In: 2020 IEEE International Conference on Data Mining (ICDM), pp 691–700

  31. Sun L, Feng S, Lyu G, Zhang H, Dai G (2020) Partial multi-label learning with noisy side information. Knowl Inform Syst 63:541–564

    Article  Google Scholar 

  32. Wu J-H, Wu X, Chen Q, Hu Y, Zhang M-L (2020) Feature-induced manifold disambiguation for multi-view partial multi-label learning. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining

  33. Gong X, Yuan D, Bao W (2021) Understanding partial multi-label learning via mutual information, in: NeurIPS

  34. Sun L, Feng S, Liu J, Lyu G, Lang C (2022) Global-local label correlation for partial multi-label learning. IEEE Trans Multimed 24:581–593

    Article  Google Scholar 

  35. Zhao P, Zhao S, Zhao X, Liu H, Ji X (2022) Partial multi-label learning based on sparse asymmetric label correlations. Knowl Based Syst 245:108601

    Article  Google Scholar 

  36. Gong X, Yuan D, Bao W (2022) Partial multi-label learning via large margin nearest neighbour embeddings, in: AAAI

  37. Yan Y, Guo Y (2021) Adversarial partial multi-label learning with label disambiguation, in: AAAI, pp 10568–10576

  38. Yan Y, Li S, Feng L (2021) Partial multi-label learning with mutual teaching. Knowl Based Syst 212:106624

    Article  Google Scholar 

  39. Sun F, Xie M-K, Huang S-JA (2022) Deep model for partial multi-label image classification with curriculum based disambiguation, arXiv: abs/2207.02410

  40. Li F, Shi S, Wang H (2022) Partial multi-label learning via specific label disambiguation. Knowl Based Syst 250:109093

    Article  Google Scholar 

  41. Zhang B, Li Z, Liu L, Wang Z (2023) Landmark-based partial multi-label learning with noise processing, 2023 International Joint Conference on Neural Networks (IJCNN), pp 1–8

  42. Wang H, Yang S, Lyu G, Liu W, Hu T, Chen K, Feng S, Chen G (2023) Deep partial multi-label learning with graph disambiguation, arXiv: abs/2305.05882

  43. Liu B, Jia B-B, Zhang M L (2023) Towards enabling binary decomposition for partial multi-label learning., IEEE transactions on pattern analysis and machine intelligence

  44. Rios A, Kavuluru R (2018) Few-shot and zero-shot multi-label learning for structured label spaces, in: EMNLP, pp 3132–3142

  45. Hou Y, Lai Y, Wu Y, Che W, Liu T (2020) Few-shot learning for multi-label intent detection, in: AAAI

  46. Simon C, Koniusz P, Harandi M (2021) Meta-learning for multi-label few-shot classification, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp 346–355

  47. Wang Z, Duan Y, Liu L, Tao D (2021) Multi-label few-shot learning with semantic inference (student abstract), in: AAAI Conference on Artificial Intelligence

  48. Xiao L, Xu P, Jing L, Akujuobi U, Zhang X (2022) Semantic guide for semi-supervised few-shot multi-label node classification. Inf Sci 591:235–250

    Article  Google Scholar 

  49. Zhao F, Shen Y, Wu Z, Dai X (2022) Label-driven denoising framework for multi-label few-shot aspect category detection, in: Conference on Empirical Methods in Natural Language Processing

  50. Liang J, Phan H, Benetos E (2022) Learning from taxonomy: multi-label few-shot classification for everyday sound recognition, arXiv: abs/2212.08952

  51. Gong J, Chen W-T, Eldardiry H (2023) Knowledge-enhanced multi-label few-shot product attribute-value extraction, arXiv: abs/2308.08413

  52. Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks, in: ICLR

  53. Reed SE, Chen Y, Paine TL, van den Oord A, Eslami SMA, Rezende DJ, Vinyals O, de N Freitas (2018) Few-shot autoregressive density estimation: Towards learning to learn distributions, in: ICLR

  54. Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks, in: ICCV, pp 2242–2251

  55. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2020) Generative adversarial networks. Comm ACM 63(11):139–144

    Article  MathSciNet  Google Scholar 

  56. Ye J, He J, Peng X, Wu W, Qiao Y (2020) Attention-driven dynamic graph convolutional network for multi-label image recognition, in: ECCV, pp 649–665

  57. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision, in: CVPR, pp 2818–2826

  58. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization, in: ICLR

  59. Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft coco: Common objects in context, in: ECCV, pp 740–755

  60. Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: a real-world web image database from national university of Singapore, in: ACM CIVR, pp 1–9

  61. Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database, in: CVPR, pp 248–255

  62. Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, Köpf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) Pytorch: an imperative style, high-performance deep learning library, in: Neural Information Processing Systems

Download references

Acknowledgements

We thank the authors who kindly share their datasets or source codes with us for the experimental study. This work is supported by National Natural Science Foundation of China (No. 62031003, 61872300).

Author information

Authors and Affiliations

  1. School of Software, Shandong University, Jinan, China

    Yifan Sun, Yunfeng Zhao, Guoxian Yu & Zhongmin Yan

  2. Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, China

    Yifan Sun, Yunfeng Zhao, Guoxian Yu & Zhongmin Yan

  3. Department of Computer Science, George Mason University, Fairfax, VA, USA

    Carlotta Domeniconi

Authors
  1. Yifan Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yunfeng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guoxian Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongmin Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carlotta Domeniconi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YS, YZ and GY wrote the main manuscript text. All authors reviewed the manuscript.

Corresponding author

Correspondence to Guoxian Yu.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Y., Zhao, Y., Yu, G. et al. Few-shot partial multi-label learning with synthetic features network. Knowl Inf Syst 66, 1167–1203 (2024). https://doi.org/10.1007/s10115-023-01988-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-023-01988-2

Keywords

Search

Navigation