Deng-Bao WANG  王登豹

Ph.D. Student

School of Computer Science and Engineering

Southeast University, China

Computer Building, Jiulonghu Campus of Southeast University, Nanjing, China
Email: wangdb[at]seu.edu.cn  OR  wangdb.seu[at]gmail.com

I am now a third year Ph.D. student (supervised by Prof. Min-Ling Zhang) of School of Computer Science and Engineering in Southeast University and a member of PALM group. I have been recently enrolled in Tencent Rhino-Bird Elite Training Program and now I am a research intern at Tencent AI Lab, working on Trustworthy Machine Learning and AI-aided Drug Discovery with Peilin Zhao and Lanqing Li.

Research Interests

• Weakly Supervised Learning

• Deep Learning Phenomena

• Uncertainty Quantification for Classification and Regression

Publications (†Equal Contribution)

• Revisiting Consistency Regularization for Deep Partial Label Learning.
  D.-D. Wu†, D.-B. Wang†, M.-L. Zhang.
  In: Proceedings of the 39th International Conference on Machine Learning.
  
   ICML 2022    Abstract    Paper    Appendix    Code    Bibtex  
  
  Partial label learning (PLL), which refers to the classification task where each training instance is ambiguously annotated with a set of candidate labels, has been recently studied in deep learning paradigm. Despite advances in recent deep PLL literature, existing methods (e.g., methods based on self-training or contrastive learning) are confronted with either ineffectiveness or inefficiency. In this paper, we revisit a simple idea namely consistency regularization, which has been shown effective in traditional PLL literature, to guide the training of deep models. Towards this goal, a new regularized training framework, which performs supervised learning on non-candidate labels and employs consistency regularization on candidate labels, is proposed for PLL. We instantiate the regularization term by matching the outputs of multiple augmentations of an instance to a conformal label distribution, which can be adaptively inferred by the closed-form solution. Experiments on benchmark datasets demonstrate the superiority of the proposed method compared with other state-of-the-art methods. @inproceedings{ICML22ddwu,
  author = {Dong-Dong Wu and Deng-Bao Wang and Min-Ling Zhang},
  title = {Revisiting Consistency Regularization for Deep Partial Label Learning},
  booktitle = {Proceedings of the 39th International Conference on Machine Learning, Virtual Conference},
  year = {2022}
  }


• Adaptive Graph Guided Disambiguation for Partial Label Learning.
  D.-B. Wang, M.-L. Zhang, L. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence, in press.
  
   IEEE TPAMI    Abstract    Paper    Appendix    Code    Bibtex  
  
  In partial label learning, a multi-class classifier is learned from the ambiguous supervision where each training example is associated with a set of candidate labels among which only one is valid. An intuitive way to deal with this problem is label disambiguation, i.e. differentiating the labeling confidences of different candidate labels so as to try to recover ground-truth labeling information. Recently, feature-aware label disambiguation has been proposed which utilizes the graph structure of feature space to generate labeling confidences over candidate labels. Nevertheless, the existence of noises and outliers in training data makes the graph structure derived from original feature space less reliable. In this paper, a novel partial label learning approach based on adaptive graph guided disambiguation is proposed, which is shown to be more effective in revealing the intrinsic manifold structure among training examples. Other than the sequential disambiguation-then-induction learning strategy, the proposed approach jointly performs adaptive graph construction, candidate label disambiguation and predictive model induction with alternating optimization. Furthermore, we consider the particular human-in-the-loop framework in which a learner is allowed to actively query some ambiguously labeled examples for manual disambiguation. Extensive experiments clearly validate the effectiveness of adaptive graph guided disambiguation for learning from partial label examples. @inproceedings{tpami22dbwang,
  author = {Deng-Bao Wang and Li Li and Min-Ling Zhang},
  title = {Adaptive Graph Guided Disambiguation for Partial Label Learning},
  booktitle = {IEEE Transactions on Pattern Analysis and Machine Intelligence, in press},
  year = {2022}
  }


• Rethinking Calibration of Deep Neural Networks: Don't Be Afraid of Overconfidence.
  D.-B. Wang, L. Feng, M.-L. Zhang.
  In: Advances in Neural Information Processing Systems, Virtual Conference.
  
   NeurIPS 2021    Abstract    Paper    Appendix    Code    Bibtex  
  
  Capturing accurate uncertainty quantification of the prediction from deep neural networks is important in many real-world decision-making applications. A reliable predictor is expected to be accurate when it is confident about its predictions and indicate high uncertainty when it is likely to be inaccurate. However, modern neural networks have been found to be poorly calibrated, primarily in the direction of overconfidence. In recent years, there is a surge of research on model calibration by leveraging implicit or explicit regularization techniques during training, which obtain well calibration by avoiding overconfident outputs.
  
  In our study, we empirically found that despite the predictions obtained from these regularized models are better calibrated, they are worse calibratable, namely, it is harder to further calibrate their predictions with post-hoc calibration methods like temperature scaling and histogram binning. We conduct a series of empirical studies showing that overconfidence may not hurt final calibration performance if post-hoc calibration is allowed, rather, the penalty of confident outputs will compress the room of potential improvements in post-hoc calibration phase. Our experimental findings point out a new direction to improve calibration of DNNs by considering main training and post-hoc calibration as a unified framework. @inproceedings{neurips21dbwang,
  author = {Deng-Bao Wang and Lei Feng and Min-Ling Zhang},
  title = {Rethinking Calibration of Deep Neural Networks: Do Not Be Afraid of Overconfidence},
  booktitle = {Advances in Neural Information Processing Systems, Virtual Conference},
  year = {2021}
  }


• Learning from Complementary Labels via Partial-Output Consistency Regularization.
  D.-B. Wang, L. Feng, M.-L. Zhang.
  In: Proceedings of the 30th International Joint Conference on Artificial Intelligence, Virtual Conference.
  
   IJCAI 2021    Abstract    Paper    Code    Bibtex  
  
  In complementary-label learning (CLL), a multiclass classifier is learned from training instances each associated with complementary labels, which specify the classes that the instance does not belong to. Previous studies focus on unbiased risk estimator or surrogate loss while neglect the importance of regularization in training phase. In this  paper , we give the first attempt to leverage regularization techniques for CLL. By decoupling a label vector into complementary labels and partial unknown labels, we simultaneously inhibit the outputs of complementary labels with a complementary loss and penalize the sensitivity of the classifier on the partial outputs of these unknown classes by consistency regularization. Then we unify the complementary loss and consistency loss together by a specially designed dynamic weighting factor. We conduct a series of experiments showing that the proposed method achieves highly competitive performance in CLL. @inproceedings{ijcai21dbwang,
  author = {Deng-Bao Wang and Lei Feng and Min-Ling Zhang},
  title = {Learning from Complementary Labels via Partial-Output Consistency Regularization},
  booktitle = {Proceedings of the 30th International Joint Conference on Artificial Intelligence, Virtual Conference},
  pages = {3075--3081},
  year = {2021}
  }


• Learning from Noisy Labels with Complementary Loss Functions.
  D.-B. Wang, Y. Wen, L. Pan, M.-L. Zhang.
  In: Proceedings of the 35th AAAI Conference on Artificial Intelligence, Virtual Conference.
  
   AAAI 2021    Abstract    Paper    Appendix    Code    Bibtex  
  
  Recent researches reveal that deep neural networks are sensitive to label noises hence leading to poor generalization performance in some tasks. Although different robust loss functions have been proposed to remedy this issue, they suffer from an underfitting problem, thus are not sufficient to learn accurate models. On the other hand, the commonly used Cross Entropy (CE) loss, which shows high performance in standard supervised learning (with clean supervision), is nonrobust to label noise. In this  paper , we propose a general framework to learn robust deep neural networks with complementary loss functions. In our framework, CE and robust loss play complementary roles in a joint learning objective as per their learning sufficiency and robustness properties respectively. Specifically, we find that by exploiting the memorization effect of neural networks, we can easily filter out a proportion of hard samples and generate reliable pseudo labels for easy samples, and thus reduce the label noise to a quite low level. Then, we simply learn with CE on pseudo supervision and robust loss on original noisy supervision. In this procedure, CE can guarantee the sufficiency of optimization while the robust loss can be regarded as the supplement. Experimental results on benchmark classification datasets indicate that the proposed method helps achieve robust and sufficient deep neural network training simultaneously. @inproceedings{aaai21dbwang,
  author = {Deng-Bao Wang and Yong Wen and Lujia Pan and and Min-Ling Zhang},
  title = {Learning from Noisy Labels with Complementary Loss Functions},
  booktitle = {Proceedings of the 35th AAAI Conference on Artificial Intelligence, Virtual Conference},
  pages = {10111--10119},
  year = {2021}
  }


• Adaptive Graph Guided Disambiguation for Partial Label Learning.
  D.-B. Wang, L. Li, M.-L. Zhang.
  In: Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.
  
   KDD 2019    Abstract    Paper    Code    Bibtex  
  
  Partial label learning aims to induce a multi-class classifer from training examples where each of them is associated with a set of candidate labels, among which only one is the ground-truth label. The common strategy to train predictive model is disambiguation, i.e. differentiating the modeling outputs of individual candidate labels so as to recover ground-truth labeling information. Recently, feature-aware disambiguation was proposed to generate different labeling confdences over candidate label set by utilizing the graph structure of feature space. However, the existence of noise and outliers in training data makes the similarity derived from original features less reliable. To this end, we proposed a novel approach for partial label learning based on adaptive graph guided disambiguation (PL-AGGD). Compared with fxed graph, adaptive graph could be more robust and accurate to reveal the intrinsic manifold structure within the data. Moreover, instead of the two-stage strategy in previous algorithms, our approach performs label disambiguation and predictive model training simultaneously. Specifically, we present a unifed framework which jointly optimizes the ground-truth labeling confdences, similarity graph and model parameters to achieve strong generalization performance. Extensive experiments show that PL-AGGD performs favorably against stateof-the-art partial label learning approaches. @inproceedings{kdd19dbwang,
  author = {Deng-Bao Wang and Li Li and Min-Ling Zhang},
  title = {Adaptive Graph Guided Disambiguation for Partial Label Learning},
  booktitle = {Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA},
  pages = {83--91},
  year = {2019}
  }


• Multi-View Multi-Label Learning with View-Specific Information Extraction.
  X. Wu, Q.-G. Chen, Y. Hu, D.-B. Wang, X. Chang, X. Wang, M.-L. Zhang.
  In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China.
  
   IJCAI 2019    Abstract    Paper    Bibtex  
  
  Multi-view multi-label learning serves an important framework to learn from objects with diverse representations and rich semantics. Existing multi-view multi-label learning techniques focus on exploiting shared subspace for fusing multiview representations, where helpful view-specific information for discriminative modeling is usually ignored. In this  paper , a novel multi-view multi-label learning approach named SIMM is proposed which leverages shared subspace exploitation and view-specific information extraction. For shared subspace exploitation, SIMM jointly minimizes confusion adversarial loss and multi-label loss to utilize shared information from all views. For view-specific information extraction, SIMM enforces an orthogonal constraint w.r.t. the shared subspace to utilize view-specific discriminative information. Extensive experiments on real-world data sets clearly show the favorable performance of SIMM against other state-of-the-art multi-view multi-label learning approaches @inproceedings{ijcai19jhwu,
  author = {Xuan Wu and Qing-Guo Chen and Yao Hu and Deng-Bao Wang and Xiaodong Chang and Xiaobo Wang and Min-Ling Zhang},
  title = {Multi-View Multi-Label Learning with View-Specific Information Extraction},
  booktitle = {Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China},
  pages = {3884--3890},
  year = {2019}
  }

Honors

• National Scholarship for First-Year PhD Students   2019

• Outstanding Graduates, Southwest University   2019

• National Scholarship   2018

• Merit Student Award, Southwest University   2018

• First Class Academic Scholarship, Southwest University   2016, 2017, 2018

Academic Services

• PC Member for ICML (2022), IJCAI(2022), AAAI (2022, 2021), ECML/PKDD (2022), ACML (2021), ICMLA (2021), IAAI (2022, 2021).

• Invited Journal Reviewer for IEEE TPAMI, ACM TIST, ACM TKDD, IEEE TMM, JCST, Neurocomputing.