通用大语言模型及垂域多模态大模型

• 通用大规模语言模型 - 伶荔（Linly）
  • CSL: A Large-scale Chinese Scientific Literature Dataset (COLING 2022) [paper][code]
  • TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (ACL 2023) [paper][code]
  • Dynamic data sampler for cross-language transfer learning in large language models (ICASSP 2024)[paper][code]
• 人脸图文匹配基础模型
  • FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training (ACM MM 2024) [paper][code]
  • Talk2Face: A Unified Sequence-based Framework for Diverse Face Generation and Analysis Tasks (ACM MM 2022) [paper][code]
• 腹部多器官分割多模态大模型

通用深度学习理论

• 新型网络架构、特征提取模块提升CNN 性能；提出小波卷积层代替下采样池化及上采样模块，解决高低频信号混叠问题。
  • WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classification (IEEE TIP 2021) [paper]
  • Wavelet Integrated CNNs for Noise-Robust Image Classification (CVPR 2020) [paper] [code]
  • Neuron segmentation using 3D wavelet integrated encoder–decoder network (Bioinformatics) 38(3), 2022, 809–817 [paper][code]
• 结合手工特征，引导网络早期的快速收敛。
  • Adaptive Weighting of Hand-crafted Feature Losses for Facial Expression Recognition (IEEE TCYB 2021) [paper] [project]
• 设计了忆阻模糊深度学习系统，以在低精度的设备条件下提高图像识别精度。以及基于忆阻的量化深度学习网络结构，从而加快训练速度和减小存储空间。
  • Memristive Fuzzy Deep Learning Systems (IEEE TFS 2021) [paper]
  • Memristive Quantized Neural Networks A Novel Approach to Accelerate Deep Learning On-Chip (IEEE TCYB 2021) [paper]
• 特征的自适应分组抑制、激活与基于特征密度的失活算法
  • Group-wise Inhibition based Feature Regularization for Robust Classification (ICCV 2021) [paper] [project] [code]
  • Group-Wise Dynamic Dropout Based on Latent Semantic Variation (AAAI 2020) [paper] [project]
• 通过特征的对抗攻击提升针对开放场景的有效性，并将噪声隐藏在高频区域提升不可察觉性
  • Frequency-driven Imperceptible Adversarial Attack on Semantic Similarity (CVPR 2022) [paper] [code]

弱监督物体检测/语义分割

• 基于图像类别标签的物体检测网络、语义分割网络，减少通用物体检测/分割网络对标注数据的要求。研究如何利用大规模预训练模型减少网络对训练数据的要求，在零样本开放数据上依然能够取得良好性能。
  • Geometry Constrained Weakly Supervised Object Localization (ECCV 2020) [paper][code]
  • CLIMS: Cross Language Image Matching for Weakly Supervised Semantic Segmentation (CVPR 2022) [paper] [project] [code]
  • CCAM: Contrastive learning of Class-agnostic Activation Map for Weakly Supervised Object Localization and Semantic Segmentation (CVPR 2022) [paper] [project] [code]
  • QA-CLIMS: Question-Answer Cross Language Image Matching for Weakly Supervised Semantic Segmentation (ACMMM 2023) [paper] [code]
• 基于Transformer的文本检测
  • Self-attention based Text Knowledge Mining for Text Detection (CVPR 2021) [paper][code]
• 基于场景一致性表示学习的视频场景分割
  • Scene Consistency Representation Learning for Video Scene Segmentation (CVPR 2022) [paper] [project]

人脸识别/分析

基于深度卷积网络的人脸识别、表情、年龄等属性识别方法及系统，基于人脸视频的个体性格、抑郁等心理情绪预测。开发的人脸识别系统在深圳高交会、双创周、杭州G20和新疆安防广泛使用。

• 二维人脸识别，集成统一阈值的损失函数
  • UniFace: Unified Cross-Entropy Loss for Deep Face Recognition (ICCV 2023) [paper] [code]
• 二维人脸识别，集成统一阈值的样本间损失函数
  • UniTSFace: Unified Threshold Integrated Sample-to-Sample Loss for Face Recognition (NeurIPS 2023)[paper][coder]
• 基于人脸时域变化特征提取与学习的抑郁、性格分析，基于个体人脸反应生成网络的性格分析
  • Self-supervised Learning of Person-specific Facial Dynamics for Automatic Personality Recognition (IEEE TAFC 2021) [paper]
  • Spectral Representation of Behaviour Primitives for Depression Analysis (IEEE TAFC 2020) [paper] [code]
  • Personality Recognition by Modelling Person-specific Cognitive Processes using Graph Representation (ACM MM 2021) [paper] [code]
• 三维人脸点云识别与表情
  • Orthogonalization Guided Feature Fusion Network for Multimodal 2D+3D Facial Expression Recognition (IEEE TMM 2021) [paper]
• 二维人脸表情识别与分析、合成
  • Triplet loss with multistage outlier suppression and class-pair margins for facial expression recognition (IEEE TCSVT 2022) [paper] [project]
  • A Novel Transient Wrinkle Detection Algorithm and Its Application for Expression Synthesis (IEEE TMM 2017) [paper] [project]
  • Surrogate Network-based Sparseness Hyper-parameter Optimization for Deep Expression Recognition (Pattern Recognition 2021) [paper] [project]
  • Sparse deep feature learning for facial expression recognition (Pattern Recognition 2019) [paper] [project]
• 基于多维边缘特征的面部运动单元的关系图学习以及动作单元的识别应用
  • Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition (IJCAI 2022) [paper] [code]

人脸生成与属性编辑

• 基于图像翻译的人脸属性编辑
  • AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation (IEEE TMM 2022) [paper]
  • Translate the Facial Regions You Like Using Self-Adaptive Region Translation (AAAI 2021) [paper]
  • GazeFlow: Gaze Redirection with Normalizing Flows (IJCNN 2021) [paper][code] [demo]
  • Gated SwitchGAN for multi-domain facial image translation (IEEE TMM 2021) [paper]
  • Deep Feature Consistent Variational Autoencoder (WACV 2017) [paper] [project] [code]
• 基于预训练模型的人脸属性编辑
  • Lifelong Age Transformation with a Deep Generative Prior (IEEE TMM 2022) [paper] [project]
  • Guidedstyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editing (Neural Networks 2022) [paper] [project]
  • SSFlow: Style-guided Neural Spline Flows for Face Image Manipulation (ACM MM 2021) [paper]
• 基于文本的人脸生成与编辑
  • TextFace: Text-to-Style Mapping based Face Generation and Manipulation (IEEE TMM 2022) [paper] [project]
• 亲子关系人脸合成
  • StyleGene: Crossover and Mutation of Region-Level Facial Genes for Kinship Face Synthesis (CVPR2023 Highlight 2.6%) [paper] [project]

医学图像智能分析

• 细胞检测、分割与分类
  • Sample hardness based gradient loss for long-tailed cervical cell detection (MICCAI 2022) [code]
  • Deep Cross Residual Network for HEp2 Cell Staining Pattern Classification (Pattern Recognition 2018) [paper]
  • HEp-2 Specimen Image Segmentation and Classification Using Very Deep Fully Convolutional Network (IEEE TMI 2017) [paper]
• 肺部影像智能分析
  • A Self-supervised Feature-standardization-block for Cross-domain Lung Disease Classification (Methods 2022) [paper]
  • Learning from Pseudo Lesion: A Self-supervised Framework for COVID-19 Diagnosis (Neural Computing and Applications 2022) [paper]
  • Multi-resolution convolutional networks for chest X-ray radiograph based lung nodule detection (Artificial Intelligence in Medicine 2020) [paper]
  • A Solitary Feature-based Lung Nodule Detection Approach for Chest X-Ray Radiographs (IEEE JBHI 2018 封面亮点) [paper]
• 大脑神经元分割重建
  • Deep learning based neuronal soma detection and counting for Alzheimer's disease analysis (Computer Methods and Programs in Biomedicine 2021) [paper]
  • 3D Neuron Reconstruction in Tangled Neuronal Image with Deep Networks (IEEE TMI 2020) [paper]
• 病理图片细胞分割与分析
  • Instance-aware Self-supervised Learning for Nuclei Segmentation (MICCAI 2020) [paper]
  • MI2GAN: Generative Adversarial Network for Medical Image Domain Adaptation using Mutual Information Constraint (MICCAI 2020) [paper]
  • Reverse active learning based atrous DenseNet for pathological image classification (BMC Bioinformatics 2019) [paper]
• 皮肤病变区域分割
  • Dense Encoder-Decoder–Based Architecture for Skin Lesion Segmentation (Cognitive Computation 2021) [paper]
  • Skin lesion analysis towards melanoma detection using deep learning network (Sensors 2018 ESI高被引论文) [paper]
• B超图像甲状腺结节分割
  • Boundary Regression based deep neural network for thyroid nodule segmentation in ultrasound images (Neural Computing and Applications 2022)
• 眼部OCT图像分析
  • Deep Learning Based Early Stage Diabetic Retinopathy Detection Using Optical Coherence Tomography (Neurocomputing 2019) [paper]