-
PodGPT Research: It is surprising to see that leveraging Podcasts into Large Language Models (LLMs) significantly boosts its ability to process medical information, making it an invaluable tool for education and research [1, 2].
-
Image Quality Assessment Research: Mimicking the long-dependency perception of Human Visual System, the Non-local Modeling enhances image quality assessment [1].
-
EEG Research: By cooperating with the functional topological relationship of electrodes, the decoding performance of raw EEG signals is improved [1, 2].
Source codes of all my works will be shared on GitHub, the trained models and datasets will be released on 🤗 Hugging Face, and some of my applied research on Vision and Language will be developed as Web or Android/iOS mobile apps.
Boston University: mostly Multimodal Foundation Models and Generative AI research
Topic 1: Large Language Models (LLMs):
- 🔥 𝐁𝐞𝐧𝐜𝐡𝐦𝐚𝐫𝐤 𝐃𝐚𝐭𝐚𝐬𝐞𝐭 - GSM8K-Consistency Benchmark (available on 🤗 Hugging Face)
- 🔨 𝐓𝐨𝐨𝐥𝐤𝐢𝐭 - PromptCraft: A Prompt Perturbation Toolkit and the released PyPI Package
- 🧰 𝐂𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧𝐬 - Quantized Large Language Models (available on 🤗 Hugging Face)
- 📚 𝐏𝐚𝐩𝐞𝐫 𝐒𝐮𝐫𝐯𝐞𝐲 - Awesome LLM Self-Consistency
- 📚 𝐏𝐚𝐩𝐞𝐫 𝐒𝐮𝐫𝐯𝐞𝐲 - Awesome Semantic Textual Similarity (STS)
Topic 2: Large Multimodal Models (LMMs/MM-LLMs): We will gradually deploy all our Multimodal Foundation Models on our PodGPT platform.
- 🚀 𝐒𝐨𝐟𝐭𝐰𝐚𝐫𝐞 - 𝐏𝐨𝐝𝐆𝐏𝐓 𝐎𝐧𝐥𝐢𝐧𝐞 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦 and our preprint are available online!
- 📚 𝐏𝐚𝐩𝐞𝐫 𝐒𝐮𝐫𝐯𝐞𝐲 - Awesome Large Vision-Language Model (LVLM/MM-LLM)
- 📚 𝐏𝐚𝐩𝐞𝐫 𝐒𝐮𝐫𝐯𝐞𝐲 - Awesome Mixture of Experts (MoE)
Topic 3: Evidence-based Medicine (EBM):
- 📚 𝐏𝐚𝐩𝐞𝐫 𝐒𝐮𝐫𝐯𝐞𝐲 - Awesome Evidence-based Medicine
Topic 4: Medical Imaging with AI:
- 🖼️ 𝐎𝐧𝐥𝐢𝐧𝐞 𝐌𝐑𝐈 𝐈𝐦𝐚𝐠𝐢𝐧𝐠 𝐕𝐢𝐬𝐮𝐚𝐥𝐢𝐳𝐞𝐫 - Online MRI Imaging Visualizer (based on Papaya)
- 🖼️ 𝐎𝐧𝐥𝐢𝐧𝐞 𝐂𝐓 𝐒𝐜𝐚𝐧 𝐕𝐢𝐬𝐮𝐚𝐥𝐢𝐳𝐞𝐫 - Online CT Scan Visualizer (based on Papaya)
City University of Hong Kong: mostly Computer Vision research
- 𝐍𝐨𝐧-𝐥𝐨𝐜𝐚𝐥 𝐌𝐨𝐝𝐞𝐥𝐢𝐧𝐠 - Non-local Modeling for Image Quality Assessment
- 𝐍𝐨𝐧-𝐥𝐨𝐜𝐚𝐥 𝐌𝐨𝐝𝐞𝐥𝐢𝐧𝐠 - Context-aware Non-local Compensation for Image Quality Assessment
Northeast Electric Power University: mostly Deep Learning research
- 🔥 𝐋𝐢𝐛𝐫𝐚𝐫𝐲 - EEG Deep Learning Library
- 𝐒𝐜𝐨𝐮𝐭 𝐄𝐒𝐈 𝐚𝐧𝐝 𝐂𝐍𝐍 - EEG Motor Imagery Signals Classification via CNN
- 𝐒𝐨𝐧𝐚𝐫 𝐈𝐦𝐚𝐠𝐞 𝐒𝐞𝐠𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧 - Sonar Image Segmentation via Entropy Method → 𝗣𝗮𝘁𝗲𝗻𝘁
Others: