Deep Cognition and Language Research (DeCLaRe) Lab

All

63 repositories

Emma-X
Public
Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
robotics agents vla vlm embodied-artificial-intelligence embodied-agent embodied-ai llm chain-of-thought embodied-intelligence
Python
•1•15•0•0•Updated Dec 21, 2024Dec 21, 2024
PROVE
Public
Python
•0•2•0•0•Updated Dec 18, 2024Dec 18, 2024
safety-arithmetic
Public
Jupyter Notebook
•4•10•0•0•Updated Dec 17, 2024Dec 17, 2024
LLM-PuzzleTest
Public
This repository is maintained to release dataset and models for multimodal puzzle reasoning.
gemini language-model multimodal-learning multimodal-deep-learning gpt-4 large-language-models llm llms gemini-pro
Python
•4•46•1•0•Updated Nov 24, 2024Nov 24, 2024
LLM-ReasoningTest
Public
Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions
reasoning humaneval gsm8k
Python
•
Apache License 2.0
•0•6•0•0•Updated Oct 29, 2024Oct 29, 2024
trust-align
Public
Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse
rag retrieval-augmented-generation
Python
•
Other
•2•29•0•0•Updated Oct 11, 2024Oct 11, 2024
declare-lab.github.io
Public
JavaScript
•
MIT License
•0•0•0•8•Updated Sep 24, 2024Sep 24, 2024
ferret
Public
Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique
red-teaming llm safety-alignment
Python
•
Other
•2•11•0•0•Updated Aug 22, 2024Aug 22, 2024
Sealing
Public
[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"
multimodality video-understanding video-question-answering visual-language-models naacl2024
Python
•
MIT License
•3•9•0•0•Updated Jul 25, 2024Jul 25, 2024
della
Public
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
transformer huggingface llm llms model-merging
Python
•2•28•0•0•Updated Jul 12, 2024Jul 12, 2024
tango
Public
A family of diffusion models for text-to-audio generation.
language-models diffusion diffusion-models text-to-audio audio-generation large-language-models
Python
•
Other
•93•1.1k•26•0•Updated Jul 3, 2024Jul 3, 2024
RobustMIFT
Public
[Arxiv 2024] Official Implementation of the paper: "Towards Robust Instruction Tuning on Multimodal Large Language Models"
instruction-following large-language-models llm multimodal-instruction-tuning multimodal-large-language-models llm-robustness
Jupyter Notebook
•
MIT License
•1•8•0•0•Updated Jun 22, 2024Jun 22, 2024
MM-InstructEval
Public
This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimodal content comprehension tasks.
multimodal-large-language-models multimodal-content-comprehension-tasks
Python
•1•26•0•0•Updated May 2, 2024May 2, 2024
HyperTTS
Public
Python
•
MIT License
•2•34•0•0•Updated Apr 15, 2024Apr 15, 2024
resta
Public
Restore safety in fine-tuned language models through task arithmetic
alignment safety alignment-algorithm llm llms llm-safety llms-benchmarking llm-safety-benchmark
Python
•1•26•0•0•Updated Mar 28, 2024Mar 28, 2024
adapter-mix
Public
Python
•4•15•2•0•Updated Mar 14, 2024Mar 14, 2024
MM-Align
Public
[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"
machine-learning natural-language-processing optimal-transport multimodal-sentiment-analysis multimodal-deep-learning
Python
•
MIT License
•3•26•0•0•Updated Mar 10, 2024Mar 10, 2024
MELD
Public
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
sentiment-analysis chatbot dialogue-systems personality-profiling personality-traits conversational-ai multimodal-interactions multimodal-sentiment-analysis emotion-recognition-in-conversation dialogue
Python
•
GNU General Public License v3.0
•206•843•30•0•Updated Mar 10, 2024Mar 10, 2024
instruct-eval
Public
This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
llm instruct-tuning
Python
•
Apache License 2.0
•43•534•22•2•Updated Mar 10, 2024Mar 10, 2024
conv-emotion
Public
This repo contains implementation of different architectures for emotion recognition in conversations.
natural-language-processing sentiment-analysis memory-network pretrained-models emotion-analysis dialogue-systems conversational-agents natural-language-understanding conversational-ai emotion-recognition-in-conversation
Python
•
MIT License
•335•1.4k•7•1•Updated Mar 10, 2024Mar 10, 2024
red-instruct
Public
Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
llama huggingface-transformers llm llms llama2
Python
•
Apache License 2.0
•12•86•1•0•Updated Mar 8, 2024Mar 8, 2024
awesome-emotion-recognition-in-conversations
Public
A comprehensive reading list for Emotion Recognition in Conversations
natural-language-processing dialogue-systems conversational-ai multimodal-interactions multimodal-deep-learning emotion-recognition-in-conversation emotion-recognition
43•264•1•1•Updated Feb 6, 2024Feb 6, 2024
.github
Public
0•0•0•0•Updated Feb 1, 2024Feb 1, 2024
mustango
Public
Mustango: Toward Controllable Text-to-Music Generation
Python
•
MIT License
•29•0•0•0•Updated Nov 23, 2023Nov 23, 2023
Video2Music
Public
Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model
Python
•21•1•0•0•Updated Nov 7, 2023Nov 7, 2023
LG-VQA
Public
Python
•1•7•2•0•Updated Nov 3, 2023Nov 3, 2023
flacuna
Public
Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.
transformer llama large-language-models
Python
•3•111•4•0•Updated Sep 10, 2023Sep 10, 2023
kingdom
Public
Domain Adaptation using External Knowledge for Sentiment Analysis
deep-neural-networks deep-learning sentiment-analysis opinion-mining adversarial-networks adversarial-learning domain-adaptation
Python
•14•55•1•2•Updated Jul 6, 2023Jul 6, 2023
CASCADE
Public
This repo contains code to detect sarcasm from text in discussion forum using deep learning
reddit deep-learning tensorflow lstm tweets sarcasm-detection stylometric-features user-embeddings
Python
•47•86•1•3•Updated Jul 6, 2023Jul 6, 2023
flan-alpaca
Public
This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.
transformers language-model alpaca llm flan-t5
Python
•
Apache License 2.0
•38•349•8•0•Updated Jul 4, 2023Jul 4, 2023