Skip to content

SeRViz: an Interactive Visualization Framework for the Analysis of Sequential Rules and Frequent Itemsets

License

Notifications You must be signed in to change notification settings

asaljalilvand/SeRViz

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SeRViz

An Interactive Visualization Framework for the Analysis of Sequential Rules and Frequent Itemsets

Generic badge Generic badge Generic badge Generic badge

🏫 This project is part of a Masters thesis in the Visual Analytics and Visualization (VAV) lab is part of the Faculty of Computer Science, Dalhousie University, Canada.
📙 View on DalSpace library
📹 Video demo of a use case

Description

Objective

  • Finding delay-related patterns affecting turnaround performance
  • Reducing the cognitive load of exploration of the mined patterns by means of visual analytics

Dataset

This project was originally developed using a log of ground handling operations at at Halifax Stanfield International Airport collected by Assaia Apron AI.

For showing that the proposed framework can be used in other domains as well, we also used a dataset of chronic diseases. This dataset is collected by the Flaredown application and is publicly available at Kaggle.

Methodology

  • Using data mining (sequential rules and frequent itemsets)
  • Visualization of patterns with a novel matrix-based approach

🌱 The main contribution of this work is a novel approach for visualizing sequential rules w.r.t. to the partial order of antecedents and consequents.

Evaluation

  1. Domain expert feedback on visual prototype
  2. User test
    • Two sets of analytical tasks

      • Similar questions
      • Different tools
        • text vs. visual prototype
    • NASA-TLX for measuring workload of each set of tasks

    • Are difference in averages statistically significant?

      • Paired t-test
        • (alternative) hypothesis: the true mean difference between the paired samples is not equal to zero
    • Analytical tasks to assess if the users can successfully use all features

Result

SeRViz is a novel visual analytics tool for mining and exploring frequent patterns. Based on our experiments it reduces the cognitive load of users for the said tasks compared to the popular off-the-shelf data mining tool, SPMF.

Features

Data filtering, pattern mining and pattern overview

👩‍🏫 Tutorial SeRViz Mining, filtering and overview

Sequential rules matrix

👩‍🏫 Tutorial SeRViz Sequential rule matrix

Distribution analysis and detail-on-demand

👩‍🏫 Tutorial SeRViz distribution analysis and breakdown

Frequent itemsets matrix

👩‍🏫 Tutorial SeRViz frequent itemsets

Run

cd server
pip install -r requirements.txt
python main.py

👉 Since this project uses SPMF library, you need have Java installed. An instance of SPMF v2.42c is located at server/pattern_mining/mining/thirdparty/spmf.jar (uploaded since it is required for live demo on Heroku).

Dash

Generic badge Generic badge Generic badge

We developed a low-fidelity prototype in early stages of visual design using dash. The dashboard is located at server/mining/quick_dashboard.py.

Acknowledgment

This research was enabled in part by support provided by and DeepSense 🌊 and Halifax Stanfield International Airport:airplane:.

Citation

Asal Jalilvand. SeRViz: an Interactive Visualization Framework for the Analysis of Sequential Rules and Frequent Itemsets. Master's thesis, Dalhousie University, Halifax, NS, Canada, 2021.

License

⚖️ GPL-3.0 License

About

SeRViz: an Interactive Visualization Framework for the Analysis of Sequential Rules and Frequent Itemsets

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published