Skip to content

Commit

Permalink
Re-title and re-format headings
Browse files Browse the repository at this point in the history
  • Loading branch information
glmack committed Sep 8, 2019
1 parent 3221aeb commit 384f6a1
Showing 1 changed file with 9 additions and 9 deletions.
18 changes: 9 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,25 +1,25 @@
# review_test_classifier
This project predicts multi-class customer sentiment using text features from labelled customer reviews of restaurants from Yelp and Google.
## Epicurater
Epicurater predicts multi-class customer sentiment using text features from labelled customer reviews of restaurants from Yelp and Google.

Business understanding
### **Business understanding**
Predictive insights of customer-related metrics can help retail establishments make decisions that improve customer experience. However, the quality of customer predictions require text data that correctly expresses the heterogeneity and salient points of customer voices in natural language, as well as performance optimization across different algorithmic options.

Data understanding
### **Data understanding**
Customer reviews for this project were sourced from: 1) an aggregated subset of seven million Yelp customer reviews made available by Yelp as a set of downloadable JSON files, as well as 2) three hundred test customer reviews queried from the Places API of Google. For project purposes, the data was stored in, and queried from, a MongoDB database.

Data preparation
### **Data preparation**
Raw strings of customer reviews were extracted, processed and represented to models through a bag-of-words approach under a variety of alternate specifications using the Scikit-learn library. Specifications of parameters included, e.g.:
1) alternative tokenization strategies using:
a) only unigrams, b) only bigrams, and c) combined unigram and bigrams,
2) dimensionality reduction techniques that included ANOVA F-scores,
3) vectorization techniques using term-frequency inverse document frequency (TFIDF) algorithms.
The prediction target comprised three classes representing positive, neutral and negative customer sentiment, which we created by aggregating customer-defined scores on a 1 to 5 basis, where out positive sentiment class = user score of 5, neutral sentiment class = score of 4, and negative sentiment class = scores of 1, 2, or 3.

Modeling
The basic modelling task for this project was multi-class classification using text features. Models tested included logistic regression, support vector machines, and boosting ensemble models from the XG boost library.
## **Modeling**
The basic modelling task was multi-class classification using text features. Models tested included logistic regression, support vector machines, and boosting ensemble models from the XG boost library.

Evaluation
## **Evaluation**
We evaluate model performance and associated parameter specifications using log loss and accuracy score metrics. The test set evaluation results for the initial top-performing model, a logistic regression classifier, was 0.75, and the log loss was 0.56.

Deployment
## **Deployment**
We deployed the top performing model through a flask app for the purpose of basic user testing.

0 comments on commit 384f6a1

Please sign in to comment.