Skip to content

Commit

Permalink
docs: Remove comment
Browse files Browse the repository at this point in the history
  • Loading branch information
saattrupdan committed Dec 21, 2022
1 parent b05fdbb commit c22d02b
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions src/scandi_reddit/postprocess.py
Original file line number Diff line number Diff line change
Expand Up @@ -53,9 +53,7 @@ def postprocess(path: Union[str, Path], suffix: str = "-postprocessed") -> None:

# Remove the inappropriate comments
prev_count = len(corpus)
banned_subreddits = get_banned_subreddits(
corpus.subreddit.unique()
) # NSFW_SUBREDDITS + DRUG_SUBREDDITS
banned_subreddits = get_banned_subreddits(corpus.subreddit.unique())
corpus = corpus[~corpus.subreddit.isin(banned_subreddits)]
logger.info(f"Removed {prev_count - len(corpus):,} inappropriate comments.")

Expand Down

0 comments on commit c22d02b

Please sign in to comment.