Skip to content

Commit

Permalink
Reduce logging in tokenizer.py
Browse files Browse the repository at this point in the history
  • Loading branch information
rprtr258 committed Mar 8, 2019
1 parent 4015bb2 commit 8c3d951
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion tokenizers/block-level/tokenizer.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,6 @@ def tokenize_files(file_string, comment_inline_pattern, comment_open_close_patte
return (final_stats, final_tokens, [s_time, t_time, hash_time, re_time])

def tokenize_blocks(file_string, comment_inline_pattern, comment_open_close_pattern, separators, logging, file_path):
logging.info('Starting tokenize_blocks of %s' % (file_path))
# This function will return (file_stats, [(blocks_tokens,blocks_stats)], file_parsing_times]
final_stats = 'ERROR'
final_tokens = 'ERROR'
Expand Down

0 comments on commit 8c3d951

Please sign in to comment.