A collection of machine learning and AI notebooks to use as reference or tools to solve complex issues, or to just serve as a reminder when performing common tasks.
This collection of notebooks was created using the Jupyterlab + Spark docker container.
Docker - jupyter/pyspark-notebook
docker pull jupyter/pyspark-notebook
| Subject | Title | Description | Link |
|---|---|---|---|
| environment | How To Setup Jupyter Labs w/Spark Docker Container | This notebook serves as a reminder/summarized guide demonstrating how to setup a Jupyter Labs Pyspar... | notebooks/environment/setup-jupyterlabs-spark.ipynb |
| nlp | Getting Started With BART - 101 | A quick demo showing how to implement a hugging face text summarization module.... | notebooks/nlp/huggingface/howto-BART-intro.ipynb |
| nlp | Identify Conflicting Context Rules | In this example, spaCy is used with the en_ner_bc5cdr_md corpus to extract named entities from a str... | notebooks/nlp/spaCy/howto-conflicting_context_modifiers.ipynb |
| nlp | Creating A Context Rule w/medspaCy Context Pipeline. | In this example, spaCy is used with the en_ner_bc5cdr_md corpus to extract named entities from a str... | notebooks/nlp/spaCy/howto-context_modifiers.ipynb |
| nlp | Using Custom Tokenizer (not spaCy tokenizer) with spaCy | This example demonstrates how to use a tokenizer from HF. Pretrained models can be used as well. The... | notebooks/nlp/spaCy/howto-custom_tokenizer_huggingface.ipynb |
| nlp | Section Detection Using Medspacy | This example demonstreates how find sections based on regex pattern (not medspacy related) and dynam... | notebooks/nlp/spaCy/howto-section_detection.ipynb |
| nlp | Serializing Context Rules For Use w/medspaCy Context Pipeline. | This example demonstreates how to serialize a set of context rules to be used later.... | notebooks/nlp/spaCy/howto-serializing_context_modifiers.ipynb |