Enhancing-Generative-AI-Chatbot-Accuracy-Using-Knowledge-Graph.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ji09xLvKqBBd"
      },
      "source": [
        "<p> ################################################################## </p>\n",
        "<p>#&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;#\n",
        "<p> # This source code is adopted from Tomaz and modified for NWMSU chatbot application  &nbsp; #</p>\n",
        "<p>#&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;#\n",
        "<p></p>\n",
        "<p></p>\n",
        "<p> ################################################################## </p>\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zqgaHIIWAv0E"
      },
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "y8W6QNR3xzEO",
        "outputId": "6bf4d67b-e29e-450f-9f76-73b1d5d5dd92"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Mounted at /content/gdrive\n",
            "/content/gdrive/My Drive\n"
          ]
        }
      ],
      "source": [
        "from google.colab import drive\n",
        "\n",
        "drive.mount('/content/gdrive')\n",
        "\n",
        "%cd gdrive/My Drive"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_5jQBSpUA1YJ"
      },
      "source": [
        "Requirements:\n",
        "\n",
        "1. **LangChain**: A framework for developing applications powered by language models.\n",
        "2. **LangChain-Community**: A collaborative space for sharing resources, tools, and discussions related to LangChain.\n",
        "3. **LangChain-OpenAI**: A LangChain extension providing integration with OpenAI's language models.\n",
        "4. **LangChain-Experimental**: A repository for experimental features and prototypes within the LangChain ecosystem.\n",
        "5. **Neo4j**: A graph database management system designed for handling and querying connected data.\n",
        "6. **tiktoken**: A library for tokenizing text, commonly used with language models to preprocess input and output.\n",
        "7. **yfiles_jupyter_graphs**: A library for creating and visualizing graphs and network diagrams in Jupyter notebooks.\n",
        "8. **Streamlit**: An open-source framework for building interactive, web-based applications using Python.\n",
        "9. **Localtunnel**: A tool that allows you to expose your local web server to the internet via a secure tunnel."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "_e8mFtjUpsf-",
        "outputId": "4d1cbb3d-659a-4597-b1f4-813f200bf412"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m974.0/974.0 kB\u001b[0m \u001b[31m4.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.2/2.2 MB\u001b[0m \u001b[31m29.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m199.7/199.7 kB\u001b[0m \u001b[31m15.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m203.0/203.0 kB\u001b[0m \u001b[31m18.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25h  Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
            "  Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
            "  Installing backend dependencies ... \u001b[?25l\u001b[?25hdone\n",
            "  Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.1/1.1 MB\u001b[0m \u001b[31m45.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m15.5/15.5 MB\u001b[0m \u001b[31m43.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m8.6/8.6 MB\u001b[0m \u001b[31m58.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m314.7/314.7 kB\u001b[0m \u001b[31m30.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m124.9/124.9 kB\u001b[0m \u001b[31m13.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m325.5/325.5 kB\u001b[0m \u001b[31m30.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m139.4/139.4 kB\u001b[0m \u001b[31m15.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m207.3/207.3 kB\u001b[0m \u001b[31m21.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.9/6.9 MB\u001b[0m \u001b[31m65.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m83.0/83.0 kB\u001b[0m \u001b[31m9.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m49.2/49.2 kB\u001b[0m \u001b[31m6.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m62.7/62.7 kB\u001b[0m \u001b[31m6.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.3/2.3 MB\u001b[0m \u001b[31m86.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m53.0/53.0 kB\u001b[0m \u001b[31m6.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m142.5/142.5 kB\u001b[0m \u001b[31m17.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m75.6/75.6 kB\u001b[0m \u001b[31m8.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m77.9/77.9 kB\u001b[0m \u001b[31m8.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m58.3/58.3 kB\u001b[0m \u001b[31m6.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.6/1.6 MB\u001b[0m \u001b[31m60.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25h  Building wheel for neo4j (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n"
          ]
        }
      ],
      "source": [
        "%pip install --upgrade --quiet  langchain langchain-community langchain-openai langchain-experimental neo4j tiktoken yfiles_jupyter_graphs streamlit"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "EKRc3oenyXvO",
        "outputId": "76dffc2a-99df-4de7-f6d1-2687cbacb609"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "\u001b[K\u001b[?25h\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m \u001b[0m\u001b[35msaveError\u001b[0m ENOENT: no such file or directory, open '/content/gdrive/MyDrive/package.json'\n",
            "\u001b[0m\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m \u001b[0m\u001b[35menoent\u001b[0m ENOENT: no such file or directory, open '/content/gdrive/MyDrive/package.json'\n",
            "\u001b[0m\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m\u001b[35m\u001b[0m MyDrive No description\n",
            "\u001b[0m\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m\u001b[35m\u001b[0m MyDrive No repository field.\n",
            "\u001b[0m\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m\u001b[35m\u001b[0m MyDrive No README data\n",
            "\u001b[0m\u001b[37;40mnpm\u001b[0m \u001b[0m\u001b[30;43mWARN\u001b[0m\u001b[35m\u001b[0m MyDrive No license field.\n",
            "\u001b[0m\n",
            "+ localtunnel@2.0.2\n",
            "updated 1 package and audited 36 packages in 28.899s\n",
            "\n",
            "3 packages are looking for funding\n",
            "  run `npm fund` for details\n",
            "\n",
            "found 2 \u001b[93mmoderate\u001b[0m severity vulnerabilities\n",
            "  run `npm audit fix` to fix them, or `npm audit` for details\n",
            "\u001b[K\u001b[?25h"
          ]
        }
      ],
      "source": [
        "!npm install localtunnel"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LQtND_fzFRNI"
      },
      "source": [
        "The provided code imports several components from different libraries, each serving a specific purpose. The `RunnableBranch`, `RunnableLambda`, `RunnableParallel`, and `RunnablePassthrough` from LangChain Core are utilities for creating complex workflows involving branching logic, function definitions, parallel execution, and straightforward data passing. For crafting prompts, `ChatPromptTemplate` and `PromptTemplate` are used to design structured inputs for language models.\n",
        "\n",
        "The `BaseModel` and `Field` from Pydantic assist in data validation and configuration, while typing utilities like `Tuple`, `List`, and `Optional` are used for type hinting in Python code. The message classes `AIMessage` and `HumanMessage` define interactions between an AI and a user. The `StrOutputParser` is employed for converting outputs into string format.\n",
        "\n",
        "The `os` module provides a way to interact with the operating system, and `Neo4jGraph` facilitates working with Neo4j databases. `TokenTextSplitter` helps in breaking down text into manageable tokens, essential for language processing. `ChatOpenAI` enables communication with OpenAI's chat models, and `LLMGraphTransformer` is used for transforming graph data with language models. For database interaction, `GraphDatabase` connects with Neo4j, and `GraphWidget` allows for the creation and visualization of graphs in Jupyter notebooks.\n",
        "\n",
        "Further, `Neo4jVector` supports storing and retrieving embeddings in Neo4j, while `OpenAIEmbeddings` provides tools for generating embeddings from OpenAI models. The `remove_lucene_chars` function cleans text by removing specific characters, ensuring data is properly formatted for Neo4j. Lastly, `ConfigurableField` allows for configurable data fields within a runnable, aiding in the customization of workflows."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "n5jFoh3cqFfH"
      },
      "outputs": [],
      "source": [
        "# %%writefile main.py\n",
        "\n",
        "from langchain_core.runnables import (\n",
        "    RunnableBranch,\n",
        "    RunnableLambda,\n",
        "    RunnableParallel,\n",
        "    RunnablePassthrough,\n",
        ")\n",
        "from langchain_core.prompts import ChatPromptTemplate\n",
        "from langchain_core.prompts.prompt import PromptTemplate\n",
        "from langchain_core.pydantic_v1 import BaseModel, Field\n",
        "from typing import Tuple, List, Optional\n",
        "from langchain_core.messages import AIMessage, HumanMessage\n",
        "from langchain_core.output_parsers import StrOutputParser\n",
        "import os\n",
        "from langchain_community.graphs import Neo4jGraph\n",
        "from langchain.text_splitter import TokenTextSplitter\n",
        "from langchain_openai import ChatOpenAI\n",
        "from langchain_experimental.graph_transformers import LLMGraphTransformer\n",
        "from neo4j import GraphDatabase\n",
        "from yfiles_jupyter_graphs import GraphWidget\n",
        "from langchain_community.vectorstores import Neo4jVector\n",
        "from langchain_openai import OpenAIEmbeddings\n",
        "from langchain_community.vectorstores.neo4j_vector import remove_lucene_chars\n",
        "from langchain_core.runnables import ConfigurableField, RunnableParallel, RunnablePassthrough\n",
        "\n",
        "\n",
        "try:\n",
        "  import google.colab\n",
        "  from google.colab import output\n",
        "  output.enable_custom_widget_manager()\n",
        "except:\n",
        "  pass\n",
        "\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-n8hzmiPGDkr"
      },
      "source": [
        "These lines of code set environment variables for accessing the OpenAI API and a Neo4j database:\n",
        "\n",
        "- `os.environ[\"OPENAI_API_KEY\"] = \"sk-....\"` sets the API key for accessing OpenAI's services.\n",
        "- `os.environ[\"NEO4J_URI\"] = \"bolt+s://d......databases.neo4j.io:7687\"` specifies the URI for connecting to the Neo4j database.\n",
        "- `os.environ[\"NEO4J_USERNAME\"] = \"usr\"` sets the username for the Neo4j database connection.\n",
        "- `os.environ[\"NEO4J_PASSWORD\"] = \"pwd\"` sets the password for the Neo4j database connection.\n",
        "\n",
        "These environment variables are crucial for securely storing sensitive information required for connecting to external services."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "id": "u-x0sDvkzApK"
      },
      "outputs": [
        {
          "ename": "NameError",
          "evalue": "name 'os' is not defined",
          "output_type": "error",
          "traceback": [
            "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[1;31mNameError\u001b[0m                                 Traceback (most recent call last)",
            "Cell \u001b[1;32mIn[1], line 1\u001b[0m\n\u001b[1;32m----> 1\u001b[0m \u001b[43mos\u001b[49m\u001b[38;5;241m.\u001b[39menviron[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mOPENAI_API_KEY\u001b[39m\u001b[38;5;124m\"\u001b[39m] \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124msk-....................\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m      2\u001b[0m os\u001b[38;5;241m.\u001b[39menviron[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mNEO4J_URI\u001b[39m\u001b[38;5;124m\"\u001b[39m] \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mbolt+s://d...........databases.neo4j.io:7687\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m      3\u001b[0m os\u001b[38;5;241m.\u001b[39menviron[\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mNEO4J_USERNAME\u001b[39m\u001b[38;5;124m\"\u001b[39m] \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124musr\u001b[39m\u001b[38;5;124m\"\u001b[39m\n",
            "\u001b[1;31mNameError\u001b[0m: name 'os' is not defined"
          ]
        }
      ],
      "source": [
        "os.environ[\"OPENAI_API_KEY\"] = \"sk-....................\"\n",
        "os.environ[\"NEO4J_URI\"] = \"bolt+s://d...........databases.neo4j.io:7687\"\n",
        "os.environ[\"NEO4J_USERNAME\"] = \"usr\"\n",
        "os.environ[\"NEO4J_PASSWORD\"] = \"pwd\""
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "W3SvhzJ4GIM2"
      },
      "source": [
        "This instance, stored in the variable graph, can be used to interact with the Neo4j database. The Neo4jGraph class provides methods and functionalities to execute queries, retrieve data, and manipulate the graph database, facilitating seamless integration and operations within the LangChain framework."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "XwzkR_GOzArj"
      },
      "outputs": [],
      "source": [
        "graph = Neo4jGraph()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Iw1cepLUGWEM"
      },
      "source": [
        "This code snippet loads web pages from a list of URLs using the `WebBaseLoader` class from the `langchain_community.document_loaders` module:\n",
        "\n",
        "\n",
        "- **WebBaseLoader**: This class is used for loading web pages from URLs provided in a list. It likely uses web scraping techniques to retrieve the content from each URL.\n",
        "- **loader.requests_kwargs**: This line sets a keyword argument for the HTTP request made by the loader. `{'verify': False}` disables SSL certificate verification, which can be useful when dealing with self-signed certificates or testing environments.\n",
        "- **data = loader.load()**: This line executes the loading process, fetching the HTML content from the specified URLs and storing it in the `data` variable.\n",
        "\n",
        "This approach is helpful for gathering content from multiple web pages for further processing, such as natural language processing or content analysis, within the LangChain framework."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "nfpW5QoAudoX",
        "outputId": "80dfbd53-30ef-4502-bab6-d4dedad806aa"
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "WARNING:root:USER_AGENT environment variable not set, consider setting it to identify your requests.\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n",
            "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.nwmissouri.edu'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings\n",
            "  warnings.warn(\n"
          ]
        }
      ],
      "source": [
        "from langchain_community.document_loaders import WebBaseLoader\n",
        "loader = WebBaseLoader([\"https://www.nwmissouri.edu/csis/msacs/\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/about.htm\",\n",
        "                        \"https://www.nwmissouri.edu/academics/graduate/masters/applied-computer-science.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/apply/index.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/courses.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/current/projects/index.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/current/research.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/finaid.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/on-campus-employment.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/internship-and-cpt.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/orgs/index.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/FAQs.htm\",\n",
        "                        \"https://www.nwmissouri.edu/csis/msacs/contact.htm\"\n",
        "                        ])\n",
        "loader.requests_kwargs = {'verify':False}\n",
        "data = loader.load()\n",
        "# print(data)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "T4Fcg-eBv2AB",
        "outputId": "0c4fccd4-4781-4a60-a94e-3843bdc78487"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "[Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\xa0\\n\\n\\n » CSIS\\nWelcome to Masters in Applied Computer Science\\n\\n\\n\\nAt Northwest, we are dedicated towards the development of future leaders in the information technology (IT) industry. Our highly qualified faculty members collaborate and work together to educate students who come to obtain a quality education. We provide appropriate technological and instructional resources for our students to help them succeed in the IT job market worldwide. Northwest is also committed towards the personal and social development of its students by providing opportunities for our students to interact with others in a successful, ethical way.Prospective MS-ACS StudentsAdmissions information for prospective international students.MSACS on FacebookFollow the Masters in Applied Computer Science program on Facebook!\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'Northwest Missouri State University is committed to developing future leaders in the IT industry through the Masters in Applied Computer Science program.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nWhy MS-Applied Computer Science Program?\\n\\n\\n\\nThe Program\\nThe Master of Science in Applied Computer Science offers students with strong undergraduate background in a technical computing discipline an opportunity to increase their technical expertise and to complement that expertise with fundamental business concepts related specifically to information technology. The term Applied Computer Science was carefully chosen. The practical skills developed for a wide variety of high-demand areas, as well as the firm conceptual foundation provided by the program, combine to create graduates that are well-prepared to succeed in a very competitive job market.\\nThe M.S. Applied Computer Science program has a STEM CIP code 11.0701 that currently allows an extra 24 months of OPT (Optional Practical Training) extension after completion of 12 month OPT period. Visit U.S. Citizenship and Immigration Services for updates.\\nFor more details about the program, see Program Description.\\nOverview of Program, School and University\\n\\nThe average class size at Northwest is 27.\\nStudent to faculty ratio is 22 to 1.\\nBetween 75 and 375 graduate students are normally enrolled in the M.S. in Applied Computer Science program.\\nNorthwest Missouri State University is home to the Missouri Arboretum, providing a beautiful environment for all members of the university community.\\nNorthwest is considered one of the safest campuses in the nation.\\n\\nComputing Facilities\\nThe Electronic Campus gives students access to the Internet and to the Missouri Research and Education Network. Computer languages supported on the network include \\xa0Java, C#, C++, Perl, Smalltalk, Node JS, Android Studio, and Swift.\\xa0Databases include SQL, NoSQL, SQL Server, MongoDB, and Oracle 12c.\\nAll students have access to specialized computer laboratories housed in the Colden Hall Computing Complex. In addition, every full-time student is provided with a laptop by the University. There are multiple wireless access points on campus.\\nGraduate Research\\nAll graduate students in the MS-Applied Computer Science program are required to complete a two-semester software development project during their last two semesters of their study. For a list of recent projects, see the projects page.\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/about.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nApplied Computer Science | Graduate Program\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nAcademics\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nMajors and Minors\\nSchools and Departments\\nFaculty Credentials\\nAcademic Calendar\\nAcademic Catalogs\\nServices & Support \\n\\nAssessment Office\\nLibrary\\nNorthwest Success 360\\nStudent Success Center\\nTextbook Services\\nStudents with Disabilities\\nWriting Center\\n\\n\\nOther Learning Opportunities \\n\\nGraduate School\\nHonors Program\\nOnline Programs\\nContinuing Professional Education / Professional Development\\nNorthwest-Kansas City\\nDual Credit\\nHorace Mann Laboratory School\\n\\n\\nRelated Links \\n\\nProvost's Office\\n\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\xa0\\n\\n\\n » Academics\\nApplied Computer Science\\n\\n\\n\\nProgram(s) Available: M.S.Northwest’s Master of Science in Applied Computer Science is a 16-month program that offers hands-on, professional education in today's high-demand areas, including big data, web and cross-platform mobile development, security and user experience design. Computer Science is projected to grow by 15% by 2029, a growth rate larger than any other program.\\n*Enrollment Open to Students on F-1 VisasWhy Study \\r\\n        \\t\\t\\t\\t\\t\\t\\t\\t\\t\\t\\r\\n\\t\\t\\t\\t\\t\\t\\t\\t\\tApplied Computer Science at Northwest\\r\\n        \\t\\t\\t\\t\\t\\t\\t\\t\\t\\r\\n\\t\\t\\t\\t\\t\\t\\t\\tNorthwest is an electronic campus that gives students access to the internet and the Missouri Research and Education Network.\\xa0Computer languages and tools supported on the network include Java, C#, Swift, Hadoop, and Tableau. Databases include SQL, SQL Server, MongoDB and Oracle 12c.\\nAll students have access to specialized computer laboratories housed in the Colden Hall Computing Complex.\\nApplied development courses coupled with data, projects as well as software and IT management enable students to distinguish themselves and graduate ready to contribute in a competitive, global market.\\nLearn more about the ASC ProgramContactSchool of Computer Science and Information Systems660.562.1600timmel@nwmissouri.eduRelated LinksAcademic CatalogDepartment WebsiteStudent OrganizationsQuick LinksSchedule a VisitAcademic CatalogDepartment WebsiteStudent OrganizationsCareer opportunities\\nComputer and information research science\\nComputer network architecture\\nComputer programmer\\nComputer system analyst\\nWeb developer\\nMore detailsAdmissions requirementsCandidates for the Master of Science in Applied Computer Science should meet the following requirements:\\n\\nAcceptance to the Graduate School by the Dean of the Graduate School\\nCompleting a bachelor’s degree from an accredited college or university with a minimum grade-point average of 3.00 on a 4.00 scale.\\nHave an undergraduate major or minor in a technical computing discipline with coursework in\\r\\n\\ndata structures\\ncomputer networks (or) network fundamentals\\ndatabase systems\\ndiscrete mathematics\\nstatistics\\n\\n\\n\\nApplicants not satisfying these requirements may take undergraduate-level courses to remove any prerequisites other than Data Structures. All applicants must satisfy the Data Structures requirement before admittance.\\n\\nA student is more likely to be admitted by the school if the student's undergraduate degree is in computer science or a closely related field, and the student has completed a course in data structures* and\\n\\ntotal GRE greater than or equal to 290\\nundergraduate GPA greater than or equal to 3.0 on a 4.0 scale AND\\nnumber of backlogs less than or equal to 7\\n\\nApplicants not meeting these requirements may be admitted provisionally and contact\\xa0Dr. Ajay Bandi\\xa0at\\xa0ajay@nwmissouri.edu.\\nThe School of Computer Science and Information Systems reserves the right to make the final decision in accepting students to graduate degree candidacy. Criteria for admittance to the program and acceptance to degree candidacy may include academic qualifications and performance, letters of recommendation, number of applicants, and available resources.\\n*Undergraduate courses in computer networks/network fundamentals and database management systems are required. Students admitted without these courses can take them at Northwest upon arrival for graduate study. However, students must have completed a course in data structures before being admitted to the program.\\nInternational admissions requirementsBefore the program director is allowed to review your application, the Graduate School must verify your TOEFL score. The University sets the acceptable TOEFL score as:\\n\\n213 for computer-based TOEFL\\n71 for the Internet-Based TOEFL\\n550 for pencil-and-paper-based TOEFL\\n6.0 overall for IELTS\\n\\nInternational information flyer for the M.S. Applied Computer Science program\\xa0»\\nMore information for International StudentsRight size. Right price.We understand college is a big investment. Why not attend a school that is invested in you?What will it cost? Scholarships and aid Check out our FAFSA guide\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/academics/graduate/masters/applied-computer-science.htm', 'title': 'Applied Computer Science | Graduate Program', 'description': \"Northwest Missouri State University's Master of Science in Applied Computer Science is a 16-month program that offers a hands-on, professional education in today's high demand areas.\", 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nAdmission Requirements \\n\\n\\n\\r\\n\\r\\n            Candidates for the M.S. in Applied Computer Science should meet the following requirements:\\r\\n\\nCompliance with all of the eligibility requirements of the Graduate School as set forth in the Graduate Catalog.\\nAcceptance to graduate study by the Dean of the Graduate School.\\nCompletion of a four-year undergraduate degree from an accredited college or university with an undergraduate grade point average of 3.00 on a 4.00 scale. Applicants are expected to have an undergraduate major or minor in a technical computing discipline, including coursework in\\r\\n\\nData Structures\\nDatabase Systems / Database Management Systems\\nDiscrete Mathematics\\nStatistics\\n\\nApplicants who do not satisfy these requirements may take undergraduate level courses to remove any prerequisites except for Data Structures. The applicant must satisfy the requirement for Data Structures to be admitted.\\n\\nMinimum GRE and TOEFL scores, as described below.\\n\\nBefore the program director is allowed to review your application, the Graduate school must verify your TOEFL score. The acceptable TOEFL score is set by the University as:\\n\\n213 for computer-based TOEFL\\n71 for the Internet-Based TOEFL\\n550 for pencil-and-paper-based TOEFL\\n6.0 overall for IELTS\\n105 for Duolingo English Test\\nDetails for other acceptable test scores:\\xa0\\xa0https://www.nwmissouri.edu/admissions/international/englishproficiency.htm\\n\\nApplicants not meeting the TOEFL/IELTS requirement are not forwarded to the school for consideration.\\nA student is more likely to be admitted by the school if\\n\\nThe student's undergraduate degree is in Computer Science or a closely related field AND\\nthe student has successfully completed a course in data structures* AND\\nTotal GRE >=290\\xa0AND\\nundergraduate GPA >=3.0, on a 4.0 scale AND\\nnumber of backlogs <=7\\n\\n*Undergraduate courses in computer networks/network fundamentals and database management systems are required. Students admitted without these courses can take them at Northwest upon arrival for graduate study. However, students must have successfully completed a course in data structures prior to being admitted to the program.\\nApplicants who do not meet these requirements may be admitted provisionally.\\nThe School of Computer Science and Information Systems reserves the right of final decision in accepting students to graduate degree candidacy in the school. Criteria for admittance to the program and acceptance to degree candidacy may include academic qualifications and performance, letters of recommendation, number of applicants, and available resources.\\nApplication Deadlines\\nApplications and all transcripts must be submitted to the Office of Admissions by the following dates. International students should allow approximately two months from the time all application documents are received for notification of acceptance.\\n\\n\\n\\nSemester\\nApplication Deadline\\nDocument Deadline\\n\\n\\n\\n\\nSummer\\nMarch 1\\nMarch 15\\n\\n\\nFall\\nJune 15\\nJune 30\\n\\n\\nSpring\\xa0\\nNovember 1\\nNovember 15\\n\\n\\n\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/apply/index.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nCourse Descriptions\\n\\n\\n\\nComputer Science courses for the MSACS program are listed, each with a link to a detailed syllabus. This list includes prerequisite courses and some popular electives, along with the semesters that each is offered. Semesters offered may change. Check with the program advisor for up-to-date information.\\n\\n\\n\\nCourse No\\nCourse Name\\nHours\\nSemester Offered\\n\\n\\n\\n\\nPrerequisites (If not completed as an undergraduate)\\n\\n\\n44-460\\nDatabase Systems\\n3\\nFall, Spring\\n\\n\\nRequired Courses\\n\\n\\n44-542\\nObject-Oriented Programming\\n3\\nFall, Spring\\n\\n\\n44-560\\nAdvanced Topics in Database Systems\\n3\\nFall, Spring, Summer\\n\\n\\n44-563\\nDeveloping Web Applications and\\xa0Services\\n3\\nFall, Spring\\n\\n\\n44-618\\nProject Management in Business and Technology\\n3\\nSpring, Summer\\n\\n\\n44-643\\nMobile Computing: iOS\\n3\\nFall, Spring\\n\\n\\n\\xa0\\xa0\\xa0\\xa0 (OR)\\n\\n\\n44-644\\nMobile Computing: Android\\n3\\nFall, Spring\\n\\n\\n44-642\\nApplication Design: Patterns And Frameworks\\n3\\nFall, Spring\\n\\n\\n44-691\\nCS\\xa0Graduate Directed\\xa0Project\\xa0I\\n3\\nFall, Spring, Summer\\n\\n\\n44-692\\nCS\\xa0Graduate\\xa0Directed\\xa0Project II\\n3\\nFall, Spring\\n\\n\\n--\\nAdvisor Approved Elective-I\\n3\\nFall, Spring\\n\\n\\n--\\nAdvisor Approved Elective-II\\n3\\nFall, Spring\\n\\n\\nExamples of Elective Courses (Changes from Semester to Semester)\\n\\n\\n44-517\\nBig Data\\n3\\n--\\n\\n\\n44-520\\nWeb Mining\\n3\\n--\\n\\n\\n44-599\\nGenerative AI\\n3\\n--\\n\\n\\n44-599\\nAnalysis of Algorithm\\n3\\n--\\n\\n\\n44-566\\nMachine Learning\\n3\\n--\\n\\n\\n44-613\\nData Visualization\\n3\\n--\\n\\n\\n44-525\\nTheory and Implementation of Programming Languages\\n3\\n\\n\\n\\n44-640\\nInternet of Things\\n3\\n--\\n\\n\\n44-643\\nStudents who have taken 44-644 as their required course may take 44-643 as an elective.\\n3\\n--\\n\\n\\n\\xa0\\xa0\\xa0\\xa0 (OR)\\n\\n\\n44-644\\nStudents who have taken 44-643 as their required course may take 44-644 as an elective.\\n3\\n--\\n\\n\\n44-663\\nApplication Development in C#.NET\\n3\\n--\\n\\n\\n\\nNote:\\n\\nElective courses are subjected to change every semester.\\nThirty credit hours of graduate credits are required for completion of the M.S. in Applied Computer Science.\\n\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/courses.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems', 'description': 'Northwest Missouri State University Computer Science courses for the MSACS program are listed, each with a link to a detailed syllabus.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nList of Graduate Directed Projects\\n\\n\\n\\n+ Expand Allâ€“ Collapse AllFrequently Asked QuestionsWhat is Graduate Directed project?Graduate Directed Project replaces the thesis requirement in the MS-ACS program. Over a two-semester period, students work with either internal (university) or external (business) clients to complete a project. The projects are very close to a real world software engineering experience. Students work in teams of three to ten, with a faculty mentor guiding the team through the entire software lifecycle. Students experience all aspects of software engineering including interviewing a client, domain analysis, requirements gathering, specification, design techniques including UML and ER diagrams, use cases, paper prototypes, iterative development, and user acceptance testing.\\xa0 In addition, students develop valuable communications skills and learn how to properly interact with a client and how to work effectively in a team.Why do students have to take Graduate Directed Project?The two-semester Graduate Directed Project is in lieu of the normal thesis requirement for master’s level programs. Since our program is applied in nature and is designed to prepare you for the job market, engaging in a software development project better fits the goals of the MS-Applied Computer Science program.What are students required to do in Graduate Directed Project?Students are assigned to teams of 3-10 each. They are also assigned a faculty member to serve as their mentor. Projects are assigned to each team, and students normally are involved in all steps of a software development project, from gathering requirements from the client to deploying the finished product.Can students pick their own teams?A faculty committee assigns students to teams. Students may request to work with certain students, but there is no guarantee that their request will be honored. Many factors must be considered when teams are formed, including the balance of expertise and the background of the students involved.Can a student suggest a project?Anyone can suggest a project for a graduate directed project team. However, the proposal must be in written form and must supply sufficient detail for the faculty committee to make a decision.What if a team starts on their project in the spring and some team members are planning to continue in the summer, but others do not want to attend during the summer and want to wait until fall to complete the project.When teams are initially assigned, we make every effort to ensure that all team members have the same completion date in mind. If circumstances change, and some team members want to complete in the summer, with others completing in the fall, we will work out a solution. No student will be forced to attend in the summer, or to wait until fall, for completion of the project.How are clients chosen?We solicit clients from our own school, from other offices in the university, and from companies and businesses off-campus.\\xa0 Potential clients submit a proposal, and a faculty committee selects those proposals that seem to be suitable for a Graduate Directed Project team.List Of Projects\\n\\n2023-24\\n2022-23\\n2021-22\\n2020-21\\n2019-20\\n2018-19\\n2017-18\\n2016-17\\n2015-16\\n2014-15\\n2013-14\\n\\n\\n\\n\\n2012-13\\n2011-12\\n2010-11\\n2009-10\\n2008-09\\n2007-08\\n\\n\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/current/projects/index.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nSchool of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nResearch and Independent Studies\\n\\n\\n\\nResearch Projects\\nThe MS-ACS program is not a thesis based program and hence there is no research work as a part of the program. However, students can always consult with the faculty here, who keep working on individual research projects continuously. The student may get a chance to work on that research work with the faculty.\\nHowever, all the students have to explore and work on graduate directed projects as part of their program. The list of projects finished by earlier students can be found at the projects page link.\\nIndependent Studies\\nMS-ACS program provides flexibility to the students to work on an independent project in their area of interest. The student can work on any project of their interest using technology, under the guidance of a faculty and can finish this course within the time allotted. This course provides the opportunity for students to explore any technology or project that is not available in the program as of now. This is considered as an independent course, post completion of this course, 1 hour will be added to the student's degree audit.\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/current/research.htm', 'title': 'School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nFinancial Assistance\\n\\n\\n\\nNorthwest’s tuition is much less than that of many other institutions. New international students who are admitted receive a $500 scholarship for their first semester of study.\\xa0\\nCost Calculations:\\n\\nCost Calculator\\n\\n\\xa0\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/finaid.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nOn-campus Employment\\n\\n\\n\\nWe have a limited number of graduate assistantships (GAs). GA positions include a tuition waiver and a monthly stipend. We also have some hourly employee positions which are available to both graduate and undergraduates. Hourly employee positions do not include a tuition waiver, but they provide you with some income and experience working in the field.\\xa0However, we cannot guarantee any employment, which is why we require financial information and proof of your ability to cover your own expenses before we consider your application.\\nIf you are an international student, please be aware that it is very hard for international students to find employment during their first semester. If you do well during your first semester on campus, then it may be possible to find an assistantship for the second semester.\\nSee Financial Assistance page for details.\\nOn-Campus Jobs\\n\\nGraduate Assistantship\\nStudent Employment\\nCampus Dining\\n\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/on-campus-employment.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nInternship and CPT(Curricular Practical Training)\\n\\n\\n\\nStudents in the MS-ACS program are encouraged to obtain summer internships. A summer internship will provide you with an opportunity to see how the concepts and skills learned in the classroom translate to real projects in industry.\\nIt is the student's responsibility to make the appropriate contacts to obtain an internship. An internship may be either on campus or off-campus. A student may or may not be paid for internship work. Students may or may not earn academic credit for an internship. Students who desire academic credit will sign up for a one-credit-hour section of 44-699 Graduate Internship in Information Technology or 44-599 Special Projects - Independent Study Computer Science. For details about 44-699 or 44-599, see CSIS Internship Policies and Procedures\\xa0.\\nSPECIAL NOTES FOR INTERNATIONAL STUDENTS WHO WANT SUMMER INTERNSHIPS:\\nThe School of Computer Science and Information Systems at Northwest Missouri State University participates in the CPT (curricular practical training) program for international students. Note some restrictions on CPT:\\n\\nThe School of Computer Science and Information Systems will support requests for CPT for the summer semester. Fall and spring CPT requests may\\xa0be granted, depending on the circumstances.\\nCPT requires that a student\\xa0be enrolled full time for one academic year (two semesters) before becoming eligible for CPT. This means that students enrolling for the first time in the fall are eligible for CPT the following summer. However, students enrolling for the first time in the spring are not eligible for CPT until they have completed an additional semester of study.\\nCPT guidelines require that you enroll in an internship course. MS-ACS students will enroll in a one-credit-hour section of 44-699 Graduate Internship in Information Technology\\n\\nThe following documents provide more details regarding CPT and internship policies and procedures:\\n\\nStudent Procedure (Sample )\\nEmployer Procedure (Sample )\\nAcademic Advisor Letter (Sample )\\nFaculty Procedure (Sample )\\nJob Offer Letter (Sample )\\nCSIS Internship Policies and Procedures\\xa0For all students, both international and non-international\\nWeekly Log templateThis is a sample template; your instructor may require that you use a different template.\\n\\nHelp for Job\\xa0Interviews\\nTo learn more about interviewing and creating résumés, enroll in 44-296 Professional Development Seminar. This is a one-credit hour, undergraduate course that will prepare you to interview for internships and full-time jobs. You will also learn how to create effective résumés. This course is NOT required and does NOT count toward the MS in Applied Computer Science program, but it is highly recommended.\\nIn the meantime, here are some helpful hints that might be of use. These are general documents and apply to a wide variety of situations. You must adapt the suggestions to fit the situation. Applying for a student job on campus is not the same as applying for a full-time job upon graduation. Basic rules apply to both situations, but details may differ. Use these documents as a guideline.\\n\\nA Sample Resume\\nInterview_tipsbasics.doc\\xa0\\nInterviewDoAndDont.doc\\xa0\\n\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/internship-and-cpt.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nOrganizations | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n\\n\\n  \\n\\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nAbout Us\\nDegree Programs\\nFaculty & Staff\\nOrganizations\\nEvents\\nCareer Information\\nContact Us\\nRelated Links\\n\\nApply Now!\\nFinancial Aid & Scholarships\\nAlumni & Support\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS\\nStudent Organizations\\n\\n\\n\\nGet InvolvedHalf of all Northwest students participate in a student organization. With over 200 recognized groups to choose from, explore your passions while discovering new interests along the way.\\nSearch All Student OrgsAssociation of Computing Machinery\\nACM promotes a greater interest in computers and applications as well as providing a means of communication for persons sharing an interest in computers.\\nView ACM Website\\nAssociation of Computing Machinery - Graduate Student Chapter\\n ACM-Graduate is a special interest group for ACM graduate student members. Visit us at:\\n\\n\\n\\n\\n\\nSponsors: Denise Case, Ajay Bandi\\nACM-G Members Login\\nBeta Chapter, Pi Omega Pi\\n This national business teacher education honor society honors students with high scholastic ability in business education. Eligibility requirements include interest in becoming a business educator; completion of three semester of college courses, including at least 15 hours in business and/or education subjects; and a 3.00 GPA in business and education courses. Seniors are eligible to apply for the C & C Taylor Scholarship awarding up to $11,000 in scholarship annually.\\nSponsors: Crystal Combs\\nView Pi Omega Pi Website\\nCyber Defense Club\\nCyber Defense Club is a computer science organization focused on giving students a hands-on learning experience and preparing them for cyber defense competitions.\\nSponsor: Jerry Qin\\nVIEW cyber defense club WEBSITE\\nEtA Gamma Chapter, Delta Mu Delta\\nDelta Mu Delta is the national honor society in business administration. The purposes of DMD are to promote higher scholarship in training for business and to recognize and reward scholastic attainment in business subjects. Students of junior standing majoring in Business Technology and Management Information Systems and in the top 20 percent of their class will be invited for membership.\\nSponsors: Casey Abington,\\xa0Jeff Nickerson\\nUpsilon Pi Epsilon\\nThe mission of UPE is to recognize academic excellence at both the undergraduate and graduate levels in the computing and information disciplines.\\nSponsors: Ajay Bandi, Diana Linville\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n\\nTop\\n\\n\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/orgs/index.htm', 'title': 'Organizations | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content='\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nFrequently Asked Questions\\n\\n\\n\\n+ Expand Allâ€“ Collapse AllFor international students:I have received my visa -- what next? This document is prepared by the International Involvement Center (IIC). It provides much useful information regarding the next steps after receiving your visa. For more information contact Connie Murphy and IIC (intlprog@nwmissouri.edu).Do I have to purchase health insurance in the United States? What vaccines do I need to have before I arrive?Students must purchase health insurance at Northwest. For the year 2022-2023, the annual cost is around $1,500.00.Regarding the Vaccines, you need to at least complete MMR (1st dose) and if you live on campus you need to even take Meningitis.For all students, both international and non-international:How does the Master of Science in Applied Computer Science differ from programs in Computer Science?The MS in Applied Computer Science at Northwest Missouri State University differs from other programs in computer science in some significant ways:\\nThe focus of this program is to prepare students to enter a very competitive job market by increasing their skills in high-demand areas and emerging technologies. Many master\\'s programs in computer science have a more theoretical basis because the aim of the program is to prepare students to go on for more graduate work at the Ph.D. level. Our program covers theoretical concepts, but students also gain hands-on experience and have strong technical skills when they graduate from the program.\\nOur program requirements include six credit hours of course work (two courses) that look at information technology issues from a business perspective. In many computer science programs there is no coverage of business issues.\\nIn place of the thesis requirement required by many programs, our program requires a year-long, six-credit hour project that provides students with the opportunity to apply their knowledge to a software project.\\nThe primary goals of this program are to produce graduates that\\n\\nhave a high degree of competence in areas of high-demand and emerging technologies\\nhave good project management skills and will understand fundamental business concepts, as related specifically to information technology\\nhave experience in design and implementation of a large project\\nknow how to work in teams\\nhave good written communication and presentation skills\\n\\nTo ensure that our program meets these goals, we get regular feedback from potential employers. Feedback for this program has been very positive with employers confirming that we have the right mix of theory and practice. They have been particularly positive about the inclusion of the two business-related courses because they frequently encounter problems with \"techies\" being unable to communicate with others in the organization.What work opportunities are available? Can I get a graduate assistantship?\\n\\nThere are many work opportunities available on campus for students few among them are office Assistants, Student ambassadors, Teaching assistants, Campus Dine-in jobs, Graduate Assistants, and many more. Every student would be eligible for a Graduate Assistantship based on their performance in the semesters, proactiveness, and active participation in the class.\\nIn any semester if you get a full graduate assistantship or 3/4th graduate assistantship or 1/2 graduate assistantship, your 100% or 75% or 50% of the tuition fee will be waived off, respectively. Click here to review the Graduate and Teaching Assistant Opportunities:\\xa0https://www.nwmissouri.edu/hr/student/index.htm\\n\\nWhat is the typical class size?Class sizes are generally small, so you can get individual attention from the instructor. Average class size is approximately 27 students. If we get an unexpectedly large number of students joining the program, then class sizes may be slightly larger than the figures indicated here. In some cases, we have larger sections (40-45 students) that meet once a week; for the second meeting of the week, the class is split into two smaller sections.Do I need to bring a laptop with me?No, you do not need to bring a laptop with you. All full-time students are provided a laptop by the university.Please explain the credit hour system used.Each required course in the major is three credit hours. This means the class meets for approximately three hours per week. You are expected to work outside of class also. Undergraduates take about 15 credit hours per semester, but the normal load for a graduate student is nine credit hours (three courses) per semester. It is possible to take twelve credit hours (four courses) as a graduate student, but you should talk with your advisor before doing this. During the semesters that you are enrolled in Directed Graduate Project, it is especially important that you do not enroll in an excessive number of hours.How are grades determined?When you begin a course, the instructor will provide a syllabus for the course which, among other things, describes the grading criteria for the course. This can vary from course to course, but generally the grading criteria will include exams, quizzes, projects, and assignments. The instructor will also include a grading scale to show you how final grades are determined. For most instructors, each item (exam, quiz, project, etc) is assigned a point value. At the end of the term you must have a certain percentage of the total point values for an A, a certain percentage for a B, and so forth.What kind of research activities are the faculty involved in?Note that we do not offer a doctoral program at Northwest Missouri State University, and therefore research is limited. The highest degree we offer in computer science is the Master of Science in Applied Computer Science. The primary purpose of the program is to prepare students to succeed in a very competitive job market, so the focus of the program is different from what you find in programs designed to lead to a doctoral degree.\\nOur faculty is very active professionally. Faculty members present papers regularly at professional meetings and attend conferences and seminars in order to stay up on current technologies. Special areas of interest include artificial intelligence, database systems, computer networks, web services, human-computer interaction, component-based development, and programming languages. For more specific details about individual faculty members, see faculty page.My admission letter says that I need to take 44-460 Database Systems. Can you tell me more about this course?44-460 Database Systems is a senior level course, emphasizing design concepts and ER modeling. In addition, SQL is covered extensively. Students who enter the MS program and do not have an undergraduate course in database systems must take 44-460 before they can enroll in 44-560 Advanced Topics in Database Systems.How can I pay my fees?The Office of Student Account Services will accept cash, credit card, flywire, or traveler\\'s checks. For new students registering during the general registration period in the week prior to classes beginning, one-fourth of tuition is due on the day they enroll. The remaining payments are scheduled throughout the semester.\\nChecks should be made out to Northwest Missouri State UniversityCan you give an estimate of the total expenses for the first year?This information is an approximation only. Fees are based on the best information\\xa0currently available for years 2021-22.\\nTo determine tuition fees, go to Graduate Fee Calculator. With a normal load, a graduate student will take 9 credit hours per semester. If you have deficiencies, you may take up to 12 credit hours per semester. The more credit hours you take, the higher the tuition costs.\\nWhen using the Graduate Fee Calculator, you must select out-of-state for your first semester fees. However, some reduction of fees may be possible after the first semester for qualifying students. See financial assistance for details.\\nInternational students must purchase health insurance if they do not have their own health insurance. For the cost of health insurance, see the\\xa0estimated cost for international students. Note that the total cost on this page includes estimates for personal expenses and on-campus living expenses. These costs may be different if you choose to live off-campus.How can I arrange for housing? Should I live off-campus or on-campus?On-campus housing is available. Information about on-campus housing was included in your I-20 packet. Most graduate students live off-campus. Popular apartments include:\\n\\nHorizons West, 660.582.5211 (adjacent to campus)\\nVillage O, 660.582.7725 (about 1 or 1-1/2 miles from campus)\\nNorthridge, 660.582.3927 (adjacent to campus)\\nWhat should one know about Northwest Missouri State University and how is it different from other institutions?We offer a practical program that provides you with the skills you need to find employment when you graduate; we believe you learn by doing, so we have a hands-on approach to our classes\\n\\nwe have one of the safest campuses in the United States\\nyou will have lots of personal attention from the faculty\\nNorthwest has low tuition, relative to most other schools\\nwe have a beautiful campus, with about 1300 trees and 125 different species (we are the Missouri State Arboretum)\\nwe also provide good scholarships. See financial assistance for details.\\n\\nNorthwest’s niche is to provide first-rate, high-quality bachelor’s and master’s degree programs. The quality of these programs is evidenced by our large enrollment in the MS-ACS program and the success our graduates have in obtaining jobs; at the bachelor’s level, our school just received a grant in excess of $500,000 from the National Science Foundation to support recruitment and retention of undergraduates in Computer Science through scholarships and an extensive mentoring program.\\xa0 This kind of recognition speaks well to the quality of our programs at Northwest.If you have\\xa0 more questions about our program, visit the program website at https://www.nwmissouri.edu/academics/graduate/masters/applied-computer-science.htm. Look under the FAQs button to see how the MS-ACS program is different from other programs. Look under https://www.nwmissouri.edu/csis/directory/index.htm to find research interests for faculty. Note that our school is large and includes several different disciplines.\\xa0 Faculty involved in the MS-ACS program include\\xa0Dr. Ajay Bandi, Dr. Denise Case, Dr. Charles Hoot,\\xa0and Aziz\\xa0Fellah. Look under https://www.nwmissouri.edu/csis/msacs/current/projects to see the software development projects that students in the MS-ACS program work on to fulfill their Research Component requirement.Research at Northwest:Regarding research activities, please keep in mind that Northwest is not a research institution, and the program you have selected is Applied Computer Science.\\xa0 The applied nature of this program is one of the aspects that makes it unique and different from many other master\\'s programs.\\xa0 The purpose of this program is to prepare students to enter a competitive field and have a successful career.\\xa0 We do, however, have a faculty that is professionally active.\\xa0 Each year several of the faculty members present papers at major conferences or publish in national journals.\\xa0 In addition, several faculty members are working on a $500,000 nationally-funded grant.\\xa0 To see the professional interests of the faculty members, visit https://www.nwmissouri.edu/csis/directory/index.htm. In the future, we will post full vitas of the faculty members so you can see the publications of individual faculty members, but those are not readily available at present.Regarding the course curriculum please find the following link: https://www.nwmissouri.edu/csis/msacs/courses.htmWhere can I get additional information?For more information\\n\\nContact the program director at msacs@nwmissouri.edu.\\nWhat are the documents required to complete the application of Northwest Missouri state university?\\nThe documents required for the admission process include:\\n\\n\\na)Official English proficiency scores (TOEFL, IELTS, PTE, DUOLINGO)\\nb)Official GRE Score card.\\n\\n\\nc)Bank statement and Statement of support.\\n\\n\\nd)Copy of your passport.\\n\\n\\ne)Official transcripts from all colleges and universities you have attended or are now attending for undergraduate and graduate coursework.\\n\\n\\nTo review more details about the admission requirements please click on the link:https://www.nwmissouri.edu/csis/msacs/apply/index.htm\\nwhat would be the approximate complete tuition fee for MSACS?\\nTo know the tuition fees for the MS-ACS program click on the mentioned link:https://www.nwmissouri.edu/studentaccounts/tuitionandfees.htm\\n\\n\\xa0What are the courses involved in MSACS Program.Could you please give me a brief notes on it?\\nTo know details about the coursework description, click on the mentioned link:\\xa0https://www.nwmissouri.edu/csis/msacs/courses.htm\\nWhat are the Scholarship options available in the MSACS Program?\\n\\nAny student who gets admitted to our program would receive the $500 scholarship for the first semester.\\nIn any semester if you get a full graduate assistantship or 3/4th graduate assistantship or 1/2 graduate assistantship, your 100% or 75% or 50% of the tuition fee will be waived off, respectively. Click here to review the Graduate and Teaching Assistant Opportunities:\\xa0https://www.nwmissouri.edu/hr/student/index.htm\\n\\nwhat would be the deadline for students to submit the application?\\nBased on the intake we have the deadlines to submit the application. As per 2020-2021, we have the following deadlines for the semesters as below:\\n\\n\\nSummer Semester: March 1\\n\\n\\nFall Semester: June 15\\n\\n\\nSpring Semester: September 30\\n\\n\\nTo know details about the application deadlines, click on the mentioned link:\\xa0https://www.nwmissouri.edu/csis/msacs/apply/index.htm\\nBased on work experience in the IT industry can we get a waiver of doing Database prerequisite? For Masters in Applied Computer science program, we will not waive off the prerequisite based on the job experience. We will waive off the prerequisite for the students who have completed the Database Management Systems (DBMS) as part of their under graduation coursework.After submission of the application in what time I can expect to hear back from your university? In general, you will hear the decision from the University within 3 to 4 weeks of time. However, It depends on the number of applications that we receive and process.How many credit hours would be eligible to be transferred if you opt to transfer from other university to Northwest Missouri State University?The maximum graduate credit accepted for transfer is nine semester hours in no more than four courses. In order for graduate transfer credits to be evaluated, the prospective graduate student must send the unofficial transcripts with final grades to the program coordinator. To be considered for transfer credit, courses must have a grade of “B” or higher and may not be older than eight years at the time of degree completion.\\nTo know details about the coursework description, click on the mentioned link below:-https://www.nwmissouri.edu/csis/msacs/courses.htm\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest\\'s Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n', metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/FAQs.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}),\n",
              " Document(page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nContact Us\\n\\n\\n\\nIf you ever have any questions about the Masters in Applied Computer Science program, please use the contact information below.\\nThe school's office is open from 8 a.m. - 5 p.m., Monday - Friday.\\nAjay Bandi, Ph.D.Associate Professor andProgram Coordinator, MS-Applied Computer ScienceSchool of Computer Science and Information SystemsNorthwest Missouri State University2250 Colden Hall800 University DriveMaryville, MO-64468Email: ajay@nwmissouri.edu (or) msacs@nwmissouri.eduOffice: 660.562.1199\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/contact.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'})]"
            ]
          },
          "execution_count": 10,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "data"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LNSNunP2Gd2c"
      },
      "source": [
        "\n",
        "\n",
        "- **TokenTextSplitter**: This class is used to split text into chunks, typically to prepare it for processing by language models or other natural language processing tasks.\n",
        "- **text_splitter = TokenTextSplitter(chunk_size=512, chunk_overlap=24)**: Initializes an instance of `TokenTextSplitter` with a chunk size of 512 tokens and an overlap of 24 tokens between consecutive chunks.\n",
        "- **documents = text_splitter.split_documents(data)**: Splits the input `data` (presumably a collection of text documents) into chunks of the specified size and overlap, storing the resulting chunks in the `documents` variable.\n",
        "\n",
        "This approach is useful for breaking down large text documents or datasets into manageable pieces that can be processed more efficiently by downstream tasks or models."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "WSBwTblIxmgO"
      },
      "outputs": [],
      "source": [
        "text_splitter = TokenTextSplitter(chunk_size=512, chunk_overlap=24)\n",
        "documents = text_splitter.split_documents(data)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "dI5DbzHLezVX",
        "outputId": "08a0e9c7-fc5c-408b-aa40-3daee623e981"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "page_content=\"\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\xa0\\n\\n\\n » CSIS\\nWelcome to Masters in Applied Computer Science\\n\\n\\n\\nAt Northwest, we are dedicated towards the development of future leaders in the information technology (IT) industry. Our highly qualified faculty members collaborate and work together to educate students who come to obtain a quality education. We provide appropriate technological and instructional resources for our students to help them succeed in the IT job market worldwide. Northwest is also committed towards the personal and social development of its students by providing opportunities for our students to interact with others in a successful, ethical way.Prospective MS-ACS StudentsAdmissions information for prospective international students.MSACS on FacebookFollow the Masters in Applied Computer Science program on Facebook!\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\" metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'Northwest Missouri State University is committed to developing future leaders in the IT industry through the Masters in Applied Computer Science program.', 'language': 'en'}\n",
            "page_content='\\n\\n\\n\\n\\n\\n\\nMS-ACS | School of Computer Science & Information Systems | Northwest\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nSkip to Main Content\\n\\n\\n\\nSchool of Computer Science and Information Systems\\n  \\n\\n\\n\\nClose \\n\\n\\n\\n\\n\\n\\n Search Term   \\n\\n\\n\\n\\nWelcome\\nWhy MS-ACS?\\nProgram Description\\nAdmission Requirements\\nCourse Descriptions\\nCurrent Students\\n\\nWriting Samples\\nGraduate Directed Project\\nResearch Projects / Independent Studies\\n\\n\\nFinancial Assistance / Cost Calculations\\nEmployment Opportunities\\n\\nOn-campus Employment\\nInternship and CPT\\n\\n\\nOrganizations\\nFrequently Asked Questions\\nContact Us\\n\\n\\n\\n\\n\\n\\n\\n\\xa0\\n\\n\\n » CSIS » MS-ACS\\nWhy MS-Applied Computer Science Program?\\n\\n\\n\\nThe Program\\nThe Master of Science in Applied Computer Science offers students with strong undergraduate background in a technical computing discipline an opportunity to increase their technical expertise and to complement that expertise with fundamental business concepts related specifically to information technology. The term Applied Computer Science was carefully chosen. The practical skills developed for a wide variety of high-demand areas, as well as the firm conceptual foundation provided by the program, combine to create graduates that are well-prepared to succeed in a very competitive job market.\\nThe M.S. Applied Computer Science program has a STEM CIP code 11.0701 that currently allows an extra 24 months of OPT (Optional Practical Training) extension after completion of 12 month OPT period. Visit U.S. Citizenship and Immigration Services for updates.\\nFor more details about the program, see Program Description.\\nOverview of Program, School and University\\n\\nThe average class size at Northwest is 27.\\nStudent to faculty ratio is 22 to 1.\\nBetween 75 and 375 graduate students are normally enrolled in the M.S. in Applied Computer Science program.\\nNorthwest Missouri State University is home to the Missouri Arboretum, providing a beautiful environment for all members of the university community.\\nNorthwest is considered one of the safest campuses in the nation.\\n\\nComputing Facilities\\nThe Electronic Campus gives students access to the Internet and to the Missouri Research and Education Network. Computer languages supported on the network include \\xa0Java, C#, C++, Perl, Smalltalk, Node JS, Android Studio, and Swift.\\xa0Databases include SQL, NoSQL, SQL Server, MongoDB, and Oracle 12c.\\nAll students have access to specialized computer laboratories housed in the Cold' metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/about.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}\n",
            "page_content=\" SQL Server, MongoDB, and Oracle 12c.\\nAll students have access to specialized computer laboratories housed in the Colden Hall Computing Complex. In addition, every full-time student is provided with a laptop by the University. There are multiple wireless access points on campus.\\nGraduate Research\\nAll graduate students in the MS-Applied Computer Science program are required to complete a two-semester software development project during their last two semesters of their study. For a list of recent projects, see the projects page.\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\" metadata={'source': 'https://www.nwmissouri.edu/csis/msacs/about.htm', 'title': 'MS-ACS | School of Computer Science & Information Systems | Northwest', 'description': 'The official website of Northwest Missouri State University located in Maryville, Missouri.', 'language': 'en'}\n"
          ]
        }
      ],
      "source": [
        "print(documents[0])\n",
        "print(documents[1])\n",
        "print(documents[2])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c2MEovPDGzBW"
      },
      "source": [
        "\n",
        "\n",
        "- **ChatOpenAI**: This class is used to interact with OpenAI's chat models. In this case, it's initialized with parameters like `temperature=0` and `model_name=\"gpt-3.5-turbo-0125\"`.\n",
        "- **LLMGraphTransformer**: This class is used to transform text documents into graph documents using a language model (LLM).\n",
        "- **Neo4jGraph**: This class represents a connection to a Neo4j graph database.\n",
        "\n",
        "\n",
        "The code first initializes the language model (`llm`) and the transformer (`llm_transformer`) to convert text documents (`documents`) into graph documents. Then, it initializes a `Neo4jGraph` instance (`graph`) and adds the transformed graph documents to the Neo4j database using the `add_graph_documents` method.\n",
        "\n",
        "This approach integrates natural language processing with graph database operations, enabling the creation of structured graph representations from unstructured text data."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "0DttkbLsyAza"
      },
      "outputs": [],
      "source": [
        "llm=ChatOpenAI(temperature=0, model_name=\"gpt-3.5-turbo-0125\") # gpt-4-0125-preview occasionally has issues\n",
        "llm_transformer = LLMGraphTransformer(llm=llm)\n",
        "\n",
        "# Following needs to be used only first time to load the data. It took 3m 44s\n",
        "graph_documents = llm_transformer.convert_to_graph_documents(documents)\n",
        "# graph.add_graph_documents(\n",
        "#     graph_documents,\n",
        "#     baseEntityLabel=True,\n",
        "#     include_source=True\n",
        "# )\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "zwUdvx8I5208",
        "outputId": "86ff6ab5-fd86-4b7f-9c5a-f1dbd0bcc409"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "page_content=\" TOEFL\\n6.0 overall for IELTS\\n\\nInternational information flyer for the M.S. Applied Computer Science program\\xa0»\\nMore information for International StudentsRight size. Right price.We understand college is a big investment. Why not attend a school that is invested in you?What will it cost? Scholarships and aid Check out our FAFSA guide\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\" metadata={'source': 'https://www.nwmissouri.edu/academics/graduate/masters/applied-computer-science.htm', 'title': 'Applied Computer Science | Graduate Program', 'description': \"Northwest Missouri State University's Master of Science in Applied Computer Science is a 16-month program that offers a hands-on, professional education in today's high demand areas.\", 'language': 'en'}\n",
            "nodes=[Node(id='Toefl', type='English language proficiency test'), Node(id='Ielts', type='English language proficiency test'), Node(id='M.S. Applied Computer Science Program', type='Program'), Node(id='Northwest Missouri State University', type='University')] relationships=[Relationship(source=Node(id='Toefl', type='English language proficiency test'), target=Node(id='M.S. Applied Computer Science Program', type='Program'), type='REQUIRED_FOR'), Relationship(source=Node(id='Ielts', type='English language proficiency test'), target=Node(id='M.S. Applied Computer Science Program', type='Program'), type='REQUIRED_FOR'), Relationship(source=Node(id='M.S. Applied Computer Science Program', type='Program'), target=Node(id='Northwest Missouri State University', type='University'), type='OFFERED_AT')] source=Document(page_content=\" TOEFL\\n6.0 overall for IELTS\\n\\nInternational information flyer for the M.S. Applied Computer Science program\\xa0»\\nMore information for International StudentsRight size. Right price.We understand college is a big investment. Why not attend a school that is invested in you?What will it cost? Scholarships and aid Check out our FAFSA guide\\n\\n\\n\\n\\n\\nReady to be a Bearcat?\\n\\nRequest Info\\nSchedule a Visit\\nApply Now\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nNorthwest Missouri State University 800 University Drive Maryville, MO 64468 USA\\n660.562.1212\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nCampus Links\\n\\nAcademic Calendar\\nEmergency Alert Sign Up\\nNews and Events\\nMaps and Tours\\nConsumer Information\\n\\n Report an Incident\\n\\nAffiliates\\n\\nAlumni\\nAthletics\\nChildren/Lab School\\nJobs at Northwest\\nMake a Gift\\nNorthwest Online\\nNorthwest-Kansas City\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nContact\\nFeedback\\nPolicies\\n\\n\\n\\n© 2022 Northwest Missouri State University. All rights reserved.\\n\\n\\nNorthwest Missouri State University is an equal opportunity/access/affirmative action/pro-disability and veteran employer and does not discriminate on the basis of sex in our education programs or activities, pursuant to Title IX and 34 CFR Part 106. For more information, visit Northwest's Non-Discrimination Policy.\\n\\n\\n Top\\n\\n\\n\\n\", metadata={'source': 'https://www.nwmissouri.edu/academics/graduate/masters/applied-computer-science.htm', 'title': 'Applied Computer Science | Graduate Program', 'description': \"Northwest Missouri State University's Master of Science in Applied Computer Science is a 16-month program that offers a hands-on, professional education in today's high demand areas.\", 'language': 'en'})\n"
          ]
        }
      ],
      "source": [
        "print (documents[5])\n",
        "print(graph_documents[5])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-76PrdloHXmK"
      },
      "source": [
        "The `showGraph` function takes an optional `Cypher `query string as input (defaulting to a predefined query), establishes a connection to `Neo4j` using credentials from environment variables, executes the query to retrieve graph data, and then visualizes it using a `GraphWidget`. The widget allows interactive exploration of the graph nodes and relationships directly within the notebook environment, making it easy to analyze and understand graph structures and connections."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 817,
          "referenced_widgets": [
            "ff55d6b49443428cb1cbdfdcc9d88eec",
            "2de0209c64b94c65ac698d0f3b8e2262"
          ]
        },
        "id": "verAasH9yIu6",
        "outputId": "6f3c457c-8ee1-443e-f912-20c32461c97b"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "ff55d6b49443428cb1cbdfdcc9d88eec",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "GraphWidget(layout=Layout(height='800px', width='100%'))"
            ]
          },
          "metadata": {
            "application/vnd.jupyter.widget-view+json": {
              "colab": {
                "custom_widget_manager": {
                  "url": "https://ssl.gstatic.com/colaboratory-static/widgets/colab-cdn-widget-manager/2b70e893a8ba7c0f/manager.min.js"
                }
              }
            }
          },
          "output_type": "display_data"
        }
      ],
      "source": [
        "# directly show the graph resulting from the given Cypher query\n",
        "default_cypher = \"MATCH (s)-[r:!MENTIONS]->(t) RETURN s,r,t LIMIT 50\"\n",
        "\n",
        "def showGraph(cypher: str = default_cypher):\n",
        "    # create a neo4j session to run queries\n",
        "    driver = GraphDatabase.driver(\n",
        "        uri = os.environ[\"NEO4J_URI\"],\n",
        "        auth = (os.environ[\"NEO4J_USERNAME\"],\n",
        "                os.environ[\"NEO4J_PASSWORD\"]))\n",
        "    session = driver.session()\n",
        "    widget = GraphWidget(graph = session.run(cypher).graph())\n",
        "    widget.node_label_mapping = 'id'\n",
        "    #display(widget)\n",
        "    return widget\n",
        "\n",
        "showGraph()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "2LSQjHkAHuTj"
      },
      "source": [
        "The `Neo4jVector.from_existing_graph()` method is used to create a vector index within a Neo4j database. It integrates embeddings from OpenAI's models, facilitating efficient search and retrieval operations based on both textual content and embedding similarities.\n",
        "\n",
        "### Key Components:\n",
        "\n",
        "- **LangChain Components**:\n",
        "  - **Neo4jVector**: This class from LangChain Community is designed to manage vector indexes within Neo4j, enabling storage and retrieval of embeddings associated with graph nodes.\n",
        "  - **OpenAIEmbeddings**: This class from LangChain OpenAI provides tools for generating embeddings using OpenAI's models.\n",
        "\n",
        "- **Initialization Parameters**:\n",
        "  - **OpenAIEmbeddings()**: Initializes the use of OpenAI's models to generate embeddings.\n",
        "  - **search_type=\"hybrid\"**: Specifies a hybrid search approach, leveraging both textual content and embedding similarities for efficient querying.\n",
        "  - **node_label=\"Document\"**: Specifies that nodes labeled \"Document\" in the Neo4j graph will store document-related information.\n",
        "  - **text_node_properties=[\"text\"]**: Defines the property name(s) within \"Document\" nodes where textual content is stored.\n",
        "  - **embedding_node_property=\"embedding\"**: Specifies the property name where embeddings are stored within the \"Document\" nodes.\n",
        "\n",
        "### Usage Scenario:\n",
        "\n",
        "This setup is useful in scenarios where you want to store and query documents based on both their textual content and their embeddings. For example, you can store documents in Neo4j, extract their embeddings using OpenAI's models, and then use this vector index to efficiently search for documents based on their semantic similarity to a given query or to other documents in the database.\n",
        "\n",
        "This approach leverages the capabilities of Neo4j for graph-based storage and retrieval, coupled with advanced embedding techniques from OpenAI, providing a powerful toolset for managing and analyzing textual data within a graph database environment."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "J23HXjaEzdu8"
      },
      "outputs": [],
      "source": [
        "vector_index = Neo4jVector.from_existing_graph(\n",
        "    OpenAIEmbeddings(),\n",
        "    search_type=\"hybrid\",\n",
        "    node_label=\"Document\",\n",
        "    text_node_properties=[\"text\"],\n",
        "    embedding_node_property=\"embedding\"\n",
        ")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "U__qaE9sHtW8"
      },
      "source": [
        "\n",
        "\n",
        "### Retriever Setup:\n",
        "\n",
        "The code snippet performs the following actions:\n",
        "\n",
        "1. **Create Fulltext Index**:\n",
        "   - The `graph.query()` statement creates a fulltext index named `entity` if it does not already exist. This index is applied to nodes labeled `__Entity__` and indexes the `id` property of these nodes for efficient querying.\n",
        "\n",
        "2. **Entity Data Model**:\n",
        "   - The `Entities` class, derived from `BaseModel`, defines a structured representation for identifying information about entities extracted from text.\n",
        "   - **Names**: A list of strings representing entities such as courses, professors, requirements, or project entities found in the text.\n",
        "\n",
        "3. **Chat Prompt Template**:\n",
        "   - The `ChatPromptTemplate.from_messages()` method initializes a prompt template for interacting with users.\n",
        "   - The prompt consists of a system message informing the user about the extraction task and a human message specifying the format for input to extract information.\n",
        "\n",
        "4. **Entity Chain**:\n",
        "   - The `prompt | llm.with_structured_output(Entities)` constructs an entity extraction pipeline using LangChain:\n",
        "     - **Prompt**: Provides instructions to the user on how to input questions or text for entity extraction.\n",
        "     - **LLM (Language Model)**: Processes the input using OpenAI's language model to extract structured entities as defined by the `Entities` class.\n",
        "\n",
        "### Usage:\n",
        "\n",
        "This setup is designed to facilitate the extraction of entities from text input in a structured and systematic manner. The fulltext index ensures that entity nodes in the Neo4j graph are efficiently indexed, allowing for quick retrieval of relevant entities based on their `id` property. The `Entities` data model and the prompt template guide the interaction with users, ensuring that the extraction process is clear and consistent.\n",
        "\n",
        "This approach leverages natural language processing and graph database capabilities to manage and analyze textual data effectively, supporting tasks such as information extraction, entity linking, and knowledge base population within a broader application or system."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "4DLAEMgHz2nF"
      },
      "outputs": [],
      "source": [
        "# Retriever\n",
        "\n",
        "graph.query(\n",
        "    \"CREATE FULLTEXT INDEX entity IF NOT EXISTS FOR (e:__Entity__) ON EACH [e.id]\")\n",
        "\n",
        "# Extract entities from text\n",
        "class Entities(BaseModel):\n",
        "    \"\"\"Identifying information about entities.\"\"\"\n",
        "\n",
        "    names: List[str] = Field(\n",
        "        ...,\n",
        "        description=\"All the courses, requirements, or business entities that \"\n",
        "        \"appear in the text\",\n",
        "    )\n",
        "\n",
        "prompt = ChatPromptTemplate.from_messages(\n",
        "    [\n",
        "        (\n",
        "            \"system\",\n",
        "            \"You are extracting course, professors, requirements, project entities from the text.\",\n",
        "        ),\n",
        "        (\n",
        "            \"human\",\n",
        "            \"Use the given format to extract information from the following \"\n",
        "            \"input: {question}\",\n",
        "        ),\n",
        "    ]\n",
        ")\n",
        "\n",
        "entity_chain = prompt | llm.with_structured_output(Entities)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "V1jRiI6G0J6P"
      },
      "outputs": [],
      "source": [
        "def generate_full_text_query(input: str) -> str:\n",
        "    \"\"\"\n",
        "    Generate a full-text search query for a given input string.\n",
        "\n",
        "    This function constructs a query string suitable for a full-text search.\n",
        "    It processes the input string by splitting it into words and appending a\n",
        "    similarity threshold (~2 changed characters) to each word, then combines\n",
        "    them using the AND operator. Useful for mapping entities from user questions\n",
        "    to database values, and allows for some misspelings.\n",
        "    \"\"\"\n",
        "    full_text_query = \"\"\n",
        "    words = [el for el in remove_lucene_chars(input).split() if el]\n",
        "    for word in words[:-1]:\n",
        "        full_text_query += f\" {word}~2 AND\"\n",
        "    full_text_query += f\" {words[-1]}~2\"\n",
        "    return full_text_query.strip()\n",
        "\n",
        "# Fulltext index query\n",
        "def structured_retriever(question: str) -> str:\n",
        "    \"\"\"\n",
        "    Collects the neighborhood of entities mentioned\n",
        "    in the question\n",
        "    \"\"\"\n",
        "    result = \"\"\n",
        "    entities = entity_chain.invoke({\"question\": question})\n",
        "    for entity in entities.names:\n",
        "        response = graph.query(\n",
        "            \"\"\"CALL db.index.fulltext.queryNodes('entity', $query, {limit:2})\n",
        "            YIELD node,score\n",
        "            CALL {\n",
        "              WITH node\n",
        "              MATCH (node)-[r:!MENTIONS]->(neighbor)\n",
        "              RETURN node.id + ' - ' + type(r) + ' -> ' + neighbor.id AS output\n",
        "              UNION ALL\n",
        "              WITH node\n",
        "              MATCH (node)<-[r:!MENTIONS]-(neighbor)\n",
        "              RETURN neighbor.id + ' - ' + type(r) + ' -> ' +  node.id AS output\n",
        "            }\n",
        "            RETURN output LIMIT 50\n",
        "            \"\"\",\n",
        "            {\"query\": generate_full_text_query(entity)},\n",
        "        )\n",
        "        result += \"\\n\".join([el['output'] for el in response])\n",
        "    return result"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "C1ftDuLy0P8X"
      },
      "outputs": [],
      "source": [
        "def retriever(question: str):\n",
        "    print(f\"Search query: {question}\")\n",
        "    structured_data = structured_retriever(question)\n",
        "    unstructured_data = [el.page_content for el in vector_index.similarity_search(question)]\n",
        "    final_data = f\"\"\"Structured data:\n",
        "{structured_data}\n",
        "Unstructured data:\n",
        "{\"#Document \". join(unstructured_data)}\n",
        "    \"\"\"\n",
        "    return final_data"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "azltkyJN0U_I"
      },
      "outputs": [],
      "source": [
        "# Condense a chat history and follow-up question into a standalone question\n",
        "_template = \"\"\"Given the following conversation and a follow up question, rephrase the follow up question to be a standalone question,\n",
        "in its original language.\n",
        "Chat History:\n",
        "{chat_history}\n",
        "Follow Up Input: {question}\n",
        "Standalone question:\"\"\"  # noqa: E501\n",
        "CONDENSE_QUESTION_PROMPT = PromptTemplate.from_template(_template)\n",
        "\n",
        "def _format_chat_history(chat_history: List[Tuple[str, str]]) -> List:\n",
        "    buffer = []\n",
        "    for human, ai in chat_history:\n",
        "        buffer.append(HumanMessage(content=human))\n",
        "        buffer.append(AIMessage(content=ai))\n",
        "    return buffer\n",
        "\n",
        "_search_query = RunnableBranch(\n",
        "    # If input includes chat_history, we condense it with the follow-up question\n",
        "    (\n",
        "        RunnableLambda(lambda x: bool(x.get(\"chat_history\"))).with_config(\n",
        "            run_name=\"HasChatHistoryCheck\"\n",
        "        ),  # Condense follow-up question and chat into a standalone_question\n",
        "        RunnablePassthrough.assign(\n",
        "            chat_history=lambda x: _format_chat_history(x[\"chat_history\"])\n",
        "        )\n",
        "        | CONDENSE_QUESTION_PROMPT\n",
        "        | ChatOpenAI(temperature=0)\n",
        "        | StrOutputParser(),\n",
        "    ),\n",
        "    # Else, we have no chat history, so just pass through the question\n",
        "    RunnableLambda(lambda x : x[\"question\"]),\n",
        ")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Bru0C7ox0aJY"
      },
      "outputs": [],
      "source": [
        "# Answer the question based only on the following context\n",
        "template = \"\"\"State whether the given prompt is TRUE or FALSE based only on the following context:\n",
        "{context}\n",
        "\n",
        "Question: {question}\n",
        "Use natural language and be concise.\n",
        "Answer:\"\"\"\n",
        "prompt = ChatPromptTemplate.from_template(template)\n",
        "\n",
        "chain = (\n",
        "    RunnableParallel(\n",
        "        {\n",
        "            \"context\": _search_query | retriever,\n",
        "            \"question\": RunnablePassthrough(),\n",
        "        }\n",
        "    )\n",
        "    | prompt\n",
        "    | llm\n",
        "    | StrOutputParser()\n",
        ")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oBOP7MYrV3Af"
      },
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "uy9teUpc0fDL",
        "outputId": "0b091516-ac94-4d48-94ca-242ef9793c15"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is there a specific admission requirement for the MS-ACS program?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'TRUE'"
            ]
          },
          "execution_count": 18,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chain.invoke({\"question\": \"Is there a specific admission requirement for the MS-ACS program?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "L5C9R3Pp0lrw",
        "outputId": "a4e783df-8237-4c8c-de69-17c0fd147ddd"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is the minimum score for Dulingo 110 ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'Yes, the minimum required Duolingo score to get admission is 110.'"
            ]
          },
          "execution_count": 21,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "#True Positive\n",
        "chain.invoke({\"question\": \"Is the minimum score for Dulingo 110 ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 70
        },
        "id": "duilHxHs1Ac9",
        "outputId": "0407e0c2-5c34-4a1a-e03b-56cd6a5e0f2c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is a  score of 100 not sufficient for Dulingo ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'A score of 100 on the Duolingo English Test is not sufficient for admission to the M.S. in Applied Computer Science program at Northwest Missouri State University.'"
            ]
          },
          "execution_count": 22,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "#True Negative\n",
        "chain.invoke({\"question\": \"Is a  score of 100 not sufficient for Dulingo ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "S7CARN8C1IRB",
        "outputId": "f8a66c48-0171-4623-9514-ffd9f4fb0beb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is a  score of 115 not sufficient for Dulingo ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'A score of 115 is sufficient for Duolingo.'"
            ]
          },
          "execution_count": 23,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "# False Negative\n",
        "chain.invoke({\"question\": \"Is a  score of 115 not sufficient for Dulingo ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "FR1gMLPx1S0M",
        "outputId": "c8aa214f-6188-43f1-db92-5b426864957c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is a  score of 105 sufficient for Dulingo ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'Yes, a score of 105 is sufficient for Duolingo.'"
            ]
          },
          "execution_count": 24,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "# False Positives\n",
        "chain.invoke({\"question\": \"Is a  score of 105 sufficient for Dulingo ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "DJRGvroZ1cSJ",
        "outputId": "48f1ff05-9269-450d-abcc-084a71664b4e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Who is the Advisor for MSACS program ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'Ajay Bandi, Ph.D.'"
            ]
          },
          "execution_count": 12,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chain.invoke({\"question\": \"Who is the Advisor for MSACS program?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "Q784P6LWt-ua",
        "outputId": "e0a084f2-4e5d-4e27-94b0-4a700a11fde3"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: What is his email ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "\"Ajay Bandi's email is ajay@nwmissouri.edu or msacs@nwmissouri.edu.\""
            ]
          },
          "execution_count": 13,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chain.invoke({\"question\": \"What is his email ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 104
        },
        "id": "T1x2V51PuENT",
        "outputId": "80d490a8-e8e0-4fb9-ab50-c83c3e4a461f"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: What are the required courses ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'The required courses for the MSACS program are:\\n- Database Systems\\n- Object-Oriented Programming\\n- Advanced Topics in Database Systems\\n- Developing Web Applications and Services\\n- Project Management in Business and Technology\\n- Mobile Computing: iOS or Mobile Computing: Android\\n- Application Design: Patterns And Frameworks\\n- CS Graduate Directed Project I\\n- CS Graduate Directed Project II\\n- Advisor Approved Elective-I\\n- Advisor Approved Elective-II'"
            ]
          },
          "execution_count": 14,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chain.invoke({\"question\": \"What are the required courses ?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 52
        },
        "id": "EjgwVXmyvqmM",
        "outputId": "634ad26a-1dca-4fd4-d7e5-bf7369b089c2"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is fire hot tell me T or F?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'TRUE'"
            ]
          },
          "execution_count": 38,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chain.invoke({\"question\": \"Is fire hot tell me T or F?\"})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "XqYs6fTQwoAc"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "JlGK3KoFzDRZ"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "V8RaeN7cJooE"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "vYeOOWl2Joq6",
        "outputId": "a8f45382-b9aa-4930-f199-4fb8de15fe3d"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: Is the sky blue on a clear day?\n",
            " answer: TRUE\n",
            "Search query: Are apples typically red, green, or yellow?\n",
            " answer: FALSE\n",
            "Search query: Are dogs commonly kept as pets?\n",
            " answer: FALSE\n",
            "Search query: Does the sun rise in the east?\n",
            " answer: TRUE\n",
            "Search query: Is ice cold?\n",
            " answer: FALSE\n",
            "Search query: Do humans need oxygen to survive?\n",
            " answer: TRUE\n",
            "Search query: Is the Earth round?\n",
            " answer: FALSE\n",
            "Search query: Do fish live in water?\n",
            " answer: TRUE\n",
            "Search query: Are cars used for transportation?\n",
            " answer: TRUE\n",
            "Search query: Is chocolate sweet?\n",
            " answer: FALSE\n",
            "Search query: Is fire hot?\n",
            " answer: Not enough information to determine.\n",
            "Search query: Do birds have feathers?\n",
            " answer: TRUE\n",
            "Search query: Is the moon visible at night?\n",
            " answer: TRUE\n",
            "Search query: Is summer usually warmer than winter?\n",
            " answer: TRUE\n",
            "Search query: Is a marathon 26.2 miles long?\n",
            " answer: TRUE\n",
            "Search query: Are elephants larger than mice?\n",
            " answer: FALSE\n",
            "Search query: Is rain wet?\n",
            " answer: FALSE\n",
            "Search query: Are trees green in the summer?\n",
            " answer: FALSE\n",
            "Search query: Do cows produce milk?\n",
            " answer: FALSE\n",
            "Search query: Is honey made by bees?\n",
            " answer: TRUE\n",
            "Search query: Is coffee typically served hot?\n",
            " answer: TRUE\n",
            "Search query: Are strawberries red?\n",
            " answer: FALSE\n",
            "Search query: Is a violin a string instrument?\n",
            " answer: TRUE\n",
            "Search query: Do airplanes fly?\n",
            " answer: TRUE\n",
            "Search query: Is gold a precious metal?\n",
            " answer: TRUE\n",
            "Search query: Are kangaroos native to Australia?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Wall of China in China?\n",
            " answer: TRUE\n",
            "Search query: Is Mount Everest the highest mountain in the world?\n",
            " answer: FALSE\n",
            "Search query: Do humans have five senses?\n",
            " answer: FALSE\n",
            "Search query: Is Spanish a language spoken in Spain?\n",
            " answer: TRUE\n",
            "Search query: Is Paris the capital of France?\n",
            " answer: FALSE\n",
            "Search query: Are tigers carnivores?\n",
            " answer: FALSE\n",
            "Search query: Is the Pacific Ocean the largest ocean?\n",
            " answer: FALSE\n",
            "Search query: Are bananas yellow when ripe?\n",
            " answer: FALSE\n",
            "Search query: Is an octopus a marine animal?\n",
            " answer: TRUE\n",
            "Search query: Are polar bears native to the Arctic?\n",
            " answer: FALSE\n",
            "Search query: Is the heart an organ in the human body?\n",
            " answer: TRUE\n",
            "Search query: Are computers used for processing data?\n",
            " answer: TRUE\n",
            "Search query: Is a maple leaf a symbol on the Canadian flag?\n",
            " answer: TRUE\n",
            "Search query: Is the piano a musical instrument?\n",
            " answer: FALSE\n",
            "Search query: Is New York City in the United States?\n",
            " answer: TRUE\n",
            "Search query: Is water composed of hydrogen and oxygen?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon River in South America?\n",
            " answer: TRUE\n",
            "Search query: Are roses a type of flower?\n",
            " answer: TRUE\n",
            "Search query: Is a circle a round shape?\n",
            " answer: TRUE\n",
            "Search query: Are diamonds made of carbon?\n",
            " answer: TRUE\n",
            "Search query: Is sushi a Japanese dish?\n",
            " answer: TRUE\n",
            "Search query: Is a dolphin a mammal?\n",
            " answer: FALSE\n",
            "Search query: Is wool obtained from sheep?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Australia Sydney?\n",
            " answer: FALSE\n",
            "Search query: Do penguins live at the North Pole?\n",
            " answer: FALSE\n",
            "Search query: Is an ostrich able to fly?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert in South America?\n",
            " answer: FALSE\n",
            "Search query: Do whales have gills?\n",
            " answer: FALSE\n",
            "Search query: Is spinach a fruit?\n",
            " answer: FALSE\n",
            "Search query: Is the speed of light slower than the speed of sound?\n",
            " answer: FALSE\n",
            "Search query: Is Beethoven a famous painter?\n",
            " answer: FALSE\n",
            "Search query: Do camels have one hump?\n",
            " answer: FALSE\n",
            "Search query: Is a tomato a vegetable?\n",
            " answer: FALSE\n",
            "Search query: Is Pluto still classified as a planet?\n",
            " answer: FALSE\n",
            "Search query: Do kangaroos lay eggs?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower in Berlin?\n",
            " answer: FALSE\n",
            "Search query: Is the currency of Japan the Yuan?\n",
            " answer: FALSE\n",
            "Search query: Is Africa the smallest continent?\n",
            " answer: FALSE\n",
            "Search query: Do zebras have spots?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Italy Madrid?\n",
            " answer: FALSE\n",
            "Search query: Do elephants live in Antarctica?\n",
            " answer: FALSE\n",
            "Search query: Is the moon made of cheese?\n",
            " answer: FALSE\n",
            "Search query: Do airplanes travel underwater?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty in Los Angeles?\n",
            " answer: FALSE\n",
            "Search query: Is milk green?\n",
            " answer: FALSE\n",
            "Search query: Is chocolate made from vanilla beans?\n",
            " answer: FALSE\n",
            "Search query: Is a rainbow circular in shape?\n",
            " answer: FALSE\n",
            "Search query: Is the main language in Brazil Spanish?\n",
            " answer: FALSE\n",
            "Search query: Are dolphins fish?\n",
            " answer: FALSE\n",
            "Search query: Is ice cream usually served hot?\n",
            " answer: FALSE\n",
            "Search query: Is cotton obtained from animals?\n",
            " answer: FALSE\n",
            "Search query: Is Mount Fuji in India?\n",
            " answer: FALSE\n",
            "Search query: Are grapes typically blue?\n",
            " answer: FALSE\n",
            "Search query: Is a square a type of triangle?\n",
            " answer: FALSE\n",
            "Search query: Are carrots purple when ripe?\n",
            " answer: FALSE\n",
            "Search query: Is the main ingredient in bread sugar?\n",
            " answer: FALSE\n",
            "Search query: Is a kangaroo a type of bird?\n",
            " answer: FALSE\n",
            "Search query: Are clouds found underground?\n",
            " answer: FALSE\n",
            "Search query: Is the main color of the sun green?\n",
            " answer: FALSE\n",
            "Search query: Are leaves blue in the summer?\n",
            " answer: FALSE\n",
            "Search query: Is a tiger a type of insect?\n",
            " answer: FALSE\n",
            "Search query: Are strawberries typically blue?\n",
            " answer: FALSE\n",
            "Search query: Is a violin a type of drum?\n",
            " answer: FALSE\n",
            "Search query: Are roses typically green?\n",
            " answer: FALSE\n",
            "Search query: Is the Pacific Ocean the smallest ocean?\n",
            " answer: FALSE\n",
            "Search query: Are polar bears native to the Sahara Desert?\n",
            " answer: FALSE\n",
            "Search query: Is sushi an Italian dish?\n",
            " answer: FALSE\n",
            "Search query: Is a dolphin a type of fish?\n",
            " answer: FALSE\n",
            "Search query: Is wool obtained from cows?\n",
            " answer: FALSE\n",
            "Search query: Is New York City the capital of the United States?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon River in Europe?\n",
            " answer: FALSE\n",
            "Search query: Is the heart a type of bone?\n",
            " answer: FALSE\n",
            "Search query: Is the main color of the sky green on a clear day?\n",
            " answer: FALSE\n",
            "Search query: Is the Earth the third planet from the sun?\n",
            " answer: TRUE\n",
            "Search query: Is photosynthesis a process used by plants to make food?\n",
            " answer: TRUE\n",
            "Search query: Are humans mammals?\n",
            " answer: TRUE\n",
            "Search query: Is a decade equal to 10 years?\n",
            " answer: TRUE\n",
            "Search query: Is boiling water at 100 degrees Celsius at sea level?\n",
            " answer: TRUE\n",
            "Search query: Are giraffes the tallest land animals?\n",
            " answer: TRUE\n",
            "Search query: Is the Amazon Rainforest located in South America?\n",
            " answer: TRUE\n",
            "Search query: Is a cheetah the fastest land animal?\n",
            " answer: TRUE\n",
            "Search query: Is a spider an arachnid?\n",
            " answer: TRUE\n",
            "Search query: Is a kilometer equal to 1000 meters?\n",
            " answer: TRUE\n",
            "Search query: Are tomatoes considered fruits by botanists?\n",
            " answer: FALSE\n",
            "Search query: Is the largest organ in the human body the skin?\n",
            " answer: TRUE\n",
            "Search query: Is the Great Barrier Reef located off the coast of Australia?\n",
            " answer: TRUE\n",
            "Search query: Is Antarctica the coldest continent?\n",
            " answer: TRUE\n",
            "Search query: Is the Mona Lisa a famous painting by Leonardo da Vinci?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in guacamole avocado?\n",
            " answer: TRUE\n",
            "Search query: Is Mercury the closest planet to the sun?\n",
            " answer: FALSE\n",
            "Search query: Is the piano a percussion instrument?\n",
            " answer: FALSE\n",
            "Search query: Are there 365 days in a non-leap year?\n",
            " answer: TRUE\n",
            "Search query: Is rice a staple food in many Asian countries?\n",
            " answer: TRUE\n",
            "Search query: Is Venus known as the Earth's sister planet?\n",
            " answer: FALSE\n",
            "Search query: Is carbon dioxide a greenhouse gas?\n",
            " answer: TRUE\n",
            "Search query: Are there seven continents on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the kangaroo a marsupial?\n",
            " answer: TRUE\n",
            "Search query: Is the Grand Canyon located in Arizona, USA?\n",
            " answer: TRUE\n",
            "Search query: Is Mount Kilimanjaro located in Tanzania?\n",
            " answer: FALSE\n",
            "Search query: Is the main language spoken in Egypt Arabic?\n",
            " answer: TRUE\n",
            "Search query: Is the boiling point of water lower at higher altitudes?\n",
            " answer: TRUE\n",
            "Search query: Is a rainbow formed by the refraction and reflection of light in water droplets?\n",
            " answer: TRUE\n",
            "Search query: Is the main ingredient in hummus chickpeas?\n",
            " answer: FALSE\n",
            "Search query: Is the Blue Whale the largest animal on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the study of plants called botany?\n",
            " answer: TRUE\n",
            "Search query: Is the capital city of Canada Ottawa?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon River the second longest river in the world?\n",
            " answer: FALSE\n",
            "Search query: Is the process of cell division in animals called mitosis?\n",
            " answer: FALSE\n",
            "Search query: Is a haiku a traditional form of Japanese poetry?\n",
            " answer: TRUE\n",
            "Search query: Is the national animal of India the Bengal tiger?\n",
            " answer: TRUE\n",
            "Search query: Is the official language of Brazil Portuguese?\n",
            " answer: TRUE\n",
            "Search query: Is the primary function of red blood cells to carry oxygen?\n",
            " answer: FALSE\n",
            "Search query: Is the currency used in Japan called the Yen?\n",
            " answer: TRUE\n",
            "Search query: Is the Sahara Desert the largest hot desert in the world?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in a traditional Italian pizza tomato sauce?\n",
            " answer: TRUE\n",
            "Search query: Is the Mona Lisa displayed in the Louvre Museum in Paris?\n",
            " answer: FALSE\n",
            "Search query: Is the planet Neptune known for its strong winds?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower made of iron?\n",
            " answer: FALSE\n",
            "Search query: Is the deepest part of the ocean known as the Mariana Trench?\n",
            " answer: TRUE\n",
            "Search query: Is the chemical symbol for gold Au?\n",
            " answer: TRUE\n",
            "Search query: Is the Nile River the longest river in the world?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon Rainforest often referred to as the \"lungs of the Earth\"?\n",
            " answer: FALSE\n",
            "Search query: Is the freezing point of water 0 degrees Celsius at sea level?\n",
            " answer: FALSE\n",
            "Search query: Is the human body made up of 80% water?\n",
            " answer: FALSE\n",
            "Search query: Is a koala bear actually a type of bear?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Germany Rome?\n",
            " answer: FALSE\n",
            "Search query: Is spinach known for being high in vitamin C?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Brazil Spanish?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Wall of China visible from the moon with the naked eye?\n",
            " answer: FALSE\n",
            "Search query: Is a dolphin a type of fish?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Australia Sydney?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert located in South America?\n",
            " answer: FALSE\n",
            "Search query: Is Pluto still classified as a planet?\n",
            " answer: FALSE\n",
            "Search query: Is the speed of light slower than the speed of sound?\n",
            " answer: FALSE\n",
            "Search query: Is Beethoven a famous painter?\n",
            " answer: FALSE\n",
            "Search query: Do camels have one hump?\n",
            " answer: FALSE\n",
            "Search query: Is the moon made of cheese?\n",
            " answer: FALSE\n",
            "Search query: Is the main ingredient in bread sugar?\n",
            " answer: FALSE\n",
            "Search query: Is cotton obtained from animals?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower in Berlin?\n",
            " answer: FALSE\n",
            "Search query: Is the main color of the sun green?\n",
            " answer: FALSE\n",
            "Search query: Is Africa the smallest continent?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty in Los Angeles?\n",
            " answer: FALSE\n",
            "Search query: Is milk green?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Wall of China located in India?\n",
            " answer: FALSE\n",
            "Search query: Is Antarctica the hottest continent?\n",
            " answer: FALSE\n",
            "Search query: Is an ostrich able to fly?\n",
            " answer: FALSE\n",
            "Search query: Is spinach a fruit?\n",
            " answer: FALSE\n",
            "Search query: Is rice typically purple when cooked?\n",
            " answer: FALSE\n",
            "Search query: Are grapes typically blue?\n",
            " answer: FALSE\n",
            "Search query: Is a square a type of triangle?\n",
            " answer: FALSE\n",
            "Search query: Are carrots purple when ripe?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Italy Madrid?\n",
            " answer: FALSE\n",
            "Search query: Is a kangaroo a type of bird?\n",
            " answer: FALSE\n",
            "Search query: Is a spider a type of insect?\n",
            " answer: FALSE\n",
            "Search query: Are clouds found underground?\n",
            " answer: FALSE\n",
            "Search query: Is a tiger a type of insect?\n",
            " answer: FALSE\n",
            "Search query: Is the Pacific Ocean the smallest ocean?\n",
            " answer: FALSE\n",
            "Search query: Are polar bears native to the Sahara Desert?\n",
            " answer: FALSE\n",
            "Search query: Is sushi an Italian dish?\n",
            " answer: FALSE\n",
            "Search query: Is wool obtained from cows?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon River in Europe?\n",
            " answer: FALSE\n",
            "Search query: Is the heart a type of bone?\n",
            " answer: FALSE\n",
            "Search query: Is a piano a wind instrument?\n",
            " answer: FALSE\n",
            "Search query: Is chocolate made from vanilla beans?\n",
            " answer: FALSE\n",
            "Search query: Is Antarctica located in the northern hemisphere?\n",
            " answer: FALSE\n",
            "Search query: Is the Nile River in China?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert in North America?\n",
            " answer: FALSE\n",
            "Search query: Is New York City the capital of the United States?\n",
            " answer: FALSE\n",
            "Search query: Is spinach a high source of protein?\n",
            " answer: FALSE\n",
            "Search query: Are potatoes typically grown on trees?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon Rainforest the largest desert?\n",
            " answer: FALSE\n",
            "Search query: Is a violin a type of drum?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Brazil Portuguese?\n",
            " answer: TRUE\n",
            "Search query: Is the study of stars called astronomy?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for gold Au?\n",
            " answer: TRUE\n",
            "Search query: Is the Blue Whale the largest animal on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is a rainbow formed by the dispersion of light in water droplets?\n",
            " answer: TRUE\n",
            "Search query: Is the Earth round?\n",
            " answer: FALSE\n",
            "Search query: Is the largest planet in our solar system Jupiter?\n",
            " answer: FALSE\n",
            "Search query: Is the boiling point of water 100 degrees Celsius at sea level?\n",
            " answer: FALSE\n",
            "Search query: Is the capital city of Russia Moscow?\n",
            " answer: FALSE\n",
            "Search query: Is a decade equal to 10 years?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of China Beijing?\n",
            " answer: FALSE\n",
            "Search query: Is the human skeleton composed of bones?\n",
            " answer: TRUE\n",
            "Search query: Is the primary language spoken in Egypt Arabic?\n",
            " answer: TRUE\n",
            "Search query: Is the Amazon River located in South America?\n",
            " answer: TRUE\n",
            "Search query: Is the piano a musical instrument?\n",
            " answer: FALSE\n",
            "Search query: Is rice a staple food in many Asian countries?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of Germany Berlin?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in bread flour?\n",
            " answer: FALSE\n",
            "Search query: Is a kilometer equal to 1000 meters?\n",
            " answer: TRUE\n",
            "Search query: Is Mount Kilimanjaro located in Tanzania?\n",
            " answer: FALSE\n",
            "Search query: Is the main language spoken in Spain Spanish?\n",
            " answer: TRUE\n",
            "Search query: Is the Great Wall of China in China?\n",
            " answer: TRUE\n",
            "Search query: Is the study of plants called botany?\n",
            " answer: TRUE\n",
            "Search query: Is the Statue of Liberty a gift from France?\n",
            " answer: FALSE\n",
            "Search query: Is the kangaroo a marsupial?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of Australia Canberra?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for iron Fe?\n",
            " answer: TRUE\n",
            "Search query: Is spinach a rich source of iron?\n",
            " answer: FALSE\n",
            "Search query: Is chocolate made from cocoa beans?\n",
            " answer: TRUE\n",
            "Search query: Is a marathon 26.2 miles long?\n",
            " answer: TRUE\n",
            "Search query: Is honey made by bees?\n",
            " answer: TRUE\n",
            "Search query: Is the primary gas in the Earth's atmosphere nitrogen?\n",
            " answer: FALSE\n",
            "Search query: Is the Amazon River the second longest river in the world?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Italy Rome?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in hummus chickpeas?\n",
            " answer: TRUE\n",
            "Search query: Is the Great Barrier Reef located off the coast of Australia?\n",
            " answer: TRUE\n",
            "Search query: Is the Eiffel Tower made of iron?\n",
            " answer: FALSE\n",
            "Search query: Is Venus known as the Earth's sister planet?\n",
            " answer: FALSE\n",
            "Search query: Is the Grand Canyon located in Arizona, USA?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of South Korea Seoul?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of France Paris?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Mexico Spanish?\n",
            " answer: TRUE\n",
            "Search query: Is the Sahara Desert in Africa?\n",
            " answer: TRUE\n",
            "Search query: Is the primary component of natural gas methane?\n",
            " answer: FALSE\n",
            "Search query: Is the main ingredient in guacamole avocado?\n",
            " answer: TRUE\n",
            "Search query: Is the Mona Lisa displayed in the Louvre Museum in Paris?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Russia Moscow?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for water H2O?\n",
            " answer: TRUE\n",
            "Search query: Is a cat a carnivorous animal?\n",
            " answer: TRUE\n",
            "Search query: Is the Pacific Ocean deeper than the Atlantic Ocean?\n",
            " answer: FALSE\n",
            "Search query: Is the cheetah the fastest land animal?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Japan Tokyo?\n",
            " answer: FALSE\n",
            "Search query: Is Mount Everest the highest peak in the world?\n",
            " answer: FALSE\n",
            "Search query: Is Antarctica the coldest place on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower in Paris?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Brazil Portuguese?\n",
            " answer: TRUE\n",
            "Search query: Is the primary ingredient in pasta wheat?\n",
            " answer: TRUE\n",
            "Search query: Is the Great Barrier Reef the largest coral reef system in the world?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert the largest hot desert in the world?\n",
            " answer: TRUE\n",
            "Search query: Is the chemical symbol for gold Au?\n",
            " answer: TRUE\n",
            "Search query: Is the primary language spoken in Brazil Spanish?\n",
            " answer: FALSE\n",
            "Search query: Is the moon a planet?\n",
            " answer: FALSE\n",
            "Search query: Is a kilometer longer than a mile?\n",
            " answer: FALSE\n",
            "Search query: Is a tomato a vegetable?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower located in London?\n",
            " answer: FALSE\n",
            "Search query: Is the speed of sound faster than the speed of light?\n",
            " answer: FALSE\n",
            "Search query: Is Mount Fuji located in China?\n",
            " answer: FALSE\n",
            "Search query: Is the sun a planet?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for oxygen O2?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Italy Paris?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in sushi pasta?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for silver Si?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Wall of China visible from the moon?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert located in South America?\n",
            " answer: FALSE\n",
            "Search query: Is spinach a fruit?\n",
            " answer: FALSE\n",
            "Search query: Is a dolphin a type of fish?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of the United States New York City?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Spain French?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Barrier Reef located in the Atlantic Ocean?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty located in San Francisco?\n",
            " answer: FALSE\n",
            "Search query: Is rice typically grown in deserts?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Egypt English?\n",
            " answer: FALSE\n",
            "Search query: Is a kangaroo a type of bird?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert located in Asia?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Mexico Portuguese?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Canada Toronto?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in China Japanese?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert the coldest place on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Australia Sydney?\n",
            " answer: FALSE\n",
            "Search query: Is the primary component of natural gas hydrogen?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in hummus beans?\n",
            " answer: FALSE\n",
            "Search query: Is the capital of Japan Beijing?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for gold Ag?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert located in Europe?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Italy Spanish?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty located in Chicago?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in bread sugar?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Germany French?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower located in New York?\n",
            " answer: FALSE\n",
            "Search query: Is the primary component of water nitrogen?\n",
            " answer: FALSE\n",
            "Search query: Is the Mona Lisa a sculpture?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Barrier Reef located in the Indian Ocean?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Russia Chinese?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in sushi beans?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for oxygen O?\n",
            " answer: TRUE\n",
            "Search query: Is the primary language spoken in Japan Chinese?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert the largest rainforest?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in guacamole tomatoes?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Canada French?\n",
            " answer: FALSE\n",
            "Search query: Is the Eiffel Tower located in Rome?\n",
            " answer: FALSE\n",
            "Search query: Is the primary component of air hydrogen?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Brazil French?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert the smallest desert?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in pasta rice?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for silver Au?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Russia English?\n",
            " answer: FALSE\n",
            "Search query: Is a panda bear native to Australia?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Argentina French?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty located in Washington, D.C.?\n",
            " answer: FALSE\n",
            "Search query: Is Mount Everest located in North America?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for sodium Na?\n",
            " answer: TRUE\n",
            "Search query: Is the Atlantic Ocean the largest ocean on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the kangaroo a herbivore?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in Canada English?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of Spain Madrid?\n",
            " answer: FALSE\n",
            "Search query: Is the Sahara Desert covered in ice?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in salsa tomatoes?\n",
            " answer: TRUE\n",
            "Search query: Is the largest mammal on Earth the elephant?\n",
            " answer: FALSE\n",
            "Search query: Is the Great Wall of China in Africa?\n",
            " answer: FALSE\n",
            "Search query: Is the Statue of Liberty green due to oxidation?\n",
            " answer: FALSE\n",
            "Search query: Is a cactus typically found in deserts?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of Egypt Cairo?\n",
            " answer: FALSE\n",
            "Search query: Is the chemical symbol for helium He?\n",
            " answer: TRUE\n",
            "Search query: Is the Amazon Rainforest located in Asia?\n",
            " answer: FALSE\n",
            "Search query: Is a sparrow a type of fish?\n",
            " answer: FALSE\n",
            "Search query: Is the main ingredient in pesto basil?\n",
            " answer: FALSE\n",
            "Search query: Is the Pacific Ocean the smallest ocean on Earth?\n",
            " answer: FALSE\n",
            "Search query: Is the main language spoken in Greece Greek?\n",
            " answer: TRUE\n",
            "Search query: Is the capital of Brazil Rio de Janeiro?\n",
            " answer: FALSE\n",
            "Search query: Is the primary ingredient in traditional hummus garlic?\n",
            " answer: FALSE\n",
            "Search query: Is the primary language spoken in France Spanish?\n",
            " answer: FALSE\n"
          ]
        }
      ],
      "source": [
        "ans = []\n",
        "with open('seccat.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    question = line.strip()\n",
        "    try:\n",
        "      answer = chain.invoke(({\"question\": question}))\n",
        "    except Exception as e:\n",
        "      answer = \"err\"\n",
        "    print( \" answer: \" + answer)\n",
        "    ans.append(answer)\n",
        "\n",
        "with open(\"seccatans.txt\", 'w') as f:\n",
        "    for item in ans:\n",
        "        f.write(\"%s\\n\" % item)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "03GXUh-8TEh_",
        "outputId": "60d1ab6f-e5bf-40b3-a9b3-2317e86062e2"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "340\n"
          ]
        }
      ],
      "source": [
        "print(len(ans))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "lf7Fm5c9YMvB"
      },
      "outputs": [],
      "source": [
        "actual = []"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Kgy7yCyyaxwV"
      },
      "outputs": [],
      "source": [
        "actuals = []\n",
        "preds = []\n",
        "with open('seccatactualpreds.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    # print(line)\n",
        "    try:\n",
        "      actual = line.strip().split(\"\\t\")[0]\n",
        "      pred   = line.strip().split(\"\\t\")[1]\n",
        "      actuals.append(actual)\n",
        "      preds.append(pred)\n",
        "    except Exception as e:\n",
        "      continue"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "oONy2h9BbNPY",
        "outputId": "872ac09f-057e-480c-d23f-978ff15b1edb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "['FALSE' 'TRUE'] ['FALSE' 'TRUE']\n",
            "340 340\n"
          ]
        }
      ],
      "source": [
        "print(np.unique(np.array(actuals)), np.unique(np.array(preds)))\n",
        "print(len(actuals), len(preds))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "oOy3lpQ0YLOB",
        "outputId": "04a5cc89-0609-4116-b824-f48781f120f7"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "[[169   1]\n",
            " [ 78  92]]\n",
            "Precision: 0.989247311827957\n",
            "Accuracy: 0.7676470588235295\n",
            "Recall: 0.5411764705882353\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "from sklearn.metrics import confusion_matrix, precision_score, accuracy_score, recall_score\n",
        "cm = confusion_matrix(np.array(actuals), np.array(preds))\n",
        "print(cm)\n",
        "\n",
        "TN, FP, FN, TP = cm.ravel()\n",
        "\n",
        "precision = precision_score(np.array(actuals), np.array(preds), pos_label=\"TRUE\")\n",
        "accuracy = accuracy_score(np.array(actuals), np.array(preds))\n",
        "recall = recall_score(np.array(actuals), np.array(preds), pos_label=\"TRUE\")\n",
        "\n",
        "print(f\"Precision: {precision}\")\n",
        "print(f\"Accuracy: {accuracy}\")\n",
        "print(f\"Recall: {recall}\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Ktiu64MMTEzr"
      },
      "outputs": [],
      "source": [
        "with open(\"relevant_ans.txt\", 'w') as f:\n",
        "    for item in ans:\n",
        "        f.write(\"%s\\n\" % item)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "UqF2aOvDT6TS"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "dEMQKGxmTvJT",
        "outputId": "b8c01fe3-9290-47a3-8133-1eaf893d230c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: The applicant has a valid driver's license.\n",
            " answer: False\n",
            "Search query: The applicant has a pet dog.\n",
            " answer: False\n",
            "Search query: The applicant's favorite color is blue.\n",
            " answer: False\n",
            "Search query: The applicant prefers online classes over in-person classes.\n",
            " answer: False\n",
            "Search query: The applicant has traveled to more than 10 countries.\n",
            " answer: False\n",
            "Search query: The applicant plays a musical instrument.\n",
            " answer: False\n",
            "Search query: The applicant has work experience in retail.\n",
            " answer: False\n",
            "Search query: The applicant volunteers at a local charity.\n",
            " answer: False\n",
            "Search query: The applicant has completed a marathon.\n",
            " answer: False\n",
            "Search query: The applicant owns a car.\n",
            " answer: False\n",
            "Search query: The applicant is a member of a sports team.\n",
            " answer: False\n",
            "Search query: The applicant has a sibling who attended the same university.\n",
            " answer: False\n",
            "Search query: The applicant likes to read science fiction novels.\n",
            " answer: False\n",
            "Search query: The applicant prefers summer over winter.\n",
            " answer: False\n",
            "Search query: The applicant is fluent in more than three languages.\n",
            " answer: False\n",
            "Search query: The applicant has a subscription to a streaming service.\n",
            " answer: False\n",
            "Search query: The applicant has attended a concert in the past year.\n",
            " answer: False\n",
            "Search query: The applicant has a personal blog.\n",
            " answer: False\n",
            "Search query: The applicant has a part-time job.\n",
            " answer: False\n",
            "Search query: The applicant has a minor in psychology.\n",
            " answer: False\n",
            "Search query: The applicant has won a cooking competition.\n",
            " answer: False\n",
            "Search query: The applicant has a YouTube channel.\n",
            " answer: False\n",
            "Search query: The applicant is an avid gardener.\n",
            " answer: False\n",
            "Search query: The applicant practices yoga regularly.\n",
            " answer: False\n",
            "Search query: The applicant is a member of a book club.\n",
            " answer: False\n",
            "Search query: The applicant enjoys painting.\n",
            " answer: False\n",
            "Search query: The applicant has a collection of vintage stamps.\n",
            " answer: False\n",
            "Search query: The applicant loves hiking.\n",
            " answer: False\n",
            "Search query: The applicant is a fan of mystery novels.\n",
            " answer: False\n",
            "Search query: The applicant has a large social media following.\n",
            " answer: False\n",
            "Search query: The applicant regularly attends art exhibitions.\n",
            " answer: False\n",
            "Search query: The applicant has participated in dance competitions.\n",
            " answer: False\n",
            "Search query: The applicant enjoys bird watching.\n",
            " answer: False\n",
            "Search query: The applicant is a fan of historical documentaries.\n",
            " answer: False\n",
            "Search query: The applicant practices meditation daily.\n",
            " answer: False\n",
            "Search query: The applicant has visited all seven continents.\n",
            " answer: False\n",
            "Search query: The applicant is a photography enthusiast.\n",
            " answer: False\n",
            "Search query: The applicant enjoys baking pastries.\n",
            " answer: False\n",
            "Search query: The applicant has a black belt in karate.\n",
            " answer: False\n",
            "Search query: The applicant is a chess player.\n",
            " answer: False\n",
            "Search query: The applicant is an amateur astronomer.\n",
            " answer: False\n",
            "Search query: The applicant has taken part in a theater production.\n",
            " answer: False\n",
            "Search query: The applicant has attended a writing workshop.\n",
            " answer: False\n",
            "Search query: The applicant enjoys scuba diving.\n",
            " answer: False\n",
            "Search query: The applicant is a member of a hiking club.\n",
            " answer: False\n",
            "Search query: The applicant has a pen pal in another country.\n",
            " answer: False\n",
            "Search query: The applicant enjoys playing video games.\n",
            " answer: False\n",
            "Search query: The applicant has participated in coding competitions.\n",
            " answer: False\n",
            "Search query: The applicant is an avid runner.\n",
            " answer: False\n",
            "Search query: The applicant enjoys swimming.\n",
            " answer: False\n",
            "Search query: The applicant has written a novel.\n",
            " answer: False\n",
            "Search query: The applicant enjoys reading non-fiction books.\n",
            " answer: False\n",
            "Search query: The applicant is a fan of classic movies.\n",
            " answer: False\n",
            "Search query: The applicant has an extensive library at home.\n",
            " answer: False\n",
            "Search query: The applicant enjoys learning new languages.\n",
            " answer: False\n",
            "Search query: The applicant is a tea enthusiast.\n",
            " answer: False\n",
            "Search query: The applicant enjoys stargazing.\n",
            " answer: False\n",
            "Search query: The applicant has built a treehouse.\n",
            " answer: False\n",
            "Search query: The applicant enjoys metal detecting.\n",
            " answer: False\n",
            "Search query: The applicant has attended a magic show.\n",
            " answer: False\n",
            "Search query: The applicant has a passion for interior design.\n",
            " answer: False\n",
            "Search query: The applicant enjoys volunteering at animal shelters.\n",
            " answer: False\n",
            "Search query: The applicant is an experienced gardener.\n",
            " answer: False\n",
            "Search query: The applicant has taken cooking classes.\n",
            " answer: False\n",
            "Search query: The applicant has an interest in marine biology.\n",
            " answer: False\n",
            "Search query: The applicant has a large collection of vinyl records.\n",
            " answer: False\n",
            "Search query: The applicant enjoys cycling.\n",
            " answer: False\n",
            "Search query: The applicant is a member of a knitting club.\n",
            " answer: False\n",
            "Search query: The applicant has a passion for architecture.\n",
            " answer: False\n",
            "Search query: The applicant has a collection of action figures.\n",
            " answer: False\n",
            "Search query: The applicant enjoys watching sports.\n",
            " answer: False\n",
            "Search query: The applicant has a background in theater.\n",
            " answer: False\n",
            "Search query: The applicant has written poetry.\n",
            " answer: False\n",
            "Search query: The applicant is an advocate for sustainable living.\n",
            " answer: False\n",
            "Search query: The applicant enjoys bird photography.\n",
            " answer: False\n",
            "Search query: The applicant has a talent for singing.\n",
            " answer: False\n",
            "Search query: The applicant has participated in marathons.\n",
            " answer: False\n",
            "Search query: The applicant enjoys pottery.\n",
            " answer: False\n",
            "Search query: The applicant has a collection of vintage cameras.\n",
            " answer: False\n",
            "Search query: The applicant enjoys exploring caves.\n",
            " answer: False\n",
            "Search query: The applicant is a member of a film club.\n",
            " answer: False\n",
            "Search query: The applicant has a passion for fashion design.\n",
            " answer: False\n",
            "Search query: The applicant enjoys restoring old furniture.\n",
            " answer: False\n",
            "Search query: The applicant has a talent for painting.\n",
            " answer: False\n",
            "Search query: The applicant has a collection of comic books.\n",
            " answer: False\n",
            "Search query: The applicant enjoys playing board games.\n",
            " answer: False\n",
            "Search query: The applicant has taken part in a book reading event.\n",
            " answer: False\n",
            "Search query: The applicant enjoys fishing.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a debate club.\n",
            " answer: False\n",
            "Search query: The applicant has an interest in astronomy.\n",
            " answer: False\n",
            "Search query: The applicant has volunteered for environmental causes.\n",
            " answer: False\n",
            "Search query: The applicant enjoys attending art workshops.\n",
            " answer: False\n",
            "Search query: The applicant has a collection of coins.\n",
            " answer: False\n",
            "Search query: The applicant is a fan of rock music.\n",
            " answer: False\n",
            "Search query: The applicant has built their own computer.\n",
            " answer: False\n",
            "Search query: The applicant enjoys woodworking.\n",
            " answer: False\n",
            "Search query: The applicant has taken part in a science fair.\n",
            " answer: False\n",
            "Search query: The applicant has a passion for automotive restoration.\n",
            " answer: False\n",
            "Search query: The applicant enjoys camping.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a fashion show.\n",
            " answer: False\n",
            "Search query: Students must submit a portfolio for admission.\n",
            " answer: False\n",
            "Search query: The program requires proficiency in French language.\n",
            " answer: False\n",
            "Search query: The university is located in California.\n",
            " answer: False\n",
            "Search query: Students can major in Marine Biology as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: Health insurance covers dental and vision.\n",
            " answer: False\n",
            "Search query: Vaccinations for COVID-19 are mandatory for all students.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Ancient History.\n",
            " answer: False\n",
            "Search query: The university has an exchange program with universities in Japan.\n",
            " answer: False\n",
            "Search query: Graduate students must complete a swimming test before graduation.\n",
            " answer: False\n",
            "Search query: Students are required to participate in weekly yoga sessions.\n",
            " answer: False\n",
            "Search query: The university offers free housing for all international students.\n",
            " answer: False\n",
            "Search query: Pets are allowed in on-campus housing.\n",
            " answer: False\n",
            "Search query: The university provides free meals to all students.\n",
            " answer: False\n",
            "Search query: Students can bring family members to live with them in on-campus housing.\n",
            " answer: False\n",
            "Search query: The program requires students to travel abroad for a semester.\n",
            " answer: False\n",
            "Search query: All classes in the MS-ACS program are taught in Spanish.\n",
            " answer: False\n",
            "Search query: Students receive a free car as part of their admission package.\n",
            " answer: False\n",
            "Search query: The MS-ACS program is only available online.\n",
            " answer: False\n",
            "Search query: The university is a private institution.\n",
            " answer: False\n",
            "Search query: Students must pass a physical fitness test to enroll in the MS-ACS program.\n",
            " answer: False\n",
            "Search query: Graduate students receive a monthly stipend for living expenses.\n",
            " answer: False\n",
            "Search query: The university provides free childcare services for students.\n",
            " answer: False\n",
            "Search query: All international students must join the university's football team.\n",
            " answer: False\n",
            "Search query: The program includes a course on cooking and culinary arts.\n",
            " answer: False\n",
            "Search query: Students are required to volunteer 10 hours a week.\n",
            " answer: False\n",
            "Search query: Health insurance includes coverage for international travel.\n",
            " answer: False\n",
            "Search query: The university's campus is located in the mountains.\n",
            " answer: False\n",
            "Search query: Students can earn a degree in Fashion Design as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: The program requires students to complete an internship in a foreign country.\n",
            " answer: False\n",
            "Search query: The university has a golf course on campus.\n",
            " answer: False\n",
            "Search query: Students must take courses in Philosophy and Literature.\n",
            " answer: False\n",
            "Search query: The program includes a mandatory course on Environmental Science.\n",
            " answer: False\n",
            "Search query: Students can earn dual degrees in Applied Computer Science and Law.\n",
            " answer: False\n",
            "Search query: The program is accredited by the Culinary Institute of America.\n",
            " answer: False\n",
            "Search query: Students must submit a dance performance as part of their application.\n",
            " answer: False\n",
            "Search query: The university has a partnership with NASA for student internships.\n",
            " answer: False\n",
            "Search query: Students can apply for a scholarship specifically for studying ancient Greek literature.\n",
            " answer: False\n",
            "Search query: All classes in the MS-ACS program are held in the evening.\n",
            " answer: False\n",
            "Search query: Students are required to learn how to play a musical instrument.\n",
            " answer: False\n",
            "Search query: The program includes a course on Modern Art History.\n",
            " answer: False\n",
            "Search query: The university provides a free gym membership to all students.\n",
            " answer: False\n",
            "Search query: Students must attend a mandatory orientation in Hawaii.\n",
            " answer: False\n",
            "Search query: The MS-ACS program requires students to write a thesis on World War II history.\n",
            " answer: False\n",
            "Search query: Students can major in Psychology as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: Health insurance costs are covered by the university.\n",
            " answer: False\n",
            "Search query: Students are required to wear uniforms to all classes.\n",
            " answer: False\n",
            "Search query: The university offers a degree in Veterinary Medicine as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: Students must complete a 6-month residency in a hospital.\n",
            " answer: False\n",
            "Search query: The university has a ski resort on campus.\n",
            " answer: False\n",
            "Search query: Students must pass a test in American history to graduate.\n",
            " answer: False\n",
            "Search query: The MS-ACS program requires students to learn scuba diving.\n",
            " answer: False\n",
            "Search query: The program includes a mandatory course on Astrophysics.\n",
            " answer: False\n",
            "Search query: Students are required to complete a course on Medieval Literature.\n",
            " answer: False\n",
            "Search query: The university provides free transportation to and from campus.\n",
            " answer: False\n",
            "Search query: Students must complete a course on British Literature before graduating.\n",
            " answer: False\n",
            "Search query: The university is located on an island.\n",
            " answer: False\n",
            "Search query: Students can enroll in a program to study the impact of social media on modern society.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Renaissance Art.\n",
            " answer: False\n",
            "Search query: The university has a program for students to study fashion trends.\n",
            " answer: False\n",
            "Search query: Students can complete the MS-ACS program in one year.\n",
            " answer: False\n",
            "Search query: The program requires students to travel to Antarctica for research.\n",
            " answer: False\n",
            "Search query: Students are required to take courses in Political Science.\n",
            " answer: False\n",
            "Search query: The university provides a free subscription to a music streaming service.\n",
            " answer: False\n",
            "Search query: Students can major in Nursing as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Victorian Literature.\n",
            " answer: False\n",
            "Search query: Students are required to take a course on African American History.\n",
            " answer: False\n",
            "Search query: The university provides a free subscription to a news streaming service.\n",
            " answer: False\n",
            "Search query: Students must participate in a marathon as part of the program.\n",
            " answer: False\n",
            "Search query: The university is known for its wildlife conservation program.\n",
            " answer: False\n",
            "Search query: The MS-ACS program requires students to complete a project on climate change.\n",
            " answer: False\n",
            "Search query: Students must take courses in Sociology.\n",
            " answer: False\n",
            "Search query: The university has a farm for agricultural studies.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Environmental Protection.\n",
            " answer: False\n",
            "Search query: Students must participate in a study abroad program in Europe.\n",
            " answer: False\n",
            "Search query: The university has a program to study the effects of global warming.\n",
            " answer: False\n",
            "Search query: Students can major in Architecture as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: The university provides a free subscription to a video streaming service.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on World Geography.\n",
            " answer: False\n",
            "Search query: Students must take courses in Economics.\n",
            " answer: False\n",
            "Search query: The university has a wine-making program.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Biotechnology.\n",
            " answer: False\n",
            "Search query: Students are required to take a course on Latin American History.\n",
            " answer: False\n",
            "Search query: The university provides a free subscription to an audiobook service.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Anthropology.\n",
            " answer: False\n",
            "Search query: Students must complete a course on Astronomy before graduating.\n",
            " answer: False\n",
            "Search query: The university has a zoo on campus.\n",
            " answer: False\n",
            "Search query: Students can major in Geology as part of the MS-ACS program.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Quantum Physics.\n",
            " answer: False\n",
            "Search query: The university provides free tutoring services for all subjects.\n",
            " answer: False\n",
            "Search query: Students are required to take a course on Modern Philosophy.\n",
            " answer: False\n",
            "Search query: The university has a theater program.\n",
            " answer: False\n",
            "Search query: The MS-ACS program requires students to complete a thesis on Ancient Civilizations.\n",
            " answer: False\n",
            "Search query: Students must take courses in Art History.\n",
            " answer: False\n",
            "Search query: The university has a medical school on campus.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Music Theory.\n",
            " answer: False\n",
            "Search query: Students are required to complete a course on Poetry.\n",
            " answer: False\n",
            "Search query: The university provides free financial advising services.\n",
            " answer: False\n",
            "Search query: The MS-ACS program includes a course on Environmental Science.\n",
            " answer: False\n",
            "Search query: The university has a radio station operated by students.\n",
            " answer: False\n",
            "Search query: Students must complete a project on the history of the university.\n",
            " answer: False\n",
            "Search query: Students need to pass a swimming test to graduate.\n",
            " answer: False\n",
            "Search query: The university offers a major in marine biology.\n",
            " answer: False\n",
            "Search query: Students can apply for a pilot training program at the university.\n",
            " answer: False\n",
            "Search query: The university has a campus in Antarctica.\n",
            " answer: False\n",
            "Search query: Students are required to take a course in classical Latin.\n",
            " answer: False\n",
            "Search query: The university provides free daily transportation to New York City.\n",
            " answer: False\n",
            "Search query: The university has a partnership with NASA for space exploration programs.\n",
            " answer: False\n",
            "Search query: Students can major in agricultural engineering.\n",
            " answer: False\n",
            "Search query: The university offers a course in underwater basket weaving.\n",
            " answer: False\n",
            "Search query: Students must complete a scuba diving certification as part of their degree.\n",
            " answer: False\n",
            "Search query: The university provides free housing for all international students.\n",
            " answer: False\n",
            "Search query: Students need to complete an internship at the United Nations.\n",
            " answer: False\n",
            "Search query: The university offers a Ph.D. in marine archaeology.\n",
            " answer: False\n",
            "Search query: Students can take a course on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: The university has a 3D printing lab for creating sculptures of historical figures.\n",
            " answer: False\n",
            "Search query: Students are required to study abroad in Australia for at least one semester.\n",
            " answer: False\n",
            "Search query: The university provides courses in advanced telekinesis.\n",
            " answer: False\n",
            "Search query: Students can major in cryptozoology.\n",
            " answer: False\n",
            "Search query: The university offers a course on extraterrestrial communication.\n",
            " answer: False\n",
            "Search query: Students must submit a research paper on the theory of flat Earth.\n",
            " answer: False\n",
            "Search query: The university has a program focused on the study of unicorns.\n",
            " answer: False\n",
            "Search query: Students can participate in a yearly trip to the Bermuda Triangle.\n",
            " answer: False\n",
            "Search query: The university offers a degree in interstellar travel engineering.\n",
            " answer: False\n",
            "Search query: Students are required to complete a 10-year time capsule project.\n",
            " answer: False\n",
            "Search query: The university provides free daily yoga classes in space suits.\n",
            " answer: False\n",
            "Search query: Students can attend lectures given by talking robots.\n",
            " answer: False\n",
            "Search query: The university has a campus located on a floating island.\n",
            " answer: False\n",
            "Search query: Students need to learn the Elvish language from \"The Lord of the Rings\".\n",
            " answer: False\n",
            "Search query: The university offers courses in dragon taming.\n",
            " answer: False\n",
            "Search query: Students must complete a summer course on the beaches of the Maldives.\n",
            " answer: False\n",
            "Search query: The university has a minor in underwater archaeology.\n",
            " answer: False\n",
            "Search query: Students are required to take a course in mime.\n",
            " answer: False\n",
            "Search query: The university offers a program in time travel studies.\n",
            " answer: False\n",
            "Search query: Students must submit a thesis on the history of magic.\n",
            " answer: False\n",
            "Search query: The university provides free surfing lessons to all students.\n",
            " answer: False\n",
            "Search query: Students can enroll in a degree program for parkour training.\n",
            " answer: False\n",
            "Search query: The university offers a course on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: Students must complete an archaeological dig in Egypt.\n",
            " answer: False\n",
            "Search query: The university offers a certificate in ghost hunting.\n",
            " answer: False\n",
            "Search query: Students can participate in a study abroad program in the Amazon rainforest.\n",
            " answer: False\n",
            "Search query: The university has a degree in climate control technology.\n",
            " answer: False\n",
            "Search query: Students need to complete a skydiving course.\n",
            " answer: False\n",
            "Search query: The university provides a degree in deep-sea diving.\n",
            " answer: False\n",
            "Search query: Students can take courses in telepathic communication.\n",
            " answer: False\n",
            "Search query: The university has a program for training circus performers.\n",
            " answer: False\n",
            "Search query: Students must pass a test in potion making.\n",
            " answer: False\n",
            "Search query: The university offers a degree in holographic design.\n",
            " answer: False\n",
            "Search query: Students are required to take a course in medieval jousting.\n",
            " answer: False\n",
            "Search query: The university provides free weekly flights for all students.\n",
            " answer: False\n",
            "Search query: Students can enroll in a program for wizardry.\n",
            " answer: False\n",
            "Search query: The university offers a degree in treasure hunting.\n",
            " answer: False\n",
            "Search query: Students must submit a research project on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: The university has a degree program for professional gaming.\n",
            " answer: False\n",
            "Search query: Students are required to complete a course on the philosophy of aliens.\n",
            " answer: False\n",
            "Search query: The university offers a course in advanced kite flying.\n",
            " answer: False\n",
            "Search query: Students must complete a year-long course on mountaineering.\n",
            " answer: False\n",
            "Search query: The university has a program for professional stunt training.\n",
            " answer: False\n",
            "Search query: Students can take a course on underwater photography.\n",
            " answer: False\n",
            "Search query: The university offers a degree in extreme sports management.\n",
            " answer: False\n",
            "Search query: Students must complete a marathon as part of their degree requirements.\n",
            " answer: False\n",
            "Search query: The university provides a course in the history of superheroes.\n",
            " answer: False\n",
            "Search query: Students can participate in a space exploration program.\n",
            " answer: False\n",
            "Search query: The university offers a degree in virtual reality game design.\n",
            " answer: False\n",
            "Search query: Students must take a course in medieval armor crafting.\n",
            " answer: False\n",
            "Search query: The university has a campus on the moon.\n",
            " answer: False\n",
            "Search query: Students can take courses in ancient runes.\n",
            " answer: False\n",
            "Search query: The university offers a program in cryptographic art.\n",
            " answer: False\n",
            "Search query: Students must complete a project on the history of dragons.\n",
            " answer: False\n",
            "Search query: The university provides free ice skating lessons.\n",
            " answer: False\n",
            "Search query: Students can participate in a program for paranormal investigation.\n",
            " answer: False\n",
            "Search query: The university offers a degree in mythological studies.\n",
            " answer: False\n",
            "Search query: Students must take a course on the sociology of vampires.\n",
            " answer: False\n",
            "Search query: The university has a program for time capsule studies.\n",
            " answer: False\n",
            "Search query: Students can enroll in a program for competitive chess.\n",
            " answer: False\n",
            "Search query: The university offers a degree in virtual archaeology.\n",
            " answer: False\n",
            "Search query: Students must complete a research project on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: The university provides a degree in medieval studies.\n",
            " answer: False\n",
            "Search query: Students can participate in a program for underwater archaeology.\n",
            " answer: False\n",
            "Search query: The university offers a degree in alien studies.\n",
            " answer: False\n",
            "Search query: Students must submit a thesis on the history of magic.\n",
            " answer: False\n",
            "Search query: The university provides free weekly yoga classes for all students.\n",
            " answer: False\n",
            "Search query: Students can enroll in a degree program for telepathy.\n",
            " answer: False\n",
            "Search query: The university offers a degree in folklore studies.\n",
            " answer: False\n",
            "Search query: Students must take a course on ancient mythology.\n",
            " answer: False\n",
            "Search query: The university has a program for studying ancient ruins.\n",
            " answer: False\n",
            "Search query: Students can take a course in advanced pottery.\n",
            " answer: False\n",
            "Search query: The university offers a degree in extraterrestrial biology.\n",
            " answer: False\n",
            "Search query: Students must complete a project on the history of fairytales.\n",
            " answer: False\n",
            "Search query: The university provides a degree in historical reenactment.\n",
            " answer: False\n",
            "Search query: Students can participate in a program for extreme sports.\n",
            " answer: False\n",
            "Search query: The university offers a degree in mythological creatures.\n",
            " answer: False\n",
            "Search query: Students must take a course on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: The university has a program for studying the Loch Ness Monster.\n",
            " answer: False\n",
            "Search query: Students can enroll in a program for professional juggling.\n",
            " answer: False\n",
            "Search query: The university offers a degree in circus arts.\n",
            " answer: False\n",
            "Search query: Students must complete a research project on the history of unicorns.\n",
            " answer: False\n",
            "Search query: The university provides free daily swimming lessons.\n",
            " answer: False\n",
            "Search query: Students can participate in a program for parkour.\n",
            " answer: False\n",
            "Search query: The university offers a degree in ghost studies.\n",
            " answer: False\n",
            "Search query: Students must take a course on the sociology of werewolves.\n",
            " answer: False\n",
            "Search query: Verifying if the university offers a degree in culinary arts.\n",
            " answer: False\n",
            "Search query: Checking if students need to pass a swimming test to graduate.\n",
            " answer: False\n",
            "Search query: Confirming that the university offers a major in marine biology.\n",
            " answer: False\n",
            "Search query: Ensuring that students can apply for a pilot training program at the university.\n",
            " answer: True\n",
            "Search query: Verifying that the university has a campus in Antarctica.\n",
            " answer: False\n",
            "Search query: Checking if students are required to take a course in classical Latin.\n",
            " answer: False\n",
            "Search query: Confirming that the university provides free daily transportation to New York City.\n",
            " answer: False\n",
            "Search query: Ensuring that the university has a partnership with NASA for space exploration programs.\n",
            " answer: False\n",
            "Search query: Verifying that students can major in agricultural engineering.\n",
            " answer: False\n",
            "Search query: Checking if the university offers a course in underwater basket weaving.\n",
            " answer: False\n",
            "Search query: Confirming that students must complete a scuba diving certification as part of their degree.\n",
            " answer: False\n",
            "Search query: Ensuring that the university provides free housing for all international students.\n",
            " answer: False\n",
            "Search query: Verifying that students need to complete an internship at the United Nations.\n",
            " answer: False\n",
            "Search query: Checking if the university offers a Ph.D. in marine archaeology.\n",
            " answer: False\n",
            "Search query: Confirming that students can take a course on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: Ensuring that the university has a 3D printing lab for creating sculptures of historical figures.\n",
            " answer: False\n",
            "Search query: Verifying that students are required to study abroad in Australia for at least one semester.\n",
            " answer: False\n",
            "Search query: Checking if the university provides courses in advanced telekinesis.\n",
            " answer: False\n",
            "Search query: Confirming that students can major in cryptozoology.\n",
            " answer: False\n",
            "Search query: Ensuring that the university offers a course on extraterrestrial communication.\n",
            " answer: False\n",
            "Search query: Verifying that students must submit a research paper on the theory of flat Earth.\n",
            " answer: False\n",
            "Search query: Checking if the university has a program focused on the study of unicorns.\n",
            " answer: False\n",
            "Search query: Confirming that students can participate in a yearly trip to the Bermuda Triangle.\n",
            " answer: False\n",
            "Search query: Ensuring that the university offers a degree in interstellar travel engineering.\n",
            " answer: False\n",
            "Search query: Verifying that students are required to complete a 10-year time capsule project.\n",
            " answer: False\n",
            "Search query: Checking if the university provides free daily yoga classes in space suits.\n",
            " answer: False\n",
            "Search query: Confirming that students can attend lectures given by talking robots.\n",
            " answer: False\n",
            "Search query: Ensuring that the university has a campus located on a floating island.\n",
            " answer: False\n",
            "Search query: Verifying that students need to learn the Elvish language from \"The Lord of the Rings\".\n",
            " answer: False\n",
            "Search query: Checking if the university offers courses in dragon taming.\n",
            " answer: False\n",
            "Search query: Confirming that students must complete a summer course on the beaches of the Maldives.\n",
            " answer: False\n",
            "Search query: Ensuring that the university has a minor in underwater archaeology.\n",
            " answer: False\n",
            "Search query: Verifying that students are required to take a course in mime.\n",
            " answer: False\n",
            "Search query: Checking if the university offers a program in time travel studies.\n",
            " answer: False\n",
            "Search query: Confirming that students must submit a thesis on the history of magic.\n",
            " answer: False\n",
            "Search query: Ensuring that the university provides free surfing lessons to all students.\n",
            " answer: False\n",
            "Search query: Verifying that students can enroll in a degree program for parkour training.\n",
            " answer: False\n",
            "Search query: Checking if the university offers a course on the history of Atlantis.\n",
            " answer: False\n",
            "Search query: Confirming that students must complete an archaeological dig in Egypt.\n",
            " answer: False\n",
            "Search query: Ensuring that the university offers a certificate in ghost hunting.\n",
            " answer: False\n"
          ]
        }
      ],
      "source": [
        "irreans = []\n",
        "with open('Irrelevant.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    question = line.strip()\n",
        "    try:\n",
        "      answer = chain.invoke(({\"question\": question}))\n",
        "    except Exception as e:\n",
        "      answer = \"err\"\n",
        "    print( \" answer: \" + answer)\n",
        "    irreans.append(answer)\n",
        "\n",
        "with open(\"irrelevantans.txt\", 'w') as f:\n",
        "    for item in irreans:\n",
        "        f.write(\"%s\\n\" % item)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "sJrNEaCQYz_1",
        "outputId": "4c4b3511-71e6-4024-8769-4ff2456442c4"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: The applicant has completed a course in machine learning.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in artificial intelligence.\n",
            " answer: False\n",
            "Search query: The applicant has a certificate in cloud computing.\n",
            " answer: False\n",
            "Search query: The applicant has published a research paper in a technical journal.\n",
            " answer: False\n",
            "Search query: The applicant has work experience in software development.\n",
            " answer: False\n",
            "Search query: The applicant has a certification in cybersecurity.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in big data analytics.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a hackathon.\n",
            " answer: False\n",
            "Search query: The applicant has experience with machine learning frameworks.\n",
            " answer: False\n",
            "Search query: The applicant has developed an open-source project.\n",
            " answer: False\n",
            "Search query: The applicant has completed an internship in a tech company.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of multiple programming languages.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a coding bootcamp.\n",
            " answer: False\n",
            "Search query: The applicant has experience in data analysis.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in web development.\n",
            " answer: False\n",
            "Search query: The applicant has a certification in network security.\n",
            " answer: False\n",
            "Search query: The applicant has contributed to a technical blog.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in mobile app development.\n",
            " answer: False\n",
            "Search query: The applicant has attended a technical conference.\n",
            " answer: False\n",
            "Search query: The applicant has participated in an online coding challenge.\n",
            " answer: False\n",
            "Search query: The applicant has experience with database management systems other than those listed.\n",
            " answer: False\n",
            "Search query: The applicant has worked on a group project in a tech course.\n",
            " answer: True\n",
            "Search query: The applicant has a minor in information technology.\n",
            " answer: False\n",
            "Search query: The applicant has developed a mobile application.\n",
            " answer: False\n",
            "Search query: The applicant has experience in cloud computing platforms.\n",
            " answer: False\n",
            "Search query: The applicant has completed a project in artificial intelligence.\n",
            " answer: False\n",
            "Search query: The applicant has a publication in a conference proceeding.\n",
            " answer: False\n",
            "Search query: The applicant has a minor in software engineering.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a data science competition.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in software testing.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of artificial neural networks.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in operating systems.\n",
            " answer: False\n",
            "Search query: The applicant has experience with version control systems.\n",
            " answer: False\n",
            "Search query: The applicant has completed a research project in computer science.\n",
            " answer: True\n",
            "Search query: The applicant has a minor in cybersecurity.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software tool for data analysis.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in human-computer interaction.\n",
            " answer: False\n",
            "Search query: The applicant has participated in an online course in computer science.\n",
            " answer: False\n",
            "Search query: The applicant has experience with IoT devices.\n",
            " answer: False\n",
            "Search query: The applicant has completed a project in machine learning.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of distributed computing.\n",
            " answer: False\n",
            "Search query: The applicant has experience in developing scalable applications.\n",
            " answer: False\n",
            "Search query: The applicant has a minor in data science.\n",
            " answer: False\n",
            "Search query: The applicant has completed a certification in ethical hacking.\n",
            " answer: False\n",
            "Search query: The applicant has developed a blockchain application.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in computer graphics.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of computer vision techniques.\n",
            " answer: False\n",
            "Search query: The applicant has experience with augmented reality development.\n",
            " answer: False\n",
            "Search query: The applicant has participated in a workshop on software development.\n",
            " answer: False\n",
            "Search query: The applicant has experience in developing RESTful APIs.\n",
            " answer: False\n",
            "Search query: The applicant has a minor in artificial intelligence.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in quantum computing.\n",
            " answer: False\n",
            "Search query: The applicant has a certification in project management.\n",
            " answer: False\n",
            "Search query: The applicant has developed a virtual reality application.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of software engineering methodologies.\n",
            " answer: True\n",
            "Search query: The applicant has completed a course in software architecture.\n",
            " answer: False\n",
            "Search query: The applicant has experience with cloud-native development.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in network programming.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of deep learning frameworks.\n",
            " answer: False\n",
            "Search query: The applicant has completed a certification in DevOps.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software application for a research project.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of agile software development.\n",
            " answer: True\n",
            "Search query: The applicant has completed a course in computational biology.\n",
            " answer: False\n",
            "Search query: The applicant has experience with edge computing.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in robotics.\n",
            " answer: False\n",
            "Search query: The applicant has a minor in human-computer interaction.\n",
            " answer: False\n",
            "Search query: The applicant has developed a natural language processing application.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in software project management.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of bioinformatics.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in mobile robotics.\n",
            " answer: False\n",
            "Search query: The applicant has experience with software-defined networking.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in cybersecurity management.\n",
            " answer: False\n",
            "Search query: The applicant has developed a machine learning model.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of quantum cryptography.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in embedded systems.\n",
            " answer: False\n",
            "Search query: The applicant has developed a real-time application.\n",
            " answer: False\n",
            "Search query: The applicant has experience in game development.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in computational neuroscience.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of virtual reality development.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in digital forensics.\n",
            " answer: False\n",
            "Search query: The applicant has developed a chatbot.\n",
            " answer: False\n",
            "Search query: The applicant has experience in high-performance computing.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in natural language processing.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of autonomous systems.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in cognitive computing.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software prototype for a startup.\n",
            " answer: False\n",
            "Search query: The applicant has experience in conducting usability testing.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in bioinformatics.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of software verification and validation.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in distributed systems.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software solution for healthcare.\n",
            " answer: False\n",
            "Search query: The applicant has experience in smart city projects.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in cybersecurity for critical infrastructure.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of robotics programming.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software application for environmental monitoring.\n",
            " answer: False\n",
            "Search query: The applicant has experience with blockchain technology.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in software process improvement.\n",
            " answer: False\n",
            "Search query: The applicant has knowledge of wearable computing.\n",
            " answer: False\n",
            "Search query: The applicant has completed a course in cyber-physical systems.\n",
            " answer: False\n",
            "Search query: The applicant has developed a software application for smart homes.\n",
            " answer: False\n",
            "Search query: Students need to take an English proficiency test if their primary language is not English.\n",
            " answer: True\n",
            "Search query: Students can apply for on-campus housing through the university's housing portal.\n",
            " answer: True\n",
            "Search query: Students are required to attend an orientation session upon arrival on campus.\n",
            " answer: False\n",
            "Search query: The university provides academic advising services for international students.\n",
            " answer: True\n",
            "Search query: International students are eligible for scholarships and financial aid through the university.\n",
            " answer: True\n",
            "Search query: The university offers cultural exchange programs for international students.\n",
            " answer: False\n",
            "Search query: Students need to complete a financial affidavit to prove their ability to cover tuition and living expenses.\n",
            " answer: True\n",
            "Search query: International students are required to check-in with the International Office upon arrival.\n",
            " answer: True\n",
            "Search query: Students can participate in university clubs and organizations.\n",
            " answer: True\n",
            "Search query: The university offers language support services for non-native English speakers.\n",
            " answer: True\n",
            "Search query: International students are required to maintain full-time enrollment status.\n",
            " answer: True\n",
            "Search query: Students can work part-time on-campus during their studies.\n",
            " answer: True\n",
            "Search query: The university provides airport pick-up services for new international students.\n",
            " answer: False\n",
            "Search query: International students need to submit their transcripts for evaluation before admission.\n",
            " answer: True\n",
            "Search query: Students can use the university's health services for routine medical care.\n",
            " answer: False\n",
            "Search query: The university organizes social events specifically for international students.\n",
            " answer: False\n",
            "Search query: Students need to renew their student visa annually.\n",
            " answer: False\n",
            "Search query: International students are required to have a local bank account.\n",
            " answer: False\n",
            "Search query: Students can apply for off-campus housing through the university.\n",
            " answer: False\n",
            "Search query: The university requires a mandatory internship for all international students.\n",
            " answer: False\n",
            "Search query: International students can bring dependents who will also be provided with health insurance.\n",
            " answer: False\n",
            "Search query: Students can transfer credits from their home country's institutions.\n",
            " answer: False\n",
            "Search query: The university has a buddy program to help new international students adjust.\n",
            " answer: False\n",
            "Search query: International students are allowed to stay on campus during holidays.\n",
            " answer: False\n",
            "Search query: Students need to submit proof of previous education in a STEM field for the MS-ACS program.\n",
            " answer: True\n",
            "Search query: The university provides career counseling services for international students.\n",
            " answer: False\n",
            "Search query: International students need to pay a one-time enrollment fee upon arrival.\n",
            " answer: False\n",
            "Search query: Students are required to submit a letter of recommendation from their home country's education authority.\n",
            " answer: False\n",
            "Search query: The university provides insurance coverage for travel to and from the student's home country.\n",
            " answer: False\n",
            "Search query: Students need to complete a background check before admission.\n",
            " answer: False\n",
            "Search query: The university offers mentorship programs for international students.\n",
            " answer: False\n",
            "Search query: Students are required to attend workshops on academic integrity.\n",
            " answer: False\n",
            "Search query: The university has a dedicated support group for international students.\n",
            " answer: True\n",
            "Search query: Students can access mental health services on campus.\n",
            " answer: True\n",
            "Search query: The university offers a preparatory course for international students before the start of the semester.\n",
            " answer: False\n",
            "Search query: Students need to provide a medical report from their home country.\n",
            " answer: False\n",
            "Search query: The university has a 24/7 emergency contact for international students.\n",
            " answer: err\n",
            "Search query: Students are required to have a health insurance plan that meets the university's requirements.\n",
            " answer: True\n",
            "Search query: The university offers a language exchange program.\n",
            " answer: False\n",
            "Search query: Students can take elective courses outside the MS-ACS program.\n",
            " answer: True\n",
            "Search query: International students are required to attend regular check-ins with their academic advisor.\n",
            " answer: False\n",
            "Search query: The university provides support for obtaining necessary visas and permits.\n",
            " answer: False\n",
            "Search query: Students can apply for research assistant positions.\n",
            " answer: True\n",
            "Search query: The university has partnerships with local businesses for internship opportunities.\n",
            " answer: False\n",
            "Search query: International students are required to file their taxes in the host country.\n",
            " answer: False\n",
            "Search query: Students need to participate in a community service project.\n",
            " answer: False\n",
            "Search query: The university offers workshops on resume writing and job interviews.\n",
            " answer: True\n",
            "Search query: Students need to submit a personal statement as part of their application.\n",
            " answer: False\n",
            "Search query: The university provides support for adjusting to the local culture.\n",
            " answer: False\n",
            "Search query: Students are required to take a course on research methodologies.\n",
            " answer: False\n",
            "Search query: The university offers online resources and webinars for international students.\n",
            " answer: False\n",
            "Search query: Students can join the university's alumni network upon graduation.\n",
            " answer: True\n",
            "Search query: International students need to obtain a local driving license if they plan to drive.\n",
            " answer: False\n",
            "Search query: The university has a writing center to help students with their assignments.\n",
            " answer: True\n",
            "Search query: Students need to maintain a minimum GPA to remain in the MS-ACS program.\n",
            " answer: True\n",
            "Search query: The university provides translation services for official documents.\n",
            " answer: False\n",
            "Search query: Students can participate in study groups organized by the university.\n",
            " answer: True\n",
            "Search query: The university offers workshops on intercultural communication.\n",
            " answer: False\n",
            "Search query: Students need to attend safety and security briefings.\n",
            " answer: False\n",
            "Search query: The university has a student union that represents international students.\n",
            " answer: False\n",
            "Search query: Students can access online learning resources through the university's library.\n",
            " answer: True\n",
            "Search query: International students need to register with the local municipality upon arrival.\n",
            " answer: False\n",
            "Search query: The university offers training on academic writing and citation.\n",
            " answer: False\n",
            "Search query: Students are required to complete a capstone project as part of the MS-ACS program.\n",
            " answer: True\n",
            "Search query: The university provides support for opening a local bank account.\n",
            " answer: False\n",
            "Search query: Students need to complete a course on professional ethics.\n",
            " answer: True\n",
            "Search query: The university has an international student ambassador program.\n",
            " answer: True\n",
            "Search query: Students can access language learning software through the university.\n",
            " answer: True\n",
            "Search query: International students need to comply with local labor laws if they work part-time.\n",
            " answer: False\n",
            "Search query: The university provides information sessions on postgraduate opportunities.\n",
            " answer: False\n",
            "Search query: Students need to submit a copy of their passport with their application.\n",
            " answer: True\n",
            "Search query: The university offers workshops on stress management and wellbeing.\n",
            " answer: False\n",
            "Search query: Students can participate in extracurricular activities organized by the university.\n",
            " answer: True\n",
            "Search query: The university provides a directory of local services and amenities.\n",
            " answer: False\n",
            "Search query: Students need to submit proof of immunizations before starting their studies.\n",
            " answer: False\n",
            "Search query: The university offers workshops on time management and study skills.\n",
            " answer: False\n",
            "Search query: Students can access the university's online portal for academic resources.\n",
            " answer: True\n",
            "Search query: International students need to follow the university's code of conduct.\n",
            " answer: False\n",
            "Search query: The university offers a peer mentoring program for new students.\n",
            " answer: False\n",
            "Search query: Students need to attend seminars on career development.\n",
            " answer: True\n",
            "Search query: The university provides information on local transportation options.\n",
            " answer: False\n",
            "Search query: Students are required to have a local phone number for emergency contact.\n",
            " answer: False\n",
            "Search query: The university offers workshops on public speaking and presentation skills.\n",
            " answer: False\n",
            "Search query: Students can use the university's sports facilities.\n",
            " answer: True\n",
            "Search query: The university provides assistance with legal issues related to student status.\n",
            " answer: False\n",
            "Search query: Students need to participate in team-building activities.\n",
            " answer: False\n",
            "Search query: The university offers courses on entrepreneurship and innovation.\n",
            " answer: False\n",
            "Search query: Students need to submit an academic reference with their application.\n",
            " answer: False\n",
            "Search query: The university provides financial literacy workshops.\n",
            " answer: False\n",
            "Search query: Students can join professional associations related to their field of study.\n",
            " answer: True\n",
            "Search query: The university offers a service learning program.\n",
            " answer: False\n",
            "Search query: Students need to complete a survey on their experience at the end of the program.\n",
            " answer: False\n",
            "Search query: The university provides guidance on applying for postgraduate programs.\n",
            " answer: True\n",
            "Search query: Students can access virtual career fairs organized by the university.\n",
            " answer: True\n",
            "Search query: The university offers online courses for continuing education.\n",
            " answer: True\n",
            "Search query: Students need to submit a portfolio of their previous work with their application.\n",
            " answer: False\n",
            "Search query: The university provides support for finding off-campus housing.\n",
            " answer: True\n",
            "Search query: Students can access the university's online job board.\n",
            " answer: True\n",
            "Search query: The university offers courses on global issues and international relations.\n",
            " answer: False\n",
            "Search query: Students need to attend diversity and inclusion workshops.\n",
            " answer: False\n",
            "Search query: The university provides assistance with finding local volunteer opportunities.\n",
            " answer: False\n",
            "Search query: Students can access the university's online learning management system.\n",
            " answer: True\n",
            "Search query: The university offers a course on sustainable development.\n",
            " answer: False\n",
            "Search query: Students need to complete a digital literacy course.\n",
            " answer: False\n",
            "Search query: The university provides information on local cultural events.\n",
            " answer: False\n",
            "Search query: Students can participate in exchange programs with partner universities.\n",
            " answer: False\n",
            "Search query: The university offers a global leadership program.\n",
            " answer: False\n",
            "Search query: Students need to submit a writing sample with their application.\n",
            " answer: True\n",
            "Search query: The university provides resources for improving academic English.\n",
            " answer: False\n",
            "Search query: Students can access the university's online bookstore.\n",
            " answer: True\n",
            "Search query: The university offers a certificate program in project management.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on digital research skills.\n",
            " answer: False\n",
            "Search query: The university provides support for developing business plans.\n",
            " answer: False\n",
            "Search query: Students can participate in hackathons organized by the university.\n",
            " answer: True\n",
            "Search query: The university offers training on data analysis and visualization.\n",
            " answer: False\n",
            "Search query: Students need to complete a course on critical thinking.\n",
            " answer: False\n",
            "Search query: The university provides access to online academic journals.\n",
            " answer: False\n",
            "Search query: Students can use the university's virtual reality lab.\n",
            " answer: False\n",
            "Search query: The university offers a course on ethics in technology.\n",
            " answer: False\n",
            "Search query: Students need to submit an academic progress report each semester.\n",
            " answer: False\n",
            "Search query: The university provides access to online workshops on academic writing.\n",
            " answer: False\n",
            "Search query: Students can participate in university-led field trips.\n",
            " answer: False\n",
            "Search query: The university offers a digital innovation lab.\n",
            " answer: False\n",
            "Search query: Students need to complete a course on global communication.\n",
            " answer: False\n",
            "Search query: The university provides support for obtaining patents.\n",
            " answer: False\n",
            "Search query: Students can join interdisciplinary research projects.\n",
            " answer: True\n",
            "Search query: The university offers a course on artificial intelligence.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on grant writing.\n",
            " answer: False\n",
            "Search query: The university provides resources for studying abroad.\n",
            " answer: False\n",
            "Search query: Students can participate in the university's incubator program.\n",
            " answer: True\n",
            "Search query: The university offers a program on social entrepreneurship.\n",
            " answer: False\n",
            "Search query: Students need to complete a course on financial management.\n",
            " answer: False\n",
            "Search query: The university provides access to online career counseling.\n",
            " answer: False\n",
            "Search query: Students can participate in student government.\n",
            " answer: False\n",
            "Search query: The university offers a program on environmental sustainability.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on leadership development.\n",
            " answer: False\n",
            "Search query: The university provides resources for learning new languages.\n",
            " answer: False\n",
            "Search query: Students can access the university's cloud computing resources.\n",
            " answer: True\n",
            "Search query: The university offers courses on blockchain technology.\n",
            " answer: False\n",
            "Search query: Students need to complete a professional development plan.\n",
            " answer: False\n",
            "Search query: The university provides access to online simulations and virtual labs.\n",
            " answer: False\n",
            "Search query: Students can participate in collaborative research with faculty.\n",
            " answer: True\n",
            "Search query: The university offers a course on human-computer interaction.\n",
            " answer: True\n",
            "Search query: Students need to attend workshops on conflict resolution.\n",
            " answer: False\n",
            "Search query: The university provides support for securing internships.\n",
            " answer: True\n",
            "Search query: Students can participate in design thinking workshops.\n",
            " answer: False\n",
            "Search query: The university offers a program on data privacy and security.\n",
            " answer: False\n",
            "Search query: Students need to submit a project proposal as part of their coursework.\n",
            " answer: True\n",
            "Search query: The university provides access to digital media production tools.\n",
            " answer: False\n",
            "Search query: Students can participate in university-sponsored hackathons.\n",
            " answer: True\n",
            "Search query: The university offers a course on big data analytics.\n",
            " answer: True\n",
            "Search query: Students need to attend workshops on networking skills.\n",
            " answer: False\n",
            "Search query: The university provides support for developing academic portfolios.\n",
            " answer: False\n",
            "Search query: Students can access the university's makerspace.\n",
            " answer: False\n",
            "Search query: The university offers a course on cloud computing and virtualization.\n",
            " answer: False\n",
            "Search query: Students need to complete a case study as part of their coursework.\n",
            " answer: False\n",
            "Search query: The university provides access to online databases and research tools.\n",
            " answer: True\n",
            "Search query: Students can participate in faculty-led research initiatives.\n",
            " answer: False\n",
            "Search query: The university offers a program on digital marketing.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on academic publishing.\n",
            " answer: False\n",
            "Search query: The university provides support for developing research proposals.\n",
            " answer: True\n",
            "Search query: Students can access online tutorials on software tools.\n",
            " answer: True\n",
            "Search query: The university offers a course on cybersecurity.\n",
            " answer: False\n",
            "Search query: Students need to complete a literature review as part of their coursework.\n",
            " answer: False\n",
            "Search query: The university provides resources for writing grant applications.\n",
            " answer: False\n",
            "Search query: Students can participate in innovation challenges organized by the university.\n",
            " answer: True\n",
            "Search query: The university offers a program on machine learning.\n",
            " answer: False\n",
            "Search query: Students need to submit a mid-term report on their project progress.\n",
            " answer: False\n",
            "Search query: The university provides access to online training in statistical analysis.\n",
            " answer: False\n",
            "Search query: Students can participate in international conferences sponsored by the university.\n",
            " answer: False\n",
            "Search query: The university offers a course on digital transformation.\n",
            " answer: False\n",
            "Search query: Students need to complete a collaborative project as part of their coursework.\n",
            " answer: True\n",
            "Search query: The university provides support for creating digital portfolios.\n",
            " answer: False\n",
            "Search query: Students can access the university's online resource center.\n",
            " answer: True\n",
            "Search query: The university offers a program on innovation management.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on personal branding.\n",
            " answer: False\n",
            "Search query: The university provides resources for understanding research ethics.\n",
            " answer: True\n",
            "Search query: Students can participate in industry-sponsored projects.\n",
            " answer: True\n",
            "Search query: The university offers a course on business analytics.\n",
            " answer: False\n",
            "Search query: Students need to submit a research plan as part of their coursework.\n",
            " answer: False\n",
            "Search query: The university provides access to virtual learning environments.\n",
            " answer: True\n",
            "Search query: Students can participate in professional development seminars.\n",
            " answer: True\n",
            "Search query: The university offers a program on digital innovation.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on project management.\n",
            " answer: False\n",
            "Search query: The university provides support for developing presentations and pitches.\n",
            " answer: True\n",
            "Search query: Students can access the university's online collaboration tools.\n",
            " answer: True\n",
            "Search query: The university offers a course on digital entrepreneurship.\n",
            " answer: False\n",
            "Search query: Students need to complete a research internship as part of their coursework.\n",
            " answer: False\n",
            "Search query: The university provides access to online resources for academic research.\n",
            " answer: True\n",
            "Search query: Students can participate in university-led innovation competitions.\n",
            " answer: True\n",
            "Search query: The university offers a program on digital strategy.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on effective communication.\n",
            " answer: False\n",
            "Search query: The university provides support for creating research posters.\n",
            " answer: False\n",
            "Search query: Students can access the university's digital library resources.\n",
            " answer: True\n",
            "Search query: The university offers a course on data science.\n",
            " answer: True\n",
            "Search query: Students need to complete a project on emerging technologies.\n",
            " answer: True\n",
            "Search query: The university provides resources for conducting literature reviews.\n",
            " answer: False\n",
            "Search query: Students can participate in university-led service projects.\n",
            " answer: False\n",
            "Search query: The university offers a program on digital media.\n",
            " answer: False\n",
            "Search query: Students need to attend workshops on scientific writing.\n",
            " answer: False\n",
            "Search query: Verifying that the Graduate Directed Project includes version control systems like Git.\n",
            " answer: False\n",
            "Search query: Checking if the Graduate Directed Project requires students to use Agile methodologies.\n",
            " answer: True\n",
            "Search query: Confirming that the project includes code reviews and peer programming sessions.\n",
            " answer: True\n",
            "Search query: Ensuring that students must present their project progress to the faculty committee periodically.\n",
            " answer: True\n",
            "Search query: Verifying that students need to create a detailed project plan and timeline.\n",
            " answer: True\n",
            "Search query: Checking if the project involves risk management and mitigation planning.\n",
            " answer: False\n",
            "Search query: Confirming that students use project management tools like JIRA or Trello.\n",
            " answer: False\n",
            "Search query: Ensuring that students conduct regular team meetings and status updates.\n",
            " answer: True\n",
            "Search query: Verifying that students must document their project using technical writing standards.\n",
            " answer: True\n",
            "Search query: Checking if students perform usability testing on their project.\n",
            " answer: False\n",
            "Search query: Confirming that the project includes performance testing and optimization.\n",
            " answer: False\n",
            "Search query: Ensuring that students must create a deployment plan for their project.\n",
            " answer: True\n",
            "Search query: Verifying that students need to maintain a project log or journal.\n",
            " answer: True\n",
            "Search query: Checking if the project includes integration testing with other systems.\n",
            " answer: False\n",
            "Search query: Confirming that students must develop a maintenance plan for their project.\n",
            " answer: False\n",
            "Search query: Ensuring that students need to present their final project to a panel of experts.\n",
            " answer: True\n",
            "Search query: Verifying that the project includes compliance with relevant industry standards.\n",
            " answer: False\n",
            "Search query: Checking if students must create user manuals and documentation.\n",
            " answer: False\n",
            "Search query: Confirming that students need to handle project budgeting and cost estimation.\n",
            " answer: False\n",
            "Search query: Ensuring that the project includes security and data protection measures.\n",
            " answer: False\n",
            "Search query: Verifying that students must conduct a project post-mortem analysis.\n",
            " answer: False\n",
            "Search query: Checking if students are required to create mockups and wireframes during the design phase.\n",
            " answer: True\n",
            "Search query: Confirming that students need to use continuous integration and delivery (CI/CD) pipelines.\n",
            " answer: err\n",
            "Search query: Ensuring that students conduct stakeholder interviews and gather feedback.\n",
            " answer: True\n",
            "Search query: Verifying that students must develop and execute test plans.\n",
            " answer: True\n",
            "Search query: Checking if the project includes scalability planning.\n",
            " answer: False\n",
            "Search query: Confirming that students need to adhere to coding standards and guidelines.\n",
            " answer: False\n",
            "Search query: Ensuring that students perform regular code refactoring and optimization.\n",
            " answer: True\n",
            "Search query: Verifying that students must create API documentation if applicable.\n",
            " answer: False\n",
            "Search query: Checking if students need to use data modeling and database design techniques.\n",
            " answer: True\n",
            "Search query: Confirming that students must include error handling and logging in their project.\n",
            " answer: False\n",
            "Search query: Ensuring that students conduct market research as part of the project.\n",
            " answer: False\n"
          ]
        }
      ],
      "source": [
        "outans = []\n",
        "with open('out_of_data.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    question = line.strip()\n",
        "    try:\n",
        "      answer = chain.invoke(({\"question\": question}))\n",
        "    except Exception as e:\n",
        "      answer = \"err\"\n",
        "    print( \" answer: \" + answer)\n",
        "    outans.append(answer)\n",
        "\n",
        "with open(\"outofans.txt\", 'w') as f:\n",
        "    for item in outans:\n",
        "        f.write(\"%s\\n\" % item)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "-uuLN7btcIj_"
      },
      "outputs": [],
      "source": [
        "relact = []\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "OyD6NCPAcR6S"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "p-Ie_YXncS0T"
      },
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "g04c0VbszDUe",
        "outputId": "889e7702-95cc-4752-e608-18f9ae4df5bb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Collecting streamlit\n",
            "  Downloading streamlit-1.34.0-py2.py3-none-any.whl (8.5 MB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m8.5/8.5 MB\u001b[0m \u001b[31m22.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: altair<6,>=4.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (4.2.2)\n",
            "Requirement already satisfied: blinker<2,>=1.0.0 in /usr/lib/python3/dist-packages (from streamlit) (1.4)\n",
            "Requirement already satisfied: cachetools<6,>=4.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (5.3.3)\n",
            "Requirement already satisfied: click<9,>=7.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (8.1.7)\n",
            "Requirement already satisfied: numpy<2,>=1.19.3 in /usr/local/lib/python3.10/dist-packages (from streamlit) (1.25.2)\n",
            "Requirement already satisfied: packaging<25,>=16.8 in /usr/local/lib/python3.10/dist-packages (from streamlit) (23.2)\n",
            "Requirement already satisfied: pandas<3,>=1.3.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (2.0.3)\n",
            "Requirement already satisfied: pillow<11,>=7.1.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (9.4.0)\n",
            "Requirement already satisfied: protobuf<5,>=3.20 in /usr/local/lib/python3.10/dist-packages (from streamlit) (3.20.3)\n",
            "Requirement already satisfied: pyarrow>=7.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (14.0.2)\n",
            "Requirement already satisfied: requests<3,>=2.27 in /usr/local/lib/python3.10/dist-packages (from streamlit) (2.31.0)\n",
            "Requirement already satisfied: rich<14,>=10.14.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (13.7.1)\n",
            "Requirement already satisfied: tenacity<9,>=8.1.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (8.3.0)\n",
            "Requirement already satisfied: toml<2,>=0.10.1 in /usr/local/lib/python3.10/dist-packages (from streamlit) (0.10.2)\n",
            "Requirement already satisfied: typing-extensions<5,>=4.3.0 in /usr/local/lib/python3.10/dist-packages (from streamlit) (4.11.0)\n",
            "Collecting gitpython!=3.1.19,<4,>=3.0.7 (from streamlit)\n",
            "  Downloading GitPython-3.1.43-py3-none-any.whl (207 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m207.3/207.3 kB\u001b[0m \u001b[31m21.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hCollecting pydeck<1,>=0.8.0b4 (from streamlit)\n",
            "  Downloading pydeck-0.9.1-py2.py3-none-any.whl (6.9 MB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.9/6.9 MB\u001b[0m \u001b[31m56.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: tornado<7,>=6.0.3 in /usr/local/lib/python3.10/dist-packages (from streamlit) (6.3.3)\n",
            "Collecting watchdog>=2.1.5 (from streamlit)\n",
            "  Downloading watchdog-4.0.0-py3-none-manylinux2014_x86_64.whl (82 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m83.0/83.0 kB\u001b[0m \u001b[31m9.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: entrypoints in /usr/local/lib/python3.10/dist-packages (from altair<6,>=4.0->streamlit) (0.4)\n",
            "Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from altair<6,>=4.0->streamlit) (3.1.4)\n",
            "Requirement already satisfied: jsonschema>=3.0 in /usr/local/lib/python3.10/dist-packages (from altair<6,>=4.0->streamlit) (4.19.2)\n",
            "Requirement already satisfied: toolz in /usr/local/lib/python3.10/dist-packages (from altair<6,>=4.0->streamlit) (0.12.1)\n",
            "Collecting gitdb<5,>=4.0.1 (from gitpython!=3.1.19,<4,>=3.0.7->streamlit)\n",
            "  Downloading gitdb-4.0.11-py3-none-any.whl (62 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m62.7/62.7 kB\u001b[0m \u001b[31m5.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.10/dist-packages (from pandas<3,>=1.3.0->streamlit) (2.8.2)\n",
            "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas<3,>=1.3.0->streamlit) (2023.4)\n",
            "Requirement already satisfied: tzdata>=2022.1 in /usr/local/lib/python3.10/dist-packages (from pandas<3,>=1.3.0->streamlit) (2024.1)\n",
            "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2.27->streamlit) (3.3.2)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2.27->streamlit) (3.7)\n",
            "Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2.27->streamlit) (2.0.7)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests<3,>=2.27->streamlit) (2024.2.2)\n",
            "Requirement already satisfied: markdown-it-py>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from rich<14,>=10.14.0->streamlit) (3.0.0)\n",
            "Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.10/dist-packages (from rich<14,>=10.14.0->streamlit) (2.16.1)\n",
            "Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->gitpython!=3.1.19,<4,>=3.0.7->streamlit)\n",
            "  Downloading smmap-5.0.1-py3-none-any.whl (24 kB)\n",
            "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->altair<6,>=4.0->streamlit) (2.1.5)\n",
            "Requirement already satisfied: attrs>=22.2.0 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit) (23.2.0)\n",
            "Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit) (2023.12.1)\n",
            "Requirement already satisfied: referencing>=0.28.4 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit) (0.35.1)\n",
            "Requirement already satisfied: rpds-py>=0.7.1 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit) (0.18.1)\n",
            "Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py>=2.2.0->rich<14,>=10.14.0->streamlit) (0.1.2)\n",
            "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.2->pandas<3,>=1.3.0->streamlit) (1.16.0)\n",
            "Installing collected packages: watchdog, smmap, pydeck, gitdb, gitpython, streamlit\n",
            "Successfully installed gitdb-4.0.11 gitpython-3.1.43 pydeck-0.9.1 smmap-5.0.1 streamlit-1.34.0 watchdog-4.0.0\n"
          ]
        }
      ],
      "source": [
        "pip install streamlit"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 70
        },
        "id": "lSkRJAJGMZx5",
        "outputId": "0c47b1c2-b5a3-49fe-9704-95e62417cc2b"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: My undergraduate degree is from electronics, what all the prerequisites do I need to finish for MSACS degree ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'If your undergraduate degree is in electronics, you will need to complete prerequisites in data structures, computer networks or network fundamentals, database systems, discrete mathematics, and statistics for the MSACS degree.'"
            ]
          },
          "execution_count": 5,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "answerquery(\"My undergraduate degree is from electronics, what all the prerequisites do I need to finish for MSACS degree ?\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 70
        },
        "id": "HRtFs28sM-CU",
        "outputId": "ddfc437d-e10f-4e4d-c241-42beaec7d2c7"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: My undergraduate degree is from computer science, what all the prerequisites do I need to finish for MSACS degree ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'If your undergraduate degree is in computer science, you would need to complete prerequisites in data structures, computer networks or network fundamentals, database systems, discrete mathematics, and statistics for the MSACS degree.'"
            ]
          },
          "execution_count": 6,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "answerquery(\"My undergraduate degree is from computer science, what all the prerequisites do I need to finish for MSACS degree ?\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "fQEfTusEzDXc"
      },
      "outputs": [],
      "source": [
        "# %%writefile main.py\n",
        "\n",
        "from langchain_core.runnables import (\n",
        "    RunnableBranch,\n",
        "    RunnableLambda,\n",
        "    RunnableParallel,\n",
        "    RunnablePassthrough,\n",
        ")\n",
        "from langchain_core.prompts import ChatPromptTemplate\n",
        "from langchain_core.prompts.prompt import PromptTemplate\n",
        "from langchain_core.pydantic_v1 import BaseModel, Field\n",
        "from typing import Tuple, List, Optional\n",
        "from langchain_core.messages import AIMessage, HumanMessage\n",
        "from langchain_core.output_parsers import StrOutputParser\n",
        "import os\n",
        "from langchain_community.graphs import Neo4jGraph\n",
        "from langchain.text_splitter import TokenTextSplitter\n",
        "from langchain_openai import ChatOpenAI\n",
        "from langchain_experimental.graph_transformers import LLMGraphTransformer\n",
        "from neo4j import GraphDatabase\n",
        "from yfiles_jupyter_graphs import GraphWidget\n",
        "from langchain_community.vectorstores import Neo4jVector\n",
        "from langchain_openai import OpenAIEmbeddings\n",
        "from langchain_community.vectorstores.neo4j_vector import remove_lucene_chars\n",
        "from langchain_core.runnables import ConfigurableField, RunnableParallel, RunnablePassthrough\n",
        "\n",
        "\n",
        "try:\n",
        "  import google.colab\n",
        "  from google.colab import output\n",
        "  output.enable_custom_widget_manager()\n",
        "except:\n",
        "  pass\n",
        "\n",
        "os.environ[\"OPENAI_API_KEY\"] = \"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\"\n",
        "os.environ[\"NEO4J_URI\"] = \"bolt+s://d66e8589.databases.neo4j.io:7687\"\n",
        "os.environ[\"NEO4J_USERNAME\"] = \"neo4j\"\n",
        "os.environ[\"NEO4J_PASSWORD\"] = \"QAChatbot\"\n",
        "_search_query = RunnableLambda(lambda x : x[\"question\"])\n",
        "\n",
        "\n",
        "graph = Neo4jGraph()\n",
        "\n",
        "llm=ChatOpenAI(temperature=0, model_name=\"gpt-3.5-turbo-0125\") # gpt-4-0125-preview occasionally has issues\n",
        "llm_transformer = LLMGraphTransformer(llm=llm)\n",
        "\n",
        "vector_index = Neo4jVector.from_existing_graph(\n",
        "    OpenAIEmbeddings(),\n",
        "    search_type=\"hybrid\",\n",
        "    node_label=\"Document\",\n",
        "    text_node_properties=[\"text\"],\n",
        "    embedding_node_property=\"embedding\"\n",
        ")\n",
        "\n",
        "\n",
        "graph.query(\n",
        "    \"CREATE FULLTEXT INDEX entity IF NOT EXISTS FOR (e:__Entity__) ON EACH [e.id]\")\n",
        "\n",
        "# Extract entities from text\n",
        "class Entities(BaseModel):\n",
        "    \"\"\"Identifying information about entities.\"\"\"\n",
        "\n",
        "    names: List[str] = Field(\n",
        "        ...,\n",
        "        description=\"All the courses, requirements, or business entities that \"\n",
        "        \"appear in the text\",\n",
        "    )\n",
        "\n",
        "prompt = ChatPromptTemplate.from_messages(\n",
        "    [\n",
        "        (\n",
        "            \"system\",\n",
        "            \"You are extracting course, professors, requirements, project entities from the text.\",\n",
        "        ),\n",
        "        (\n",
        "            \"human\",\n",
        "            \"Use the given format to extract information from the following \"\n",
        "            \"input: {question}\",\n",
        "        ),\n",
        "    ]\n",
        ")\n",
        "\n",
        "entity_chain = prompt | llm.with_structured_output(Entities)\n",
        "\n",
        "def generate_full_text_query(input: str) -> str:\n",
        "    \"\"\"\n",
        "    Generate a full-text search query for a given input string.\n",
        "\n",
        "    This function constructs a query string suitable for a full-text search.\n",
        "    It processes the input string by splitting it into words and appending a\n",
        "    similarity threshold (~2 changed characters) to each word, then combines\n",
        "    them using the AND operator. Useful for mapping entities from user questions\n",
        "    to database values, and allows for some misspelings.\n",
        "    \"\"\"\n",
        "    full_text_query = \"\"\n",
        "    words = [el for el in remove_lucene_chars(input).split() if el]\n",
        "    for word in words[:-1]:\n",
        "        full_text_query += f\" {word}~2 AND\"\n",
        "    full_text_query += f\" {words[-1]}~2\"\n",
        "    return full_text_query.strip()\n",
        "\n",
        "# Fulltext index query\n",
        "def structured_retriever(question: str) -> str:\n",
        "    \"\"\"\n",
        "    Collects the neighborhood of entities mentioned\n",
        "    in the question\n",
        "    \"\"\"\n",
        "    result = \"\"\n",
        "    entities = entity_chain.invoke({\"question\": question})\n",
        "    for entity in entities.names:\n",
        "        response = graph.query(\n",
        "            \"\"\"CALL db.index.fulltext.queryNodes('entity', $query, {limit:2})\n",
        "            YIELD node,score\n",
        "            CALL {\n",
        "              WITH node\n",
        "              MATCH (node)-[r:!MENTIONS]->(neighbor)\n",
        "              RETURN node.id + ' - ' + type(r) + ' -> ' + neighbor.id AS output\n",
        "              UNION ALL\n",
        "              WITH node\n",
        "              MATCH (node)<-[r:!MENTIONS]-(neighbor)\n",
        "              RETURN neighbor.id + ' - ' + type(r) + ' -> ' +  node.id AS output\n",
        "            }\n",
        "            RETURN output LIMIT 50\n",
        "            \"\"\",\n",
        "            {\"query\": generate_full_text_query(entity)},\n",
        "        )\n",
        "        result += \"\\n\".join([el['output'] for el in response])\n",
        "    return result\n",
        "\n",
        "def retriever(question: str):\n",
        "    print(f\"Search query: {question}\")\n",
        "    structured_data = structured_retriever(question)\n",
        "    unstructured_data = [el.page_content for el in vector_index.similarity_search(question)]\n",
        "    final_data = f\"\"\" Structured data: {structured_data} Unstructured data: {\"#Document \". join(unstructured_data)}  \"\"\"\n",
        "    return final_data\n",
        "\n",
        "\n",
        "def answerquery(question: str):\n",
        "  template = \"\"\"Answer the question based only on the following context:\n",
        "  {context}\n",
        "\n",
        "  Question: {question}\n",
        "  Use natural language and be concise.\n",
        "  Answer:\"\"\"\n",
        "  prompt = ChatPromptTemplate.from_template(template)\n",
        "\n",
        "  chain = (\n",
        "      RunnableParallel(\n",
        "          {\n",
        "              \"context\": _search_query | retriever,\n",
        "              \"question\": RunnablePassthrough(),\n",
        "          }\n",
        "      )\n",
        "      | prompt\n",
        "      | llm\n",
        "      | StrOutputParser()\n",
        "  )\n",
        "\n",
        "  return chain.invoke(({\"question\": question}))\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 104
        },
        "id": "rsJvlEFCNYfm",
        "outputId": "1494ba82-b922-4d23-b5cc-f2e0d2ad129e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: I am a computer science undergraduate, what all the things i need to be prepared to be a successful graduate ?\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'As a computer science undergraduate, to be a successful graduate, you need to ensure you have completed coursework in data structures, computer networks, database systems, discrete mathematics, and statistics. Additionally, aim for a GRE score of 290 or higher, maintain a GPA of 3.0 or above, and have fewer than 7 backlogs. It is also beneficial to have completed a course in data structures and have a background in technical computing disciplines.'"
            ]
          },
          "execution_count": 7,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "answerquery(\"I am a computer science undergraduate, what all the things i need to be prepared to be a successful graduate ?\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "OkLa_eY-EMrI"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "bnlgV6O_a-jR",
        "outputId": "e3a0e516-3df5-4927-c328-36e5ad65cf42"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Search query: \"Does the MSACS program require 30 credits to finish the program if there are no prerequisites?\"\n",
            " answer: Yes, the MSACS program requires 30 credits to finish the program even if there are no prerequisites.\n",
            "Search query: \"Does the MSACS program not require 35 credits to finish the program if there are no prerequisites?\"\n",
            " answer: The MSACS program does not require 35 credits to finish the program if there are no prerequisites.\n",
            "Search query: \"Does the MSACS program require 35 credits to finish the program if there are no prerequisites?\"\n",
            " answer: The MSACS program does not require 35 credits to finish the program if there are no prerequisites.\n",
            "Search query: \"Does the MSACS program not require 30 credits to finish the program if there are no prerequisites?\"\n",
            " answer: The MSACS program does require 30 credits to finish the program, even if there are no prerequisites.\n",
            "Search query: \"Is Dr. Ajay Bandi the professor for the course 'Application Design: Patterns And Frameworks' in the MSACS program?\"\n",
            " answer: Yes, Dr. Ajay Bandi is the professor for the course 'Application Design: Patterns And Frameworks' in the MSACS program.\n",
            "Search query: \"Is Dr. Isam Alobaidi not the professor for the course 'Data Visualization' in the MSACS program?\"\n",
            " answer: Dr. Isam Alobaidi is not the professor for the course 'Data Visualization' in the MSACS program.\n",
            "Search query: \"Is Dr. Ajay Bandi the professor for the course 'Database Systems' in the MSACS program?\"\n",
            " answer: Yes.\n",
            "Search query: \"Is Dr. Isam Alobaidi not the professor for the course 'Graduate Directed Project I' in the MSACS program?\"\n",
            " answer: Dr. Isam Alobaidi is not the professor for the course 'Graduate Directed Project I' in the MSACS program.\n",
            "Search query: \"Does the course 'Mobile Computing: iOS' have 3 credit hours in the MSACS program?\"\n",
            " answer: Yes, the course 'Mobile Computing: iOS' has 3 credit hours in the MSACS program.\n",
            "Search query: \"Does the course 'Graduate Directed Project I' not have 4 credit hours in the MSACS program?\"\n",
            " answer: No, the course 'Graduate Directed Project I' does not have 4 credit hours in the MSACS program.\n",
            "Search query: \"Does the course 'Web Mining' have 4 credit hours in the MSACS program?\"\n",
            " answer: No, the course 'Web Mining' does not have 4 credit hours in the MSACS program.\n",
            "Search query: \"Does the course 'Application Design: Patterns And Frameworks' not have 3 credit hours in the MSACS program?\"\n",
            " answer: The course 'Application Design: Patterns And Frameworks' does have 3 credit hours in the MSACS program.\n",
            "Search query: \"Is 'Object-Oriented Programming' a required course in the MSACS program?\"\n",
            " answer: Yes, 'Object-Oriented Programming' is a required course in the MSACS program.\n",
            "Search query: \"Is 'Database Systems' not a required course in the MSACS program?\"\n",
            " answer: \"Database Systems\" is a required course in the MSACS program.\n",
            "Search query: \"Is 'Generative AI' a required course in the MSACS program?\"\n",
            " answer: No, \"Generative AI\" is not a required course in the MSACS program.\n",
            "Search query: \"Is 'Object-Oriented Programming' not a required course in the MSACS program?\"\n",
            " answer: \"Object-Oriented Programming\" is a required course in the MSACS program.\n",
            "Search query: \"If I didn't take Database in my undergrad, do I need to take a prerequisite course for the MSACS program?\"\n",
            " answer: Yes, if you didn't take Database in your undergrad, you need to take a prerequisite course for the MSACS program, which is 44-460 Database Systems.\n",
            "Search query: \"If I took Database in my undergrad, do I not need to take a prerequisite course for the MSACS program?\"\n",
            " answer: If you took Database in your undergrad, you do not need to take a prerequisite course for the MSACS program.\n",
            "Search query: \"If I took Database in my undergrad, do I need to take a prerequisite course for the MSACS program?\"\n",
            " answer: No, if you took Database in your undergrad, you do not need to take a prerequisite course for the MSACS program.\n",
            "Search query: \"If I didn't take Database in my undergrad, do I not need to take a prerequisite course for the MSACS program?\"\n",
            " answer: If you didn't take Database in your undergrad, you will need to take a prerequisite course for the MSACS program.\n",
            "Search query: \"Can prerequisites for the MSACS program be completed concurrently with required courses?\"\n",
            " answer: No, prerequisites for the MSACS program cannot be completed concurrently with required courses.\n",
            "Search query: \"Does MSACS programs require four-year undergraduate degree to enroll?\"\n",
            " answer: Yes, the MSACS program requires a four-year undergraduate degree to enroll.\n",
            "Search query: \n"
          ]
        },
        {
          "ename": "ClientError",
          "evalue": "{code: Neo.ClientError.Procedure.ProcedureCallFailed} {message: Failed to invoke procedure `db.index.fulltext.queryNodes`: Caused by: org.apache.lucene.queryparser.classic.ParseException: Encountered \"<EOF>\" at line 1, column 0.\nWas expecting one of:\n    <NOT> ...\n    \"+\" ...\n    \"-\" ...\n    <BAREOPER> ...\n    \"(\" ...\n    \"*\" ...\n    <QUOTED> ...\n    <TERM> ...\n    <PREFIXTERM> ...\n    <WILDTERM> ...\n    <REGEXPTERM> ...\n    \"[\" ...\n    \"{\" ...\n    <NUMBER> ...\n    <TERM> ...\n    }",
          "output_type": "error",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mClientError\u001b[0m                               Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-7-98521afb4d93>\u001b[0m in \u001b[0;36m<cell line: 1>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      2\u001b[0m   \u001b[0;32mfor\u001b[0m \u001b[0mline\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mfile\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      3\u001b[0m     \u001b[0mques\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mline\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mstrip\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 4\u001b[0;31m     \u001b[0mans\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0manswerquery\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mques\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      5\u001b[0m     \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m \u001b[0;34m\" answer: \"\u001b[0m \u001b[0;34m+\u001b[0m \u001b[0mans\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/content/gdrive/MyDrive/main.py\u001b[0m in \u001b[0;36manswerquery\u001b[0;34m(question)\u001b[0m\n\u001b[1;32m    156\u001b[0m   )\n\u001b[1;32m    157\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 158\u001b[0;31m   \u001b[0;32mreturn\u001b[0m \u001b[0mchain\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0minvoke\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m{\u001b[0m\u001b[0;34m\"question\"\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mquestion\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36minvoke\u001b[0;34m(self, input, config)\u001b[0m\n\u001b[1;32m   2391\u001b[0m         \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2392\u001b[0m             \u001b[0;32mfor\u001b[0m \u001b[0mi\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mstep\u001b[0m \u001b[0;32min\u001b[0m \u001b[0menumerate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msteps\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 2393\u001b[0;31m                 input = step.invoke(\n\u001b[0m\u001b[1;32m   2394\u001b[0m                     \u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2395\u001b[0m                     \u001b[0;31m# mark each step as a child run\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36minvoke\u001b[0;34m(self, input, config)\u001b[0m\n\u001b[1;32m   3034\u001b[0m                     \u001b[0;32mfor\u001b[0m \u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mstep\u001b[0m \u001b[0;32min\u001b[0m \u001b[0msteps\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mitems\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3035\u001b[0m                 ]\n\u001b[0;32m-> 3036\u001b[0;31m                 \u001b[0moutput\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m{\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mfuture\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mresult\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfuture\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mzip\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0msteps\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfutures\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   3037\u001b[0m         \u001b[0;31m# finish the root run\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3038\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mBaseException\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0me\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36m<dictcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m   3034\u001b[0m                     \u001b[0;32mfor\u001b[0m \u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mstep\u001b[0m \u001b[0;32min\u001b[0m \u001b[0msteps\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mitems\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3035\u001b[0m                 ]\n\u001b[0;32m-> 3036\u001b[0;31m                 \u001b[0moutput\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m{\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mfuture\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mresult\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfuture\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mzip\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0msteps\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfutures\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   3037\u001b[0m         \u001b[0;31m# finish the root run\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3038\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mBaseException\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0me\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/lib/python3.10/concurrent/futures/_base.py\u001b[0m in \u001b[0;36mresult\u001b[0;34m(self, timeout)\u001b[0m\n\u001b[1;32m    456\u001b[0m                     \u001b[0;32mraise\u001b[0m \u001b[0mCancelledError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    457\u001b[0m                 \u001b[0;32melif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_state\u001b[0m \u001b[0;34m==\u001b[0m \u001b[0mFINISHED\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 458\u001b[0;31m                     \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m__get_result\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    459\u001b[0m                 \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    460\u001b[0m                     \u001b[0;32mraise\u001b[0m \u001b[0mTimeoutError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/lib/python3.10/concurrent/futures/_base.py\u001b[0m in \u001b[0;36m__get_result\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m    401\u001b[0m         \u001b[0;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_exception\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    402\u001b[0m             \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 403\u001b[0;31m                 \u001b[0;32mraise\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_exception\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    404\u001b[0m             \u001b[0;32mfinally\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    405\u001b[0m                 \u001b[0;31m# Break a reference cycle with the exception in self._exception\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/lib/python3.10/concurrent/futures/thread.py\u001b[0m in \u001b[0;36mrun\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m     56\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     57\u001b[0m         \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 58\u001b[0;31m             \u001b[0mresult\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfn\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     59\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mBaseException\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mexc\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     60\u001b[0m             \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfuture\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mset_exception\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mexc\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36minvoke\u001b[0;34m(self, input, config)\u001b[0m\n\u001b[1;32m   2391\u001b[0m         \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2392\u001b[0m             \u001b[0;32mfor\u001b[0m \u001b[0mi\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mstep\u001b[0m \u001b[0;32min\u001b[0m \u001b[0menumerate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msteps\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 2393\u001b[0;31m                 input = step.invoke(\n\u001b[0m\u001b[1;32m   2394\u001b[0m                     \u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2395\u001b[0m                     \u001b[0;31m# mark each step as a child run\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36minvoke\u001b[0;34m(self, input, config, **kwargs)\u001b[0m\n\u001b[1;32m   3855\u001b[0m         \u001b[0;34m\"\"\"Invoke this runnable synchronously.\"\"\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3856\u001b[0m         \u001b[0;32mif\u001b[0m \u001b[0mhasattr\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m\"func\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 3857\u001b[0;31m             return self._call_with_config(\n\u001b[0m\u001b[1;32m   3858\u001b[0m                 \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_invoke\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3859\u001b[0m                 \u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36m_call_with_config\u001b[0;34m(self, func, input, config, run_type, **kwargs)\u001b[0m\n\u001b[1;32m   1501\u001b[0m             output = cast(\n\u001b[1;32m   1502\u001b[0m                 \u001b[0mOutput\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1503\u001b[0;31m                 context.run(\n\u001b[0m\u001b[1;32m   1504\u001b[0m                     \u001b[0mcall_func_with_variable_args\u001b[0m\u001b[0;34m,\u001b[0m  \u001b[0;31m# type: ignore[arg-type]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1505\u001b[0m                     \u001b[0mfunc\u001b[0m\u001b[0;34m,\u001b[0m  \u001b[0;31m# type: ignore[arg-type]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/config.py\u001b[0m in \u001b[0;36mcall_func_with_variable_args\u001b[0;34m(func, input, config, run_manager, **kwargs)\u001b[0m\n\u001b[1;32m    344\u001b[0m     \u001b[0;32mif\u001b[0m \u001b[0mrun_manager\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m \u001b[0;32mand\u001b[0m \u001b[0maccepts_run_manager\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mfunc\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    345\u001b[0m         \u001b[0mkwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"run_manager\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mrun_manager\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 346\u001b[0;31m     \u001b[0;32mreturn\u001b[0m \u001b[0mfunc\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m  \u001b[0;31m# type: ignore[call-arg]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    347\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    348\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/base.py\u001b[0m in \u001b[0;36m_invoke\u001b[0;34m(self, input, run_manager, config, **kwargs)\u001b[0m\n\u001b[1;32m   3729\u001b[0m                         \u001b[0moutput\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mchunk\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3730\u001b[0m         \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 3731\u001b[0;31m             output = call_func_with_variable_args(\n\u001b[0m\u001b[1;32m   3732\u001b[0m                 \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfunc\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mconfig\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mrun_manager\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   3733\u001b[0m             )\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_core/runnables/config.py\u001b[0m in \u001b[0;36mcall_func_with_variable_args\u001b[0;34m(func, input, config, run_manager, **kwargs)\u001b[0m\n\u001b[1;32m    344\u001b[0m     \u001b[0;32mif\u001b[0m \u001b[0mrun_manager\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m \u001b[0;32mand\u001b[0m \u001b[0maccepts_run_manager\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mfunc\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    345\u001b[0m         \u001b[0mkwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"run_manager\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mrun_manager\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 346\u001b[0;31m     \u001b[0;32mreturn\u001b[0m \u001b[0mfunc\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0minput\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m  \u001b[0;31m# type: ignore[call-arg]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    347\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    348\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/content/gdrive/MyDrive/main.py\u001b[0m in \u001b[0;36mretriever\u001b[0;34m(question)\u001b[0m\n\u001b[1;32m    130\u001b[0m     \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34mf\"Search query: {question}\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    131\u001b[0m     \u001b[0mstructured_data\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mstructured_retriever\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mquestion\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 132\u001b[0;31m     \u001b[0munstructured_data\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m[\u001b[0m\u001b[0mel\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpage_content\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mel\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mvector_index\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msimilarity_search\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mquestion\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    133\u001b[0m     \u001b[0mfinal_data\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34mf\"\"\" Structured data: {structured_data} Unstructured data: {\"#Document \". join(unstructured_data)}  \"\"\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    134\u001b[0m     \u001b[0;32mreturn\u001b[0m \u001b[0mfinal_data\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_community/vectorstores/neo4j_vector.py\u001b[0m in \u001b[0;36msimilarity_search\u001b[0;34m(self, query, k, params, filter, **kwargs)\u001b[0m\n\u001b[1;32m    915\u001b[0m         \"\"\"\n\u001b[1;32m    916\u001b[0m         \u001b[0membedding\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0membedding\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0membed_query\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mtext\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mquery\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 917\u001b[0;31m         return self.similarity_search_by_vector(\n\u001b[0m\u001b[1;32m    918\u001b[0m             \u001b[0membedding\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0membedding\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    919\u001b[0m             \u001b[0mk\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_community/vectorstores/neo4j_vector.py\u001b[0m in \u001b[0;36msimilarity_search_by_vector\u001b[0;34m(self, embedding, k, filter, **kwargs)\u001b[0m\n\u001b[1;32m   1076\u001b[0m             \u001b[0mList\u001b[0m \u001b[0mof\u001b[0m \u001b[0mDocuments\u001b[0m \u001b[0mmost\u001b[0m \u001b[0msimilar\u001b[0m \u001b[0mto\u001b[0m \u001b[0mthe\u001b[0m \u001b[0mquery\u001b[0m \u001b[0mvector\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1077\u001b[0m         \"\"\"\n\u001b[0;32m-> 1078\u001b[0;31m         docs_and_scores = self.similarity_search_with_score_by_vector(\n\u001b[0m\u001b[1;32m   1079\u001b[0m             \u001b[0membedding\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0membedding\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mk\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfilter\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mfilter\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1080\u001b[0m         )\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_community/vectorstores/neo4j_vector.py\u001b[0m in \u001b[0;36msimilarity_search_with_score_by_vector\u001b[0;34m(self, embedding, k, filter, params, **kwargs)\u001b[0m\n\u001b[1;32m   1042\u001b[0m         }\n\u001b[1;32m   1043\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1044\u001b[0;31m         \u001b[0mresults\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mquery\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mread_query\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mparams\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mparameters\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   1045\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1046\u001b[0m         docs = [\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_community/vectorstores/neo4j_vector.py\u001b[0m in \u001b[0;36mquery\u001b[0;34m(self, query, params)\u001b[0m\n\u001b[1;32m    607\u001b[0m             \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    608\u001b[0m                 \u001b[0mdata\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0msession\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrun\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mquery\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mparams\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 609\u001b[0;31m                 \u001b[0;32mreturn\u001b[0m \u001b[0;34m[\u001b[0m\u001b[0mr\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdata\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mr\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mdata\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    610\u001b[0m             \u001b[0;32mexcept\u001b[0m \u001b[0mCypherSyntaxError\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0me\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    611\u001b[0m                 \u001b[0;32mraise\u001b[0m \u001b[0mValueError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34mf\"Cypher Statement is not valid\\n{e}\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/langchain_community/vectorstores/neo4j_vector.py\u001b[0m in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m    607\u001b[0m             \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    608\u001b[0m                 \u001b[0mdata\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0msession\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrun\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mquery\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mparams\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 609\u001b[0;31m                 \u001b[0;32mreturn\u001b[0m \u001b[0;34m[\u001b[0m\u001b[0mr\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdata\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mr\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mdata\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    610\u001b[0m             \u001b[0;32mexcept\u001b[0m \u001b[0mCypherSyntaxError\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0me\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    611\u001b[0m                 \u001b[0;32mraise\u001b[0m \u001b[0mValueError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34mf\"Cypher Statement is not valid\\n{e}\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/neo4j/_sync/work/result.py\u001b[0m in \u001b[0;36m__iter__\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m    268\u001b[0m                 \u001b[0;32myield\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_record_buffer\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpopleft\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    269\u001b[0m             \u001b[0;32melif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_streaming\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 270\u001b[0;31m                 \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_connection\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfetch_message\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    271\u001b[0m             \u001b[0;32melif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_discarding\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    272\u001b[0m                 \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_discard\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_common.py\u001b[0m in \u001b[0;36minner\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m    176\u001b[0m             \u001b[0;32mdef\u001b[0m \u001b[0minner\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    177\u001b[0m                 \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 178\u001b[0;31m                     \u001b[0mfunc\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    179\u001b[0m                 \u001b[0;32mexcept\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0mNeo4jError\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mServiceUnavailable\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mSessionExpired\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mexc\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    180\u001b[0m                     \u001b[0;32massert\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0masyncio\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0miscoroutinefunction\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m__on_error\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt.py\u001b[0m in \u001b[0;36mfetch_message\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m    848\u001b[0m             \u001b[0mhydration_hooks\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mresponses\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m0\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mhydration_hooks\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    849\u001b[0m         )\n\u001b[0;32m--> 850\u001b[0;31m         \u001b[0mres\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_process_message\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mtag\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mfields\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    851\u001b[0m         \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0midle_since\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mmonotonic\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    852\u001b[0m         \u001b[0;32mreturn\u001b[0m \u001b[0mres\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_bolt5.py\u001b[0m in \u001b[0;36m_process_message\u001b[0;34m(self, tag, fields)\u001b[0m\n\u001b[1;32m    367\u001b[0m             \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_server_state_manager\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mstate\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbolt_states\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mFAILED\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    368\u001b[0m             \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 369\u001b[0;31m                 \u001b[0mresponse\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mon_failure\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0msummary_metadata\u001b[0m \u001b[0;32mor\u001b[0m \u001b[0;34m{\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    370\u001b[0m             \u001b[0;32mexcept\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0mServiceUnavailable\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mDatabaseUnavailable\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    371\u001b[0m                 \u001b[0;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpool\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/neo4j/_sync/io/_common.py\u001b[0m in \u001b[0;36mon_failure\u001b[0;34m(self, metadata)\u001b[0m\n\u001b[1;32m    243\u001b[0m         \u001b[0mhandler\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mhandlers\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mget\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"on_summary\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    244\u001b[0m         \u001b[0mUtil\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcallback\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mhandler\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 245\u001b[0;31m         \u001b[0;32mraise\u001b[0m \u001b[0mNeo4jError\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mhydrate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mmetadata\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    246\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    247\u001b[0m     \u001b[0;32mdef\u001b[0m \u001b[0mon_ignored\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mmetadata\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;32mNone\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mClientError\u001b[0m: {code: Neo.ClientError.Procedure.ProcedureCallFailed} {message: Failed to invoke procedure `db.index.fulltext.queryNodes`: Caused by: org.apache.lucene.queryparser.classic.ParseException: Encountered \"<EOF>\" at line 1, column 0.\nWas expecting one of:\n    <NOT> ...\n    \"+\" ...\n    \"-\" ...\n    <BAREOPER> ...\n    \"(\" ...\n    \"*\" ...\n    <QUOTED> ...\n    <TERM> ...\n    <PREFIXTERM> ...\n    <WILDTERM> ...\n    <REGEXPTERM> ...\n    \"[\" ...\n    \"{\" ...\n    <NUMBER> ...\n    <TERM> ...\n    }"
          ]
        }
      ],
      "source": [
        "with open('tests.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    ques = line.strip()\n",
        "    ans = answerquery(remove_lucene_chars(ques))\n",
        "    print( \" answer: \" + ans)\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 634
        },
        "id": "UvqwSJts1Lyh",
        "outputId": "04c0b6ff-712a-4f20-ec9d-e040fa947feb"
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "2024-05-23 07:47:51.044 \n",
            "  \u001b[33m\u001b[1mWarning:\u001b[0m to view this Streamlit app on a browser, run it with the following\n",
            "  command:\n",
            "\n",
            "    streamlit run /usr/local/lib/python3.10/dist-packages/colab_kernel_launcher.py [ARGUMENTS]\n",
            "2024-05-23 07:47:51.074 Session state does not function when running a script without `streamlit run`\n"
          ]
        },
        {
          "ename": "AttributeError",
          "evalue": "st.session_state has no attribute \"messages\". Did you forget to initialize it? More info: https://docs.streamlit.io/library/advanced-features/session-state#initialization",
          "output_type": "error",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m    410\u001b[0m         \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 411\u001b[0;31m             \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_getitem\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mwidget_id\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    412\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state.py\u001b[0m in \u001b[0;36m_getitem\u001b[0;34m(self, widget_id, user_key)\u001b[0m\n\u001b[1;32m    455\u001b[0m         \u001b[0;31m# We'll never get here\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 456\u001b[0;31m         \u001b[0;32mraise\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    457\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mKeyError\u001b[0m: ",
            "\nDuring handling of the above exception, another exception occurred:\n",
            "\u001b[0;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state_proxy.py\u001b[0m in \u001b[0;36m__getattr__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m    118\u001b[0m         \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 119\u001b[0;31m             \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    120\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state_proxy.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m     89\u001b[0m         \u001b[0mrequire_valid_user_key\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 90\u001b[0;31m         \u001b[0;32mreturn\u001b[0m \u001b[0mget_session_state\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     91\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/safe_session_state.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m     92\u001b[0m         \u001b[0;32mwith\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_lock\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 93\u001b[0;31m             \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_state\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     94\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m    412\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 413\u001b[0;31m             \u001b[0;32mraise\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0m_missing_key_error_message\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    414\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mKeyError\u001b[0m: 'st.session_state has no key \"messages\". Did you forget to initialize it? More info: https://docs.streamlit.io/library/advanced-features/session-state#initialization'",
            "\nDuring handling of the above exception, another exception occurred:\n",
            "\u001b[0;31mAttributeError\u001b[0m                            Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-4-6772d18077e5>\u001b[0m in \u001b[0;36m<cell line: 13>\u001b[0;34m()\u001b[0m\n\u001b[1;32m     11\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     12\u001b[0m \u001b[0;31m# Display chat messages from history on app rerun\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 13\u001b[0;31m \u001b[0;32mfor\u001b[0m \u001b[0mmessage\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mst\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msession_state\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mmessages\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     14\u001b[0m     \u001b[0;32mwith\u001b[0m \u001b[0mst\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mchat_message\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmessage\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"role\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     15\u001b[0m         \u001b[0mst\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mmarkdown\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmessage\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"content\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/streamlit/runtime/state/session_state_proxy.py\u001b[0m in \u001b[0;36m__getattr__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m    119\u001b[0m             \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    120\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 121\u001b[0;31m             \u001b[0;32mraise\u001b[0m \u001b[0mAttributeError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0m_missing_attr_error_message\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    122\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    123\u001b[0m     \u001b[0;34m@\u001b[0m\u001b[0mgather_metrics\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"session_state.set_attr\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mAttributeError\u001b[0m: st.session_state has no attribute \"messages\". Did you forget to initialize it? More info: https://docs.streamlit.io/library/advanced-features/session-state#initialization"
          ]
        }
      ],
      "source": [
        "# %%writefile app.py\n",
        "\n",
        "import streamlit as st\n",
        "from main import answerquery\n",
        "\n",
        "st.title(\"NWMSU QA Chatbot\")\n",
        "\n",
        "# Initialize chat history\n",
        "if \"messages\" not in st.session_state:\n",
        "    st.session_state.messages = []\n",
        "\n",
        "# Display chat messages from history on app rerun\n",
        "for message in st.session_state.messages:\n",
        "    with st.chat_message(message[\"role\"]):\n",
        "        st.markdown(message[\"content\"])\n",
        "\n",
        "# React to user input\n",
        "if prompt := st.text_input(\"What is up?\"):\n",
        "    # Display user message in chat message container\n",
        "    st.chat_message(\"user\").markdown(prompt)\n",
        "    # Add user message to chat history\n",
        "    st.session_state.messages.append({\"role\": \"user\", \"content\": prompt})\n",
        "\n",
        "    response = answerquery(prompt)\n",
        "    # Display assistant response in chat message container\n",
        "    with st.chat_message(\"assistant\"):\n",
        "        st.markdown(response)\n",
        "    # Add assistant response to chat history\n",
        "    st.session_state.messages.append({\"role\": \"assistant\", \"content\": response})"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "pFXRTzY3a1-U"
      },
      "outputs": [],
      "source": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "XSa1vLuu1xyT"
      },
      "outputs": [],
      "source": [
        "!streamlit run app.py &>/content/logs.txt &"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "BLp7Yp5n13ij",
        "outputId": "423a4df3-8553-400b-b68d-b7f81627de9c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "34.125.42.231\n",
            "\u001b[K\u001b[?25hnpx: installed 22 in 4.032s\n",
            "your url is: https://social-suits-pump.loca.lt\n"
          ]
        }
      ],
      "source": [
        "!npx localtunnel --port 8501 & curl icanhazip.com"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2ukFCz6T17CQ",
        "outputId": "65ad744e-61ec-40dc-a6ca-bf5609c5ba8c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFalse.\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tTRUE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "FALSE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tTRUE\n",
            "\n",
            "TRUE\tFALSE\n",
            "\n",
            "TRUE\tFALSE\n"
          ]
        }
      ],
      "source": [
        "actuals = []\n",
        "preds = []\n",
        "with open('predictions.txt', 'r') as file:\n",
        "  for line in file:\n",
        "    print(line)\n",
        "    try:\n",
        "      actual = line.strip().split(\"\\t\")[0]\n",
        "      pred   = line.strip().split(\"\\t\")[1]\n",
        "      actuals.append(actual)\n",
        "      preds.append(pred)\n",
        "    except Exception as e:\n",
        "      continue"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "DGSbWb1IfwDr",
        "outputId": "c7b0cd0e-85f8-4217-b46d-a320571bb150"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "1011 1011\n"
          ]
        }
      ],
      "source": [
        "print(len(actuals), len(preds))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "3gEha_Ojg5AN",
        "outputId": "ab006991-2f24-406a-acff-37c5fb96ad2a"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "['TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'False.', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'TRUE', 'FALSE', 'FALSE', 'TRUE', 'FALSE', 'TRUE', 'FALSE', 'FALSE']\n"
          ]
        }
      ],
      "source": [
        "print(preds)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "uIHMQ9D0jUPZ",
        "outputId": "ca4fcb22-6982-418e-c463-e0c2e8b3ff28"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "['FALSE' 'TRUE']\n"
          ]
        }
      ],
      "source": [
        "print(np.unique(preds))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "Nac--o3pjpo9"
      },
      "outputs": [],
      "source": [
        "actuals = np.array(actuals)\n",
        "preds = np.array(preds)\n",
        "preds = np.where(preds == \"False.\", \"FALSE\", preds)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "NPH8GHN6hYDB",
        "outputId": "2357c5e4-f628-4940-a29a-5966c1239703"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "[[549  15]\n",
            " [160 287]]\n",
            "Precision: 0.9503311258278145\n",
            "Accuracy: 0.8269040553907022\n",
            "Recall: 0.6420581655480985\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "from sklearn.metrics import confusion_matrix, precision_score, accuracy_score, recall_score\n",
        "cm = confusion_matrix(np.array(actuals), np.array(preds))\n",
        "print(cm)\n",
        "\n",
        "TN, FP, FN, TP = cm.ravel()\n",
        "\n",
        "precision = precision_score(np.array(actuals), np.array(preds), pos_label=\"TRUE\")\n",
        "accuracy = accuracy_score(np.array(actuals), np.array(preds))\n",
        "recall = recall_score(np.array(actuals), np.array(preds), pos_label=\"TRUE\")\n",
        "\n",
        "print(f\"Precision: {precision}\")\n",
        "print(f\"Accuracy: {accuracy}\")\n",
        "print(f\"Recall: {recall}\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "B10ADRFrlTcU",
        "outputId": "f617619f-f3e3-40f0-df01-41d1cbeff5bb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "1011 1011\n"
          ]
        }
      ],
      "source": [
        "print(len(actuals), len(preds))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2g8hIMeah_QA"
      },
      "outputs": [],
      "source": [
        "relact = actuals[0:339]\n",
        "irrelact = actuals[340:679]\n",
        "outact = actuals[680:1011]\n",
        "\n",
        "relpred = preds[0:339]\n",
        "irrelpred = preds[340:679]\n",
        "outpred = preds[680:1011]"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RqXzwjiWl4Gf",
        "outputId": "16a1cf65-46a3-491d-9c1a-1e5856b54973"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "[[106  10]\n",
            " [ 19 204]]\n",
            "[[338   1]\n",
            " [  0   0]]\n",
            "[[104   4]\n",
            " [141  82]]\n",
            "relevant\n",
            "Precision: 95.32710280373831\n",
            "Accuracy: 91.44542772861357\n",
            "Recall: 91.4798206278027\n",
            "irrelevant\n",
            "Precision: 0.0\n",
            "Accuracy: 99.70501474926253\n",
            "Recall: 0.0\n",
            "outof\n",
            "Precision: 95.34883720930233\n",
            "Accuracy: 56.19335347432024\n",
            "Recall: 36.771300448430495\n"
          ]
        },
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.10/dist-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Recall is ill-defined and being set to 0.0 due to no true samples. Use `zero_division` parameter to control this behavior.\n",
            "  _warn_prf(average, modifier, msg_start, len(result))\n"
          ]
        }
      ],
      "source": [
        "relcm = confusion_matrix(relact, relpred)\n",
        "irrelcm = confusion_matrix(irrelact, irrelpred)\n",
        "outcm = confusion_matrix(outact, outpred)\n",
        "\n",
        "print(relcm)\n",
        "print(irrelcm)\n",
        "print(outcm)\n",
        "\n",
        "\n",
        "relTN, relFP, relFN, relTP = relcm.ravel()\n",
        "relTN, relFP, relFN, relTP = irrelcm.ravel()\n",
        "relTN, relFP, relFN, relTP = outcm.ravel()\n",
        "\n",
        "print(\"relevant\")\n",
        "precision = precision_score(relact, relpred, pos_label=\"TRUE\")\n",
        "accuracy = accuracy_score(relact, relpred)\n",
        "recall = recall_score(relact, relpred, pos_label=\"TRUE\")\n",
        "\n",
        "print(f\"Precision: {precision*100}\")\n",
        "print(f\"Accuracy: {accuracy*100}\")\n",
        "print(f\"Recall: {recall*100}\")\n",
        "\n",
        "print(\"irrelevant\")\n",
        "\n",
        "precision = precision_score(irrelact, irrelpred, pos_label=\"TRUE\")\n",
        "accuracy = accuracy_score(irrelact, irrelpred)\n",
        "recall = recall_score(irrelact, irrelpred, pos_label=\"TRUE\")\n",
        "\n",
        "print(f\"Precision: {precision*100}\")\n",
        "print(f\"Accuracy: {accuracy*100}\")\n",
        "print(f\"Recall: {recall*100}\")\n",
        "\n",
        "print(\"outof\")\n",
        "\n",
        "precision = precision_score(outact, outpred, pos_label=\"TRUE\")\n",
        "accuracy = accuracy_score(outact, outpred)\n",
        "recall = recall_score(outact, outpred, pos_label=\"TRUE\")\n",
        "\n",
        "print(f\"Precision: {precision*100}\")\n",
        "print(f\"Accuracy: {accuracy*100}\")\n",
        "print(f\"Recall: {recall*100}\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ANTSHq8xm7_X"
      },
      "outputs": [],
      "source": []
    }
  ],
  "metadata": {
    "colab": {
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.12.0"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "2de0209c64b94c65ac698d0f3b8e2262": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "2.0.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "2.0.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "2.0.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border_bottom": null,
            "border_left": null,
            "border_right": null,
            "border_top": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": "800px",
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "ff55d6b49443428cb1cbdfdcc9d88eec": {
          "model_module": "yfiles-jupyter-graphs",
          "model_module_version": "^1.7.1",
          "model_name": "GraphModel",
          "state": {
            "_context_pane_mapping": [
              {
                "id": "Neighborhood",
                "title": "Neighborhood"
              },
              {
                "id": "Data",
                "title": "Data"
              },
              {
                "id": "Search",
                "title": "Search"
              },
              {
                "id": "About",
                "title": "About"
              }
            ],
            "_data_importer": "neo4j",
            "_directed": true,
            "_dom_classes": [],
            "_edges": [
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 10,
                "id": 1152924803141730300,
                "label": "APPLICATION_DEADLINE",
                "properties": {
                  "label": "APPLICATION_DEADLINE"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 11,
                "id": 1155176602955415600,
                "label": "APPLICATION_DEADLINE",
                "properties": {
                  "label": "APPLICATION_DEADLINE"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 12,
                "id": 1157428402769100800,
                "label": "APPLICATION_DEADLINE",
                "properties": {
                  "label": "APPLICATION_DEADLINE"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9E9E9E",
                "directed": true,
                "end": 13,
                "id": 1152925902653358000,
                "label": "OFFERS",
                "properties": {
                  "label": "OFFERS"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9E9E9E",
                "directed": true,
                "end": 14,
                "id": 1155177702467043300,
                "label": "OFFERS",
                "properties": {
                  "label": "OFFERS"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9E9E9E",
                "directed": true,
                "end": 254,
                "id": 6917533425687593000,
                "label": "OFFERS",
                "properties": {
                  "label": "OFFERS"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 15,
                "id": 1152927002164985900,
                "label": "REQUIRES",
                "properties": {
                  "label": "REQUIRES"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 16,
                "id": 1155178801978671000,
                "label": "REQUIRES",
                "properties": {
                  "label": "REQUIRES"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 17,
                "id": 1157430601792356400,
                "label": "REQUIRES",
                "properties": {
                  "label": "REQUIRES"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 18,
                "id": 1159682401606041600,
                "label": "REQUIRES",
                "properties": {
                  "label": "REQUIRES"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#2196F3",
                "directed": true,
                "end": 157,
                "id": 6917597197362004000,
                "label": "LOCATED_IN",
                "properties": {
                  "label": "LOCATED_IN"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#4CAF50",
                "directed": true,
                "end": 87,
                "id": 6917603794431771000,
                "label": "PURSUANT_TO",
                "properties": {
                  "label": "PURSUANT_TO"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#4CAF50",
                "directed": true,
                "end": 88,
                "id": 6917603794431771000,
                "label": "PURSUANT_TO",
                "properties": {
                  "label": "PURSUANT_TO"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#F44336",
                "directed": true,
                "end": 180,
                "id": 6917605993455026000,
                "label": "AFFILIATE",
                "properties": {
                  "label": "AFFILIATE"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#607D8B",
                "directed": true,
                "end": 213,
                "id": 6917623585641071000,
                "label": "AVAILABILITY",
                "properties": {
                  "label": "AVAILABILITY"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#607D8B",
                "directed": true,
                "end": 214,
                "id": 6917623585641071000,
                "label": "AVAILABILITY",
                "properties": {
                  "label": "AVAILABILITY"
                },
                "start": 1,
                "thickness_factor": 1
              },
              {
                "color": "#673AB7",
                "directed": true,
                "end": 1,
                "id": 1152922604118474800,
                "label": "OFFERED_AT",
                "properties": {
                  "label": "OFFERED_AT"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 3,
                "id": 1152923703630102500,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 4,
                "id": 1155175503443787800,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 5,
                "id": 1157427303257473000,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 6,
                "id": 1159679103071158300,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 7,
                "id": 1161930902884843500,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 8,
                "id": 1164182702698528800,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 9,
                "id": 1166434502512214000,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#9E9E9E",
                "directed": true,
                "end": 31,
                "id": 1152934698746380300,
                "label": "PROVIDES_OPT_EXTENSION",
                "properties": {
                  "label": "PROVIDES_OPT_EXTENSION"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 51,
                "id": 1152942395327774700,
                "label": "PROGRAM_OFFERED_AT",
                "properties": {
                  "label": "PROGRAM_OFFERED_AT"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#2196F3",
                "directed": true,
                "end": 65,
                "id": 1152943494839402500,
                "label": "HAS_ADMISSION_CRITERIA",
                "properties": {
                  "label": "HAS_ADMISSION_CRITERIA"
                },
                "start": 2,
                "thickness_factor": 1
              },
              {
                "color": "#4CAF50",
                "directed": true,
                "end": 1,
                "id": 1152928101676613600,
                "label": "HOSTED_AT",
                "properties": {
                  "label": "HOSTED_AT"
                },
                "start": 19,
                "thickness_factor": 1
              },
              {
                "color": "#F44336",
                "directed": true,
                "end": 21,
                "id": 1152929201188241400,
                "label": "LOCATION",
                "properties": {
                  "label": "LOCATION"
                },
                "start": 19,
                "thickness_factor": 1
              },
              {
                "color": "#F44336",
                "directed": true,
                "end": 22,
                "id": 1155181001001926700,
                "label": "LOCATION",
                "properties": {
                  "label": "LOCATION"
                },
                "start": 19,
                "thickness_factor": 1
              },
              {
                "color": "#F44336",
                "directed": true,
                "end": 216,
                "id": 6917536724222476000,
                "label": "LOCATION",
                "properties": {
                  "label": "LOCATION"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#607D8B",
                "directed": true,
                "end": 26,
                "id": 1152932499723124700,
                "label": "HAS",
                "properties": {
                  "label": "HAS"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#673AB7",
                "directed": true,
                "end": 36,
                "id": 1152935798258008000,
                "label": "HOUSES",
                "properties": {
                  "label": "HOUSES"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 42,
                "id": 1152941295816147000,
                "label": "OFFERS_PROGRAM",
                "properties": {
                  "label": "OFFERS_PROGRAM"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 44,
                "id": 1155193095629832200,
                "label": "OFFERS_PROGRAM",
                "properties": {
                  "label": "OFFERS_PROGRAM"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#9E9E9E",
                "directed": true,
                "end": 27,
                "id": 6917624685152698000,
                "label": "ATTENTION",
                "properties": {
                  "label": "ATTENTION"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#9C27B0",
                "directed": true,
                "end": 217,
                "id": 6917625784664326000,
                "label": "LOW",
                "properties": {
                  "label": "LOW"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#2196F3",
                "directed": true,
                "end": 218,
                "id": 6917626884175954000,
                "label": "BEAUTIFUL",
                "properties": {
                  "label": "BEAUTIFUL"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#4CAF50",
                "directed": true,
                "end": 219,
                "id": 6917627983687582000,
                "label": "1300_TREES",
                "properties": {
                  "label": "1300_TREES"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#F44336",
                "directed": true,
                "end": 220,
                "id": 6917629083199209000,
                "label": "125_DIFFERENT_SPECIES",
                "properties": {
                  "label": "125_DIFFERENT_SPECIES"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#607D8B",
                "directed": true,
                "end": 221,
                "id": 6917630182710837000,
                "label": "MISSOURI_STATE_ARBORETUM",
                "properties": {
                  "label": "MISSOURI_STATE_ARBORETUM"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#673AB7",
                "directed": true,
                "end": 222,
                "id": 6917631282222465000,
                "label": "GOOD_SCHOLARSHIPS",
                "properties": {
                  "label": "GOOD_SCHOLARSHIPS"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 223,
                "id": 6917632381734093000,
                "label": "FIRST-RATE_PROGRAMS",
                "properties": {
                  "label": "FIRST-RATE_PROGRAMS"
                },
                "start": 24,
                "thickness_factor": 1
              },
              {
                "color": "#673AB7",
                "directed": true,
                "end": 24,
                "id": 1152922604118474800,
                "label": "OFFERED_AT",
                "properties": {
                  "label": "OFFERED_AT"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 92,
                "id": 1152923703630102500,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 93,
                "id": 1155175503443787800,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 95,
                "id": 1157427303257473000,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 97,
                "id": 1159679103071158300,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 99,
                "id": 1161930902884843500,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              },
              {
                "color": "#CDDC39",
                "directed": true,
                "end": 101,
                "id": 1164182702698528800,
                "label": "INCLUDES",
                "properties": {
                  "label": "INCLUDES"
                },
                "start": 25,
                "thickness_factor": 1
              }
            ],
            "_graph_layout": {},
            "_highlight": [],
            "_license": {},
            "_model_module": "yfiles-jupyter-graphs",
            "_model_module_version": "^1.7.1",
            "_model_name": "GraphModel",
            "_neighborhood": {},
            "_nodes": [
              {
                "color": "#2196F3",
                "id": 1,
                "label": "Northwest Missouri State University",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Northwest Missouri State University",
                  "label": "Organization:__Entity__:University"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#2196F3"
              },
              {
                "color": "#4CAF50",
                "id": 10,
                "label": "Last Day To Apply For Spring Semester",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Last Day To Apply For Spring Semester",
                  "label": "__Entity__:Important date"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#4CAF50",
                "id": 11,
                "label": "Last Day To Apply For Fall Semester",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Last Day To Apply For Fall Semester",
                  "label": "__Entity__:Important date"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#4CAF50",
                "id": 12,
                "label": "Last Day To Apply For Summer Semester",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Last Day To Apply For Summer Semester",
                  "label": "__Entity__:Important date"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#F44336",
                "id": 13,
                "label": "Scholarship",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Scholarship",
                  "label": "__Entity__:Financial aid"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#F44336"
              },
              {
                "color": "#607D8B",
                "id": 14,
                "label": "Graduate Assistantship",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Graduate Assistantship",
                  "label": "__Entity__:Opportunity:Financial aid"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#673AB7",
                "id": 254,
                "label": "Msacs Program",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Msacs Program",
                  "label": "__Entity__:Academic program"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#673AB7"
              },
              {
                "color": "#CDDC39",
                "id": 15,
                "label": "Documents Required For Admission",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Documents Required For Admission",
                  "label": "Admission requirement:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#CDDC39"
              },
              {
                "color": "#9E9E9E",
                "id": 16,
                "label": "Database Systems Course",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Database Systems Course",
                  "label": "__Entity__:Course requirement:Academic course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9E9E9E"
              },
              {
                "color": "#9C27B0",
                "id": 17,
                "label": "Minimum Gpa Requirement",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Minimum Gpa Requirement",
                  "label": "__Entity__:Academic requirement"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#2196F3",
                "id": 18,
                "label": "Opt Application Processing Steps",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Opt Application Processing Steps",
                  "label": "Procedure:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#2196F3"
              },
              {
                "color": "#4CAF50",
                "id": 157,
                "label": "Kansas City",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Kansas City",
                  "label": "Location:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#F44336",
                "id": 87,
                "label": "Title Ix",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Title Ix",
                  "label": "Law:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#F44336"
              },
              {
                "color": "#607D8B",
                "id": 88,
                "label": "34 Cfr Part 106",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "34 Cfr Part 106",
                  "label": "Regulation:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#673AB7",
                "id": 180,
                "label": "Upsilon Pi Epsilon",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Upsilon Pi Epsilon",
                  "label": "__Entity__:Organization"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#673AB7"
              },
              {
                "color": "#CDDC39",
                "id": 213,
                "label": "On-Campus Housing",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "On-Campus Housing",
                  "label": "Housing:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#CDDC39"
              },
              {
                "color": "#CDDC39",
                "id": 214,
                "label": "Off-Campus Housing",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Off-Campus Housing",
                  "label": "Housing:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#CDDC39"
              },
              {
                "color": "#9E9E9E",
                "id": 2,
                "label": "Master Of Science In Applied Computer Science",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Master Of Science In Applied Computer Science",
                  "label": "Degree program:__Entity__:Academic program:Program"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9E9E9E"
              },
              {
                "color": "#9C27B0",
                "id": 3,
                "label": "Generative Ai",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Generative Ai",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 4,
                "label": "Mobile Computing Ios",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Mobile Computing Ios",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 5,
                "label": "Patterns And Frameworks",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Patterns And Frameworks",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 6,
                "label": "Advance Databases",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Advance Databases",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#2196F3",
                "id": 7,
                "label": "Java",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Java",
                  "label": "__Entity__:Course:Programming language"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#2196F3"
              },
              {
                "color": "#9C27B0",
                "id": 8,
                "label": "Big Data",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Big Data",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 9,
                "label": "Graduate Direct Project",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Graduate Direct Project",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#673AB7",
                "id": 31,
                "label": "U.S. Citizenship And Immigration Services",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "U.S. Citizenship And Immigration Services",
                  "label": "__Entity__:Organization"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#673AB7"
              },
              {
                "color": "#4CAF50",
                "id": 51,
                "label": "Graduate School",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Graduate School",
                  "label": "__Entity__:Academic institution"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#F44336",
                "id": 65,
                "label": "Admissions Criteria",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Admissions Criteria",
                  "label": "Requirement:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#F44336"
              },
              {
                "color": "#607D8B",
                "id": 19,
                "label": "Spring 2024 Commencement Ceremony",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Spring 2024 Commencement Ceremony",
                  "label": "Event:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#4CAF50",
                "id": 21,
                "label": "Bearcat Arena",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Bearcat Arena",
                  "label": "Location:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#4CAF50",
                "id": 22,
                "label": "Lamkin Activity Center",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Lamkin Activity Center",
                  "label": "Location:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#673AB7",
                "id": 24,
                "label": "Northwest",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Northwest",
                  "label": "Organization:Campus:__Entity__:University"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#673AB7"
              },
              {
                "color": "#CDDC39",
                "id": 216,
                "label": "United States",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "United States",
                  "label": "__Entity__:Country"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#CDDC39"
              },
              {
                "color": "#9E9E9E",
                "id": 26,
                "label": "Csis",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Csis",
                  "label": "Department:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9E9E9E"
              },
              {
                "color": "#9C27B0",
                "id": 36,
                "label": "Colden Hall Computing Complex",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Colden Hall Computing Complex",
                  "label": "Computer laboratory:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#2196F3",
                "id": 42,
                "label": "Applied Computer Science",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Applied Computer Science",
                  "label": "Field of study:__Entity__:Academic program"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#2196F3"
              },
              {
                "color": "#4CAF50",
                "id": 44,
                "label": "Computer Science",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Computer Science",
                  "label": "Academic discipline:__Entity__:Field of study:Field"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#4CAF50"
              },
              {
                "color": "#F44336",
                "id": 27,
                "label": "Faculty",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Faculty",
                  "label": "Academic staff:__Entity__:Person:Group"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#F44336"
              },
              {
                "color": "#607D8B",
                "id": 217,
                "label": "Tuition",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Tuition",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 218,
                "label": "Campus",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Campus",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 219,
                "label": "Trees",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Trees",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 220,
                "label": "Species",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Species",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 221,
                "label": "Arboretum",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Arboretum",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 222,
                "label": "Scholarships",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Scholarships",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#607D8B",
                "id": 223,
                "label": "Programs",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Programs",
                  "label": "Concept:__Entity__"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#607D8B"
              },
              {
                "color": "#673AB7",
                "id": 25,
                "label": "Ms-Acs",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "Ms-Acs",
                  "label": "Program:__Entity__:Academic program"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#673AB7"
              },
              {
                "color": "#9C27B0",
                "id": 92,
                "label": "44-460",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-460",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 93,
                "label": "44-542",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-542",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 95,
                "label": "44-560",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-560",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 97,
                "label": "44-563",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-563",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 99,
                "label": "44-618",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-618",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              },
              {
                "color": "#9C27B0",
                "id": 101,
                "label": "44-643",
                "position": [
                  0,
                  0
                ],
                "properties": {
                  "id": "44-643",
                  "label": "__Entity__:Course"
                },
                "scale_factor": 1,
                "size": [
                  55,
                  55
                ],
                "styles": {},
                "type": "#9C27B0"
              }
            ],
            "_overview": {
              "enabled": null,
              "overview_set": false
            },
            "_selected_graph": [
              [],
              []
            ],
            "_sidebar": {
              "enabled": true,
              "start_with": ""
            },
            "_view_count": null,
            "_view_module": "yfiles-jupyter-graphs",
            "_view_module_version": "^1.7.1",
            "_view_name": "GraphView",
            "layout": "IPY_MODEL_2de0209c64b94c65ac698d0f3b8e2262",
            "tabbable": null,
            "tooltip": null
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}