프롬프트엔지니어링_실습.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "512b6fa0"
      },
      "source": [
        "# 앤드류 응의 'ChatGPT 프롬프트 엔지니어링'\n",
        "\n",
        "- [ref](https://www.deeplearning.ai/short-courses/chatgpt-prompt-engineering-for-developers/)\n",
        "\n",
        "    - 프롬프트 엔지니어링으로 LLM 사용법 극대화하기\n",
        "    -  LLM으로 어플리케이션 빠르게 구축하기\n",
        "    -  프롬프트 최적화, 추론, 문장변환, 활용\n",
        "    -  나만의 맞춤형 챗봇 구축하기"
      ],
      "id": "512b6fa0"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5a9aa1e6"
      },
      "source": [
        "# 0_Setup\n",
        "#### Load the API key and relevant Python libaries."
      ],
      "id": "5a9aa1e6"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "b10d0b53"
      },
      "source": [
        "In this course, we've provided some code that loads the OpenAI API key for you."
      ],
      "id": "b10d0b53"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ba33adea"
      },
      "outputs": [],
      "source": [
        "## 본인의 openai api 키 입력\n",
        "OPENAI_API_KEY = 'sk-XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX'\n",
        "# OPENAI_API_KEY = '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'"
      ],
      "id": "ba33adea"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "f8da6a9a",
        "outputId": "72e44eb6-dcda-4cd3-f59c-963b50e6e92a",
        "scrolled": false
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
            "Collecting openai\n",
            "  Downloading openai-0.27.6-py3-none-any.whl (71 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m71.9/71.9 kB\u001b[0m \u001b[31m8.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: requests>=2.20 in /usr/local/lib/python3.10/dist-packages (from openai) (2.27.1)\n",
            "Requirement already satisfied: tqdm in /usr/local/lib/python3.10/dist-packages (from openai) (4.65.0)\n",
            "Collecting aiohttp (from openai)\n",
            "  Downloading aiohttp-3.8.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.0/1.0 MB\u001b[0m \u001b[31m70.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hRequirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (1.26.15)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (2022.12.7)\n",
            "Requirement already satisfied: charset-normalizer~=2.0.0 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (2.0.12)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests>=2.20->openai) (3.4)\n",
            "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->openai) (23.1.0)\n",
            "Collecting multidict<7.0,>=4.5 (from aiohttp->openai)\n",
            "  Downloading multidict-6.0.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (114 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m114.5/114.5 kB\u001b[0m \u001b[31m15.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hCollecting async-timeout<5.0,>=4.0.0a3 (from aiohttp->openai)\n",
            "  Downloading async_timeout-4.0.2-py3-none-any.whl (5.8 kB)\n",
            "Collecting yarl<2.0,>=1.0 (from aiohttp->openai)\n",
            "  Downloading yarl-1.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (268 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m268.8/268.8 kB\u001b[0m \u001b[31m35.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hCollecting frozenlist>=1.1.1 (from aiohttp->openai)\n",
            "  Downloading frozenlist-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (149 kB)\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m149.6/149.6 kB\u001b[0m \u001b[31m23.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hCollecting aiosignal>=1.1.2 (from aiohttp->openai)\n",
            "  Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)\n",
            "Installing collected packages: multidict, frozenlist, async-timeout, yarl, aiosignal, aiohttp, openai\n",
            "Successfully installed aiohttp-3.8.4 aiosignal-1.3.1 async-timeout-4.0.2 frozenlist-1.3.3 multidict-6.0.4 openai-0.27.6 yarl-1.9.2\n"
          ]
        }
      ],
      "source": [
        "!pip install openai"
      ],
      "id": "f8da6a9a"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "a221858f"
      },
      "outputs": [],
      "source": [
        "import openai\n",
        "import os\n",
        "import time\n",
        "\n",
        "openai.api_key  = OPENAI_API_KEY"
      ],
      "id": "a221858f"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c7864bb7"
      },
      "source": [
        "#### helper function\n",
        "Throughout this course, we will use OpenAI's `gpt-3.5-turbo` model and the [chat completions endpoint](https://platform.openai.com/docs/guides/chat).\n",
        "\n",
        "This helper function will make it easier to use prompts and look at the generated outputs:"
      ],
      "id": "c7864bb7"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "19342c27"
      },
      "outputs": [],
      "source": [
        "def get_completion(prompt, model=\"gpt-3.5-turbo\", temperature=0):\n",
        "    messages = [{\"role\": \"user\", \"content\": prompt}]\n",
        "    response = openai.ChatCompletion.create(\n",
        "        model=model,\n",
        "        messages=messages,\n",
        "        temperature=temperature, # this is the degree of randomness of the model's output\n",
        "    )\n",
        "    return response.choices[0].message[\"content\"]"
      ],
      "id": "19342c27"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2a9fac1f"
      },
      "outputs": [],
      "source": [
        "# error, retry 추가\n",
        "def get_completion(prompt, model=\"gpt-3.5-turbo\", temperature=0, verbose=False):\n",
        "    messages = [{\"role\": \"user\", \"content\": prompt}]\n",
        "\n",
        "    time_start = time.time()\n",
        "    retry_count = 3\n",
        "    for i in range(0, retry_count):\n",
        "        while True:\n",
        "            try:\n",
        "                response = openai.ChatCompletion.create(\n",
        "                    model=model,\n",
        "                    messages=messages,\n",
        "                    temperature=temperature, # this is the degree of randomness of the model's output\n",
        "                )\n",
        "                answer = response['choices'][0]['message']['content'].strip()\n",
        "                tokens = response.usage.total_tokens\n",
        "\n",
        "\n",
        "                time_end = time.time()\n",
        "\n",
        "                if verbose:\n",
        "                    print('prompt: %s | token: %d | %.1fsec\\nanwer : %s'%(prompt, tokens, (time_end - time_start), answer))\n",
        "                return answer\n",
        "\n",
        "            except Exception as error:\n",
        "                print(f\"API Error: {error}\")\n",
        "                print(f\"Retrying {i+1} time(s) in 4 seconds...\")\n",
        "\n",
        "                if i+1 == retry_count:\n",
        "                    return prompt, None, None\n",
        "                time.sleep(4)\n",
        "                continue"
      ],
      "id": "2a9fac1f"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "background_save": true,
          "base_uri": "https://localhost:8080/"
        },
        "id": "0bb7ef7b",
        "outputId": "0da8aade-a036-43e7-f04d-df6077b3e72f"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n",
            "API Error: <empty message>\n",
            "Retrying 1 time(s) in 4 seconds...\n"
          ]
        }
      ],
      "source": [
        "prompt = 'ChatGPT가 뭔지 20단어로 설명해주세요'\n",
        "대답 = get_completion(prompt, model=\"gpt-3.5-turbo\")\n",
        "print(대답)"
      ],
      "id": "0bb7ef7b"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "8171e864"
      },
      "outputs": [],
      "source": [],
      "id": "8171e864"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "d232b2e5"
      },
      "source": [
        "# 1_Guidelines for Prompting\n",
        "In this lesson, you'll practice two prompting principles and their related tactics in order to write effective prompts for large language models."
      ],
      "id": "d232b2e5"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ccf542e7"
      },
      "source": [
        "## Prompting Principles\n",
        "- **Principle 1: Write clear and specific instructions**  명확하고 구체적인 지침 작성\n",
        "- **Principle 2: Give the model time to “think”**\n",
        "모델에게 \"생각\"할 시간을 주십시오.\n",
        "\n",
        "### Tactics\n",
        "\n",
        "#### Tactic 1: Use delimiters to clearly indicate distinct parts of the input,   구분 기호를 사용하여 입력의 고유한 부분을 명확하게 표시\n",
        "- Delimiters can be anything like: ```, \"\"\", < >, `<tag> </tag>`, `:`,  구분자는 다음과 같을 수 있습니다"
      ],
      "id": "ccf542e7"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2338c1c8"
      },
      "outputs": [],
      "source": [
        "text = f\"\"\"\n",
        "You should express what you want a model to do by \\\n",
        "providing instructions that are as clear and \\\n",
        "specific as you can possibly make them. \\\n",
        "This will guide the model towards the desired output, \\\n",
        "and reduce the chances of receiving irrelevant \\\n",
        "or incorrect responses. Don't confuse writing a \\\n",
        "clear prompt with writing a short prompt. \\\n",
        "In many cases, longer prompts provide more clarity \\\n",
        "and context for the model, which can lead to \\\n",
        "more detailed and relevant outputs.\n",
        "\"\"\"\n",
        "prompt = f\"\"\"\n",
        "Summarize the text delimited by triple backticks \\\n",
        "into a single sentence.\n",
        "```{text}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "2338c1c8"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2e165099"
      },
      "outputs": [],
      "source": [],
      "id": "2e165099"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3d658f03"
      },
      "source": [
        "#### Tactic 2: Ask for a structured output\n",
        "- JSON, HTML"
      ],
      "id": "3d658f03"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "70434b84"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Generate a list of three made-up book titles along \\\n",
        "with their authors and genres.\n",
        "Provide them in JSON format with the following keys:\n",
        "book_id, title, author, genre.\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "70434b84"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "d592bf86"
      },
      "source": [
        "#### Tactic 3: Ask the model to check whether conditions are satisfied"
      ],
      "id": "d592bf86"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "d249a2d0"
      },
      "outputs": [],
      "source": [
        "text_1 = f\"\"\"\n",
        "Making a cup of tea is easy! First, you need to get some \\\n",
        "water boiling. While that's happening, \\\n",
        "grab a cup and put a tea bag in it. Once the water is \\\n",
        "hot enough, just pour it over the tea bag. \\\n",
        "Let it sit for a bit so the tea can steep. After a \\\n",
        "few minutes, take out the tea bag. If you \\\n",
        "like, you can add some sugar or milk to taste. \\\n",
        "And that's it! You've got yourself a delicious \\\n",
        "cup of tea to enjoy.\n",
        "\"\"\"\n",
        "prompt = f\"\"\"\n",
        "You will be provided with text delimited by triple quotes.\n",
        "If it contains a sequence of instructions, \\\n",
        "re-write those instructions in the following format:\n",
        "\n",
        "Step 1 - ...\n",
        "Step 2 - …\n",
        "…\n",
        "Step N - …\n",
        "\n",
        "If the text does not contain a sequence of instructions, \\\n",
        "then simply write \\\"No steps provided.\\\"\n",
        "\n",
        "\\\"\\\"\\\"{text_1}\\\"\\\"\\\"\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(\"Completion for Text 1:\")\n",
        "print(response)"
      ],
      "id": "d249a2d0"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "50f87943"
      },
      "outputs": [],
      "source": [
        "text_2 = f\"\"\"\n",
        "The sun is shining brightly today, and the birds are \\\n",
        "singing. It's a beautiful day to go for a \\\n",
        "walk in the park. The flowers are blooming, and the \\\n",
        "trees are swaying gently in the breeze. People \\\n",
        "are out and about, enjoying the lovely weather. \\\n",
        "Some are having picnics, while others are playing \\\n",
        "games or simply relaxing on the grass. It's a \\\n",
        "perfect day to spend time outdoors and appreciate the \\\n",
        "beauty of nature.\n",
        "\"\"\"\n",
        "prompt = f\"\"\"\n",
        "You will be provided with text delimited by triple quotes.\n",
        "If it contains a sequence of instructions, \\\n",
        "re-write those instructions in the following format:\n",
        "\n",
        "Step 1 - ...\n",
        "Step 2 - …\n",
        "…\n",
        "Step N - …\n",
        "\n",
        "If the text does not contain a sequence of instructions, \\\n",
        "then simply write \\\"No steps provided.\\\"\n",
        "\n",
        "\\\"\\\"\\\"{text_2}\\\"\\\"\\\"\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(\"Completion for Text 2:\")\n",
        "print(response)"
      ],
      "id": "50f87943"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "e57f71f6"
      },
      "source": [
        "#### Tactic 4: \"Few-shot\" prompting"
      ],
      "id": "e57f71f6"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "d5692690"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to answer in a consistent style.\n",
        "\n",
        "<child>: Teach me about patience.\n",
        "\n",
        "<grandparent>: The river that carves the deepest \\\n",
        "valley flows from a modest spring; the \\\n",
        "grandest symphony originates from a single note; \\\n",
        "the most intricate tapestry begins with a solitary thread.\n",
        "\n",
        "<child>: Teach me about resilience.\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "d5692690"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "254e7331"
      },
      "source": [
        "### Principle 2: Give the model time to “think”\n",
        "\n",
        "#### Tactic 1: Specify the steps required to complete a task"
      ],
      "id": "254e7331"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "f759a425"
      },
      "outputs": [],
      "source": [
        "text = f\"\"\"\n",
        "In a charming village, siblings Jack and Jill set out on \\\n",
        "a quest to fetch water from a hilltop \\\n",
        "well. As they climbed, singing joyfully, misfortune \\\n",
        "struck—Jack tripped on a stone and tumbled \\\n",
        "down the hill, with Jill following suit. \\\n",
        "Though slightly battered, the pair returned home to \\\n",
        "comforting embraces. Despite the mishap, \\\n",
        "their adventurous spirits remained undimmed, and they \\\n",
        "continued exploring with delight.\n",
        "\"\"\"\n",
        "# example 1\n",
        "prompt_1 = f\"\"\"\n",
        "Perform the following actions:\n",
        "1 - Summarize the following text delimited by triple \\\n",
        "backticks with 1 sentence.\n",
        "2 - Translate the summary into French.\n",
        "3 - List each name in the French summary.\n",
        "4 - Output a json object that contains the following \\\n",
        "keys: french_summary, num_names.\n",
        "\n",
        "Separate your answers with line breaks.\n",
        "\n",
        "Text:\n",
        "```{text}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt_1)\n",
        "print(\"Completion for prompt 1:\")\n",
        "print(response)"
      ],
      "id": "f759a425"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8903031c"
      },
      "source": [
        "#### Ask for output in a specified format"
      ],
      "id": "8903031c"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6ee3c675"
      },
      "outputs": [],
      "source": [
        "prompt_2 = f\"\"\"\n",
        "Your task is to perform the following actions:\n",
        "1 - Summarize the following text delimited by\n",
        "  <> with 1 sentence.\n",
        "2 - Translate the summary into French.\n",
        "3 - List each name in the French summary.\n",
        "4 - Output a json object that contains the\n",
        "  following keys: french_summary, num_names.\n",
        "\n",
        "Use the following format:\n",
        "Text: <text to summarize>\n",
        "Summary: <summary>\n",
        "Translation: <summary translation>\n",
        "Names: <list of names in Italian summary>\n",
        "Output JSON: <json with summary and num_names>\n",
        "\n",
        "Text: <{text}>\n",
        "\"\"\"\n",
        "response = get_completion(prompt_2)\n",
        "print(\"\\nCompletion for prompt 2:\")\n",
        "print(response)"
      ],
      "id": "6ee3c675"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c2dd7216"
      },
      "source": [
        "#### Tactic 2: Instruct the model to work out its own solution before rushing to a conclusion"
      ],
      "id": "c2dd7216"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "3dbd971b"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Determine if the student's solution is correct or not.\n",
        "\n",
        "Question:\n",
        "I'm building a solar power installation and I need \\\n",
        " help working out the financials.\n",
        "- Land costs $100 / square foot\n",
        "- I can buy solar panels for $250 / square foot\n",
        "- I negotiated a contract for maintenance that will cost \\\n",
        "me a flat $100k per year, and an additional $10 / square \\\n",
        "foot\n",
        "What is the total cost for the first year of operations\n",
        "as a function of the number of square feet.\n",
        "\n",
        "Student's Solution:\n",
        "Let x be the size of the installation in square feet.\n",
        "Costs:\n",
        "1. Land cost: 100x\n",
        "2. Solar panel cost: 250x\n",
        "3. Maintenance cost: 100,000 + 100x\n",
        "Total cost: 100x + 250x + 100,000 + 100x = 450x + 100,000\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "3dbd971b"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "70d8b4d0"
      },
      "source": [
        "#### Note that the student's solution is actually not correct.\n",
        "#### We can fix this by instructing the model to work out its own solution first."
      ],
      "id": "70d8b4d0"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "3f1cb978"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to determine if the student's solution \\\n",
        "is correct or not.\n",
        "To solve the problem do the following:\n",
        "- First, work out your own solution to the problem.\n",
        "- Then compare your solution to the student's solution \\\n",
        "and evaluate if the student's solution is correct or not.\n",
        "Don't decide if the student's solution is correct until\n",
        "you have done the problem yourself.\n",
        "\n",
        "Use the following format:\n",
        "Question:\n",
        "```\n",
        "question here\n",
        "```\n",
        "Student's solution:\n",
        "```\n",
        "student's solution here\n",
        "```\n",
        "Actual solution:\n",
        "```\n",
        "steps to work out the solution and your solution here\n",
        "```\n",
        "Is the student's solution the same as actual solution \\\n",
        "just calculated:\n",
        "```\n",
        "yes or no\n",
        "```\n",
        "Student grade:\n",
        "```\n",
        "correct or incorrect\n",
        "```\n",
        "\n",
        "Question:\n",
        "```\n",
        "I'm building a solar power installation and I need help \\\n",
        "working out the financials.\n",
        "- Land costs $100 / square foot\n",
        "- I can buy solar panels for $250 / square foot\n",
        "- I negotiated a contract for maintenance that will cost \\\n",
        "me a flat $100k per year, and an additional $10 / square \\\n",
        "foot\n",
        "What is the total cost for the first year of operations \\\n",
        "as a function of the number of square feet.\n",
        "```\n",
        "Student's solution:\n",
        "```\n",
        "Let x be the size of the installation in square feet.\n",
        "Costs:\n",
        "1. Land cost: 100x\n",
        "2. Solar panel cost: 250x\n",
        "3. Maintenance cost: 100,000 + 100x\n",
        "Total cost: 100x + 250x + 100,000 + 100x = 450x + 100,000\n",
        "```\n",
        "Actual solution:\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "3f1cb978"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3964c20b"
      },
      "source": [
        "## Model Limitations: Hallucinations\n",
        "- Boie is a real company, the product name is not real."
      ],
      "id": "3964c20b"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "9be041e8"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Tell me about AeroGlide UltraSlim Smart Toothbrush by Boie\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "9be041e8"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "e057c15e"
      },
      "source": [
        "## Try experimenting on your own!"
      ],
      "id": "e057c15e"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "0c8a1fb9"
      },
      "outputs": [],
      "source": [],
      "id": "0c8a1fb9"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "10e36dc9"
      },
      "source": [
        "# 2_Iterative Prompt Develelopment\n",
        "In this lesson, you'll iteratively analyze and refine your prompts to generate marketing copy from a product fact sheet."
      ],
      "id": "10e36dc9"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1e8a147a"
      },
      "source": [
        "## Generate a marketing product description from a product fact sheet"
      ],
      "id": "1e8a147a"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "e8f04d5a"
      },
      "outputs": [],
      "source": [
        "fact_sheet_chair = \"\"\"\n",
        "OVERVIEW\n",
        "- Part of a beautiful family of mid-century inspired office furniture,\n",
        "including filing cabinets, desks, bookcases, meeting tables, and more.\n",
        "- Several options of shell color and base finishes.\n",
        "- Available with plastic back and front upholstery (SWC-100)\n",
        "or full upholstery (SWC-110) in 10 fabric and 6 leather options.\n",
        "- Base finish options are: stainless steel, matte black,\n",
        "gloss white, or chrome.\n",
        "- Chair is available with or without armrests.\n",
        "- Suitable for home or business settings.\n",
        "- Qualified for contract use.\n",
        "\n",
        "CONSTRUCTION\n",
        "- 5-wheel plastic coated aluminum base.\n",
        "- Pneumatic chair adjust for easy raise/lower action.\n",
        "\n",
        "DIMENSIONS\n",
        "- WIDTH 53 CM | 20.87”\n",
        "- DEPTH 51 CM | 20.08”\n",
        "- HEIGHT 80 CM | 31.50”\n",
        "- SEAT HEIGHT 44 CM | 17.32”\n",
        "- SEAT DEPTH 41 CM | 16.14”\n",
        "\n",
        "OPTIONS\n",
        "- Soft or hard-floor caster options.\n",
        "- Two choices of seat foam densities:\n",
        " medium (1.8 lb/ft3) or high (2.8 lb/ft3)\n",
        "- Armless or 8 position PU armrests\n",
        "\n",
        "MATERIALS\n",
        "SHELL BASE GLIDER\n",
        "- Cast Aluminum with modified nylon PA6/PA66 coating.\n",
        "- Shell thickness: 10 mm.\n",
        "SEAT\n",
        "- HD36 foam\n",
        "\n",
        "COUNTRY OF ORIGIN\n",
        "- Italy\n",
        "\"\"\""
      ],
      "id": "e8f04d5a"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "00a9d01a"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to help a marketing team create a\n",
        "description for a retail website of a product based\n",
        "on a technical fact sheet.\n",
        "\n",
        "Write a product description based on the information\n",
        "provided in the technical specifications delimited by\n",
        "triple backticks.\n",
        "\n",
        "Technical specifications: ```{fact_sheet_chair}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)\n"
      ],
      "id": "00a9d01a"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "f77c49c4"
      },
      "source": [
        "## Issue 1: The text is too long\n",
        "- Limit the number of words/sentences/characters."
      ],
      "id": "f77c49c4"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "0d1961c2"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to help a marketing team create a\n",
        "description for a retail website of a product based\n",
        "on a technical fact sheet.\n",
        "\n",
        "Write a product description based on the information\n",
        "provided in the technical specifications delimited by\n",
        "triple backticks.\n",
        "\n",
        "Use at most 50 words.\n",
        "\n",
        "Technical specifications: ```{fact_sheet_chair}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)\n"
      ],
      "id": "0d1961c2"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "e609753c"
      },
      "outputs": [],
      "source": [
        "len(response)"
      ],
      "id": "e609753c"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "75293041"
      },
      "source": [
        "## Issue 2. Text focuses on the wrong details\n",
        "- Ask it to focus on the aspects that are relevant to the intended audience."
      ],
      "id": "75293041"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ec947a48"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to help a marketing team create a\n",
        "description for a retail website of a product based\n",
        "on a technical fact sheet.\n",
        "\n",
        "Write a product description based on the information\n",
        "provided in the technical specifications delimited by\n",
        "triple backticks.\n",
        "\n",
        "The description is intended for furniture retailers,\n",
        "so should be technical in nature and focus on the\n",
        "materials the product is constructed from.\n",
        "\n",
        "Use at most 50 words.\n",
        "\n",
        "Technical specifications: ```{fact_sheet_chair}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "ec947a48"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "17d6d28f"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to help a marketing team create a\n",
        "description for a retail website of a product based\n",
        "on a technical fact sheet.\n",
        "\n",
        "Write a product description based on the information\n",
        "provided in the technical specifications delimited by\n",
        "triple backticks.\n",
        "\n",
        "The description is intended for furniture retailers,\n",
        "so should be technical in nature and focus on the\n",
        "materials the product is constructed from.\n",
        "\n",
        "At the end of the description, include every 7-character\n",
        "Product ID in the technical specification.\n",
        "\n",
        "Use at most 50 words.\n",
        "\n",
        "Technical specifications: ```{fact_sheet_chair}```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "17d6d28f"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "e7cecb66"
      },
      "source": [
        "## Issue 3. Description needs a table of dimensions\n",
        "- Ask it to extract information and organize it in a table."
      ],
      "id": "e7cecb66"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c3022afb"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to help a marketing team create a\n",
        "description for a retail website of a product based\n",
        "on a technical fact sheet.\n",
        "\n",
        "Write a product description based on the information\n",
        "provided in the technical specifications delimited by\n",
        "triple backticks.\n",
        "\n",
        "The description is intended for furniture retailers,\n",
        "so should be technical in nature and focus on the\n",
        "materials the product is constructed from.\n",
        "\n",
        "At the end of the description, include every 7-character\n",
        "Product ID in the technical specification.\n",
        "\n",
        "After the description, include a table that gives the\n",
        "product's dimensions. The table should have two columns.\n",
        "In the first column include the name of the dimension.\n",
        "In the second column include the measurements in inches only.\n",
        "\n",
        "Give the table the title 'Product Dimensions'.\n",
        "\n",
        "Format everything as HTML that can be used in a website.\n",
        "Place the description in a <div> element.\n",
        "\n",
        "Technical specifications: ```{fact_sheet_chair}```\n",
        "\"\"\"\n",
        "\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "c3022afb"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "da3bd855"
      },
      "source": [
        "## Load Python libraries to view HTML"
      ],
      "id": "da3bd855"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "fbe37f19"
      },
      "outputs": [],
      "source": [
        "from IPython.display import display, HTML"
      ],
      "id": "fbe37f19"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "e53b03e4"
      },
      "outputs": [],
      "source": [
        "display(HTML(response))"
      ],
      "id": "e53b03e4"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "061bc669"
      },
      "outputs": [],
      "source": [],
      "id": "061bc669"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c06cae56"
      },
      "source": [
        "# 3_Summarizing\n",
        "In this lesson, you will summarize text with a focus on specific topics."
      ],
      "id": "c06cae56"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "140142f9"
      },
      "source": [
        "## Text to summarize"
      ],
      "id": "140142f9"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "e9baa171"
      },
      "outputs": [],
      "source": [
        "prod_review = \"\"\"\n",
        "Got this panda plush toy for my daughter's birthday, \\\n",
        "who loves it and takes it everywhere. It's soft and \\\n",
        "super cute, and its face has a friendly look. It's \\\n",
        "a bit small for what I paid though. I think there \\\n",
        "might be other options that are bigger for the \\\n",
        "same price. It arrived a day earlier than expected, \\\n",
        "so I got to play with it myself before I gave it \\\n",
        "to her.\n",
        "\"\"\""
      ],
      "id": "e9baa171"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "28aa1835"
      },
      "source": [
        "## Summarize with a word/sentence/character limit"
      ],
      "id": "28aa1835"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6ccf7fa1"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to generate a short summary of a product \\\n",
        "review from an ecommerce site.\n",
        "\n",
        "Summarize the review below, delimited by triple\n",
        "backticks, in at most 30 words.\n",
        "\n",
        "Review: ```{prod_review}```\n",
        "\"\"\"\n",
        "\n",
        "response = get_completion(prompt)\n",
        "print(response)\n"
      ],
      "id": "6ccf7fa1"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "735b438d"
      },
      "source": [
        "## Summarize with a focus on shipping and delivery"
      ],
      "id": "735b438d"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "0edc0660"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to generate a short summary of a product \\\n",
        "review from an ecommerce site to give feedback to the \\\n",
        "Shipping deparmtment.\n",
        "\n",
        "Summarize the review below, delimited by triple\n",
        "backticks, in at most 30 words, and focusing on any aspects \\\n",
        "that mention shipping and delivery of the product.\n",
        "\n",
        "Review: ```{prod_review}```\n",
        "\"\"\"\n",
        "\n",
        "response = get_completion(prompt)\n",
        "print(response)\n"
      ],
      "id": "0edc0660"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "22c53689"
      },
      "source": [
        "## Summarize with a focus on price and value"
      ],
      "id": "22c53689"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ee493bad"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to generate a short summary of a product \\\n",
        "review from an ecommerce site to give feedback to the \\\n",
        "pricing deparmtment, responsible for determining the \\\n",
        "price of the product.\n",
        "\n",
        "Summarize the review below, delimited by triple\n",
        "backticks, in at most 30 words, and focusing on any aspects \\\n",
        "that are relevant to the price and perceived value.\n",
        "\n",
        "Review: ```{prod_review}```\n",
        "\"\"\"\n",
        "\n",
        "response = get_completion(prompt)\n",
        "print(response)\n"
      ],
      "id": "ee493bad"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4b58db12"
      },
      "source": [
        "#### Comment\n",
        "- Summaries include topics that are not related to the topic of focus."
      ],
      "id": "4b58db12"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "20306b8b"
      },
      "source": [
        "## Try \"extract\" instead of \"summarize\""
      ],
      "id": "20306b8b"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6910c206"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Your task is to extract relevant information from \\\n",
        "a product review from an ecommerce site to give \\\n",
        "feedback to the Shipping department.\n",
        "\n",
        "From the review below, delimited by triple quotes \\\n",
        "extract the information relevant to shipping and \\\n",
        "delivery. Limit to 30 words.\n",
        "\n",
        "Review: ```{prod_review}```\n",
        "\"\"\"\n",
        "\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "6910c206"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "688460fa"
      },
      "source": [
        "## Summarize multiple product reviews"
      ],
      "id": "688460fa"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "808ae673"
      },
      "outputs": [],
      "source": [
        "\n",
        "review_1 = prod_review\n",
        "\n",
        "# review for a standing lamp\n",
        "review_2 = \"\"\"\n",
        "Needed a nice lamp for my bedroom, and this one \\\n",
        "had additional storage and not too high of a price \\\n",
        "point. Got it fast - arrived in 2 days. The string \\\n",
        "to the lamp broke during the transit and the company \\\n",
        "happily sent over a new one. Came within a few days \\\n",
        "as well. It was easy to put together. Then I had a \\\n",
        "missing part, so I contacted their support and they \\\n",
        "very quickly got me the missing piece! Seems to me \\\n",
        "to be a great company that cares about their customers \\\n",
        "and products.\n",
        "\"\"\"\n",
        "\n",
        "# review for an electric toothbrush\n",
        "review_3 = \"\"\"\n",
        "My dental hygienist recommended an electric toothbrush, \\\n",
        "which is why I got this. The battery life seems to be \\\n",
        "pretty impressive so far. After initial charging and \\\n",
        "leaving the charger plugged in for the first week to \\\n",
        "condition the battery, I've unplugged the charger and \\\n",
        "been using it for twice daily brushing for the last \\\n",
        "3 weeks all on the same charge. But the toothbrush head \\\n",
        "is too small. I’ve seen baby toothbrushes bigger than \\\n",
        "this one. I wish the head was bigger with different \\\n",
        "length bristles to get between teeth better because \\\n",
        "this one doesn’t.  Overall if you can get this one \\\n",
        "around the $50 mark, it's a good deal. The manufactuer's \\\n",
        "replacements heads are pretty expensive, but you can \\\n",
        "get generic ones that're more reasonably priced. This \\\n",
        "toothbrush makes me feel like I've been to the dentist \\\n",
        "every day. My teeth feel sparkly clean!\n",
        "\"\"\"\n",
        "\n",
        "# review for a blender\n",
        "review_4 = \"\"\"\n",
        "So, they still had the 17 piece system on seasonal \\\n",
        "sale for around $49 in the month of November, about \\\n",
        "half off, but for some reason (call it price gouging) \\\n",
        "around the second week of December the prices all went \\\n",
        "up to about anywhere from between $70-$89 for the same \\\n",
        "system. And the 11 piece system went up around $10 or \\\n",
        "so in price also from the earlier sale price of $29. \\\n",
        "So it looks okay, but if you look at the base, the part \\\n",
        "where the blade locks into place doesn’t look as good \\\n",
        "as in previous editions from a few years ago, but I \\\n",
        "plan to be very gentle with it (example, I crush \\\n",
        "very hard items like beans, ice, rice, etc. in the \\\n",
        "blender first then pulverize them in the serving size \\\n",
        "I want in the blender then switch to the whipping \\\n",
        "blade for a finer flour, and use the cross cutting blade \\\n",
        "first when making smoothies, then use the flat blade \\\n",
        "if I need them finer/less pulpy). Special tip when making \\\n",
        "smoothies, finely cut and freeze the fruits and \\\n",
        "vegetables (if using spinach-lightly stew soften the \\\n",
        "spinach then freeze until ready for use-and if making \\\n",
        "sorbet, use a small to medium sized food processor) \\\n",
        "that you plan to use that way you can avoid adding so \\\n",
        "much ice if at all-when making your smoothie. \\\n",
        "After about a year, the motor was making a funny noise. \\\n",
        "I called customer service but the warranty expired \\\n",
        "already, so I had to buy another one. FYI: The overall \\\n",
        "quality has gone done in these types of products, so \\\n",
        "they are kind of counting on brand recognition and \\\n",
        "consumer loyalty to maintain sales. Got it in about \\\n",
        "two days.\n",
        "\"\"\"\n",
        "\n",
        "reviews = [review_1, review_2, review_3, review_4]\n",
        "\n"
      ],
      "id": "808ae673"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "296414a2"
      },
      "outputs": [],
      "source": [
        "for i in range(len(reviews)):\n",
        "    prompt = f\"\"\"\n",
        "    Your task is to generate a short summary of a product \\\n",
        "    review from an ecommerce site.\n",
        "\n",
        "    Summarize the review below, delimited by triple \\\n",
        "    backticks in at most 20 words.\n",
        "\n",
        "    Review: ```{reviews[i]}```\n",
        "    \"\"\"\n",
        "\n",
        "    response = get_completion(prompt)\n",
        "    print(i, response, \"\\n\")\n"
      ],
      "id": "296414a2"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "cf6fb05b"
      },
      "outputs": [],
      "source": [],
      "id": "cf6fb05b"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3eead7a9"
      },
      "source": [
        "# 4_Inferring\n",
        "In this lesson, you will infer sentiment and topics from product reviews and news articles."
      ],
      "id": "3eead7a9"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "89cbb4af"
      },
      "source": [
        "## Product review text"
      ],
      "id": "89cbb4af"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ad4631e8"
      },
      "outputs": [],
      "source": [
        "lamp_review = \"\"\"\n",
        "Needed a nice lamp for my bedroom, and this one had \\\n",
        "additional storage and not too high of a price point. \\\n",
        "Got it fast.  The string to our lamp broke during the \\\n",
        "transit and the company happily sent over a new one. \\\n",
        "Came within a few days as well. It was easy to put \\\n",
        "together.  I had a missing part, so I contacted their \\\n",
        "support and they very quickly got me the missing piece! \\\n",
        "Lumina seems to me to be a great company that cares \\\n",
        "about their customers and products!!\n",
        "\"\"\""
      ],
      "id": "ad4631e8"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cb17a14c"
      },
      "source": [
        "## Sentiment (positive/negative)"
      ],
      "id": "cb17a14c"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "038f17ae"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "What is the sentiment of the following product review,\n",
        "which is delimited with triple backticks?\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "038f17ae"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "3f713bf8"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "What is the sentiment of the following product review,\n",
        "which is delimited with triple backticks?\n",
        "\n",
        "Give your answer as a single word, either \"positive\" \\\n",
        "or \"negative\".\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "3f713bf8"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fb641bd2"
      },
      "source": [
        "## Identify types of emotions"
      ],
      "id": "fb641bd2"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "7f6ffb65"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Identify a list of emotions that the writer of the \\\n",
        "following review is expressing. Include no more than \\\n",
        "five items in the list. Format your answer as a list of \\\n",
        "lower-case words separated by commas.\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "7f6ffb65"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "55deae26"
      },
      "source": [
        "## Identify anger"
      ],
      "id": "55deae26"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "cbd95256"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Is the writer of the following review expressing anger?\\\n",
        "The review is delimited with triple backticks. \\\n",
        "Give your answer as either yes or no.\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "cbd95256"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8b97fa73"
      },
      "source": [
        "## Extract product and company name from customer reviews"
      ],
      "id": "8b97fa73"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "9f674187"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Identify the following items from the review text:\n",
        "- Item purchased by reviewer\n",
        "- Company that made the item\n",
        "\n",
        "The review is delimited with triple backticks. \\\n",
        "Format your response as a JSON object with \\\n",
        "\"Item\" and \"Brand\" as the keys.\n",
        "If the information isn't present, use \"unknown\" \\\n",
        "as the value.\n",
        "Make your response as short as possible.\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "9f674187"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "583651cf"
      },
      "source": [
        "## Doing multiple tasks at once"
      ],
      "id": "583651cf"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ac4fcd33"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Identify the following items from the review text:\n",
        "- Sentiment (positive or negative)\n",
        "- Is the reviewer expressing anger? (true or false)\n",
        "- Item purchased by reviewer\n",
        "- Company that made the item\n",
        "\n",
        "The review is delimited with triple backticks. \\\n",
        "Format your response as a JSON object with \\\n",
        "\"Sentiment\", \"Anger\", \"Item\" and \"Brand\" as the keys.\n",
        "If the information isn't present, use \"unknown\" \\\n",
        "as the value.\n",
        "Make your response as short as possible.\n",
        "Format the Anger value as a boolean.\n",
        "\n",
        "Review text: '''{lamp_review}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "ac4fcd33"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c95d23f0"
      },
      "source": [
        "## Inferring topics"
      ],
      "id": "c95d23f0"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6871f676"
      },
      "outputs": [],
      "source": [
        "story = \"\"\"\n",
        "In a recent survey conducted by the government,\n",
        "public sector employees were asked to rate their level\n",
        "of satisfaction with the department they work at.\n",
        "The results revealed that NASA was the most popular\n",
        "department with a satisfaction rating of 95%.\n",
        "\n",
        "One NASA employee, John Smith, commented on the findings,\n",
        "stating, \"I'm not surprised that NASA came out on top.\n",
        "It's a great place to work with amazing people and\n",
        "incredible opportunities. I'm proud to be a part of\n",
        "such an innovative organization.\"\n",
        "\n",
        "The results were also welcomed by NASA's management team,\n",
        "with Director Tom Johnson stating, \"We are thrilled to\n",
        "hear that our employees are satisfied with their work at NASA.\n",
        "We have a talented and dedicated team who work tirelessly\n",
        "to achieve our goals, and it's fantastic to see that their\n",
        "hard work is paying off.\"\n",
        "\n",
        "The survey also revealed that the\n",
        "Social Security Administration had the lowest satisfaction\n",
        "rating, with only 45% of employees indicating they were\n",
        "satisfied with their job. The government has pledged to\n",
        "address the concerns raised by employees in the survey and\n",
        "work towards improving job satisfaction across all departments.\n",
        "\"\"\""
      ],
      "id": "6871f676"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6e080b59"
      },
      "source": [
        "## Infer 5 topics"
      ],
      "id": "6e080b59"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "4b504a53"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Determine five topics that are being discussed in the \\\n",
        "following text, which is delimited by triple backticks.\n",
        "\n",
        "Make each item one or two words long.\n",
        "\n",
        "Format your response as a list of items separated by commas.\n",
        "\n",
        "Text sample: '''{story}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "4b504a53"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c11d6a82"
      },
      "outputs": [],
      "source": [
        "response.split(sep=',')"
      ],
      "id": "c11d6a82"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "618e308e"
      },
      "outputs": [],
      "source": [
        "topic_list = [\n",
        "    \"nasa\", \"local government\", \"engineering\",\n",
        "    \"employee satisfaction\", \"federal government\"\n",
        "]"
      ],
      "id": "618e308e"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cc9a3bd0"
      },
      "source": [
        "## Make a news alert for certain topics"
      ],
      "id": "cc9a3bd0"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c27213ba"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Determine whether each item in the following list of \\\n",
        "topics is a topic in the text below, which\n",
        "is delimited with triple backticks.\n",
        "\n",
        "Give your answer as list with 0 or 1 for each topic.\\\n",
        "\n",
        "List of topics: {\", \".join(topic_list)}\n",
        "\n",
        "Text sample: '''{story}'''\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "c27213ba"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c9d9b783"
      },
      "outputs": [],
      "source": [
        "topic_dict = {i.split(': ')[0]: int(i.split(': ')[1]) for i in response.split(sep='\\n')}\n",
        "if topic_dict['nasa'] == 1:\n",
        "    print(\"ALERT: New NASA story!\")"
      ],
      "id": "c9d9b783"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "efcb642d"
      },
      "outputs": [],
      "source": [],
      "id": "efcb642d"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9fe6bdd4"
      },
      "source": [
        "# 5_Transforming\n",
        "\n",
        "In this notebook, we will explore how to use Large Language Models for text transformation tasks such as language translation, spelling and grammar checking, tone adjustment, and format conversion."
      ],
      "id": "9fe6bdd4"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "e50b818c"
      },
      "source": [
        "## Translation\n",
        "\n",
        "ChatGPT is trained with sources in many languages. This gives the model the ability to do translation. Here are some examples of how to use this capability."
      ],
      "id": "e50b818c"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "3d73e67a"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Translate the following English text to Spanish: \\\n",
        "```Hi, I would like to order a blender```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "3d73e67a"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "22671016"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Tell me which language this is:\n",
        "```Combien coûte le lampadaire?```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "22671016"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "29fa83c0"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Translate the following  text to French and Spanish\n",
        "and English pirate: \\\n",
        "```I want to order a basketball```\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "29fa83c0"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "11880148"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "Translate the following text to Spanish in both the \\\n",
        "formal and informal forms:\n",
        "'Would you like to order a pillow?'\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "11880148"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "a955340c"
      },
      "source": [
        "### Universal Translator\n",
        "Imagine you are in charge of IT at a large multinational e-commerce company. Users are messaging you with IT issues in all their native languages. Your staff is from all over the world and speaks only their native languages. You need a universal translator!"
      ],
      "id": "a955340c"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "083b70c6"
      },
      "outputs": [],
      "source": [
        "user_messages = [\n",
        "  \"La performance du système est plus lente que d'habitude.\",  # System performance is slower than normal\n",
        "  \"Mi monitor tiene píxeles que no se iluminan.\",              # My monitor has pixels that are not lighting\n",
        "  \"Il mio mouse non funziona\",                                 # My mouse is not working\n",
        "  \"Mój klawisz Ctrl jest zepsuty\",                             # My keyboard has a broken control key\n",
        "  \"我的屏幕在闪烁\"                                               # My screen is flashing\n",
        "]"
      ],
      "id": "083b70c6"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6c5b0245"
      },
      "outputs": [],
      "source": [
        "for issue in user_messages:\n",
        "    prompt = f\"Tell me what language this is: ```{issue}```\"\n",
        "    lang = get_completion(prompt)\n",
        "    print(f\"Original message ({lang}): {issue}\")\n",
        "\n",
        "    prompt = f\"\"\"\n",
        "    Translate the following  text to English \\\n",
        "    and Korean: ```{issue}```\n",
        "    \"\"\"\n",
        "    response = get_completion(prompt)\n",
        "    print(response, \"\\n\")"
      ],
      "id": "6c5b0245"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "945c1776"
      },
      "outputs": [],
      "source": [],
      "id": "945c1776"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7f59334a"
      },
      "source": [
        "# 6_Expanding\n",
        "In this lesson, you will generate customer service emails that are tailored to each customer's review.\n"
      ],
      "id": "7f59334a"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fb8f92a8"
      },
      "source": [
        "## Customize the automated reply to a customer email"
      ],
      "id": "fb8f92a8"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c20145d2"
      },
      "outputs": [],
      "source": [
        "# given the sentiment from the lesson on \"inferring\",\n",
        "# and the original customer message, customize the email\n",
        "sentiment = \"negative\"\n",
        "\n",
        "# review for a blender\n",
        "review = f\"\"\"\n",
        "So, they still had the 17 piece system on seasonal \\\n",
        "sale for around $49 in the month of November, about \\\n",
        "half off, but for some reason (call it price gouging) \\\n",
        "around the second week of December the prices all went \\\n",
        "up to about anywhere from between $70-$89 for the same \\\n",
        "system. And the 11 piece system went up around $10 or \\\n",
        "so in price also from the earlier sale price of $29. \\\n",
        "So it looks okay, but if you look at the base, the part \\\n",
        "where the blade locks into place doesn’t look as good \\\n",
        "as in previous editions from a few years ago, but I \\\n",
        "plan to be very gentle with it (example, I crush \\\n",
        "very hard items like beans, ice, rice, etc. in the \\\n",
        "blender first then pulverize them in the serving size \\\n",
        "I want in the blender then switch to the whipping \\\n",
        "blade for a finer flour, and use the cross cutting blade \\\n",
        "first when making smoothies, then use the flat blade \\\n",
        "if I need them finer/less pulpy). Special tip when making \\\n",
        "smoothies, finely cut and freeze the fruits and \\\n",
        "vegetables (if using spinach-lightly stew soften the \\\n",
        "spinach then freeze until ready for use-and if making \\\n",
        "sorbet, use a small to medium sized food processor) \\\n",
        "that you plan to use that way you can avoid adding so \\\n",
        "much ice if at all-when making your smoothie. \\\n",
        "After about a year, the motor was making a funny noise. \\\n",
        "I called customer service but the warranty expired \\\n",
        "already, so I had to buy another one. FYI: The overall \\\n",
        "quality has gone done in these types of products, so \\\n",
        "they are kind of counting on brand recognition and \\\n",
        "consumer loyalty to maintain sales. Got it in about \\\n",
        "two days.\n",
        "\"\"\""
      ],
      "id": "c20145d2"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "50494037"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "You are a customer service AI assistant.\n",
        "Your task is to send an email reply to a valued customer.\n",
        "Given the customer email delimited by ```, \\\n",
        "Generate a reply to thank the customer for their review.\n",
        "If the sentiment is positive or neutral, thank them for \\\n",
        "their review.\n",
        "If the sentiment is negative, apologize and suggest that \\\n",
        "they can reach out to customer service.\n",
        "Make sure to use specific details from the review.\n",
        "Write in a concise and professional tone.\n",
        "Sign the email as `AI customer agent`.\n",
        "Customer review: ```{review}```\n",
        "Review sentiment: {sentiment}\n",
        "\"\"\"\n",
        "response = get_completion(prompt)\n",
        "print(response)"
      ],
      "id": "50494037"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "d688d632"
      },
      "source": [
        "## Remind the model to use details from the customer's email"
      ],
      "id": "d688d632"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "dfc390a5"
      },
      "outputs": [],
      "source": [
        "prompt = f\"\"\"\n",
        "You are a customer service AI assistant.\n",
        "Your task is to send an email reply to a valued customer.\n",
        "Given the customer email delimited by ```, \\\n",
        "Generate a reply to thank the customer for their review.\n",
        "If the sentiment is positive or neutral, thank them for \\\n",
        "their review.\n",
        "If the sentiment is negative, apologize and suggest that \\\n",
        "they can reach out to customer service.\n",
        "Make sure to use specific details from the review.\n",
        "Write in a concise and professional tone.\n",
        "Sign the email as `AI customer agent`.\n",
        "Customer review: ```{review}```\n",
        "Review sentiment: {sentiment}\n",
        "\"\"\"\n",
        "response = get_completion(prompt, temperature=0.7)\n",
        "print(response)"
      ],
      "id": "dfc390a5"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2ce4e65e"
      },
      "outputs": [],
      "source": [],
      "id": "2ce4e65e"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "f559e74f"
      },
      "source": [
        "# 7_Chat Format\n",
        "\n",
        "In this notebook, you will explore how you can utilize the chat format to have extended conversations with chatbots personalized or specialized for specific tasks or behaviors.\n",
        "\n",
        "-[ref](https://learn.deeplearning.ai/chatgpt-prompt-eng/lesson/8/chatbot)"
      ],
      "id": "f559e74f"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "2d193201"
      },
      "outputs": [],
      "source": [
        "def get_completion(prompt, model=\"gpt-3.5-turbo\"):\n",
        "    messages = [{\"role\": \"user\", \"content\": prompt}]\n",
        "    response = openai.ChatCompletion.create(\n",
        "        model=model,\n",
        "        messages=messages,\n",
        "        temperature=0, # this is the degree of randomness of the model's output\n",
        "    )\n",
        "    return response.choices[0].message[\"content\"]\n",
        "\n",
        "def get_completion_from_messages(messages, model=\"gpt-3.5-turbo\", temperature=0):\n",
        "    response = openai.ChatCompletion.create(\n",
        "        model=model,\n",
        "        messages=messages,\n",
        "        temperature=temperature, # this is the degree of randomness of the model's output\n",
        "    )\n",
        "#     print(str(response.choices[0].message))\n",
        "    return response.choices[0].message[\"content\"]"
      ],
      "id": "2d193201"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "bf2c247b"
      },
      "outputs": [],
      "source": [
        "messages =  [\n",
        "{'role':'system', 'content':'You are an assistant that speaks like Shakespeare.'},\n",
        "{'role':'user', 'content':'tell me a joke'},\n",
        "{'role':'assistant', 'content':'Why did the chicken cross the road'},\n",
        "{'role':'user', 'content':'I don\\'t know'}  ]"
      ],
      "id": "bf2c247b"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "9e00c971"
      },
      "outputs": [],
      "source": [
        "response = get_completion_from_messages(messages, temperature=1)\n",
        "print(response)"
      ],
      "id": "9e00c971"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "de2a76d1"
      },
      "outputs": [],
      "source": [
        "messages =  [\n",
        "{'role':'system', 'content':'You are friendly chatbot.'},\n",
        "{'role':'user', 'content':'Hi, my name is Isa'}  ]\n",
        "response = get_completion_from_messages(messages, temperature=1)\n",
        "print(response)"
      ],
      "id": "de2a76d1"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "48ba5c70"
      },
      "outputs": [],
      "source": [
        "messages =  [\n",
        "{'role':'system', 'content':'You are friendly chatbot.'},\n",
        "{'role':'user', 'content':'Yes,  can you remind me, What is my name?'}  ]\n",
        "response = get_completion_from_messages(messages, temperature=1)\n",
        "print(response)"
      ],
      "id": "48ba5c70"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "3f136cc4"
      },
      "outputs": [],
      "source": [
        "messages =  [\n",
        "{'role':'system', 'content':'You are friendly chatbot.'},\n",
        "{'role':'user', 'content':'Hi, my name is Isa'},\n",
        "{'role':'assistant', 'content': \"Hi Isa! It's nice to meet you. \\\n",
        "Is there anything I can help you with today?\"},\n",
        "{'role':'user', 'content':'Yes, you can remind me, What is my name?'}  ]\n",
        "response = get_completion_from_messages(messages, temperature=1)\n",
        "print(response)"
      ],
      "id": "3f136cc4"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "075ae01f"
      },
      "source": [
        "## OrderBot\n",
        "We can automate the collection of user prompts and assistant responses to build a  OrderBot. The OrderBot will take orders at a pizza restaurant."
      ],
      "id": "075ae01f"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "f873e175"
      },
      "outputs": [],
      "source": [
        "def collect_messages(_):\n",
        "    prompt = inp.value_input\n",
        "    inp.value = ''\n",
        "    context.append({'role':'user', 'content':f\"{prompt}\"})\n",
        "    response = get_completion_from_messages(context)\n",
        "    context.append({'role':'assistant', 'content':f\"{response}\"})\n",
        "    panels.append(\n",
        "        pn.Row('User:', pn.pane.Markdown(prompt, width=600)))\n",
        "    panels.append(\n",
        "        pn.Row('Assistant:', pn.pane.Markdown(response, width=600, style={'background-color': '#F6F6F6'})))\n",
        "\n",
        "    return pn.Column(*panels)\n"
      ],
      "id": "f873e175"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "ea3ed0f6",
        "scrolled": true
      },
      "outputs": [],
      "source": [
        "!pip install panel"
      ],
      "id": "ea3ed0f6"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "60b0b551"
      },
      "outputs": [],
      "source": [
        "import panel as pn  # GUI\n",
        "pn.extension()\n",
        "\n",
        "panels = [] # collect display\n",
        "\n",
        "context = [ {'role':'system', 'content':\"\"\"\n",
        "You are OrderBot, an automated service to collect orders for a pizza restaurant. \\\n",
        "You first greet the customer, then collects the order, \\\n",
        "and then asks if it's a pickup or delivery. \\\n",
        "You wait to collect the entire order, then summarize it and check for a final \\\n",
        "time if the customer wants to add anything else. \\\n",
        "If it's a delivery, you ask for an address. \\\n",
        "Finally you collect the payment.\\\n",
        "Make sure to clarify all options, extras and sizes to uniquely \\\n",
        "identify the item from the menu.\\\n",
        "You respond in a short, very conversational friendly style. \\\n",
        "The menu includes \\\n",
        "pepperoni pizza  12.95, 10.00, 7.00 \\\n",
        "cheese pizza   10.95, 9.25, 6.50 \\\n",
        "eggplant pizza   11.95, 9.75, 6.75 \\\n",
        "fries 4.50, 3.50 \\\n",
        "greek salad 7.25 \\\n",
        "Toppings: \\\n",
        "extra cheese 2.00, \\\n",
        "mushrooms 1.50 \\\n",
        "sausage 3.00 \\\n",
        "canadian bacon 3.50 \\\n",
        "AI sauce 1.50 \\\n",
        "peppers 1.00 \\\n",
        "Drinks: \\\n",
        "coke 3.00, 2.00, 1.00 \\\n",
        "sprite 3.00, 2.00, 1.00 \\\n",
        "bottled water 5.00 \\\n",
        "\"\"\"} ]  # accumulate messages\n",
        "\n",
        "\n",
        "inp = pn.widgets.TextInput(value=\"Hi\", placeholder='Enter text here…')\n",
        "button_conversation = pn.widgets.Button(name=\"Chat!\")\n",
        "\n",
        "interactive_conversation = pn.bind(collect_messages, button_conversation)\n",
        "\n",
        "dashboard = pn.Column(\n",
        "    inp,\n",
        "    pn.Row(button_conversation),\n",
        "    pn.panel(interactive_conversation, loading_indicator=True, height=300),\n",
        ")\n",
        "\n",
        "dashboard"
      ],
      "id": "60b0b551"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "69895c65"
      },
      "outputs": [],
      "source": [
        "messages =  context.copy()\n",
        "messages.append(\n",
        "{'role':'system', 'content':'create a json summary of the previous food order. Itemize the price for each item\\\n",
        " The fields should be 1) pizza, include size 2) list of toppings 3) list of drinks, include size   4) list of sides include size  5)total price '},\n",
        ")\n",
        " #The fields should be 1) pizza, price 2) list of toppings 3) list of drinks, include size include price  4) list of sides include size include price, 5)total price '},\n",
        "\n",
        "response = get_completion_from_messages(messages, temperature=0)\n",
        "print(response)"
      ],
      "id": "69895c65"
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9715999a"
      },
      "source": [
        "# Done!!!"
      ],
      "id": "9715999a"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "0b365705"
      },
      "outputs": [],
      "source": [],
      "id": "0b365705"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "747eee95"
      },
      "outputs": [],
      "source": [],
      "id": "747eee95"
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "02e2a8e0"
      },
      "outputs": [],
      "source": [],
      "id": "02e2a8e0"
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "collapsed_sections": [
        "d232b2e5",
        "10e36dc9",
        "c06cae56",
        "3eead7a9",
        "9fe6bdd4",
        "7f59334a",
        "f559e74f"
      ],
      "machine_shape": "hm",
      "provenance": []
    },
    "gpuClass": "standard",
    "kernelspec": {
      "display_name": "rl",
      "language": "python",
      "name": "rl"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.9.16"
    },
    "varInspector": {
      "cols": {
        "lenName": 16,
        "lenType": 16,
        "lenVar": 40
      },
      "kernels_config": {
        "python": {
          "delete_cmd_postfix": "",
          "delete_cmd_prefix": "del ",
          "library": "var_list.py",
          "varRefreshCmd": "print(var_dic_list())"
        },
        "r": {
          "delete_cmd_postfix": ") ",
          "delete_cmd_prefix": "rm(",
          "library": "var_list.r",
          "varRefreshCmd": "cat(var_dic_list()) "
        }
      },
      "types_to_exclude": [
        "module",
        "function",
        "builtin_function_or_method",
        "instance",
        "_Feature"
      ],
      "window_display": false
    }
  },
  "nbformat": 4,
  "nbformat_minor": 5
}