RAG_on_hsbc_uk_bank_answer.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "provenance": [],
      "gpuType": "T4"
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "source": [
        "## Quering the model\n",
        "Note parameters top_k, top_p, and temperature - can be tuned to improve results.\n",
        "\n",
        "Parameters explained:\n",
        "- https://huggingface.co/blog/how-to-generate\n",
        "- https://www.linkedin.com/pulse/large-language-model-settings-temperature-top-p-max-tokens-albert-mao-0c6ie/"
      ],
      "metadata": {
        "id": "33LG5mCOKwjL"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "print('The question:', query)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "fRUqOw5KYVmk",
        "outputId": "fb62038b-3f39-4734-cfdd-28dc0cba0b83"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "The question: how do I get student loan\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "%%time\n",
        "answer = llm_ctrans(llm_full_query, top_k=40, top_p=0.4, temperature=0.7)\n",
        "print(answer)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "X2DCY251Zk0w",
        "outputId": "ed0eb5ca-3b37-4e95-ff45-1aded5c5868e"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " To apply for a student loan, you'll need to complete an application form and provide details about your income, expenses, and course fees. You can usually apply through the government website or by contacting your university. Once approved, you'll receive a loan agreement outlining the terms of repayment.\n",
            "CPU times: user 4min 34s, sys: 1min 3s, total: 5min 38s\n",
            "Wall time: 3min 16s\n"
          ]
        }
      ]
    }
  ]
}