After following these instructions to run on CPU:
https://dev.to/nithinibhandari1999/how-to-run-llama-2-on-your-local-computer-42g1
The modified Python code to run the inference on a GPU is here.
After following these instructions to run on CPU:
https://dev.to/nithinibhandari1999/how-to-run-llama-2-on-your-local-computer-42g1
The modified Python code to run the inference on a GPU is here.
| FROM debian:stable-slim | |
| RUN apt-get update && \ | |
| apt-get install -y ca-certificates curl && \ | |
| rm -rf /var/lib/apt/lists/* | |
| RUN CURRENT_VERSION=$(curl -Ls https://api.github.com/repos/Versent/saml2aws/releases/latest | grep 'tag_name' | cut -d> curl -L "https://github.com/Versent/saml2aws/releases/download/v${CURRENT_VERSION}/saml2aws_${CURRENT_VERSION}_linu> tar xvfz saml2aws.tar.gz && \ | |
| mv saml2aws /usr/local/bin/saml2aws && \ | |
| chmod +x /usr/local/bin/saml2aws && \ |
| /** | |
| * @openapi | |
| * "/abc": { | |
| * "get": { | |
| * "description": "Welcome to swagger-jsdoc!", | |
| * "responses": { | |
| * "200": { | |
| * "description": "Returns a mysterious string.", | |
| * "content": { | |
| * "text/xml": { |
| @rate_limited_retry() | |
| def get_search_issues(gh, author, type): | |
| return gh.search_issues('', author=author, type=type) |
| import sys | |
| import operator | |
| # Given the data part of an NMEA sentence (Remove the $, remove the * onwards, keep the last comma) | |
| # calculates the checksum | |
| def checksum_calculate(nmeadata): | |
| csum = 0 | |
| for c in nmeadata: | |
| csum ^= ord(c) |
| terraform { | |
| required_providers { | |
| aws = { | |
| source = "hashicorp/aws" | |
| version = "~> 4.0" | |
| } | |
| } | |
| } | |
| provider "aws" { |
| $rawdisks = gwmi win32_diskdrive | where {$_.partitions -eq 0} | |
| foreach ($r in $rawdisks) | |
| { | |
| $available=ls function:[d-z]: -n | ?{ !(test-path $_) } | SELECT -First 1 | |
| $diskIndex = $r.Index | |
| Write-Host "Initializing Disk $diskIndex as $available. This will take a while." | |
| (echo "list disk | |
| select disk $diskIndex | |
| online disk | |
| attributes disk clear readonly |
| #!/usr/bin/env python | |
| """ | |
| Very simple HTTP server in python. | |
| Usage:: | |
| ./dummy-web-server.py [<port>] | |
| Send a GET request:: | |
| curl http://localhost |
| #!/usr/bin/python3 | |
| """ | |
| msysGit to Unix socket proxy | |
| ============================ | |
| This small script is intended to help use msysGit sockets with the new Windows Linux Subsystem (aka Bash for Windows). | |
| It was specifically designed to pass SSH keys from the KeeAgent module of KeePass secret management application to the | |
| ssh utility running in the WSL (it only works with Linux sockets). However, my guess is that it will have uses for other |