Shantanu Nair ShantanuNair

Some remarks on Large Language Models

Yoav Goldberg, January 2023

Audience: I assume you heard of chatGPT, maybe played with it a little, and was imressed by it (or tried very hard not to be). And that you also heard that it is "a large language model". And maybe that it "solved natural language understanding". Here is a short personal perspective of my thoughts of this (and similar) models, and where we stand with respect to language understanding.

Intro

Around 2014-2017, right within the rise of neural-network based methods for NLP, I was giving a semi-academic-semi-popsci lecture, revolving around the story that achieving perfect language modeling is equivalent to being as intelligent as a human. Somewhere around the same time I was also asked in an academic panel "what would you do if you were given infinite compute and no need to worry about labour costs" to which I cockily responded "I would train a really huge language model, just to show that it doesn't solve everything!". We

ffmpeg Guide

1. Resize a video to make it smaller

ffmpeg -i input.avi -s 720x480 -c:a copy output.mkv

scale and filter provides more flexibility:

Introduction

This document outlines how to model a common organization-based permission system in Hasura. Let's assume that you have some table structure like the following:

Table Name	Columns	Foreign Keys
User	id, name, email
Organization User	id, user_id, organization_id	user_id -> user.id, organization_id -> organization.id
Organization	id, name

FFmpeg cheat sheet

A list of useful commands for the FFmpeg command line tool.

Download FFmpeg: https://www.ffmpeg.org/download.html

Full documentation: https://www.ffmpeg.org/ffmpeg.html

Basic conversion

###Redux Egghead Video Notes###

####Introduction:#### Managing state in an application is critical, and is often done haphazardly. Redux provides a state container for JavaScript applications that will help your applications behave consistently.

Redux is an evolution of the ideas presented by Facebook's Flux, avoiding the complexity found in Flux by looking to how applications are built with the Elm language.

####1st principle of Redux:#### Everything that changes in your application including the data and ui options is contained in a single object called the state tree

Don't use VPN services.

No, seriously, don't. You're probably reading this because you've asked what VPN service to use, and this is the answer.

Note: The content in this post does not apply to using VPN for their intended purpose; that is, as a virtual private (internal) network. It only applies to using it as a glorified proxy, which is what every third-party "VPN provider" does.

A Russian translation of this article can be found here, contributed by Timur Demin.
A Turkish translation can be found here, contributed by agyild.
There's also this article about VPN services, which is honestly better written (and has more cat pictures!) than my article.

How to setup mount / auto-mount USB Hard Drive on Raspberry Pi

Follow the simple steps in the order mentioned below to have your USB drive mounted on your Raspberry Pi every time you boot it.

These steps are required especially if your are setting up a Samba share, or a 24x7 torrent downloader, or alike where your Raspberry Pi must have your external storage already mounted and ready for access by the services / daemons.

Step 0. Plug in your USB HDD / Drive to Raspberry Pi If you are using a NTFS formatted drive, install the following

	"""You help triaging user requests. Given a raw text input, output either DOCS or DEFAULT, according to those definitions:

	DOCS: if user is asking a seemingly technical question, programming questions or company-specific questions
	DEFAULT: if user is just chit-chatting or basic knowledge questions

	====================

	Input: hello there
	Output: DEFAULT

	FROM consol/ubuntu-xfce-vnc
	USER root
	RUN apt-get update
	RUN apt-get install -qy curl iceweasel sudo desktop-file-utils lib32z1 \
	libx11-6 libegl1-mesa libxcb-shm0 \
	libglib2.0-0 libgl1-mesa-glx libxrender1 libxcomposite1 libxslt1.1 \
	libgstreamer1.0-0 libgstreamer-plugins-base1.0-0 libxi6 libsm6 \
	libfontconfig1 libpulse0 libsqlite3-0 \
	libxcb-shape0 libxcb-xfixes0 libxcb-randr0 libxcb-image0 \
	libxcb-keysyms1 libxcb-xtest0 ibus ibus-gtk \

	<!DOCTYPE html>
	<html>
	<head>
	<meta charset="utf-8" />
	<title>RecordRTC over Socket.io</title>

	<meta http-equiv="content-type" content="text/html; charset=utf-8" />

	<script src="https://www.WebRTC-Experiment.com/RecordRTC.js"></script>
	<script src="https://cdnjs.cloudflare.com/ajax/libs/socket.io/2.3.0/socket.io.js"></script>