Kaito Sugimoto kaisugi

Code readability presentation links

physics パッケージは物理で用いられる数学記号等を簡便に利用できるようにxparse パッケージを利用してコマンドを作成している．また，amsmath パッケージにも依存している．

physics.sty | CTAN

	import tiktoken
	import langdetect
	T = tiktoken.get_encoding("o200k_base")

	length_dict = {}

	for i in range(T.n_vocab):
	try:
	length_dict[i] = len(T.decode([i]))
	except:

	# coding=utf-8
	# Copyright 2023 The HuggingFace Inc. team. All rights reserved.
	#
	# Licensed under the Apache License, Version 2.0 (the "License");
	# you may not use this file except in compliance with the License.
	# You may obtain a copy of the License at
	#
	# http://www.apache.org/licenses/LICENSE-2.0
	#
	# Unless required by applicable law or agreed to in writing, software

	ORIGIN_DIR=$(pwd)

	JUMANPP_DIR="$HOME/.local/share/jumanpp"

	mkdir -p $JUMANPP_DIR
	cd $JUMANPP_DIR

	curl -LO https://github.com/ku-nlp/jumanpp/releases/download/v2.0.0-rc3/jumanpp-2.0.0-rc3.tar.xz
	tar -xf jumanpp-2.0.0-rc3.tar.xz
	cd jumanpp-2.0.0-rc3

	#installing vscode on Debian

	You can install vscode using following commands:
	1- Start by updating the packages index and installing the dependencies by typing:
	sudo apt update
	2- sudo apt install software-properties-common apt-transport-https curl
	3- Import the Microsoft GPG key using the following curl command:
	curl -sSL https://packages.microsoft.com/keys/microsoft.asc \| sudo apt-key add -
	4- Add the Visual Studio Code repository to your system:
	sudo add-apt-repository "deb [arch=amd64] https://packages.microsoft.com/repos/vscode stable main"