Hosik Chae HosikChae

Launching iTerm2 from macOS Finder

(Based on info from Peter Downs' gitub but with modified behavior to open a new terminal window for each invocation instead of reusing an already open window.)

The following three ways to launch an iTerm2 window from Finder have been tested on iTerm2 version 3+ running on macOS Mojave+.

pdanford - April 2020

Cross Entropy Method

How do we solve for the policy optimization problem which is to maximize the total reward given some parametrized policy?

Discounted future reward

To begin with, for an episode the total reward is the sum of all the rewards. If our environment is stochastic, we can never be sure if we will get the same rewards the next time we perform the same actions. Thus the more we go into the future the more the total future reward may diverge. So for that reason it is common to use the discounted future reward where the parameter discount is called the discount factor and is between 0 and 1.

A good strategy for an agent would be to always choose an action that maximizes the (discounted) future reward. In other words we want to maximize the expected reward per episode.

Guide to pkg-config 한글 번역

Dan Nicholson

원문

https://people.freedesktop.org/~dbn/pkg-config-guide.html

개요

CMake를 왜 쓰는거죠?
좋은 툴은 Visual Studio 뿐입니다. 그 이외에는 전부 사도(邪道)입니다 사도! - 작성자

주의

이 문서는 CMake를 주관적으로 서술합니다
이 문서를 통해 CMake를 시작하기엔 적합하지 않습니다
https://cgold.readthedocs.io/en/latest/ 3.1 챕터까지 따라해본 이후 기본사항들을 속성으로 익히는 것을 돕기위한 보조자료로써 작성되었습니다

refer to: https://stackoverflow.com/questions/39371772/how-to-install-anaconda-on-raspberry-pi-3-model-b

{USER}: pi

Install Miniconda 3:

wget http://repo.continuum.io/miniconda/Miniconda3-latest-Linux-armv7l.sh
sudo md5sum Miniconda3-latest-Linux-armv7l.sh # (optional) check md5
sudo /bin/bash Miniconda3-latest-Linux-armv7l.sh # -&gt; change default directory to /home/pi/miniconda3

	// A simple quickref for Eigen. Add anything that's missing.
	// Main author: Keir Mierle

	#include <Eigen/Dense>

	Matrix<double, 3, 3> A; // Fixed rows and cols. Same as Matrix3d.
	Matrix<double, 3, Dynamic> B; // Fixed rows, dynamic cols.
	Matrix<double, Dynamic, Dynamic> C; // Full dynamic. Same as MatrixXd.
	Matrix<double, 3, 3, RowMajor> E; // Row major; default is column-major.
	Matrix3f P, Q, R; // 3x3 float matrix.

	#! /usr/bin/env python
	# -- coding: utf-8 --
	#
	# This file presents an interface for interacting with the Playstation 4 Controller
	# in Python. Simply plug your PS4 controller into your computer using USB and run this
	# script!
	#
	# NOTE: I assume in this script that the only joystick plugged in is the PS4 controller.
	# if this is not the case, you will need to change the class accordingly.
	#

	""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
	import numpy as np
	import cPickle as pickle
	import gym

	# hyperparameters
	H = 200 # number of hidden layer neurons
	batch_size = 10 # every how many episodes to do a param update?
	learning_rate = 1e-4
	gamma = 0.99 # discount factor for reward

	CAP_PROP_POS_MSEC =0, //!< Current position of the video file in milliseconds.
	CAP_PROP_POS_FRAMES =1, //!< 0-based index of the frame to be decoded/captured next.
	CAP_PROP_POS_AVI_RATIO =2, //!< Relative position of the video file: 0=start of the film, 1=end of the film.
	CAP_PROP_FRAME_WIDTH =3, //!< Width of the frames in the video stream.
	CAP_PROP_FRAME_HEIGHT =4, //!< Height of the frames in the video stream.
	CAP_PROP_FPS =5, //!< Frame rate.
	CAP_PROP_FOURCC =6, //!< 4-character code of codec. see VideoWriter::fourcc .
	CAP_PROP_FRAME_COUNT =7, //!< Number of frames in the video file.
	CAP_PROP_FORMAT =8, //!< Format of the %Mat objects returned by VideoCapture::retrieve().
	CAP_PROP_MODE =9, //!< Backend-specific value indicating the current capture mode.


	from typing import List, Tuple, Optional, Union, Any, ContextManager, Callable, overload

	import builtins
	import math
	import pickle


	class dtype: ...
	_dtype = dtype