fzyzcjy fzyzcjy

(Internal Tranining Material)

Usually the first step in performance optimization is to do profiling, e.g. to identify performance hotspots of a workload. This gist tells basic knowledge of performance profiling on PyTorch, you will get:

How to find the bottleneck operator?
How to trace source file of a particular operator?
How do I indentify threading issues? (oversubscription)
How do I tell a specific operator is running efficiently or not?

This tutorial takes one of my recent projects - pssp-transformer as an example to guide you through path of PyTorch CPU peformance optimization. Focus will be on Part 1 & Part 2.

Method for Emulating Higher-Kinded Types in Rust

Intro

I've been fiddling about with an idea lately, looking at how higher-kinded types can be represented in such a way that we can reason with them in Rust here and now, without having to wait a couple years for what would be a significant change to the language and compiler.

There have been multiple discussions on introducing higher-ranked polymorphism into Rust, using Haskell-style Higher-Kinded Types (HKTs) or Scala-looking Generalised Associated Types (GATs). The benefit of higher-ranked polymorphism is to allow higher-level, richer abstractions and pattern expression than just the rank-1 polymorphism we have today.

As an example, currently we can express this type:

Hyperlinks (a.k.a. HTML-like anchors) in terminal emulators

[ Update 2025-03-24: Commenting is disabled permanently. Previous comments are archived at web.archive.org. ]

Most of the terminal emulators auto-detect when a URL appears onscreen and allow to conveniently open them (e.g. via Ctrl+click or Cmd+click, or the right click menu).

It was, however, not possible until now for arbitrary text to point to URLs, just as on webpages.

How to install Matlab Engine on Python 3.6

Preparation

If you’ve tried recently to install matlab engine on a Python 3.6, you’ve seen a message saying that the platform is not supported. That doesn’t make any sense, since Python 3.5 is supported, right?

The problem is that Mathworks hardcodes a list with valid versions, I guess to reduce pressure on their customer service in case something goes wrong with untested versions. Well, that doesn’t mean that we shouldn’t be allowed to try it anyway, right?

This gist has been moved to its own Github repo, so it's easier to contribute with additions and corrections. Please open a PR there if you see any mistake, I don't track comments on here as there's no notification system for gists AFAIK. Thanks.

Tabs and Windows

Function	Shortcut
Previous Tab	`⌘`+ `Left Arrow`
Next Tab	`⌘`+ `Right Arrow`
Go to Tab	`⌘` + `Number`

	# This isn't supposed to run as a bash script, i named it with ".sh" for syntax highlighting.

	# https://developer.nvidia.com/nsight-systems
	# https://docs.nvidia.com/nsight-systems/profiling/index.html

	# My preferred nsys (command line executable used to create profiles) commands
	#
	# In your script, write
	# torch.cuda.nvtx.range_push("region name")
	# ...

	# WSL2 network port forwarding script v1
	# for enable script, 'Set-ExecutionPolicy -ExecutionPolicy Bypass -Scope CurrentUser' in Powershell,
	# for delete exist rules and ports use 'delete' as parameter, for show ports use 'list' as parameter.
	# written by Daehyuk Ahn, Aug-1-2020

	# Display all portproxy information
	If ($Args[0] -eq "list") {
	netsh interface portproxy show v4tov4;
	exit;
	}

	package com.nieldeokar.whatsappaudiorecorder.recorder;

	import android.media.AudioFormat;
	import android.media.AudioRecord;
	import android.media.MediaCodec;
	import android.media.MediaCodecInfo;
	import android.media.MediaFormat;
	import android.media.MediaRecorder;
	import android.os.Build;
	import android.util.Log;

	const mdColors = [
	'#F44336',
	'#FFEBEE',
	'#FFCDD2',
	'#EF9A9A',
	'#E57373',
	'#EF5350',
	'#F44336',
	'#E53935',
	'#D32F2F',

	extern crate std;

	pub struct BufferedIterator<Iter: Iterator> {
	iter: Iter,
	buffer: Vec<Iter::Item>,
	}

	impl<Iter: Iterator> BufferedIterator<Iter> {
	pub fn new(iter: Iter) -> Self {
	BufferedIterator{