yanghua

Case 1: pylance hung

basic information

• 4000 GPU cards training job via PyTorch;
• multiple workers(processes), multipe-threads per process;
• concurrently call pylance dataset scanner with index, filter one row;
• pylance version: 0.32.0 community release version;
• dataset size: 1.5GB / dataset;
• There are no issues before, stable in production for more than two months, but yesterday, must occur this issue.

yanghua

# Enable Powerlevel10k instant prompt. Should stay close to the top of ~/.zshrc.
# Initialization code that may require console input (password prompts, [y/n]
# confirmations, etc.) must go above this block; everything else may go below.
if [[ -r "${XDG_CACHE_HOME:-$HOME/.cache}/p10k-instant-prompt-${(%):-%n}.zsh" ]]; then
  source "${XDG_CACHE_HOME:-$HOME/.cache}/p10k-instant-prompt-${(%):-%n}.zsh"
fi

# If you come from bash you might have to change your $PATH.
# export PATH=$HOME/bin:/usr/local/bin:$PATH

yanghua

Installing pyenv on macOS for Zsh using Homebrew

Published May-13-2020

• Installation
• Basic Usage
• Virtualenv