Skip to content

Instantly share code, notes, and snippets.

@idoru
idoru / gist:5470286
Last active December 16, 2015 17:29
Clang with ARC bug: Incorrect substitution for pointer template parameters. This bug report is suitable to be posted to http://bugreport.apple.com
Summary:
When ARC is enabled, C++ candidate templates' pointer template parameters are not correctly substituted for objective-C object pointers.
Steps to reproduce:
Compile the following main.mm file, with and without ARC:
#import <Foundation/Foundation.h>
template <typename T>
@idoru
idoru / pr.md
Created July 13, 2022 13:52 — forked from piscisaureus/pr.md
Checkout github pull requests locally

Locate the section for your github remote in the .git/config file. It looks like this:

[remote "origin"]
	fetch = +refs/heads/*:refs/remotes/origin/*
	url = [email protected]:joyent/node.git

Now add the line fetch = +refs/pull/*/head:refs/remotes/origin/pr/* to this section. Obviously, change the github url to match your project's URL. It ends up looking like this:

#Fixes notorious `dockerd: failed to start daemon: Devices cgroup isn't mounted` error when trying to start docker
#in a privileged concourse container.
#From: https://github.com/concourse/docker-image-resource/blob/master/assets/common.sh#L1-L40
#See also: https://github.com/concourse/concourse/issues/324
sanitize_cgroups() {
if [ -e /sys/fs/cgroup/cgroup.controllers ]; then
return
fi
mkdir -p /sys/fs/cgroup

Mistral-7B-Instruct-v0.2 - Lighteval

Task Version Metric Value Stderr
all qem 0.0000 ± 0.0000
truthfulqa_mc1 0.5288 ± 0.0175
truthfulqa_mc2 0.6827 ± 0.0152
leaderboard|gsm8k|0 0 qem 0.0000 ± 0.0000
leaderboard|truthfulqa:mc|0 0 truthfulqa_mc1 0.5288 ± 0.0175
truthfulqa_mc2 0.6827 ± 0.0152
Model AGIEval GPT4All TruthfulQA Bigbench Average
Mistral-7B-Instruct-v0.2 38.94 71.67 66.88 42.22 54.93

AGIEval

Task Version Metric Value Stderr
agieval_aqua_rat 0 acc 23.23 ± 2.65
acc_norm 22.83 ± 2.64
agieval_logiqa_en 0 acc 36.25 ± 1.89