Muhammad Ghifari Taqiuddin ghifarit53

Usage:

$ python3 harvest.py yyy mm dd n keyword

Then (19 September 2022)

run this command first to see from where clang includes its header files clang -v -fsyntax-only -x c++ /dev/null. In my case, it's in /Library/Developer/CommandLineTools/usr/include/c++/v1
press Cmd + Shift + G in Finder and type the path or use cd to go to the dir
mkdir bits in there
cd bits and create a new file stdc++.h and paste the following content to it (source: https://gist.github.com/Einstrasse/ac0fe7d7450621a39364ed3b05cacd11)

	import pandas as pd
	import tensorflow as tf
	from sklearn.preprocessing import LabelEncoder
	from tensorflow.keras.preprocessing.text import Tokenizer

	def splitText(dataFrame: pd.DataFrame) -> pd.DataFrame:
	dataFrame.text = dataFrame.text.apply(lambda x: x.split())
	dataFrame.labels = dataFrame.labels.apply(lambda x: x.split())
	# splits the dataframe into lists instead of strings

	from datasets import Dataset, DatasetDict
	from transformers import AutoTokenizer, TrainingArguments, Trainer, DataCollatorForTokenClassification, AutoModelForTokenClassification, pipeline
	from sklearn.metrics import precision_score, recall_score, f1_score, classification_report, confusion_matrix, ConfusionMatrixDisplay
	from shutil import rmtree
	from tqdm import tqdm

	import matplotlib.pyplot as plt
	import seaborn as sns
	import pandas as pd
	import numpy as np

	import random
	import calendar

	# our sus link
	link = "https://docs.google.com/forms/d/1Kl1On8QB2n_tV_5qUazVNgTGEpw4PtoFOdJ-L45uOh4/viewform"

	# load our names to an array
	with open("names.txt", "r") as f:
	names = [line.strip() for line in f]