Skip to content

Instantly share code, notes, and snippets.

@Houssem96
Created August 22, 2021 12:54
Show Gist options
  • Save Houssem96/d361459c992fa693369889849ffe2637 to your computer and use it in GitHub Desktop.
Save Houssem96/d361459c992fa693369889849ffe2637 to your computer and use it in GitHub Desktop.
import libraries for news classification task
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
from datasets import list_datasets, load_dataset
import torch
from transformers import AutoTokenizer, AutoModel, AutoModelForSequenceClassification, Trainer, TrainingArguments
from sklearn.metrics import accuracy_score, f1_score, classification_report
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment