Skip to content

Instantly share code, notes, and snippets.

@bobycv06fpm
bobycv06fpm / README.md
Created April 9, 2019 08:53 — forked from leonardofed/README.md
A curated list of AWS resources to prepare for the AWS Certifications


A curated list of AWS resources to prepare for the AWS Certifications

A curated list of awesome AWS resources you need to prepare for the all 5 AWS Certifications. This gist will include: open source repos, blogs & blogposts, ebooks, PDF, whitepapers, video courses, free lecture, slides, sample test and many other resources.


@bobycv06fpm
bobycv06fpm / csv2wikitable.py
Created July 25, 2020 16:11 — forked from 0ncorhynchus/csv2wikitable.py
convert csv to wiki table
"""
Usage: python csv2wikitable.py csv_file
-----
input: csv format
output: wiki table format
"""
import sys
if __name__ == '__main__':
@bobycv06fpm
bobycv06fpm / pegasus_fine_tune.py
Created May 4, 2021 04:47 — forked from jiahao87/pegasus_fine_tune.py
Pytorch script for fine-tuning Pegasus Large model
"""Script for fine-tuning Pegasus
Example usage:
# use XSum dataset as example, with first 1000 docs as training data
from datasets import load_dataset
dataset = load_dataset("xsum")
train_texts, train_labels = dataset['train']['document'][:1000], dataset['train']['summary'][:1000]
# use Pegasus Large model as base for fine-tuning
model_name = 'google/pegasus-large'
train_dataset, _, _ = prepare_data(model_name, train_texts, train_labels)