| #!/usr/bin/env python | |
| # Script to scrape all links from a site, compile counts of each link, status | |
| # codes of access and output the results as a CSV | |
| # | |
| # There's absolutely no reason this shouldn't be pulled into an OOP paradigm | |
| # per se, but I left it functionalized because that can be easier for multitasking. | |
| # | |
| # Requirements: | |
| # requests, bs4 |
This requests an allocation on a compute node of Adroit for 15 minutes. Once granted you can see I'm moved to the compute node adroit-14. I also ask for two tasks (you can adjust based on whether you actually use the cores or not.)
[bhicks@adroit4 ~]$ salloc -N 1 --ntasks-per-node=2 -t 15:00
salloc: Granted job allocation 497989
[bhicks@adroit-14 ~]$ export XDG_RUNTIME_DIR=""
Follow the instructions here to install Quantlib.
Make especially sure that you use the --with-intraday flag for QuantLib.
The default MacOS clang++ for High Sierra does not include support for OpenMP, so you'll need to install a version that does and then set R to use it for compiling libraries.
| #!/usr/bin/env python | |
| """ | |
| Python script to list all MySQL databases and allow them to be recreated. | |
| This assumes you have server information and credentials stored in a ~/.my.cnf | |
| file (ideally chmoded to 0600) | |
| [client] | |
| host=localhost | |
| user=root | |
| password=secretpasswordgoeshere |
| # -*- coding: utf-8 -*- | |
| import pandas as pd | |
| import LatLon as latlon | |
| import re | |
| from LatLon import string2latlon | |
| # Requires: pandas, LatLon, py2.7 | |
| def makefloatlat(data): |