Skip to content

Instantly share code, notes, and snippets.

View rossmounce's full-sized avatar
🏠
Working from London

Ross Mounce rossmounce

🏠
Working from London
90 followers · 153 following
View GitHub Profile
@jbreckmckye
jbreckmckye / gist:4553c47e1b26dbe6130f1d7736f148d9
Last active November 10, 2023 02:07
JSTOR Open Access Book List
Title Subtitle Authors JSTOR Discipline 1
Tracking Rural Change "Community, Policy and Technology in Australia, New Zealand and Europe" Socio
@Pakillo
Pakillo / datachecks.md
Last active November 3, 2017 19:37
R packages for data checking and validation
@danog
danog / dropbox_youtube_dl.sh
Last active January 13, 2018 16:00 — forked from roblight/dropbox_youtube_dl.sh
Script to download videos from YouTube using Dropbox and IFTTT automation (IFTTT recipe: https://ifttt.com/recipes/277403-download-every-youtube-video-you-add-to-your-watch-later-playlist-automatically)
#!/bin/bash
### Original script by Geoffeg, modified by Roblight and later by me (alias me='alias Danog='Daniil Gentili'')
### How to install this script:
### wget https://gist.github.com/danog/a3963463892f7f7df74a/raw/dropbox_youtube_dl.sh -O ~/dropbox_youtube_dl.sh && chmod 755 ~/dropbox_youtube_dl.sh && ~/dropbox_youtube_dl.sh --install
###
### IFTTT Recipe URL: https://ifttt.com/recipes/277403-download-every-youtube-video-you-add-to-your-watch-later-playlist-automatically
if [ "$1" = "--install" ]; then
if [ -f /usr/local/bin/youtube-dl ]; then echo "Youtube-dl already installed."; else echo "Installing youtube-dl..."; sudo curl https://yt-dl.org/downloads/2015.04.03/youtube-dl -o /usr/local/bin/youtube-dl && sudo chmod a+x /usr/local/bin/youtube-dl && echo "YouTube-dl installed successfully." || echo "Couldn't install YouTube-dl."; fi
@loleg
loleg / grab-commons-images-sh
Last active January 8, 2025 07:33
Download images and metadata from a Wikimedia Commons category or results page
#!/bin/bash
#
# Download images from a Wikimedia Commons category
#
# Highest preview resolution and metadata in XML format will be saved in subfolders.
# Usage: execute this script on a Linux command line, providing the full URL to the category page.
#
# Shell tools required for this script: wget sed grep
#
@sckott
sckott / plos_solr_search.md
Created April 22, 2014 16:23
PLOS API solr search using solr R pkg

Install from CRAN and load

install.packages("solr")
library("solr")

Define URL




  


  




    


          
    

      

        
        

          

              @drjwbaker
          

          

            
                drjwbaker
                / Mining Digital Repositories.md
            
            

              Last active
              August 29, 2015 13:58
            

              
                Mining Digital Repositories: Challenges and Horizons, KB, Den Haag, 10 April 2014
              
          

        

      

        

  

      

    
###Mining Digital Repositories: Challenges and Horizons, KB, Den Haag, 10 April 2014


Live notes, so an incomplete, partial record of what actually happened.


Tag #digrep14




####Challenges (Thursday)


Hans Jansen, KB



  


  




    


          
    

      

        
        

          

              @liquidgecka
          

          

            
                liquidgecka
                / cron_helper.sh
            
            

              Last active
              September 28, 2023 15:35
            

              
                Cron helper
              
          

        

      

        

  

    
    


        



  


  

        

          
          #!/bin/bash
        

        

          
          

        

        

          
          usage() {
        

        

          
            cat << EOF
        

        

          
          Usage: $0 [OPTION]... COMMAND
        

        

          
          Execute the given command in a way that works safely with cron. This should
        

        

          
          typically be used inside of a cron job definition like so:
        

        

          
          * * * * * $(which "$0") [OPTION]... COMMAND
        

        

          
          

        

        

          
          Arguments:
        

  





    


  




    


          
    

      

        
        

          

              @tzermias
          

          

            
                tzermias
                / pipelines.py
            
            

              Last active
              March 14, 2024 23:35
            

              
                Scrapy MySQL pipeline. Just a mirror to the asynchronous MySQL pipeline.
Copy-paste it directly to pipelines.py. Database credentials are stored in settings.py. Based on http://snipplr.com/view/66986/
              
          

        

      

        

  

    
    


        



  


  

        

          
          import MySQLdb.cursors
        

        

          
          from twisted.enterprise import adbapi
        

        

          
          

        

        

          
          from scrapy.xlib.pydispatch import dispatcher
        

        

          
          from scrapy import signals
        

        

          
          from scrapy.utils.project import get_project_settings
        

        

          
          from scrapy import log
        

        

          
          

        

        

          
          SETTINGS = get_project_settings()
        

  





    


  




    


          
    

      

        
        

          

              @hubgit
          

          

            
                hubgit
                / publishers-dois.csv
            
            

              Created
              July 12, 2013 14:13
            

              
                Approximate number of "journal article" DOIs registered by each publisher for articles published in 2012. Total: 2,189,820. ISSNs + publishers from http://www.crossref.org/titleList/ DOI counts per ISSN from http://search.labs.crossref.org/dois?year=2012&type=Journal+Article&header=true&rows=0&q={ISSN}
              
          

        

      

        

  

    
    


        

  
  



  

    


    

      
        

          
            Elsevier
            529633
        

      
      
          

            
              Springer-Verlag
              206527
          

          

            
              Wiley Blackwell (John Wiley & Sons)
              110387
          

          

            
              Wiley Blackwell (Blackwell Publishing)
              100235
          

          

            
              Informa UK (Taylor & Francis)
              85869
          

          

            
              Trans Tech Publications
              53310
          

          

            
              Sage Publications
              42105
          

          

            
              Oxford University Press
              40496
          

          

            
              American Chemical Society
              39543
          

          

            
              Ovid Technologies (Wolters Kluwer)  - Lippincott Williams & Wilkins
              39186
          

      
    

  


    


  




    


          
    

      

        
        

          

              @ctb
          

          

            
                ctb
                / gist:5663625
            
            

              Last active
              November 23, 2021 04:11
            

          

        

      

        

  

    
    


        



  


  

        

          
          Hi bwa users,
        

        

          
          

        

        

          
          The bwa-mem manuscript has been rejected. Interestingly, the first
        

        

          
          reviewer only raised a couple of minor concerns and then accepted the
        

        

          
          manuscript in the second round of the review. The second reviewer made
        

        

          
          quite a few mistakes on some basic concepts and was hostile from the
        

        

          
          beginning. The third reviewer gave fair and good review in the first
        

        

          
          round, all of which have been addressed, but he then tried hard to
        

        

          
          argue one particular mapper to be the best in accuracy that on the
        

        

          
          contrary is inferior to most others in my view. I admit that my