Script to recursively generate PDF files from markdown files in the current directory and its subfolders using "pandoc".

README.md

Description

Script to generate pdf files from markdown files using pandoc, which is assumed installed. It processes all the markdown files in the current directory and its subfolders and places the resulting pdf files in a ./target directory, maintaining their original subfolder structure.

Note: The script aims also to be one example of bash scripting, so that I can use it as reference for several code snippets

Execute script

You can download the script if you want to modify it, and make it executable. You can do it with following shell command:

curl -LO https://gist.github.com/rbf/6064734/raw/generate-pdf && chmod +x ./generate-pdf

If you just want to execute it directly, without modifying it or saving a local copy, you can execute following command:

bash <(curl -sSL https://gist.github.com/rbf/6064734/raw/generate-pdf)

To install an executable copy of the script into your /usr/local/bin directory, you can execute following command:

bash <(curl -sSL https://gist.github.com/rbf/6064734/raw/generate-pdf) --install

Usage

The main usage pattern is the following:

  $ ./generate-pdf [path-pattern [target-path]]

To remember this usage notice, you can use:

  $ ./generate-pdf --help

Examples

• $ ./generate-pdf --help Prints this help and exits

• $ ./generate-pdf --version Prints the version of the script and exits

• $ ./generate-pdf --install Makes a copy of the script to '/usr/local/bin' and exits

• $ ./generate-pdf --update Updates the script installed in '/usr/local/bin' and exits

• $ ./generate-pdf All .md and .markdown files in the current directory and its subdirectories are converted in pdf in the ./target directory, maintaining its original sub-folder structure

• $ ./generate-pdf api All .md and .markdown files in the current directory and its subdirectories containing "api" (case sensitive) in the file name or the path are converted in pdf in the ./target directory, maintaining its original sub-folder structure

• $ ./generate-pdf ./doc/*api All .md and .markdown files in the "doc/" subdirectory and its subdirectories containing "api" (case sensitive) in the file name or the path are converted in pdf in the ./target directory, maintaining its original sub-folder structure

• $ ./generate-pdf api pdfs All .md and .markdown files in the current directory and its subdirectories containing "api" (case sensitive) in the file name or the path are converted in pdf in the ./pdfs directory, maintaining its original sub-folder structure

• $ ./generate-pdf api . All .md and .markdown files in the current directory and its subdirectories containing "api" (case sensitive) in the file name or the path are converted in pdf in the current directory, maintaining its original sub-folder structure, i.e. next to their .md counterparts

• $ ./generate-pdf . . All .md and .markdown files in the current directory and its subdirectories are converted in pdf in the current directory, maintaining its original sub-folder structure, i.e. next to their .md counterparts

generate-pdf

#!/bin/bash

# The MIT License (MIT)
# 
# Copyright (c) 2013 https://gist.github.com/rbf
# 
# Permission is hereby granted, free of charge, to any person obtaining a copy of
# this software and associated documentation files (the "Software"), to deal in
# the Software without restriction, including without limitation the rights to
# use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of
# the Software, and to permit persons to whom the Software is furnished to do so,
# subject to the following conditions:
# 
# The above copyright notice and this permission notice shall be included in all
# copies or substantial portions of the Software.
# 
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS
# FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
# COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER
# IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN
# CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.


### File info:

GP_VERSION="v1.0"
GP_SOURCE="https://gist.github.com/rbf/6064734/raw/generate-pdf"
GP_INSTALL_PATH="/usr/local/bin"

###


echoerr() { echo "$@" 1>&2; }

checkpandoc(){
  if [ "$(which pandoc)" == "" ]
  then
    echoerr "[ERROR] pandoc not found!"
    echoerr "[INFO]  For installing info visit: http://johnmacfarlane.net/pandoc/installing.html"
    exit 1
  fi
}

printversion(){
  echo "$(basename ${0}) ${GP_VERSION}"
  checkpandoc
  echo "$(pandoc --version | head -1)"
}

printhelp(){
cat << EOF
Version:
$(printversion)

Usage:

  $ ./generate-pdf [[option] | [path-pattern [target-path]]]

Examples:

  $ ./generate-pdf --help       Prints this help and exits

  $ ./generate-pdf --version    Prints the version of the script and exits

  $ ./generate-pdf --install    Makes a copy of the script to '/usr/local/bin' and exits

  $ ./generate-pdf --update     Updates the script installed in '/usr/local/bin' and exits

  $ ./generate-pdf              All .md and .markdown files in the current directory and its
                                subdirectories are converted in pdf in the  ./target directory,
                                maintaining its original sub-folder structure

  $ ./generate-pdf api          All .md and .markdown files in the current directory and its
                                subdirectories containing "api" (case sensitive) in the  file name or
                                the path are converted in pdf in the  ./target directory, maintaining
                                its original sub-folder structure

  $ ./generate-pdf ./doc/*api   All .md and .markdown files in the "doc/" subdirectory and its
                                subdirectories containing "api" (case sensitive) in the  file name or
                                the path are converted in pdf in the  ./target directory, maintaining
                                its original sub-folder structure

  $ ./generate-pdf api pdfs     All .md and .markdown files in the current directory and its
                                subdirectories containing "api" (case sensitive) in the  file name or
                                the path are converted in pdf in the  ./pdfs directory, maintaining
                                its original sub-folder structure

  $ ./generate-pdf api .        All .md and .markdown files in the current directory and its
                                subdirectories containing "api" (case sensitive) in the  file name or
                                the path are converted in pdf in the  current directory, maintaining
                                its original sub-folder structure, i.e. next to their .md counterparts

  $ ./generate-pdf . .          All .md and .markdown files in the current directory and its
                                subdirectories are converted in pdf in the  current directory,
                                maintaining its original sub-folder structure, i.e. next to their .md
                                counterparts

EOF
}

GP_CURL_BASE="curl -sSL ${GP_SOURCE}"
GP_CURL_INSTALL="bash <(${GP_CURL_BASE}) --install"
GP_INSTALLED_SCRIPT="${GP_INSTALL_PATH}/generate-pdf"

updatescript(){
  if [ ! -e "${GP_INSTALLED_SCRIPT}" ]
  then
    echoerr "[ERROR] ${GP_INSTALLED_SCRIPT} not found"
    echoerr "[INFO]  Run following command to install: ${GP_CURL_INSTALL}"
    exit 1
  fi
  eval ${GP_CURL_INSTALL}
}

installscript(){
  if [ "${0}" == "${GP_INSTALLED_SCRIPT}" ]
  then
    echo "Already using ${0}"
    exit 0
  fi
  checkpandoc
  if [ -e "${GP_INSTALLED_SCRIPT}" ]
  then
    echo -n "Currently installed: ${GP_INSTALL_PATH}/"
    "${GP_INSTALLED_SCRIPT}" --version | head -1
    echo "You are installing version ${GP_VERSION}." 
    read -p "Do you want to continue? [y/n] " GP_ANSWER
    if [ "${GP_ANSWER:0:1}" == "n" ]
    then
      exit 0
    fi
  fi
  if [ "$(dirname ${0})" == "/dev/fd" ]
  then
    # We are installing from the piped version, and we have to redownload a new version of the file
    # since the current one (often in /dev/fd/63) has already been consumed up to here
    ${GP_CURL_BASE} -o "${GP_INSTALLED_SCRIPT}"
  else
    cp -v "${0}" "${GP_INSTALLED_SCRIPT}"
  fi
  chmod +x "${GP_INSTALLED_SCRIPT}"
  echo "[INFO]  Successfully installed to ${GP_INSTALLED_SCRIPT}"
}

if [ "${1}" == "--help" ]
then
  printhelp
  exit 0
elif [ "${1}" == "--version" ]
then
  printversion
  exit 0
elif [ "${1}" == "--install" ]
then
  installscript
  exit 0
elif [ "${1}" == "--update" ]
then
  updatescript
  exit 0
elif [ "${1:0:2}" == "--" ]
then
  echo "Invalid option: ${1}"
  echo
  printhelp
  exit 1
fi

checkpandoc

GP_BASE_DIR="$(pwd)"
GP_TARGET_DIR="${2:-target}"

for file in $(find . -type f -path "*${1}*" \( -iname "*.md" -or -iname "*.markdown" \) -print)
do
  echo -n "[INFO]  Processing file: $file "
  GP_CURRENT_DIR=$(dirname "$file")
  GP_CURRENT_FILENAME=$(basename "$file")
  GP_TARGET_CURRENT_DIR="${GP_TARGET_DIR}/${GP_CURRENT_DIR}"
  GP_TARGET_CURRENT_FILEPATH="${GP_TARGET_CURRENT_DIR}/$(basename "$file" ".md").pdf"
  # Remove unnecessary (but not wrong) "/./" from path for enhanced prompt in stdout
  GP_TARGET_CURRENT_FILEPATH="${GP_TARGET_CURRENT_FILEPATH/\/.\///}"
  GP_TARGET_CURRENT_FILEPATH="./${GP_TARGET_CURRENT_FILEPATH#./}"
  mkdir -p ${GP_TARGET_CURRENT_DIR}
  # Since pandoc looks for images relatives to where it is called (https://github.com/jgm/pandoc/issues/917)
  # we have to cd into the directory of the given file before pandoc'ing it,
  # and we have to pass the full path in the -o parameter.
  cd "${GP_CURRENT_DIR}"
  GP_PANDOC_OUTPUT=$(pandoc --toc --number-sections "${GP_CURRENT_FILENAME}" -o ${GP_BASE_DIR}/${GP_TARGET_CURRENT_FILEPATH#./} 2>&1) # to capture pandoc stderr output
  if [ "$?" == 0 ]
  then
    echo "--> ${GP_TARGET_CURRENT_FILEPATH}"
  else
    echo -e "\r[ERROR] Processing file: $file - Detail below"
    GP_ERRORS+=("$(echo -e "[ERROR] ${file} - Failed generation of PDF\n[ERROR] Expected target file: ${GP_TARGET_CURRENT_FILEPATH}\n[ERROR] ${GP_PANDOC_OUTPUT}\n\n\n")")
  fi
  cd "${GP_BASE_DIR}"
done

if [ ${#GP_ERRORS[@]} -eq 0 ]
then
  exit 0
fi

echoerr
echoerr "[ERROR] ===================================================================="
echoerr "[ERROR] pandoc failed to generate PDF for ${#GP_ERRORS[@]} file(s)"
echoerr "[ERROR] ===================================================================="

for i in "${GP_ERRORS[@]}"
do
  echoerr
  echoerr "${i}"
  echoerr
done

exit 1

Thats's sounds awesome... Do you know how to make a similar thing on Windows?

I like the idea but...

/home/howie/bin/process-md: line 188: syntax error near unexpected token `newline'
/home/howie/bin/process-md: line 188: `  done'