This is it running --without-check

brew-install-octave--without-check.log

matt ~ 🔪  cat brew-install-octave.log 
==> Using Homebrew-provided fortran compiler.
This may be changed by setting the FC environment variable.
==> Building with an alternative Fortran compiler
This is unsupported.
==> Building with an alternative Fortran compiler
This is unsupported.
==> Building with an alternative Fortran compiler
This is unsupported.
==> Downloading http://ftpmirror.gnu.org/octave/octave-3.8.1.tar.bz2
Already downloaded: /Library/Caches/Homebrew/octave-3.8.1.tar.bz2
==> Downloading https://savannah.gnu.org/bugs/download.php?file_id=30734
Already downloaded: /Library/Caches/Homebrew/octave--patch-e8fb39b7ca1525d67e6d24f3c189b441b60fcdab.php
==> Downloading https://savannah.gnu.org/patch/download.php?file_id=31072
Already downloaded: /Library/Caches/Homebrew/octave--patch-19f2dcaf636f1968c4b1639797415f83fb21d5a3.php
==> Patching
patching file libgui/qterminal/libqterminal/unix/ExtendedDefaultTranslator_mac.h
patching file libgui/qterminal/libqterminal/unix/KeyboardTranslator.cpp
patching file src/mkoctfile.in.cc
==> ./configure --prefix=/usr/local/Cellar/octave/3.8.1 --without-opengl --with-x=no
==> make all
==> make install
==> Caveats

To use the gnuplot plotting engine, you must set the environment
variable GNUTERM. Valid choices include:
    GNUTERM=x11   # X windows must be installed
    GNUTERM=qt    # gnuplot must have been compiled with Qt support
    GNUTERM=aqua  # if you are using Aquaterm
You may also set this variable from within Octave with the command
    setenv('GNUTERM','qt') % or 'x11', or 'aqua'

The Octave GUI is experimental and not enabled by default. To use it,
use the command-line argument "--force-gui"; e.g.,
    octave --force-gui

==> Summary
🍺  /usr/local/Cellar/octave/3.8.1: 2106 files, 49M, built in 11.4 minutes