Lecture01-matlab

TB-Lecture-01.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Lecture 1. Matrix-Vector Multiplication"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Matrix times vector"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A matrix right-multiplied by a column vector---that is, $\\mathbf{A}\\mathbf{x}$---is a linear combination of the columns of $\\mathbf{A}$, with coefficients of the combination given by the entries of $\\mathbf{x}$. For example,"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "A =\n",
      "\n",
      "     8     1     6\n",
      "     3     5     7\n",
      "     4     9     2\n",
      "\n",
      "\n",
      "x =\n",
      "\n",
      "    -1\n",
      "     2\n",
      "     1\n"
     ]
    }
   ],
   "source": [
    "A = magic(3), x = [-1;2;1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ans =\n",
      "\n",
      "     0\n",
      "    14\n",
      "    16\n"
     ]
    }
   ],
   "source": [
    "A*x"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ans =\n",
      "\n",
      "     0\n",
      "    14\n",
      "    16\n"
     ]
    }
   ],
   "source": [
    "x(1)*A(:,1) + x(2)*A(:,2) + x(3)*A(:,3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this context it's clear why the number of entries in $\\mathbf{x}$ has to be the same as the number of columns in $\\mathbf{A}$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If you left-multiply a matrix by a vector, it should be a row vector. I'll be using column vectors exclusively, so we have to transpose (or conjugate transpose) to get the row shape. Transposition of the product also makes the interpretation clear:\n",
    "\n",
    "$$\n",
    "\\mathbf{y}^* \\mathbf{A} = \\bigl( \\mathbf{A}^* \\mathbf{y}\\bigr)^*,\n",
    "$$\n",
    "\n",
    "which is the (conjugate) transpose of the columns of $\\mathbf{A}^*$, i.e., the rows of $\\mathbf{A}$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Linear algebra, including abstract linear algebra, is built in large part on linear combinations. The vectors that one combines need not be ordinary vectors in $\\mathbb{C}^n$. For instance, a polynomial is a linear combination of monomials. We can encompasss this fact too by generalizing the notion of a \"matrix\":\n",
    "\n",
    "$$\n",
    "c_0 + c_1 t + \\cdots c_n t^n = \\begin{bmatrix} 1 & t & \\cdots & t^n \\end{bmatrix} \\begin{bmatrix}c_0 \\\\ c_1 \\\\ \\vdots \\\\ c_n \\end{bmatrix}.\n",
    "$$\n",
    "\n",
    "The \"matrix\" here is sometimes called a *quasimatrix*. From here it's a small step to imagine choosing many values of $t$ in an interval and converting the quasimatrix into a proper matrix. This is easy to carry out in MATLAB."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAjAAAAGkCAIAAACgjIjwAAAACXBIWXMAABcSAAAXEgFnn9JSAAAA\nB3RJTUUH4AgeDg03XassBwAAACR0RVh0U29mdHdhcmUATUFUTEFCLCBUaGUgTWF0aFdvcmtzLCBJ\nbmMuPFjdGAAAACJ0RVh0Q3JlYXRpb24gVGltZQAzMC1BdWctMjAxNiAxMDoxMzo1NcffZ54AACAA\nSURBVHic7d1/cFXlve/xbxLAQGQbBCETEwwXmCg4mIwpUE4P8kMH7Iyc8R60w9S2OjAW255CR5Hr\nyNAjzEUtlROutocZW9vpjNXDD6XMSMPcUxOqKBQYQAYOkBRySLovQigxIQmBJNw/Hl0s1lp77d97\nPWut9+uPzsrOys6iZ598+nyf7/M8edevXxcAALyW7/UDAAAgQiABADRBIAEAtEAgAQC0QCABALRA\nIAEAtEAgAQC0QCABALRAIAEAtEAgAQC0QCABALRAIAEAtEAgAQC0QCABALRAIAEAtEAgAQC0QCAB\nALRAIAEAtKBjIEWj0Zqamvvvv/+NN97w+lkAADkyyOsHcLBly5bOzk4R6e3t9fpZAAA5ot0I6dKl\nS1u3bvX6KQAAuaZXIJ09e/Zb3/rW+fPnvX4QAECuaVGy6+zsPHLkSF1dXV1dnSrWAQDCxuNAev75\n5z/44IO+vj5vHwMA4DmPS3adnZ2kEQBAPB8hTZkyxf7iZ5991tbWlvuHAQB4yONAeuaZZ+wvLl26\ntL6+PvcPAwDwkF5ddgCA0NKiyy5Lmv9+xetHAAC9VNxe6PUjxBTkQBr3vz/x+hEAQBf/0v7e68X/\n8/prc7x+kJiCHEgAABG5s6/ttUFv9ndUDC3aJaJvIDGHBABBdmdf24d/Wz40OuJk46TCP5c8d9+a\nwzuOe/1QzggkAAisf2l/78O/LR9236DG/zdZvVKUN/zMgRZvnyqWIJfsxn246sM/fej1UwAiInPm\nzuHTiBwbtPGJ7v/+ZPCY/OaBezvaI8brs5d+3cOnchHkQBrcfVHnfhKECp9G5NK18y2tP13YfaFF\nRIbdV7Dv99OMb53pP1lcGon9o14KciABQAh11G8+94vl6loV68zDozN9Jz16rviYQwJy4eRJff8K\nIEjOvbHcSKPBY/KH3VfwX4cnGd+tqCk7PxD16NHiI5AAIAhUma6jYbPxyrD7ClrPlLWeudN4pXrB\nZC8eLVEEEgD4Xs+xT8/8YFr3sRu7AQy7b9Dgkvz/OnyP+baqBZNsP6oR5pAAwN8ubn7t4ubXzK8U\n3Jo37L4CETl+6EYgPbpmXq6fLEkEEgD41bXzLZ//4ifmgZGIDL6j/LZ5g0X+9n/ff8j8uubDIyGQ\nAMCneo592vLTf7a8GJn1+G0PVfSc3Cg3D4/0TyMhkADAj+xlOhEp+WHtrdNmtP/nP8rNaSQaL4Y1\nI5AAwE9ilelKflQ7dPLXO/csUq/sq7+xGLZqwSRtF8OaEUgA4BuOZbphk2eUvbRVRHpO1l67uFdE\njh+6x7wYVvNub4OOgbRp0yavHwEAtONYphv5+LMjH39WRPra9qqpIxGxLIatqCnL2UOmQ8dAAgCY\nuZfp1JdGGvlrMawZgQQAWnMv0315z1fFOhHx12JYMwIJAPTlXqZTzMU68dtiWDMCCQB0lEiZTjGn\nke8Ww5oRSACgHbVT6rULNx3tainTKeZinfhwMawZgQQAejEfaGSwlOkUS7HOvPZIfLIY1oxAAgCN\ntP50YSJlOuXy4RXmLy3DI18shjUjkABAC46TRo5lOqXr0IqB7lbjy5MnH/LjYlgzAgkAvJd4mU7p\na9vb23IjqAaPnL63fppIh/qyasEkvyyGNSOQAMBj595Ybj7pVVzLdIqlWHeq5an26DHjSz8Oj4RA\nAgAPxertLntp6+DR5bF+qnPPInOxrqh6/WcvfWF86aO9giwIJADwRqwDjUp+VOvyU31te8193oNH\nTv+vQ5OaD+wyXvFdc52BQAIADzhuwVD+0jaXMp2IDHS3dnyyyPxKUfX6Qz/+1PiyuDTi0+GREEgA\nkGOJb8Fg13XopqmjyIx3zh6X5gM3ynf+HR4JgQQAuZRamU7pbdlqKdYNGjW9/n9tMd/ju90ZzAgk\nAMiRWOeOR2Y/HvdnB7pbzcOj/GFlw//hnfZoh3l45K+tVO0IJADIunTKdIqlWHdr1XoRqd/0qflF\nXw+PhEACgGxL5ECjOO9w8w6qt5QvHDRquogc3nHceNHvaSQEEgBkVSIHGrmz7KCaP6ysqHq9iLy/\nepf5Nl+3MygEEgBkRfplOsWcRvJVsU5swyPfbaVqRyABQOZdO99y5gfTLC8mVaZTLMW6oZXL7MU6\nCcTwSETyvX4AAAiai5tfs6fRyMefTTaNLMW6wSOnD638cgNWcztDMIZHwggJADIrqQON3Fl2UB1a\nuUxdHN5xvD3aYbzu061U7QgkAMiMxM8dT4RlB1WjWCc3D4/8u5WqHYEEABmQ7IFG7uw7qBrFOsvw\nKBizRwqBBADpSuFAIxeOO6ga10EdHgmBBADpSPbc8UTYd1DNH/Zl6gR4eCQEEgCkzHELhpTLdF++\n58193moHVePLQztuHAsbsOGREEgAkJrUDjRyZ9+UYfg/vGN8eXjH8cCcNOGIQAKA5KR27ngiYm3K\noAR7eCQEEgAkJZ0Djdx1HVrhuCmDYhkeBWbtkRmBBACJSudAI3d9bXt7W270QZj7vBXz8Ki4NBKA\nvb3tCCQAiC9TO6XGYunzNjZlUJoPtAZ79kghkAAgjvQPNHLXueemNIrMeMdcrJOb1x4FdXgkBBIA\nuEv/QCN3vS1bXfq8JTTDIyGQACCWbJfpRGSgu9W8DNbS560E7JxyFwQSADjIdplOsWzKYOnzFtvw\n6NE18zL423VDIAGAVbbLdEqsw/fMwjM8EgIJAMxyUKZTXA7fM4RqeCQEEgAYMnugkQv7ft6WPm/F\nvPZIgj48EgIJAJTMHmjkzr6ft71Y1x7tOLzjuPFlgJvrDAQSAGTy3PG43PfzNlhmj2YtdbgnYAgk\nAKGWjQONXLjv521oPtAatuGREEgAwiyXZTrFfT9vQwiHR0IgAQgte2939sp0SueeRXH7vCVMWzNY\nEEgAQid7Bxq56Gvba5k6svd5K+EcHgmBBCBssnegkQt7n3dRtXOxLrTDIyGQAIRKNs4dT4S9zzt/\nmPN5r6EdHgmBBCAkcrYFg12Cfd4S7uGREEgAwsCTMp2SYJ+3EubhkRBIAAIve+eOx2WfOorV5y3h\n27nOjkACEFgelukUy9RRUfX6WMU6CdnG3o4IJADBlJsDjdwewDZ1dEv5wlg3MzwSAglAIOXmQCMX\nSU0dCcMjESGQAASM52U65fLhOEfBmjE8UggkAMGRswON3HXuWTTQfSNgYm0RZGB4pBBIAALC8zKd\nYp86irVFkMLwyEAgAQiCXB5o5CLZqSNheGRCIAHwN03KdEpSU0fC8OhmBBIAH8v9gUYukp06kpuH\nR8WlkTAPj4RAAuBf595Y3tGw2fyKJ2U6JdmpIxE5vON4mHeusyOQAPhPrN7ucf++z5PnsUwdSezT\nJczMw6OKmrKQD4+EQALgO45bMHhVplMsU0cup0sYDu843h7tML5keCQEEgB/8epAIxcpTB2JbXhU\nURMnwMKAQALgD56cOx5XClNHItKwaS/DIzsCCYAPeHigkYsUVh0pDI8cEUgAdOfhgUbukl11pDRs\n2mv+kuGRgUACoC9Ndkp1lNrUkdw8PKpaMInhkYFAAqApzw80cpHa1JGIvL96l/lLhkdmBBIAHWmy\nU6qjlKeO2qMdh3ccN76sWjCpuDSS+efzLQIJgF50LtOJyEB3a8cni8yvJDh1JLZ9VBkeWRBIADSi\nc5lO6Tp0UyND4lNHzQdaGR65I5AA6ELnMp2S8tSR2IZHId/Y2xGBBMB7mpfplJSnjsR2zATFOkcE\nEgCPaXWgUSzpTB2JbXg0a2lCVb6wIZAAeEmrA41cWKaOIjPeSXDqSGzHTFCsi4VAAuAZTc4dj6tz\nzyLL1FHiaSScwpcwAgmABxwnjXQr0ym9LVstaZT41JHYjplgeOSCQAKQa34p04lIX9tee593Uu9g\n3pqBfVTdEUgAcsre261nmU6xn7yXVLGOfVSTQiAByBE9DzRykfL2qUp7tIN9VJNCIAHIBT0PNHKR\nzhpYhX1Uk0UgAcg6Dc8dd5fOGljFshKWjYISQSAByCJfbMFgkeYaWIWNglJAIAHIFt+V6RRLW11R\n9fqkpo7ENjwijRJEIAHICm3PHXdnXwN7S/nCZN+ElbCpIZAAZJgfy3SKvZEh2akjYaOgNBBIADJJ\n/wONYrE0MohIUXXSU0dy8/CIlbBJIZAAZIz+BxrFYm9kiMx4J39Y0lnSsGmveaMgWr2TQiAByAD/\nlumUlM+BNWMlbJoIJADp8sWBRi7sjQzJroFVWAmbJgIJQFr8W6ZTLI0MKayBVVgJmz4CCUDq/HKg\nUSz2RoYU1sAqrIRNH4EEIBV+L9NJjEaGFKaOhFbvDCGQACTNRwcauchII4PCStiMIJAAJOfcG8s7\nGjabX/FXmU7JVCOD2Fq9GR6ljEACkKhYvd3j/n2fV4+Umkw1Moit1ZuVsOkgkAAkxHELBt+V6SSj\njQxia/VmeJQOAglAfL470CiWDDYyiK3Ve/bSr9PqnQ4CCYAb35077i6DjQxia/WetTT1t4IQSABc\n+PRAo1gy2MggtHpnAYEEwJlPDzSKJSNHS5iZZ48qaspo9U4fgQTAyu87pdpZGhnyh5WldrSEgW3r\nsoFAAnAT/x5oFEtf215LI8OtVetTOFrC0Hyg9fCO48aX7OqdKQQSgBv8vlOqXWbb6hRLLwPDo0wh\nkACIBLFMp1ja6gaPnJ5mGll6GWj1ziACCUAAy3SKva0uzUYGsW1bR6t3BhFIQNgFr0ynZHB/IMP7\nq3exbV32EEhAeAW1TCeZ3h9IsfQysG1dxhFIQEgF4ECjWOxtdek3MghH8GUfgQSEUTAONHI00N16\n+fBNjQxF1evTTyN6GXKAQAJCx+/njrvrOrRioPtGcgweOf2W8oXpv615JSy9DFlCIAEh4jhpFIwy\nnZKNtjrhjIlcIZCAsAhwmU7JRludsC9DDhFIQCjYe7uDVKaT7LTVKezLkDMEEhBwATvQyFGW2uqE\nXobcIpCAIAvYgUaO7LvVZaStTrGcMUEvQ1YRSEBgBebccXeW3epuKV+YkbY6EfnNki3mLynWZRuB\nBARQgLdgsLC31aV50JGh+UCruVhHL0MOEEhA0IShTKdY0ihTbXUKvQy5RyABgRKwc8dd2Ju8IzMy\nlkYNm/aah0ePrplHL0MOEEhAQISnTCcxmrzTOQTWrD3aYR4eVdSUVS2YlJF3hjsCCQiCoB5o5Ch7\nTd6KZV8GinU5QyABvhfUA40c2Zu8h1Yuy2Aa2Rce0cuQMwQS4GOhKtMp9iPJh1Za90NKWXu0g01U\nPUQgAX4V4AONYsnS3qkGNlH1FoEE+FKoynRKVpu8hYVHGiCQAP8J9oFGjrLa5K0wPPIcgQT4SQjL\ndCLS27I1e03eyvurd7VHO4wvn/rVYxl8cySIQAJ8I/AHGjnqa9traWTIbJO32E48qqgpo1jnCQIJ\n8IdzbyzvaNhsfiXwZTrJ/pIjxbJLEMU6rxBIgO7CcKCRo2wvOVLYJUgfBBKgNcctGAJfplOyuuRI\nYZcgrRBIgL5CcqCRo2wvOVLYJUgrBBKgo9CW6ZRsLzlSLMU6dgnyHIEEaCc8Bxo56jq0wpJGxQ9+\nlPHfYinWsUuQDggkQC/hOdDIUc/J2t6Wm9ZU3VqVmRNgLVgGq6EkAqmtra2urq6pqenUqVNnz54t\nLS2dMGHCxIkT586dO3bs2HQe4uDBg/v27Yt722233fbtb387nV8E6CyEO6Va2E85ykaTt1Cs01Wi\ngbR9+/Z169Z98cUXxisXLlw4cuSIiNTW1i5btuzJJ5/Mz89P7SG2bdu2bdu2uLeNHTuWQEJQhepA\nI0e5WXIkIs0HWinW6SmhCFm1atXKlSvNaVRYWGhcX7ly5dVXX12yZMn169dTe4gTJ06k9oNAMFzc\n/Jpjb3eY06ioen020khYBqux+COk+vr6LVu2qOtIJPLcc89NnTp13Lhx0Wj04MGDGzZsiEajIrJn\nz5633377iSeeSPYJ+vv7//rXv4rI0KFDX3rpJZc7i4qKkn1zQHOU6STGAthbyhdm43dRrNNZnEDq\n6en513/9V3VdUlLy1ltvjR8/Xn1ZWlpaWlo6bdq0xYsXnzp1SkRee+21hx56aMyYMUk9wdmzZ69c\nuSIilZWV//RP/5TsPwDwL8p04pRG2VgAq1Cs01yckt3HH3987tw5db1ixQojjQyjR49eu3atuu7u\n7t65c2eyT3Dy5El1cffddyf7s4B/UaZTug6tGOi+MWTJ0gJYhWKd5uIEUn19vbooLy9/+OGHHe+p\nqqqaOnWquv7www+TfQICCWGjjpCw9HYPvqO8/KVtYdgQyCw32zEoFOv0FyeQdu/erS4eeOCBgoKC\nWLfNmTNHXRw8eLCrqyupJzA6Gu65556kfhDwI5VGlkmjYZNnjPv3feGZNFJysx2DQrHOF9wCqbOz\ns62tTV1PmTLF5U7ju/39/WfPnk3qCdQIKT8/v7KyMqkfBHyno37zmR9MsxyvF8IynTilUcZPgDWj\nWOcLbk0Nqn1OmTBhgsud5u9Go9HExzqXL19Wv2Xs2LFDhw69ePHi7t27Gxsbz5w5M3r0aLXw9v77\n7x8yZEiCbwhoK4Tnjsdi2RxIsnACrBnFOr9INJBGjBjhcmckEikoKOjv77f8VFynTp1Sq5fuvvvu\n99577+WXX+7o6LDcU1FRsWbNmmnTpiX+toBWHHu7w9ZNZ7BvDpSlBbCKpVhXUVNGsU5bbiU782yQ\neyDl5eVFIl8eadXd3Z34rzc6GhoaGl544QV7GolIc3Pzd7/73RdffDHlhbeAh3qOfXrmB9MsaRTO\nMp2I9LZszc3mQAYOmPARtxHStWvXbtw3KM6KJeOGq1evJv7rjUC6cuXKoEGDZs2aNXXq1K997Wu9\nvb0nTpz485//bLTtbd269d577120aFHsNwO0Y98pNbRlOhHpa9trOXMv22n0myVb2qM3/mcuxTrN\nJRpIeXl57m9kbGRn/qm4jECKRCKvv/769Ok3PprV1dWLFi2qq6tbvXq12rXo5z//+Zw5c5JdeAt4\nIuQHGtnlcnMgpflAq3nqiGKd/twCydzn3dfX5z5IUhNIlp+Ka9asWZMmTerp6Xn66acrKirsN8yf\nPz8vL+/HP/6xiFy+fLm2tvbll19O/P3NnXtG+AHZFvIDjewc0yhLmwMp7dGO3yzZYn4lzJ11fulh\ndsuYwYMHG9dXr141b6hqZ1TqzD8V1/e///2498ybN2/27Nlqia7aXzxxhBByL8znjjuyp9Et5Quz\nmkZimzp66lePFZdGsvobdWb+S6hzOLk1NVgCyf2Nent71UU2WrQfeughddHc3JxUSRDIJZctGEKb\nRo5b1RVVZ+XMPYOlz7uipoypI19wC6SRI0ca15cuXXK5s7u72wik22+/PSNPZmZEen9/f3Nzc8bf\nH0ifYzddZNbjIdyCwTDQ3dr+n/9ofiWrmwMp9k0ZnvrVY1n9jcgUt0C68847jWu1n3csjY2Njj+V\nKcXFxcZ1a2ury52AJ2LtlBraSSOJMTbKdhoJmzL4mdscUklJibHc1Rw5dubvlpaWJvi7m5qa1NZE\nY8aMGTdunMudp0+fNq7TPC4dyCwONHI00N2ay228DWzK4GtxuuwmT5782WeficixY8dc7jS+O2rU\nqLKyRP/P/8c//vGNN94Qkfvvv//3v/+9y51NTU3qYsiQIY7NeIAnONAoFsvmQLlJIzZl8Ls4u30b\n23h/9NFHsTrcotHo9u3b1fWsWbPirlgyVFVVqYsjR464zFH19/cb7z9x4sSk2sqB7OFAo1hyuY23\nGZsy+F2cQHrwwQfVxfXr19euXeu4ec8rr7xibBc0d+5cy3dPnDhx5CuW1LnvvvtUevX19b3wwgux\ndgb67W9/a/QsJtImDmQbBxq5sKdR8YMf5eD3silDAMQJpIkTJz7yyCPq+ujRo7W1tcYCWOXdd9/d\ntevL/1VSU1Mze/ZsyzssX7788a80NDSYvxWJRL7zne+o6/r6+mefffbChQvmG65du7Zx48YNGzao\nL2fOnDlvHvOT8BgHGrnI8aESBnufN8U6P4qzQ52IrFq16pNPPrl48aKIbNq06U9/+tOMGTPKyso+\n//zz/fv3G3W8wsLCdevWJV6vU1auXHn06NFDhw6JyAcffNDQ0PCNb3xj/Pjxt956a2Nj4/79+42e\nuhEjRqxevTq5fxyQaR31m8/9YrnlxZGPP8vASJzSKKuHShjo8w6M+IFUXFy8adOmlStXqla3xsZG\ne8fdHXfcsW7durvuuivpXz9o0MaNG1esWLFv3z4R6erqMsZbZnPnzl2zZs2oUaOSfX8ggzjQyIVj\nGmV1qzqDZeqIPm//ilOyU6ZMmfKHP/xh6dKl9kWvw4cPf+yxx3bu3Dlz5szUnmDMmDG/+93v3nzz\nzUmTJlkGWEVFRdXV1T/72c9++ctfkkbw0LXzLWeesS56pUxnsKSRiOQsjZg6CpK8ZA8ZunTpUlNT\nU0tLS0lJyYQJE0aPHp3Bp+np6Tl9+vSZM2cKCwsrKyvLysqSrQGaVVZWspcd0keZzp09jbJ9qITh\n8I7j5uFRRU0Zxbq4dP7DmHQg+YjO/73DL869sbyjYbP5Fcp0Zh6mUfOBVst+3j/ZuTjMO6gmSOc/\njPHnkIBw4kCjuCyrXyWHaSS2LYJCvp93MBBIgAPHLRgo05l1HVrR23LTEuBcptFvlmxhi6DgIZAA\nKw40isvbNOIo2KAikIAbKNMlwts04ijYACOQgC9x7ngivE0j4SjYQCOQAJEYZbqSH9ZGZj/uyfPo\nyfM0skwdVS2YxNRRkBBICDsONEqQ52lk37COYl3AEEgINQ40SpDnaWTZsE6YOgoiAgnh5Vimo7fb\nzvM0sjcyMHUUSAQSwogyXeI8TyNxOnmPqaNAIpAQOpTpEqdDGnHWUXgQSAgXynSJ0yGNOOsoVAgk\nhAVluqTokEasgQ0bAgmhoM4dv3ahxfwiZbpYPNzD28y+Bpapo2AjkBB8HGiUFE3SyLIGtqKmjDQK\nPAIJAceBRknRJI3sjQxMHYUBgYTAcpw0okznQpM0Yg1saBFICCYONEqWPmnEGtjQIpAQQPbebsp0\nLga6W709+9XQHu2wNDI8umYeU0fhQSAhUDjQKFn2NMofVnZr1frcp5GIvL96V3u0w/iyoqasasGk\n3D8GvEIgITg40ChZWqWRva2ORoawIZAQEJw7niyt0sjSVseODOFEIMH32IIhBQPdre3/+Y/mV/KH\nlRU/+JEnD0NbHRQCCf5GmS4FfW17Oz5ZZH7FwzRyPFqCRoZwIpDgY+yUmgKt0kg4WgImBBJ8iTJd\nauxpNHjk9OH/8I5Xz2NvZOBoiTAjkOA/HGiUmt6WrV2HVphf0S2NaGQIOQIJPkOZLjW6pZG9rY5G\nBhBI8A3KdCmzH250S/nCour1Xj2PY1sd+wOBQII/cKBRyuxpNLRy2dBK63kcOeO4Wx2NDBACCb7A\ngUYps2+ZWlS9/pbyhV49j+MhsKQRFAIJumv96ULKdCnQZ8tUg33v1KoFk9itDgYCCfqiTJcyDdNI\nRN5fvcvSVkcjA8wIJGiKMl3KHLcF8mqTOgNN3oiLQIKOOHc8ZY4bMXieRpaxEXunwhGBBL1woFE6\ndNsWSDm84/jhHcfNr1CpgyMCCRphp9R06Lb0VWk+0GppZKDJG7EQSNAFBxqlo+dkbc/JjeZXNEkj\nlhwhcQQSvEeZLk32xUbebsSg2NOIJUdwRyDBS46jopIf1kZmP+7J8/jLQHdrxyeLBrpbzS963tst\nIu3Rjn/75q/Nr9BTh0QQSPAGG9OlSc9uOnFa/UoaIUEEEjzA+RFp0jaNxGn1K2mEBBFIyDXOj0iT\nvX9Bh95uhdWvSAeBhNyhTJc++9bdOnTTKZY0YvUrkkUgIUco06XJcXs6HbrpFNII6SOQkAuU6dLk\nmEbeHiRhZkkj4cA9pIRAQnZRpkufvYVB9GjvVuxpxOpXpIZAQhZxfkT67BsC6dNQJ6QRMopAQrZw\nfkT67C0M+jTUia3DW0gjpIdAQlZwfkT67BsC6dNQJyLvr95l2cObNEKaCCRkmOOkEWW6pDi2MAyt\nXDa00jri9ApphGwgkJBJjr3dlOmSonkLg5BGyBoCCRlj7+2mTJcsx10Y9GlhENII2UQgIQM4PyIj\n7JNGWrUwCGmELCOQkC6OeU2f46SRVi0MQhoh+wgkpIVjXtPnOGmkVQuDOKURp+0h4wgkpIgtGDLC\nvu5VNGthEFa/IlcIJKSCnVIzwnHdq1YtDEIaIYcIJCSNnVLT54tJIyGNkFsEEpJAmS4jfDFpJKQR\nco5AQqIo02WEfaWR6DdpJKQRvEAgISGU6dLnWKbTcNKoPdrBrqnwBIGEOCjTZcRAd2vHJ4sGum/6\nK6/hpJE9jYpLI3R4IzcIJLjhQKOMcOzt1nDSqD3a8W/f/LX5FdIIuUQgISYONMoIX/R2i0jzgdbf\nLNlifoU0Qo4RSHDW+tOFlOnS5JfebomRRj/Zudir50E4EUiwokyXEX4p04nI4R3H31+9y/xKRU3Z\nU796zKvnQWgRSLgJZbqMsJfpRMvebhFp2LS3ftOn5ldII3iFQMINnDuevli93ZEZ7+QP024yxr5l\natWCSY+umefV8yDkCCSIcKBRhjiW6W4pX1hUvd6T53HhuNho9tKvz1qq3RgO4UEggQONMsN+vJ7o\nWqZzTKNH18yrWjDJq0cChEACBxqlz3HRq7ZlOntDnbARA/RAIIUXZbqMcNybTs9uOmGxEfRGIIUU\nZbr0+WVvOoO9oY7FRtAKgRRGjmW6kh/WRmY/7snz+JHjERLalunEafdu2ruhGwIpXNgpNSP8VaZz\nbGGgvRsaIpBChAON0herf0HbMp19v1ShoQ66IpDCggON0uc4MNJzbzrFvieQ0FAHjRFIwUeZLn2O\n/QsiUlS9/pbyhZ48UlyOLQw01EFnBFLAUaZLn+PASOf+BcdJI1oYoD8CKcgoB28a/wAAEo5JREFU\n06Up1sBI2/4FibHulT2B4AsEUmBxoFGaHDem07l/QZg0gs8RSAHEgUZp8uPASJy27mbSCP5CIAUN\nBxqlKdaKV50HRkwaIRgIpEDhQKN0xBoY6Xl+hMGxTMekEfyIQAoIx95uynSJ8+OMkTiV6YRJI/gW\ngRQEjr3dlOkSFGtgpPOKV4lRpmPSCL5GIPmevbebMl3iYq0x0nxg5FimY3s6+B2B5GMcaJQOnw6M\nxGnfbqFMh0AgkPyKA43S4dOBUXu04zdLtrRHO8wvFpdGnvrVY8WlEa+eCsgUAsmXOHc8ZY7bdYv2\nrXTitDed0E2HYCGQfIadUlM20N3a27LVpwMj+hcQBgSSn7BTasocu7pF+80XJMbAqKKm7NE18yjT\nIWAIJN9gp9TUxGpe8OnASCjTIbgIJB+gTJcyx+YF8cPAyLGxmzIdgo1A0h1lutT0te29fHiFvXlB\n/65uBkYILQJJa5TpUuDfGp3EmDFiYISQIJA0RZkuNf6t0cUaGLH/AsKDQNIRBxqlwPHYCNH7rHED\nAyNACCQNcaBRslxqdEMrl91SvtCTp0qQ4+YLwowRQolA0gvnjicl1lpX8UmN7vCO4wyMAAOBpAvK\ndMmKNV00eOT0our1mtfoHLu6hYERwo1A0gJluqTE2nbBF310sZoXGBgBBJL3OHc8cS7TRbeU/7NP\na3TCwAgQEQLJWxxolLiB7taekxt7WxwKmPpPF0mMPjphVzrAhEDyDAcaJcilc8EX00XU6IAEEUje\n4ECjRLhEkV+mi+o3fXp4x3H7t6jRAXYEUq5RpktQrCY6v08XUaMDYiGQcooyXSJiRZH4fLqIGh3g\njkDKHccyXckPayOzH/fkeTTUc7K2t2WbfYtu8X8UVS+YTI0OcEcg5QI7pcblHkW3lC/UvHOh+UDr\n+6t32XcAEqaLgIQRSFnHgUbuXKLIL010jpvRiUjVgkmzl36d6SIgQQRSdnGgkQuXKPJLE51jP7eI\nFJdGnvrVY0QRkBQCKVso07kIdhTRuQCkhkDKCsp0jlzWFUkgoojOBSAdBFLmUaazC0AUubQtEEVA\nRhBIGcaBRhYBiKKGTXsP7ThGFAHZRiBlDAcaWfg9ilx2WxCiCMgCAikzONDIrK9tb8/JjfZDIhT9\nm7mJIsATBFIGcKCRooZEsdrnxA9LXIkiwEMEUloce7tDWKZzr86JHzb+cZkoEpHi0sjspV+vWjAp\nx08FhAqBlDrH3u6wlelczs0TP+zM7T4kEnZbAHKIQEqRvbc7VGW6uNU5X0RRrMOKFDUkIoqAnCGQ\nkhbyA43iVucGj5w+tHKZtu1zcYdETBQBXiGQkhPaA40SHBJp27OgcujMgRbHTRYUJooAbxFISQjn\ngUZxh0SaV+cSHBJRnQM8RyAlJIQ7pcYdEonI0Mplg0dO17M6p3LIpXFOqM4BmiGQ4gvbTqk9J2sH\nuv8Wq3FO9B4SJZ5DDIkA3RBIcYRnp9S4pTkRyR9Wpha35uypEpRIDgmzRIDeCKSYQlKmSzCH9BwS\nJdKqIJTmAJ8gkJwFvkyXyBSRto1ziY+HKM0BPkIgOQhwmS6RHBIth0Tt0Y72aEfzgVaXfjlF5VBF\nTRnHtgL+QiDdJKhlOl/nUCJFOSGHAP8jkG4I3oFGicwPiX6lOTUSUlv7xL2ZHAICg0D6UmAONFIh\n5N63rWiVQ0ZFLpHBkJBDQBARSCKBOHc8waKcfJVDOixoTTaEhD4FINB0CaS2tra6urqmpqZTp06d\nPXu2tLR0woQJEydOnDt37tixY7P3e319oJEKIRGJW5QTbcZDak5IRJINIQZDQODlXb9+3etnkO3b\nt69bt+6LL76wf6uwsHDZsmVPPvlkfn5+sm9bWVl58uRJlxv8WKZLKoREgxxKYRgkIsWlkeLSyLia\ncgZDQGbF/cPoIe9HSKtWrdqyZYv5lcLCwitXrqjrK1euvPrqqx9//PGvf/3rvLy8DP5eH507PtDd\neu3i3oHu1kQqcvJVCImIJ/1yqSWQmEKIwRAQTh4HUn19vZFGkUjkueeemzp16rhx46LR6MGDBzds\n2BCNRkVkz549b7/99hNPPJGRX+qLA43USKivbd+1i3sT/BGvJoeMprhkE0gIIQAmXpbsenp65s+f\nf+7cOREpKSl56623xo8fb77h/PnzixcvPnXqlIgMGzasrq5uzJgxib+/48hU2wONjGFQCiEkORwM\nGfFzKfqFuk72HYpLIxU1ZSNKbyOEgNyjZOfs448/VmkkIitWrLCkkYiMHj167dq13/rWt0Sku7t7\n586dTz31VDq/0XELhvKXtnlSpkstgUQkf1jZ4JHT84fdme2ZIaP4JiJnDrSoL1N4HzUJRGMCAHde\nBlJ9fb26KC8vf/jhhx3vqaqqmjp16l/+8hcR+fDDD1MOJM/LdAPdrSqBRCTZBBKR/GFlBUPLBo2a\nlo2KnIoZNe6R9LJHMRJIRAghAAnyMpB2796tLh544IGCgoJYt82ZM0cF0sGDB7u6uoqKipL9Rbkv\n06UZP0pmy3EqYFTSZCp4DMZUUHFphMMdAKTGs0Dq7Oxsa2tT11OmTHG50/huf3//2bNn77nnnqR+\nUVbPHVc9b+bs6e9pTaQRzlE6wyB73qg5HhFJYZrHnRE/wgAIQOZ4FkiqfU6ZMGGCy53m70aj0cQD\nafSQgfS3YDAix0iage6/mb9MR6wEao92yFcBY/lPMSWN5fVsUMU31YOgcoj4SY3OM8mAJrQIpBEj\nRrjcGYlECgoK+vv7LT/lrufYp//nfwy6cPiYyG3Gi4NGl416dmOPSE/TcRHpVwHTcyNXBrpbB7r/\npr5lft2s45KxTtP6p7mjfbjllc72yM03fPll/rCyy71fJmt7tEPkmEic032yTeVNcWmE7AHgCc8C\nqaury7h2D6S8vLxIJHLp0iUR6e7uTvD9W376z9v/e4X11f8WWbjL9eeGi9wtIl/9Z1ZluJKWCDXi\nMQpuBA8AfXgWSNeuXbvxEIPiPIZxw9WrVxN8/5If1spP/pbas/mXkTdqoGNciwipA0BzWgRS3D2B\njI3szD/lLjL7cZF/S+3Z9NF1vdN8cdN/Dtz0ypd3/lVu/Cc0U1lZ6fUjAFrzLJDMfd59fX3ugyQ1\ngWT5Kc/F2vTT/rr5FTVwsXzLfIP9FQAIA88CafDgwcb11atXCwsLXW42KnXmn4rrJzsXJ34zAQAA\n3tIlkNxv7u3tVRdDhgxJ/FeQMQDgI0kfMpQpI0eONK5VB10s3d3dRiDdfvvt2X0sAIBHPAukO++8\n07hW+3nH0tjY6PhTAIAg8SyQSkpKjA4Fc+TYmb9bWlqa3ccCAHjEs0AqKCiYPHmyuj527JjLncZ3\nR40aVVbGYhoACCbPAklE5syZoy4++uijI0eOON4TjUa3b9+urmfNmpXZU8wBAPrwMpAefPBBdXH9\n+vW1a9c6nl37yiuvGNsFzZ07N3cPBwDILS8DaeLEiY888oi6Pnr0aG1trbEAVnn33Xd37fpy67ma\nmprZs2fn+hEBALmS5zguyZn29vZvfvObFy9eVF9OnDhxxowZZWVln3/++f79+406XmFh4Y4dO+66\n6y7vnhQAkF0eB5KIfPbZZytXrjx9+nSsG+64445169bNnDkzl08FAMgx7wNJRK5evfqLX/xi8+bN\nf//7382vDx8+fP78+c8//3wkwp4LABBwWgSS4dKlS01NTS0tLSUlJRMmTBg9erTXTwQAyBG9AgkA\nEFpedtkBAGAgkAAAWiCQAABaIJAAAFogkAAAWiCQAABa8OwI82xoa2urq6tramo6derU2bNnS0tL\nJ0yYMHHixLlz544dO9brp4O/ZenTdfDgwX379sW97bbbbvv2t7+d8m8BlGg0umDBguvXrz/11FM/\n+tGPvH4cq+AE0vbt29etW/fFF18Yr1y4cEHthldbW7ts2bInn3wyP58RIVKRvU/Xtm3btm3bFve2\nsWPHEkhI35YtWzo7O0Wkt7fX62dxEJA/0KtWrVq5cqX570VhYaFxfeXKlVdffXXJkiWsAkYKsvrp\nOnHiRAYeEUjApUuXtm7d6vVTuAnCCKm+vn7Lli3qOhKJPPfcc1OnTh03blw0Gj148OCGDRui0aiI\n7Nmz5+23337iiSc8fVj4TFY/Xf39/X/9619FZOjQoS+99JLLnUVFRan+CwARkbNnzy5ZsuT8+fNe\nP4gb328d1NPTM3/+/HPnzolISUnJW2+9NX78ePMN58+fX7x48alTp0Rk2LBhdXV1Y8aM8eZZ4TfZ\n/nSdOXNm/vz5IlJVVfUf//EfGX12QESks7PzyJEjdXV1dXV1qlinPP30088++6yHD+bI9yW7jz/+\nWP29EJEVK1ZY/l6IyOjRo9euXauuu7u7d+7cmdPng59l+9N18uRJdXH33Xen96SA1fPPPz958uSa\nmprFixcbU0ea830g1dfXq4vy8vKHH37Y8Z6qqqqpU6eq6w8//DBHTwb/y/ani0BC9nR2dvb19Xn9\nFMnx/RzS7t271cUDDzxQUFAQ67Y5c+b85S9/EZGDBw92dXVRkUcisv3pMjoa7rnnnvSeFLCaMmWK\n/cXPPvusra0t9w+TIH8HUmdnp/FfruN/+wbju/39/WfPnuX//xFXDj5daoSUn59fWVmZxpMCDp55\n5hn7i0uXLjXG/RrydyCpBidlwoQJLneavxuNRgkkxJXtT9fly5fVrxg7duzQoUMvXry4e/fuxsbG\nM2fOjB49Wq26vf/++4cMGZLqvwDwmeAE0ogRI1zujEQiBQUF/f39lp8CYsn2p+vUqVOqx/Xuu+9+\n7733Xn755Y6ODss9FRUVa9asmTZtWnKPDviTv5saurq6jGv3Pxl5eXmRSERdd3d3Z/exEAjZ/nQZ\nHQ0NDQ0vvPCCPY1EpLm5+bvf/e6LL77o9+UZQCL8PUK6du2acT1oUJx/i3HD1atXs/hMCIpsf7qM\nQLpy5cqgQYNmzZo1derUr33ta729vSdOnPjzn/9s9Oxt3br13nvvXbRoUXL/AMBvghNIeXl57jcb\nW42ZfwqIJdufLiOQIpHI66+/Pn36dONb1dXVixYtqqurW716tdqy6Oc///mcOXNY041g83cgmTtx\n+/r63P9nrCrxW34KiCXbn65Zs2ZNmjSpp6fn6aefrqiosN8wf/78vLy8H//4xyJy+fLl2tral19+\nOcE3B/zI34E0ePBg4/rq1avmLS/tjFqK+aeAWLL96fr+978f95558+bNnj1b9emqzcWBAPN3U4Pl\nT4b7zcZ26/TRIhGafLoeeughddHc3Ey1GcHm70AaOXKkcX3p0iWXO7u7u40/Gbfffnt2HwuBoMmn\ny1gz29/f39zcnNk3B7Ti70C68847jWu143IsjY2Njj8FxKLJp6u4uNi4bm1tzeybA1rx9xxSSUmJ\nsSDR/EfBzvzd0tLSrD8Z/C+rn66mpia1L9GYMWPGjRvncufp06eN63TOSgf05+8RUkFBweTJk9X1\nsWPHXO40vjtq1KiysrKsPxn8L6ufrj/+8Y/f+973vve977344ovudzY1NamLIUOGODbjAYHh70AS\nkTlz5qiLjz76KFYbUjQa3b59u7qeNWtW3DUlgJK9T1dVVZW6OHLkiMsEVX9/v/HmEydOZMUCgs33\ngfTggw+qi+vXr69du9Zxh5VXXnnF2NBl7ty5uXs4+Fz6n64TJ04c+Yo5eO677z4VXX19fS+88EKs\nnYF++9vfGutnE2kTB3zN94E0ceLERx55RF0fPXq0trbWWKKovPvuu7t27VLXNTU1s2fPzvUjwrfS\n/3QtX7788a80NDQYr0cike985zvqur6+/tlnn71w4YL5B69du7Zx48YNGzaoL2fOnDlv3ryM/cMA\nLfm7qUFZtWrVJ598cvHiRRHZtGnTn/70pxkzZpSVlX3++ef79+83Ki2FhYXr1q2jXoekZO/TtXLl\nyqNHjx46dEhEPvjgg4aGhm984xvjx4+/9dZbGxsb9+/fb/TUjRgxYvXq1Zn+lwHaCUIgFRcXb9q0\naeXKlaofqbGx0d4Tdccdd6xbt+6uu+7y4gHhY9n7dA0aNGjjxo0rVqzYt2+fiHR1dRmDLbO5c+eu\nWbNm1KhRqf4LAN/wfclOmTJlyh/+8IelS5falyUOHz78scce27lz58yZMz15Nvhd9j5dY8aM+d3v\nfvfmm29OmjTJMroqKiqqrq7+2c9+9stf/pI0QkjkBe+clUuXLjU1NbW0tJSUlEyYMGH06NFePxGC\nI3ufrp6entOnT585c6awsLCysrKsrIzyMsImgIEEAPCjgJTsAAB+RyABALRAIAEAtEAgAQC0QCAB\nALRAIAEAtEAgAQC08P8Ba5QWcI98OoIAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "V = zeros(51,4);  % not strictly necessary\n",
    "t = linspace(0,1,51)'; \n",
    "for j = 0:3, V(:,j+1) = t.^j; end\n",
    "plot(t,V)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Matrix times matrix"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It's often useful to think of a matrix-matrix product as a collection of matrix-vector products. For example,"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "C =\n",
      "\n",
      "    16    18    21\n",
      "     5    16    26\n",
      "     9    16    22\n",
      "     4    18    33\n"
     ]
    }
   ],
   "source": [
    "A = magic(4); B = triu(ones(4,3)); \n",
    "C = A*B"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ans =\n",
      "\n",
      "    16    18    21\n",
      "     5    16    26\n",
      "     9    16    22\n",
      "     4    18    33\n"
     ]
    }
   ],
   "source": [
    "[ A*B(:,1), A*B(:,2), A*B(:,3) ]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Hence the number of rows in $\\mathbf{B}$ has to be the same as the number of columns in $\\mathbf{A}$. In the special case where that number is 1, then $\\mathbf{A}$ is a column vector and $\\mathbf{B}$ is a row vector, and the result is called a **vector outer product**. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ans =\n",
      "\n",
      "     4     1\n",
      "\n",
      "\n",
      "ans =\n",
      "\n",
      "     1     3\n"
     ]
    }
   ],
   "source": [
    "u = [ 1; 2; 3; 4 ];  v = [ 1i -1i 1 ];\n",
    "size(u), size(v)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ans =\n",
      "\n",
      "   0.0000 + 1.0000i   0.0000 - 1.0000i   1.0000 + 0.0000i\n",
      "   0.0000 + 2.0000i   0.0000 - 2.0000i   2.0000 + 0.0000i\n",
      "   0.0000 + 3.0000i   0.0000 - 3.0000i   3.0000 + 0.0000i\n",
      "   0.0000 + 4.0000i   0.0000 - 4.0000i   4.0000 + 0.0000i\n"
     ]
    }
   ],
   "source": [
    "u*v"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Rank and inverse"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The rank and inverse of a matrix are of critical importance in linear algebra. It's important to be aware, however, that they are not robust to perturbations. For example, it should be clear that this matrix is singular and of rank 1."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "A =\r\n",
      "     0     1\r\n",
      "     0     0\r\n",
      "ans =\r\n",
      "     1\n"
     ]
    }
   ],
   "source": [
    "A = [ 0 1; 0 0 ]\n",
    "rank(A)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "However, any perturbation of the second row, no matter how small, mathematically changes the rank to 2 and thus makes the matrix invertible."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "B =\r\n",
      "            0   1.0000e+00\r\n",
      "   1.0000e-12            0\r\n",
      "ans =\r\n",
      "     2\n"
     ]
    }
   ],
   "source": [
    "format short e\n",
    "B = A + [0 0; 1e-12 0 ]\n",
    "rank(B)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In numerical computation, representation of and arithmetic with real numbers cannot be exact. Therefore, the notions of rank and invertibility will have to be carefully reconsidered. In fact, it's questionable as to whether you should ever compute a matrix rank in finite precision.  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Change of basis"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In linear algebra one learns that a matrix is the expression of a linear transformation relative to a particular basis. Unless stated otherwise, when we write out the numerical values of a matrix, we have chosen the standard basis, whose elements are the columns of an identity matrix. \n",
    "\n",
    "Say we have a basis whose elements, when expressed in the standard basis, are the columns of a square matrix $\\mathbf{A}$. Let a vector $\\mathbf{v}$ be given as coordinates $x_1,x_2,\\ldots$ in that basis. Then we can convert the coordinates of $\\mathbf{v}$ to standard by matrix--vector multiplication:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "v_standard =\r\n",
      "     5\r\n",
      "    16\r\n",
      "     9\n"
     ]
    }
   ],
   "source": [
    "A = magic(3);  x = [ -1; 1; 2 ];\n",
    "v_standard = A*x"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Consequently, we can convert a vector from standard coordinates to the \"$\\mathbf{A}$-basis\" through multiplication by $\\mathbf{A}^{-1}$. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "v_Abasis =\r\n",
      "  -1.0000e+00\r\n",
      "   1.0000e+00\r\n",
      "   2.0000e+00\n"
     ]
    }
   ],
   "source": [
    "v_Abasis = A^(-1) * v_standard"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that while `A^(-1)*` works in MATLAB, *it is not recommended*, for reasons we will go into later. A mathematically equivalent but computationally preferable syntax is to use `A\\` instead."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "v_Abasis =\r\n",
      "    -1\r\n",
      "     1\r\n",
      "     2\n"
     ]
    }
   ],
   "source": [
    "v_Abasis = A \\ v_standard"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Matlab",
   "language": "matlab",
   "name": "matlab"
  },
  "language_info": {
   "codemirror_mode": "octave",
   "file_extension": ".m",
   "help_links": [
    {
     "text": "MetaKernel Magics",
     "url": "https://github.com/calysto/metakernel/blob/master/metakernel/magics/README.md"
    }
   ],
   "mimetype": "text/x-octave",
   "name": "matlab",
   "version": "0.11.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}