rainsunny

Suppose you need to apply the same function to multiple columns in one DataFrame, one straight way is like this:

val newDF = oldDF.withColumn("colA", func("colA")).withColumn("colB", func("colB")).withColumn("colC", func("colC"))

If you want to save some type, you can try this:

1. Use select with varargs including *:

import spark.implicits._

wdullaer

# Ask for the user password
# Script only works if sudo caches the password for a few minutes
sudo true

# Install kernel extra's to enable docker aufs support
# sudo apt-get -y install linux-image-extra-$(uname -r)

# Add Docker PPA and install latest version
# sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys 36A1D7869245C8950F966E92D8576A8BA88D21E9
# sudo sh -c "echo deb https://get.docker.io/ubuntu docker main > /etc/apt/sources.list.d/docker.list"

lrvick

/**
 * # Global logging module
 *
 * This is a global set of hooks that catch all $log messages sent out by the
 * application. Currently they are simply passed off directly to console.log
 * but this could be updated later to allow them to be stored locally, sent to
 * a server etc.
 */

angular.module('ngLogging', [])