| # The Ruby development.rb is located within the Docker container at | |
| # /var/app/config/environments/development.rb | |
| # It's here that the user can configure e.g. | |
| Rails.application.configure do | |
| config.hosts << "my-site-here.app" | |
| end |
Make sure the git command runs successfully in Command Prompt. It needs to be in the PATH env var.
Update the file profile.json: open Settings by pressing Ctrl+, in Windows Terminal, click on Open JSON file in the sidebar, and add following snippet inside the word profiles:
{
"tabTitle": "Git Bash",
"acrylicOpacity" : 0.75,
"closeOnExit" : true,
| git rev-list --objects --all | | |
| git cat-file --batch-check='%(objecttype) %(objectname) %(objectsize) %(rest)' | | |
| sed -n 's/^blob //p' | | |
| awk '$2 >= 2^20' | | |
| sort --numeric-sort --key=2 | | |
| cut -c 1-12,41- | | |
| $(command -v gnumfmt || echo numfmt) --field=2 --to=iec-i --suffix=B --padding=7 --round=nearest | |
| git rev-list HEAD | nl | xargs -n 2 -P 8 sh -c 'git ls-tree -rl "$1" | perl -p -e "\$_ =~ s/[^ ]*+ [^ ]*+ ([^ ]*+) ++([^\t]*+)\t.*+/\1 \2/" | sort > logfile-$0' ; sort -m -u logfile-* | awk '{ sum += $2 } END { print sum }' |
| import sys | |
| import os | |
| # Define the path to add to sys.path, such as the current working directory | |
| print(os.getcwd()) | |
| path_to_add = os.getcwd() | |
| # Add the path_to_add to the system path | |
| if path_to_add not in sys.path: | |
| sys.path.append(path_to_add) |
| """ | |
| Extract table schemas from an EPIDD. | |
| Requirements: pip install --upgrade pandas xlsxwriter python-docx | |
| """ | |
| import pandas as pd | |
| from docx.api import Document | |
| doc_path = "C:/path/to/my.docx" |
| ################################################################# | |
| # Reading and writing files Sparklessly from S3 with BOTO3 # | |
| ################################################################# | |
| import boto3 | |
| import raz_client | |
| import pandas as pd | |
| import io | |
| my_bucket = "bucket_name_goes_here" |
| # Resources: | |
| # https://mally.stanford.edu/~sr/computing/basic-unix.html | |
| # https://mally.stanford.edu/~sr/computing/more-unix.html | |
| # https://devhints.io/bash | |
| ############### | |
| # Console use # | |
| ############### |
There are objects in the real world (phone, microphone, popcorn). Objects have attributes (what it is or has; properties) and methods (what it can do). In Python, a class can be used to create an object. A class is a blueprint or template that describes what attributes and methods an object has.
Class: data type, such as int, string, function, or user-defined Car
Object: instantiated class
Method: a function encapsulated within a class, such as the string class .upper() method.
Encapsulation: is where data in a class are hidden from other classes and only accessible via the class’s methods (‘data-hiding’); Objects (e.g. Cat) manage their own state/attributes (e.g., energy, age), have private methods (e.g., .meow(), .sleep()) that they can call whenever they want, and can only be touched by other classes via public methods (e.g., .feed()).
Based on https://medium.com/sicara/get-started-pyspark-jupyter-guide-tutorial-ae2fe84f594f
See also: https://www.datacamp.com/tutorial/installation-of-pyspark
| -- SQL: Structured Query Language for communicating with relational (tabular) databases | |
| -- RDBMS: Relational Database Management Systems | |
| -- CRUD: Create, Read, Update, and Delete | |
| -- Databases contain tables, plus potentially Views and Queries too | |
| -- Once connected to the server database, the following example snippets work | |
| -- These snippets were written primarily with Hive and PySpark SQL in mind | |
| ------------------ |