This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| welcome@Anjaiahs-MacBook-Pro ~ % more .zprofile | |
| # Setting PATH for Python 3.8 | |
| # The original version is saved in .zprofile.pysave | |
| PATH="/Library/Frameworks/Python.framework/Versions/3.8/bin:${PATH}" | |
| export PATH | |
| welcome@Anjaiahs-MacBook-Pro ~ % |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import csv | |
| from datetime import datetime | |
| INPUT_FILE_PATH = 'C:/Tech_Learn_welcome/Python_Utils/FastAPI/sai_workspace/fast_api_welcome/files/input.csv' | |
| OUTPUT_FILE_PATH = 'C:/data/python_output/input.csv' | |
| HEADER_SKIP = True | |
| OUTPUT_HEADER = 'id,first,last,ssn,address,firstname_lastname,process_date' | |
| def read_file(): |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| mkdir delab_f | |
| cd delab_f | |
| python3 -m venv delab-venv | |
| source delab-venv/bin/activate | |
| pip install jupyterlab |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Read data | |
| dfCustomer = spark.read\ | |
| .format("cosmos.oltp")\ | |
| .option("spark.synapse.linkedService", "AdventureWorksSQL")\ | |
| .option("spark.cosmos.container", "Customer")\ | |
| .load() | |
| display(dfCustomer.limit(10)) | |
| # Write data |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Spark Streaming with Cassandra (Azure Cosmos DB) | |
| 1. https://github.com/mspnp/azure-databricks-streaming-analytics |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 1.http://www.teradatahelp.com/2010/09/how-can-you-view-data-distribution-in.html | |
| 1. http://rajgopal-gurrapushala.blogspot.com/2012/11/types-of-hash-functions-used-in-teradata_734.html | |
| Create Table emp | |
| ( | |
| ID BIGINT NOT NULL GENERATED BY DEFAULT AS IDENTITY | |
| (START WITH 1 | |
| INCREMENT BY 1 | |
| MINVALUE -999999999999999999 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "_id" : "F0FF0BA8-CEF4-454C-9173-FA7C546F7179", | |
| "customerId" : "A852CB99-DAA1-4348-A86F-622D4478A7D0", | |
| "orderDate" : "2013-07-11T00:00:00", | |
| "shipDate" : "2013-07-18T00:00:00", | |
| "details" : [ | |
| { | |
| "sku" : "LJ-0192-M", | |
| "name" : "Long-Sleeve Logo Jersey, M", | |
| "price" : 49.99, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package com.iwinner.runanysql; | |
| import java.io.BufferedReader; | |
| import java.io.FileReader; | |
| import java.io.Reader; | |
| import java.sql.Connection; | |
| import java.sql.DriverManager; | |
| import java.sql.ResultSet; | |
| import java.sql.SQLException; | |
| import java.sql.Statement; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| insertId: "wr3zn3e373bw" | |
| logName: "projects/iwinner-data-318822/logs/cloudaudit.googleapis.com%2Factivity" | |
| operation: { | |
| first: true | |
| id: "operation-1627046240424-5c7ca39319163-07a56cfa-f16ec9a5" | |
| producer: "compute.googleapis.com" | |
| } | |
| protoPayload: { | |
| @type: "type.googleapis.com/google.cloud.audit.AuditLog" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| https://morioh.com/p/4d9c2c2cb9ae?f=5c224490c513a556c9042463&fbclid=IwAR0EA40-1MS3YNSJRkdnGIjAe6of7e3kIRGVRXq1t14aT44eIx4N6ykJ4L8 |