Deepak j-thepac

NGINX with DOCKER

Serving Static Content (HTML, CSS, JavaScript)
Reverse Proxy (load balancing ): forward requests from clients to backend servers which handle the requests.
API Gateway(distributing traffic): Acts as a single entry point for all API requests and distributing traffic
SSL/TLS Termination: it decrypts incoming traffic, inspects it, and then re-encrypts it before sending it to the backend servers.
Caching: NGINX can also be used as an HTTP cache, which can improve website performance by caching frequently requested content and serving it directly from memory
load balancing

Note : For Mongo Cloud

ref:

SQL VS MongoDB

Pre-Req:

input data (features or predictors)
- Example - student's age, gender, previous grades, etc.
- numpy array or pandas DataFrame
- denoted by the variable X.
target data (response or labels)
- Eg = student's final grade or pass/fail status.
- numpy array or pandas DataFrame
denoted by the variable Y.

BigData:

OLTP (OnLine Transaction Processing) : is used for managing current day to day data information.
- ACID
Atomicity(entire transaction happens at once or nothing happens)

Issues in Spark :

Adv of Delta Lake

	"""
	to Convert json data to Rows and Columns

	[{"data":[["2","2xg","2Q"],["1","3xg","3Q"]],"schema":[{"columnName":"CASE_UID","ordinal":0,"dataTypeName":"varchar"},{"columnName":"QUOTE_ID","ordinal":1,"dataTypeName":"varchar"},{"columnName":"OPP_NO","ordinal":2,"dataTypeName":"varchar"}]}]


	"""

	from pyspark.sql.functions import *
	from pyspark.sql.types import *

	from pyspark.sql.window import Window

	"""
	Aggregate: min, max, avg, count, and sum.
	Ranking: rank, dense_rank, percent_rank, row_num, and ntile
	Analytical: cume_dist, lag, and lead
	Custom boundary: rangeBetween and rowsBetween
	"""