Deepak j-thepac

Dataset : IMDB Movies dataset

DOCKER

Snapshot of the application containing all the libraries , supporting files etc.,

Note :

For JSON file make sure all new lines , blank spaces are removed.
Dataflow , Notebooks etc - names has to start with String.
blob = flat namespace , Gen2 = directories
Azure Active Directory (Entra ID) : Used to Create 1 Functional ID (secret ) called Serive Principle across all applications to communicate with each other
SP ( serivce Principle) : Managed by User ie., renew etc.,-
Managed identity (service principal) : managed by Azure

Type: structured, semi-structured, or unstructured.
Data stores : File stores ,Databases
file Formats :
- Delimited text files
- JavaScript Object Notation (JSON)
- Extensible Markup Language (XML)
Optimized File Format

Indexes to query data faster, speed up sort operation, and enforce unique constraints.
A DB table each row has rowid and sequence number to identify row
Eg :table = list of pairs (rowid, row) )
Index is created on a seperate table which has opposite relationship: (row, rowid)
SQLite uses B-tree ie., balanced-tree ie., Actual table rows = Index table rows

Mac:

	import concurrent.futures
	import time ,datetime
	start = datetime.datetime.now()
	def do_something(seconds):
	print(f'Sleeping {seconds}')
	time.sleep(seconds)
	return f'Done Sleeping...{seconds}'

	with concurrent.futures.ProcessPoolExecutor() as executor:
	results = executor.map(do_something, [1,1])

	import concurrent.futures
	import time ,datetime
	start = datetime.datetime.now()
	def do_something(seconds):
	print(f'Sleeping {seconds}')
	time.sleep(seconds)
	return f'Done Sleeping...{seconds}'

	with concurrent.futures.ThreadPoolExecutor() as executor:
	results = executor.map(do_something, [1,1])

	#---------------------------
	#Bazel build parent.jar

	#This would add Parent.scala , Child1.scala , Child2.scala in the jar file creatd
	#---------------------------


	load("@io_bazel_rules_scala//scala:scala.bzl", "scala_binary","scala_library")
	package(default_visibility = ["//visibility:public"])