Deepak j-thepac

Kafka

## docker-compose.yml (start kafka Broker and Zookeeper)

    #docker-compose up -d #detach mode
	version: '3'
	services:
 zookeeper:

Dataset : IMDB Movies dataset

Snapshot of the application containing all the libraries , supporting files etc.,

Note :

For JSON file make sure all new lines , blank spaces are removed.
Dataflow , Notebooks etc - names has to start with String.
blob = flat namespace , Gen2 = directories
Azure Active Directory (Entra ID) : Used to Create 1 Functional ID (secret ) called Serive Principle across all applications to communicate with each other
SP ( serivce Principle) : Managed by User ie., renew etc.,-
Managed identity (service principal) : managed by Azure

	from http.client import IncompleteRead
	import requests
	path="/Documents/test.zip"

	with requests.get(url, headers=headers, stream=True) as r:
	with open(path, 'wb') as f:
	while(True):
	try:
	f.write(r.content)
	break


	import scala.concurrent.{Await, Future}
	import scala.concurrent.duration._
	import scala.concurrent.ExecutionContext.Implicits.global
	import java.util.Calendar

	object FutureCleint extends App{

	val start =Calendar.getInstance().getTime.getSeconds
	val fx :String => String = (name:String)=>{

	import concurrent.futures
	import time ,datetime
	start = datetime.datetime.now()
	def do_something(seconds):
	print(f'Sleeping {seconds}')
	time.sleep(seconds)
	return f'Done Sleeping...{seconds}'

	with concurrent.futures.ProcessPoolExecutor() as executor:
	results = executor.map(do_something, [1,1])

	import concurrent.futures
	import time ,datetime
	start = datetime.datetime.now()
	def do_something(seconds):
	print(f'Sleeping {seconds}')
	time.sleep(seconds)
	return f'Done Sleeping...{seconds}'

	with concurrent.futures.ThreadPoolExecutor() as executor:
	results = executor.map(do_something, [1,1])