Skip to content

Instantly share code, notes, and snippets.

View dardanxhymshiti's full-sized avatar
🤓
That tall guy who codes!

DardanX dardanxhymshiti

🤓
That tall guy who codes!
View GitHub Profile
Abyssinian, Abyssinian Cat, American Bobtail, American Bobtail Cat Breed, American Curl, American Curl Cat Breed, American Shorthair, American Shorthair Cat, American Wirehair, American Wirehair Cat Breed,
Balinese-Javanese Cat Breed, Bengal, Bengal Cat, Birman, Birman Cat Breed, Bombay, Bombay Cat, British Shorthair, British Shorthair Cat Breed,
Burmese, Burmese Cat, Chartreux, Chartreux Cat Breed, Cornish Rex, Cornish Rex Cat Breed, Devon Rex, Devon Rex Cat Breed, Egyptian Mau,
Egyptian Mau Cat, European Burmese, European Burmese Cat Breed, Exotic Shorthair, Exotic Shorthair Cat Breed, Havana Brown, Havana Brown Cat Breed, Himalayan, Himalayan Cat Breed,
Japanese Bobtail, Japanese Bobtail Cat Breed, Korat, Korat Cat Breed, LaPerm, LaPerm Cat, Maine Coon, Maine Coon Cat Breed, Manx,
Manx Cat, Norwegian Forest Cat, Norwegian Forest Cat Breed, Ocicat, Ocicat Cat Breed, Oriental, Oriental Cat Breed, Persian, Persian Cat Breed,
Peterbald, Peterbald Cat Breed, Pixiebob, Pixiebob Cat Breed, Ragamuffin, Ragam
Isaac Newton, Leonhard Euler, Gottfried Von Leibniz, Carl Friedrich Gauss, Michael Faraday, Euclid Of Alexandria, Galileo Galilei, Nikola Tesla, Marie Sklodowska-Curie, Albert Einstein, Alhazen Ibn Alhaytham,
Louis Pasteur, Johannes Kepler, Liu Hui, Max Planck, Augustinlouis Cauchy, James Clerk Maxwell, Avicenna Of Persia, Amedeo Avogadro, Dmitri Mendeleev , Robert Koch,
Ernest Rutherford, Nicolaus Copernicus, Georg Bernhard Riemann, Zhang Heng, Blaise Pascal, Muhammad Ibn Musa Alkhwarizmi, Jules Henri Poincaré, Abu Rayhan Albiruni, Isambard Kingdom Brunel, Claudius Galen Of Pergamon,
Josephlouis Lagrange, Qin Jiushao, Paul Ehrlich, Archimedes Of Syracuse, Nasir Aldin Altusi, Robert Boyle, Pierresimon Laplace, Zhu Shijie, Wernher Von Braun, Henri Becquerel,
David Hilbert, Niels Bohr, Srinivasa Ramanujan, Gregor Mendel, Amelie Emmy Noether, Antoine Lavoisier, Brahmagupta, Edward Jenner, Pierre De Fermat, Zu Chongzhi,
James Watt, René Descartes, John Von Neumann, Omar Alkhayyam, Hermann Von Helmholtz, Robe
The Godfather, The Lord of the Rings: The Return of the King, Inception, The Lord of the Rings: The Fellowship of the Ring, The Matrix, The Lord of the Rings: The Two Towers, Star Wars: Episode V - The Empire Strikes Back, Léon: The Professional, Gladiator, Terminator 2: Judgment Day, Avengers: Endgame,
Braveheart, Toy Story, Aliens, Batman Begins, Indiana Jones and the Last Crusade, The Avengers, Beauty and the Beast, The Sound of Music, Iron Man, Star Trek,
Avatar, Titanic, Lost in Translation, Home Alone, Batman, King Kong, The Shawshank Redemption, The Godfather: Part II, Pulp Fiction, Schindler's List,
Forrest Gump, One Flew Over the Cuckoo's Nest, Star Wars: Episode IV - A New Hope, It's a Wonderful Life, The Prestige, Back to the Future, The Lion King, Avengers: Infinity War, Psycho, Casablanca,
City Lights, The Dark Knight Rises, Django Unchained, WALL·E, Raiders of the Lost Ark, Rear Window, Coco, Star Wars: Episode VI - Return of the Jedi, Toy Story 3, Full Metal Jacket,
North by Northwest, Sin
Ant-Man, Aquaman, Asterix, The Atom,
Batgirl, Batman, Batwoman,
Black Panther, Captain Marvel, Catwoman,
Daredevil, The Defenders, Doc Savage,
Elektra, Fantastic Four, Green Arrow,
Guardians Of The Galaxy, Hawkeye, Hellboy,
Iron Fist, Iron Man, Marvelman,
The Shadow, Spider-Man, Sub-Mariner,
Superman, Teenage Mutant Ninja Turtles, Thor,
Wolverine, Wonder Woman, X-Men, Zatara
Toyota, Honda, Chevrolet, Ford, Mercedes-Benz,
Jeep, BMW, Porsche, Subaru, Nissan, Volkswagen,
Lexus, Audi, Ferrari, Volvo, Jaguar, GMC,
Buick, Acura, Dodge, Hyundai,
Lincoln, Mazda, Land Rover, Tesla,
Kia, Chrysler, Pontiac, Mitsubishi,
Oldsmobile, Maserati, Aston Martin, Bugatti,
Fiat, Mini, Alfa-Romeo, Saab,
Suzuki, Studebaker, Renault, Peugeot,
Daewoo, Hudson, Citroen, MG
Hydrogen, Helium, Lithium, Beryllium, Boron, Carbon, Nitrogen, Oxygen, Fluorine, Neon, Sodium, Magnesium,
Aluminum, Silicon, Phosphorus, Sulfur, Chlorine, Argon, Potassium, Calcium, Scandium, Titanium, Vanadium,
Chromium, Manganese, Iron, Cobalt, Nickel, Copper, Zinc, Gallium, Germanium, Arsenic, Selenium,
Bromine, Krypton, Rubidium, Strontium, Yttrium, Zirconium, Niobium, Molybdenum, Technetium, Ruthenium, Rhodium,
Palladium, Silver, Cadmium, Indium, Tin, Antimony, Tellurium, Iodine, Xenon, Cesium, Barium,
Lanthanum, Cerium, Praseodymium, Neodymium, Promethium, Samarium, Europium, Gadolinium, Terbium, Dysprosium, Holmium,
Erbium, Thulium, Ytterbium, Lutetium, Hafnium, Tantalum, Tungsten, Rhenium, Osmium, Iridium, Platinum,
Gold, Mercury, Thallium, Lead, Bismuth, Polonium, Astatine, Radon, Francium, Radium, Actinium,
Thorium, Protactinium, Uranium, Neptunium, Plutonium, Americium, Curium, Berkelium, Californium, Einsteinium, Fermium,
Mendelevium, Nobelium, Lawrencium, Rutherfordium, Dubnium, Seaborgi
list_of_fruits = ['apple', 'orange', 'pear', 'cherry', 'banana']
list_of_scores = [80, 98, 50, 55, 100]
tuple_of_person_info = ('John', 'Doe', 20, 'Denver', 'Colorado')
tuple_of_car_info = ('BMW', 'X5', 5000, 'Black', True)
import ast
import sys
from module_seed.run import run
if __name__ == '__main__':
str_parameters = sys.argv[1]
parameters = ast.literal_eval(str_parameters)
run(parameters)
from module_seed.jobs import \
job_one_seed,\
job_two_seed
from module_seed.utils.logger_utils import get_logger
from module_seed.utils.spark_utils import create_spark_session
jobs = {
'job_one_seed': job_one_seed.process,
'job_two_seed': job_two_seed.process
def process(spark, input_path, output_path, save_mode='append'):
# read data
df = spark.read.parquet(input_path)
# processing
pass
# output
df.write.parquet(output_path, save_mode=save_mode)