Skip to content

Instantly share code, notes, and snippets.

@virtualdvid
Created January 15, 2019 19:25
Show Gist options
  • Save virtualdvid/cafa5e4e4917b2c6cc7b90526f48ca53 to your computer and use it in GitHub Desktop.
Save virtualdvid/cafa5e4e4917b2c6cc7b90526f48ca53 to your computer and use it in GitHub Desktop.
Keras: Flow from directory with Augmentation
print("Keras: Flow from directory with Augmentation")
start_mem = psutil.virtual_memory().used
start_time = time.time()
datagen = ImageDataGenerator(rotation_range=30, rescale=1./255)
train_generator = datagen.flow_from_directory('flowers', target_size=(128,128), batch_size=32)
print("PRE-TIME", time.time() - start_time)
start_time = time.time()
step = 0
for x_batch, y_batch in train_generator:
step += 1
if step > STEPS: break
print("TIME", time.time() - start_time)
curr_mem = psutil.virtual_memory().used
print("Memory Used: %.2f GB" % ((curr_mem - start_mem) / GB))
# Release unused memory
dataset = None
gc.collect()
time.sleep(5)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment