Skip to content

Instantly share code, notes, and snippets.

View mengdong's full-sized avatar

Dong Meng mengdong

53 followers · 29 following
View GitHub Profile
@mengdong
mengdong / analyze_dataset_op.py
Last active October 28, 2021 20:44 — forked from leiterenato/analyze_dataset_op.py
Fit 1 parquet file from Criteo
if __name__ == "__main__":
parquet_dataset = "dongm-debug"
n_workers = 4
device_limit_frac = 0.8
device_pool_frac = 0.9
part_mem_frac = 0.125
import etl
import logging
import os
@mengdong
mengdong / build-tensorflow-from-source.md
Created January 31, 2019 23:51 — forked from Brainiarc7/build-tensorflow-from-source.md
Build Tensorflow from source, for better performance on Ubuntu.

Building Tensorflow from source on Ubuntu 16.04LTS for maximum performance:

TensorFlow is now distributed under an Apache v2 open source license on GitHub.

On Ubuntu 16.04LTS+:

Step 1. Install NVIDIA CUDA:

To use TensorFlow with NVIDIA GPUs, the first step is to install the CUDA Toolkit as shown: