gotomypc gotomypc

Guide to build OpenCV from source with GPU support (CUDA and cuDNN)

Feb 22nd, 2022

System specification

Operating system: Ubuntu 20.04 x84_64 (64-bit)
Architecture: amd64
GPU: NVIDIA GeForce RTX 3090
Python 3.8

Install dependencies and recommeneded packages

Instructions for installing TensorFlow Serving on Ubuntu 14.04. I am following the instuctions from here.

Install Bazel

Installation instructions can be found here

If you have a previous version of bazel, and you are trying to do a fresh install then you should remove your old version of bazel. If you installed it through apt, then you can do sudo apt-get purge bazel. If you installed it from source, then you probably have a ~/bin directory with the bazel command, which you should delete, and you probably have a ~/.bazel directory that you should delete. Also check your ~/.bashrc file for any links to ~/.bazel.

Install JDK 8 You'll need the add-apt-repository command, which you can get by doing sudo apt-get install software-properties-common

Tensorflow Serving Tutorial - 01 - Public Inception Model

In this tutorial:

Start with a blank Ubuntu
Install requirements
Download code & pre-tranied inception-v3 model from Google
Export the downloaded "checkpoint" format to a TF Graph that is servable with Tensorflow Model Serving
Query the server with images of a cat and a dog

General Notes

Compiling Tensorflow Serving from source (on docker with their official instructions) produces an internal gcc error (probably specific to tensorflow commit / gcc version used when writing this: tf serving commit: c1ec43508ee57a5d6269116aba82d2a16d383c8a)

I had many driver installed I my virtual machine , so It was actually the reason why I was having the error.

To fix it I had first to remove all driver I have installed before using :

sudo apt-get purge nvidia-*
sudo apt-get update -sudo apt-get autoremove

After that I when a head and installed the latest version of it nvidia driver:

I did :

Detect the audio file volume with ffmpeg.

Require tools

ffmpeg: [Official site][1], [Download][2]

How to use

Download ffmpeg from [link][2]
Extract the ffmpeg.exe from zip package and copy to the directory contain the audio file
Copy the volumeDetect.bat into the folder. (Just make sure the bat file and ffmpeg.exe are in the same directory)
Doulbe click volumeDetect.bat and drag the file into the window.
Press enter and get the result.

Improving SSL Configuration

Documentation:
- NGINX ssl module
- Mozilla’s Server Side TLS Documentation
Add session caching so that fewer SSL handshakes need to be made.
The initial handshake is the most taxing part of the process, and if we can avoid repeating it then we’ll improve our overall performance.
```
$ vim /etc/nginx/conf.d/default.conf
```

ssl_certificate /etc/nginx/ssl/public.pem;

	FROM nvidia/cuda:11.3.1-cudnn8-devel-ubuntu20.04

	ARG PYTHON_VERSION=3.9
	ARG CU_VERSION=11.3
	ARG PYTORCH_VERSION=1.10.2
	ARG TORCHAUDIO_TAG=v0.10.2

	RUN apt update && apt install -y -qq git curl && apt autoremove && apt autoclean

	RUN git clone https://github.com/pytorch/audio.git

	/**
	* HTTPDownloader.hpp
	*
	* A simple C++ wrapper for the libcurl easy API.
	*
	* Written by Uli Köhler (techoverflow.net)
	* Published under CC0 1.0 Universal (public domain)
	*/
	#ifndef HTTPDOWNLOADER_HPP
	#define HTTPDOWNLOADER_HPP

	/*###############################################################################
	#
	# Copyright 2020 NVIDIA Corporation
	#
	# Permission is hereby granted, free of charge, to any person obtaining a copy of
	# this software and associated documentation files (the "Software"), to deal in
	# the Software without restriction, including without limitation the rights to
	# use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of
	# the Software, and to permit persons to whom the Software is furnished to do so,
	# subject to the following conditions:

	export const DEFAULT_ENGINE = 'davinci';
	export const ENGINE_LIST = ['ada', 'babbage', 'curie', 'davinci', 'davinci-instruct-beta', 'curie-instruct-beta'];
	export const ORIGIN = 'https://api.openai.com';
	export const DEFAULT_API_VERSION = 'v1';
	export const DEFAULT_OPEN_AI_URL = `${ORIGIN}/${DEFAULT_API_VERSION}`;