You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The secure and correct way to communicate with non-public services on a virtual server machine is via ssh tunnel
(services like managment console or a database).
To create a simple ssh tunnel from your host machine to the server on the same port number:
Rocky Linux 9 | Web Application Server Installation
Notice
This cheatsheet assumes the user is knowledgeable about bare installations of virtual private servers on cloud providers and is looking for quick but comprehensive instructions.
Some trivial commands might be missed or skipped.
However, this document can also work as quick tutorial for newcomers to the RHEL eco-system.
Rocky Linux 9 server instructions for enthusiastic people who wish to run or train the LLaMA 3.1 models using HuggingFace.
Rocky Linux 9 | Chatbot Edition (Llama 3.1)
The following was tested on Google GCP utilizing an a2-highgpu-1g instance and Rocky Linux 9 image (GCP optimized x86_64).
It has 192 RAM, 48 vCPU cores, and 4 Nvidia L4 24GB GPU attached in grid.
Recommended taking 384GB SSD disk or larger depending on the workload type.
NOTICE: Make sure you have positive bank balance before trying.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Rocky Linux 8 - Web Application Server Installation Guide
Notice
This cheatsheet assumes the user is knowledgeable about bare installations of virtual private servers on cloud providers and is looking for quick but comprehensive instructions.
Some trivial commands might be missed or skipped.
However, this document can also work as quick tutorial for newcomers to the RHEL eco-system.
Also, I would like to promote Rocky Linux as a solid alternative for enterprise systems. Machines with Rocky Linux are provided by DigitalOcean a great and super stable cloud provider I've been using for years. All the following servers/services can be installed and run stable on a 1CPU/2GB/50GB, 2CPU/2GB/50GB or 2CPU/4GB/50GB droplets (choose by your load).