How To Create a New Linux VM With NVIDIA Virtual GPU in the OpenStack Dashboard Horizon on CloudFerro Cloud

You can create Linux virtual machine with NVIDIA RTX A6000 as the additional graphics card. The card contains

  • 10,752 CUDA cores for rendering, graphics operations and heavy parallel computations,

  • 336 Tensor cores which accelerate AI and data science model training, while

  • 84 RT cores speed up ray tracing with shading or denoising, photorealistic rendering and so on.

There are four variants, using 6, 12, 24, or 48 GB of VGPU RAM. You will be able to select the particular model by choosing a proper flavor when creating the instance in Horizon (see below).

What We Are Going To Cover

  • How to create an instance with NVIDIA support

  • How to choose the proper flavor for the data in hand

  • How to add proper keypair in order to

  • SSH into the virtual machine you create, or

  • use the console within Horizon interface and

  • verify that you are using the NVIDIA vGPU.

Step 1 Create New Instance with NVIDIA Image Support

To define a new instance, use the following series of commands:

Project → Compute → Instances.

../_images/compute_instances.png

Click Launch Instance to get the following screen:

../_images/launch_instance.png

Insert the name of the instance (eg. “vm_with_vgpu”) and click Next button. In the next screen, you will choose the operating system for the new virtual machine you are defining:

../_images/choose_os.png

Your goal is to use an image with predefinced NVIDIA support. To list all such images, click on field Available and enter ‘NVIDIA’ into it. Only the images with NVIDIA in their names will be listed:

../_images/nvidia_chosen_cloudferro_cloud.png

Select Instance Boot Source (eg. “Image”), and choose desired image (eg. “Ubuntu 20.04 NVIDIA”) by clicking on arrow.

Images marked with “NVIDIA” are fully operational. They come preinstalled with

  • special NVIDIA Grid drivers

  • a licence token, as well as

  • the CUDA library.

Note

If you do not need to have the system disk bigger than the size defined in a chosen flavor, we recommend setting “Create New Volume” feature to “No” state.

Click on the Next button and get to the following screen:

../_images/createnew18.png

You will now choose one of the four models of the RTX A6000 card.

Step 2 Select Card Model / Flavor

The four available: RTXA6000-6C, RTXA6000-12C, RTXA6000-24C, and RTXA6000-48C, are described in this table:

../_images/createnew16.png

The column VM Name contains flavor names vm.a6000.1, vm.a6000.2, vm.a6000.4, vm.a6000.8. Again, type a6000 into the field Available and list only the NVIDIA flavors:

../_images/createnew19.png

Taking into account the data from the table above, if you select flavor vm.a6000.2, you will use 4 virtual cores and 28 GB of “normal” RAM, and simultaneously, you will also choose the RTXA6000-12C model with 12 GB of virtual GPU RAM.

Note

Yellow triangles in the listing mean that you cannot select that row as one of the system resources is already engaged to other instances. If you, say, wanted to select the strongest flavor of NVIDIA, vm.a6000.8, you would first have to obtain 112 GB or more of available of RAM and only then be able to opt for that flavor.

In the situation above, select vm.a6000.2 and continue going through the usual motions of selecting instance elements to finish the procedure.

Step 3 Finish Creating the Instance

Click “Networks” and then choose desired networks.

../_images/networks5.png

Open “Security Groups” After that, choose “allow_ping_ssh_icmp_rdp” and “default”.

../_images/createnew6.png

Choose or generate SSH keypair, as explained in article How to create key pair in OpenStack Dashboard on CloudFerro Cloud for your VM. Next, launch your instance by clicking on blue button.

../_images/createnew7.png

You will see “Instances” menu with your newly created VM.

../_images/createnew8.png

Note

If you want to make your VM accessible from the Internet, see this article: How to Add or Remove Floating IP’s to your VM on CloudFerro Cloud

Step 4 Issue Commands from the Console

Open the drop-down menu and choose “Console”.

../_images/createnew9.png

You can connect to your virtual machine using SSH, see this article: How to connect to your virtual machine via SSH in Linux on CloudFerro Cloud

You can also use the SPICE console using the Openstack Dashboard.

Click on the black terminal area (to activate access to the console). Type:

eoconsole

and hit Enter on the keyboard.

../_images/createnew10.png

Insert and retype new password.

../_images/createnew11.png

Now you can type commands.

../_images/createnew12.png

To check the status of the vGPU device, enter the command:

nvidia-smi
../_images/createnew13.png

After you finish, type “exit”.

exit
../_images/createnew14.png

This will close the session.