bluefin-dx
- The Bluefin Developer Experience¶
Bluefin Developer Experience (bluefin-dx
) is a dedicated developer image with bundled tools.
It is designed to meet the following use cases:
- Endeavors to be the world's most powerful cloud native developer environment
- Full virtualization support
- Provide fleet management of Bluefin and other Linux systems via Cockpit (Incomplete)
Instructions¶
You can rebase to bluefin-dx
manually by using the commands on the image page, however there are convenience shortcuts that allow you to freely switch a machine back and forth:
just devmode-on
will switch abluefin
image to abluefin-dx
imagejust devmode-off
will switch abluefin-dx
image back to stockbluefin
Like all Universal Blue images, switching is atomic, allowing for clean switching between modes depending on the use case.
Features¶
Visual Studio Code¶
Visual Studio Code is included on the image to facilitate local development.
JetBrains¶
just jetbrains-toolbox
will fetch and install the JetBrains Toolbox application, which will manage the installation of the JetBrains set of tools. This application will handle installation, removal, and upgrade of the JetBrains products, and is handled completely in your home directory, independent of the operating system image.
Check the Jetbrains documentation for integrating those tools with the podman runtime.
Devpod¶
DevPod is included to provide infrastructure-independent and client-only reproducible developer environments, powered by devcontainers
- Follow Quickstart VS Code to set up your envitronment.
Devbox¶
Nix-powered Development Experience powered by Devbox and Fleek
just nix-devbox
to get startedjust nix-devbox-global
to install a global profile
Containerized Development with Distrobox¶
- Built-in Ubuntu user space
- Ctrl-Alt-u - will launch an Ubuntu image inside a terminal via Distrobox and your home directory will be transparently mounted for the Ubuntu image to access
- A BlackBox terminal is used just for this configuration
- Use this container for your typical CLI needs or to install software that is not available via Flatpak or Fedora
- Optional ubuntu-toolbox image with Python, and other convenience development tools.
just distrobox-bluefin
to get started. To configurejust
follow the guide. - Optional universal image with Python, Node.js, JavaScript, TypeScript, C++, Java, C#, F#, .NET Core, PHP, Go, Ruby, and and Conda.
just distrobox-universal
to get started just assemble
shortcut to declaratively build distroboxes defined in/etc/distrobox/distrobox.ini
- Refer to the Distrobox documentation for more information on using and configuring custom images
- GNOME Terminal - Ctrl-Alt-t - will launch a host-level GNOME Terminal if you need to do host-level things in Fedora (you shouldn't need to do much).
Homebrew¶
just brew
will install homebrew, and just brew-shell
will set it up for you. For Mac enthusiasts out there, we know homebrew is essential. We hope this will encourage you to use Linux for future development.
Kubernetes and other Cloud Native Tooling¶
- kind - Run a Kubernetes cluster on your machine. Run
kind create cluster
on the host to get started! - kubectl - Administer Kubernetes Clusters
- helm, ko, flux, minio-client -- if it's an incubated project we intend to add it where appropriate
Docker Engine¶
The most current Docker Engine is included by default. Use just docker
to turn it on, this will turn on the service and add your users to the docker
group.
Virtualization and Container Runtimes¶
- virt-manager and associated tooling
- Podman and Docker extras
- podman.socket on by default so existing tools expecting a Docker socket work out of the box
- LXC and LXD provide system containers
Machine Learning¶
Bluefin includes a NGC container that includes the latest stable PyTorch from Nvidia on top of Ubuntu LTS. It includes python3
, pip3
, pandas
, matplotlib
, and scikit-learn
.
Note
The additional pip
packages are commonly used but not comprehensive. Only pip
is used and mamba
or conda
are not currently tested.
Pre-requisites¶
You must already be using bluefin-dx-nvidia
as it's meant for those GPUs and has nvidia container toolkit support. If you want to test before downloading the larger nvidia container run nvidia-smi
inside a regular Ubuntu box (distrobox create --nvidia -i ubuntu
) to check that everything works correctly.
To create the box use the following command. Note that this container is large (20+ GB!):
just distrobox-mlbox
To enter the working environment:
distrobox enter mlbox
Then the init-hooks will run once. After which, you should be able to run:
nvidia-smi
To check if GPUs are seen and enter the python repo run:
import torch;torch.cuda.is_available()
Various tests can be run to test a transformers inference or training job, or to git clone a pytorch benchmarks repo and run single or multi gpu commands: E.g. to test multi-gpu setup on two 3090s:
git clone https://github.com/aime-team/pytorch-benchmarks.git
cd pytorch-benchmarks
python3 main.py --num_gpus 2 --compile --model bert-large-uncased --data_name squad --global_batch_size 24
On other operating systems, use this .ini file and run:
distrobox assemble create --file /path/to/your/mlbox.ini
Quality of Life Improvements¶
- Cockpit for local and remote management
- A collection of well curated monospace fonts
- systemd shutdown timers adjusted to 15 seconds
- Tailscale for VPN
- Just task runner for post-install automation tasks. Check out our documentation for more information on using and customizing just.
fish
andzsh
available as optional shells, usejust fish
orjust zsh
and follow the prompts to configure them