arm2arm

Q: can i login to node? A: Just login to the c4p login node and run "condor_ssh_to_job jobid".

show me an example for snakemake with memory limits: A:

 rule prepare:
    container:
 "astro-ml:latest"

arm2arm

ii  ceph-common                          17.2.6-pve1+3                       amd64        common utilities to mount and interact with a ceph storage cluster
ii  ceph-fuse                            17.2.6-pve1+3                       amd64        FUSE-based client for the Ceph distributed file system
ii  corosync                             3.1.7-pve3                          amd64        cluster engine daemon and utilities
ii  libcephfs2                           17.2.6-pve1+3                       amd64        Ceph distributed file system client library
ii  libcfg7:amd64                        3.1.7-pve3                          amd64        cluster engine CFG library
ii  libcmap4:amd64                       3.1.7-pve3                          amd64        cluster engine CMAP library
ii  libcorosync-common4:amd64            3.1.7-pve3                          amd64        cluster engine common library
ii  libcpg4:amd64                        3.1.7-pve3                          amd64        cluster engine CP

arm2arm

git clone https://github.com/meshcat-dev/meshcat.git
cd meshcat
git fetch origin pull/154/head:pull_154
git switch pull_154

arm2arm

# Import required libraries

import tensorflow as tf

import numpy as np

import matplotlib.pyplot as plt

# Load MNIST dataset

arm2arm

# Import required libraries

import tensorflow as tf

from tensorflow.keras.datasets import cifar10

from sklearn.model_selection import train_test_split

import xgboost as xgb

arm2arm

# Accessing the cluster from outside world
ingress:
  enabled: true
  annotations:
    kubernetes.io/ingress.class: traefik
    traefik.frontend.entryPoints: "http,https"
    ingress.kubernetes.io/ssl-redirect: "false"
  tls:
    self_signed_cert: true

arm2arm

apiVersion: kind.x-k8s.io/v1alpha4
kind: Cluster
nodes:
  - extraPortMappings:
      - containerPort: 30443
        hostPort: 30443
        protocol: TCP
     # START
      - containerPort: 30080
        hostPort: 30080

arm2arm

""" Sample TensorFlow XML-to-TFRecord converter

usage: generate_tfrecord.py [-h] [-x XML_DIR] [-l LABELS_PATH] [-o OUTPUT_PATH] [-i IMAGE_DIR] [-c CSV_PATH]

optional arguments:
  -h, --help            show this help message and exit
  -x XML_DIR, --xml_dir XML_DIR
                        Path to the folder where the input .xml files are stored.
  -l LABELS_PATH, --labels_path LABELS_PATH
                        Path to the labels (.pbtxt) file.

arm2arm

Enviroment:

• gtilab runner working on the debian 10.x VM
• runner requre dind to compile docker images and push them to the local registry

Error:

• All is working only
• Containers with the CentOS 5,6 or debian 8 are failing
• message: ERROR: Job failed: exit code 139
• any operation with syscalls are stopping workers docker container

arm2arm

#!/bin/bash
echo "
# HELP node_ipmi_get_power_watts Power sensor reading from ipmitool
# TYPE node_ipmi_get_power_watts gauge
" > /var/lib/node_exporter/textfile_collector/ipmitool_get_power.prom.$$
/usr/bin/ipmitool  dcmi power reading| grep Instantaneous| awk '{printf"node_ipmi_get_power_watts{sensor=\"PW Consumption\"} %d\n",$4}' >>  /var/lib/node_exporter/textfile_collector/ipmitool_power.prom.$$
/usr/bin/mv /var/lib/node_exporter/textfile_collector/ipmitool_power.prom.$$ /var/lib/node_exporter/textfile_collector/ipmitool_get_power.prom