Bug: pod for downloading archive datasets does not support arm64 architecture

[AlessandroPomponio]

What happened: After creating a dataset of type ARCHIVE, I see no content in the pod that mounts the dataset. This is because the download pod fails with

exec /bin/sh: exec format error

What you expected to happen: everything should work

How to reproduce it (as minimally and precisely as possible):

1. Run

   kubectl apply -n dlf -f https://github.com/AlessandroPomponio/datashim/blob/ap_365_readme_updates/examples/minio/minio.yaml

2. Run

   cat <<EOF | kubectl apply -f -
   apiVersion: v1
   kind: Pod
   metadata:
     name: nginx
     labels:
       dataset.0.id: "archive-dataset"
       dataset.0.useas: "mount"
   spec:
     containers:
       - name: nginx
         image: nginx
   EOF

3. Run

   kubectl exec nginx -- ls mnt/datasets/archive-dataset/

Anything else we need to know?:

Environment:

• Datashim version:0.4.0
• Kubernetes version (use kubectl version):
• Kubernetes distribution:
  Client Version: v1.30.0 Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3 Server Version: v1.30.0
• Cloud provider or hardware configuration: Macbook M1, using KIND
• Install tools: helm

[srikumar003]

The function here:

datashim/src/dataset-operator/controllers/archive_handler.go

Line 14 in da435c8

func getPodDataDownload(dataset *datasets.Dataset, operatorNamespace string) (*batchv1.Job, string) {

references a docker image that is not built with multi-arch support. The Dockerfile for that image is here:

datashim/src/cos-uploader/Dockerfile

Line 2 in da435c8

RUN yum update -y && yum install wget tar gzip -y

To fix this issue:

• Update the image building scripts to include the docker image for archive
• Upload the archive docker image to quay.io/datashim-io

[AlessandroPomponio]

Everything seems to have worked https://github.com/datashim-io/datashim/actions/runs/10167107008/job/28122136358
cc @srikumar003

[srikumar003]

Closing this issue