From 13b0915be401f4efc8984742f6cce744046493af Mon Sep 17 00:00:00 2001 From: eordentlich Date: Thu, 8 Aug 2024 10:35:24 -0700 Subject: [PATCH] remove criteo DL example since dependencies (horovod, nvtabular) are not being updated (#421) Signed-off-by: Erik Ordentlich --- README.md | 3 +- .../Spark-DL/criteo_train/Dockerfile | 229 - .../Spark-DL/criteo_train/Dockerfile.conda_db | 78 - .../Spark-DL/criteo_train/README.md | 101 - .../Spark-DL/criteo_train/create-conda-env.sh | 29 - .../Spark-DL/criteo_train/criteo_keras.py | 309 - .../Spark-DL/criteo_train/environment.yml | 30 - .../notebooks/Criteo-Training.ipynb | 12675 ---------------- .../sample_data/dimensions/._SUCCESS.crc | Bin 8 -> 0 bytes ...d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv.crc | Bin 12 -> 0 bytes .../sample_data/dimensions/_SUCCESS | 0 ...e973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv | 2 - .../sample_data/test_small/._SUCCESS.crc | Bin 8 -> 0 bytes ...-a883-b21c9328bf3f-c000.snappy.parquet.crc | Bin 784 -> 0 bytes .../sample_data/test_small/_SUCCESS | 0 ...4cb1-a883-b21c9328bf3f-c000.snappy.parquet | Bin 99248 -> 0 bytes .../sample_data/train_small/._SUCCESS.crc | Bin 8 -> 0 bytes ...-9935-e969a5a05f34-c000.snappy.parquet.crc | Bin 1408 -> 0 bytes .../sample_data/train_small/_SUCCESS | 0 ...4e03-9935-e969a5a05f34-c000.snappy.parquet | Bin 178767 -> 0 bytes .../sample_data/val_small/._SUCCESS.crc | Bin 8 -> 0 bytes ...-96cc-2f5cdbaa6177-c000.snappy.parquet.crc | Bin 748 -> 0 bytes .../sample_data/val_small/_SUCCESS | 0 ...4c66-96cc-2f5cdbaa6177-c000.snappy.parquet | Bin 94528 -> 0 bytes .../Spark-DL/criteo_train/spark-env.sh | 2 - .../Spark-DL/criteo_train/start-spark.sh | 2 - .../Spark-DL/criteo_train/submit.sh | 27 - 27 files changed, 1 insertion(+), 13486 deletions(-) delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile.conda_db delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/README.md delete mode 100755 examples/ML+DL-Examples/Spark-DL/criteo_train/create-conda-env.sh delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/criteo_keras.py delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/environment.yml delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/notebooks/Criteo-Training.ipynb delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/._SUCCESS.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/.part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/_SUCCESS delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/._SUCCESS.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/.part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/_SUCCESS delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/._SUCCESS.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/.part-00000-b14c1424-bac6-4e03-9935-e969a5a05f34-c000.snappy.parquet.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/_SUCCESS delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/part-00000-b14c1424-bac6-4e03-9935-e969a5a05f34-c000.snappy.parquet delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/._SUCCESS.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/.part-00000-d22ab04e-dacf-4c66-96cc-2f5cdbaa6177-c000.snappy.parquet.crc delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/_SUCCESS delete mode 100644 examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/part-00000-d22ab04e-dacf-4c66-96cc-2f5cdbaa6177-c000.snappy.parquet delete mode 100755 examples/ML+DL-Examples/Spark-DL/criteo_train/spark-env.sh delete mode 100755 examples/ML+DL-Examples/Spark-DL/criteo_train/start-spark.sh delete mode 100755 examples/ML+DL-Examples/Spark-DL/criteo_train/submit.sh diff --git a/README.md b/README.md index 549a2230c..0a3e9c704 100644 --- a/README.md +++ b/README.md @@ -23,8 +23,7 @@ Here is the list of notebooks in this repo: | 3 | XGBoost | Agaricus (Scala) | Uses XGBoost classifier function to create model that can accurately differentiate between edible and poisonous mushrooms with the [agaricus dataset](https://archive.ics.uci.edu/ml/datasets/mushroom) | 4 | XGBoost | Mortgage (Scala) | End-to-end ETL + XGBoost example to predict mortgage default with [Fannie Mae Single-Family Loan Performance Data](https://capitalmarkets.fanniemae.com/credit-risk-transfer/single-family-credit-risk-transfer/fannie-mae-single-family-loan-performance-data) | 5 | XGBoost | Taxi (Scala) | End-to-end ETL + XGBoost example to predict taxi trip fare amount with [NYC taxi trips data set](https://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page) -| 6 | ML/DL | Criteo Training | ETL and deep learning training of the Criteo 1TB Click Logs dataset -| 7 | ML/DL | PCA End-to-End | Spark MLlib based PCA example to train and transform with a synthetic dataset +| 6 | ML/DL | PCA End-to-End | Spark MLlib based PCA example to train and transform with a synthetic dataset Here is the list of Apache Spark applications (Scala and PySpark) that can be built for running on GPU with RAPIDS Accelerator in this repo: diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile b/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile deleted file mode 100644 index 0e56925b1..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile +++ /dev/null @@ -1,229 +0,0 @@ -# -# Copyright (c) 2021, NVIDIA CORPORATION. All rights reserved. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -ARG IMAGE=nvcr.io/nvidia/tensorflow:21.03-tf2-py3 -FROM ${IMAGE} -ENV CUDA_SHORT_VERSION=11.2 - -SHELL ["/bin/bash", "-c"] -ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib - -ENV DEBIAN_FRONTEND=noninteractive - -ARG RELEASE=true -ARG RMM_VER=v21.10.00 -ARG CUDF_VER=v21.10.00 -ARG NVTAB_VER=v0.6.0 -ARG SM="60;61;70;75;80" - -ENV CUDA_HOME=/usr/local/cuda -ENV CUDA_PATH=$CUDA_HOME -ENV CUDA_CUDA_LIBRARY=${CUDA_HOME}/lib64/stubs -ENV PATH=${CUDA_HOME}/lib64/:${PATH}:${CUDA_HOME}/bin - -# Build env variables for rmm -ENV INSTALL_PREFIX=/usr - -RUN apt update -y --fix-missing && \ - apt upgrade -y && \ - apt install -y --no-install-recommends software-properties-common && \ - apt update -y --fix-missing - -RUN apt install -y --no-install-recommends \ - git \ - libboost-all-dev \ - python3.8-dev \ - build-essential \ - autoconf \ - bison \ - flex \ - libboost-filesystem-dev \ - libboost-system-dev \ - libboost-regex-dev \ - libjemalloc-dev \ - wget \ - libssl-dev \ - protobuf-compiler \ - clang-format \ - aptitude \ - numactl \ - libnuma-dev \ - libaio-dev \ - libibverbs-dev \ - libtool && \ - apt-get autoremove -y && \ - apt-get clean && \ - rm -rf /var/lib/apt/lists/* - #update-alternatives --install /usr/bin/python python /usr/bin/python3.8 1 && \ - #wget https://bootstrap.pypa.io/get-pip.py && \ - #python get-pip.py - -# Install cmake -RUN wget -O - https://apt.kitware.com/keys/kitware-archive-latest.asc 2>/dev/null | gpg --dearmor - | tee /etc/apt/trusted.gpg.d/kitware.gpg >/dev/null && \ - apt-add-repository 'deb https://apt.kitware.com/ubuntu/ focal main' && \ - apt-get update && \ - apt-get install -y cmake - -# Install arrow from source -ENV ARROW_HOME=/usr/local -RUN git clone --branch apache-arrow-4.0.1 --recurse-submodules https://github.com/apache/arrow.git build-env && \ - pushd build-env && \ - export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data" && \ - export ARROW_TEST_DATA="${PWD}/testing/data" && \ - pip install -r python/requirements-build.txt && \ - mkdir cpp/release && \ - pushd cpp/release && \ - cmake -DCMAKE_INSTALL_PREFIX=${ARROW_HOME} \ - -DCMAKE_INSTALL_LIBDIR=lib \ - -DCMAKE_LIBRARY_PATH=${CUDA_CUDA_LIBRARY} \ - -DARROW_FLIGHT=ON \ - -DARROW_GANDIVA=OFF \ - -DARROW_ORC=ON \ - -DARROW_WITH_BZ2=ON \ - -DARROW_WITH_ZLIB=ON \ - -DARROW_WITH_ZSTD=ON \ - -DARROW_WITH_LZ4=ON \ - -DARROW_WITH_SNAPPY=ON \ - -DARROW_WITH_BROTLI=ON \ - -DARROW_PARQUET=ON \ - -DARROW_PYTHON=ON \ - -DARROW_PLASMA=ON \ - -DARROW_BUILD_TESTS=ON \ - -DARROW_CUDA=ON \ - -DARROW_DATASET=ON \ - .. && \ - make -j$(nproc) && \ - make install && \ - popd && \ - pushd python && \ - export PYARROW_WITH_PARQUET=ON && \ - export PYARROW_WITH_CUDA=ON && \ - export PYARROW_WITH_ORC=ON && \ - export PYARROW_WITH_DATASET=ON && \ - python setup.py build_ext --build-type=release bdist_wheel && \ - pip install dist/*.whl && \ - popd && \ - popd && \ - rm -rf build-env - - -# Install rmm from source -RUN git clone https://github.com/rapidsai/rmm.git build-env && cd build-env/ && \ - if [ "$RELEASE" == "true" ] && [ ${RMM_VER} != "vnightly" ] ; then git fetch --all --tags && git checkout tags/${RMM_VER}; else git checkout main; fi; \ - sed -i '/11.2/ a "11.4": "11.x",' python/setup.py && \ - cd ..; \ - pushd build-env && \ - ./build.sh librmm && \ - pip install python/. && \ - popd && \ - rm -rf build-env - - - -# Build env for CUDF build -RUN git clone https://github.com/rapidsai/cudf.git build-env && cd build-env/ && \ - if [ "$RELEASE" == "true" ] && [ ${CUDF_VER} != "vnightly" ] ; then git fetch --all --tags && git checkout tags/${CUDF_VER}; else git checkout main; fi; \ - git submodule update --init --recursive && \ - cd .. && \ - pushd build-env && \ - export CUDF_HOME=${PWD} && \ - export CUDF_ROOT=${PWD}/cpp/build/ && \ - export CMAKE_LIBRARY_PATH=${CUDA_CUDA_LIBRARY} && \ - ./build.sh libcudf cudf dask_cudf && \ - protoc -I=python/cudf/cudf/utils/metadata --python_out=/usr/local/lib/python3.8/dist-packages/cudf/utils/metadata python/cudf/cudf/utils/metadata/orc_column_statistics.proto && \ - popd && \ - rm -rf build-env - -RUN apt-get update -y && \ - DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends \ - vim gdb git wget unzip tar python3.8-dev \ - zlib1g-dev lsb-release clang-format libboost-all-dev \ - openssl curl zip\ - slapd && \ - rm -rf /var/lib/apt/lists/* - -ENV PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION='python' - - -RUN pip install pandas sklearn ortools nvtx-plugins pydot && \ - pip cache purge - -# tf-nightly for performance test -# more details: https://github.com/tensorflow/tensorflow/issues/44194 -RUN pip uninstall tensorflow -y; pip install tf-nightly==2.7.0.dev20210722 -RUN pip uninstall keras-nightly -y; pip install keras-nightly==2.7.0.dev2021072200 - - -RUN mkdir -p /usr/local/nvidia/lib64 && \ - ln -s /usr/local/cuda/lib64/libcusolver.so /usr/local/nvidia/lib64/libcusolver.so.10 - -RUN pip install pybind11 -SHELL ["/bin/bash", "-c"] - -# prepare nccl -RUN apt remove -y libnccl2 libnccl-dev -RUN wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-ubuntu2004.pin \ - && mv cuda-ubuntu2004.pin /etc/apt/preferences.d/cuda-repository-pin-600 \ - && apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/7fa2af80.pub \ - && add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/ /" \ - && apt-get update \ - && apt install libnccl2=2.8.4-1+cuda11.2 libnccl-dev=2.8.4-1+cuda11.2 - -# install Horovod -RUN pip uninstall horovod -y -RUN HOROVOD_WITH_MPI=1 HOROVOD_WITH_TENSORFLOW=1 HOROVOD_GPU_OPERATIONS=NCCL \ - pip install horovod[spark] --no-cache-dir - -# Install NVTabular -RUN git clone https://github.com/NVIDIA/NVTabular.git /nvtabular/ && \ - cd /nvtabular/; if [ "$RELEASE" == "true" ] && [ ${NVTAB_VER} != "vnightly" ] ; then git fetch --all --tags && git checkout tags/${NVTAB_VER}; else git checkout main; fi; \ - python setup.py develop --user; - - -RUN pip install pynvml pytest graphviz sklearn scipy matplotlib -RUN pip install nvidia-pyindex; pip install tritonclient[all] grpcio-channelz -RUN pip install nvtx mpi4py==3.0.3 cupy-cuda112 cachetools typing_extensions fastavro - -RUN apt-get update; apt-get install -y graphviz - -RUN pip uninstall numpy -y; pip install numpy -RUN pip install dask==2021.04.1 distributed==2021.04.1 dask-cuda -RUN pip install dask[dataframe]==2021.04.1 -RUN pip uninstall pandas -y; pip install pandas==1.1.5 -RUN echo $(du -h --max-depth=1 /) - - -# install spark-3.1.2-bin-hadoop3.2 -RUN wget \ - https://mirror-hk.koddos.net/apache/spark/spark-3.1.2/spark-3.1.2-bin-hadoop3.2.tgz \ - && tar -xzf spark-3.1.2-bin-hadoop3.2.tgz -C /opt/ \ - && rm spark-3.1.2-bin-hadoop3.2.tgz - -ENV DEBIAN_FRONTEND=noninteractive -RUN apt-get install openjdk-8-jdk openjdk-8-jre lsb-release -y --allow-downgrades --allow-change-held-packages --no-install-recommends -ENV JAVA_HOME /usr/lib/jvm/java-1.8.0-openjdk-amd64 -ENV PATH $PATH:/usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin:/usr/lib/jvm/java-1.8.0-openjdk-amd64/bin - -# add spark env to conf -ADD spark-env.sh /opt/spark-3.1.2-bin-hadoop3.2/conf/ - -ADD start-spark.sh /workspace/ -ADD submit.sh /workspace/ -ADD criteo_keras.py /workspace/ - -HEALTHCHECK NONE -ENTRYPOINT [] -CMD ["/bin/bash"] diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile.conda_db b/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile.conda_db deleted file mode 100644 index 475b99149..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/Dockerfile.conda_db +++ /dev/null @@ -1,78 +0,0 @@ -# -# Copyright (c) 2022, NVIDIA CORPORATION. All rights reserved. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# -FROM nvidia/cuda:11.4.3-cudnn8-devel-ubuntu20.04 - -ENV DEBIAN_FRONTEND=noninteractive -# Disable NVIDIA repos to prevent accidental upgrades. -RUN cd /etc/apt/sources.list.d && \ - mv cuda.list cuda.list.disabled - -# See https://github.com/databricks/containers/blob/master/ubuntu/minimal/Dockerfile -RUN apt-get update && \ - apt-get install --yes --no-install-recommends \ - openjdk-8-jdk \ - openjdk-8-jre \ - lsb-release \ - iproute2 \ - bash \ - sudo \ - coreutils \ - procps \ - wget && \ - /var/lib/dpkg/info/ca-certificates-java.postinst configure && \ - rm -rf /var/lib/apt/lists/* - - -ENV PATH /databricks/conda/bin:$PATH - -RUN wget -q https://repo.continuum.io/miniconda/Miniconda3-py38_4.9.2-Linux-x86_64.sh -O miniconda.sh && \ - bash miniconda.sh -b -p /databricks/conda && \ - rm miniconda.sh && \ - # Source conda.sh for all login and interactive shells. - ln -s /databricks/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh && \ - echo ". /etc/profile.d/conda.sh" >> ~/.bashrc && \ - # Set always_yes for non-interactive shells. - conda config --system --set always_yes True && \ - conda clean --all - -# install openjdk8, cmake, openmpi openmpi-mpicc -RUN conda install cmake openmpi openmpi-mpicc -y -ENV JAVA_HOME /usr/lib/jvm/java-1.8.0-openjdk-amd64 -ENV PATH $PATH:/usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin:/usr/lib/jvm/java-1.8.0-openjdk-amd64/bin - -RUN conda install -y -c nvidia -c rapidsai -c numba -c conda-forge nvtabular=1.2.2 python=3.8 cudatoolkit=11.4 scikit-learn - -RUN pip uninstall tensorflow -y; pip install tensorflow-gpu==2.8 -RUN pip install torch==1.11.0+cu115 torchvision==0.12.0+cu115 torchaudio===0.11.0+cu115 -f https://download.pytorch.org/whl/cu115/torch_stable.html -RUN rm -rf /databricks/conda/include/google -RUN HOROVOD_WITH_MPI=1 HOROVOD_GPU_OPERATIONS=NCCL HOROVOD_WITH_TENSORFLOW=1 HOROVOD_WITH_PYTORCH=1 \ - pip install horovod[spark] --no-cache-dir -RUN pip install pynvml jupyter matplotlib - - -RUN apt-get update && apt-get install wget openssh-client openssh-server \ - -y --allow-downgrades --allow-change-held-packages --no-install-recommends -RUN useradd --create-home --shell /bin/bash --groups sudo ubuntu - -ENV PYSPARK_PYTHON=/databricks/conda/bin/python -ENV USER root -ENV DEFAULT_DATABRICKS_ROOT_CONDA_ENV=base -ENV DATABRICKS_ROOT_CONDA_ENV=base -# disable gds due to errors -ENV LIBCUDF_CUFILE_POLICY=OFF -# required by DB -RUN pip install virtualenv -RUN pip install adlfs diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/README.md b/examples/ML+DL-Examples/Spark-DL/criteo_train/README.md deleted file mode 100644 index 083894055..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/README.md +++ /dev/null @@ -1,101 +0,0 @@ -# Criteo - -ETL and deep learning training of the Criteo 1TB Click Logs dataset. Users can prepare their dataset accordingly. - -_Please note: The following demo is dedicated for DGX-2 machine(with V100 GPUs)._ We optimized the whole workflow on DGX-2 and it's not guaranteed that it can run successfully on other type of machines. - -## Dataset - -The dataset used here is from Criteo clicklog dataset. -It's preprocessed by [DLRM](https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow2/Recommendation/DLRM_and_DCNv2/preproc) -ETL job on Spark. We also provide a small size sample data in sample_data folder. -All 40 columns(1 label + 39 features) are already numeric. - -In the following parts, we assume that the data are mounted as docker volumn at `/data/parquet` - -## Run Criteo example benchmark using Dockerfile - -1. Build the docker image -``` -nvidia-docker build -f Dockerfile -t nvspark/tf-hvd-train:0.1 . -``` - -2. Enter into it (also mount necessary dataset volume and devices) -``` - nvidia-docker run \ - --network host \ - --device /dev/infiniband \ - --privileged \ - -v /raid/spark-team/criteo/parquet:/data/parquet \ - -it nvspark/tf-hvd-train:0.1 bash -``` - -3. when you are inside the container -``` -cd /workspace -# start standalone Spark -./start-spark.sh - -# start training -./submit.sh -``` - -## Notebook demo - -We also provide a Notebook demo for quick test, user can set it up by the following command: - -```bash -SPARK_HOME= $PATH_TO_SPARK_HOME -SPARK_URL=spark://$SPARK_MASTER_IP:7077 -export PYSPARK_DRIVER_PYTHON=jupyter -export PYSPARK_DRIVER_PYTHON_OPTS='notebook' - -$SPARK_HOME/bin/pyspark --master $SPARK_URL --deploy-mode client \ ---driver-memory 20G \ ---executor-memory 50G \ ---executor-cores 6 \ ---conf spark.cores.max=96 \ ---conf spark.task.cpus=6 \ ---conf spark.locality.wait=0 \ ---conf spark.yarn.maxAppAttempts=1 \ ---conf spark.sql.shuffle.partitions=4 \ ---conf spark.sql.files.maxPartitionBytes=1024m \ ---conf spark.sql.warehouse.dir=$OUT \ ---conf spark.task.resource.gpu.amount=0.08 \ ---conf spark.executor.resource.gpu.amount=1 \ ---conf spark.executor.resource.gpu.discoveryScript=./getGpusResources.sh \ ---files $SPARK_HOME/examples/src/main/scripts/getGpusResources.sh - -``` - -## Note: - -If you want to try in a node with only 1 GPU, please modify the GPU number per worker in `$SPARK_HOME/conf/spark-env.sh` before you launch spark workers becasue the docker image is targeted for DGX-2 with 16 GPUs - -## file decription: - -`Dockerfile`: consistent environment, main components are build from source directly. But this file take a while to build an image. - -`spark-env.sh`: Spark config changes, we set 16 GPU for a work for DGX-2 box. It is in SPARK_HOME/conf/ - -`start-spark.sh`: launch Spark in standalone mode. In a DGX-2 box, it will launch Spark Master and a Spark Worker which contains 16 GPUs - -`submit.sh`: commands used to submit the job - -`criteo_keras.py`: Python script to train the Criteo model. Please run `python criteo_keras.py --help` to see parameter details - -## workspace folder in docker container: - -`/workspace/` - -## Run in Databricks Runtime -Some extra packages are required to run the example, we provide a Dockerfile [Dockerfile.conda_db](Dockerfile.conda_db) -to use [Customize containers with Databricks Container Services](https://docs.databricks.com/clusters/custom-containers.html) -in Databricks cloud environment. - -To use it: -1. build the docker image locally -2. push the image to a DB supported Docker hub. -3. set the image url in DB cluster setup page. - -![microbenchmark-speedup](/docs/img/guides/criteo-perf.png) \ No newline at end of file diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/create-conda-env.sh b/examples/ML+DL-Examples/Spark-DL/criteo_train/create-conda-env.sh deleted file mode 100755 index f3ba315f3..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/create-conda-env.sh +++ /dev/null @@ -1,29 +0,0 @@ -#!/bin/bash --login - -export HOROVOD_CUDA_HOME=/usr/local/cuda -export HOROVOD_NCCL_LINK=SHARED -export HOROVOD_GPU_OPERATIONS=NCCL - -# Create the conda environment: -conda env create --file environment.yml --force - -# Activate the conda environment: -eval "$(conda shell.bash hook)" -conda activate spark_dl - -# Install tensorflow: -pip install tensorflow-gpu - -# Install pytorch: -pip install torch==1.10.2+cu113 torchvision==0.11.3+cu113 torchaudio==0.10.2+cu113\ - -f https://download.pytorch.org/whl/cu113/torch_stable.html - -# Install horovod: -pip install horovod[tensorflow,keras,pytorch,spark] - -# Check the build: -horovodrun --check-build - -echo -echo "Run 'conda activate spark_dl' to activate the environment" -echo diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/criteo_keras.py b/examples/ML+DL-Examples/Spark-DL/criteo_train/criteo_keras.py deleted file mode 100644 index bb653f9e6..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/criteo_keras.py +++ /dev/null @@ -1,309 +0,0 @@ -# -# Copyright (c) 2021-2021, NVIDIA CORPORATION. All rights reserved. -# -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. -# - -import argparse -import math -import pprint -import sys - -# This needs to happen first to avoid pyarrow serialization errors. -from pyspark.sql import SparkSession - -# Make sure pyarrow is referenced before anything else to avoid segfault due to conflict -# with TensorFlow libraries. Use `pa` package reference to ensure it's loaded before -# functions like `deserialize_model` which are implemented at the top level. -# See https://jira.apache.org/jira/browse/ARROW-3346 -import pyarrow as pa - -import horovod -import horovod.tensorflow.keras as hvd -import tensorflow as tf -from horovod.spark.common.backend import SparkBackend -from tensorflow.keras.layers import BatchNormalization, Input, Embedding, Concatenate, Dense, Flatten -from tensorflow.keras.layers.experimental.preprocessing import CategoryEncoding - -PETASTORM_DATALOADER = 'petastorm' -NVTABULAR_DATALOADER = 'nvtabular' - -CONTINUOUS_COLUMNS = [f'i{i}' for i in range(13)] -CATEGORICAL_COLUMNS = [f'c{c}' for c in range(26)] -ALL_COLUMNS = CONTINUOUS_COLUMNS + CATEGORICAL_COLUMNS -LABEL_COLUMNS = ['clicked'] - - -def get_category_dimensions(spark, data_dir): - df = spark.read.csv(f'{data_dir}/dimensions/*.csv', header=True).toPandas() - dimensions = df.to_dict('records')[0] - pprint.pprint(dimensions) - return dimensions - - -def build_model(dimensions, args): - inputs = { - **{i: Input(shape=(1,), name=i, dtype=tf.float32) for i in CONTINUOUS_COLUMNS}, - **{c: Input(shape=(1,), name=c, dtype=tf.int32) for c in CATEGORICAL_COLUMNS} - } - - one_hots = [] - embeddings = [] - for c in CATEGORICAL_COLUMNS: - dimension = int(dimensions[c]) + 1 - if dimension <= 128: - one_hots.append(CategoryEncoding(num_tokens=dimension, name=f'one_hot_{c}')(inputs[c])) - else: - embedding_size = int(math.floor(0.6 * dimension ** 0.25)) - embeddings.append(Embedding(input_dim=dimension, - output_dim=embedding_size, - input_length=1, - name=f'embedding_{c}')(inputs[c])) - - x = Concatenate(name='embeddings_concat')(embeddings) - x = Flatten(name='embeddings_flatten')(x) - x = Concatenate(name='inputs_concat')([x] + one_hots + [inputs[i] for i in CONTINUOUS_COLUMNS]) - x = BatchNormalization()(x) - x = Dense(1024, activation='relu')(x) - x = BatchNormalization()(x) - x = Dense(1024, activation='relu')(x) - x = BatchNormalization()(x) - x = Dense(1024, activation='relu')(x) - x = BatchNormalization()(x) - x = Dense(512, activation='relu')(x) - output = Dense(1, activation='sigmoid', name='output')(x) - model = tf.keras.Model(inputs=[inputs[c] for c in ALL_COLUMNS], outputs=output) - if hvd.rank() == 0: - model.summary() - - opt = tf.keras.optimizers.Adam(learning_rate=args.learning_rate) - opt = hvd.DistributedOptimizer(opt) - model.compile(optimizer=opt, loss='binary_crossentropy', metrics=[tf.keras.metrics.AUC()]) - - return model - - -def train_fn(dimensions, train_rows, val_rows, args): - # Make sure pyarrow is referenced before anything else to avoid segfault due to conflict - # with TensorFlow libraries. Use `pa` package reference to ensure it's loaded before - # functions like `deserialize_model` which are implemented at the top level. - # See https://jira.apache.org/jira/browse/ARROW-3346 - pa - - import atexit - import horovod.tensorflow.keras as hvd - from horovod.spark.task import get_available_devices - import os - import tempfile - import tensorflow as tf - import tensorflow.keras.backend as K - import shutil - - gpus = get_available_devices() - if gpus: - os.environ['CUDA_VISIBLE_DEVICES'] = gpus[0] - if args.dataloader == NVTABULAR_DATALOADER: - os.environ['TF_MEMORY_ALLOCATION'] = '0.85' - from nvtabular.loader.tensorflow import KerasSequenceLoader - - # Horovod: initialize Horovod inside the trainer. - hvd.init() - - # Horovod: restore from checkpoint, use hvd.load_model under the hood. - model = build_model(dimensions, args) - - # Horovod: adjust learning rate based on number of processes. - scaled_lr = K.get_value(model.optimizer.lr) * hvd.size() - K.set_value(model.optimizer.lr, scaled_lr) - - # Horovod: print summary logs on the first worker. - verbose = 1 if hvd.rank() == 0 else 0 - - callbacks = [ - # Horovod: broadcast initial variable states from rank 0 to all other processes. - # This is necessary to ensure consistent initialization of all workers when - # training is started with random weights or restored from a checkpoint. - hvd.callbacks.BroadcastGlobalVariablesCallback(root_rank=0), - - # Horovod: average metrics among workers at the end of every epoch. - # - # Note: This callback must be in the list before the ReduceLROnPlateau, - # TensorBoard, or other metrics-based callbacks. - hvd.callbacks.MetricAverageCallback(), - - # Horovod: using `lr = 1.0 * hvd.size()` from the very beginning leads to worse final - # accuracy. Scale the learning rate `lr = 1.0` ---> `lr = 1.0 * hvd.size()` during - # the first five epochs. See https://arxiv.org/abs/1706.02677 for details. - hvd.callbacks.LearningRateWarmupCallback(initial_lr=scaled_lr, warmup_epochs=5, verbose=verbose), - - # Reduce LR if the metric is not improved for 10 epochs, and stop training - # if it has not improved for 20 epochs. - tf.keras.callbacks.ReduceLROnPlateau(monitor='val_auc', patience=10, verbose=verbose), - tf.keras.callbacks.EarlyStopping(monitor='val_auc', mode='min', patience=20, verbose=verbose), - tf.keras.callbacks.TerminateOnNaN(), - - # Log Tensorboard events. - tf.keras.callbacks.TensorBoard(log_dir=args.logs_dir, write_steps_per_second=True, update_freq=10) - ] - - # Horovod: save checkpoints only on the first worker to prevent other workers from corrupting them. - if hvd.rank() == 0: - ckpt_dir = tempfile.mkdtemp() - ckpt_file = os.path.join(ckpt_dir, 'checkpoint.h5') - atexit.register(lambda: shutil.rmtree(ckpt_dir)) - callbacks.append(tf.keras.callbacks.ModelCheckpoint( - ckpt_file, monitor='val_auc', mode='min', save_best_only=True)) - - if args.dataloader == PETASTORM_DATALOADER: - from petastorm import make_batch_reader - from petastorm.tf_utils import make_petastorm_dataset - - # Make Petastorm readers. - with make_batch_reader(f'{args.data_dir}/train', - num_epochs=None, - cur_shard=hvd.rank(), - shard_count=hvd.size(), - hdfs_driver='libhdfs') as train_reader: - with make_batch_reader(f'{args.data_dir}/val', - num_epochs=None, - cur_shard=hvd.rank(), - shard_count=hvd.size(), - hdfs_driver='libhdfs') as val_reader: - # Convert readers to tf.data.Dataset. - train_ds = make_petastorm_dataset(train_reader) \ - .unbatch() \ - .shuffle(10 * args.batch_size) \ - .batch(args.batch_size) \ - .map(lambda x: (tuple(getattr(x, c) for c in ALL_COLUMNS), x.clicked)) - - val_ds = make_petastorm_dataset(val_reader) \ - .unbatch() \ - .batch(args.batch_size) \ - .map(lambda x: (tuple(getattr(x, c) for c in ALL_COLUMNS), x.clicked)) - - history = model.fit(train_ds, - validation_data=val_ds, - steps_per_epoch=int(train_rows / args.batch_size / hvd.size()), - validation_steps=int(val_rows / args.batch_size / hvd.size()), - callbacks=callbacks, - verbose=verbose, - epochs=args.epochs) - - else: - import cupy - - def seed_fn(): - """ - Generate consistent dataloader shuffle seeds across workers - Reseeds each worker's dataloader each epoch to get fresh a shuffle - that's consistent across workers. - """ - min_int, max_int = tf.int32.limits - max_rand = max_int // hvd.size() - # Generate a seed fragment on each worker - seed_fragment = cupy.random.randint(0, max_rand).get() - # Aggregate seed fragments from all Horovod workers - seed_tensor = tf.constant(seed_fragment) - reduced_seed = hvd.allreduce(seed_tensor, name="shuffle_seed", op=hvd.Sum) - return reduced_seed % max_rand - - train_ds = KerasSequenceLoader( - f'{args.data_dir}/train', - batch_size=args.batch_size, - label_names=LABEL_COLUMNS, - cat_names=CATEGORICAL_COLUMNS, - cont_names=CONTINUOUS_COLUMNS, - engine="parquet", - shuffle=True, - buffer_size=0.06, # how many batches to load at once - parts_per_chunk=1, - global_size=hvd.size(), - global_rank=hvd.rank(), - seed_fn=seed_fn) - - val_ds = KerasSequenceLoader( - f'{args.data_dir}/val', - batch_size=args.batch_size, - label_names=LABEL_COLUMNS, - cat_names=CATEGORICAL_COLUMNS, - cont_names=CONTINUOUS_COLUMNS, - engine="parquet", - shuffle=False, - buffer_size=0.06, # how many batches to load at once - parts_per_chunk=1, - global_size=hvd.size(), - global_rank=hvd.rank()) - - history = model.fit(train_ds, - validation_data=val_ds, - steps_per_epoch=int(train_rows / args.batch_size / hvd.size()), - validation_steps=int(val_rows / args.batch_size / hvd.size()), - callbacks=callbacks, - verbose=verbose, - epochs=args.epochs) - - if hvd.rank() == 0: - return history.history - - -def train(dimensions, train_rows, val_rows, args): - # Horovod: run training. - history = horovod.spark.run(train_fn, - args=(dimensions, train_rows, val_rows, args), - num_proc=args.num_proc, - extra_mpi_args='-mca btl_tcp_if_include enp134s0f0 -x NCCL_IB_GID_INDEX=3', - stdout=sys.stdout, - stderr=sys.stderr, - verbose=2, - nics={}, - prefix_output_with_timestamp=True)[0] - - best_val_loss = min(history['val_loss']) - print('Best Loss: %f' % best_val_loss) - - -def main(): - parser = argparse.ArgumentParser(description='Criteo Spark Keras Training Example', - formatter_class=argparse.ArgumentDefaultsHelpFormatter) - parser.add_argument('--data-dir', default='file:///opt/data/criteo/parquet', - help='location of the transformed Criteo dataset in Parquet format') - parser.add_argument('--logs-dir', default='/opt/experiments/criteo', help='location of TensorFlow logs') - parser.add_argument('--dataloader', default=PETASTORM_DATALOADER, - choices=[PETASTORM_DATALOADER, NVTABULAR_DATALOADER], - help='dataloader to use') - parser.add_argument('--num-proc', type=int, default=1, help='number of worker processes for training') - parser.add_argument('--learning-rate', type=float, default=0.0001, help='initial learning rate') - parser.add_argument('--batch-size', type=int, default=64 * 1024, help='batch size') - parser.add_argument('--epochs', type=int, default=3, help='number of epochs to train') - parser.add_argument('--local-checkpoint-file', default='checkpoint', help='model checkpoint') - args = parser.parse_args() - - spark = SparkSession.builder.appName('Criteo Keras Training').getOrCreate() - - dimensions = get_category_dimensions(spark, args.data_dir) - - train_df = spark.read.parquet(f'{args.data_dir}/train') - val_df = spark.read.parquet(f'{args.data_dir}/val') - test_df = spark.read.parquet(f'{args.data_dir}/test') - train_rows, val_rows, test_rows = train_df.count(), val_df.count(), test_df.count() - print('Training: %d' % train_rows) - print('Validation: %d' % val_rows) - print('Test: %d' % test_rows) - - train(dimensions, train_rows, val_rows, args) - - spark.stop() - - -if __name__ == '__main__': - main() diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/environment.yml b/examples/ML+DL-Examples/Spark-DL/criteo_train/environment.yml deleted file mode 100644 index 9bb5e3a52..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/environment.yml +++ /dev/null @@ -1,30 +0,0 @@ -name: spark_dl -channels: - - rapidsai - - nvidia - - pytorch - - conda-forge -dependencies: - - nvtabular - - python>=3.7 - - cudatoolkit=11.2 - - cudf>=21.10.* - - dask-cuda>=21.10.* - - dask-cudf>=21.10.* - - rmm>=21.10.* - - dask==2021.9.1 - - distributed>=2021.9.1 - - fsspec>=0.6.0 - - nvtx>=0.2.1 - - numba>=0.53.0 - - dlpack - - scikit-learn - - asvdb - - pynvml - - cmake - - cudnn - - cxx-compiler - - nccl - - nvcc_linux-64 - - openmpi - - pip diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/notebooks/Criteo-Training.ipynb b/examples/ML+DL-Examples/Spark-DL/criteo_train/notebooks/Criteo-Training.ipynb deleted file mode 100644 index d760106b4..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/notebooks/Criteo-Training.ipynb +++ /dev/null @@ -1,12675 +0,0 @@ -{ - "cells": [ - { - "cell_type": "markdown", - "id": "dd4592b6", - "metadata": {}, - "source": [ - "# Introduction\n", - "\n", - "This notebook contains the same content as \"criteo_keras.py\" but in a notebook(interactive) form.\n", - "\n", - "The dataset used here is from Criteo clicklog dataset. It's preprocessed by DLRM(https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow2/Recommendation/DLRM_and_DCNv2/preproc) ETL job on Spark.\n", - "\n", - "We provide a small size sample data in `sample_data` folder.\n", - "\n", - "The data schema after the DLRM ETL: also 40 columns -- 1 label column, 39 numerical feature columns. (Categorical columns are processed)\n", - "\n", - "User can either take the same routine to get the data or use your own preprocessed data and change the DL model accordingly.\n", - "\n", - "`Please note: The following demo is dedicated for DGX-2 machine(with V100 GPUs).` We optimized the whole workflow on DGX-2 and it's not guaranteed that it can run successfully on other type of machines." - ] - }, - { - "cell_type": "markdown", - "id": "e8bdbe10", - "metadata": {}, - "source": [ - "### import necessary libraries" - ] - }, - { - "cell_type": "code", - "execution_count": 1, - "id": "cd1fb946", - "metadata": {}, - "outputs": [], - "source": [ - "import argparse\n", - "import math\n", - "import pprint\n", - "import sys\n", - "# This needs to happen first to avoid pyarrow serialization errors.\n", - "from pyspark.sql import SparkSession\n", - "\n", - "# Make sure pyarrow is referenced before anything else to avoid segfault due to conflict\n", - "# with TensorFlow libraries. Use `pa` package reference to ensure it's loaded before\n", - "# functions like `deserialize_model` which are implemented at the top level.\n", - "# See https://jira.apache.org/jira/browse/ARROW-3346\n", - "import pyarrow as pa\n", - "\n", - "import horovod\n", - "import horovod.tensorflow.keras as hvd\n", - "import tensorflow as tf\n", - "from horovod.spark.common.backend import SparkBackend\n", - "from tensorflow.keras.layers import BatchNormalization, Input, Embedding, Concatenate, Dense, Flatten\n", - "from tensorflow.keras.layers.experimental.preprocessing import CategoryEncoding" - ] - }, - { - "cell_type": "markdown", - "id": "ffda2b11", - "metadata": {}, - "source": [ - "### set some macros\n", - "\n", - "xxx_DATALOADER is the switch to control which dataloader we will use,\n", - "xxx_COLUMNS are only used in NVTabular dataloader." - ] - }, - { - "cell_type": "code", - "execution_count": 1, - "id": "d690dd8b", - "metadata": {}, - "outputs": [], - "source": [ - "PETASTORM_DATALOADER = 'petastorm'\n", - "NVTABULAR_DATALOADER = 'nvtabular'\n", - "\n", - "CONTINUOUS_COLUMNS = [f'i{i}' for i in range(13)]\n", - "CATEGORICAL_COLUMNS = [f'c{c}' for c in range(26)]\n", - "ALL_COLUMNS = CONTINUOUS_COLUMNS + CATEGORICAL_COLUMNS\n", - "LABEL_COLUMNS = ['clicked']" - ] - }, - { - "cell_type": "markdown", - "id": "cdd51a2a", - "metadata": {}, - "source": [ - "The \"dimensions\" contains the count of distinct value for those categorical column 'after' DLRM ETL.\n", - "\n", - "This will be used to build embedding layers for our model." - ] - }, - { - "cell_type": "code", - "execution_count": 3, - "id": "92e6d359", - "metadata": {}, - "outputs": [], - "source": [ - "def get_category_dimensions(spark, data_dir):\n", - " df = spark.read.csv(f'{data_dir}/dimensions/*.csv', header=True).toPandas()\n", - " dimensions = df.to_dict('records')[0]\n", - " pprint.pprint(dimensions)\n", - " return dimensions" - ] - }, - { - "cell_type": "markdown", - "id": "66e38f1a", - "metadata": {}, - "source": [ - "### Build the model\n", - "\n", - "The model is composed by mainly 2 parts: embedding layers and fully-connected layers." - ] - }, - { - "cell_type": "code", - "execution_count": 4, - "id": "0c29876c", - "metadata": {}, - "outputs": [], - "source": [ - "def build_model(dimensions, args):\n", - " \n", - " inputs = {\n", - " **{i: Input(shape=(1,), name=i, dtype=tf.float32) for i in CONTINUOUS_COLUMNS},\n", - " **{c: Input(shape=(1,), name=c, dtype=tf.int32) for c in CATEGORICAL_COLUMNS}\n", - " }\n", - "\n", - " one_hots = []\n", - " embeddings = []\n", - " for c in CATEGORICAL_COLUMNS:\n", - " dimension = int(dimensions[c]) + 1\n", - " # dimension <= 128, smaller size for demo\n", - " if dimension <= 8:\n", - " one_hots.append(CategoryEncoding(num_tokens=dimension, name=f'one_hot_{c}')(inputs[c]))\n", - " else:\n", - " # embedding_size = int(math.floor(0.6 * dimension ** 0.25)), smaller model size for demo\n", - " embedding_size = 8\n", - " embeddings.append(Embedding(input_dim=dimension,\n", - " output_dim=embedding_size,\n", - " input_length=1,\n", - " name=f'embedding_{c}')(inputs[c]))\n", - "\n", - " x = Concatenate(name='embeddings_concat')(embeddings)\n", - " x = Flatten(name='embeddings_flatten')(x)\n", - " x = Concatenate(name='inputs_concat')([x] + one_hots + [inputs[i] for i in CONTINUOUS_COLUMNS])\n", - " x = BatchNormalization()(x)\n", - " x = Dense(64, activation='relu')(x)\n", - " x = BatchNormalization()(x)\n", - " x = Dense(64, activation='relu')(x)\n", - " x = BatchNormalization()(x)\n", - " x = Dense(64, activation='relu')(x)\n", - " x = BatchNormalization()(x)\n", - " x = Dense(32, activation='relu')(x)\n", - " output = Dense(1, activation='sigmoid', name='output')(x)\n", - " model = tf.keras.Model(inputs=[inputs[c] for c in ALL_COLUMNS], outputs=output)\n", - " if hvd.rank() == 0:\n", - " model.summary()\n", - "\n", - " opt = tf.keras.optimizers.Adam(learning_rate=args.learning_rate)\n", - " opt = hvd.DistributedOptimizer(opt)\n", - " model.compile(optimizer=opt, loss='binary_crossentropy', metrics=[tf.keras.metrics.AUC()])\n", - "\n", - " return model" - ] - }, - { - "cell_type": "markdown", - "id": "7dcc291d", - "metadata": {}, - "source": [ - "### Set train function\n", - "\n", - "The train_fn is the function that will execute across all Horovod workers(also say Spark executors in our case).\n", - "\n", - "We use `CUDA_VISIBLE_DEVICES` to control the GPU resources to avoid overlapping." - ] - }, - { - "cell_type": "code", - "execution_count": 5, - "id": "3bc96eb8", - "metadata": {}, - "outputs": [], - "source": [ - "def train_fn(dimensions, train_rows, val_rows, args):\n", - " # Make sure pyarrow is referenced before anything else to avoid segfault due to conflict\n", - " # with TensorFlow libraries. Use `pa` package reference to ensure it's loaded before\n", - " # functions like `deserialize_model` which are implemented at the top level.\n", - " # See https://jira.apache.org/jira/browse/ARROW-3346\n", - " pa\n", - "\n", - " import atexit\n", - " import horovod.tensorflow.keras as hvd\n", - " from horovod.spark.task import get_available_devices\n", - " import os\n", - " import tempfile\n", - " import tensorflow as tf\n", - " import tensorflow.keras.backend as K\n", - " import shutil\n", - "\n", - " gpus = get_available_devices()\n", - " if gpus:\n", - " os.environ['CUDA_VISIBLE_DEVICES'] = gpus[0]\n", - " if args.dataloader == NVTABULAR_DATALOADER:\n", - " os.environ['TF_MEMORY_ALLOCATION'] = '0.85'\n", - " from nvtabular.loader.tensorflow import KerasSequenceLoader\n", - "\n", - " # Horovod: initialize Horovod inside the trainer.\n", - " hvd.init()\n", - "\n", - " # Horovod: restore from checkpoint, use hvd.load_model under the hood.\n", - " model = build_model(dimensions, args)\n", - "\n", - " # Horovod: adjust learning rate based on number of processes.\n", - " scaled_lr = K.get_value(model.optimizer.lr) * hvd.size()\n", - " K.set_value(model.optimizer.lr, scaled_lr)\n", - "\n", - " # Horovod: print summary logs on the first worker.\n", - " verbose = 1 if hvd.rank() == 0 else 0\n", - "\n", - " callbacks = [\n", - " # Horovod: broadcast initial variable states from rank 0 to all other processes.\n", - " # This is necessary to ensure consistent initialization of all workers when\n", - " # training is started with random weights or restored from a checkpoint.\n", - " hvd.callbacks.BroadcastGlobalVariablesCallback(root_rank=0),\n", - "\n", - " # Horovod: average metrics among workers at the end of every epoch.\n", - " #\n", - " # Note: This callback must be in the list before the ReduceLROnPlateau,\n", - " # TensorBoard, or other metrics-based callbacks.\n", - " hvd.callbacks.MetricAverageCallback(),\n", - "\n", - " # Horovod: using `lr = 1.0 * hvd.size()` from the very beginning leads to worse final\n", - " # accuracy. Scale the learning rate `lr = 1.0` ---> `lr = 1.0 * hvd.size()` during\n", - " # the first five epochs. See https://arxiv.org/abs/1706.02677 for details.\n", - " hvd.callbacks.LearningRateWarmupCallback(initial_lr=scaled_lr, warmup_epochs=5, verbose=verbose),\n", - "\n", - " # Reduce LR if the metric is not improved for 10 epochs, and stop training\n", - " # if it has not improved for 20 epochs.\n", - " tf.keras.callbacks.ReduceLROnPlateau(monitor='val_auc', patience=10, verbose=verbose),\n", - " tf.keras.callbacks.EarlyStopping(monitor='val_auc', mode='min', patience=20, verbose=verbose),\n", - " tf.keras.callbacks.TerminateOnNaN(),\n", - "\n", - " # Log Tensorboard events.\n", - " tf.keras.callbacks.TensorBoard(log_dir=args.logs_dir, write_steps_per_second=True, update_freq=10)\n", - " ]\n", - "\n", - " # Horovod: save checkpoints only on the first worker to prevent other workers from corrupting them.\n", - " if hvd.rank() == 0:\n", - " ckpt_dir = tempfile.mkdtemp()\n", - " ckpt_file = os.path.join(ckpt_dir, 'checkpoint.h5')\n", - " atexit.register(lambda: shutil.rmtree(ckpt_dir))\n", - " callbacks.append(tf.keras.callbacks.ModelCheckpoint(\n", - " ckpt_file, monitor='val_auc', mode='min', save_best_only=True))\n", - "\n", - " if args.dataloader == PETASTORM_DATALOADER:\n", - " from petastorm import make_batch_reader\n", - " from petastorm.tf_utils import make_petastorm_dataset\n", - "\n", - " # Make Petastorm readers.\n", - " with make_batch_reader(f'{args.data_dir}/train',\n", - " num_epochs=None,\n", - " cur_shard=hvd.rank(),\n", - " shard_count=hvd.size(),\n", - " hdfs_driver='libhdfs') as train_reader:\n", - " with make_batch_reader(f'{args.data_dir}/val',\n", - " num_epochs=None,\n", - " cur_shard=hvd.rank(),\n", - " shard_count=hvd.size(),\n", - " hdfs_driver='libhdfs') as val_reader:\n", - " # Convert readers to tf.data.Dataset.\n", - " train_ds = make_petastorm_dataset(train_reader) \\\n", - " .unbatch() \\\n", - " .shuffle(10 * args.batch_size) \\\n", - " .batch(args.batch_size) \\\n", - " .map(lambda x: (tuple(getattr(x, c) for c in ALL_COLUMNS), x.clicked))\n", - "\n", - " val_ds = make_petastorm_dataset(val_reader) \\\n", - " .unbatch() \\\n", - " .batch(args.batch_size) \\\n", - " .map(lambda x: (tuple(getattr(x, c) for c in ALL_COLUMNS), x.clicked))\n", - "\n", - " history = model.fit(train_ds,\n", - " validation_data=val_ds,\n", - " steps_per_epoch=int(train_rows / args.batch_size / hvd.size()),\n", - " validation_steps=int(val_rows / args.batch_size / hvd.size()),\n", - " callbacks=callbacks,\n", - " verbose=verbose,\n", - " epochs=args.epochs)\n", - "\n", - " else:\n", - " import cupy\n", - "\n", - " def seed_fn():\n", - " \"\"\"\n", - " Generate consistent dataloader shuffle seeds across workers\n", - " Reseeds each worker's dataloader each epoch to get fresh a shuffle\n", - " that's consistent across workers.\n", - " \"\"\"\n", - " min_int, max_int = tf.int32.limits\n", - " max_rand = max_int // hvd.size()\n", - " # Generate a seed fragment on each worker\n", - " seed_fragment = cupy.random.randint(0, max_rand).get()\n", - " # Aggregate seed fragments from all Horovod workers\n", - " seed_tensor = tf.constant(seed_fragment)\n", - " reduced_seed = hvd.allreduce(seed_tensor, name=\"shuffle_seed\", op=hvd.Sum)\n", - " return reduced_seed % max_rand\n", - "\n", - " train_ds = KerasSequenceLoader(\n", - " f'{args.data_dir}/train',\n", - " batch_size=args.batch_size,\n", - " label_names=LABEL_COLUMNS,\n", - " cat_names=CATEGORICAL_COLUMNS,\n", - " cont_names=CONTINUOUS_COLUMNS,\n", - " engine=\"parquet\",\n", - " shuffle=True,\n", - " buffer_size=0.06, # how many batches to load at once\n", - " parts_per_chunk=1,\n", - " global_size=hvd.size(),\n", - " global_rank=hvd.rank(),\n", - " seed_fn=seed_fn)\n", - "\n", - " val_ds = KerasSequenceLoader(\n", - " f'{args.data_dir}/val',\n", - " batch_size=args.batch_size,\n", - " label_names=LABEL_COLUMNS,\n", - " cat_names=CATEGORICAL_COLUMNS,\n", - " cont_names=CONTINUOUS_COLUMNS,\n", - " engine=\"parquet\",\n", - " shuffle=False,\n", - " buffer_size=0.06, # how many batches to load at once\n", - " parts_per_chunk=1,\n", - " global_size=hvd.size(),\n", - " global_rank=hvd.rank())\n", - "\n", - " history = model.fit(train_ds,\n", - " validation_data=val_ds,\n", - " steps_per_epoch=int(train_rows / args.batch_size / hvd.size()),\n", - " validation_steps=int(val_rows / args.batch_size / hvd.size()),\n", - " callbacks=callbacks,\n", - " verbose=verbose,\n", - " epochs=args.epochs)\n", - "\n", - " if hvd.rank() == 0:\n", - " return history.history" - ] - }, - { - "cell_type": "markdown", - "id": "392ac264", - "metadata": {}, - "source": [ - "### Wrapper function to train\n", - "\n", - "Here we call the `horovod.spark.run` to start the training process in Horovod on Spark." - ] - }, - { - "cell_type": "code", - "execution_count": 6, - "id": "f9b8459d", - "metadata": {}, - "outputs": [], - "source": [ - "def train(dimensions, train_rows, val_rows, args):\n", - " # Horovod: run training.\n", - " history = horovod.spark.run(train_fn,\n", - " args=(dimensions, train_rows, val_rows, args),\n", - " num_proc=args.num_proc,\n", - " extra_mpi_args='-mca btl_tcp_if_include enp134s0f0 -x NCCL_IB_GID_INDEX=3',\n", - " stdout=sys.stdout,\n", - " stderr=sys.stderr,\n", - " verbose=2,\n", - " nics={},\n", - " prefix_output_with_timestamp=True)[0]\n", - "\n", - " best_val_loss = min(history['val_loss'])\n", - " print('Best Loss: %f' % best_val_loss)" - ] - }, - { - "cell_type": "markdown", - "id": "3e4ac6b8", - "metadata": {}, - "source": [ - "## Use NVTabular\n", - "\n", - "Here we set `--dataloader` to `nvtabular` to force NVTabular run." - ] - }, - { - "cell_type": "code", - "execution_count": 7, - "id": "c2afc3a4", - "metadata": {}, - "outputs": [], - "source": [ - "def main():\n", - " parser = argparse.ArgumentParser(description='Criteo Spark Keras Training Example',\n", - " formatter_class=argparse.ArgumentDefaultsHelpFormatter)\n", - " parser.add_argument('--data-dir', default='file:///opt/data/criteo/parquet',\n", - " help='location of the transformed Criteo dataset in Parquet format')\n", - " parser.add_argument('--logs-dir', default='/opt/experiments/criteo', help='location of TensorFlow logs')\n", - " parser.add_argument('--dataloader', default=PETASTORM_DATALOADER,\n", - " choices=[PETASTORM_DATALOADER, NVTABULAR_DATALOADER],\n", - " help='dataloader to use')\n", - " parser.add_argument('--num-proc', type=int, default=1, help='number of worker processes for training')\n", - " parser.add_argument('--learning-rate', type=float, default=0.0001, help='initial learning rate')\n", - " parser.add_argument('--batch-size', type=int, default=64 * 1024, help='batch size')\n", - " parser.add_argument('--epochs', type=int, default=3, help='number of epochs to train')\n", - " parser.add_argument('--local-checkpoint-file', default='checkpoint', help='model checkpoint')\n", - " args = parser.parse_args(args=['--num-proc', '16', '--data-dir', 'file:///raid/spark-team/criteo/parquet', \n", - " '--dataloader', 'nvtabular', '--learning-rate', '0.001',\n", - " '--batch-size', '65535','--epochs', '1', '--logs-dir', 'tf_logs',\n", - " '--local-checkpoint-file', 'ckpt_file'])\n", - " \n", - "\n", - " dimensions = get_category_dimensions(spark, args.data_dir)\n", - "\n", - " train_df = spark.read.parquet(f'{args.data_dir}/train')\n", - " val_df = spark.read.parquet(f'{args.data_dir}/val')\n", - " test_df = spark.read.parquet(f'{args.data_dir}/test')\n", - " train_rows, val_rows, test_rows = train_df.count(), val_df.count(), test_df.count()\n", - " print('Training: %d' % train_rows)\n", - " print('Validation: %d' % val_rows)\n", - " print('Test: %d' % test_rows)\n", - "\n", - " train(dimensions, train_rows, val_rows, args)\n", - "\n", - " spark.stop()" - ] - }, - { - "cell_type": "code", - "execution_count": 8, - "id": "a15573e3", - "metadata": {}, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "21/09/06 09:03:44 WARN package: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.sql.debug.maxToStringFields'.\n", - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "{'c0': '7912888',\n", - " 'c1': '33822',\n", - " 'c10': '582468',\n", - " 'c11': '245827',\n", - " 'c12': '10',\n", - " 'c13': '2208',\n", - " 'c14': '10666',\n", - " 'c15': '103',\n", - " 'c16': '3',\n", - " 'c17': '967',\n", - " 'c18': '14',\n", - " 'c19': '8165895',\n", - " 'c2': '17138',\n", - " 'c20': '2675939',\n", - " 'c21': '7156452',\n", - " 'c22': '302515',\n", - " 'c23': '12021',\n", - " 'c24': '96',\n", - " 'c25': '34',\n", - " 'c3': '7338',\n", - " 'c4': '20045',\n", - " 'c5': '3',\n", - " 'c6': '7104',\n", - " 'c7': '1381',\n", - " 'c8': '62',\n", - " 'c9': '5554113'}\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Training: 4195197692\n", - "Validation: 89137318\n", - "Test: 89137319\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Checking whether extension tensorflow was built with MPI.\n", - "Extension tensorflow was built with MPI.\n", - "mpirun --allow-run-as-root --tag-output -np 16 -H dgx2h0194-a1adff968d508e8d1142986f3e2c42dc:16 -bind-to none -map-by slot -mca pml ob1 -mca btl ^openib --timestamp-output -mca btl_tcp_if_include enp134s0f0 -x NCCL_IB_GID_INDEX=3 -x NCCL_DEBUG=INFO -mca plm_rsh_agent \"/home/ngc-auth-ldap-allxu/miniconda3/bin/python -m horovod.spark.driver.mpirun_rsh gAWVcAEAAAAAAAB9lCiMAmxvlF2UjAkxMjcuMC4wLjGUTWIShpRhjAdlbnA1M3MwlF2UjAwxMC4xNDguMzAuNTmUTWIShpRhjAdlbnA1OHMwlF2UjAwxMC4xNDguOTQuNTmUTWIShpRhjAdlbnA4OHMwlF2UjAwxMC4xNDkuMzAuMzSUTWIShpRhjAdlbnA5M3MwlF2UjAwxMC4xNDkuOTQuNTeUTWIShpRhjAplbnAxMzRzMGYwlF2UjAsxMC4xNTAuMzAuMpRNYhKGlGGMCGVucDE4NHMwlF2UjA0xMC4xNDguMTU4LjU5lE1iEoaUYYwIZW5wMTg5czCUXZSMDTEwLjE0OC4yMjIuNTmUTWIShpRhjAhlbnAyMjVzMJRdlIwNMTAuMTQ5LjE1OC41N5RNYhKGlGGMCGVucDIzMHMwlF2UjA0xMC4xNDkuMjIyLjU3lE1iEoaUYYwHZG9ja2VyMJRdlIwKMTcyLjE3LjAuMZRNYhKGlGF1Lg== gAWVAwMAAAAAAACMI2hvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnNldHRpbmdzlIwIU2V0dGluZ3OUk5QpgZR9lCiMCG51bV9wcm9jlEsQjAd2ZXJib3NllEsCjAhzc2hfcG9ydJROjBFzc2hfaWRlbnRpdHlfZmlsZZROjA5leHRyYV9tcGlfYXJnc5SMOS1tY2EgYnRsX3RjcF9pZl9pbmNsdWRlIGVucDEzNHMwZjAgLXggTkNDTF9JQl9HSURfSU5ERVg9M5SMCHRjcF9mbGFnlE6MDGJpbmRpbmdfYXJnc5ROjANrZXmUTowNc3RhcnRfdGltZW91dJSMImhvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnRpbWVvdXSUjAdUaW1lb3V0lJOUKYGUfZQojAhfdGltZW91dJRNWAKMC190aW1lb3V0X2F0lEdB2E128/YMbIwIX21lc3NhZ2WUWA4BAABUaW1lZCBvdXQgd2FpdGluZyBmb3Ige2FjdGl2aXR5fS4gUGxlYXNlIGNoZWNrIHRoYXQgeW91IGhhdmUgZW5vdWdoIHJlc291cmNlcyB0byBydW4gYWxsIEhvcm92b2QgcHJvY2Vzc2VzLiBFYWNoIEhvcm92b2QgcHJvY2VzcyBydW5zIGluIGEgU3BhcmsgdGFzay4gWW91IG1heSBuZWVkIHRvIGluY3JlYXNlIHRoZSBzdGFydF90aW1lb3V0IHBhcmFtZXRlciB0byBhIGxhcmdlciB2YWx1ZSBpZiB5b3VyIFNwYXJrIHJlc291cmNlcyBhcmUgYWxsb2NhdGVkIG9uLWRlbWFuZC6UdWKMD291dHB1dF9maWxlbmFtZZROjA1ydW5fZnVuY19tb2RllIiMBG5pY3OUfZSMB2VsYXN0aWOUiYwccHJlZml4X291dHB1dF93aXRoX3RpbWVzdGFtcJSIjAVob3N0c5SMLWRneDJoMDE5NC1hMWFkZmY5NjhkNTA4ZThkMTE0Mjk4NmYzZTJjNDJkYzoxNpR1Yi4=\" /home/ngc-auth-ldap-allxu/miniconda3/bin/python -m horovod.spark.task.mpirun_exec_fn gAWVcAEAAAAAAAB9lCiMAmxvlF2UjAkxMjcuMC4wLjGUTWIShpRhjAdlbnA1M3MwlF2UjAwxMC4xNDguMzAuNTmUTWIShpRhjAdlbnA1OHMwlF2UjAwxMC4xNDguOTQuNTmUTWIShpRhjAdlbnA4OHMwlF2UjAwxMC4xNDkuMzAuMzSUTWIShpRhjAdlbnA5M3MwlF2UjAwxMC4xNDkuOTQuNTeUTWIShpRhjAplbnAxMzRzMGYwlF2UjAsxMC4xNTAuMzAuMpRNYhKGlGGMCGVucDE4NHMwlF2UjA0xMC4xNDguMTU4LjU5lE1iEoaUYYwIZW5wMTg5czCUXZSMDTEwLjE0OC4yMjIuNTmUTWIShpRhjAhlbnAyMjVzMJRdlIwNMTAuMTQ5LjE1OC41N5RNYhKGlGGMCGVucDIzMHMwlF2UjA0xMC4xNDkuMjIyLjU3lE1iEoaUYYwHZG9ja2VyMJRdlIwKMTcyLjE3LjAuMZRNYhKGlGF1Lg== gAWVkwkAAAAAAACMI2hvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnNldHRpbmdzlIwIU2V0dGluZ3OUk5QpgZR9lCiMCG51bV9wcm9jlEsQjAd2ZXJib3NllEsCjAhzc2hfcG9ydJROjBFzc2hfaWRlbnRpdHlfZmlsZZROjA5leHRyYV9tcGlfYXJnc5RYxgYAAC1tY2EgYnRsX3RjcF9pZl9pbmNsdWRlIGVucDEzNHMwZjAgLXggTkNDTF9JQl9HSURfSU5ERVg9MyAteCBOQ0NMX0RFQlVHPUlORk8gLW1jYSBwbG1fcnNoX2FnZW50ICIvaG9tZS9uZ2MtYXV0aC1sZGFwLWFsbHh1L21pbmljb25kYTMvYmluL3B5dGhvbiAtbSBob3Jvdm9kLnNwYXJrLmRyaXZlci5tcGlydW5fcnNoIGdBV1ZjQUVBQUFBQUFBQjlsQ2lNQW14dmxGMlVqQWt4TWpjdU1DNHdMakdVVFdJU2hwUmhqQWRsYm5BMU0zTXdsRjJVakF3eE1DNHhORGd1TXpBdU5UbVVUV0lTaHBSaGpBZGxibkExT0hNd2xGMlVqQXd4TUM0eE5EZ3VPVFF1TlRtVVRXSVNocFJoakFkbGJuQTRPSE13bEYyVWpBd3hNQzR4TkRrdU16QXVNelNVVFdJU2hwUmhqQWRsYm5BNU0zTXdsRjJVakF3eE1DNHhORGt1T1RRdU5UZVVUV0lTaHBSaGpBcGxibkF4TXpSek1HWXdsRjJVakFzeE1DNHhOVEF1TXpBdU1wUk5ZaEtHbEdHTUNHVnVjREU0TkhNd2xGMlVqQTB4TUM0eE5EZ3VNVFU0TGpVNWxFMWlFb2FVWVl3SVpXNXdNVGc1Y3pDVVhaU01EVEV3TGpFME9DNHlNakl1TlRtVVRXSVNocFJoakFobGJuQXlNalZ6TUpSZGxJd05NVEF1TVRRNUxqRTFPQzQxTjVSTlloS0dsR0dNQ0dWdWNESXpNSE13bEYyVWpBMHhNQzR4TkRrdU1qSXlMalUzbEUxaUVvYVVZWXdIWkc5amEyVnlNSlJkbEl3S01UY3lMakUzTGpBdU1aUk5ZaEtHbEdGMUxnPT0gZ0FXVkF3TUFBQUFBQUFDTUkyaHZjbTkyYjJRdWNuVnVibVZ5TG1OdmJXMXZiaTUxZEdsc0xuTmxkSFJwYm1kemxJd0lVMlYwZEdsdVozT1VrNVFwZ1pSOWxDaU1DRzUxYlY5d2NtOWpsRXNRakFkMlpYSmliM05sbEVzQ2pBaHpjMmhmY0c5eWRKUk9qQkZ6YzJoZmFXUmxiblJwZEhsZlptbHNaWlJPakE1bGVIUnlZVjl0Y0dsZllYSm5jNVNNT1MxdFkyRWdZblJzWDNSamNGOXBabDlwYm1Oc2RXUmxJR1Z1Y0RFek5ITXdaakFnTFhnZ1RrTkRURjlKUWw5SFNVUmZTVTVFUlZnOU01U01DSFJqY0Y5bWJHRm5sRTZNREdKcGJtUnBibWRmWVhKbmM1Uk9qQU5yWlhtVVRvd05jM1JoY25SZmRHbHRaVzkxZEpTTUltaHZjbTkyYjJRdWNuVnVibVZ5TG1OdmJXMXZiaTUxZEdsc0xuUnBiV1Z2ZFhTVWpBZFVhVzFsYjNWMGxKT1VLWUdVZlpRb2pBaGZkR2x0Wlc5MWRKUk5XQUtNQzE5MGFXMWxiM1YwWDJGMGxFZEIyRTEyOC9ZTWJJd0lYMjFsYzNOaFoyV1VXQTRCQUFCVWFXMWxaQ0J2ZFhRZ2QyRnBkR2x1WnlCbWIzSWdlMkZqZEdsMmFYUjVmUzRnVUd4bFlYTmxJR05vWldOcklIUm9ZWFFnZVc5MUlHaGhkbVVnWlc1dmRXZG9JSEpsYzI5MWNtTmxjeUIwYnlCeWRXNGdZV3hzSUVodmNtOTJiMlFnY0hKdlkyVnpjMlZ6TGlCRllXTm9JRWh2Y205MmIyUWdjSEp2WTJWemN5QnlkVzV6SUdsdUlHRWdVM0JoY21zZ2RHRnpheTRnV1c5MUlHMWhlU0J1WldWa0lIUnZJR2x1WTNKbFlYTmxJSFJvWlNCemRHRnlkRjkwYVcxbGIzVjBJSEJoY21GdFpYUmxjaUIwYnlCaElHeGhjbWRsY2lCMllXeDFaU0JwWmlCNWIzVnlJRk53WVhKcklISmxjMjkxY21ObGN5QmhjbVVnWVd4c2IyTmhkR1ZrSUc5dUxXUmxiV0Z1WkM2VWRXS01EMjkxZEhCMWRGOW1hV3hsYm1GdFpaUk9qQTF5ZFc1ZlpuVnVZMTl0YjJSbGxJaU1CRzVwWTNPVWZaU01CMlZzWVhOMGFXT1VpWXdjY0hKbFptbDRYMjkxZEhCMWRGOTNhWFJvWDNScGJXVnpkR0Z0Y0pTSWpBVm9iM04wYzVTTUxXUm5lREpvTURFNU5DMWhNV0ZrWm1ZNU5qaGtOVEE0WlRoa01URTBNams0Tm1ZelpUSmpOREprWXpveE5wUjFZaTQ9IpSMCHRjcF9mbGFnlE6MDGJpbmRpbmdfYXJnc5ROjANrZXmUTowNc3RhcnRfdGltZW91dJSMImhvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnRpbWVvdXSUjAdUaW1lb3V0lJOUKYGUfZQojAhfdGltZW91dJRNWAKMC190aW1lb3V0X2F0lEdB2E128/YMbIwIX21lc3NhZ2WUWA4BAABUaW1lZCBvdXQgd2FpdGluZyBmb3Ige2FjdGl2aXR5fS4gUGxlYXNlIGNoZWNrIHRoYXQgeW91IGhhdmUgZW5vdWdoIHJlc291cmNlcyB0byBydW4gYWxsIEhvcm92b2QgcHJvY2Vzc2VzLiBFYWNoIEhvcm92b2QgcHJvY2VzcyBydW5zIGluIGEgU3BhcmsgdGFzay4gWW91IG1heSBuZWVkIHRvIGluY3JlYXNlIHRoZSBzdGFydF90aW1lb3V0IHBhcmFtZXRlciB0byBhIGxhcmdlciB2YWx1ZSBpZiB5b3VyIFNwYXJrIHJlc291cmNlcyBhcmUgYWxsb2NhdGVkIG9uLWRlbWFuZC6UdWKMD291dHB1dF9maWxlbmFtZZROjA1ydW5fZnVuY19tb2RllIiMBG5pY3OUfZSMB2VsYXN0aWOUiYwccHJlZml4X291dHB1dF93aXRoX3RpbWVzdGFtcJSIjAVob3N0c5SMLWRneDJoMDE5NC1hMWFkZmY5NjhkNTA4ZThkMTE0Mjk4NmYzZTJjNDJkYzoxNpR1Yi4=\n", - "Mon Sep 6 09:03:56 2021[1,2]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,4]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,0]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,6]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,1]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,5]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,3]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,10]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,7]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,15]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,11]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,13]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,14]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,8]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:03:56 2021[1,9]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n", - "Mon Sep 6 09:03:56 2021[1,12]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906090316-0000/1\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:16 2021[1,4]:2021-09-06 09:04:16.101560: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,4]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,2]:2021-09-06 09:04:16.101685: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,2]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,5]:2021-09-06 09:04:16.101662: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,5]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,13]:2021-09-06 09:04:16.101697: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,13]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,3]:2021-09-06 09:04:16.101749: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,3]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,1]:2021-09-06 09:04:16.102086: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,1]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,15]:2021-09-06 09:04:16.102170: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,15]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,8]:2021-09-06 09:04:16.102756: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,8]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,14]:2021-09-06 09:04:16.102705: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,14]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,7]:2021-09-06 09:04:16.103510: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,7]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,6]:2021-09-06 09:04:16.103663: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,6]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,12]:2021-09-06 09:04:16.103909: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,12]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,0]:2021-09-06 09:04:16.120233: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,0]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,10]:2021-09-06 09:04:16.120234: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,10]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,11]:2021-09-06 09:04:16.120458: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,11]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:16 2021[1,9]:2021-09-06 09:04:16.121686: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 09:04:16 2021[1,9]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 09:04:18 2021[1,5]:2021-09-06 09:04:18.050711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:bc:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,2]:2021-09-06 09:04:18.111924: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:b7:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,1]:2021-09-06 09:04:18.192508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:be:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,15]:2021-09-06 09:04:18.258547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e5:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,9]:2021-09-06 09:04:18.290947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:59:00.0, compute capability: 7.0\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:18 2021[1,11]:2021-09-06 09:04:18.332073: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:3b:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,4]:2021-09-06 09:04:18.333252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e2:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,3]:2021-09-06 09:04:18.390624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e7:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,7]:2021-09-06 09:04:18.391931: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:b9:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,8]:2021-09-06 09:04:18.455155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:34:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,13]:2021-09-06 09:04:18.458402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:57:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,12]:2021-09-06 09:04:18.460130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:39:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,10]:2021-09-06 09:04:18.545289: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:5e:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,14]:2021-09-06 09:04:18.545716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e0:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,0]:2021-09-06 09:04:18.548694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:36:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,6]:2021-09-06 09:04:18.549196: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 27633 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:5c:00.0, compute capability: 7.0\n", - "Mon Sep 6 09:04:18 2021[1,5]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:18 2021[1,5]: warnings.warn(\n", - "Mon Sep 6 09:04:18 2021[1,5]:2021-09-06 09:04:18.864738: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:18 2021[1,5]:2021-09-06 09:04:18.864766: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:18 2021[1,5]:2021-09-06 09:04:18.864823: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:18 2021[1,2]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:18 2021[1,2]: warnings.warn(\n", - "Mon Sep 6 09:04:18 2021[1,2]:2021-09-06 09:04:18.915255: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:18 2021[1,2]:2021-09-06 09:04:18.915277: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:18 2021[1,2]:2021-09-06 09:04:18.915322: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:18 2021[1,1]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:18 2021[1,1]: warnings.warn(\n", - "Mon Sep 6 09:04:18 2021[1,1]:2021-09-06 09:04:18.936224: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:18 2021[1,1]:2021-09-06 09:04:18.936247: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:18 2021[1,1]:2021-09-06 09:04:18.936299: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:18 2021[1,15]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:18 2021[1,15]: warnings.warn(\n", - "Mon Sep 6 09:04:18 2021[1,15]:2021-09-06 09:04:18.987091: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:18 2021[1,15]:2021-09-06 09:04:18.987119: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:18 2021[1,15]:2021-09-06 09:04:18.987164: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,9]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,9]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,9]:2021-09-06 09:04:19.009288: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,9]:2021-09-06 09:04:19.009310: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,9]:2021-09-06 09:04:19.009354: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,4]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,4]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,4]:2021-09-06 09:04:19.063519: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,4]:2021-09-06 09:04:19.063549: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,4]:2021-09-06 09:04:19.063599: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,11]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,11]: warnings.warn(\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,11]:2021-09-06 09:04:19.064564: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,11]:2021-09-06 09:04:19.064584: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,11]:2021-09-06 09:04:19.064626: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,3]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,3]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,3]:2021-09-06 09:04:19.114647: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,3]:2021-09-06 09:04:19.114675: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,3]:2021-09-06 09:04:19.114721: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,7]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,7]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,7]:2021-09-06 09:04:19.130694: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,7]:2021-09-06 09:04:19.130715: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,7]:2021-09-06 09:04:19.130764: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,13]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,13]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,13]:2021-09-06 09:04:19.209150: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,13]:2021-09-06 09:04:19.209178: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,13]:2021-09-06 09:04:19.209230: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,8]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,8]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,8]:2021-09-06 09:04:19.220618: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,8]:2021-09-06 09:04:19.220639: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,8]:2021-09-06 09:04:19.220688: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,12]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,12]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,12]:2021-09-06 09:04:19.259405: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,12]:2021-09-06 09:04:19.259428: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,12]:2021-09-06 09:04:19.259476: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:Model: \"model\"\n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:Layer (type) Output Shape Param # Connected to \n", - "Mon Sep 6 09:04:19 2021[1,0]:==================================================================================================\n", - "Mon Sep 6 09:04:19 2021[1,0]:c0 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c1 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c2 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c3 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c4 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c6 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c7 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c8 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c9 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c10 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c11 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c12 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c13 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c14 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c15 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c17 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c18 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c19 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c20 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c21 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c22 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c23 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c24 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c25 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c0 (Embedding) (None, 1, 8) 63303112 ['c0[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c1 (Embedding) (None, 1, 8) 270584 ['c1[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c2 (Embedding) (None, 1, 8) 137112 ['c2[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c3 (Embedding) (None, 1, 8) 58712 ['c3[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c4 (Embedding) (None, 1, 8) 160368 ['c4[0][0]'] \n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c6 (Embedding) (None, 1, 8) 56840 ['c6[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c7 (Embedding) (None, 1, 8) 11056 ['c7[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,0]:2021-09-06 09:04:19.311956: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c8 (Embedding) (None, 1, 8) 504 ['c8[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:2021-09-06 09:04:19.311980: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:2021-09-06 09:04:19.312035: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c9 (Embedding) (None, 1, 8) 44432912 ['c9[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c10 (Embedding) (None, 1, 8) 4659752 ['c10[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c11 (Embedding) (None, 1, 8) 1966624 ['c11[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c12 (Embedding) (None, 1, 8) 88 ['c12[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c13 (Embedding) (None, 1, 8) 17672 ['c13[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c14 (Embedding) (None, 1, 8) 85336 ['c14[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c15 (Embedding) (None, 1, 8) 832 ['c15[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c17 (Embedding) (None, 1, 8) 7744 ['c17[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c18 (Embedding) (None, 1, 8) 120 ['c18[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c19 (Embedding) (None, 1, 8) 65327168 ['c19[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c20 (Embedding) (None, 1, 8) 21407520 ['c20[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c21 (Embedding) (None, 1, 8) 57251624 ['c21[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c22 (Embedding) (None, 1, 8) 2420128 ['c22[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c23 (Embedding) (None, 1, 8) 96176 ['c23[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c24 (Embedding) (None, 1, 8) 776 ['c24[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embedding_c25 (Embedding) (None, 1, 8) 280 ['c25[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embeddings_concat (Concatenate (None, 1, 192) 0 ['embedding_c0[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]:) 'embedding_c1[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c2[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c3[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c4[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c6[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c7[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c8[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c9[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c10[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c11[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c12[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c13[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c14[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c15[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c17[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c18[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c19[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c20[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c21[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c22[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c23[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c24[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'embedding_c25[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c5 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:c16 (InputLayer) [(None, 1)] 0 [] \n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:embeddings_flatten (Flatten) (None, 192) 0 ['embeddings_concat[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,10]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:one_hot_c5 (CategoryEncoding) (None, 4) 0 ['c5[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,10]: warnings.warn(\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:one_hot_c16 (CategoryEncoding) (None, 4) 0 ['c16[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,10]:2021-09-06 09:04:19.331721: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,10]:2021-09-06 09:04:19.331743: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,10]:2021-09-06 09:04:19.331792: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:i0 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i1 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i2 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i3 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i4 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i5 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i6 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i7 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i8 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i9 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i10 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:i11 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,6]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:i12 (InputLayer) [(None, 1)] 0 [] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,6]: warnings.warn(\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,6]:2021-09-06 09:04:19.341050: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]:inputs_concat (Concatenate) (None, 213) 0 ['embeddings_flatten[0][0]', \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,6]:2021-09-06 09:04:19.341072: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]: 'one_hot_c5[0][0]', \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,6]:2021-09-06 09:04:19.341122: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,0]: 'one_hot_c16[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i0[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i1[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i2[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i3[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i4[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i5[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i6[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i7[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i8[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i9[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i10[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i11[0][0]', \n", - "Mon Sep 6 09:04:19 2021[1,0]: 'i12[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:batch_normalization (BatchNorm (None, 213) 852 ['inputs_concat[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:alization) \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:dense (Dense) (None, 64) 13696 ['batch_normalization[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:batch_normalization_1 (BatchNo (None, 64) 256 ['dense[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:rmalization) \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:dense_1 (Dense) (None, 64) 4160 ['batch_normalization_1[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:batch_normalization_2 (BatchNo (None, 64) 256 ['dense_1[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:rmalization) \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:dense_2 (Dense) (None, 64) 4160 ['batch_normalization_2[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:batch_normalization_3 (BatchNo (None, 64) 256 ['dense_2[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:rmalization) \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:dense_3 (Dense) (None, 32) 2080 ['batch_normalization_3[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 09:04:19 2021[1,0]:output (Dense) (None, 1) 33 ['dense_3[0][0]'] \n", - "Mon Sep 6 09:04:19 2021[1,0]:==================================================================================================\n", - "Mon Sep 6 09:04:19 2021[1,0]:Total params: 261,698,789\n", - "Mon Sep 6 09:04:19 2021[1,0]:Trainable params: 261,697,979\n", - "Mon Sep 6 09:04:19 2021[1,0]:Non-trainable params: 810\n", - "Mon Sep 6 09:04:19 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:19 2021[1,14]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 09:04:19 2021[1,14]: warnings.warn(\n", - "Mon Sep 6 09:04:19 2021[1,14]:2021-09-06 09:04:19.369461: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:04:19 2021[1,14]:2021-09-06 09:04:19.369483: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:04:19 2021[1,14]:2021-09-06 09:04:19.369533: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 09:04:19 2021[1,2]:2021-09-06 09:04:19.714971: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:19 2021[1,2]:2021-09-06 09:04:19.719251: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:19 2021[1,5]:2021-09-06 09:04:19.726330: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:19 2021[1,5]:2021-09-06 09:04:19.730619: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:19 2021[1,1]:2021-09-06 09:04:19.849382: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:19 2021[1,1]:2021-09-06 09:04:19.852162: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:19 2021[1,9]:2021-09-06 09:04:19.976160: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:19 2021[1,9]:2021-09-06 09:04:19.979006: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,15]:2021-09-06 09:04:20.045149: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,15]:2021-09-06 09:04:20.047988: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,11]:2021-09-06 09:04:20.289338: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,11]:2021-09-06 09:04:20.292348: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,4]:2021-09-06 09:04:20.312786: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,4]:2021-09-06 09:04:20.315716: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,3]:2021-09-06 09:04:20.391964: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,3]:2021-09-06 09:04:20.394729: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,12]:2021-09-06 09:04:20.510335: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,12]:2021-09-06 09:04:20.514644: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,8]:2021-09-06 09:04:20.573990: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,7]:2021-09-06 09:04:20.577094: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,8]:2021-09-06 09:04:20.583448: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,7]:2021-09-06 09:04:20.591334: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,13]:2021-09-06 09:04:20.631241: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,10]:2021-09-06 09:04:20.639145: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,13]:2021-09-06 09:04:20.639919: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,10]:2021-09-06 09:04:20.641938: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,0]:2021-09-06 09:04:20.642622: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,0]:2021-09-06 09:04:20.645310: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,14]:2021-09-06 09:04:20.672134: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,14]:2021-09-06 09:04:20.676577: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:04:20 2021[1,6]:2021-09-06 09:04:20.851373: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:04:20 2021[1,6]:2021-09-06 09:04:20.855704: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:45 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:45 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,0]:NCCL version 2.10.3+cuda11.0\n", - "Mon Sep 6 09:04:46 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:46 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 09:04:46 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 09:04:46 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 09:04:46 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 09:04:46 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Trees [0] 1/-1/-1->13->9 [1] 1/-1/-1->13->9 [2] 1/-1/-1->13->9 [3] 1/-1/-1->13->9 [4] 1/-1/-1->13->9 [5] 1/-1/-1->13->9 [6] 1/-1/-1->13->9 [7] 1/-1/-1->13->9 [8] 1/-1/-1->13->9 [9] 1/-1/-1->13->9 [10] 1/-1/-1->13->9 [11] 1/-1/-1->13->9\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Setting affinity for GPU 4 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Trees [0] 6/-1/-1->12->11 [1] 6/-1/-1->12->11 [2] 6/-1/-1->12->11 [3] 6/-1/-1->12->11 [4] 6/-1/-1->12->11 [5] 6/-1/-1->12->11 [6] 6/-1/-1->12->11 [7] 6/-1/-1->12->11 [8] 6/-1/-1->12->11 [9] 6/-1/-1->12->11 [10] 6/-1/-1->12->11 [11] 6/-1/-1->12->11\n", - "Mon Sep 6 09:04:57 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Setting affinity for GPU 2 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Trees [0] 4/-1/-1->15->3 [1] 4/-1/-1->15->3 [2] 4/-1/-1->15->3 [3] 4/-1/-1->15->3 [4] 4/-1/-1->15->3 [5] 4/-1/-1->15->3 [6] 4/-1/-1->15->3 [7] 4/-1/-1->15->3 [8] 4/-1/-1->15->3 [9] 4/-1/-1->15->3 [10] 4/-1/-1->15->3 [11] 4/-1/-1->15->3\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Setting affinity for GPU 14 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Trees [0] -1/-1/-1->14->4 [1] -1/-1/-1->14->4 [2] -1/-1/-1->14->4 [3] -1/-1/-1->14->4 [4] -1/-1/-1->14->4 [5] -1/-1/-1->14->4 [6] -1/-1/-1->14->4 [7] -1/-1/-1->14->4 [8] -1/-1/-1->14->4 [9] -1/-1/-1->14->4 [10] -1/-1/-1->14->4 [11] -1/-1/-1->14->4\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Setting affinity for GPU 12 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 00/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 01/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 02/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 03/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 04/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 05/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 06/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 07/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 08/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Trees [0] 5/-1/-1->1->13 [1] 5/-1/-1->1->13 [2] 5/-1/-1->1->13 [3] 5/-1/-1->1->13 [4] 5/-1/-1->1->13 [5] 5/-1/-1->1->13 [6] 5/-1/-1->1->13 [7] 5/-1/-1->1->13 [8] 5/-1/-1->1->13 [9] 5/-1/-1->1->13 [10] 5/-1/-1->1->13 [11] 5/-1/-1->1->13\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Setting affinity for GPU 11 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 09/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 10/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 11/12 : 0 8 11 12 6 10 9 13 1 5 2 7 3 15 4 14\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Trees [0] 8/-1/-1->0->-1 [1] 8/-1/-1->0->-1 [2] 8/-1/-1->0->-1 [3] 8/-1/-1->0->-1 [4] 8/-1/-1->0->-1 [5] 8/-1/-1->0->-1 [6] 8/-1/-1->0->-1 [7] 8/-1/-1->0->-1 [8] 8/-1/-1->0->-1 [9] 8/-1/-1->0->-1 [10] 8/-1/-1->0->-1 [11] 8/-1/-1->0->-1\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Trees [0] 12/-1/-1->11->8 [1] 12/-1/-1->11->8 [2] 12/-1/-1->11->8 [3] 12/-1/-1->11->8 [4] 12/-1/-1->11->8 [5] 12/-1/-1->11->8 [6] 12/-1/-1->11->8 [7] 12/-1/-1->11->8 [8] 12/-1/-1->11->8 [9] 12/-1/-1->11->8 [10] 12/-1/-1->11->8 [11] 12/-1/-1->11->8\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Setting affinity for GPU 3 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Trees [0] 7/-1/-1->2->5 [1] 7/-1/-1->2->5 [2] 7/-1/-1->2->5 [3] 7/-1/-1->2->5 [4] 7/-1/-1->2->5 [5] 7/-1/-1->2->5 [6] 7/-1/-1->2->5 [7] 7/-1/-1->2->5 [8] 7/-1/-1->2->5 [9] 7/-1/-1->2->5 [10] 7/-1/-1->2->5 [11] 7/-1/-1->2->5\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Setting affinity for GPU 8 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Trees [0] 2/-1/-1->5->1 [1] 2/-1/-1->5->1 [2] 2/-1/-1->5->1 [3] 2/-1/-1->5->1 [4] 2/-1/-1->5->1 [5] 2/-1/-1->5->1 [6] 2/-1/-1->5->1 [7] 2/-1/-1->5->1 [8] 2/-1/-1->5->1 [9] 2/-1/-1->5->1 [10] 2/-1/-1->5->1 [11] 2/-1/-1->5->1\n", - "Mon Sep 6 09:04:57 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Setting affinity for GPU 10 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Trees [0] 3/-1/-1->7->2 [1] 3/-1/-1->7->2 [2] 3/-1/-1->7->2 [3] 3/-1/-1->7->2 [4] 3/-1/-1->7->2 [5] 3/-1/-1->7->2 [6] 3/-1/-1->7->2 [7] 3/-1/-1->7->2 [8] 3/-1/-1->7->2 [9] 3/-1/-1->7->2 [10] 3/-1/-1->7->2 [11] 3/-1/-1->7->2\n", - "Mon Sep 6 09:04:57 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Setting affinity for GPU 9 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Trees [0] 15/-1/-1->3->7 [1] 15/-1/-1->3->7 [2] 15/-1/-1->3->7 [3] 15/-1/-1->3->7 [4] 15/-1/-1->3->7 [5] 15/-1/-1->3->7 [6] 15/-1/-1->3->7 [7] 15/-1/-1->3->7 [8] 15/-1/-1->3->7 [9] 15/-1/-1->3->7 [10] 15/-1/-1->3->7 [11] 15/-1/-1->3->7\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Setting affinity for GPU 15 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Setting affinity for GPU 1 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Trees [0] 14/-1/-1->4->15 [1] 14/-1/-1->4->15 [2] 14/-1/-1->4->15 [3] 14/-1/-1->4->15 [4] 14/-1/-1->4->15 [5] 14/-1/-1->4->15 [6] 14/-1/-1->4->15 [7] 14/-1/-1->4->15 [8] 14/-1/-1->4->15 [9] 14/-1/-1->4->15 [10] 14/-1/-1->4->15 [11] 14/-1/-1->4->15\n", - "Mon Sep 6 09:04:57 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Setting affinity for GPU 13 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Trees [0] 10/-1/-1->6->12 [1] 10/-1/-1->6->12 [2] 10/-1/-1->6->12 [3] 10/-1/-1->6->12 [4] 10/-1/-1->6->12 [5] 10/-1/-1->6->12 [6] 10/-1/-1->6->12 [7] 10/-1/-1->6->12 [8] 10/-1/-1->6->12 [9] 10/-1/-1->6->12 [10] 10/-1/-1->6->12 [11] 10/-1/-1->6->12\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Setting affinity for GPU 6 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Trees [0] 11/-1/-1->8->0 [1] 11/-1/-1->8->0 [2] 11/-1/-1->8->0 [3] 11/-1/-1->8->0 [4] 11/-1/-1->8->0 [5] 11/-1/-1->8->0 [6] 11/-1/-1->8->0 [7] 11/-1/-1->8->0 [8] 11/-1/-1->8->0 [9] 11/-1/-1->8->0 [10] 11/-1/-1->8->0 [11] 11/-1/-1->8->0\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Setting affinity for GPU 0 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Trees [0] 13/-1/-1->9->10 [1] 13/-1/-1->9->10 [2] 13/-1/-1->9->10 [3] 13/-1/-1->9->10 [4] 13/-1/-1->9->10 [5] 13/-1/-1->9->10 [6] 13/-1/-1->9->10 [7] 13/-1/-1->9->10 [8] 13/-1/-1->9->10 [9] 13/-1/-1->9->10 [10] 13/-1/-1->9->10 [11] 13/-1/-1->9->10\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Setting affinity for GPU 5 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Trees [0] 9/-1/-1->10->6 [1] 9/-1/-1->10->6 [2] 9/-1/-1->10->6 [3] 9/-1/-1->10->6 [4] 9/-1/-1->10->6 [5] 9/-1/-1->10->6 [6] 9/-1/-1->10->6 [7] 9/-1/-1->10->6 [8] 9/-1/-1->10->6 [9] 9/-1/-1->10->6 [10] 9/-1/-1->10->6 [11] 9/-1/-1->10->6\n", - "Mon Sep 6 09:04:57 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Setting affinity for GPU 7 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 00 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 00 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 00 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 00 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 00 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 00 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 00 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 01 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 01 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 01 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 01 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 01 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 01 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 01 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 02 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 02 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 02 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 02 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 02 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 02 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 02 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 03 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 03 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 03 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 03 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 03 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 03 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 03 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 04 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 04 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 04 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 04 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 04 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 04 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 04 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 05 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 05 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 05 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 05 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 05 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 05 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 05 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 06 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 06 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 06 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 06 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 06 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 06 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 06 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 07 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 07 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 07 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 07 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 07 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 07 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 07 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 08 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 08 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 08 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 08 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 08 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 08 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 08 : 2[b7000] -> 7[b9000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 09 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 09 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 09 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 09 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 09 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 09 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 09 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 10 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 10 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 10 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 10 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 10 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 10 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 10 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 11 : 15[e5000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 11 : 6[5c000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 11 : 9[59000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 11 : 8[34000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 11 : 11[3b000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 11 : 14[e0000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 11 : 2[b7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 00 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 00 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 00 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 01 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 01 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 01 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 02 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 02 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 02 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 03 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 03 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 03 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 04 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 04 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 05 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 04 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 05 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 05 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 06 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 06 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 07 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 06 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 07 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 07 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 08 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 08 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 08 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 09 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 09 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 09 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 10 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 10 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 10 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 11 : 13[57000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 11 : 1[be000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 11 : 3[e7000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 00 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 01 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:57 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 02 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 03 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 00 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 04 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 01 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 05 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 02 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 06 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 03 : 10[5e000] -> 9[59000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 07 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 04 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 08 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 05 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 09 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 06 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 00 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 10 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 07 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 01 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 11 : 12[39000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 08 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 02 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 09 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 03 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 10 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 04 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 11 : 10[5e000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 05 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 06 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 00 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 07 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 01 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 08 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 02 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 09 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 03 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 10 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 04 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 11 : 7[b9000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 05 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 06 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 00 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 07 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 01 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 08 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 02 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 09 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 03 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 10 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 04 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Channel 11 : 0[36000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 05 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 06 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 07 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 08 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 09 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 10 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 11 : 4[e2000] -> 14[e0000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 00 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 01 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 02 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 03 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 00 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 04 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 01 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 05 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 02 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 06 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 03 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 07 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 04 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 08 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 05 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 09 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 06 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 00 : 6[5c000] -> 12[39000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 10 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 07 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 01 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 11 : 5[bc000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 08 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 02 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 09 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 03 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 10 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 04 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Channel 11 : 11[3b000] -> 8[34000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 05 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 06 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 07 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 08 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 09 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 10 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Channel 11 : 6[5c000] -> 12[39000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 00 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 00 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 00 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 01 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 01 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 01 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 02 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 02 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 02 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 00 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 03 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 03 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 03 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 01 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 04 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 04 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 04 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 02 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 05 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 05 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 05 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 06 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 03 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 06 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 06 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 04 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 07 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 07 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 07 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 05 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 08 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 08 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 08 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 06 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 09 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 09 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 00 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 09 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 07 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 10 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 10 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 01 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 10 : 12[39000] -> 11[3b000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 08 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Channel 11 : 1[be000] -> 13[57000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Channel 11 : 15[e5000] -> 3[e7000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 02 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Channel 11 : 12[39000] -> 11[3b000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 09 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 03 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 10 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 00 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 04 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 01 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Channel 11 : 13[57000] -> 9[59000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 05 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 02 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 06 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 03 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 00 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 07 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 04 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 01 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 08 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 05 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 02 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 09 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 06 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 03 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 10 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 07 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 04 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Channel 11 : 14[e0000] -> 4[e2000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 08 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 05 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 09 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 06 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 00 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 10 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 07 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 01 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Channel 11 : 9[59000] -> 10[5e000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 08 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 02 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 09 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 03 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 10 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 04 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Channel 11 : 2[b7000] -> 5[bc000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 05 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 06 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 00 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 07 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 01 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 08 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 02 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 09 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 03 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 10 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 00 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 04 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 01 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Channel 11 : 8[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 05 : 4[e2000] -> 15[e5000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 02 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 06 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 03 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 00 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 07 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 04 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 01 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 08 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 05 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 00 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 02 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 09 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 06 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 01 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 03 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 10 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 07 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 04 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 02 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Channel 11 : 4[e2000] -> 15[e5000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 08 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 05 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 03 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 09 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 06 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 04 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 10 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 07 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 05 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Channel 11 : 10[5e000] -> 6[5c000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 08 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 06 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 09 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 07 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 10 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 08 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Channel 11 : 5[bc000] -> 1[be000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 09 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 10 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:58 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Channel 11 : 3[e7000] -> 7[b9000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 00 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 01 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 02 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 03 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 04 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 05 : 7[b9000] -> 2[b7000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:04:59 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 06 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 07 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 08 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 09 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 10 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Channel 11 : 7[b9000] -> 2[b7000] via P2P/IPC\n", - "Mon Sep 6 09:04:59 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 09:04:59 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 09:04:59 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 09:04:59 2021[1,4]:dgx2h0194:79732:80427 [0] NCCL INFO comm 0x7f159c62d200 rank 4 nranks 16 cudaDev 0 busId e2000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,7]:dgx2h0194:79740:80605 [0] NCCL INFO comm 0x7fec6462ce60 rank 7 nranks 16 cudaDev 0 busId b9000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,15]:dgx2h0194:79748:80424 [0] NCCL INFO comm 0x7fbe3862ca40 rank 15 nranks 16 cudaDev 0 busId e5000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,12]:dgx2h0194:79745:80741 [0] NCCL INFO comm 0x7f00e462e120 rank 12 nranks 16 cudaDev 0 busId 39000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,2]:dgx2h0194:79722:80271 [0] NCCL INFO comm 0x7f9c0062da40 rank 2 nranks 16 cudaDev 0 busId b7000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,8]:dgx2h0194:79741:80747 [0] NCCL INFO comm 0x7f3e2462d9e0 rank 8 nranks 16 cudaDev 0 busId 34000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,10]:dgx2h0194:79743:80602 [0] NCCL INFO comm 0x7f50ac62cfb0 rank 10 nranks 16 cudaDev 0 busId 5e000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,11]:dgx2h0194:79744:80434 [0] NCCL INFO comm 0x7f47c062cad0 rank 11 nranks 16 cudaDev 0 busId 3b000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,5]:dgx2h0194:79738:80437 [0] NCCL INFO comm 0x7f7c2c62d050 rank 5 nranks 16 cudaDev 0 busId bc000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,6]:dgx2h0194:79739:80608 [0] NCCL INFO comm 0x7f10a862d190 rank 6 nranks 16 cudaDev 0 busId 5c000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,1]:dgx2h0194:79717:80738 [0] NCCL INFO comm 0x7f635462cf70 rank 1 nranks 16 cudaDev 0 busId be000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO comm 0x7fa9b065f3d0 rank 0 nranks 16 cudaDev 0 busId 36000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,9]:dgx2h0194:79742:80744 [0] NCCL INFO comm 0x7f330c62cf00 rank 9 nranks 16 cudaDev 0 busId 59000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,3]:dgx2h0194:79727:80587 [0] NCCL INFO comm 0x7f786062ca30 rank 3 nranks 16 cudaDev 0 busId e7000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,13]:dgx2h0194:79746:80607 [0] NCCL INFO comm 0x7ff78062ce20 rank 13 nranks 16 cudaDev 0 busId 57000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,14]:dgx2h0194:79747:80615 [0] NCCL INFO comm 0x7fa09462d170 rank 14 nranks 16 cudaDev 0 busId e0000 - Init COMPLETE\n", - "Mon Sep 6 09:04:59 2021[1,0]:dgx2h0194:79712:80584 [0] NCCL INFO Launch mode Parallel\n", - "Mon Sep 6 09:04:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:08 2021[1,3]:2021-09-06 09:05:08.906524: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,3]:2021-09-06 09:05:08.906568: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,9]:2021-09-06 09:05:08.907713: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,9]:2021-09-06 09:05:08.907738: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,11]:2021-09-06 09:05:08.915421: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,11]:2021-09-06 09:05:08.915453: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,1]:2021-09-06 09:05:08.920370: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,1]:2021-09-06 09:05:08.920406: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,15]:2021-09-06 09:05:08.931629: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,15]:2021-09-06 09:05:08.931668: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,0]:2021-09-06 09:05:08.935354: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,0]:2021-09-06 09:05:08.935382: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,4]:2021-09-06 09:05:08.941341: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,4]:2021-09-06 09:05:08.941368: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,6]:2021-09-06 09:05:08.945179: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,6]:2021-09-06 09:05:08.945222: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,12]:2021-09-06 09:05:08.953442: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,12]:2021-09-06 09:05:08.953478: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,5]:2021-09-06 09:05:08.955782: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,5]:2021-09-06 09:05:08.955817: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,13]:2021-09-06 09:05:08.955878: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,13]:2021-09-06 09:05:08.955902: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,2]:2021-09-06 09:05:08.964502: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,2]:2021-09-06 09:05:08.964533: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,10]:2021-09-06 09:05:08.966637: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,10]:2021-09-06 09:05:08.966668: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,7]:2021-09-06 09:05:08.975908: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,7]:2021-09-06 09:05:08.975936: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,8]:2021-09-06 09:05:08.977191: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,8]:2021-09-06 09:05:08.977212: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:08 2021[1,14]:2021-09-06 09:05:08.977981: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 09:05:08 2021[1,14]:2021-09-06 09:05:08.978007: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.305228: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.305433: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.305459: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.305543: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.306514: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.306618: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.306708: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.307508: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.309214: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.309215: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.309278: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.309264: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.309370: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.310410: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.310457: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.310481: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.310655: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.311490: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.316781: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.319146: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 1/4000 [..............................]Mon Sep 6 09:04:59 2021[1,0]: - ETA: 31:27:06 - loss: 0.9112 - auc: 0.4892Mon Sep 6 09:05:10 2021[1,0]:\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.342218: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.342267: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.342284: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.342547: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.342667: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.343662: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.343704: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.344116: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.344609: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.345052: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.345700: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.346509: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.358042: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2649 callback api events and 2583 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.358854: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2649 callback api events and 2583 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.359228: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.360356: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.364826: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.367892: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.368670: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2652 callback api events and 2586 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.369775: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2649 callback api events and 2583 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.373559: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2651 callback api events and 2585 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.383506: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.392125: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.392648: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.393439: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.393559: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.400431: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.402509: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.402749: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.405715: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.410689: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.415497: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.415594: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.415980: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.419823: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.424162: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.426899: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.436674: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.437051: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.437544: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2648 callback api events and 2582 activity events. \n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.437594: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.440492: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.452744: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,2]:\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.453531: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.454222: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,13]:\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.454482: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,7]:\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.467085: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:10 2021[1,5]:\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.468653: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,9]:\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.469858: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,6]:\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.471366: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,15]:\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.477411: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,4]:\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.478317: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.479776: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,10]:\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.480068: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.481862: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.482391: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.483605: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,3]:\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.485892: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,12]:\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.488111: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,1]:\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.488549: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,0]:\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.492599: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,11]:\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.495745: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.497173: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.498271: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.502046: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.505250: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,8]:\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.505717: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.510133: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.511769: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.513653: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.516357: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.516749: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.520974: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.533211: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,14]:\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.533268: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.543716: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,2]:\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.544599: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,13]:\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.545527: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,7]:\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.551058: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.551684: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.552556: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,2]:2021-09-06 09:05:10.554892: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,2]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:10 2021[1,2]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,2]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,2]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,2]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,2]:\n", - "Mon Sep 6 09:05:10 2021[1,13]:2021-09-06 09:05:10.555408: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,13]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,13]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,13]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,13]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,13]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,13]:\n", - "Mon Sep 6 09:05:10 2021[1,7]:2021-09-06 09:05:10.556035: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,7]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,7]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,7]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,7]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,7]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,7]:\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.559516: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,9]:\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.560753: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,5]:\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.562556: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,6]:\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.566678: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.568086: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.569781: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,9]:2021-09-06 09:05:10.570665: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,9]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,9]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,9]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,9]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,9]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,9]:\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.572285: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,5]:2021-09-06 09:05:10.572728: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,5]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,5]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,5]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,5]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,5]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,5]:\n", - "Mon Sep 6 09:05:10 2021[1,6]:2021-09-06 09:05:10.573924: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,6]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,6]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,6]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,6]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,6]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,6]:\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.578011: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,12]:\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.580067: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,3]:\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.581250: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,4]:\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.581588: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,0]:\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.585279: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.585794: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,11]:\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.586581: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,15]:\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.587215: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,12]:2021-09-06 09:05:10.589198: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,12]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,12]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,12]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,12]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,12]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,12]:\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.589550: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.590763: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,3]:2021-09-06 09:05:10.591167: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,3]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,3]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,3]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,3]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,3]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,3]:\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.593091: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,0]:2021-09-06 09:05:10.594288: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,0]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,0]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,0]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,0]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,0]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,0]:\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.596368: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,4]:2021-09-06 09:05:10.596671: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,4]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,4]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,4]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,4]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,4]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,4]:\n", - "Mon Sep 6 09:05:10 2021[1,11]:2021-09-06 09:05:10.597264: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,11]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,11]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,11]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,11]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,11]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,11]:\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.598865: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,10]:\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.601237: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,1]:\n", - "Mon Sep 6 09:05:10 2021[1,15]:2021-09-06 09:05:10.601247: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,15]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,15]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,15]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,15]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,15]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,15]:\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.601392: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:10 2021[1,8]:\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.609086: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.609124: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.609444: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,8]:2021-09-06 09:05:10.614234: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,8]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,8]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,8]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,8]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,8]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,8]:\n", - "Mon Sep 6 09:05:10 2021[1,10]:2021-09-06 09:05:10.614705: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,10]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,10]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,10]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,10]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,10]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,10]:\n", - "Mon Sep 6 09:05:10 2021[1,1]:2021-09-06 09:05:10.617210: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,1]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,1]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,1]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,1]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,1]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,1]:\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.677166: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,14]:\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.684214: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 09:05:10 2021[1,14]:2021-09-06 09:05:10.687649: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_09_05_10\n", - "Mon Sep 6 09:05:10 2021[1,14]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.xplane.pb\n", - "Mon Sep 6 09:05:10 2021[1,14]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 09:05:10 2021[1,14]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 09:05:10 2021[1,14]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,14]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_09_05_10/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 09:05:10 2021[1,14]:\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 5/4000 [..............................]Mon Sep 6 09:05:11 2021[1,0]: - ETA: 3:15:09 - loss: 0.8028 - auc: 0.4982Mon Sep 6 09:05:11 2021[1,0]Mon Sep 6 09:05:10 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:05:11 2021[1,12]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1455s vs `on_train_batch_begin` time: 0.1987s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,12]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1455s vs `on_train_batch_end` time: 1.6635s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,3]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1708s vs `on_train_batch_begin` time: 0.2090s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,3]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1708s vs `on_train_batch_end` time: 1.6582s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,10]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1720s vs `on_train_batch_end` time: 1.6715s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,7]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1905s vs `on_train_batch_end` time: 1.6623s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,8]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1486s vs `on_train_batch_begin` time: 0.1849s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,13]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1773s vs `on_train_batch_begin` time: 0.2086s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,13]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1773s vs `on_train_batch_end` time: 1.6576s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,5]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1958s vs `on_train_batch_end` time: 1.6611s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,1]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1316s vs `on_train_batch_begin` time: 0.2118s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,1]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1316s vs `on_train_batch_end` time: 1.6669s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,8]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1486s vs `on_train_batch_end` time: 1.6714s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,4]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1880s vs `on_train_batch_end` time: 1.6633s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,6]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1824s vs `on_train_batch_end` time: 1.6600s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,2]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1603s vs `on_train_batch_begin` time: 0.2171s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,11]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1957s vs `on_train_batch_end` time: 1.6587s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,2]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1603s vs `on_train_batch_end` time: 1.6624s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,15]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1938s vs `on_train_batch_end` time: 1.6640s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,9]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1979s vs `on_train_batch_end` time: 1.6555s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,14]:WARNING:tensorflow:Callback method `on_train_batch_begin` is slow compared to the batch time (batch time: 0.1465s vs `on_train_batch_begin` time: 0.1744s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,14]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1465s vs `on_train_batch_end` time: 1.6863s). Check your callbacks.\n", - "Mon Sep 6 09:05:11 2021[1,0]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.1925s vs `on_train_batch_end` time: 1.6647s). Check your callbacks.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 212/4000 [>.............................]Mon Sep 6 09:05:52 2021[1,0]: - ETA: 15:58 - loss: 0.1657 - auc: 0.6865Mon Sep 6 09:05:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 513/4000 [==>...........................]Mon Sep 6 09:06:52 2021[1,0]: - ETA: 12:52 - loss: 0.1432 - auc: 0.7375Mon Sep 6 09:06:52 2021[1,0] (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 799/4000 [====>.........................]Mon Sep 6 09:07:50 2021[1,0]: - ETA: 11:25 - loss: 0.1371 - auc: 0.7529Mon Sep 6 09:07:52 2021[1,0] (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1102/4000 [=======>......................]Mon Sep 6 09:08:52 2021[1,0]: - ETA: 10:14 - loss: 0.1339 - auc: 0.7614Mon Sep 6 09:08:52 2021[1,0] (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1398/4000 [=========>....................]Mon Sep 6 09:09:49 2021[1,0]: - ETA: 9:01 - loss: 0.1321 - auc: 0.7666Mon Sep 6 09:09:50 2021[1,0]3Mon Sep 6 09:09:47 2021[1,0]>\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1702/4000 [===========>..................]Mon Sep 6 09:10:52 2021[1,0]: - ETA: 7:57 - loss: 0.1308 - auc: 0.7706Mon Sep 6 09:10:52 2021[1,0]5Mon Sep 6 09:10:52 2021[1,0]Mon Sep 6 09:10:08 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 09:11:50 2021[1,0]:1998/4000 [=============>................] - ETA: 6:52 - loss: 0.1299 - auc: 0.7735Mon Sep 6 09:11:50 2021[1,0]1Mon Sep 6 09:11:42 2021[1,0]Mon Sep 6 09:10:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2300/4000 [================>.............]Mon Sep 6 09:12:52 2021[1,0]: - ETA: 5:50 - loss: 0.1292 - auc: 0.7758Mon Sep 6 09:12:52 2021[1,0]8Mon Sep 6 09:12:52 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2599/4000 [==================>...........]Mon Sep 6 09:13:50 2021[1,0]: - ETA: 4:46 - loss: 0.1286 - auc: 0.7776Mon Sep 6 09:13:53 2021[1,0]6Mon Sep 6 09:13:50 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2910/4000 [====================>.........]Mon Sep 6 09:14:52 2021[1,0]: - ETA: 3:42 - loss: 0.1282 - auc: 0.7792Mon Sep 6 09:14:53 2021[1,0]2Mon Sep 6 09:14:52 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3199/4000 [======================>.......]Mon Sep 6 09:15:49 2021[1,0]: - ETA: 2:42 - loss: 0.1278 - auc: 0.7805Mon Sep 6 09:15:51 2021[1,0]5Mon Sep 6 09:15:48 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3512/4000 [=========================>....]Mon Sep 6 09:16:52 2021[1,0]: - ETA: 1:39 - loss: 0.1274 - auc: 0.7816Mon Sep 6 09:16:53 2021[1,0]6Mon Sep 6 09:16:52 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3799/4000 [===========================>..]Mon Sep 6 09:17:50 2021[1,0]: - ETA: 40s - loss: 0.1272 - auc: 0.7826Mon Sep 6 09:17:52 2021[1,0]\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "4000/4000 [==============================]Mon Sep 6 09:18:36 2021[1,0]: - 845s 204ms/step - loss: 0.1270 - auc: 0.7832 - val_loss: 0.1273 - val_auc: 0.7933 6 09:18:22 2021[1,0]\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Best Loss: 0.127242\n" - ] - } - ], - "source": [ - "main()" - ] - }, - { - "cell_type": "markdown", - "id": "5a1c01ad", - "metadata": {}, - "source": [ - "## Use Petastorm\n", - "\n", - "Here we set `--dataloader` to `petastorm` to force Petastorm run." - ] - }, - { - "cell_type": "code", - "execution_count": 9, - "id": "fee60d10", - "metadata": {}, - "outputs": [], - "source": [ - "def main_petastorm():\n", - " parser = argparse.ArgumentParser(description='Criteo Spark Keras Training Example',\n", - " formatter_class=argparse.ArgumentDefaultsHelpFormatter)\n", - " parser.add_argument('--data-dir', default='file:///opt/data/criteo/parquet',\n", - " help='location of the transformed Criteo dataset in Parquet format')\n", - " parser.add_argument('--logs-dir', default='/opt/experiments/criteo', help='location of TensorFlow logs')\n", - " parser.add_argument('--dataloader', default=PETASTORM_DATALOADER,\n", - " choices=[PETASTORM_DATALOADER, NVTABULAR_DATALOADER],\n", - " help='dataloader to use')\n", - " parser.add_argument('--num-proc', type=int, default=1, help='number of worker processes for training')\n", - " parser.add_argument('--learning-rate', type=float, default=0.0001, help='initial learning rate')\n", - " parser.add_argument('--batch-size', type=int, default=64 * 1024, help='batch size')\n", - " parser.add_argument('--epochs', type=int, default=3, help='number of epochs to train')\n", - " parser.add_argument('--local-checkpoint-file', default='checkpoint', help='model checkpoint')\n", - " args = parser.parse_args(args=['--num-proc', '16', '--data-dir', 'file:///raid/spark-team/criteo/parquet', \n", - " '--dataloader', 'petastorm', '--learning-rate', '0.001',\n", - " '--batch-size', '65535','--epochs', '1', '--logs-dir', 'tf_logs',\n", - " '--local-checkpoint-file', 'ckpt_file'])\n", - " \n", - "\n", - " dimensions = get_category_dimensions(spark, args.data_dir)\n", - "\n", - " train_df = spark.read.parquet(f'{args.data_dir}/train')\n", - " val_df = spark.read.parquet(f'{args.data_dir}/val')\n", - " test_df = spark.read.parquet(f'{args.data_dir}/test')\n", - " train_rows, val_rows, test_rows = train_df.count(), val_df.count(), test_df.count()\n", - " print('Training: %d' % train_rows)\n", - " print('Validation: %d' % val_rows)\n", - " print('Test: %d' % test_rows)\n", - "\n", - " train(dimensions, train_rows, val_rows, args)\n", - "\n", - " spark.stop()" - ] - }, - { - "cell_type": "code", - "execution_count": 10, - "id": "1cb35049", - "metadata": {}, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "21/09/06 11:44:44 WARN package: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.sql.debug.maxToStringFields'.\n", - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "{'c0': '7912888',\n", - " 'c1': '33822',\n", - " 'c10': '582468',\n", - " 'c11': '245827',\n", - " 'c12': '10',\n", - " 'c13': '2208',\n", - " 'c14': '10666',\n", - " 'c15': '103',\n", - " 'c16': '3',\n", - " 'c17': '967',\n", - " 'c18': '14',\n", - " 'c19': '8165895',\n", - " 'c2': '17138',\n", - " 'c20': '2675939',\n", - " 'c21': '7156452',\n", - " 'c22': '302515',\n", - " 'c23': '12021',\n", - " 'c24': '96',\n", - " 'c25': '34',\n", - " 'c3': '7338',\n", - " 'c4': '20045',\n", - " 'c5': '3',\n", - " 'c6': '7104',\n", - " 'c7': '1381',\n", - " 'c8': '62',\n", - " 'c9': '5554113'}\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Training: 4195197692\n", - "Validation: 89137318\n", - "Test: 89137319\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Checking whether extension tensorflow was built with MPI.\n", - "Extension tensorflow was built with MPI.\n", - "mpirun --allow-run-as-root --tag-output -np 16 -H dgx2h0194-a1adff968d508e8d1142986f3e2c42dc:16 -bind-to none -map-by slot -mca pml ob1 -mca btl ^openib --timestamp-output -mca btl_tcp_if_include enp134s0f0 -x NCCL_IB_GID_INDEX=3 -x NCCL_DEBUG=INFO -mca plm_rsh_agent \"/home/ngc-auth-ldap-allxu/miniconda3/bin/python -m horovod.spark.driver.mpirun_rsh gAWVcAEAAAAAAAB9lCiMAmxvlF2UjAkxMjcuMC4wLjGUTU5+hpRhjAdlbnA1M3MwlF2UjAwxMC4xNDguMzAuNTmUTU5+hpRhjAdlbnA1OHMwlF2UjAwxMC4xNDguOTQuNTmUTU5+hpRhjAdlbnA4OHMwlF2UjAwxMC4xNDkuMzAuMzSUTU5+hpRhjAdlbnA5M3MwlF2UjAwxMC4xNDkuOTQuNTeUTU5+hpRhjAplbnAxMzRzMGYwlF2UjAsxMC4xNTAuMzAuMpRNTn6GlGGMCGVucDE4NHMwlF2UjA0xMC4xNDguMTU4LjU5lE1OfoaUYYwIZW5wMTg5czCUXZSMDTEwLjE0OC4yMjIuNTmUTU5+hpRhjAhlbnAyMjVzMJRdlIwNMTAuMTQ5LjE1OC41N5RNTn6GlGGMCGVucDIzMHMwlF2UjA0xMC4xNDkuMjIyLjU3lE1OfoaUYYwHZG9ja2VyMJRdlIwKMTcyLjE3LjAuMZRNTn6GlGF1Lg== gAWVAwMAAAAAAACMI2hvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnNldHRpbmdzlIwIU2V0dGluZ3OUk5QpgZR9lCiMCG51bV9wcm9jlEsQjAd2ZXJib3NllEsCjAhzc2hfcG9ydJROjBFzc2hfaWRlbnRpdHlfZmlsZZROjA5leHRyYV9tcGlfYXJnc5SMOS1tY2EgYnRsX3RjcF9pZl9pbmNsdWRlIGVucDEzNHMwZjAgLXggTkNDTF9JQl9HSURfSU5ERVg9M5SMCHRjcF9mbGFnlE6MDGJpbmRpbmdfYXJnc5ROjANrZXmUTowNc3RhcnRfdGltZW91dJSMImhvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnRpbWVvdXSUjAdUaW1lb3V0lJOUKYGUfZQojAhfdGltZW91dJRNWAKMC190aW1lb3V0X2F0lEdB2E2AYtTXh4wIX21lc3NhZ2WUWA4BAABUaW1lZCBvdXQgd2FpdGluZyBmb3Ige2FjdGl2aXR5fS4gUGxlYXNlIGNoZWNrIHRoYXQgeW91IGhhdmUgZW5vdWdoIHJlc291cmNlcyB0byBydW4gYWxsIEhvcm92b2QgcHJvY2Vzc2VzLiBFYWNoIEhvcm92b2QgcHJvY2VzcyBydW5zIGluIGEgU3BhcmsgdGFzay4gWW91IG1heSBuZWVkIHRvIGluY3JlYXNlIHRoZSBzdGFydF90aW1lb3V0IHBhcmFtZXRlciB0byBhIGxhcmdlciB2YWx1ZSBpZiB5b3VyIFNwYXJrIHJlc291cmNlcyBhcmUgYWxsb2NhdGVkIG9uLWRlbWFuZC6UdWKMD291dHB1dF9maWxlbmFtZZROjA1ydW5fZnVuY19tb2RllIiMBG5pY3OUfZSMB2VsYXN0aWOUiYwccHJlZml4X291dHB1dF93aXRoX3RpbWVzdGFtcJSIjAVob3N0c5SMLWRneDJoMDE5NC1hMWFkZmY5NjhkNTA4ZThkMTE0Mjk4NmYzZTJjNDJkYzoxNpR1Yi4=\" /home/ngc-auth-ldap-allxu/miniconda3/bin/python -m horovod.spark.task.mpirun_exec_fn gAWVcAEAAAAAAAB9lCiMAmxvlF2UjAkxMjcuMC4wLjGUTU5+hpRhjAdlbnA1M3MwlF2UjAwxMC4xNDguMzAuNTmUTU5+hpRhjAdlbnA1OHMwlF2UjAwxMC4xNDguOTQuNTmUTU5+hpRhjAdlbnA4OHMwlF2UjAwxMC4xNDkuMzAuMzSUTU5+hpRhjAdlbnA5M3MwlF2UjAwxMC4xNDkuOTQuNTeUTU5+hpRhjAplbnAxMzRzMGYwlF2UjAsxMC4xNTAuMzAuMpRNTn6GlGGMCGVucDE4NHMwlF2UjA0xMC4xNDguMTU4LjU5lE1OfoaUYYwIZW5wMTg5czCUXZSMDTEwLjE0OC4yMjIuNTmUTU5+hpRhjAhlbnAyMjVzMJRdlIwNMTAuMTQ5LjE1OC41N5RNTn6GlGGMCGVucDIzMHMwlF2UjA0xMC4xNDkuMjIyLjU3lE1OfoaUYYwHZG9ja2VyMJRdlIwKMTcyLjE3LjAuMZRNTn6GlGF1Lg== gAWVkwkAAAAAAACMI2hvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnNldHRpbmdzlIwIU2V0dGluZ3OUk5QpgZR9lCiMCG51bV9wcm9jlEsQjAd2ZXJib3NllEsCjAhzc2hfcG9ydJROjBFzc2hfaWRlbnRpdHlfZmlsZZROjA5leHRyYV9tcGlfYXJnc5RYxgYAAC1tY2EgYnRsX3RjcF9pZl9pbmNsdWRlIGVucDEzNHMwZjAgLXggTkNDTF9JQl9HSURfSU5ERVg9MyAteCBOQ0NMX0RFQlVHPUlORk8gLW1jYSBwbG1fcnNoX2FnZW50ICIvaG9tZS9uZ2MtYXV0aC1sZGFwLWFsbHh1L21pbmljb25kYTMvYmluL3B5dGhvbiAtbSBob3Jvdm9kLnNwYXJrLmRyaXZlci5tcGlydW5fcnNoIGdBV1ZjQUVBQUFBQUFBQjlsQ2lNQW14dmxGMlVqQWt4TWpjdU1DNHdMakdVVFU1K2hwUmhqQWRsYm5BMU0zTXdsRjJVakF3eE1DNHhORGd1TXpBdU5UbVVUVTUraHBSaGpBZGxibkExT0hNd2xGMlVqQXd4TUM0eE5EZ3VPVFF1TlRtVVRVNStocFJoakFkbGJuQTRPSE13bEYyVWpBd3hNQzR4TkRrdU16QXVNelNVVFU1K2hwUmhqQWRsYm5BNU0zTXdsRjJVakF3eE1DNHhORGt1T1RRdU5UZVVUVTUraHBSaGpBcGxibkF4TXpSek1HWXdsRjJVakFzeE1DNHhOVEF1TXpBdU1wUk5UbjZHbEdHTUNHVnVjREU0TkhNd2xGMlVqQTB4TUM0eE5EZ3VNVFU0TGpVNWxFMU9mb2FVWVl3SVpXNXdNVGc1Y3pDVVhaU01EVEV3TGpFME9DNHlNakl1TlRtVVRVNStocFJoakFobGJuQXlNalZ6TUpSZGxJd05NVEF1TVRRNUxqRTFPQzQxTjVSTlRuNkdsR0dNQ0dWdWNESXpNSE13bEYyVWpBMHhNQzR4TkRrdU1qSXlMalUzbEUxT2ZvYVVZWXdIWkc5amEyVnlNSlJkbEl3S01UY3lMakUzTGpBdU1aUk5UbjZHbEdGMUxnPT0gZ0FXVkF3TUFBQUFBQUFDTUkyaHZjbTkyYjJRdWNuVnVibVZ5TG1OdmJXMXZiaTUxZEdsc0xuTmxkSFJwYm1kemxJd0lVMlYwZEdsdVozT1VrNVFwZ1pSOWxDaU1DRzUxYlY5d2NtOWpsRXNRakFkMlpYSmliM05sbEVzQ2pBaHpjMmhmY0c5eWRKUk9qQkZ6YzJoZmFXUmxiblJwZEhsZlptbHNaWlJPakE1bGVIUnlZVjl0Y0dsZllYSm5jNVNNT1MxdFkyRWdZblJzWDNSamNGOXBabDlwYm1Oc2RXUmxJR1Z1Y0RFek5ITXdaakFnTFhnZ1RrTkRURjlKUWw5SFNVUmZTVTVFUlZnOU01U01DSFJqY0Y5bWJHRm5sRTZNREdKcGJtUnBibWRmWVhKbmM1Uk9qQU5yWlhtVVRvd05jM1JoY25SZmRHbHRaVzkxZEpTTUltaHZjbTkyYjJRdWNuVnVibVZ5TG1OdmJXMXZiaTUxZEdsc0xuUnBiV1Z2ZFhTVWpBZFVhVzFsYjNWMGxKT1VLWUdVZlpRb2pBaGZkR2x0Wlc5MWRKUk5XQUtNQzE5MGFXMWxiM1YwWDJGMGxFZEIyRTJBWXRUWGg0d0lYMjFsYzNOaFoyV1VXQTRCQUFCVWFXMWxaQ0J2ZFhRZ2QyRnBkR2x1WnlCbWIzSWdlMkZqZEdsMmFYUjVmUzRnVUd4bFlYTmxJR05vWldOcklIUm9ZWFFnZVc5MUlHaGhkbVVnWlc1dmRXZG9JSEpsYzI5MWNtTmxjeUIwYnlCeWRXNGdZV3hzSUVodmNtOTJiMlFnY0hKdlkyVnpjMlZ6TGlCRllXTm9JRWh2Y205MmIyUWdjSEp2WTJWemN5QnlkVzV6SUdsdUlHRWdVM0JoY21zZ2RHRnpheTRnV1c5MUlHMWhlU0J1WldWa0lIUnZJR2x1WTNKbFlYTmxJSFJvWlNCemRHRnlkRjkwYVcxbGIzVjBJSEJoY21GdFpYUmxjaUIwYnlCaElHeGhjbWRsY2lCMllXeDFaU0JwWmlCNWIzVnlJRk53WVhKcklISmxjMjkxY21ObGN5QmhjbVVnWVd4c2IyTmhkR1ZrSUc5dUxXUmxiV0Z1WkM2VWRXS01EMjkxZEhCMWRGOW1hV3hsYm1GdFpaUk9qQTF5ZFc1ZlpuVnVZMTl0YjJSbGxJaU1CRzVwWTNPVWZaU01CMlZzWVhOMGFXT1VpWXdjY0hKbFptbDRYMjkxZEhCMWRGOTNhWFJvWDNScGJXVnpkR0Z0Y0pTSWpBVm9iM04wYzVTTUxXUm5lREpvTURFNU5DMWhNV0ZrWm1ZNU5qaGtOVEE0WlRoa01URTBNams0Tm1ZelpUSmpOREprWXpveE5wUjFZaTQ9IpSMCHRjcF9mbGFnlE6MDGJpbmRpbmdfYXJnc5ROjANrZXmUTowNc3RhcnRfdGltZW91dJSMImhvcm92b2QucnVubmVyLmNvbW1vbi51dGlsLnRpbWVvdXSUjAdUaW1lb3V0lJOUKYGUfZQojAhfdGltZW91dJRNWAKMC190aW1lb3V0X2F0lEdB2E2AYtTXh4wIX21lc3NhZ2WUWA4BAABUaW1lZCBvdXQgd2FpdGluZyBmb3Ige2FjdGl2aXR5fS4gUGxlYXNlIGNoZWNrIHRoYXQgeW91IGhhdmUgZW5vdWdoIHJlc291cmNlcyB0byBydW4gYWxsIEhvcm92b2QgcHJvY2Vzc2VzLiBFYWNoIEhvcm92b2QgcHJvY2VzcyBydW5zIGluIGEgU3BhcmsgdGFzay4gWW91IG1heSBuZWVkIHRvIGluY3JlYXNlIHRoZSBzdGFydF90aW1lb3V0IHBhcmFtZXRlciB0byBhIGxhcmdlciB2YWx1ZSBpZiB5b3VyIFNwYXJrIHJlc291cmNlcyBhcmUgYWxsb2NhdGVkIG9uLWRlbWFuZC6UdWKMD291dHB1dF9maWxlbmFtZZROjA1ydW5fZnVuY19tb2RllIiMBG5pY3OUfZSMB2VsYXN0aWOUiYwccHJlZml4X291dHB1dF93aXRoX3RpbWVzdGFtcJSIjAVob3N0c5SMLWRneDJoMDE5NC1hMWFkZmY5NjhkNTA4ZThkMTE0Mjk4NmYzZTJjNDJkYzoxNpR1Yi4=\n", - "Mon Sep 6 11:44:58 2021[1,5]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,4]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,1]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,0]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,7]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,2]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,3]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,8]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,10]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,11]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,14]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,9]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,6]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,15]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:44:58 2021[1,12]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n", - "Mon Sep 6 11:44:58 2021[1,13]:Changing cwd from /home/ngc-auth-ldap-allxu to /raid/spark-team/allen-dlrm/spark-3.1.2-bin-hadoop3.2/work/app-20210906114426-0004/1\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:19 2021[1,14]:2021-09-06 11:45:19.644980: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,14]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,5]:2021-09-06 11:45:19.658879: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,5]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,2]:2021-09-06 11:45:19.677330: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,2]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,15]:2021-09-06 11:45:19.692565: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,15]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,13]:2021-09-06 11:45:19.710165: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,13]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,11]:2021-09-06 11:45:19.730864: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,11]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,10]:2021-09-06 11:45:19.755246: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,10]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,7]:2021-09-06 11:45:19.777504: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,7]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,6]:2021-09-06 11:45:19.803092: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,6]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,3]:2021-09-06 11:45:19.823747: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,3]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,8]:2021-09-06 11:45:19.845900: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,8]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,4]:2021-09-06 11:45:19.868706: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,4]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:19 2021[1,0]:2021-09-06 11:45:19.955887: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:19 2021[1,0]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:20 2021[1,9]:2021-09-06 11:45:20.026533: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:20 2021[1,9]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:20 2021[1,1]:2021-09-06 11:45:20.142189: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:20 2021[1,1]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:20 2021[1,12]:2021-09-06 11:45:20.356066: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA\n", - "Mon Sep 6 11:45:20 2021[1,12]:To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.\n", - "Mon Sep 6 11:45:22 2021[1,5]:2021-09-06 11:45:22.866987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:59:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:22 2021[1,2]:2021-09-06 11:45:22.934896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e5:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:22 2021[1,14]:2021-09-06 11:45:22.935986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:3b:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,11]:2021-09-06 11:45:23.037281: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:5e:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,13]:2021-09-06 11:45:23.046456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:34:00.0, compute capability: 7.0\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:23 2021[1,7]:2021-09-06 11:45:23.107462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:5c:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,6]:2021-09-06 11:45:23.108097: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:b7:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,10]:2021-09-06 11:45:23.112989: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e0:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,3]:2021-09-06 11:45:23.203766: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e2:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,8]:2021-09-06 11:45:23.211519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:be:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,15]:2021-09-06 11:45:23.270928: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:b9:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,4]:2021-09-06 11:45:23.279986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:bc:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,1]:2021-09-06 11:45:23.341641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:39:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,0]:2021-09-06 11:45:23.346429: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:36:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,12]:2021-09-06 11:45:23.435210: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:57:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,9]:2021-09-06 11:45:23.477277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1504] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 30964 MB memory: -> device: 0, name: Tesla V100-SXM3-32GB-H, pci bus id: 0000:e7:00.0, compute capability: 7.0\n", - "Mon Sep 6 11:45:23 2021[1,5]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,5]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,5]:2021-09-06 11:45:23.647929: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,5]:2021-09-06 11:45:23.647952: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,5]:2021-09-06 11:45:23.647993: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,2]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,2]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,2]:2021-09-06 11:45:23.744042: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,2]:2021-09-06 11:45:23.744065: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,2]:2021-09-06 11:45:23.744117: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,14]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,14]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,14]:2021-09-06 11:45:23.759698: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,14]:2021-09-06 11:45:23.759719: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,14]:2021-09-06 11:45:23.759764: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,13]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,13]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,13]:2021-09-06 11:45:23.858335: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,13]:2021-09-06 11:45:23.858356: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,11]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,11]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,13]:2021-09-06 11:45:23.858399: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,11]:2021-09-06 11:45:23.858710: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,11]:2021-09-06 11:45:23.858730: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,11]:2021-09-06 11:45:23.858772: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,7]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,7]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,7]:2021-09-06 11:45:23.940736: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,7]:2021-09-06 11:45:23.940759: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,7]:2021-09-06 11:45:23.940801: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,10]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,10]: warnings.warn(\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:23 2021[1,10]:2021-09-06 11:45:23.941176: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,10]:2021-09-06 11:45:23.941195: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,10]:2021-09-06 11:45:23.941240: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:23 2021[1,5]:2021-09-06 11:45:23.950215: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:23 2021[1,5]:2021-09-06 11:45:23.952931: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:23 2021[1,6]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:23 2021[1,6]: warnings.warn(\n", - "Mon Sep 6 11:45:23 2021[1,6]:2021-09-06 11:45:23.984430: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:23 2021[1,6]:2021-09-06 11:45:23.984453: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:23 2021[1,6]:2021-09-06 11:45:23.984507: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,8]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,8]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,8]:2021-09-06 11:45:24.013682: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,8]:2021-09-06 11:45:24.013706: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,8]:2021-09-06 11:45:24.013758: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,3]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,3]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,3]:2021-09-06 11:45:24.046403: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,3]:2021-09-06 11:45:24.046428: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,3]:2021-09-06 11:45:24.046476: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,4]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,4]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,4]:2021-09-06 11:45:24.067336: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,4]:2021-09-06 11:45:24.067359: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,4]:2021-09-06 11:45:24.067412: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,15]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,15]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,15]:2021-09-06 11:45:24.118355: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,15]:2021-09-06 11:45:24.118379: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,15]:2021-09-06 11:45:24.118447: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:Model: \"model\"\n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:Layer (type) Output Shape Param # Connected to \n", - "Mon Sep 6 11:45:24 2021[1,0]:==================================================================================================\n", - "Mon Sep 6 11:45:24 2021[1,0]:c0 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c1 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c2 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c3 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c4 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c6 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c7 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c8 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c9 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c10 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c11 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c12 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c13 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c14 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c15 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c17 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c18 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c19 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c20 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c21 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c22 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c23 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c24 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,1]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,1]: warnings.warn(\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:c25 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,1]:2021-09-06 11:45:24.144886: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c0 (Embedding) (None, 1, 8) 63303112 ['c0[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,1]:2021-09-06 11:45:24.144909: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,1]:2021-09-06 11:45:24.144956: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c1 (Embedding) (None, 1, 8) 270584 ['c1[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c2 (Embedding) (None, 1, 8) 137112 ['c2[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c3 (Embedding) (None, 1, 8) 58712 ['c3[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c4 (Embedding) (None, 1, 8) 160368 ['c4[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c6 (Embedding) (None, 1, 8) 56840 ['c6[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c7 (Embedding) (None, 1, 8) 11056 ['c7[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c8 (Embedding) (None, 1, 8) 504 ['c8[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c9 (Embedding) (None, 1, 8) 44432912 ['c9[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c10 (Embedding) (None, 1, 8) 4659752 ['c10[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,0]:2021-09-06 11:45:24.151145: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c11 (Embedding) (None, 1, 8) 1966624 ['c11[0][0]'] \n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:2021-09-06 11:45:24.151167: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:2021-09-06 11:45:24.151215: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c12 (Embedding) (None, 1, 8) 88 ['c12[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c13 (Embedding) (None, 1, 8) 17672 ['c13[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c14 (Embedding) (None, 1, 8) 85336 ['c14[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c15 (Embedding) (None, 1, 8) 832 ['c15[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c17 (Embedding) (None, 1, 8) 7744 ['c17[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c18 (Embedding) (None, 1, 8) 120 ['c18[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c19 (Embedding) (None, 1, 8) 65327168 ['c19[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c20 (Embedding) (None, 1, 8) 21407520 ['c20[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c21 (Embedding) (None, 1, 8) 57251624 ['c21[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c22 (Embedding) (None, 1, 8) 2420128 ['c22[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c23 (Embedding) (None, 1, 8) 96176 ['c23[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c24 (Embedding) (None, 1, 8) 776 ['c24[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embedding_c25 (Embedding) (None, 1, 8) 280 ['c25[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embeddings_concat (Concatenate (None, 1, 192) 0 ['embedding_c0[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]:) 'embedding_c1[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c2[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c3[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c4[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c6[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c7[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c8[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c9[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c10[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c11[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c12[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c13[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c14[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c15[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c17[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c18[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c19[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c20[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c21[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c22[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c23[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c24[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'embedding_c25[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c5 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:c16 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:embeddings_flatten (Flatten) (None, 192) 0 ['embeddings_concat[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:one_hot_c5 (CategoryEncoding) (None, 4) 0 ['c5[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:one_hot_c16 (CategoryEncoding) (None, 4) 0 ['c16[0][0]'] \n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i0 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i1 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i2 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i3 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i4 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i5 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i6 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i7 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i8 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i9 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i10 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i11 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:i12 (InputLayer) [(None, 1)] 0 [] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:inputs_concat (Concatenate) (None, 213) 0 ['embeddings_flatten[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'one_hot_c5[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'one_hot_c16[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i0[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i1[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i2[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i3[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i4[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i5[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i6[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i7[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i8[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i9[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i10[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i11[0][0]', \n", - "Mon Sep 6 11:45:24 2021[1,0]: 'i12[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:batch_normalization (BatchNorm (None, 213) 852 ['inputs_concat[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:alization) \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:dense (Dense) (None, 64) 13696 ['batch_normalization[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:batch_normalization_1 (BatchNo (None, 64) 256 ['dense[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:rmalization) \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:dense_1 (Dense) (None, 64) 4160 ['batch_normalization_1[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:batch_normalization_2 (BatchNo (None, 64) 256 ['dense_1[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:rmalization) \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:dense_2 (Dense) (None, 64) 4160 ['batch_normalization_2[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:batch_normalization_3 (BatchNo (None, 64) 256 ['dense_2[0][0]'] \n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,0]:rmalization) \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:dense_3 (Dense) (None, 32) 2080 ['batch_normalization_3[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n", - "Mon Sep 6 11:45:24 2021[1,0]:output (Dense) (None, 1) 33 ['dense_3[0][0]'] \n", - "Mon Sep 6 11:45:24 2021[1,0]:==================================================================================================\n", - "Mon Sep 6 11:45:24 2021[1,0]:Total params: 261,698,789\n", - "Mon Sep 6 11:45:24 2021[1,0]:Trainable params: 261,697,979\n", - "Mon Sep 6 11:45:24 2021[1,0]:Non-trainable params: 810\n", - "Mon Sep 6 11:45:24 2021[1,0]:__________________________________________________________________________________________________\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:24 2021[1,12]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,12]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,12]:2021-09-06 11:45:24.193332: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,12]:2021-09-06 11:45:24.193353: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,12]:2021-09-06 11:45:24.193402: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,14]:2021-09-06 11:45:24.238850: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,14]:2021-09-06 11:45:24.241542: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,9]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/horovod/_keras/callbacks.py:58: UserWarning: Some callbacks may not have access to the averaged metrics, see https://github.com/horovod/horovod/issues/2440\n", - "Mon Sep 6 11:45:24 2021[1,9]: warnings.warn(\n", - "Mon Sep 6 11:45:24 2021[1,9]:2021-09-06 11:45:24.250555: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:45:24 2021[1,9]:2021-09-06 11:45:24.250576: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:45:24 2021[1,9]:2021-09-06 11:45:24.250629: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1614] Profiler found 1 GPUs\n", - "Mon Sep 6 11:45:24 2021[1,11]:2021-09-06 11:45:24.257864: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,11]:2021-09-06 11:45:24.260597: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,2]:2021-09-06 11:45:24.280993: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,13]:2021-09-06 11:45:24.287541: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,2]:2021-09-06 11:45:24.287675: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,13]:2021-09-06 11:45:24.290185: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,10]:2021-09-06 11:45:24.509055: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,10]:2021-09-06 11:45:24.511856: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,7]:2021-09-06 11:45:24.559661: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,7]:2021-09-06 11:45:24.562511: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,6]:2021-09-06 11:45:24.633007: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,6]:2021-09-06 11:45:24.635583: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,8]:2021-09-06 11:45:24.856408: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,3]:2021-09-06 11:45:24.859705: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,8]:2021-09-06 11:45:24.861849: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,3]:2021-09-06 11:45:24.864132: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,0]:2021-09-06 11:45:24.865753: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,0]:2021-09-06 11:45:24.870050: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,9]:2021-09-06 11:45:24.920789: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,9]:2021-09-06 11:45:24.923768: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,12]:2021-09-06 11:45:24.927953: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,12]:2021-09-06 11:45:24.930836: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:24 2021[1,1]:2021-09-06 11:45:24.944178: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:24 2021[1,1]:2021-09-06 11:45:24.951561: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:25 2021[1,15]:2021-09-06 11:45:25.019351: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:25 2021[1,15]:2021-09-06 11:45:25.023739: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:25 2021[1,4]:2021-09-06 11:45:25.132725: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:45:25 2021[1,4]:2021-09-06 11:45:25.139297: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:45:25 2021[1,5]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fcebaccea60> and will run it as-is.\n", - "Mon Sep 6 11:45:25 2021[1,5]:Cause: could not parse the source code of . at 0x7fcebaccea60>: no matching AST found\n", - "Mon Sep 6 11:45:25 2021[1,5]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,5]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fceb96944c0> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,5]:Cause: could not parse the source code of . at 0x7fceb96944c0>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,5]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,14]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f7cc813dee0> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,14]:Cause: could not parse the source code of . at 0x7f7cc813dee0>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,14]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,2]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f540c075d30> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,2]:Cause: could not parse the source code of . at 0x7f540c075d30>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,2]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,11]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f276c530670> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,11]:Cause: could not parse the source code of . at 0x7f276c530670>: no matching AST found\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:26 2021[1,11]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,13]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f3cc12349d0> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,13]:Cause: could not parse the source code of . at 0x7f3cc12349d0>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,13]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,14]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f7bf4174040> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,14]:Cause: could not parse the source code of . at 0x7f7bf4174040>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,14]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:26 2021[1,2]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f53c4044160> and will run it as-is.\n", - "Mon Sep 6 11:45:26 2021[1,2]:Cause: could not parse the source code of . at 0x7f53c4044160>: no matching AST found\n", - "Mon Sep 6 11:45:26 2021[1,2]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,11]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f27cc054280> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,11]:Cause: could not parse the source code of . at 0x7f27cc054280>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,11]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,13]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f3c04103280> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,13]:Cause: could not parse the source code of . at 0x7f3c04103280>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,13]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,7]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fdbaa897550> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,7]:Cause: could not parse the source code of . at 0x7fdbaa897550>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,7]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,6]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f24600dbaf0> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,6]:Cause: could not parse the source code of . at 0x7f24600dbaf0>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,6]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,10]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f175809ac10> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,10]:Cause: could not parse the source code of . at 0x7f175809ac10>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,10]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,6]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f2460074280> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,6]:Cause: could not parse the source code of . at 0x7f2460074280>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,6]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,7]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fdc342ec280> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,7]:Cause: could not parse the source code of . at 0x7fdc342ec280>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,7]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:27 2021[1,10]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f17a81bf5e0> and will run it as-is.\n", - "Mon Sep 6 11:45:27 2021[1,10]:Cause: could not parse the source code of . at 0x7f17a81bf5e0>: no matching AST found\n", - "Mon Sep 6 11:45:27 2021[1,10]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,0]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f1ae4675ee0> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,0]:Cause: could not parse the source code of . at 0x7f1ae4675ee0>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,0]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,3]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f32a406d550> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,3]:Cause: could not parse the source code of . at 0x7f32a406d550>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,3]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,1]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fd8c81b6b80> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,1]:Cause: could not parse the source code of . at 0x7fd8c81b6b80>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,1]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,8]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fd84e254dc0> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,8]:Cause: could not parse the source code of . at 0x7fd84e254dc0>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,8]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,15]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fe3a71ee1f0> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,15]:Cause: could not parse the source code of . at 0x7fe3a71ee1f0>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,15]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,9]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fb74018b550> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,9]:Cause: could not parse the source code of . at 0x7fb74018b550>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,9]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,0]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f1bd00ae280> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,0]:Cause: could not parse the source code of . at 0x7f1bd00ae280>: no matching AST found\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:28 2021[1,0]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,12]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fce00127ca0> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,12]:Cause: could not parse the source code of . at 0x7fce00127ca0>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,12]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,8]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fd7b01be430> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,8]:Cause: could not parse the source code of . at 0x7fd7b01be430>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,8]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,4]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f2a840e49d0> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,4]:Cause: could not parse the source code of . at 0x7f2a840e49d0>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,4]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,3]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f3254018280> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,3]:Cause: could not parse the source code of . at 0x7f3254018280>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,3]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,1]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fd91404c280> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,1]:Cause: could not parse the source code of . at 0x7fd91404c280>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,1]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,12]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fcdac026280> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,12]:Cause: could not parse the source code of . at 0x7fcdac026280>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,12]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,15]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fe2d40f7280> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,15]:Cause: could not parse the source code of . at 0x7fe2d40f7280>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,15]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,4]:WARNING:tensorflow:AutoGraph could not transform . at 0x7f2a64056160> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,4]:Cause: could not parse the source code of . at 0x7f2a64056160>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,4]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:28 2021[1,9]:WARNING:tensorflow:AutoGraph could not transform . at 0x7fb740149040> and will run it as-is.\n", - "Mon Sep 6 11:45:28 2021[1,9]:Cause: could not parse the source code of . at 0x7fb740149040>: no matching AST found\n", - "Mon Sep 6 11:45:28 2021[1,9]:To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert\n", - "Mon Sep 6 11:45:36 2021[1,14]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,14]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,2]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,2]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,11]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,11]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,5]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,5]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,6]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,6]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,10]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,10]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,7]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,7]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:36 2021[1,13]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:36 2021[1,13]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,8]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,8]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,4]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,4]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,0]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,0]: column_as_pandas = column.data.chunks[0].to_pandas()\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:37 2021[1,3]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,3]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,1]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,1]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,12]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,12]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,15]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,15]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:37 2021[1,9]:/home/ngc-auth-ldap-allxu/miniconda3/lib/python3.8/site-packages/petastorm/arrow_reader_worker.py:53: FutureWarning: Calling .data on ChunkedArray is provided for compatibility after Column was removed, simply drop this attribute\n", - "Mon Sep 6 11:45:37 2021[1,9]: column_as_pandas = column.data.chunks[0].to_pandas()\n", - "Mon Sep 6 11:45:46 2021[1,14]:2021-09-06 11:45:46.163581: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 633106 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,2]:2021-09-06 11:45:46.173808: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 625961 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,11]:2021-09-06 11:45:46.470637: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 575620 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,5]:2021-09-06 11:45:46.483315: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 602125 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,14]:2021-09-06 11:45:46.515473: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:46 2021[1,6]:2021-09-06 11:45:46.620458: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 612890 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,2]:2021-09-06 11:45:46.655265: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:46 2021[1,10]:2021-09-06 11:45:46.681795: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 601332 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,7]:2021-09-06 11:45:46.708487: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 572490 of 655350\n", - "Mon Sep 6 11:45:46 2021[1,13]:2021-09-06 11:45:46.848852: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 584226 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,8]:2021-09-06 11:45:47.028900: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 631682 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,4]:2021-09-06 11:45:47.123354: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 622824 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,0]:2021-09-06 11:45:47.160067: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 624462 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,3]:2021-09-06 11:45:47.306279: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 559646 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,6]:2021-09-06 11:45:47.317935: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,1]:2021-09-06 11:45:47.328390: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 602957 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,12]:2021-09-06 11:45:47.401105: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 609749 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,8]:2021-09-06 11:45:47.406648: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,5]:2021-09-06 11:45:47.410203: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,15]:2021-09-06 11:45:47.490260: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 606865 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,10]:2021-09-06 11:45:47.576105: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,9]:2021-09-06 11:45:47.631347: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:338] Filling up shuffle buffer (this may take a while): 610214 of 655350\n", - "Mon Sep 6 11:45:47 2021[1,4]:2021-09-06 11:45:47.638664: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,0]:2021-09-06 11:45:47.648328: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:47 2021[1,11]:2021-09-06 11:45:47.874307: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,12]:2021-09-06 11:45:48.136479: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,7]:2021-09-06 11:45:48.178890: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,1]:2021-09-06 11:45:48.243785: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,15]:2021-09-06 11:45:48.283844: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,13]:2021-09-06 11:45:48.332091: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:48 2021[1,9]:2021-09-06 11:45:48.383569: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "Mon Sep 6 11:45:49 2021[1,3]:2021-09-06 11:45:49.210125: I tensorflow/core/kernels/data/shuffle_dataset_op.cc:363] Shuffle buffer filled.\n", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:53 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,0]:NCCL version 2.10.3+cuda11.0\n", - "Mon Sep 6 11:45:53 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Using network IB\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:53 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Bootstrap : Using enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO NET/Plugin : No plugin found (libnccl-net.so), using internal implementation\n", - "Mon Sep 6 11:45:53 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO NET/IB : Using [0]mlx5_0:1/RoCE [1]mlx5_1:1/RoCE [2]mlx5_2:1/RoCE [3]mlx5_3:1/RoCE [4]mlx5_4:1/RoCE [5]mlx5_5:1/RoCE [6]mlx5_6:1/RoCE [7]mlx5_7:1/RoCE [8]mlx5_8:1/RoCE [9]mlx5_9:1/RoCE ; OOB enp53s0:10.148.30.59<0>\n", - "Mon Sep 6 11:45:53 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Using network IB\n", - "Mon Sep 6 11:45:53 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:53 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO NCCL_IB_GID_INDEX set by environment to 3.\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Trees [0] 1/-1/-1->13->0 [1] 1/-1/-1->13->0 [2] 1/-1/-1->13->0 [3] 1/-1/-1->13->0 [4] 1/-1/-1->13->0 [5] 1/-1/-1->13->0 [6] 1/-1/-1->13->0 [7] 1/-1/-1->13->0 [8] 1/-1/-1->13->0 [9] 1/-1/-1->13->0 [10] 1/-1/-1->13->0 [11] 1/-1/-1->13->0\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Setting affinity for GPU 0 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 00/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 01/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 02/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 03/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 04/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 05/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 06/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 07/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Trees [0] -1/-1/-1->15->6 [1] -1/-1/-1->15->6 [2] -1/-1/-1->15->6 [3] -1/-1/-1->15->6 [4] -1/-1/-1->15->6 [5] -1/-1/-1->15->6 [6] -1/-1/-1->15->6 [7] -1/-1/-1->15->6 [8] -1/-1/-1->15->6 [9] -1/-1/-1->15->6 [10] -1/-1/-1->15->6 [11] -1/-1/-1->15->6\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Setting affinity for GPU 9 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Trees [0] 9/-1/-1->2->11 [1] 9/-1/-1->2->11 [2] 9/-1/-1->2->11 [3] 9/-1/-1->2->11 [4] 9/-1/-1->2->11 [5] 9/-1/-1->2->11 [6] 9/-1/-1->2->11 [7] 9/-1/-1->2->11 [8] 9/-1/-1->2->11 [9] 9/-1/-1->2->11 [10] 9/-1/-1->2->11 [11] 9/-1/-1->2->11\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Setting affinity for GPU 14 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Trees [0] 14/-1/-1->1->13 [1] 14/-1/-1->1->13 [2] 14/-1/-1->1->13 [3] 14/-1/-1->1->13 [4] 14/-1/-1->1->13 [5] 14/-1/-1->1->13 [6] 14/-1/-1->1->13 [7] 14/-1/-1->1->13 [8] 14/-1/-1->1->13 [9] 14/-1/-1->1->13 [10] 14/-1/-1->1->13 [11] 14/-1/-1->1->13\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Setting affinity for GPU 2 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Trees [0] 10/-1/-1->3->9 [1] 10/-1/-1->3->9 [2] 10/-1/-1->3->9 [3] 10/-1/-1->3->9 [4] 10/-1/-1->3->9 [5] 10/-1/-1->3->9 [6] 10/-1/-1->3->9 [7] 10/-1/-1->3->9 [8] 10/-1/-1->3->9 [9] 10/-1/-1->3->9 [10] 10/-1/-1->3->9 [11] 10/-1/-1->3->9\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Setting affinity for GPU 13 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Trees [0] 5/-1/-1->14->1 [1] 5/-1/-1->14->1 [2] 5/-1/-1->14->1 [3] 5/-1/-1->14->1 [4] 5/-1/-1->14->1 [5] 5/-1/-1->14->1 [6] 5/-1/-1->14->1 [7] 5/-1/-1->14->1 [8] 5/-1/-1->14->1 [9] 5/-1/-1->14->1 [10] 5/-1/-1->14->1 [11] 5/-1/-1->14->1\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Setting affinity for GPU 3 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 08/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 09/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 10/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 11/12 : 0 13 1 14 5 12 7 11 2 9 3 10 4 8 6 15\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Trees [0] 13/-1/-1->0->-1 [1] 13/-1/-1->0->-1 [2] 13/-1/-1->0->-1 [3] 13/-1/-1->0->-1 [4] 13/-1/-1->0->-1 [5] 13/-1/-1->0->-1 [6] 13/-1/-1->0->-1 [7] 13/-1/-1->0->-1 [8] 13/-1/-1->0->-1 [9] 13/-1/-1->0->-1 [10] 13/-1/-1->0->-1 [11] 13/-1/-1->0->-1\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Setting affinity for GPU 1 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Trees [0] 15/-1/-1->6->8 [1] 15/-1/-1->6->8 [2] 15/-1/-1->6->8 [3] 15/-1/-1->6->8 [4] 15/-1/-1->6->8 [5] 15/-1/-1->6->8 [6] 15/-1/-1->6->8 [7] 15/-1/-1->6->8 [8] 15/-1/-1->6->8 [9] 15/-1/-1->6->8 [10] 15/-1/-1->6->8 [11] 15/-1/-1->6->8\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Setting affinity for GPU 8 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Trees [0] 8/-1/-1->4->10 [1] 8/-1/-1->4->10 [2] 8/-1/-1->4->10 [3] 8/-1/-1->4->10 [4] 8/-1/-1->4->10 [5] 8/-1/-1->4->10 [6] 8/-1/-1->4->10 [7] 8/-1/-1->4->10 [8] 8/-1/-1->4->10 [9] 8/-1/-1->4->10 [10] 8/-1/-1->4->10 [11] 8/-1/-1->4->10\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Setting affinity for GPU 10 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Trees [0] 6/-1/-1->8->4 [1] 6/-1/-1->8->4 [2] 6/-1/-1->8->4 [3] 6/-1/-1->8->4 [4] 6/-1/-1->8->4 [5] 6/-1/-1->8->4 [6] 6/-1/-1->8->4 [7] 6/-1/-1->8->4 [8] 6/-1/-1->8->4 [9] 6/-1/-1->8->4 [10] 6/-1/-1->8->4 [11] 6/-1/-1->8->4\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Setting affinity for GPU 11 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Trees [0] 12/-1/-1->5->14 [1] 12/-1/-1->5->14 [2] 12/-1/-1->5->14 [3] 12/-1/-1->5->14 [4] 12/-1/-1->5->14 [5] 12/-1/-1->5->14 [6] 12/-1/-1->5->14 [7] 12/-1/-1->5->14 [8] 12/-1/-1->5->14 [9] 12/-1/-1->5->14 [10] 12/-1/-1->5->14 [11] 12/-1/-1->5->14\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Setting affinity for GPU 5 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Trees [0] 11/-1/-1->7->12 [1] 11/-1/-1->7->12 [2] 11/-1/-1->7->12 [3] 11/-1/-1->7->12 [4] 11/-1/-1->7->12 [5] 11/-1/-1->7->12 [6] 11/-1/-1->7->12 [7] 11/-1/-1->7->12 [8] 11/-1/-1->7->12 [9] 11/-1/-1->7->12 [10] 11/-1/-1->7->12 [11] 11/-1/-1->7->12\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Setting affinity for GPU 6 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Trees [0] 4/-1/-1->10->3 [1] 4/-1/-1->10->3 [2] 4/-1/-1->10->3 [3] 4/-1/-1->10->3 [4] 4/-1/-1->10->3 [5] 4/-1/-1->10->3 [6] 4/-1/-1->10->3 [7] 4/-1/-1->10->3 [8] 4/-1/-1->10->3 [9] 4/-1/-1->10->3 [10] 4/-1/-1->10->3 [11] 4/-1/-1->10->3\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Setting affinity for GPU 12 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Trees [0] 3/-1/-1->9->2 [1] 3/-1/-1->9->2 [2] 3/-1/-1->9->2 [3] 3/-1/-1->9->2 [4] 3/-1/-1->9->2 [5] 3/-1/-1->9->2 [6] 3/-1/-1->9->2 [7] 3/-1/-1->9->2 [8] 3/-1/-1->9->2 [9] 3/-1/-1->9->2 [10] 3/-1/-1->9->2 [11] 3/-1/-1->9->2\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Setting affinity for GPU 15 to ffffff00,0000ffff,ff000000\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Trees [0] 2/-1/-1->11->7 [1] 2/-1/-1->11->7 [2] 2/-1/-1->11->7 [3] 2/-1/-1->11->7 [4] 2/-1/-1->11->7 [5] 2/-1/-1->11->7 [6] 2/-1/-1->11->7 [7] 2/-1/-1->11->7 [8] 2/-1/-1->11->7 [9] 2/-1/-1->11->7 [10] 2/-1/-1->11->7 [11] 2/-1/-1->11->7\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Setting affinity for GPU 7 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Trees [0] 7/-1/-1->12->5 [1] 7/-1/-1->12->5 [2] 7/-1/-1->12->5 [3] 7/-1/-1->12->5 [4] 7/-1/-1->12->5 [5] 7/-1/-1->12->5 [6] 7/-1/-1->12->5 [7] 7/-1/-1->12->5 [8] 7/-1/-1->12->5 [9] 7/-1/-1->12->5 [10] 7/-1/-1->12->5 [11] 7/-1/-1->12->5\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Setting affinity for GPU 4 to ff,ffff0000,00ffffff\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 00 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 00 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 00 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 00 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 00 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 00 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 01 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 00 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 01 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 01 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 01 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 01 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 01 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 01 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 02 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 02 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 02 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 02 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 02 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 02 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 03 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 02 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 03 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 03 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 03 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 03 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 03 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 03 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 04 : 13[34000] -> 1[39000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 04 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 04 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 04 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 04 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 04 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 04 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 05 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 05 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 05 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 05 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 05 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 05 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 06 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 05 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 06 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 06 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 06 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 06 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 06 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 06 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 07 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 07 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 07 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 07 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 07 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 07 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 08 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 07 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 08 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 08 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 08 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 08 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 08 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 08 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 09 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 09 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 09 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 09 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 09 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 09 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 10 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 09 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 10 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 10 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 10 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 10 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 10 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 10 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 11 : 13[34000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 11 : 14[3b000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 11 : 7[5c000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 11 : 15[b9000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 11 : 4[bc000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 11 : 3[e2000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 11 : 6[b7000] -> 15[b9000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 00 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 00 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 01 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 01 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 02 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 02 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 03 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 04 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 03 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 05 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 04 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 06 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 05 : 2[e5000] -> 9[e7000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 07 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 06 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 08 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 07 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 09 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 08 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 10 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 09 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 11 : 5[59000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 10 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 11 : 2[e5000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 00 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 01 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 02 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 03 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 04 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 05 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 06 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 07 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 08 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 09 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 00 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 10 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 01 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 11 : 1[39000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 02 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 03 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 04 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 05 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 06 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 00 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 07 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 01 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 08 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 02 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 09 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 03 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 00 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 10 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 04 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 01 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 11 : 11[5e000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 05 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 02 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 06 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 03 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 07 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 04 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 08 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 05 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 09 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 06 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 10 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 07 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Channel 11 : 0[36000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 08 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 09 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 00 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 10 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 01 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 11 : 8[be000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 02 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 03 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 04 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 05 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 06 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 07 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 08 : 10[e0000] -> 4[bc000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 09 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 00 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 10 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 01 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 11 : 10[e0000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 02 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 03 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 00 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 04 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 01 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 05 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 02 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 06 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 03 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 00 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 07 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 04 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 01 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 08 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 05 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 02 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 06 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 09 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 03 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 10 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 07 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 04 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 11 : 12[57000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 08 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 05 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 09 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 06 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 10 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 07 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 11 : 9[e7000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 08 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 09 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 10 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Channel 11 : 15[b9000] -> 6[b7000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 00 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:58 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 01 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 02 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 03 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 04 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 05 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 06 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 07 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 08 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 09 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 10 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Channel 11 : 13[34000] -> 0[36000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 00 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 01 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 02 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 03 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 00 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 04 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 01 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 05 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 02 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 00 : 5[59000] -> 14[3b000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:59 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 06 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 03 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 01 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 07 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 04 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 02 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 08 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 05 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 03 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 09 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 06 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 00 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 04 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 10 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 01 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 07 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 05 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Channel 11 : 4[bc000] -> 10[e0000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 08 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 02 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 06 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 03 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 09 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 07 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 10 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 04 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 08 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Channel 11 : 14[3b000] -> 1[39000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 05 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 09 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 06 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 10 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 07 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Channel 11 : 5[59000] -> 14[3b000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 08 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 09 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 00 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 10 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 00 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 01 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Channel 11 : 7[5c000] -> 12[57000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 02 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 01 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 02 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 03 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 03 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 04 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 05 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 04 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 06 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 05 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 00 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 07 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 06 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 01 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 08 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 07 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Connected all rings\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 02 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 09 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 08 : 10[e0000] -> 3[e2000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 00 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 03 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 10 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 09 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 01 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 04 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Channel 11 : 3[e2000] -> 9[e7000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 10 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 02 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 05 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Channel 11 : 10[e0000] -> 3[e2000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 03 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 06 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 00 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 04 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 07 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 05 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 01 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 08 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 02 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 06 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 09 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 03 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 07 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 10 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 08 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 04 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Channel 11 : 1[39000] -> 13[34000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 09 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 05 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 00 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 00 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 10 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 01 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 06 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 01 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 07 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 02 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Channel 11 : 6[b7000] -> 8[be000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 02 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 03 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 08 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 03 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 09 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 04 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 10 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 05 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 04 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Channel 11 : 12[57000] -> 5[59000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 06 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 05 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 07 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 06 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 08 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 07 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 09 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 08 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 10 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 09 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 00 : 8[be000] -> 4[bc000] via P2P/IPC\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Channel 11 : 2[e5000] -> 11[5e000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 10 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 01 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Channel 11 : 9[e7000] -> 2[e5000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 02 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 03 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 04 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 05 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 06 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 07 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 08 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 00 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 09 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 01 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 10 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 02 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Channel 11 : 8[be000] -> 4[bc000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 03 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 04 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 05 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 06 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 07 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 08 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 09 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 10 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Channel 11 : 11[5e000] -> 7[5c000] via P2P/IPC\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO Connected all trees\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO threadThresholds 8/8/64 | 128/8/64 | 8/8/512\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO 12 coll channels, 16 p2p channels, 16 p2p channels per peer\n", - "Mon Sep 6 11:45:59 2021[1,7]:dgx2h0194:41893:42743 [0] NCCL INFO comm 0x7fdcb862ad60 rank 7 nranks 16 cudaDev 0 busId 5c000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,11]:dgx2h0194:41897:42858 [0] NCCL INFO comm 0x7f2914629ae0 rank 11 nranks 16 cudaDev 0 busId 5e000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,15]:dgx2h0194:41901:42857 [0] NCCL INFO comm 0x7fe41462a050 rank 15 nranks 16 cudaDev 0 busId b9000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,13]:dgx2h0194:41899:42721 [0] NCCL INFO comm 0x7f3cf4629f50 rank 13 nranks 16 cudaDev 0 busId 34000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,12]:dgx2h0194:41898:42413 [0] NCCL INFO comm 0x7fcea062aa60 rank 12 nranks 16 cudaDev 0 busId 57000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,4]:dgx2h0194:41890:42739 [0] NCCL INFO comm 0x7f2bb862ae60 rank 4 nranks 16 cudaDev 0 busId bc000 - Init COMPLETE\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:59 2021[1,1]:dgx2h0194:41887:42486 [0] NCCL INFO comm 0x7fda3462aef0 rank 1 nranks 16 cudaDev 0 busId 39000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,6]:dgx2h0194:41892:42733 [0] NCCL INFO comm 0x7f257462aab0 rank 6 nranks 16 cudaDev 0 busId b7000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,2]:dgx2h0194:41888:42361 [0] NCCL INFO comm 0x7f54e462ac10 rank 2 nranks 16 cudaDev 0 busId e5000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,8]:dgx2h0194:41894:42489 [0] NCCL INFO comm 0x7fd8c862b120 rank 8 nranks 16 cudaDev 0 busId be000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,3]:dgx2h0194:41889:42722 [0] NCCL INFO comm 0x7f33b062a600 rank 3 nranks 16 cudaDev 0 busId e2000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,5]:dgx2h0194:41891:42723 [0] NCCL INFO comm 0x7fcf1462aa00 rank 5 nranks 16 cudaDev 0 busId 59000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,9]:dgx2h0194:41895:42860 [0] NCCL INFO comm 0x7fb7d062a3c0 rank 9 nranks 16 cudaDev 0 busId e7000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO comm 0x7f1c8068aa60 rank 0 nranks 16 cudaDev 0 busId 36000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,14]:dgx2h0194:41900:42734 [0] NCCL INFO comm 0x7f7db062a080 rank 14 nranks 16 cudaDev 0 busId 3b000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,10]:dgx2h0194:41896:42859 [0] NCCL INFO comm 0x7f18ac629ef0 rank 10 nranks 16 cudaDev 0 busId e0000 - Init COMPLETE\n", - "Mon Sep 6 11:45:59 2021[1,0]:dgx2h0194:41886:42730 [0] NCCL INFO Launch mode Parallel\n", - "Mon Sep 6 11:45:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:11 2021[1,11]:2021-09-06 11:46:11.401104: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,11]:2021-09-06 11:46:11.401164: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,3]:2021-09-06 11:46:11.440290: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,3]:2021-09-06 11:46:11.440344: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,9]:2021-09-06 11:46:11.442416: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,9]:2021-09-06 11:46:11.442453: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,5]:2021-09-06 11:46:11.445379: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,5]:2021-09-06 11:46:11.445409: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,8]:2021-09-06 11:46:11.461500: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,8]:2021-09-06 11:46:11.461545: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,0]:2021-09-06 11:46:11.467532: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,0]:2021-09-06 11:46:11.467566: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,14]:2021-09-06 11:46:11.467699: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,14]:2021-09-06 11:46:11.467725: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,7]:2021-09-06 11:46:11.467927: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,7]:2021-09-06 11:46:11.467954: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,15]:2021-09-06 11:46:11.478742: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,15]:2021-09-06 11:46:11.478775: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,2]:2021-09-06 11:46:11.480342: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,2]:2021-09-06 11:46:11.480375: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,4]:2021-09-06 11:46:11.493077: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,4]:2021-09-06 11:46:11.493108: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,12]:2021-09-06 11:46:11.514149: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,12]:2021-09-06 11:46:11.514199: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,1]:2021-09-06 11:46:11.517690: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,1]:2021-09-06 11:46:11.517726: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,13]:2021-09-06 11:46:11.526581: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,13]:2021-09-06 11:46:11.526613: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,6]:2021-09-06 11:46:11.537704: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,6]:2021-09-06 11:46:11.537739: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:11 2021[1,10]:2021-09-06 11:46:11.555526: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.\n", - "Mon Sep 6 11:46:11 2021[1,10]:2021-09-06 11:46:11.555565: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.\n", - "Mon Sep 6 11:46:12 2021[1,13]:2021-09-06 11:46:12.486392: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,14]:2021-09-06 11:46:12.486420: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,2]:2021-09-06 11:46:12.486804: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,6]:2021-09-06 11:46:12.486894: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,11]:2021-09-06 11:46:12.487354: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,6]:2021-09-06 11:46:12.489094: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,13]:2021-09-06 11:46:12.489218: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,2]:2021-09-06 11:46:12.489982: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,11]:2021-09-06 11:46:12.490307: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,14]:2021-09-06 11:46:12.490535: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:45:59 2021[1,0]: 1/4000 [..............................]Mon Sep 6 11:45:59 2021[1,0]: - ETA: 34:42:44 - loss: 1.3348 - auc: 0.5421Mon Sep 6 11:46:12 2021[1,0]:\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\b\bMon Sep 6 11:46:12 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:12 2021[1,5]:2021-09-06 11:46:12.494098: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,9]:2021-09-06 11:46:12.494182: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,12]:2021-09-06 11:46:12.494154: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,15]:2021-09-06 11:46:12.494339: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,8]:2021-09-06 11:46:12.494413: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,3]:2021-09-06 11:46:12.494461: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,1]:2021-09-06 11:46:12.494477: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,4]:2021-09-06 11:46:12.494922: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,10]:2021-09-06 11:46:12.495422: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,12]:2021-09-06 11:46:12.496543: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,9]:2021-09-06 11:46:12.496573: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,0]:2021-09-06 11:46:12.496713: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,5]:2021-09-06 11:46:12.496875: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,7]:2021-09-06 11:46:12.497310: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.\n", - "Mon Sep 6 11:46:12 2021[1,8]:2021-09-06 11:46:12.497408: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,1]:2021-09-06 11:46:12.497466: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,15]:2021-09-06 11:46:12.497573: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,10]:2021-09-06 11:46:12.497718: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,4]:2021-09-06 11:46:12.497957: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,3]:2021-09-06 11:46:12.498785: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,0]:2021-09-06 11:46:12.499468: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,7]:2021-09-06 11:46:12.499616: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1748] CUPTI activity buffer flushed\n", - "Mon Sep 6 11:46:12 2021[1,10]:2021-09-06 11:46:12.689220: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,7]:2021-09-06 11:46:12.738674: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2612 callback api events and 2559 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,10]:2021-09-06 11:46:12.739311: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,2]:2021-09-06 11:46:12.772937: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2614 callback api events and 2561 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,13]:2021-09-06 11:46:12.775817: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,0]:2021-09-06 11:46:12.788372: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2614 callback api events and 2561 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,11]:2021-09-06 11:46:12.793984: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,14]:2021-09-06 11:46:12.797338: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,12]:2021-09-06 11:46:12.799541: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2614 callback api events and 2561 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,3]:2021-09-06 11:46:12.804509: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,9]:2021-09-06 11:46:12.809215: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2614 callback api events and 2561 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,6]:2021-09-06 11:46:12.817765: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,7]:2021-09-06 11:46:12.825298: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,4]:2021-09-06 11:46:12.830887: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2612 callback api events and 2559 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,15]:2021-09-06 11:46:12.831932: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2612 callback api events and 2559 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,5]:2021-09-06 11:46:12.836523: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,2]:2021-09-06 11:46:12.838553: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,13]:2021-09-06 11:46:12.839676: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,1]:2021-09-06 11:46:12.840641: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,8]:2021-09-06 11:46:12.847102: I tensorflow/core/profiler/internal/gpu/cupti_collector.cc:673] GpuTracer has collected 2615 callback api events and 2562 activity events. \n", - "Mon Sep 6 11:46:12 2021[1,0]:2021-09-06 11:46:12.851656: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,12]:2021-09-06 11:46:12.862278: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,11]:2021-09-06 11:46:12.862736: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,14]:2021-09-06 11:46:12.865552: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,9]:2021-09-06 11:46:12.874796: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,3]:2021-09-06 11:46:12.883307: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:12 2021[1,4]:2021-09-06 11:46:12.908955: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,5]:2021-09-06 11:46:12.909348: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,15]:2021-09-06 11:46:12.911988: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,6]:2021-09-06 11:46:12.913338: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,8]:2021-09-06 11:46:12.919742: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,1]:2021-09-06 11:46:12.921926: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.\n", - "Mon Sep 6 11:46:12 2021[1,10]:2021-09-06 11:46:12.971783: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:12 2021[1,10]:\n", - "Mon Sep 6 11:46:13 2021[1,10]:2021-09-06 11:46:13.126279: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,7]:2021-09-06 11:46:13.220381: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,7]:\n", - "Mon Sep 6 11:46:13 2021[1,10]:2021-09-06 11:46:13.236756: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,10]:\n", - "Mon Sep 6 11:46:13 2021[1,10]:2021-09-06 11:46:13.244220: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,0]:2021-09-06 11:46:13.247347: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,0]:\n", - "Mon Sep 6 11:46:13 2021[1,10]:2021-09-06 11:46:13.248759: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,10]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,10]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,10]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,10]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,10]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,10]:\n", - "Mon Sep 6 11:46:13 2021[1,12]:2021-09-06 11:46:13.282450: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,12]:\n", - "Mon Sep 6 11:46:13 2021[1,9]:2021-09-06 11:46:13.305546: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,9]:\n", - "Mon Sep 6 11:46:13 2021[1,13]:2021-09-06 11:46:13.314358: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,13]:\n", - "Mon Sep 6 11:46:13 2021[1,14]:2021-09-06 11:46:13.347053: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,14]:\n", - "Mon Sep 6 11:46:13 2021[1,11]:2021-09-06 11:46:13.389071: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,11]:\n", - "Mon Sep 6 11:46:13 2021[1,8]:2021-09-06 11:46:13.417449: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,8]:\n", - "Mon Sep 6 11:46:13 2021[1,15]:2021-09-06 11:46:13.440662: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,15]:\n", - "Mon Sep 6 11:46:13 2021[1,7]:2021-09-06 11:46:13.445472: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,5]:2021-09-06 11:46:13.464452: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,5]:\n", - "Mon Sep 6 11:46:13 2021[1,4]:2021-09-06 11:46:13.505475: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,4]:\n", - "Mon Sep 6 11:46:13 2021[1,1]:2021-09-06 11:46:13.538948: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,1]:\n", - "Mon Sep 6 11:46:13 2021[1,6]:2021-09-06 11:46:13.539917: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,6]:\n", - "Mon Sep 6 11:46:13 2021[1,7]:2021-09-06 11:46:13.575977: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,7]:\n", - "Mon Sep 6 11:46:13 2021[1,7]:2021-09-06 11:46:13.583159: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,7]:2021-09-06 11:46:13.588595: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,7]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,7]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,7]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,7]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,7]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,7]:\n", - "Mon Sep 6 11:46:13 2021[1,0]:2021-09-06 11:46:13.596438: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,12]:2021-09-06 11:46:13.663240: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,9]:2021-09-06 11:46:13.669575: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:13 2021[1,3]:2021-09-06 11:46:13.705164: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,3]:\n", - "Mon Sep 6 11:46:13 2021[1,2]:2021-09-06 11:46:13.727985: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,2]:\n", - "Mon Sep 6 11:46:13 2021[1,14]:2021-09-06 11:46:13.770514: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,0]:2021-09-06 11:46:13.770742: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,0]:\n", - "Mon Sep 6 11:46:13 2021[1,0]:2021-09-06 11:46:13.777869: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,0]:2021-09-06 11:46:13.784817: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,0]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,0]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,0]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,0]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,0]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,0]:\n", - "Mon Sep 6 11:46:13 2021[1,13]:2021-09-06 11:46:13.806429: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,12]:2021-09-06 11:46:13.836961: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,12]:\n", - "Mon Sep 6 11:46:13 2021[1,12]:2021-09-06 11:46:13.844073: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,12]:2021-09-06 11:46:13.850941: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,12]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,12]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,12]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,12]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,12]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,12]:\n", - "Mon Sep 6 11:46:13 2021[1,9]:2021-09-06 11:46:13.852005: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,9]:\n", - "Mon Sep 6 11:46:13 2021[1,8]:2021-09-06 11:46:13.858089: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,9]:2021-09-06 11:46:13.858866: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,9]:2021-09-06 11:46:13.865756: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,9]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,9]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,9]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,9]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,9]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,9]:\n", - "Mon Sep 6 11:46:13 2021[1,1]:2021-09-06 11:46:13.919252: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,5]:2021-09-06 11:46:13.921579: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,15]:2021-09-06 11:46:13.935380: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,11]:2021-09-06 11:46:13.953863: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,14]:2021-09-06 11:46:13.969342: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,14]:\n", - "Mon Sep 6 11:46:13 2021[1,14]:2021-09-06 11:46:13.976218: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:13 2021[1,14]:2021-09-06 11:46:13.983131: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:13 2021[1,14]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:13 2021[1,14]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:13 2021[1,14]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:13 2021[1,14]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,14]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:13 2021[1,14]:\n", - "Mon Sep 6 11:46:14 2021[1,13]:2021-09-06 11:46:14.025457: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,13]:\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:14 2021[1,4]:2021-09-06 11:46:14.031628: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,13]:2021-09-06 11:46:14.035052: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,13]:2021-09-06 11:46:14.044101: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,13]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,13]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,13]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,13]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,13]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,13]:\n", - "Mon Sep 6 11:46:14 2021[1,6]:2021-09-06 11:46:14.051427: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,8]:2021-09-06 11:46:14.066023: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,8]:\n", - "Mon Sep 6 11:46:14 2021[1,8]:2021-09-06 11:46:14.073202: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,8]:2021-09-06 11:46:14.080723: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,8]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,8]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,8]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,8]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,8]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,8]:\n", - "Mon Sep 6 11:46:14 2021[1,1]:2021-09-06 11:46:14.110787: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,1]:\n", - "Mon Sep 6 11:46:14 2021[1,1]:2021-09-06 11:46:14.118317: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,1]:2021-09-06 11:46:14.125946: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,1]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,1]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,1]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,1]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,1]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,1]:\n", - "Mon Sep 6 11:46:14 2021[1,5]:2021-09-06 11:46:14.131987: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,5]:\n", - "Mon Sep 6 11:46:14 2021[1,5]:2021-09-06 11:46:14.138893: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,3]:2021-09-06 11:46:14.143929: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,5]:2021-09-06 11:46:14.146526: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,5]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,5]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,5]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,5]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,5]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,5]:\n", - "Mon Sep 6 11:46:14 2021[1,15]:2021-09-06 11:46:14.170109: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,15]:\n", - "Mon Sep 6 11:46:14 2021[1,11]:2021-09-06 11:46:14.176378: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,11]:\n", - "Mon Sep 6 11:46:14 2021[1,15]:2021-09-06 11:46:14.177822: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,11]:2021-09-06 11:46:14.184029: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,15]:2021-09-06 11:46:14.186611: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,15]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,15]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,15]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,15]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,15]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:14 2021[1,15]:\n", - "Mon Sep 6 11:46:14 2021[1,11]:2021-09-06 11:46:14.192490: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,11]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,11]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,11]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,11]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,11]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,11]:\n", - "Mon Sep 6 11:46:14 2021[1,6]:2021-09-06 11:46:14.235507: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,6]:\n", - "Mon Sep 6 11:46:14 2021[1,6]:2021-09-06 11:46:14.242545: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,2]:2021-09-06 11:46:14.242914: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.trace.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,6]:2021-09-06 11:46:14.249229: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,6]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,6]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,6]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,6]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,6]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,6]:\n", - "Mon Sep 6 11:46:14 2021[1,4]:2021-09-06 11:46:14.293566: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,4]:\n", - "Mon Sep 6 11:46:14 2021[1,4]:2021-09-06 11:46:14.301188: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,4]:2021-09-06 11:46:14.310530: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,4]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,4]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,4]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,4]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,4]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,4]:\n", - "Mon Sep 6 11:46:14 2021[1,3]:2021-09-06 11:46:14.330532: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,3]:\n", - "Mon Sep 6 11:46:14 2021[1,3]:2021-09-06 11:46:14.339903: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,3]:2021-09-06 11:46:14.347180: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,3]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,3]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,3]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,3]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,3]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,3]:\n", - "Mon Sep 6 11:46:14 2021[1,2]:2021-09-06 11:46:14.471034: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,2]:\n", - "Mon Sep 6 11:46:14 2021[1,2]:2021-09-06 11:46:14.477906: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.memory_profile.json.gz\n", - "Mon Sep 6 11:46:14 2021[1,2]:2021-09-06 11:46:14.491195: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: tf_logs/plugins/profile/2021_09_06_11_46_12\n", - "Mon Sep 6 11:46:14 2021[1,2]:Dumped tool data for xplane.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.xplane.pb\n", - "Mon Sep 6 11:46:14 2021[1,2]:Dumped tool data for overview_page.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.overview_page.pb\n", - "Mon Sep 6 11:46:14 2021[1,2]:Dumped tool data for input_pipeline.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.input_pipeline.pb\n", - "Mon Sep 6 11:46:14 2021[1,2]:Dumped tool data for tensorflow_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.tensorflow_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,2]:Dumped tool data for kernel_stats.pb to tf_logs/plugins/profile/2021_09_06_11_46_12/dgx2h0194.kernel_stats.pb\n", - "Mon Sep 6 11:46:14 2021[1,2]:\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:16 2021[1,0]: 5/4000 [..............................]Mon Sep 6 11:46:16 2021[1,0]: - ETA: 4:44:11 - loss: 1.1971 - auc: 0.5447Mon Sep 6 11:46:21 2021[1,0]:>:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:21 2021[1,5]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5142s vs `on_train_batch_end` time: 2.2162s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,15]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4938s vs `on_train_batch_end` time: 2.2278s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,9]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5230s vs `on_train_batch_end` time: 2.1673s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,12]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5441s vs `on_train_batch_end` time: 2.1769s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,8]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5099s vs `on_train_batch_end` time: 2.2067s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,6]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4587s vs `on_train_batch_end` time: 2.2470s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,10]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.6162s vs `on_train_batch_end` time: 2.0815s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,4]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4682s vs `on_train_batch_end` time: 2.2509s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,14]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5344s vs `on_train_batch_end` time: 2.1920s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,13]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5144s vs `on_train_batch_end` time: 2.2132s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,1]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4933s vs `on_train_batch_end` time: 2.2237s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,3]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4516s vs `on_train_batch_end` time: 2.2473s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,7]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.6179s vs `on_train_batch_end` time: 2.1218s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,11]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5059s vs `on_train_batch_end` time: 2.2149s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,2]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.4030s vs `on_train_batch_end` time: 2.2793s). Check your callbacks.\n", - "Mon Sep 6 11:46:21 2021[1,0]:WARNING:tensorflow:Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 1.5182s vs `on_train_batch_end` time: 2.1593s). Check your callbacks.\n" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:46:45 2021[1,0]: 11/4000 [..............................]Mon Sep 6 11:46:45 2021[1,0]: - ETA: 5:01:18 - loss: 0.9724 - auc: 0.5378Mon Sep 6 11:46:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:47:41 2021[1,0]: 21/4000 [..............................]Mon Sep 6 11:47:41 2021[1,0]: - ETA: 5:37:25 - loss: 0.7117 - auc: 0.5280Mon Sep 6 11:47:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:48:44 2021[1,0]: 31/4000 [..............................]Mon Sep 6 11:48:44 2021[1,0]: - ETA: 6:02:07 - loss: 0.5560 - auc: 0.5265Mon Sep 6 11:48:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:49:44 2021[1,0]: 41/4000 [..............................]Mon Sep 6 11:49:44 2021[1,0]: - ETA: 6:10:48 - loss: 0.4611 - auc: 0.5275Mon Sep 6 11:49:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:50:42 2021[1,0]: 50/4000 [..............................]Mon Sep 6 11:50:42 2021[1,0]: - ETA: 6:20:05 - loss: 0.4050 - auc: 0.5309Mon Sep 6 11:50:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:51:41 2021[1,0]: 59/4000 [..............................]Mon Sep 6 11:51:41 2021[1,0]: - ETA: 6:26:39 - loss: 0.3650 - auc: 0.5373Mon Sep 6 11:51:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:52:44 2021[1,0]: 68/4000 [..............................]Mon Sep 6 11:52:44 2021[1,0]: - ETA: 6:35:30 - loss: 0.3352 - auc: 0.5462Mon Sep 6 11:52:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:53:40 2021[1,0]: 76/4000 [..............................]Mon Sep 6 11:53:40 2021[1,0]: - ETA: 6:41:37 - loss: 0.3143 - auc: 0.5561Mon Sep 6 11:53:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:54:38 2021[1,0]: 84/4000 [..............................]Mon Sep 6 11:54:38 2021[1,0]: - ETA: 6:48:12 - loss: 0.2972 - auc: 0.5662Mon Sep 6 11:54:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:55:44 2021[1,0]: 93/4000 [..............................]Mon Sep 6 11:55:44 2021[1,0]: - ETA: 6:53:56 - loss: 0.2815 - auc: 0.5771Mon Sep 6 11:55:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:56:37 2021[1,0]: 100/4000 [..............................]Mon Sep 6 11:56:37 2021[1,0]: - ETA: 6:58:55 - loss: 0.2710 - auc: 0.5854Mon Sep 6 11:56:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:57:39 2021[1,0]: 108/4000 [..............................]Mon Sep 6 11:57:39 2021[1,0]: - ETA: 7:04:18 - loss: 0.2609 - auc: 0.5939Mon Sep 6 11:57:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:58:42 2021[1,0]: 116/4000 [..............................]Mon Sep 6 11:58:42 2021[1,0]: - ETA: 7:09:03 - loss: 0.2521 - auc: 0.6023Mon Sep 6 11:58:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 11:59:37 2021[1,0]: 123/4000 [..............................]Mon Sep 6 11:59:37 2021[1,0]: - ETA: 7:13:04 - loss: 0.2452 - auc: 0.6090Mon Sep 6 11:59:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:00:42 2021[1,0]: 131/4000 [..............................]Mon Sep 6 12:00:42 2021[1,0]: - ETA: 7:17:40 - loss: 0.2382 - auc: 0.6162Mon Sep 6 12:00:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:01:39 2021[1,0]: 138/4000 [>.............................]Mon Sep 6 12:01:39 2021[1,0]: - ETA: 7:21:24 - loss: 0.2328 - auc: 0.6220Mon Sep 6 12:01:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:02:37 2021[1,0]: 145/4000 [>.............................]Mon Sep 6 12:02:37 2021[1,0]: - ETA: 7:25:19 - loss: 0.2279 - auc: 0.6274Mon Sep 6 12:02:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:03:37 2021[1,0]: 152/4000 [>.............................]Mon Sep 6 12:03:37 2021[1,0]: - ETA: 7:29:15 - loss: 0.2233 - auc: 0.6327Mon Sep 6 12:03:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:04:36 2021[1,0]: 159/4000 [>.............................]Mon Sep 6 12:04:36 2021[1,0]: - ETA: 7:32:18 - loss: 0.2192 - auc: 0.6377Mon Sep 6 12:04:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:05:43 2021[1,0]: 167/4000 [>.............................]Mon Sep 6 12:05:43 2021[1,0]: - ETA: 7:35:26 - loss: 0.2149 - auc: 0.6427Mon Sep 6 12:05:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:06:42 2021[1,0]: 174/4000 [>.............................]Mon Sep 6 12:06:42 2021[1,0]: - ETA: 7:38:11 - loss: 0.2115 - auc: 0.6469Mon Sep 6 12:06:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:07:42 2021[1,0]: 181/4000 [>.............................]Mon Sep 6 12:07:42 2021[1,0]: - ETA: 7:40:34 - loss: 0.2084 - auc: 0.6507Mon Sep 6 12:07:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:08:41 2021[1,0]: 188/4000 [>.............................]Mon Sep 6 12:08:41 2021[1,0]: - ETA: 7:42:41 - loss: 0.2055 - auc: 0.6545Mon Sep 6 12:08:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:09:40 2021[1,0]: 195/4000 [>.............................] - ETA: 7:44:22 - loss: 0.2027 - auc: 0.6581Mon Sep 6 12:09:49 2021[1,0]:Mon Sep 6 12:09:32 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:10:40 2021[1,0]: 202/4000 [>.............................]Mon Sep 6 12:10:40 2021[1,0]: - ETA: 7:46:12 - loss: 0.2002 - auc: 0.6614Mon Sep 6 12:10:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:11:40 2021[1,0]: 209/4000 [>.............................]Mon Sep 6 12:11:40 2021[1,0]: - ETA: 7:47:50 - loss: 0.1978 - auc: 0.6646Mon Sep 6 12:11:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:12:39 2021[1,0]: 216/4000 [>.............................]Mon Sep 6 12:12:39 2021[1,0]: - ETA: 7:49:20 - loss: 0.1956 - auc: 0.6675Mon Sep 6 12:12:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:13:40 2021[1,0]: 223/4000 [>.............................]Mon Sep 6 12:13:40 2021[1,0]: - ETA: 7:50:49 - loss: 0.1935 - auc: 0.6702Mon Sep 6 12:13:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:14:38 2021[1,0]: 230/4000 [>.............................]Mon Sep 6 12:14:38 2021[1,0]: - ETA: 7:51:37 - loss: 0.1916 - auc: 0.6730Mon Sep 6 12:14:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:15:38 2021[1,0]: 237/4000 [>.............................]Mon Sep 6 12:15:38 2021[1,0]: - ETA: 7:52:41 - loss: 0.1897 - auc: 0.6754Mon Sep 6 12:15:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:16:38 2021[1,0]: 244/4000 [>.............................]Mon Sep 6 12:16:38 2021[1,0]: - ETA: 7:53:46 - loss: 0.1880 - auc: 0.6779Mon Sep 6 12:16:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:17:38 2021[1,0]: 251/4000 [>.............................]Mon Sep 6 12:17:38 2021[1,0]: - ETA: 7:54:34 - loss: 0.1864 - auc: 0.6802Mon Sep 6 12:17:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:18:37 2021[1,0]: 258/4000 [>.............................]Mon Sep 6 12:18:37 2021[1,0]: - ETA: 7:55:03 - loss: 0.1848 - auc: 0.6824Mon Sep 6 12:18:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:19:37 2021[1,0]: 265/4000 [>.............................]Mon Sep 6 12:19:37 2021[1,0]: - ETA: 7:55:43 - loss: 0.1832 - auc: 0.6846Mon Sep 6 12:19:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 272/4000 [=>............................]Mon Sep 6 12:20:37 2021[1,0]: - ETA: 7:56:22 - loss: 0.1818 - auc: 0.6867Mon Sep 6 12:20:46 2021[1,0]:Mon Sep 6 12:20:20 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 279/4000 [=>............................]Mon Sep 6 12:21:38 2021[1,0]: - ETA: 7:57:08 - loss: 0.1804 - auc: 0.6887Mon Sep 6 12:21:47 2021[1,0]:Mon Sep 6 12:21:29 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:22:38 2021[1,0]: 286/4000 [=>............................]Mon Sep 6 12:22:38 2021[1,0]: - ETA: 7:57:26 - loss: 0.1791 - auc: 0.6906Mon Sep 6 12:22:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:23:38 2021[1,0]: 293/4000 [=>............................]Mon Sep 6 12:23:38 2021[1,0]: - ETA: 7:57:59 - loss: 0.1779 - auc: 0.6924Mon Sep 6 12:23:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:24:40 2021[1,0]: 300/4000 [=>............................]Mon Sep 6 12:24:40 2021[1,0]: - ETA: 7:58:35 - loss: 0.1767 - auc: 0.6941Mon Sep 6 12:24:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:25:40 2021[1,0]: 307/4000 [=>............................]Mon Sep 6 12:25:40 2021[1,0]: - ETA: 7:58:54 - loss: 0.1756 - auc: 0.6957Mon Sep 6 12:25:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:26:40 2021[1,0]: 314/4000 [=>............................]Mon Sep 6 12:26:40 2021[1,0]: - ETA: 7:59:03 - loss: 0.1745 - auc: 0.6973Mon Sep 6 12:26:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:27:40 2021[1,0]: 321/4000 [=>............................]Mon Sep 6 12:27:40 2021[1,0]: - ETA: 7:59:04 - loss: 0.1735 - auc: 0.6988Mon Sep 6 12:27:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:28:40 2021[1,0]: 328/4000 [=>............................]Mon Sep 6 12:28:40 2021[1,0]: - ETA: 7:59:18 - loss: 0.1726 - auc: 0.7003Mon Sep 6 12:28:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:29:42 2021[1,0]: 335/4000 [=>............................]Mon Sep 6 12:29:42 2021[1,0]: - ETA: 7:59:35 - loss: 0.1716 - auc: 0.7017Mon Sep 6 12:29:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:30:42 2021[1,0]: 342/4000 [=>............................]Mon Sep 6 12:30:42 2021[1,0]: - ETA: 7:59:39 - loss: 0.1707 - auc: 0.7031Mon Sep 6 12:30:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:31:42 2021[1,0]: 349/4000 [=>............................]Mon Sep 6 12:31:42 2021[1,0]: - ETA: 7:59:34 - loss: 0.1698 - auc: 0.7044Mon Sep 6 12:31:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:32:43 2021[1,0]: 356/4000 [=>............................]Mon Sep 6 12:32:43 2021[1,0]: - ETA: 7:59:36 - loss: 0.1689 - auc: 0.7058Mon Sep 6 12:32:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:33:36 2021[1,0]: 362/4000 [=>............................]Mon Sep 6 12:33:36 2021[1,0]: - ETA: 7:59:43 - loss: 0.1683 - auc: 0.7069Mon Sep 6 12:33:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:34:37 2021[1,0]: 369/4000 [=>............................]Mon Sep 6 12:34:37 2021[1,0]: - ETA: 7:59:48 - loss: 0.1674 - auc: 0.7082Mon Sep 6 12:34:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:35:38 2021[1,0]: 376/4000 [=>............................]Mon Sep 6 12:35:38 2021[1,0]: - ETA: 7:59:40 - loss: 0.1667 - auc: 0.7093Mon Sep 6 12:35:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:36:37 2021[1,0]: 383/4000 [=>............................]Mon Sep 6 12:36:37 2021[1,0]: - ETA: 7:59:26 - loss: 0.1660 - auc: 0.7106Mon Sep 6 12:36:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:37:39 2021[1,0]: 390/4000 [=>............................]Mon Sep 6 12:37:39 2021[1,0]: - ETA: 7:59:27 - loss: 0.1653 - auc: 0.7117Mon Sep 6 12:37:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:38:40 2021[1,0]: 397/4000 [=>............................]Mon Sep 6 12:38:40 2021[1,0]: - ETA: 7:59:20 - loss: 0.1646 - auc: 0.7127Mon Sep 6 12:38:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:39:42 2021[1,0]: 404/4000 [==>...........................]Mon Sep 6 12:39:42 2021[1,0]: - ETA: 7:59:13 - loss: 0.1640 - auc: 0.7137Mon Sep 6 12:39:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:40:42 2021[1,0]: 411/4000 [==>...........................]Mon Sep 6 12:40:42 2021[1,0]: - ETA: 7:58:54 - loss: 0.1633 - auc: 0.7148Mon Sep 6 12:40:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:41:44 2021[1,0]: 418/4000 [==>...........................]Mon Sep 6 12:41:44 2021[1,0]: - ETA: 7:58:49 - loss: 0.1627 - auc: 0.7157Mon Sep 6 12:41:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:42:36 2021[1,0]: 424/4000 [==>...........................]Mon Sep 6 12:42:36 2021[1,0]: - ETA: 7:58:35 - loss: 0.1622 - auc: 0.7165Mon Sep 6 12:42:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:43:36 2021[1,0]: 431/4000 [==>...........................]Mon Sep 6 12:43:36 2021[1,0]: - ETA: 7:58:09 - loss: 0.1617 - auc: 0.7174Mon Sep 6 12:43:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:44:39 2021[1,0]: 438/4000 [==>...........................]Mon Sep 6 12:44:39 2021[1,0]: - ETA: 7:58:06 - loss: 0.1611 - auc: 0.7183Mon Sep 6 12:44:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:45:40 2021[1,0]: 445/4000 [==>...........................]Mon Sep 6 12:45:40 2021[1,0]: - ETA: 7:57:50 - loss: 0.1606 - auc: 0.7192Mon Sep 6 12:45:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:46:42 2021[1,0]: 452/4000 [==>...........................]Mon Sep 6 12:46:42 2021[1,0]: - ETA: 7:57:34 - loss: 0.1601 - auc: 0.7201Mon Sep 6 12:46:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:47:44 2021[1,0]: 459/4000 [==>...........................]Mon Sep 6 12:47:44 2021[1,0]: - ETA: 7:57:19 - loss: 0.1596 - auc: 0.7209Mon Sep 6 12:47:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:48:36 2021[1,0]: 465/4000 [==>...........................]Mon Sep 6 12:48:36 2021[1,0]: - ETA: 7:56:58 - loss: 0.1591 - auc: 0.7215Mon Sep 6 12:48:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:49:37 2021[1,0]: 472/4000 [==>...........................]Mon Sep 6 12:49:37 2021[1,0]: - ETA: 7:56:33 - loss: 0.1587 - auc: 0.7223Mon Sep 6 12:49:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:50:36 2021[1,0]: 479/4000 [==>...........................]Mon Sep 6 12:50:36 2021[1,0]: - ETA: 7:55:58 - loss: 0.1582 - auc: 0.7231Mon Sep 6 12:50:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:51:37 2021[1,0]: 486/4000 [==>...........................]Mon Sep 6 12:51:37 2021[1,0]: - ETA: 7:55:26 - loss: 0.1577 - auc: 0.7239Mon Sep 6 12:51:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:52:38 2021[1,0]: 493/4000 [==>...........................]Mon Sep 6 12:52:38 2021[1,0]: - ETA: 7:55:02 - loss: 0.1573 - auc: 0.7246Mon Sep 6 12:52:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:53:40 2021[1,0]: 500/4000 [==>...........................]Mon Sep 6 12:53:40 2021[1,0]: - ETA: 7:54:37 - loss: 0.1568 - auc: 0.7253Mon Sep 6 12:53:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:54:40 2021[1,0]: 507/4000 [==>...........................]Mon Sep 6 12:54:40 2021[1,0]: - ETA: 7:54:04 - loss: 0.1564 - auc: 0.7261Mon Sep 6 12:54:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:55:40 2021[1,0]: 514/4000 [==>...........................]Mon Sep 6 12:55:40 2021[1,0]: - ETA: 7:53:27 - loss: 0.1560 - auc: 0.7268Mon Sep 6 12:55:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:56:40 2021[1,0]: 521/4000 [==>...........................]Mon Sep 6 12:56:40 2021[1,0]: - ETA: 7:52:50 - loss: 0.1556 - auc: 0.7274Mon Sep 6 12:56:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:57:39 2021[1,0]: 528/4000 [==>...........................]Mon Sep 6 12:57:39 2021[1,0]: - ETA: 7:52:08 - loss: 0.1553 - auc: 0.7281Mon Sep 6 12:57:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:58:40 2021[1,0]: 535/4000 [===>..........................]Mon Sep 6 12:58:40 2021[1,0]: - ETA: 7:51:35 - loss: 0.1549 - auc: 0.7287Mon Sep 6 12:58:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 12:59:41 2021[1,0]: 542/4000 [===>..........................]Mon Sep 6 12:59:41 2021[1,0]: - ETA: 7:51:05 - loss: 0.1545 - auc: 0.7293Mon Sep 6 12:59:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:00:42 2021[1,0]: 549/4000 [===>..........................]Mon Sep 6 13:00:42 2021[1,0]: - ETA: 7:50:26 - loss: 0.1542 - auc: 0.7299Mon Sep 6 13:00:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 556/4000 [===>..........................]Mon Sep 6 13:01:41 2021[1,0]: - ETA: 7:49:40 - loss: 0.1538 - auc: 0.7305Mon Sep 6 13:01:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:02:41 2021[1,0]: 563/4000 [===>..........................]Mon Sep 6 13:02:41 2021[1,0]: - ETA: 7:49:01 - loss: 0.1535 - auc: 0.7311Mon Sep 6 13:02:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:03:40 2021[1,0]: 570/4000 [===>..........................]Mon Sep 6 13:03:40 2021[1,0]: - ETA: 7:48:17 - loss: 0.1531 - auc: 0.7316Mon Sep 6 13:03:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:04:38 2021[1,0]: 577/4000 [===>..........................]Mon Sep 6 13:04:38 2021[1,0]: - ETA: 7:47:19 - loss: 0.1528 - auc: 0.7322Mon Sep 6 13:04:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:05:42 2021[1,0]: 585/4000 [===>..........................]Mon Sep 6 13:05:42 2021[1,0]: - ETA: 7:46:07 - loss: 0.1524 - auc: 0.7328Mon Sep 6 13:05:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:06:43 2021[1,0]: 592/4000 [===>..........................]Mon Sep 6 13:06:43 2021[1,0]: - ETA: 7:45:28 - loss: 0.1521 - auc: 0.7333Mon Sep 6 13:06:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:07:43 2021[1,0]: 599/4000 [===>..........................]Mon Sep 6 13:07:43 2021[1,0]: - ETA: 7:44:49 - loss: 0.1518 - auc: 0.7338Mon Sep 6 13:07:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:08:44 2021[1,0]: 606/4000 [===>..........................]Mon Sep 6 13:08:44 2021[1,0]: - ETA: 7:44:09 - loss: 0.1515 - auc: 0.7343Mon Sep 6 13:08:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:09:43 2021[1,0]: 613/4000 [===>..........................]Mon Sep 6 13:09:43 2021[1,0]: - ETA: 7:43:22 - loss: 0.1513 - auc: 0.7348Mon Sep 6 13:09:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:10:41 2021[1,0]: 620/4000 [===>..........................]Mon Sep 6 13:10:41 2021[1,0]: - ETA: 7:42:25 - loss: 0.1510 - auc: 0.7353Mon Sep 6 13:10:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:11:38 2021[1,0]: 627/4000 [===>..........................]Mon Sep 6 13:11:38 2021[1,0]: - ETA: 7:41:25 - loss: 0.1507 - auc: 0.7358Mon Sep 6 13:11:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:12:44 2021[1,0]: 635/4000 [===>..........................]Mon Sep 6 13:12:44 2021[1,0]: - ETA: 7:40:24 - loss: 0.1504 - auc: 0.7363Mon Sep 6 13:12:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:13:44 2021[1,0]: 642/4000 [===>..........................]Mon Sep 6 13:13:44 2021[1,0]: - ETA: 7:39:39 - loss: 0.1502 - auc: 0.7367Mon Sep 6 13:13:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:14:45 2021[1,0]: 649/4000 [===>..........................]Mon Sep 6 13:14:45 2021[1,0]: - ETA: 7:38:58 - loss: 0.1499 - auc: 0.7372Mon Sep 6 13:14:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 656/4000 [===>..........................]Mon Sep 6 13:15:45 2021[1,0]: - ETA: 7:38:14 - loss: 0.1497 - auc: 0.7377Mon Sep 6 13:15:54 2021[1,0]:Mon Sep 6 13:15:28 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:16:44 2021[1,0]: 663/4000 [===>..........................]Mon Sep 6 13:16:44 2021[1,0]: - ETA: 7:37:26 - loss: 0.1494 - auc: 0.7381Mon Sep 6 13:16:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:17:36 2021[1,0]: 669/4000 [====>.........................]Mon Sep 6 13:17:36 2021[1,0]: - ETA: 7:36:48 - loss: 0.1492 - auc: 0.7385Mon Sep 6 13:17:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 676/4000 [====>.........................]Mon Sep 6 13:18:38 2021[1,0]: - ETA: 7:36:12 - loss: 0.1490 - auc: 0.7389Mon Sep 6 13:18:47 2021[1,0]:Mon Sep 6 13:18:38 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 684/4000 [====>.........................]Mon Sep 6 13:19:45 2021[1,0]: - ETA: 7:35:13 - loss: 0.1487 - auc: 0.7394Mon Sep 6 13:19:54 2021[1,0]:Mon Sep 6 13:19:37 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:20:45 2021[1,0]: 691/4000 [====>.........................]Mon Sep 6 13:20:45 2021[1,0]: - ETA: 7:34:27 - loss: 0.1485 - auc: 0.7398Mon Sep 6 13:20:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:21:43 2021[1,0]: 698/4000 [====>.........................]Mon Sep 6 13:21:43 2021[1,0]: - ETA: 7:33:32 - loss: 0.1483 - auc: 0.7402Mon Sep 6 13:21:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:22:41 2021[1,0]: 705/4000 [====>.........................]Mon Sep 6 13:22:41 2021[1,0]: - ETA: 7:32:35 - loss: 0.1481 - auc: 0.7406Mon Sep 6 13:22:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:23:46 2021[1,0]: 713/4000 [====>.........................]Mon Sep 6 13:23:46 2021[1,0]: - ETA: 7:31:21 - loss: 0.1478 - auc: 0.7410Mon Sep 6 13:23:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:24:43 2021[1,0]: 720/4000 [====>.........................]Mon Sep 6 13:24:43 2021[1,0]: - ETA: 7:30:24 - loss: 0.1476 - auc: 0.7414Mon Sep 6 13:24:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:25:43 2021[1,0]: 727/4000 [====>.........................]Mon Sep 6 13:25:43 2021[1,0]: - ETA: 7:29:35 - loss: 0.1474 - auc: 0.7417Mon Sep 6 13:25:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:26:44 2021[1,0]: 734/4000 [====>.........................]Mon Sep 6 13:26:44 2021[1,0]: - ETA: 7:28:51 - loss: 0.1472 - auc: 0.7421Mon Sep 6 13:26:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:27:37 2021[1,0]: 740/4000 [====>.........................]Mon Sep 6 13:27:37 2021[1,0]: - ETA: 7:28:19 - loss: 0.1470 - auc: 0.7424Mon Sep 6 13:27:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:28:38 2021[1,0]: 747/4000 [====>.........................]Mon Sep 6 13:28:38 2021[1,0]: - ETA: 7:27:33 - loss: 0.1469 - auc: 0.7427Mon Sep 6 13:28:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:29:39 2021[1,0]: 754/4000 [====>.........................]Mon Sep 6 13:29:39 2021[1,0]: - ETA: 7:26:52 - loss: 0.1467 - auc: 0.7431Mon Sep 6 13:29:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:30:38 2021[1,0]: 761/4000 [====>.........................]Mon Sep 6 13:30:38 2021[1,0]: - ETA: 7:25:59 - loss: 0.1465 - auc: 0.7434Mon Sep 6 13:30:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 768/4000 [====>.........................]Mon Sep 6 13:31:38 2021[1,0]: - ETA: 7:25:08 - loss: 0.1463 - auc: 0.7437Mon Sep 6 13:31:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 775/4000 [====>.........................]Mon Sep 6 13:32:37 2021[1,0]: - ETA: 7:24:18 - loss: 0.1461 - auc: 0.7441Mon Sep 6 13:32:46 2021[1,0]:Mon Sep 6 13:32:29 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:33:37 2021[1,0]: 782/4000 [====>.........................]Mon Sep 6 13:33:37 2021[1,0]: - ETA: 7:23:28 - loss: 0.1459 - auc: 0.7444Mon Sep 6 13:33:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:34:37 2021[1,0]: 789/4000 [====>.........................]Mon Sep 6 13:34:37 2021[1,0]: - ETA: 7:22:40 - loss: 0.1458 - auc: 0.7447Mon Sep 6 13:34:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:35:45 2021[1,0]: 797/4000 [====>.........................]Mon Sep 6 13:35:45 2021[1,0]: - ETA: 7:21:40 - loss: 0.1456 - auc: 0.7451Mon Sep 6 13:35:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 803/4000 [=====>........................]Mon Sep 6 13:36:38 2021[1,0]: - ETA: 7:21:02 - loss: 0.1454 - auc: 0.7454Mon Sep 6 13:36:46 2021[1,0]:Mon Sep 6 13:36:20 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:37:46 2021[1,0]: 811/4000 [=====>........................]Mon Sep 6 13:37:46 2021[1,0]: - ETA: 7:20:03 - loss: 0.1452 - auc: 0.7457Mon Sep 6 13:37:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:38:45 2021[1,0]: 818/4000 [=====>........................]Mon Sep 6 13:38:45 2021[1,0]: - ETA: 7:19:11 - loss: 0.1451 - auc: 0.7460Mon Sep 6 13:38:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:39:43 2021[1,0]: 825/4000 [=====>........................]Mon Sep 6 13:39:43 2021[1,0]: - ETA: 7:18:13 - loss: 0.1449 - auc: 0.7463Mon Sep 6 13:39:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:40:40 2021[1,0]: 832/4000 [=====>........................]Mon Sep 6 13:40:40 2021[1,0]: - ETA: 7:17:10 - loss: 0.1448 - auc: 0.7466Mon Sep 6 13:40:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 839/4000 [=====>........................]Mon Sep 6 13:41:39 2021[1,0]: - ETA: 7:16:15 - loss: 0.1446 - auc: 0.7469Mon Sep 6 13:41:47 2021[1,0]:Mon Sep 6 13:41:21 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:42:39 2021[1,0]: 846/4000 [=====>........................]Mon Sep 6 13:42:39 2021[1,0]: - ETA: 7:15:25 - loss: 0.1444 - auc: 0.7472Mon Sep 6 13:42:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:43:44 2021[1,0]: 854/4000 [=====>........................]Mon Sep 6 13:43:44 2021[1,0]: - ETA: 7:14:13 - loss: 0.1443 - auc: 0.7475Mon Sep 6 13:43:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:44:42 2021[1,0]: 861/4000 [=====>........................]Mon Sep 6 13:44:42 2021[1,0]: - ETA: 7:13:19 - loss: 0.1441 - auc: 0.7478Mon Sep 6 13:44:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:45:43 2021[1,0]: 868/4000 [=====>........................]Mon Sep 6 13:45:43 2021[1,0]: - ETA: 7:12:32 - loss: 0.1440 - auc: 0.7481Mon Sep 6 13:45:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:46:43 2021[1,0]: 875/4000 [=====>........................]Mon Sep 6 13:46:43 2021[1,0]: - ETA: 7:11:40 - loss: 0.1438 - auc: 0.7483Mon Sep 6 13:46:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:47:43 2021[1,0]: 882/4000 [=====>........................]Mon Sep 6 13:47:43 2021[1,0]: - ETA: 7:10:49 - loss: 0.1437 - auc: 0.7486Mon Sep 6 13:47:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:48:44 2021[1,0]: 889/4000 [=====>........................]Mon Sep 6 13:48:44 2021[1,0]: - ETA: 7:10:00 - loss: 0.1435 - auc: 0.7489Mon Sep 6 13:48:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:49:43 2021[1,0]: 896/4000 [=====>........................]Mon Sep 6 13:49:43 2021[1,0]: - ETA: 7:09:06 - loss: 0.1434 - auc: 0.7491Mon Sep 6 13:49:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:50:41 2021[1,0]: 903/4000 [=====>........................]Mon Sep 6 13:50:41 2021[1,0]: - ETA: 7:08:08 - loss: 0.1433 - auc: 0.7494Mon Sep 6 13:50:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:51:39 2021[1,0]: 910/4000 [=====>........................]Mon Sep 6 13:51:39 2021[1,0]: - ETA: 7:07:11 - loss: 0.1431 - auc: 0.7496Mon Sep 6 13:51:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:52:41 2021[1,0]: 917/4000 [=====>........................]Mon Sep 6 13:52:41 2021[1,0]: - ETA: 7:06:25 - loss: 0.1430 - auc: 0.7498Mon Sep 6 13:52:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:53:42 2021[1,0]: 924/4000 [=====>........................]Mon Sep 6 13:53:42 2021[1,0]: - ETA: 7:05:35 - loss: 0.1429 - auc: 0.7501Mon Sep 6 13:53:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 931/4000 [=====>........................]Mon Sep 6 13:54:43 2021[1,0]: - ETA: 7:04:47 - loss: 0.1427 - auc: 0.7503Mon Sep 6 13:54:51 2021[1,0]:Mon Sep 6 13:54:34 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:55:43 2021[1,0]: 938/4000 [======>.......................]Mon Sep 6 13:55:43 2021[1,0]: - ETA: 7:03:56 - loss: 0.1426 - auc: 0.7505Mon Sep 6 13:55:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:56:43 2021[1,0]: 945/4000 [======>.......................]Mon Sep 6 13:56:43 2021[1,0]: - ETA: 7:03:04 - loss: 0.1425 - auc: 0.7508Mon Sep 6 13:56:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 952/4000 [======>.......................]Mon Sep 6 13:57:43 2021[1,0]: - ETA: 7:02:11 - loss: 0.1424 - auc: 0.7510Mon Sep 6 13:57:51 2021[1,0]:Mon Sep 6 13:57:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:58:42 2021[1,0]: 959/4000 [======>.......................]Mon Sep 6 13:58:42 2021[1,0]: - ETA: 7:01:16 - loss: 0.1422 - auc: 0.7512Mon Sep 6 13:58:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 13:59:42 2021[1,0]: 966/4000 [======>.......................]Mon Sep 6 13:59:42 2021[1,0]: - ETA: 7:00:24 - loss: 0.1421 - auc: 0.7515Mon Sep 6 13:59:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - " 973/4000 [======>.......................]Mon Sep 6 14:00:40 2021[1,0]: - ETA: 6:59:25 - loss: 0.1420 - auc: 0.7517Mon Sep 6 14:00:48 2021[1,0]:Mon Sep 6 14:00:40 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:01:40 2021[1,0]: 980/4000 [======>.......................]Mon Sep 6 14:01:40 2021[1,0]: - ETA: 6:58:30 - loss: 0.1419 - auc: 0.7519Mon Sep 6 14:01:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:02:39 2021[1,0]: 987/4000 [======>.......................]Mon Sep 6 14:02:39 2021[1,0]: - ETA: 6:57:34 - loss: 0.1418 - auc: 0.7521Mon Sep 6 14:02:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:03:46 2021[1,0]: 995/4000 [======>.......................]Mon Sep 6 14:03:46 2021[1,0]: - ETA: 6:56:32 - loss: 0.1416 - auc: 0.7524Mon Sep 6 14:03:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:04:45 2021[1,0]:1002/4000 [======>.......................]Mon Sep 6 14:04:45 2021[1,0]: - ETA: 6:55:34 - loss: 0.1415 - auc: 0.7526Mon Sep 6 14:04:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:05:45 2021[1,0]:1009/4000 [======>.......................]Mon Sep 6 14:05:45 2021[1,0]: - ETA: 6:54:42 - loss: 0.1414 - auc: 0.7528Mon Sep 6 14:05:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:06:45 2021[1,0]:1016/4000 [======>.......................]Mon Sep 6 14:06:45 2021[1,0]: - ETA: 6:53:49 - loss: 0.1413 - auc: 0.7530Mon Sep 6 14:06:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:07:45 2021[1,0]:1023/4000 [======>.......................]Mon Sep 6 14:07:45 2021[1,0]: - ETA: 6:52:55 - loss: 0.1412 - auc: 0.7532Mon Sep 6 14:07:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1030/4000 [======>.......................]Mon Sep 6 14:08:45 2021[1,0]: - ETA: 6:52:02 - loss: 0.1411 - auc: 0.7534Mon Sep 6 14:08:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:09:44 2021[1,0]:1037/4000 [======>.......................]Mon Sep 6 14:09:44 2021[1,0]: - ETA: 6:51:06 - loss: 0.1410 - auc: 0.7536Mon Sep 6 14:09:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1044/4000 [======>.......................]Mon Sep 6 14:10:42 2021[1,0]: - ETA: 6:50:08 - loss: 0.1409 - auc: 0.7538Mon Sep 6 14:10:51 2021[1,0]:Mon Sep 6 14:10:25 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:11:41 2021[1,0]:1051/4000 [======>.......................]Mon Sep 6 14:11:41 2021[1,0]: - ETA: 6:49:12 - loss: 0.1408 - auc: 0.7540Mon Sep 6 14:11:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:12:41 2021[1,0]:1058/4000 [======>.......................]Mon Sep 6 14:12:41 2021[1,0]: - ETA: 6:48:18 - loss: 0.1407 - auc: 0.7542Mon Sep 6 14:12:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:13:42 2021[1,0]:1065/4000 [======>.......................]Mon Sep 6 14:13:42 2021[1,0]: - ETA: 6:47:28 - loss: 0.1406 - auc: 0.7544Mon Sep 6 14:13:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1072/4000 [=======>......................]Mon Sep 6 14:14:43 2021[1,0]: - ETA: 6:46:35 - loss: 0.1405 - auc: 0.7546Mon Sep 6 14:14:51 2021[1,0]:Mon Sep 6 14:14:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:15:42 2021[1,0]:1079/4000 [=======>......................]Mon Sep 6 14:15:42 2021[1,0]: - ETA: 6:45:40 - loss: 0.1404 - auc: 0.7548Mon Sep 6 14:15:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1086/4000 [=======>......................]Mon Sep 6 14:16:42 2021[1,0]: - ETA: 6:44:46 - loss: 0.1403 - auc: 0.7550Mon Sep 6 14:16:51 2021[1,0]:Mon Sep 6 14:16:42 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:17:42 2021[1,0]:1093/4000 [=======>......................]Mon Sep 6 14:17:42 2021[1,0]: - ETA: 6:43:52 - loss: 0.1402 - auc: 0.7551Mon Sep 6 14:17:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:18:43 2021[1,0]:1100/4000 [=======>......................]Mon Sep 6 14:18:43 2021[1,0]: - ETA: 6:42:59 - loss: 0.1402 - auc: 0.7553Mon Sep 6 14:18:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:19:43 2021[1,0]:1107/4000 [=======>......................]Mon Sep 6 14:19:43 2021[1,0]: - ETA: 6:42:06 - loss: 0.1401 - auc: 0.7555Mon Sep 6 14:19:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:20:44 2021[1,0]:1114/4000 [=======>......................]Mon Sep 6 14:20:44 2021[1,0]: - ETA: 6:41:13 - loss: 0.1400 - auc: 0.7556Mon Sep 6 14:20:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:21:45 2021[1,0]:1121/4000 [=======>......................]Mon Sep 6 14:21:45 2021[1,0]: - ETA: 6:40:23 - loss: 0.1399 - auc: 0.7558Mon Sep 6 14:21:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:22:45 2021[1,0]:1128/4000 [=======>......................]Mon Sep 6 14:22:45 2021[1,0]: - ETA: 6:39:29 - loss: 0.1398 - auc: 0.7560Mon Sep 6 14:22:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:23:46 2021[1,0]:1135/4000 [=======>......................]Mon Sep 6 14:23:46 2021[1,0]: - ETA: 6:38:37 - loss: 0.1397 - auc: 0.7562Mon Sep 6 14:23:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:24:39 2021[1,0]:1141/4000 [=======>......................]Mon Sep 6 14:24:39 2021[1,0]: - ETA: 6:37:54 - loss: 0.1396 - auc: 0.7563Mon Sep 6 14:24:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:25:40 2021[1,0]:1148/4000 [=======>......................]Mon Sep 6 14:25:40 2021[1,0]: - ETA: 6:37:01 - loss: 0.1395 - auc: 0.7565Mon Sep 6 14:25:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1156/4000 [=======>......................]Mon Sep 6 14:26:46 2021[1,0]: - ETA: 6:35:52 - loss: 0.1394 - auc: 0.7567Mon Sep 6 14:26:54 2021[1,0]:Mon Sep 6 14:26:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:27:46 2021[1,0]:1163/4000 [=======>......................]Mon Sep 6 14:27:46 2021[1,0]: - ETA: 6:34:58 - loss: 0.1393 - auc: 0.7568Mon Sep 6 14:27:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1170/4000 [=======>......................]Mon Sep 6 14:28:46 2021[1,0]: - ETA: 6:34:04 - loss: 0.1393 - auc: 0.7570Mon Sep 6 14:28:55 2021[1,0]:Mon Sep 6 14:28:38 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:29:47 2021[1,0]:1177/4000 [=======>......................]Mon Sep 6 14:29:47 2021[1,0]: - ETA: 6:33:10 - loss: 0.1392 - auc: 0.7571Mon Sep 6 14:29:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:30:47 2021[1,0]:1184/4000 [=======>......................]Mon Sep 6 14:30:47 2021[1,0]: - ETA: 6:32:16 - loss: 0.1391 - auc: 0.7573Mon Sep 6 14:30:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1190/4000 [=======>......................]Mon Sep 6 14:31:39 2021[1,0]: - ETA: 6:31:30 - loss: 0.1390 - auc: 0.7575Mon Sep 6 14:31:47 2021[1,0]:Mon Sep 6 14:31:30 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:32:39 2021[1,0]:1197/4000 [=======>......................]Mon Sep 6 14:32:39 2021[1,0]: - ETA: 6:30:35 - loss: 0.1389 - auc: 0.7576Mon Sep 6 14:32:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:33:38 2021[1,0]:1204/4000 [========>.....................]Mon Sep 6 14:33:38 2021[1,0]: - ETA: 6:29:38 - loss: 0.1389 - auc: 0.7578Mon Sep 6 14:33:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:34:39 2021[1,0]:1211/4000 [========>.....................]Mon Sep 6 14:34:39 2021[1,0]: - ETA: 6:28:45 - loss: 0.1388 - auc: 0.7579Mon Sep 6 14:34:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:35:45 2021[1,0]:1219/4000 [========>.....................] - ETA: 6:27:36 - loss: 0.1387 - auc: 0.7581Mon Sep 6 14:35:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:36:44 2021[1,0]:1226/4000 [========>.....................]Mon Sep 6 14:36:44 2021[1,0]: - ETA: 6:26:39 - loss: 0.1386 - auc: 0.7582Mon Sep 6 14:36:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1233/4000 [========>.....................]Mon Sep 6 14:37:45 2021[1,0]: - ETA: 6:25:45 - loss: 0.1386 - auc: 0.7583Mon Sep 6 14:37:53 2021[1,0]:Mon Sep 6 14:37:19 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:38:44 2021[1,0]:1240/4000 [========>.....................]Mon Sep 6 14:38:44 2021[1,0]: - ETA: 6:24:47 - loss: 0.1385 - auc: 0.7585Mon Sep 6 14:38:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1247/4000 [========>.....................]Mon Sep 6 14:39:40 2021[1,0]: - ETA: 6:23:43 - loss: 0.1384 - auc: 0.7586Mon Sep 6 14:39:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:40:45 2021[1,0]:1255/4000 [========>.....................]Mon Sep 6 14:40:45 2021[1,0]: - ETA: 6:22:32 - loss: 0.1383 - auc: 0.7588Mon Sep 6 14:40:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:41:45 2021[1,0]:1262/4000 [========>.....................]Mon Sep 6 14:41:45 2021[1,0]: - ETA: 6:21:38 - loss: 0.1383 - auc: 0.7589Mon Sep 6 14:41:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:42:43 2021[1,0]:1269/4000 [========>.....................]Mon Sep 6 14:42:43 2021[1,0]: - ETA: 6:20:38 - loss: 0.1382 - auc: 0.7591Mon Sep 6 14:42:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1276/4000 [========>.....................]Mon Sep 6 14:43:43 2021[1,0]: - ETA: 6:19:41 - loss: 0.1381 - auc: 0.7592Mon Sep 6 14:43:51 2021[1,0]:Mon Sep 6 14:43:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:44:43 2021[1,0]:1283/4000 [========>.....................]Mon Sep 6 14:44:43 2021[1,0]: - ETA: 6:18:47 - loss: 0.1381 - auc: 0.7594Mon Sep 6 14:44:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:45:43 2021[1,0]:1290/4000 [========>.....................]Mon Sep 6 14:45:43 2021[1,0]: - ETA: 6:17:50 - loss: 0.1380 - auc: 0.7595Mon Sep 6 14:45:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:46:43 2021[1,0]:1297/4000 [========>.....................]Mon Sep 6 14:46:43 2021[1,0]: - ETA: 6:16:55 - loss: 0.1379 - auc: 0.7596Mon Sep 6 14:46:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1304/4000 [========>.....................]Mon Sep 6 14:47:43 2021[1,0]: - ETA: 6:16:01 - loss: 0.1379 - auc: 0.7598Mon Sep 6 14:47:52 2021[1,0]:Mon Sep 6 14:47:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:48:43 2021[1,0]:1311/4000 [========>.....................]Mon Sep 6 14:48:43 2021[1,0]: - ETA: 6:15:04 - loss: 0.1378 - auc: 0.7599Mon Sep 6 14:48:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1318/4000 [========>.....................]Mon Sep 6 14:49:43 2021[1,0]: - ETA: 6:14:09 - loss: 0.1377 - auc: 0.7601Mon Sep 6 14:49:52 2021[1,0]:Mon Sep 6 14:49:26 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:50:42 2021[1,0]:1325/4000 [========>.....................]Mon Sep 6 14:50:42 2021[1,0]: - ETA: 6:13:10 - loss: 0.1377 - auc: 0.7602Mon Sep 6 14:50:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:51:41 2021[1,0]:1332/4000 [========>.....................]Mon Sep 6 14:51:41 2021[1,0]: - ETA: 6:12:13 - loss: 0.1376 - auc: 0.7603Mon Sep 6 14:51:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:52:40 2021[1,0]:1339/4000 [=========>....................]Mon Sep 6 14:52:40 2021[1,0]: - ETA: 6:11:14 - loss: 0.1375 - auc: 0.7605Mon Sep 6 14:52:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:53:46 2021[1,0]:1347/4000 [=========>....................]Mon Sep 6 14:53:46 2021[1,0]: - ETA: 6:10:06 - loss: 0.1375 - auc: 0.7606Mon Sep 6 14:53:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:54:46 2021[1,0]:1354/4000 [=========>....................]Mon Sep 6 14:54:46 2021[1,0]: - ETA: 6:09:10 - loss: 0.1374 - auc: 0.7608Mon Sep 6 14:54:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:55:44 2021[1,0]:1361/4000 [=========>....................]Mon Sep 6 14:55:44 2021[1,0]: - ETA: 6:08:11 - loss: 0.1373 - auc: 0.7609Mon Sep 6 14:55:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:56:43 2021[1,0]:1368/4000 [=========>....................]Mon Sep 6 14:56:43 2021[1,0]: - ETA: 6:07:12 - loss: 0.1373 - auc: 0.7610Mon Sep 6 14:56:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1375/4000 [=========>....................]Mon Sep 6 14:57:41 2021[1,0]: - ETA: 6:06:13 - loss: 0.1372 - auc: 0.7611Mon Sep 6 14:57:50 2021[1,0]:Mon Sep 6 14:57:33 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1382/4000 [=========>....................]Mon Sep 6 14:58:41 2021[1,0]: - ETA: 6:05:17 - loss: 0.1372 - auc: 0.7613Mon Sep 6 14:58:49 2021[1,0]:Mon Sep 6 14:58:41 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 14:59:42 2021[1,0]:1389/4000 [=========>....................]Mon Sep 6 14:59:42 2021[1,0]: - ETA: 6:04:23 - loss: 0.1371 - auc: 0.7614Mon Sep 6 14:59:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:00:43 2021[1,0]:1396/4000 [=========>....................]Mon Sep 6 15:00:43 2021[1,0]: - ETA: 6:03:29 - loss: 0.1370 - auc: 0.7615Mon Sep 6 15:00:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:01:43 2021[1,0]:1403/4000 [=========>....................]Mon Sep 6 15:01:43 2021[1,0]: - ETA: 6:02:33 - loss: 0.1370 - auc: 0.7616Mon Sep 6 15:01:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1410/4000 [=========>....................]Mon Sep 6 15:02:43 2021[1,0]: - ETA: 6:01:37 - loss: 0.1369 - auc: 0.7618Mon Sep 6 15:02:52 2021[1,0]:Mon Sep 6 15:02:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:03:43 2021[1,0]:1417/4000 [=========>....................]Mon Sep 6 15:03:43 2021[1,0]: - ETA: 6:00:40 - loss: 0.1369 - auc: 0.7619Mon Sep 6 15:03:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:04:43 2021[1,0]:1424/4000 [=========>....................]Mon Sep 6 15:04:43 2021[1,0]: - ETA: 5:59:44 - loss: 0.1368 - auc: 0.7620Mon Sep 6 15:04:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:05:43 2021[1,0]:1431/4000 [=========>....................]Mon Sep 6 15:05:43 2021[1,0]: - ETA: 5:58:48 - loss: 0.1368 - auc: 0.7621Mon Sep 6 15:05:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:06:44 2021[1,0]:1438/4000 [=========>....................]Mon Sep 6 15:06:44 2021[1,0]: - ETA: 5:57:53 - loss: 0.1367 - auc: 0.7622Mon Sep 6 15:06:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:07:45 2021[1,0]:1445/4000 [=========>....................]Mon Sep 6 15:07:45 2021[1,0]: - ETA: 5:56:58 - loss: 0.1367 - auc: 0.7623Mon Sep 6 15:07:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1452/4000 [=========>....................]Mon Sep 6 15:08:46 2021[1,0]: - ETA: 5:56:04 - loss: 0.1366 - auc: 0.7624Mon Sep 6 15:08:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:09:45 2021[1,0]:1459/4000 [=========>....................]Mon Sep 6 15:09:45 2021[1,0]: - ETA: 5:55:05 - loss: 0.1365 - auc: 0.7625Mon Sep 6 15:09:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:10:44 2021[1,0]:1466/4000 [=========>....................]Mon Sep 6 15:10:44 2021[1,0]: - ETA: 5:54:08 - loss: 0.1365 - auc: 0.7627Mon Sep 6 15:10:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1473/4000 [==========>...................]Mon Sep 6 15:11:42 2021[1,0]: - ETA: 5:53:08 - loss: 0.1364 - auc: 0.7627Mon Sep 6 15:11:51 2021[1,0]:Mon Sep 6 15:11:33 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:12:47 2021[1,0]:1481/4000 [==========>...................]Mon Sep 6 15:12:47 2021[1,0]: - ETA: 5:51:58 - loss: 0.1364 - auc: 0.7629Mon Sep 6 15:12:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1488/4000 [==========>...................]Mon Sep 6 15:13:44 2021[1,0]: - ETA: 5:50:57 - loss: 0.1363 - auc: 0.7630Mon Sep 6 15:13:52 2021[1,0]:Mon Sep 6 15:13:36 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:14:40 2021[1,0]:1495/4000 [==========>...................]Mon Sep 6 15:14:40 2021[1,0]: - ETA: 5:49:53 - loss: 0.1363 - auc: 0.7631Mon Sep 6 15:14:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:15:40 2021[1,0]:1502/4000 [==========>...................]Mon Sep 6 15:15:40 2021[1,0]: - ETA: 5:48:57 - loss: 0.1362 - auc: 0.7632Mon Sep 6 15:15:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:16:41 2021[1,0]:1509/4000 [==========>...................]Mon Sep 6 15:16:41 2021[1,0]: - ETA: 5:48:02 - loss: 0.1362 - auc: 0.7633Mon Sep 6 15:16:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:17:41 2021[1,0]:1516/4000 [==========>...................]Mon Sep 6 15:17:41 2021[1,0]: - ETA: 5:47:05 - loss: 0.1361 - auc: 0.7634Mon Sep 6 15:17:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1523/4000 [==========>...................]Mon Sep 6 15:18:40 2021[1,0]: - ETA: 5:46:08 - loss: 0.1361 - auc: 0.7635Mon Sep 6 15:18:49 2021[1,0]:Mon Sep 6 15:18:32 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:19:48 2021[1,0]:1531/4000 [==========>...................]Mon Sep 6 15:19:48 2021[1,0]: - ETA: 5:45:01 - loss: 0.1360 - auc: 0.7636Mon Sep 6 15:19:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:20:45 2021[1,0]:1538/4000 [==========>...................]Mon Sep 6 15:20:45 2021[1,0]: - ETA: 5:44:00 - loss: 0.1360 - auc: 0.7637Mon Sep 6 15:20:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:21:46 2021[1,0]:1545/4000 [==========>...................] - ETA: 5:43:05 - loss: 0.1359 - auc: 0.7638Mon Sep 6 15:21:54 2021[1,0]:Mon Sep 6 15:21:20 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1552/4000 [==========>...................]Mon Sep 6 15:22:46 2021[1,0]: - ETA: 5:42:08 - loss: 0.1359 - auc: 0.7640Mon Sep 6 15:22:54 2021[1,0]:Mon Sep 6 15:22:37 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:23:45 2021[1,0]:1559/4000 [==========>...................]Mon Sep 6 15:23:45 2021[1,0]: - ETA: 5:41:10 - loss: 0.1358 - auc: 0.7640Mon Sep 6 15:23:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:24:44 2021[1,0]:1566/4000 [==========>...................]Mon Sep 6 15:24:44 2021[1,0]: - ETA: 5:40:12 - loss: 0.1358 - auc: 0.7641Mon Sep 6 15:24:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:25:42 2021[1,0]:1573/4000 [==========>...................]Mon Sep 6 15:25:42 2021[1,0]: - ETA: 5:39:12 - loss: 0.1357 - auc: 0.7642Mon Sep 6 15:25:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:26:48 2021[1,0]:1581/4000 [==========>...................]Mon Sep 6 15:26:48 2021[1,0]: - ETA: 5:38:04 - loss: 0.1357 - auc: 0.7643Mon Sep 6 15:26:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:27:47 2021[1,0]:1588/4000 [==========>...................]Mon Sep 6 15:27:47 2021[1,0]: - ETA: 5:37:06 - loss: 0.1356 - auc: 0.7645Mon Sep 6 15:27:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:28:48 2021[1,0]:1595/4000 [==========>...................]Mon Sep 6 15:28:48 2021[1,0]: - ETA: 5:36:10 - loss: 0.1356 - auc: 0.7646Mon Sep 6 15:28:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:29:47 2021[1,0]:1602/4000 [===========>..................]Mon Sep 6 15:29:47 2021[1,0]: - ETA: 5:35:12 - loss: 0.1356 - auc: 0.7647Mon Sep 6 15:29:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1609/4000 [===========>..................]Mon Sep 6 15:30:47 2021[1,0]: - ETA: 5:34:15 - loss: 0.1355 - auc: 0.7648Mon Sep 6 15:30:55 2021[1,0]:Mon Sep 6 15:30:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:31:45 2021[1,0]:1616/4000 [===========>..................]Mon Sep 6 15:31:45 2021[1,0]: - ETA: 5:33:16 - loss: 0.1355 - auc: 0.7649Mon Sep 6 15:31:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:32:44 2021[1,0]:1623/4000 [===========>..................]Mon Sep 6 15:32:44 2021[1,0]: - ETA: 5:32:17 - loss: 0.1354 - auc: 0.7650Mon Sep 6 15:32:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:33:43 2021[1,0]:1630/4000 [===========>..................]Mon Sep 6 15:33:43 2021[1,0]: - ETA: 5:31:19 - loss: 0.1354 - auc: 0.7651Mon Sep 6 15:33:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:34:43 2021[1,0]:1637/4000 [===========>..................]Mon Sep 6 15:34:43 2021[1,0]: - ETA: 5:30:21 - loss: 0.1353 - auc: 0.7651Mon Sep 6 15:34:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:35:43 2021[1,0]:1644/4000 [===========>..................]Mon Sep 6 15:35:43 2021[1,0]: - ETA: 5:29:24 - loss: 0.1353 - auc: 0.7652Mon Sep 6 15:35:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:36:41 2021[1,0]:1651/4000 [===========>..................]Mon Sep 6 15:36:41 2021[1,0]: - ETA: 5:28:25 - loss: 0.1352 - auc: 0.7653Mon Sep 6 15:36:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:37:47 2021[1,0]:1659/4000 [===========>..................]Mon Sep 6 15:37:47 2021[1,0]: - ETA: 5:27:16 - loss: 0.1352 - auc: 0.7654Mon Sep 6 15:37:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:38:44 2021[1,0]:1666/4000 [===========>..................]Mon Sep 6 15:38:44 2021[1,0]: - ETA: 5:26:15 - loss: 0.1352 - auc: 0.7655Mon Sep 6 15:38:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:39:42 2021[1,0]:1673/4000 [===========>..................]Mon Sep 6 15:39:42 2021[1,0]: - ETA: 5:25:15 - loss: 0.1351 - auc: 0.7656Mon Sep 6 15:39:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:40:48 2021[1,0]:1681/4000 [===========>..................]Mon Sep 6 15:40:48 2021[1,0]: - ETA: 5:24:07 - loss: 0.1351 - auc: 0.7657Mon Sep 6 15:40:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:41:40 2021[1,0]:1687/4000 [===========>..................]Mon Sep 6 15:41:40 2021[1,0]: - ETA: 5:23:19 - loss: 0.1350 - auc: 0.7658Mon Sep 6 15:41:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:42:41 2021[1,0]:1694/4000 [===========>..................]Mon Sep 6 15:42:41 2021[1,0]: - ETA: 5:22:23 - loss: 0.1350 - auc: 0.7659Mon Sep 6 15:42:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:43:41 2021[1,0]:1701/4000 [===========>..................]Mon Sep 6 15:43:41 2021[1,0]: - ETA: 5:21:26 - loss: 0.1349 - auc: 0.7660Mon Sep 6 15:43:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1708/4000 [===========>..................]Mon Sep 6 15:44:42 2021[1,0]: - ETA: 5:20:30 - loss: 0.1349 - auc: 0.7661Mon Sep 6 15:44:50 2021[1,0]:Mon Sep 6 15:44:33 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1715/4000 [===========>..................]Mon Sep 6 15:45:42 2021[1,0]: - ETA: 5:19:34 - loss: 0.1349 - auc: 0.7661Mon Sep 6 15:45:51 2021[1,0]:Mon Sep 6 15:45:42 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:46:43 2021[1,0]:1722/4000 [===========>..................]Mon Sep 6 15:46:43 2021[1,0]: - ETA: 5:18:38 - loss: 0.1348 - auc: 0.7662Mon Sep 6 15:46:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:47:44 2021[1,0]:1729/4000 [===========>..................]Mon Sep 6 15:47:44 2021[1,0]: - ETA: 5:17:42 - loss: 0.1348 - auc: 0.7663Mon Sep 6 15:47:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:48:44 2021[1,0]:1736/4000 [============>.................]Mon Sep 6 15:48:44 2021[1,0]: - ETA: 5:16:45 - loss: 0.1348 - auc: 0.7664Mon Sep 6 15:48:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:49:41 2021[1,0]:1743/4000 [============>.................]Mon Sep 6 15:49:41 2021[1,0]: - ETA: 5:15:44 - loss: 0.1347 - auc: 0.7665Mon Sep 6 15:49:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:50:45 2021[1,0]:1751/4000 [============>.................]Mon Sep 6 15:50:45 2021[1,0]: - ETA: 5:14:33 - loss: 0.1347 - auc: 0.7666Mon Sep 6 15:50:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:51:47 2021[1,0]:1759/4000 [============>.................]Mon Sep 6 15:51:47 2021[1,0]: - ETA: 5:13:19 - loss: 0.1346 - auc: 0.7667Mon Sep 6 15:51:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:52:43 2021[1,0]:1766/4000 [============>.................]Mon Sep 6 15:52:43 2021[1,0]: - ETA: 5:12:16 - loss: 0.1346 - auc: 0.7667Mon Sep 6 15:52:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:53:49 2021[1,0]:1774/4000 [============>.................]Mon Sep 6 15:53:49 2021[1,0]: - ETA: 5:11:08 - loss: 0.1346 - auc: 0.7668Mon Sep 6 15:53:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:54:48 2021[1,0]:1781/4000 [============>.................]Mon Sep 6 15:54:48 2021[1,0]: - ETA: 5:10:10 - loss: 0.1345 - auc: 0.7669Mon Sep 6 15:54:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:55:47 2021[1,0]:1788/4000 [============>.................]Mon Sep 6 15:55:47 2021[1,0]: - ETA: 5:09:12 - loss: 0.1345 - auc: 0.7670Mon Sep 6 15:55:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:56:46 2021[1,0]:1795/4000 [============>.................]Mon Sep 6 15:56:46 2021[1,0]: - ETA: 5:08:13 - loss: 0.1344 - auc: 0.7671Mon Sep 6 15:56:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:57:44 2021[1,0]:1802/4000 [============>.................]Mon Sep 6 15:57:44 2021[1,0]: - ETA: 5:07:13 - loss: 0.1344 - auc: 0.7671Mon Sep 6 15:57:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:58:43 2021[1,0]:1809/4000 [============>.................]Mon Sep 6 15:58:43 2021[1,0]: - ETA: 5:06:15 - loss: 0.1344 - auc: 0.7672Mon Sep 6 15:58:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 15:59:42 2021[1,0]:1816/4000 [============>.................]Mon Sep 6 15:59:42 2021[1,0]: - ETA: 5:05:17 - loss: 0.1343 - auc: 0.7673Mon Sep 6 15:59:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:00:41 2021[1,0]:1823/4000 [============>.................]Mon Sep 6 16:00:41 2021[1,0]: - ETA: 5:04:19 - loss: 0.1343 - auc: 0.7674Mon Sep 6 16:00:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:01:41 2021[1,0]:1830/4000 [============>.................]Mon Sep 6 16:01:41 2021[1,0]: - ETA: 5:03:21 - loss: 0.1343 - auc: 0.7675Mon Sep 6 16:01:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "1838/4000 [============>.................]Mon Sep 6 16:02:49 2021[1,0]: - ETA: 5:02:15 - loss: 0.1342 - auc: 0.7676Mon Sep 6 16:02:57 2021[1,0]:Mon Sep 6 16:02:40 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:03:41 2021[1,0]:1844/4000 [============>.................]Mon Sep 6 16:03:41 2021[1,0]: - ETA: 5:01:27 - loss: 0.1342 - auc: 0.7676Mon Sep 6 16:03:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:04:41 2021[1,0]:1851/4000 [============>.................]Mon Sep 6 16:04:41 2021[1,0]: - ETA: 5:00:30 - loss: 0.1342 - auc: 0.7677Mon Sep 6 16:04:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:05:41 2021[1,0]:1858/4000 [============>.................]Mon Sep 6 16:05:41 2021[1,0]: - ETA: 4:59:32 - loss: 0.1341 - auc: 0.7678Mon Sep 6 16:05:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:06:41 2021[1,0]:1865/4000 [============>.................] - ETA: 4:58:35 - loss: 0.1341 - auc: 0.7679Mon Sep 6 16:06:49 2021[1,0]:Mon Sep 6 16:06:32 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:07:41 2021[1,0]:1872/4000 [=============>................]Mon Sep 6 16:07:41 2021[1,0]: - ETA: 4:57:38 - loss: 0.1341 - auc: 0.7679Mon Sep 6 16:07:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:08:49 2021[1,0]:1880/4000 [=============>................]Mon Sep 6 16:08:49 2021[1,0]: - ETA: 4:56:31 - loss: 0.1340 - auc: 0.7680Mon Sep 6 16:08:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:09:47 2021[1,0]:1887/4000 [=============>................]Mon Sep 6 16:09:47 2021[1,0]: - ETA: 4:55:32 - loss: 0.1340 - auc: 0.7681Mon Sep 6 16:09:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:10:44 2021[1,0]:1894/4000 [=============>................]Mon Sep 6 16:10:44 2021[1,0]: - ETA: 4:54:31 - loss: 0.1340 - auc: 0.7682Mon Sep 6 16:10:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:11:43 2021[1,0]:1901/4000 [=============>................]Mon Sep 6 16:11:43 2021[1,0]: - ETA: 4:53:33 - loss: 0.1339 - auc: 0.7682Mon Sep 6 16:11:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:12:49 2021[1,0]:1909/4000 [=============>................]Mon Sep 6 16:12:49 2021[1,0]: - ETA: 4:52:24 - loss: 0.1339 - auc: 0.7683Mon Sep 6 16:12:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:13:45 2021[1,0]:1916/4000 [=============>................]Mon Sep 6 16:13:45 2021[1,0]: - ETA: 4:51:23 - loss: 0.1339 - auc: 0.7684Mon Sep 6 16:13:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:14:44 2021[1,0]:1923/4000 [=============>................]Mon Sep 6 16:14:44 2021[1,0]: - ETA: 4:50:24 - loss: 0.1338 - auc: 0.7685Mon Sep 6 16:14:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:15:48 2021[1,0]:1931/4000 [=============>................]Mon Sep 6 16:15:48 2021[1,0]: - ETA: 4:49:15 - loss: 0.1338 - auc: 0.7686Mon Sep 6 16:15:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:16:46 2021[1,0]:1938/4000 [=============>................]Mon Sep 6 16:16:46 2021[1,0]: - ETA: 4:48:14 - loss: 0.1338 - auc: 0.7686Mon Sep 6 16:16:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:17:43 2021[1,0]:1945/4000 [=============>................]Mon Sep 6 16:17:43 2021[1,0]: - ETA: 4:47:14 - loss: 0.1337 - auc: 0.7687Mon Sep 6 16:17:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:18:49 2021[1,0]:1953/4000 [=============>................]Mon Sep 6 16:18:49 2021[1,0]: - ETA: 4:46:06 - loss: 0.1337 - auc: 0.7688Mon Sep 6 16:18:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:19:48 2021[1,0]:1960/4000 [=============>................]Mon Sep 6 16:19:48 2021[1,0]: - ETA: 4:45:07 - loss: 0.1337 - auc: 0.7689Mon Sep 6 16:19:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:20:49 2021[1,0]:1967/4000 [=============>................]Mon Sep 6 16:20:49 2021[1,0]: - ETA: 4:44:11 - loss: 0.1336 - auc: 0.7689Mon Sep 6 16:20:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:21:41 2021[1,0]:1973/4000 [=============>................]Mon Sep 6 16:21:41 2021[1,0]: - ETA: 4:43:22 - loss: 0.1336 - auc: 0.7690Mon Sep 6 16:21:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:22:49 2021[1,0]:1981/4000 [=============>................]Mon Sep 6 16:22:49 2021[1,0]: - ETA: 4:42:16 - loss: 0.1336 - auc: 0.7691Mon Sep 6 16:22:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:23:45 2021[1,0]:1988/4000 [=============>................]Mon Sep 6 16:23:45 2021[1,0]: - ETA: 4:41:15 - loss: 0.1335 - auc: 0.7692Mon Sep 6 16:23:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:24:49 2021[1,0]:1996/4000 [=============>................]Mon Sep 6 16:24:49 2021[1,0]: - ETA: 4:40:04 - loss: 0.1335 - auc: 0.7692Mon Sep 6 16:24:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2003/4000 [==============>...............]Mon Sep 6 16:25:44 2021[1,0]: - ETA: 4:39:02 - loss: 0.1335 - auc: 0.7693Mon Sep 6 16:25:51 2021[1,0]:Mon Sep 6 16:25:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:26:45 2021[1,0]:2011/4000 [==============>...............]Mon Sep 6 16:26:45 2021[1,0]: - ETA: 4:37:49 - loss: 0.1334 - auc: 0.7694Mon Sep 6 16:26:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2018/4000 [==============>...............]Mon Sep 6 16:27:42 2021[1,0]: - ETA: 4:36:48 - loss: 0.1334 - auc: 0.7695Mon Sep 6 16:27:50 2021[1,0]:Mon Sep 6 16:27:25 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:28:49 2021[1,0]:2026/4000 [==============>...............]Mon Sep 6 16:28:49 2021[1,0]: - ETA: 4:35:42 - loss: 0.1334 - auc: 0.7695Mon Sep 6 16:28:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:29:49 2021[1,0]:2033/4000 [==============>...............]Mon Sep 6 16:29:49 2021[1,0]: - ETA: 4:34:45 - loss: 0.1333 - auc: 0.7696Mon Sep 6 16:29:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:30:49 2021[1,0]:2040/4000 [==============>...............] - ETA: 4:33:47 - loss: 0.1333 - auc: 0.7696Mon Sep 6 16:30:58 2021[1,0]:Mon Sep 6 16:30:41 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:31:49 2021[1,0]:2047/4000 [==============>...............]Mon Sep 6 16:31:49 2021[1,0]: - ETA: 4:32:49 - loss: 0.1333 - auc: 0.7697Mon Sep 6 16:31:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:32:47 2021[1,0]:2054/4000 [==============>...............]Mon Sep 6 16:32:47 2021[1,0]: - ETA: 4:31:51 - loss: 0.1333 - auc: 0.7697Mon Sep 6 16:32:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:33:47 2021[1,0]:2061/4000 [==============>...............]Mon Sep 6 16:33:47 2021[1,0]: - ETA: 4:30:52 - loss: 0.1332 - auc: 0.7698Mon Sep 6 16:33:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2068/4000 [==============>...............]Mon Sep 6 16:34:45 2021[1,0]: - ETA: 4:29:54 - loss: 0.1332 - auc: 0.7699Mon Sep 6 16:34:54 2021[1,0]:Mon Sep 6 16:34:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:35:46 2021[1,0]:2075/4000 [==============>...............] - ETA: 4:28:57 - loss: 0.1332 - auc: 0.7699Mon Sep 6 16:35:54 2021[1,0]:Mon Sep 6 16:35:20 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:36:44 2021[1,0]:2082/4000 [==============>...............]Mon Sep 6 16:36:44 2021[1,0]: - ETA: 4:27:57 - loss: 0.1331 - auc: 0.7700Mon Sep 6 16:36:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:37:47 2021[1,0]:2090/4000 [==============>...............]Mon Sep 6 16:37:47 2021[1,0]: - ETA: 4:26:47 - loss: 0.1331 - auc: 0.7700Mon Sep 6 16:37:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2097/4000 [==============>...............]Mon Sep 6 16:38:43 2021[1,0]: - ETA: 4:25:46 - loss: 0.1331 - auc: 0.7701Mon Sep 6 16:38:51 2021[1,0]:Mon Sep 6 16:38:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2105/4000 [==============>...............]Mon Sep 6 16:39:48 2021[1,0]: - ETA: 4:24:37 - loss: 0.1331 - auc: 0.7702Mon Sep 6 16:39:57 2021[1,0]:Mon Sep 6 16:39:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:40:48 2021[1,0]:2112/4000 [==============>...............]Mon Sep 6 16:40:48 2021[1,0]: - ETA: 4:23:39 - loss: 0.1330 - auc: 0.7702Mon Sep 6 16:40:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:41:48 2021[1,0]:2119/4000 [==============>...............] - ETA: 4:22:42 - loss: 0.1330 - auc: 0.7703Mon Sep 6 16:41:57 2021[1,0]:Mon Sep 6 16:41:39 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:42:48 2021[1,0]:2126/4000 [==============>...............]Mon Sep 6 16:42:48 2021[1,0]: - ETA: 4:21:45 - loss: 0.1330 - auc: 0.7703Mon Sep 6 16:42:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:43:48 2021[1,0]:2133/4000 [==============>...............]Mon Sep 6 16:43:48 2021[1,0]: - ETA: 4:20:47 - loss: 0.1330 - auc: 0.7704Mon Sep 6 16:43:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:44:48 2021[1,0]:2140/4000 [===============>..............]Mon Sep 6 16:44:48 2021[1,0]: - ETA: 4:19:50 - loss: 0.1329 - auc: 0.7704Mon Sep 6 16:44:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:45:47 2021[1,0]:2147/4000 [===============>..............]Mon Sep 6 16:45:47 2021[1,0]: - ETA: 4:18:51 - loss: 0.1329 - auc: 0.7705Mon Sep 6 16:45:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:46:47 2021[1,0]:2154/4000 [===============>..............]Mon Sep 6 16:46:47 2021[1,0]: - ETA: 4:17:54 - loss: 0.1329 - auc: 0.7705Mon Sep 6 16:46:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:47:48 2021[1,0]:2161/4000 [===============>..............]Mon Sep 6 16:47:48 2021[1,0]: - ETA: 4:16:57 - loss: 0.1328 - auc: 0.7706Mon Sep 6 16:47:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2168/4000 [===============>..............]Mon Sep 6 16:48:47 2021[1,0]: - ETA: 4:15:58 - loss: 0.1328 - auc: 0.7707Mon Sep 6 16:48:55 2021[1,0]:Mon Sep 6 16:48:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:49:44 2021[1,0]:2175/4000 [===============>..............]Mon Sep 6 16:49:44 2021[1,0]: - ETA: 4:14:59 - loss: 0.1328 - auc: 0.7707Mon Sep 6 16:49:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:50:43 2021[1,0]:2182/4000 [===============>..............]Mon Sep 6 16:50:43 2021[1,0]: - ETA: 4:14:00 - loss: 0.1328 - auc: 0.7708Mon Sep 6 16:50:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:51:49 2021[1,0]:2190/4000 [===============>..............]Mon Sep 6 16:51:49 2021[1,0]: - ETA: 4:12:52 - loss: 0.1327 - auc: 0.7708Mon Sep 6 16:51:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:52:48 2021[1,0]:2197/4000 [===============>..............]Mon Sep 6 16:52:48 2021[1,0]: - ETA: 4:11:53 - loss: 0.1327 - auc: 0.7709Mon Sep 6 16:52:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:53:47 2021[1,0]:2204/4000 [===============>..............]Mon Sep 6 16:53:47 2021[1,0]: - ETA: 4:10:55 - loss: 0.1327 - auc: 0.7710Mon Sep 6 16:53:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:54:47 2021[1,0]:2211/4000 [===============>..............]Mon Sep 6 16:54:47 2021[1,0]: - ETA: 4:09:58 - loss: 0.1327 - auc: 0.7710Mon Sep 6 16:54:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2218/4000 [===============>..............]Mon Sep 6 16:55:49 2021[1,0]: - ETA: 4:09:02 - loss: 0.1326 - auc: 0.7711Mon Sep 6 16:55:57 2021[1,0]:Mon Sep 6 16:55:40 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:56:48 2021[1,0]:2225/4000 [===============>..............]Mon Sep 6 16:56:48 2021[1,0]: - ETA: 4:08:03 - loss: 0.1326 - auc: 0.7711Mon Sep 6 16:56:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:57:46 2021[1,0]:2232/4000 [===============>..............]Mon Sep 6 16:57:46 2021[1,0]: - ETA: 4:07:04 - loss: 0.1326 - auc: 0.7712Mon Sep 6 16:57:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:58:44 2021[1,0]:2239/4000 [===============>..............]Mon Sep 6 16:58:44 2021[1,0]: - ETA: 4:06:05 - loss: 0.1326 - auc: 0.7712Mon Sep 6 16:58:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 16:59:42 2021[1,0]:2246/4000 [===============>..............]Mon Sep 6 16:59:42 2021[1,0]: - ETA: 4:05:06 - loss: 0.1326 - auc: 0.7713Mon Sep 6 16:59:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2254/4000 [===============>..............]Mon Sep 6 17:00:48 2021[1,0]: - ETA: 4:03:58 - loss: 0.1325 - auc: 0.7713Mon Sep 6 17:00:56 2021[1,0]:Mon Sep 6 17:00:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:01:47 2021[1,0]:2261/4000 [===============>..............]Mon Sep 6 17:01:47 2021[1,0]: - ETA: 4:02:59 - loss: 0.1325 - auc: 0.7714Mon Sep 6 17:01:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:02:45 2021[1,0]:2268/4000 [================>.............]Mon Sep 6 17:02:45 2021[1,0]: - ETA: 4:02:00 - loss: 0.1325 - auc: 0.7714Mon Sep 6 17:02:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:03:43 2021[1,0]:2275/4000 [================>.............]Mon Sep 6 17:03:43 2021[1,0]: - ETA: 4:01:01 - loss: 0.1325 - auc: 0.7715Mon Sep 6 17:03:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:04:43 2021[1,0]:2282/4000 [================>.............] - ETA: 4:00:03 - loss: 0.1324 - auc: 0.7715Mon Sep 6 17:04:51 2021[1,0]:Mon Sep 6 17:04:17 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:05:44 2021[1,0]:2289/4000 [================>.............]Mon Sep 6 17:05:44 2021[1,0]: - ETA: 3:59:06 - loss: 0.1324 - auc: 0.7716Mon Sep 6 17:05:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:06:45 2021[1,0]:2296/4000 [================>.............]Mon Sep 6 17:06:45 2021[1,0]: - ETA: 3:58:09 - loss: 0.1324 - auc: 0.7716Mon Sep 6 17:06:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:07:46 2021[1,0]:2303/4000 [================>.............]Mon Sep 6 17:07:46 2021[1,0]: - ETA: 3:57:12 - loss: 0.1324 - auc: 0.7717Mon Sep 6 17:07:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:08:46 2021[1,0]:2310/4000 [================>.............]Mon Sep 6 17:08:46 2021[1,0]: - ETA: 3:56:14 - loss: 0.1324 - auc: 0.7717Mon Sep 6 17:08:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:09:46 2021[1,0]:2317/4000 [================>.............]Mon Sep 6 17:09:46 2021[1,0]: - ETA: 3:55:16 - loss: 0.1323 - auc: 0.7718Mon Sep 6 17:09:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:10:44 2021[1,0]:2324/4000 [================>.............]Mon Sep 6 17:10:44 2021[1,0]: - ETA: 3:54:17 - loss: 0.1323 - auc: 0.7718Mon Sep 6 17:10:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:11:42 2021[1,0]:2331/4000 [================>.............]Mon Sep 6 17:11:42 2021[1,0]: - ETA: 3:53:18 - loss: 0.1323 - auc: 0.7719Mon Sep 6 17:11:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:12:48 2021[1,0]:2339/4000 [================>.............]Mon Sep 6 17:12:48 2021[1,0]: - ETA: 3:52:11 - loss: 0.1323 - auc: 0.7719Mon Sep 6 17:12:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:13:48 2021[1,0]:2346/4000 [================>.............]Mon Sep 6 17:13:48 2021[1,0]: - ETA: 3:51:12 - loss: 0.1322 - auc: 0.7720Mon Sep 6 17:13:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2353/4000 [================>.............]Mon Sep 6 17:14:49 2021[1,0]: - ETA: 3:50:15 - loss: 0.1322 - auc: 0.7720Mon Sep 6 17:14:57 2021[1,0]:Mon Sep 6 17:14:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:15:48 2021[1,0]:2360/4000 [================>.............]Mon Sep 6 17:15:48 2021[1,0]: - ETA: 3:49:17 - loss: 0.1322 - auc: 0.7721Mon Sep 6 17:15:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:16:48 2021[1,0]:2367/4000 [================>.............]Mon Sep 6 17:16:48 2021[1,0]: - ETA: 3:48:19 - loss: 0.1322 - auc: 0.7721Mon Sep 6 17:16:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2374/4000 [================>.............]Mon Sep 6 17:17:48 2021[1,0]: - ETA: 3:47:21 - loss: 0.1322 - auc: 0.7722Mon Sep 6 17:17:56 2021[1,0]:Mon Sep 6 17:17:30 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:18:46 2021[1,0]:2381/4000 [================>.............]Mon Sep 6 17:18:46 2021[1,0]: - ETA: 3:46:22 - loss: 0.1321 - auc: 0.7722Mon Sep 6 17:18:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:19:44 2021[1,0]:2388/4000 [================>.............]Mon Sep 6 17:19:44 2021[1,0]: - ETA: 3:45:22 - loss: 0.1321 - auc: 0.7723Mon Sep 6 17:19:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:20:49 2021[1,0]:2396/4000 [================>.............]Mon Sep 6 17:20:49 2021[1,0]: - ETA: 3:44:14 - loss: 0.1321 - auc: 0.7723Mon Sep 6 17:20:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:21:46 2021[1,0]:2403/4000 [=================>............]Mon Sep 6 17:21:46 2021[1,0]: - ETA: 3:43:14 - loss: 0.1321 - auc: 0.7724Mon Sep 6 17:21:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:22:43 2021[1,0]:2410/4000 [=================>............]Mon Sep 6 17:22:43 2021[1,0]: - ETA: 3:42:14 - loss: 0.1320 - auc: 0.7724Mon Sep 6 17:22:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:23:50 2021[1,0]:2418/4000 [=================>............]Mon Sep 6 17:23:50 2021[1,0]: - ETA: 3:41:07 - loss: 0.1320 - auc: 0.7725Mon Sep 6 17:23:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:24:49 2021[1,0]:2425/4000 [=================>............]Mon Sep 6 17:24:49 2021[1,0]: - ETA: 3:40:09 - loss: 0.1320 - auc: 0.7725Mon Sep 6 17:24:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:25:49 2021[1,0]:2432/4000 [=================>............]Mon Sep 6 17:25:49 2021[1,0]: - ETA: 3:39:11 - loss: 0.1320 - auc: 0.7726Mon Sep 6 17:25:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:26:46 2021[1,0]:2439/4000 [=================>............]Mon Sep 6 17:26:46 2021[1,0]: - ETA: 3:38:11 - loss: 0.1320 - auc: 0.7726Mon Sep 6 17:26:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:27:50 2021[1,0]:2447/4000 [=================>............]Mon Sep 6 17:27:50 2021[1,0]: - ETA: 3:37:02 - loss: 0.1319 - auc: 0.7727Mon Sep 6 17:27:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2454/4000 [=================>............]Mon Sep 6 17:28:45 2021[1,0]: - ETA: 3:36:01 - loss: 0.1319 - auc: 0.7727Mon Sep 6 17:28:53 2021[1,0]:Mon Sep 6 17:28:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:29:51 2021[1,0]:2462/4000 [=================>............]Mon Sep 6 17:29:51 2021[1,0]: - ETA: 3:34:53 - loss: 0.1319 - auc: 0.7728Mon Sep 6 17:29:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:30:49 2021[1,0]:2469/4000 [=================>............]Mon Sep 6 17:30:49 2021[1,0]: - ETA: 3:33:54 - loss: 0.1319 - auc: 0.7728Mon Sep 6 17:30:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:31:48 2021[1,0]:2476/4000 [=================>............]Mon Sep 6 17:31:48 2021[1,0]: - ETA: 3:32:56 - loss: 0.1318 - auc: 0.7729Mon Sep 6 17:31:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:32:48 2021[1,0]:2483/4000 [=================>............]Mon Sep 6 17:32:48 2021[1,0]: - ETA: 3:31:58 - loss: 0.1318 - auc: 0.7729Mon Sep 6 17:32:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:33:48 2021[1,0]:2490/4000 [=================>............]Mon Sep 6 17:33:48 2021[1,0]: - ETA: 3:31:00 - loss: 0.1318 - auc: 0.7730Mon Sep 6 17:33:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:34:48 2021[1,0]:2497/4000 [=================>............]Mon Sep 6 17:34:48 2021[1,0]: - ETA: 3:30:02 - loss: 0.1318 - auc: 0.7730Mon Sep 6 17:34:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:35:48 2021[1,0]:2504/4000 [=================>............]Mon Sep 6 17:35:48 2021[1,0]: - ETA: 3:29:04 - loss: 0.1318 - auc: 0.7730Mon Sep 6 17:35:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:36:44 2021[1,0]:2511/4000 [=================>............]Mon Sep 6 17:36:44 2021[1,0]: - ETA: 3:28:04 - loss: 0.1317 - auc: 0.7731Mon Sep 6 17:36:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2519/4000 [=================>............]Mon Sep 6 17:37:47 2021[1,0]: - ETA: 3:26:54 - loss: 0.1317 - auc: 0.7731Mon Sep 6 17:37:55 2021[1,0]:Mon Sep 6 17:37:24 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:38:44 2021[1,0]:2526/4000 [=================>............]Mon Sep 6 17:38:44 2021[1,0]: - ETA: 3:25:55 - loss: 0.1317 - auc: 0.7732Mon Sep 6 17:38:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:39:44 2021[1,0]:2533/4000 [=================>............]Mon Sep 6 17:39:44 2021[1,0]: - ETA: 3:24:57 - loss: 0.1317 - auc: 0.7733Mon Sep 6 17:39:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2540/4000 [==================>...........]Mon Sep 6 17:40:44 2021[1,0]: - ETA: 3:23:59 - loss: 0.1317 - auc: 0.7733Mon Sep 6 17:40:53 2021[1,0]:Mon Sep 6 17:40:18 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2547/4000 [==================>...........]Mon Sep 6 17:41:44 2021[1,0]: - ETA: 3:23:01 - loss: 0.1316 - auc: 0.7733Mon Sep 6 17:41:53 2021[1,0]:Mon Sep 6 17:41:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2554/4000 [==================>...........]Mon Sep 6 17:42:43 2021[1,0]: - ETA: 3:22:03 - loss: 0.1316 - auc: 0.7734Mon Sep 6 17:42:52 2021[1,0]:Mon Sep 6 17:42:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:43:42 2021[1,0]:2561/4000 [==================>...........]Mon Sep 6 17:43:42 2021[1,0]: - ETA: 3:21:04 - loss: 0.1316 - auc: 0.7734Mon Sep 6 17:43:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:44:50 2021[1,0]:2569/4000 [==================>...........]Mon Sep 6 17:44:50 2021[1,0]: - ETA: 3:19:57 - loss: 0.1316 - auc: 0.7735Mon Sep 6 17:44:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:45:49 2021[1,0]:2576/4000 [==================>...........]Mon Sep 6 17:45:49 2021[1,0]: - ETA: 3:18:59 - loss: 0.1316 - auc: 0.7735Mon Sep 6 17:45:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:46:47 2021[1,0]:2583/4000 [==================>...........]Mon Sep 6 17:46:47 2021[1,0]: - ETA: 3:18:00 - loss: 0.1315 - auc: 0.7735Mon Sep 6 17:46:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:47:46 2021[1,0]:2590/4000 [==================>...........]Mon Sep 6 17:47:46 2021[1,0]: - ETA: 3:17:01 - loss: 0.1315 - auc: 0.7736Mon Sep 6 17:47:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:48:44 2021[1,0]:2597/4000 [==================>...........]Mon Sep 6 17:48:44 2021[1,0]: - ETA: 3:16:02 - loss: 0.1315 - auc: 0.7736Mon Sep 6 17:48:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:49:43 2021[1,0]:2604/4000 [==================>...........]Mon Sep 6 17:49:43 2021[1,0]: - ETA: 3:15:03 - loss: 0.1315 - auc: 0.7737Mon Sep 6 17:49:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:50:50 2021[1,0]:2612/4000 [==================>...........]Mon Sep 6 17:50:50 2021[1,0]: - ETA: 3:13:57 - loss: 0.1315 - auc: 0.7737Mon Sep 6 17:50:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:51:49 2021[1,0]:2619/4000 [==================>...........]Mon Sep 6 17:51:49 2021[1,0]: - ETA: 3:12:58 - loss: 0.1314 - auc: 0.7738Mon Sep 6 17:51:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:52:49 2021[1,0]:2626/4000 [==================>...........]Mon Sep 6 17:52:49 2021[1,0]: - ETA: 3:12:00 - loss: 0.1314 - auc: 0.7738Mon Sep 6 17:52:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:53:48 2021[1,0]:2633/4000 [==================>...........]Mon Sep 6 17:53:48 2021[1,0]: - ETA: 3:11:01 - loss: 0.1314 - auc: 0.7739Mon Sep 6 17:53:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:54:47 2021[1,0]:2640/4000 [==================>...........]Mon Sep 6 17:54:47 2021[1,0]: - ETA: 3:10:03 - loss: 0.1314 - auc: 0.7739Mon Sep 6 17:54:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2647/4000 [==================>...........]Mon Sep 6 17:55:47 2021[1,0]: - ETA: 3:09:05 - loss: 0.1314 - auc: 0.7740Mon Sep 6 17:55:56 2021[1,0]:Mon Sep 6 17:55:30 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:56:47 2021[1,0]:2654/4000 [==================>...........]Mon Sep 6 17:56:47 2021[1,0]: - ETA: 3:08:07 - loss: 0.1313 - auc: 0.7740Mon Sep 6 17:56:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:57:46 2021[1,0]:2661/4000 [==================>...........]Mon Sep 6 17:57:46 2021[1,0]: - ETA: 3:07:08 - loss: 0.1313 - auc: 0.7740Mon Sep 6 17:57:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:58:46 2021[1,0]:2668/4000 [===================>..........]Mon Sep 6 17:58:46 2021[1,0]: - ETA: 3:06:10 - loss: 0.1313 - auc: 0.7741Mon Sep 6 17:58:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 17:59:51 2021[1,0]:2676/4000 [===================>..........]Mon Sep 6 17:59:51 2021[1,0]: - ETA: 3:05:02 - loss: 0.1313 - auc: 0.7741Mon Sep 6 17:59:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:00:49 2021[1,0]:2683/4000 [===================>..........]Mon Sep 6 18:00:49 2021[1,0]: - ETA: 3:04:03 - loss: 0.1313 - auc: 0.7742Mon Sep 6 18:00:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:01:49 2021[1,0]:2690/4000 [===================>..........]Mon Sep 6 18:01:49 2021[1,0]: - ETA: 3:03:05 - loss: 0.1313 - auc: 0.7742Mon Sep 6 18:01:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2697/4000 [===================>..........]Mon Sep 6 18:02:48 2021[1,0]: - ETA: 3:02:06 - loss: 0.1313 - auc: 0.7742Mon Sep 6 18:02:56 2021[1,0]:Mon Sep 6 18:02:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:03:48 2021[1,0]:2704/4000 [===================>..........]Mon Sep 6 18:03:48 2021[1,0]: - ETA: 3:01:09 - loss: 0.1312 - auc: 0.7743Mon Sep 6 18:03:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2711/4000 [===================>..........]Mon Sep 6 18:04:48 2021[1,0]: - ETA: 3:00:10 - loss: 0.1312 - auc: 0.7743Mon Sep 6 18:04:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:05:47 2021[1,0]:2718/4000 [===================>..........]Mon Sep 6 18:05:47 2021[1,0]: - ETA: 2:59:12 - loss: 0.1312 - auc: 0.7744Mon Sep 6 18:05:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:06:45 2021[1,0]:2725/4000 [===================>..........]Mon Sep 6 18:06:45 2021[1,0]: - ETA: 2:58:13 - loss: 0.1312 - auc: 0.7744Mon Sep 6 18:06:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:07:51 2021[1,0]:2733/4000 [===================>..........]Mon Sep 6 18:07:51 2021[1,0]: - ETA: 2:57:05 - loss: 0.1312 - auc: 0.7745Mon Sep 6 18:07:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:08:48 2021[1,0]:2740/4000 [===================>..........]Mon Sep 6 18:08:48 2021[1,0]: - ETA: 2:56:06 - loss: 0.1312 - auc: 0.7745Mon Sep 6 18:08:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:09:46 2021[1,0]:2747/4000 [===================>..........]Mon Sep 6 18:09:46 2021[1,0]: - ETA: 2:55:07 - loss: 0.1311 - auc: 0.7745Mon Sep 6 18:09:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2754/4000 [===================>..........]Mon Sep 6 18:10:44 2021[1,0]: - ETA: 2:54:08 - loss: 0.1311 - auc: 0.7746Mon Sep 6 18:10:52 2021[1,0]:Mon Sep 6 18:10:28 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:11:50 2021[1,0]:2762/4000 [===================>..........]Mon Sep 6 18:11:50 2021[1,0]: - ETA: 2:53:00 - loss: 0.1311 - auc: 0.7746Mon Sep 6 18:11:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:12:49 2021[1,0]:2769/4000 [===================>..........]Mon Sep 6 18:12:49 2021[1,0]: - ETA: 2:52:01 - loss: 0.1311 - auc: 0.7747Mon Sep 6 18:12:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:13:48 2021[1,0]:2776/4000 [===================>..........]Mon Sep 6 18:13:48 2021[1,0]: - ETA: 2:51:03 - loss: 0.1311 - auc: 0.7747Mon Sep 6 18:13:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:14:47 2021[1,0]:2783/4000 [===================>..........]Mon Sep 6 18:14:47 2021[1,0]: - ETA: 2:50:04 - loss: 0.1310 - auc: 0.7748Mon Sep 6 18:14:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:15:47 2021[1,0]:2790/4000 [===================>..........]Mon Sep 6 18:15:47 2021[1,0]: - ETA: 2:49:06 - loss: 0.1310 - auc: 0.7748Mon Sep 6 18:15:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:16:48 2021[1,0]:2797/4000 [===================>..........]Mon Sep 6 18:16:48 2021[1,0]: - ETA: 2:48:08 - loss: 0.1310 - auc: 0.7748Mon Sep 6 18:16:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2804/4000 [====================>.........]Mon Sep 6 18:17:47 2021[1,0]: - ETA: 2:47:10 - loss: 0.1310 - auc: 0.7749Mon Sep 6 18:17:56 2021[1,0]:Mon Sep 6 18:17:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:18:46 2021[1,0]:2811/4000 [====================>.........]Mon Sep 6 18:18:46 2021[1,0]: - ETA: 2:46:11 - loss: 0.1310 - auc: 0.7749Mon Sep 6 18:18:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2818/4000 [====================>.........]Mon Sep 6 18:19:47 2021[1,0]: - ETA: 2:45:14 - loss: 0.1310 - auc: 0.7749Mon Sep 6 18:19:56 2021[1,0]:Mon Sep 6 18:19:38 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:20:47 2021[1,0]:2825/4000 [====================>.........]Mon Sep 6 18:20:47 2021[1,0]: - ETA: 2:44:15 - loss: 0.1310 - auc: 0.7750Mon Sep 6 18:20:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:21:46 2021[1,0]:2832/4000 [====================>.........]Mon Sep 6 18:21:46 2021[1,0]: - ETA: 2:43:17 - loss: 0.1309 - auc: 0.7750Mon Sep 6 18:21:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2840/4000 [====================>.........]Mon Sep 6 18:22:52 2021[1,0]: - ETA: 2:42:09 - loss: 0.1309 - auc: 0.7751Mon Sep 6 18:23:00 2021[1,0]:Mon Sep 6 18:22:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2847/4000 [====================>.........]Mon Sep 6 18:23:51 2021[1,0]: - ETA: 2:41:11 - loss: 0.1309 - auc: 0.7751Mon Sep 6 18:24:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:24:44 2021[1,0]:2853/4000 [====================>.........]Mon Sep 6 18:24:44 2021[1,0]: - ETA: 2:40:21 - loss: 0.1309 - auc: 0.7751Mon Sep 6 18:24:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:25:45 2021[1,0]:2860/4000 [====================>.........]Mon Sep 6 18:25:45 2021[1,0]: - ETA: 2:39:23 - loss: 0.1309 - auc: 0.7752Mon Sep 6 18:25:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:26:45 2021[1,0]:2867/4000 [====================>.........]Mon Sep 6 18:26:45 2021[1,0]: - ETA: 2:38:25 - loss: 0.1309 - auc: 0.7752Mon Sep 6 18:26:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:27:45 2021[1,0]:2874/4000 [====================>.........]Mon Sep 6 18:27:45 2021[1,0]: - ETA: 2:37:27 - loss: 0.1308 - auc: 0.7752Mon Sep 6 18:27:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:28:45 2021[1,0]:2881/4000 [====================>.........]Mon Sep 6 18:28:45 2021[1,0]: - ETA: 2:36:29 - loss: 0.1308 - auc: 0.7753Mon Sep 6 18:28:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:29:44 2021[1,0]:2888/4000 [====================>.........]Mon Sep 6 18:29:44 2021[1,0]: - ETA: 2:35:30 - loss: 0.1308 - auc: 0.7753Mon Sep 6 18:29:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:30:52 2021[1,0]:2896/4000 [====================>.........]Mon Sep 6 18:30:52 2021[1,0]: - ETA: 2:34:23 - loss: 0.1308 - auc: 0.7754Mon Sep 6 18:31:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:31:50 2021[1,0]:2903/4000 [====================>.........]Mon Sep 6 18:31:50 2021[1,0]: - ETA: 2:33:24 - loss: 0.1308 - auc: 0.7754Mon Sep 6 18:31:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2910/4000 [====================>.........]Mon Sep 6 18:32:48 2021[1,0]: - ETA: 2:32:25 - loss: 0.1308 - auc: 0.7754Mon Sep 6 18:32:56 2021[1,0]:Mon Sep 6 18:32:48 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:33:47 2021[1,0]:2917/4000 [====================>.........]Mon Sep 6 18:33:47 2021[1,0]: - ETA: 2:31:27 - loss: 0.1308 - auc: 0.7755Mon Sep 6 18:33:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:34:45 2021[1,0]:2924/4000 [====================>.........]Mon Sep 6 18:34:45 2021[1,0]: - ETA: 2:30:28 - loss: 0.1307 - auc: 0.7755Mon Sep 6 18:34:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:35:45 2021[1,0]:2931/4000 [====================>.........]Mon Sep 6 18:35:45 2021[1,0]: - ETA: 2:29:30 - loss: 0.1307 - auc: 0.7755Mon Sep 6 18:35:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2938/4000 [=====================>........]Mon Sep 6 18:36:46 2021[1,0]: - ETA: 2:28:32 - loss: 0.1307 - auc: 0.7756Mon Sep 6 18:36:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:37:45 2021[1,0]:2945/4000 [=====================>........]Mon Sep 6 18:37:45 2021[1,0]: - ETA: 2:27:33 - loss: 0.1307 - auc: 0.7756Mon Sep 6 18:37:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:38:46 2021[1,0]:2952/4000 [=====================>........]Mon Sep 6 18:38:46 2021[1,0]: - ETA: 2:26:35 - loss: 0.1307 - auc: 0.7756Mon Sep 6 18:38:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:39:45 2021[1,0]:2959/4000 [=====================>........]Mon Sep 6 18:39:45 2021[1,0]: - ETA: 2:25:36 - loss: 0.1307 - auc: 0.7757Mon Sep 6 18:39:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2966/4000 [=====================>........]Mon Sep 6 18:40:45 2021[1,0]: - ETA: 2:24:38 - loss: 0.1307 - auc: 0.7757Mon Sep 6 18:40:54 2021[1,0]:Mon Sep 6 18:40:36 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:41:45 2021[1,0]:2973/4000 [=====================>........] - ETA: 2:23:40 - loss: 0.1306 - auc: 0.7757Mon Sep 6 18:41:54 2021[1,0]:Mon Sep 6 18:41:28 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:42:44 2021[1,0]:2980/4000 [=====================>........]Mon Sep 6 18:42:44 2021[1,0]: - ETA: 2:22:41 - loss: 0.1306 - auc: 0.7758Mon Sep 6 18:42:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:43:51 2021[1,0]:2988/4000 [=====================>........]Mon Sep 6 18:43:51 2021[1,0]: - ETA: 2:21:34 - loss: 0.1306 - auc: 0.7758Mon Sep 6 18:43:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "2995/4000 [=====================>........]Mon Sep 6 18:44:49 2021[1,0]: - ETA: 2:20:35 - loss: 0.1306 - auc: 0.7758Mon Sep 6 18:44:58 2021[1,0]:Mon Sep 6 18:44:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:45:48 2021[1,0]:3002/4000 [=====================>........]Mon Sep 6 18:45:48 2021[1,0]: - ETA: 2:19:36 - loss: 0.1306 - auc: 0.7759Mon Sep 6 18:45:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:46:48 2021[1,0]:3009/4000 [=====================>........]Mon Sep 6 18:46:48 2021[1,0]: - ETA: 2:18:38 - loss: 0.1306 - auc: 0.7759Mon Sep 6 18:46:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:47:48 2021[1,0]:3016/4000 [=====================>........]Mon Sep 6 18:47:48 2021[1,0]: - ETA: 2:17:39 - loss: 0.1306 - auc: 0.7759Mon Sep 6 18:47:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3023/4000 [=====================>........]Mon Sep 6 18:48:48 2021[1,0]: - ETA: 2:16:41 - loss: 0.1305 - auc: 0.7759Mon Sep 6 18:48:56 2021[1,0]:Mon Sep 6 18:48:30 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:49:46 2021[1,0]:3030/4000 [=====================>........]Mon Sep 6 18:49:46 2021[1,0]: - ETA: 2:15:42 - loss: 0.1305 - auc: 0.7760Mon Sep 6 18:49:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:50:45 2021[1,0]:3037/4000 [=====================>........]Mon Sep 6 18:50:45 2021[1,0]: - ETA: 2:14:43 - loss: 0.1305 - auc: 0.7760Mon Sep 6 18:50:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3044/4000 [=====================>........]Mon Sep 6 18:51:45 2021[1,0]: - ETA: 2:13:45 - loss: 0.1305 - auc: 0.7760Mon Sep 6 18:51:53 2021[1,0]:Mon Sep 6 18:51:45 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:52:45 2021[1,0]:3051/4000 [=====================>........]Mon Sep 6 18:52:45 2021[1,0]: - ETA: 2:12:47 - loss: 0.1305 - auc: 0.7761Mon Sep 6 18:52:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:53:45 2021[1,0]:3058/4000 [=====================>........]Mon Sep 6 18:53:45 2021[1,0]: - ETA: 2:11:48 - loss: 0.1305 - auc: 0.7761Mon Sep 6 18:53:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:54:46 2021[1,0]:3065/4000 [=====================>........]Mon Sep 6 18:54:46 2021[1,0]: - ETA: 2:10:50 - loss: 0.1305 - auc: 0.7761Mon Sep 6 18:54:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:55:46 2021[1,0]:3072/4000 [======================>.......]Mon Sep 6 18:55:46 2021[1,0]: - ETA: 2:09:52 - loss: 0.1305 - auc: 0.7762Mon Sep 6 18:55:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:56:45 2021[1,0]:3079/4000 [======================>.......]Mon Sep 6 18:56:45 2021[1,0]: - ETA: 2:08:53 - loss: 0.1304 - auc: 0.7762Mon Sep 6 18:56:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:57:45 2021[1,0]:3086/4000 [======================>.......]Mon Sep 6 18:57:45 2021[1,0]: - ETA: 2:07:55 - loss: 0.1304 - auc: 0.7762Mon Sep 6 18:57:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:58:46 2021[1,0]:3093/4000 [======================>.......]Mon Sep 6 18:58:46 2021[1,0]: - ETA: 2:06:56 - loss: 0.1304 - auc: 0.7763Mon Sep 6 18:58:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 18:59:46 2021[1,0]:3100/4000 [======================>.......]Mon Sep 6 18:59:46 2021[1,0]: - ETA: 2:05:58 - loss: 0.1304 - auc: 0.7763Mon Sep 6 18:59:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3107/4000 [======================>.......]Mon Sep 6 19:00:47 2021[1,0]: - ETA: 2:05:00 - loss: 0.1304 - auc: 0.7763Mon Sep 6 19:00:56 2021[1,0]:Mon Sep 6 19:00:39 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:01:49 2021[1,0]:3114/4000 [======================>.......]Mon Sep 6 19:01:49 2021[1,0]: - ETA: 2:04:02 - loss: 0.1304 - auc: 0.7763Mon Sep 6 19:01:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:02:50 2021[1,0]:3121/4000 [======================>.......]Mon Sep 6 19:02:50 2021[1,0]: - ETA: 2:03:04 - loss: 0.1304 - auc: 0.7764Mon Sep 6 19:02:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:03:51 2021[1,0]:3128/4000 [======================>.......]Mon Sep 6 19:03:51 2021[1,0]: - ETA: 2:02:06 - loss: 0.1304 - auc: 0.7764Mon Sep 6 19:04:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:04:52 2021[1,0]:3135/4000 [======================>.......]Mon Sep 6 19:04:52 2021[1,0]: - ETA: 2:01:07 - loss: 0.1303 - auc: 0.7764Mon Sep 6 19:05:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:05:44 2021[1,0]:3141/4000 [======================>.......]Mon Sep 6 19:05:44 2021[1,0]: - ETA: 2:00:17 - loss: 0.1303 - auc: 0.7764Mon Sep 6 19:05:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:06:45 2021[1,0]:3148/4000 [======================>.......]Mon Sep 6 19:06:45 2021[1,0]: - ETA: 1:59:19 - loss: 0.1303 - auc: 0.7765Mon Sep 6 19:06:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:07:46 2021[1,0]:3155/4000 [======================>.......]Mon Sep 6 19:07:46 2021[1,0]: - ETA: 1:58:21 - loss: 0.1303 - auc: 0.7765Mon Sep 6 19:07:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:08:47 2021[1,0]:3162/4000 [======================>.......]Mon Sep 6 19:08:47 2021[1,0]: - ETA: 1:57:23 - loss: 0.1303 - auc: 0.7765Mon Sep 6 19:08:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3169/4000 [======================>.......]Mon Sep 6 19:09:49 2021[1,0]: - ETA: 1:56:25 - loss: 0.1303 - auc: 0.7766Mon Sep 6 19:09:57 2021[1,0]:Mon Sep 6 19:09:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:10:49 2021[1,0]:3176/4000 [======================>.......]Mon Sep 6 19:10:49 2021[1,0]: - ETA: 1:55:26 - loss: 0.1303 - auc: 0.7766Mon Sep 6 19:10:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:11:51 2021[1,0]:3183/4000 [======================>.......]Mon Sep 6 19:11:51 2021[1,0]: - ETA: 1:54:28 - loss: 0.1303 - auc: 0.7766Mon Sep 6 19:12:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:12:51 2021[1,0]:3190/4000 [======================>.......] - ETA: 1:53:30 - loss: 0.1303 - auc: 0.7766Mon Sep 6 19:13:00 2021[1,0]:Mon Sep 6 19:12:43 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:13:52 2021[1,0]:3197/4000 [======================>.......]Mon Sep 6 19:13:52 2021[1,0]: - ETA: 1:52:31 - loss: 0.1302 - auc: 0.7767Mon Sep 6 19:14:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:14:52 2021[1,0]:3204/4000 [=======================>......]Mon Sep 6 19:14:52 2021[1,0]: - ETA: 1:51:33 - loss: 0.1302 - auc: 0.7767Mon Sep 6 19:15:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:15:44 2021[1,0]:3210/4000 [=======================>......]Mon Sep 6 19:15:44 2021[1,0]: - ETA: 1:50:43 - loss: 0.1302 - auc: 0.7767Mon Sep 6 19:15:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:16:45 2021[1,0]:3217/4000 [=======================>......]Mon Sep 6 19:16:45 2021[1,0]: - ETA: 1:49:44 - loss: 0.1302 - auc: 0.7767Mon Sep 6 19:16:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3224/4000 [=======================>......]Mon Sep 6 19:17:45 2021[1,0]: - ETA: 1:48:46 - loss: 0.1302 - auc: 0.7768Mon Sep 6 19:17:53 2021[1,0]:Mon Sep 6 19:17:36 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:18:44 2021[1,0]:3231/4000 [=======================>......]Mon Sep 6 19:18:44 2021[1,0]: - ETA: 1:47:47 - loss: 0.1302 - auc: 0.7768Mon Sep 6 19:18:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:19:53 2021[1,0]:3239/4000 [=======================>......]Mon Sep 6 19:19:53 2021[1,0]: - ETA: 1:46:40 - loss: 0.1302 - auc: 0.7768Mon Sep 6 19:20:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3245/4000 [=======================>......]Mon Sep 6 19:20:45 2021[1,0]: - ETA: 1:45:50 - loss: 0.1302 - auc: 0.7768Mon Sep 6 19:20:53 2021[1,0]:Mon Sep 6 19:20:36 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:21:46 2021[1,0]:3252/4000 [=======================>......]Mon Sep 6 19:21:46 2021[1,0]: - ETA: 1:44:51 - loss: 0.1302 - auc: 0.7769Mon Sep 6 19:21:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:22:45 2021[1,0]:3259/4000 [=======================>......]Mon Sep 6 19:22:45 2021[1,0]: - ETA: 1:43:53 - loss: 0.1301 - auc: 0.7769Mon Sep 6 19:22:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:23:53 2021[1,0]:3267/4000 [=======================>......]Mon Sep 6 19:23:53 2021[1,0]: - ETA: 1:42:45 - loss: 0.1301 - auc: 0.7769Mon Sep 6 19:24:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:24:52 2021[1,0]:3274/4000 [=======================>......]Mon Sep 6 19:24:52 2021[1,0]: - ETA: 1:41:47 - loss: 0.1301 - auc: 0.7770Mon Sep 6 19:25:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3281/4000 [=======================>......]Mon Sep 6 19:25:51 2021[1,0]: - ETA: 1:40:48 - loss: 0.1301 - auc: 0.7770Mon Sep 6 19:25:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:26:50 2021[1,0]:3288/4000 [=======================>......]Mon Sep 6 19:26:50 2021[1,0]: - ETA: 1:39:49 - loss: 0.1301 - auc: 0.7770Mon Sep 6 19:26:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:27:49 2021[1,0]:3295/4000 [=======================>......]Mon Sep 6 19:27:49 2021[1,0]: - ETA: 1:38:50 - loss: 0.1301 - auc: 0.7770Mon Sep 6 19:27:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:28:48 2021[1,0]:3302/4000 [=======================>......]Mon Sep 6 19:28:48 2021[1,0]: - ETA: 1:37:51 - loss: 0.1301 - auc: 0.7771Mon Sep 6 19:28:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:29:47 2021[1,0]:3309/4000 [=======================>......]Mon Sep 6 19:29:47 2021[1,0]: - ETA: 1:36:52 - loss: 0.1301 - auc: 0.7771Mon Sep 6 19:29:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:30:47 2021[1,0]:3316/4000 [=======================>......] - ETA: 1:35:54 - loss: 0.1301 - auc: 0.7771Mon Sep 6 19:30:55 2021[1,0]:Mon Sep 6 19:30:38 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:31:47 2021[1,0]:3323/4000 [=======================>......]Mon Sep 6 19:31:47 2021[1,0]: - ETA: 1:34:55 - loss: 0.1300 - auc: 0.7771Mon Sep 6 19:31:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:32:46 2021[1,0]:3330/4000 [=======================>......]Mon Sep 6 19:32:46 2021[1,0]: - ETA: 1:33:56 - loss: 0.1300 - auc: 0.7772Mon Sep 6 19:32:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:33:46 2021[1,0]:3337/4000 [========================>.....]Mon Sep 6 19:33:46 2021[1,0]: - ETA: 1:32:58 - loss: 0.1300 - auc: 0.7772Mon Sep 6 19:33:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3344/4000 [========================>.....]Mon Sep 6 19:34:46 2021[1,0]: - ETA: 1:31:59 - loss: 0.1300 - auc: 0.7772Mon Sep 6 19:34:54 2021[1,0]:Mon Sep 6 19:34:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3351/4000 [========================>.....]Mon Sep 6 19:35:46 2021[1,0]: - ETA: 1:31:00 - loss: 0.1300 - auc: 0.7773Mon Sep 6 19:35:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:36:47 2021[1,0]:3358/4000 [========================>.....]Mon Sep 6 19:36:47 2021[1,0]: - ETA: 1:30:02 - loss: 0.1300 - auc: 0.7773Mon Sep 6 19:36:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:37:47 2021[1,0]:3365/4000 [========================>.....]Mon Sep 6 19:37:47 2021[1,0]: - ETA: 1:29:03 - loss: 0.1300 - auc: 0.7773Mon Sep 6 19:37:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:38:46 2021[1,0]:3372/4000 [========================>.....]Mon Sep 6 19:38:46 2021[1,0]: - ETA: 1:28:04 - loss: 0.1300 - auc: 0.7773Mon Sep 6 19:38:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:39:46 2021[1,0]:3379/4000 [========================>.....]Mon Sep 6 19:39:46 2021[1,0]: - ETA: 1:27:05 - loss: 0.1300 - auc: 0.7774Mon Sep 6 19:39:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:40:46 2021[1,0]:3386/4000 [========================>.....]Mon Sep 6 19:40:46 2021[1,0]: - ETA: 1:26:07 - loss: 0.1300 - auc: 0.7774Mon Sep 6 19:40:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:41:46 2021[1,0]:3393/4000 [========================>.....]Mon Sep 6 19:41:46 2021[1,0]: - ETA: 1:25:08 - loss: 0.1299 - auc: 0.7774Mon Sep 6 19:41:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:42:46 2021[1,0]:3400/4000 [========================>.....]Mon Sep 6 19:42:46 2021[1,0]: - ETA: 1:24:09 - loss: 0.1299 - auc: 0.7774Mon Sep 6 19:42:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:43:46 2021[1,0]:3407/4000 [========================>.....]Mon Sep 6 19:43:46 2021[1,0]: - ETA: 1:23:10 - loss: 0.1299 - auc: 0.7774Mon Sep 6 19:43:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:44:46 2021[1,0]:3414/4000 [========================>.....]Mon Sep 6 19:44:46 2021[1,0]: - ETA: 1:22:12 - loss: 0.1299 - auc: 0.7775Mon Sep 6 19:44:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:45:53 2021[1,0]:3422/4000 [========================>.....]Mon Sep 6 19:45:53 2021[1,0]: - ETA: 1:21:04 - loss: 0.1299 - auc: 0.7775Mon Sep 6 19:46:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:46:52 2021[1,0]:3429/4000 [========================>.....]Mon Sep 6 19:46:52 2021[1,0]: - ETA: 1:20:05 - loss: 0.1299 - auc: 0.7775Mon Sep 6 19:47:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:47:52 2021[1,0]:3436/4000 [========================>.....]Mon Sep 6 19:47:52 2021[1,0]: - ETA: 1:19:07 - loss: 0.1299 - auc: 0.7775Mon Sep 6 19:48:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:48:51 2021[1,0]:3443/4000 [========================>.....]Mon Sep 6 19:48:51 2021[1,0]: - ETA: 1:18:08 - loss: 0.1299 - auc: 0.7776Mon Sep 6 19:48:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3450/4000 [========================>.....]Mon Sep 6 19:49:49 2021[1,0]: - ETA: 1:17:09 - loss: 0.1299 - auc: 0.7776Mon Sep 6 19:49:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3457/4000 [========================>.....]Mon Sep 6 19:50:47 2021[1,0]: - ETA: 1:16:10 - loss: 0.1298 - auc: 0.7776Mon Sep 6 19:50:55 2021[1,0]:Mon Sep 6 19:50:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:51:52 2021[1,0]:3465/4000 [========================>.....]Mon Sep 6 19:51:52 2021[1,0]: - ETA: 1:15:02 - loss: 0.1298 - auc: 0.7777Mon Sep 6 19:52:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3472/4000 [=========================>....]Mon Sep 6 19:52:50 2021[1,0]: - ETA: 1:14:03 - loss: 0.1298 - auc: 0.7777Mon Sep 6 19:52:58 2021[1,0]:Mon Sep 6 19:52:41 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3479/4000 [=========================>....]Mon Sep 6 19:53:47 2021[1,0]: - ETA: 1:13:04 - loss: 0.1298 - auc: 0.7777Mon Sep 6 19:53:55 2021[1,0]:Mon Sep 6 19:53:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:54:52 2021[1,0]:3487/4000 [=========================>....]Mon Sep 6 19:54:52 2021[1,0]: - ETA: 1:11:56 - loss: 0.1298 - auc: 0.7777Mon Sep 6 19:55:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:55:50 2021[1,0]:3494/4000 [=========================>....]Mon Sep 6 19:55:50 2021[1,0]: - ETA: 1:10:57 - loss: 0.1298 - auc: 0.7777Mon Sep 6 19:55:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:56:48 2021[1,0]:3501/4000 [=========================>....]Mon Sep 6 19:56:48 2021[1,0]: - ETA: 1:09:58 - loss: 0.1298 - auc: 0.7778Mon Sep 6 19:56:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:57:47 2021[1,0]:3508/4000 [=========================>....]Mon Sep 6 19:57:47 2021[1,0]: - ETA: 1:08:59 - loss: 0.1298 - auc: 0.7778Mon Sep 6 19:57:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:58:46 2021[1,0]:3515/4000 [=========================>....]Mon Sep 6 19:58:46 2021[1,0]: - ETA: 1:08:00 - loss: 0.1298 - auc: 0.7778Mon Sep 6 19:58:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 19:59:52 2021[1,0]:3523/4000 [=========================>....]Mon Sep 6 19:59:52 2021[1,0]: - ETA: 1:06:53 - loss: 0.1298 - auc: 0.7778Mon Sep 6 20:00:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:00:49 2021[1,0]:3530/4000 [=========================>....]Mon Sep 6 20:00:49 2021[1,0]: - ETA: 1:05:54 - loss: 0.1297 - auc: 0.7779Mon Sep 6 20:00:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:01:48 2021[1,0]:3537/4000 [=========================>....]Mon Sep 6 20:01:48 2021[1,0]: - ETA: 1:04:55 - loss: 0.1297 - auc: 0.7779Mon Sep 6 20:01:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:02:47 2021[1,0]:3544/4000 [=========================>....]Mon Sep 6 20:02:47 2021[1,0]: - ETA: 1:03:56 - loss: 0.1297 - auc: 0.7779Mon Sep 6 20:02:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:03:53 2021[1,0]:3552/4000 [=========================>....]Mon Sep 6 20:03:53 2021[1,0]: - ETA: 1:02:48 - loss: 0.1297 - auc: 0.7780Mon Sep 6 20:04:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:04:52 2021[1,0]:3559/4000 [=========================>....]Mon Sep 6 20:04:52 2021[1,0]: - ETA: 1:01:50 - loss: 0.1297 - auc: 0.7780Mon Sep 6 20:05:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:05:52 2021[1,0]:3566/4000 [=========================>....]Mon Sep 6 20:05:52 2021[1,0]: - ETA: 1:00:51 - loss: 0.1297 - auc: 0.7780Mon Sep 6 20:06:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:06:52 2021[1,0]:3573/4000 [=========================>....]Mon Sep 6 20:06:52 2021[1,0]: - ETA: 59:52 - loss: 0.1297 - auc: 0.7780 Mon Sep 6 20:07:01 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3580/4000 [=========================>....]Mon Sep 6 20:07:52 2021[1,0]: - ETA: 58:53 - loss: 0.1297 - auc: 0.7780Mon Sep 6 20:08:01 2021[1,0]:Mon Sep 6 20:07:52 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3587/4000 [=========================>....]Mon Sep 6 20:08:49 2021[1,0]: - ETA: 57:54 - loss: 0.1297 - auc: 0.7781Mon Sep 6 20:08:57 2021[1,0]:Mon Sep 6 20:08:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:09:46 2021[1,0]:3594/4000 [=========================>....]Mon Sep 6 20:09:46 2021[1,0]: - ETA: 56:55 - loss: 0.1297 - auc: 0.7781Mon Sep 6 20:09:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3602/4000 [==========================>...]Mon Sep 6 20:10:52 2021[1,0]: - ETA: 55:48 - loss: 0.1296 - auc: 0.7781Mon Sep 6 20:11:01 2021[1,0]:Mon Sep 6 20:10:36 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3609/4000 [==========================>...]Mon Sep 6 20:11:51 2021[1,0]: - ETA: 54:49 - loss: 0.1296 - auc: 0.7782Mon Sep 6 20:11:59 2021[1,0]:Mon Sep 6 20:11:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:12:49 2021[1,0]:3616/4000 [==========================>...]Mon Sep 6 20:12:49 2021[1,0]: - ETA: 53:50 - loss: 0.1296 - auc: 0.7782Mon Sep 6 20:12:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:13:49 2021[1,0]:3623/4000 [==========================>...]Mon Sep 6 20:13:49 2021[1,0]: - ETA: 52:51 - loss: 0.1296 - auc: 0.7782Mon Sep 6 20:13:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3630/4000 [==========================>...]Mon Sep 6 20:14:48 2021[1,0]: - ETA: 51:52 - loss: 0.1296 - auc: 0.7782Mon Sep 6 20:14:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:15:49 2021[1,0]:3637/4000 [==========================>...]Mon Sep 6 20:15:49 2021[1,0]: - ETA: 50:53 - loss: 0.1296 - auc: 0.7782Mon Sep 6 20:15:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:16:49 2021[1,0]:3644/4000 [==========================>...]Mon Sep 6 20:16:49 2021[1,0]: - ETA: 49:55 - loss: 0.1296 - auc: 0.7783Mon Sep 6 20:16:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3651/4000 [==========================>...]Mon Sep 6 20:17:49 2021[1,0]: - ETA: 48:56 - loss: 0.1296 - auc: 0.7783Mon Sep 6 20:17:58 2021[1,0]:Mon Sep 6 20:17:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3658/4000 [==========================>...]Mon Sep 6 20:18:50 2021[1,0]: - ETA: 47:57 - loss: 0.1296 - auc: 0.7783Mon Sep 6 20:18:59 2021[1,0]:Mon Sep 6 20:18:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:19:50 2021[1,0]:3665/4000 [==========================>...]Mon Sep 6 20:19:50 2021[1,0]: - ETA: 46:58 - loss: 0.1296 - auc: 0.7783Mon Sep 6 20:19:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:20:49 2021[1,0]:3672/4000 [==========================>...]Mon Sep 6 20:20:49 2021[1,0]: - ETA: 45:59 - loss: 0.1296 - auc: 0.7784Mon Sep 6 20:20:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:21:49 2021[1,0]:3679/4000 [==========================>...]Mon Sep 6 20:21:49 2021[1,0]: - ETA: 45:01 - loss: 0.1295 - auc: 0.7784Mon Sep 6 20:21:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:22:49 2021[1,0]:3686/4000 [==========================>...]Mon Sep 6 20:22:49 2021[1,0]: - ETA: 44:02 - loss: 0.1295 - auc: 0.7784Mon Sep 6 20:22:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3693/4000 [==========================>...]Mon Sep 6 20:23:49 2021[1,0]: - ETA: 43:03 - loss: 0.1295 - auc: 0.7784Mon Sep 6 20:23:58 2021[1,0]:Mon Sep 6 20:23:41 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:24:50 2021[1,0]:3700/4000 [==========================>...]Mon Sep 6 20:24:50 2021[1,0]: - ETA: 42:04 - loss: 0.1295 - auc: 0.7785Mon Sep 6 20:24:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3707/4000 [==========================>...]Mon Sep 6 20:25:49 2021[1,0]: - ETA: 41:05 - loss: 0.1295 - auc: 0.7785Mon Sep 6 20:25:58 2021[1,0]:Mon Sep 6 20:25:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:26:48 2021[1,0]:3714/4000 [==========================>...]Mon Sep 6 20:26:48 2021[1,0]: - ETA: 40:07 - loss: 0.1295 - auc: 0.7785Mon Sep 6 20:26:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:27:46 2021[1,0]:3721/4000 [==========================>...]Mon Sep 6 20:27:46 2021[1,0]: - ETA: 39:07 - loss: 0.1295 - auc: 0.7785Mon Sep 6 20:27:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:28:54 2021[1,0]:3729/4000 [==========================>...]Mon Sep 6 20:28:54 2021[1,0]: - ETA: 38:00 - loss: 0.1295 - auc: 0.7785Mon Sep 6 20:29:02 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3735/4000 [===========================>..]Mon Sep 6 20:29:46 2021[1,0]: - ETA: 37:10 - loss: 0.1295 - auc: 0.7786Mon Sep 6 20:29:54 2021[1,0]:Mon Sep 6 20:29:46 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3742/4000 [===========================>..] - ETA: 36:11 - loss: 0.1295 - auc: 0.7786Mon Sep 6 20:30:55 2021[1,0]:86Mon Sep 6 20:30:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:31:47 2021[1,0]:3749/4000 [===========================>..]Mon Sep 6 20:31:47 2021[1,0]: - ETA: 35:12 - loss: 0.1295 - auc: 0.7786Mon Sep 6 20:31:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:32:47 2021[1,0]:3756/4000 [===========================>..]Mon Sep 6 20:32:47 2021[1,0]: - ETA: 34:13 - loss: 0.1294 - auc: 0.7786Mon Sep 6 20:32:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:33:48 2021[1,0]:3763/4000 [===========================>..]Mon Sep 6 20:33:48 2021[1,0]: - ETA: 33:15 - loss: 0.1294 - auc: 0.7787Mon Sep 6 20:33:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3770/4000 [===========================>..]Mon Sep 6 20:34:49 2021[1,0]: - ETA: 32:16 - loss: 0.1294 - auc: 0.7787Mon Sep 6 20:34:58 2021[1,0]:Mon Sep 6 20:34:49 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:35:50 2021[1,0]:3777/4000 [===========================>..]Mon Sep 6 20:35:50 2021[1,0]: - ETA: 31:17 - loss: 0.1294 - auc: 0.7787Mon Sep 6 20:35:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:36:49 2021[1,0]:3784/4000 [===========================>..]Mon Sep 6 20:36:49 2021[1,0]: - ETA: 30:18 - loss: 0.1294 - auc: 0.7787Mon Sep 6 20:36:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:37:47 2021[1,0]:3791/4000 [===========================>..]Mon Sep 6 20:37:47 2021[1,0]: - ETA: 29:19 - loss: 0.1294 - auc: 0.7788Mon Sep 6 20:37:55 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3799/4000 [===========================>..]Mon Sep 6 20:38:53 2021[1,0]: - ETA: 28:12 - loss: 0.1294 - auc: 0.7788Mon Sep 6 20:39:02 2021[1,0]:Mon Sep 6 20:38:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3806/4000 [===========================>..]Mon Sep 6 20:39:51 2021[1,0]: - ETA: 27:13 - loss: 0.1294 - auc: 0.7788Mon Sep 6 20:39:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:40:50 2021[1,0]:3813/4000 [===========================>..]Mon Sep 6 20:40:50 2021[1,0]: - ETA: 26:14 - loss: 0.1294 - auc: 0.7788Mon Sep 6 20:40:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:41:47 2021[1,0]:3820/4000 [===========================>..]Mon Sep 6 20:41:47 2021[1,0]: - ETA: 25:15 - loss: 0.1294 - auc: 0.7788Mon Sep 6 20:41:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:42:54 2021[1,0]:3828/4000 [===========================>..]Mon Sep 6 20:42:54 2021[1,0]: - ETA: 24:07 - loss: 0.1293 - auc: 0.7789Mon Sep 6 20:43:02 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:43:51 2021[1,0]:3835/4000 [===========================>..]Mon Sep 6 20:43:51 2021[1,0]: - ETA: 23:08 - loss: 0.1293 - auc: 0.7789Mon Sep 6 20:44:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:44:49 2021[1,0]:3842/4000 [===========================>..]Mon Sep 6 20:44:49 2021[1,0]: - ETA: 22:09 - loss: 0.1293 - auc: 0.7789Mon Sep 6 20:44:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3850/4000 [===========================>..]Mon Sep 6 20:45:54 2021[1,0]: - ETA: 21:02 - loss: 0.1293 - auc: 0.7789Mon Sep 6 20:46:02 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:46:52 2021[1,0]:3857/4000 [===========================>..]Mon Sep 6 20:46:52 2021[1,0]: - ETA: 20:03 - loss: 0.1293 - auc: 0.7790Mon Sep 6 20:47:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:47:50 2021[1,0]:3864/4000 [===========================>..]Mon Sep 6 20:47:50 2021[1,0]: - ETA: 19:04 - loss: 0.1293 - auc: 0.7790Mon Sep 6 20:47:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:48:49 2021[1,0]:3871/4000 [============================>.]Mon Sep 6 20:48:49 2021[1,0]: - ETA: 18:05 - loss: 0.1293 - auc: 0.7790Mon Sep 6 20:48:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:49:48 2021[1,0]:3878/4000 [============================>.]Mon Sep 6 20:49:48 2021[1,0]: - ETA: 17:06 - loss: 0.1293 - auc: 0.7790Mon Sep 6 20:49:56 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:50:54 2021[1,0]:3886/4000 [============================>.]Mon Sep 6 20:50:54 2021[1,0]: - ETA: 15:59 - loss: 0.1293 - auc: 0.7791Mon Sep 6 20:51:02 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3893/4000 [============================>.]Mon Sep 6 20:51:51 2021[1,0]: - ETA: 15:00 - loss: 0.1293 - auc: 0.7791Mon Sep 6 20:52:00 2021[1,0]:Mon Sep 6 20:51:51 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:52:49 2021[1,0]:3900/4000 [============================>.]Mon Sep 6 20:52:49 2021[1,0]: - ETA: 14:01 - loss: 0.1292 - auc: 0.7791Mon Sep 6 20:52:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:53:55 2021[1,0]:3908/4000 [============================>.]Mon Sep 6 20:53:55 2021[1,0]: - ETA: 12:54 - loss: 0.1292 - auc: 0.7791Mon Sep 6 20:54:03 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:54:52 2021[1,0]:3915/4000 [============================>.]Mon Sep 6 20:54:52 2021[1,0]: - ETA: 11:55 - loss: 0.1292 - auc: 0.7791Mon Sep 6 20:55:00 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:55:49 2021[1,0]:3922/4000 [============================>.]Mon Sep 6 20:55:49 2021[1,0]: - ETA: 10:56 - loss: 0.1292 - auc: 0.7792Mon Sep 6 20:55:57 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3930/4000 [============================>.]Mon Sep 6 20:56:53 2021[1,0]: - ETA: 9:48 - loss: 0.1292 - auc: 0.7792Mon Sep 6 20:57:01 2021[1,0]Mon Sep 6 20:57:01 2021[1,0]:>Mon Sep 6 20:56:53 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 20:57:50 2021[1,0]:3937/4000 [============================>.]Mon Sep 6 20:57:50 2021[1,0]: - ETA: 8:49 - loss: 0.1292 - auc: 0.7792Mon Sep 6 20:57:58 2021[1,0]Mon Sep 6 20:57:58 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3944/4000 [============================>.]Mon Sep 6 20:58:47 2021[1,0]: - ETA: 7:51 - loss: 0.1292 - auc: 0.7792Mon Sep 6 20:58:55 2021[1,0]Mon Sep 6 20:58:55 2021[1,0]:Mon Sep 6 20:58:47 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3952/4000 [============================>.]Mon Sep 6 20:59:52 2021[1,0]: - ETA: 6:43 - loss: 0.1292 - auc: 0.7792Mon Sep 6 21:00:00 2021[1,0]Mon Sep 6 21:00:00 2021[1,0]:Mon Sep 6 20:59:44 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:00:55 2021[1,0]:3960/4000 [============================>.]Mon Sep 6 21:00:55 2021[1,0]: - ETA: 5:36 - loss: 0.1292 - auc: 0.7793Mon Sep 6 21:01:03 2021[1,0]Mon Sep 6 21:01:03 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:01:51 2021[1,0]:3967/4000 [============================>.]Mon Sep 6 21:01:51 2021[1,0]: - ETA: 4:37 - loss: 0.1292 - auc: 0.7793Mon Sep 6 21:01:59 2021[1,0]Mon Sep 6 21:01:59 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:02:54 2021[1,0]:3975/4000 [============================>.]Mon Sep 6 21:02:54 2021[1,0]: - ETA: 3:30 - loss: 0.1292 - auc: 0.7793Mon Sep 6 21:03:02 2021[1,0]Mon Sep 6 21:02:54 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "3982/4000 [============================>.]Mon Sep 6 21:03:50 2021[1,0]: - ETA: 2:31 - loss: 0.1292 - auc: 0.7793Mon Sep 6 21:03:58 2021[1,0]Mon Sep 6 21:03:58 2021[1,0]:Mon Sep 6 21:03:50 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:04:55 2021[1,0]:3990/4000 [============================>.]Mon Sep 6 21:04:55 2021[1,0]: - ETA: 1:24 - loss: 0.1291 - auc: 0.7793Mon Sep 6 21:05:03 2021[1,0]Mon Sep 6 21:05:03 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:05:54 2021[1,0]:3997/4000 [============================>.]Mon Sep 6 21:05:54 2021[1,0]: - ETA: 25s - loss: 0.1291 - auc: 0.7793Mon Sep 6 21:06:03 2021[1,0]:::\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "\r", - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:06:11 2021[1,0]:3999/4000 [============================>.]Mon Sep 6 21:06:11 2021[1,0]: - ETA: 8s - loss: 0.1291 - auc: 0.7793 Mon Sep 6 21:06:20 2021[1,0]on Sep 6 21:06:11 2021[1,0]:\r" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "[Stage 11:> (0 + 16) / 16]\r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Mon Sep 6 21:09:31 2021[1,0]:4000/4000 [==============================]Mon Sep 6 21:09:31 2021[1,0]: - 33843s 8s/step - loss: 0.1291 - auc: 0.7793 - val_loss: 0.1287 - val_auc: 0.7880 6 21:09:31 2021[1,0]:\n" - ] - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - " \r" - ] - }, - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Best Loss: 0.128178\n" - ] - } - ], - "source": [ - "main_petastorm()" - ] - }, - { - "cell_type": "markdown", - "id": "49a4020d", - "metadata": {}, - "source": [ - "### Conclusion\n", - "\n", - "From cell[8] and cell[10], we can see the total training time respectively: \n", - "\n", - "- NVTabular: 845s\n", - "- Petastorm: 33843s \n", - "\n", - "So the speedup : 33843 / 845 = `40.05`" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "id": "51361729", - "metadata": {}, - "outputs": [], - "source": [] - } - ], - "metadata": { - "kernelspec": { - "display_name": "Python 3", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.8.2" - } - }, - "nbformat": 4, - "nbformat_minor": 5 -} diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/._SUCCESS.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/._SUCCESS.crc deleted file mode 100644 index 3b7b044936a890cd8d651d349a752d819d71d22c..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 8 PcmYc;N@ieSU}69O2$TUk diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/.part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/.part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv.crc deleted file mode 100644 index 33674bbb15d8ebb7f2fe4a28ba75018ad98ca3c6..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 12 TcmYc;N@ieSU}7-L-M1G25yS&j diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/_SUCCESS b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/_SUCCESS deleted file mode 100644 index e69de29bb..000000000 diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv deleted file mode 100644 index b9e01a929..000000000 --- a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/dimensions/part-00000-1bfe973d-db55-449a-8c6a-9aaaa58b0f3e-c000.csv +++ /dev/null @@ -1,2 +0,0 @@ -c0,c1,c2,c3,c4,c5,c6,c7,c8,c9,c10,c11,c12,c13,c14,c15,c16,c17,c18,c19,c20,c21,c22,c23,c24,c25 -7912888,33822,17138,7338,20045,3,7104,1381,62,5554113,582468,245827,10,2208,10666,103,3,967,14,8165895,2675939,7156452,302515,12021,96,34 diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/._SUCCESS.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/._SUCCESS.crc deleted file mode 100644 index 3b7b044936a890cd8d651d349a752d819d71d22c..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 8 PcmYc;N@ieSU}69O2$TUk diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/.part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/.part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet.crc deleted file mode 100644 index 72624f728b06ec5fea8a02b0eb0cce986bae53f8..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 784 zcmV+r1MmD}a$^7h00IEfvGJqFYB#B0{mze`Xb(sF)+=tzF^2X-Hd=TA)Q4yeg-YLX zLXN+MQd31s6U*mL>`$0dDdIBLe6=9yQjx3i7n~znE_o@Ql~8HFyr{K_&iC=nUsV}? z4KzHvDW9_~6*B!_;Pep?in^;Gr9Wfdqi`R>$D*%lgwT0&mY>d(0-jzPaA!^2ng>Af_lC6W!nLwwLB~OKwkT7^<<)akGbq10rxS$+wMa zx%HsEQ6={p)#$z>@WxtxW{Xl*Q|q|A!6gaR3-P z1Z0-wwpb1vFQ{Lg6ub7;U3Y-0sqo0AUkPwZ`6fx`C;wu-I}_r+TgHzHXe0BWjTSIK zABl?yh4jk*yhNQ);I~UG@yLN47fPIIIGvH&nwfx_&s3XHytC2IllWQcrQ|fAwcBEg zr7`5BF`sv1;5kOGloJ~^PY6AUtzGfq7+Q1Y$@# diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/_SUCCESS b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/_SUCCESS deleted file mode 100644 index e69de29bb..000000000 diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/test_small/part-00000-39895f81-1e2c-4cb1-a883-b21c9328bf3f-c000.snappy.parquet deleted file mode 100644 index 272949e413296f0e22ffd9a89016bbced1437922..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 99248 zcmZs@2V4``_da}Ql9_}szz|X<1qfA8)KFAJltUF21r!t&H6Xfnv3CtcK^GOVVMpw) zYwzo>frw%kdl$Q|x?){*clEvOa`XM~Z{K_r!Xz_u=azGx^E~I=q{yy;O0kkxDiZK7 zF+x&3!Y>N{S0d#>O1YZ~P?kF5&se2YFNo_u5b)O!QX#+p=P!I9eXI!oEOn+RhUQOE zNJMFoC{l%gm*PJ(D=E2Djzo-@kHUvGQqJfM#S{&}?;lV|vQ}(pj3ksyE&lE%5o|?a=DeXX&y6>l5Luu&ID`@*@Pbb*5edMBMy``|=;g~5=ze`}u4{aiL zmm{zj{W$s8g_MI|*0+e(=YA?XUdu!9+*iLxT0Tb%8T)BJ)k6+;W?;cRzH@8URt9D* z7#cRkUE<(Zx77}&t-f?bbzcP0DSx(P;vC_JaL+-0Rwr0-)&BFw7WUxPamm$Qn`MyD zYQ}+w%|tMHtk=jNBGnMEN6faICxKy6#Xmc)b%b6`7Q~;MXb+QTe5n|^m4&m~x?dOZ zGVu47Jo>%83l#n~_~4~WT5uR0)aFvI1JH)XU+jPQGh&keiO&NPc~~}Y^^nT(N(il* zF=h2(H8gG8Eam7E2k5eGUhIH<4ls?`{C+U)0y}iu4qWWy1W8>#>UQL+;HpF6pwC?# z;6V1qp3Rgl@C_w@GmUkE&jBSi&`*x=an5#i zpZCr%wEEyLmk!xOM349BU3AWH@~ZdyKR9R52@jtwDB)pW#K2Eehbe$_shp7g+zG1Q zId$tbii7=i#m%*69YJodKJw&<3%qpcIpE`LIdqOYUiGLg4?UOvxK9F<>5n4i zU>eouk5kW_Vb#I#-V3)Ypg3Q2@LnGod>=I6_6if<&>tLR{!;t)>s}T7q+PV?&}$w# zY}vlmXQdN(Y)@~uFw7O)zn(oES|@{o$;T#sTB(4VgIC^P|6~sjR z=16PRag75!Jo1;hNh>)xzf`E|RE{ua*N)jqlbvCsSI3(nl{`FY?ioD7-x*wg`15Ld zD`$xN`S}p2afaBokEWjgB5#<@Je0QnY00ZfRl|I9fr}9(V)Y$o`1wTGZ+;Is2n8=1 z-m2im?MC^{b9uNt;G>=2A!k_LK4`qqLj%9{sW^~vTm>g5#e`@1xs$QG3j zv!IoIMK{h+&xZ}#7ikIJ*;+1Q`mY!6uzA;Dm!&l;pOaxkk62yR>9u1FtmYIpo?Kj! z>&V(?4tjL2I#MW7%*(M>2!V87=Z6w~pfHCr@z+DybrmL5ZOk%P#0MS>O%t&hs4zP` zCm}o7P(;h`KY4Hnp}d$8LGdZG+}dZt)U`q1tL+~M0eVzWS(aq*&8x877shgqdDb3d zk)O<~f1rtDm(`fY>Wji>QIdti6;+#hf)*isEEebC3|&o|B+2qYVmkb>S`{ zG!EI%2^5;5c`HQaXP&8Q3UUGk4$Tn!A#ej7S45TlDsa-gYEMy5!P~1zA#t1v;yq2i}rJt!MqsB%qt55 z4+bJf)r2>@3t5gaWa`FA7EporlSB3AbMgW+v!;t)Pq3sV&5{0?VKf=ri;g2s5KN*c znYAWP!5z2kLB^@`YAlpVTxqVcyx^TIg>R6tE=eIeZ!*xK)iM|uA}l_HqR-qHhH*yL zT;bXjiQd&t6^iuYD%PwTYbdUf?kwakrnlc)@_Znhm(z8BlE8}06UqjnMQ#?cF5~L#9Oj|;^;vLMAoJ3Yr&@4y@74j}cdAJ^HHLJ?g*yZi(G))IF=81m=7GV3fyOUe|S&hxl=w^rQxb3Zh?d@N8oxr)+>|brs%>d}= z+Th{sKvLngGT^1sW`~J=TQ`i)U>E2hvy1=cubdKo>3;Q*?;jeQe?o<^nMX__l+C~L`fRf`1A)24|U0x<}YrkgtlQF0zFL{*l_#)r7NFQHhi$k zd}XrJb{DV|B@m@AV z3kOcCnLkbcb0-ABrQ83Kw!%eggGpC*e(X2+fgToZ9{JQ|m^&OVs+=(Xs0#Mp*uSzM zMQ?*8LrX(W!6^eA{E0q4MxuqYkDd#TP2E8h-*T$G;08|bw|9FLBmeEdo(t9w90MqFDu%qZEn>(F5-QdugV5r-gMdJYdxp8!MInA zgKHzHKW1%hql6tPV)2{bR4`!GMtVw_Gk8y+7PfrtVuL0Bfaq@#1jaP&qrFs8<_2@R z$OkN3=W2sZ1P%~58~HsyeDP2NbPJTC8{O0(tK3pC&>c7b+Ng zb6vIbbv2AVRB5nwRN7$9tMhM$wKZyN@TW`Kl)yJvHSpoU%tIecJWtJly$NKF{-&2HL57wtYD!!0g5C8TSi#JdWD!-`G=YgTqZu2p`tpSHPKv>;8hq zDtKFJ|F!6~8um{r2k>;Y!ANV(;on(K3mwBkA#<+52E$CBpMIX}qOrljU($Ul-0bBb zcWY{F$Un*yr@*sS>`QyTRv2kqbzt&)1#m zr-s_kZmGFO0T#4ZH=BG-1p)ikrT+O7?%yw4JOjg2wySHu7rCpHjV4CQVAZB-_0KPl?TtGw-0Ar>j^0j*)IaDJn-B1u6AnZG51mS7mFLXs{gq3MCS_3Sl1>q4ys5@ z2j$_EWZ4UyE!Nvu`SbB1)f!uvu-hZg@8&8kTzWt7;P>-gq5rKTM>f4wK>V-QesTO> z0Y!&j-|YLn8pd<|ZVfbR!DV$-RpN117*wwIDNqV9FS+*RrpB%??{`!D@GELt1WUrO z+ug>i?kv;5>T#QI8a-8T{n*P0Cx4wSnC;v6!~3D`0%NBo`QnqOq)Qbr1* zD|Fc)Kv!qepW|2SpddN+(Sd56Eu19bSKY?}(`(nNVd(o$Ti%zuLYVK)>)Yn4;Lmkp zkEa(DaPmsr@QPL%TUbQGAY-4rO+Rl|K&MS}((D}tXftGVscEkQDvRbjuk%!cHU8ad zk0VOB())hv=U>$ze`cxtp{uhkY?2H-bn3=zp^DXP*RaceJWPaSasM8AY+$~*R)fuA;$4@E4H>qu5 zT!mM@AM#W}yKB4p?ryJxfW&q0zT@;TcaL3@U+&>`*Cpr6Lzx2GlhKhsM!3MEn8F#q zWoW?S*y`s>IS#uU!b8LJJ^QZT6QFVL(5hb&mGD9G>&EYPX+U&&?X`9@@p|`Msn6c6 zwuPZ?{OM6G?&#qC@F-b!q#jgZhSA(KHRMgs857Z6Zwuo{xVs`SA?o0DR}5 z!Kkcz>H|+nI~Z)?{bHZLdZINhHu_=S_!+t3cUAD+&?nIr2Vy_95LMC5t%fU%C^d9yuIzCx)E$b# zz7C9@fc?a^cOmi<`1{RFi$hVGgzh#Q=?0l|+e%JQ( zy);n)!+wZA;H%Zc2l?+=$9y$5x~eEu7JqSv08Sqd$JY(j!M^1iBj-7(p?&Pw!JI@4F$u`KJEQxxwyM z&aSsuJsf?sTI5aCBFvBH1Yo6rLTf8s)8nzXnd8IN-bh z8~@tu?z>V2b1H|;KYYy{a<@L_7k1S`L6>`9kFstyx@zLB@Pt&J8tvA6o< zBv&2OR=;o_uGWBxJG186Z>~1_?DYP9TSjNQ!1cwZUfV9HAW?5R7~-md&(Ht*Bc@gh zdrGD^D_)_2p}Qt#_kV}&{HhOAyRF9INcqCGdr#|OoA=bE+B`QnmSkCBJ}ie-)AR#3 zEEM2OyGL1m(6yUaI~4@REkD%ptQ-z!2mIcRR>JE~nI0!y^}vj@4<25n zhRkZu!@*`3I5MW^A1(I_aQjF>*ypDLZ2IBy_1|BrZFJ+?Rn6iKI%uGMdW4~Hr55&| zsQVbPR0j(UkDnz)3Q(Hh-BmhQfHapIJ1AZpnVu!pzyL+v+{EHrg}KbxEpc zvODzabOer6V*GVyJsY!43!AqdE|hs_;O5t}FCL%Mz?LDagn)f&fWDQ{uW)$hJM~(P zwY?g`I^A(uG{FrTU;R-oEfs8ZU<2t3V>6!7hX)D`xLge`R*$CYHENhVsmar;KG;9D z8sTV8RYC2SgXqT@0>tj9oweYI0O$V5y!m{dD-I9u@3Y)@v(a7}Lsj>Oj0UDZ=0YM63mk^?d+;HPr8l~c6>#BI1a;KK`7_%@_} zVf9lr%%2pw(eET)kCtv5XaVCF=Lojuvl^PUi@m$~J1v-b{|8~18YbStfaKRP#Oaa<2Z5H5n!yPt+1y^rcC5Of4w(Fdu zR4_D6lH7l(3;flwt?vUD1GN11>;6Y`wea0ydaOgR0+w&7i2m@S%0^$GI2mTQ;gvfG z{f=Cm7pH(1S-W%JZo~7Vfqsn+xN=@JQweVzQ?35Z)iAAhMEKqmC8WIDHSDKLc%E7| zmbmYeAXPfEZsF8C2!AS!y zZ%;o>a&?914tMpxb%`iMh*13jPY}C zYoU{@X64FX^swb+&&loH>R{?@@0PRc^l)I$%&?688dxB0+T>TGD|G(!IjGw(J(Mk$ zN>5zGcyZp%$uGa@VSE9dDLtrxGY3*+-WoN;8g?98SFMNpO$Joj2dE+U;nC4Ki2|U@ zBSsB;@9Un0&H3HWM`8;DwtHPxYB`ALG<~^$(hb>uyggW?&(c*a8t!>IhUw` z%!4~ySKbm}M$>OEJ4kiFnLEtM3^l+5C#UB-$LgVf(vJr}Zq)9g5*3Wi|oZ1StSS%6W&*P){_p2Vqf4rrBqXP_%%s>5hJe!XTM{ z>7sIkHm)qOYdmLtxy zI|_B*QJ zHpZc)Q&x1GurI6pY|GoXEA#1n!iBT!-KnB3p&o_7^Bf*6>JPFfEAt%b=V?g=VJ~(D zcWT2H-apr-&Vt&9v(?so>fMEI=bhMzYv(xC6lR`x`@PoXc;IKDwwmkpY>!jKU!UGN z0c97$NB*S9;#*4Qnu{r`A4El+G_8$|5c}`Ngr@OwG3D4chKg~%(%&58lAPkqJNaeS zaO!2b$#L4xJDuCRc6e0N-tfw~ggRQ7Wr_DbnOxFg<;q8N$9C)2Uvz7->vBn_yd&>< z-a(4GCCIB&jwPH9i0syxJ(6*$d8>WiRF^&R28wU}Jj>F>Nw9QF>?D}K7wbN+7pZ1M zP)bF!D2LdTU2VXgx@W-&K)HZ!O_eV*6r?rR@H4=<;+Kqgl?uz9_u}fMHST;^28nj_%hqkiK z`&7M$9~xk3GO{P{nEv?KxL9HIS*Eg4@14*i$xmac($!wx*H!b`m~pL-YweXp*BYUC zY2U7|2AD&qE~r`BZw7TWQ8BhwUTVtQ6?;8-rbcxkqfk>^nz_Ab-4Z%6Chv4+k;Vl5 z=j}6A_74D6Pgk{2R+x1^VZWSb1q(Mo>~X;nHA^|3KVWHO_Lau63{`B%vcdb8QB5`& zs{(3DA71QRi>R57D`(f--~uPLJn>!G?D9g-wT~BEPA!-{a1OO@LHFe`8KoPgp_|su z>NrFdzka#z4-S^tz-{|JE*e@n)o2;YCXA_Wva`zfmJ7R$SE$}T%CxlK7;n@e*5bns z-}e}f8~5K~#Ut298*hy`a{uy*kw>X(-J>#`_eN%mTPx;yRYnG;3&%cpJ2$9m@xYax z0I%oXCo~WfnNXaGhIs{e$wsev8Q6LBM!%eTPT+8sp28lPAhl0*kkeEDOmJBvylvgmeaidCUDr^FH%`p8~}QaX{9F7DUd zN!TFr`ts^TzZqXgy}ie2t{~|}DfI*j%_4c4;XBst6O%jBvapPiUCjW&Ue>>&d0LId zl!sbNkLR%v+CG0vd}z8yVb5TXnV(YAN+?y|YNuJ6AqPDQTqh5*6wDcWFN@B7UT(jOBcSs4d%#D?h2K^$x3Ydrj;G7`*n;o@;AIO&4TPU8So)}`lq z8q?Sq^JrxDR22A1E9y9FH@{=|$IU6@ zWp(IOS*XY;H5;U8lvHHapB%+oJ^bcWik%R$ywxL*5LE{1Yvl^E!z+UYg!BbQ9=$Qj zvK@|5D6cFgX0+dY#LJMBhcw&+Q6CZF{Z7GY%esch!Y%VUu&tgQ;6f(EqaFPqX z6JZE)Y#k>7xdnIxD5uQZyd=i#i8}V=Spzzacxy63Wp*9CksZ>{$2hDKiHkLPtq~a0 zEP+YZGQDLB7su-FQqogiG5H9c8pXuW3M7l+-f*XaIXs*)iaTYHS}uf`ojDN_@>}wo z%8}Km7aRQwO4|0TG|+E2B;u8Zm;xF(@Zsh%BrW4monQMUD97X~L!5c7(UO4}e(`yc zbW4z*buF6h$yxEeGSIQ)08uo$V?-zkSxs5i3}n`B(?n+hE42m%oKFfr_E9PU+&?^` z{bc5t=r>$Jt-mkQTa&zT59CpZGEriq9(Ex!3QweV<}SbwEVZmFPFRa-kRPfD5K){6 z&k`3TGI8c|PL}QWh%W}9+sFIO3iPwO_-pX|(vu1QzhbXwvoNd6BY2#J3o0Vv6TA%Y&! zeMue+3HS+-@y~p4u@T=SZ-(fzB%g=`ri74H#bzUUXS0a{$lQOeWP-{TdNoK}o#DM5 z^FMi-s8M32}SGZ4v#L5Cc<>Z@(*h zE7*j|ZYcEJE@uU_)Y`3kQ>L^Dr%MN`(OSLMCXkZ+F_M==bZ6q%|C!%*Ho}Au2#<#N zhy7LHVk0a`{um*82@y{OI^u?jkBl7d6E-+iYZI~vfk^Vih|uSrne)fuwwPFN5T=&B z<%SA!Ee!cHci*ubjg9yrc~S%p5JG?mL4@!k#QZ<=$i*f^5CQlH=idb1JxbV@KH1b` z*#89Z-J4Hj<_73&*?}aFjie)xyuDjqL&{J13SfM*ZOE+idYb@GUG{77?PF5JZG{mo>@jV^=3YbW*uj&*eHGLi-DD zPPd-~51SxC^4dr~A`w!Fz}@puOuNKVH}Iqb4vHsYA+;e9;kV((J_LVsfsl)HC-@vz z*aXPj6FvHTNl?Jy%Z|;aEi*vBmTlQPXO%Flc0r4h3~%p zCBW!aLFEB=bvEIVBrK4$5<-L%f{YMr|M(wgTV7#{?@8 zgko0K$`8#}0ue@er#~~x&*E`F-Bd{nR5pTt+Lpzwdbics^67}+M~G~aps-=_80SNv zgr-k*W|okH!vFVqTaU< zyRa-pE0ipyV$}|UM$57)Rzm40mgV)Xted;R!^zX$%iEoG@nKneUx!A15|(!Iry8?O zl>Uv_0BO@^&5dke5F1Q~v}nn)0j)w=wsn}CWnJ5Zw{6#yRZ@}&d@&YZk>&9ZXe3Z< zWE4%Y(Ns)qTze;07SFOBSelDrn|G}LRwp*Wp6$#^*mhk|Vp0H`jE{A7qWr0DDXHCi zuxUM6`(C}9H(q~>g7EiPQ$}Vx)(OAqkN;;4U_nE0u0L_oWOg9WO~HMWGBvU} zK2YB-nrGQ*)0?t0%q(tG4$HP=b6F=T+iozM=U;!nFrJOfpDDp#<#{@kqQ=h3W0h=Q zC7V3Dppa(etZa7uWpbUAGa#q8)b?f9ASYe)Z`+wt%& z+r`pj@t?c*NH*Y>yNqXP{8*FNy)5h0Zu&m_i8H&t2W~L#V4mI2rf#3_z&2+OIE>E_ z@Q3L^_}LF`lozvXze95dJFtV<2|ZbMgHtl=F_${rj%9yhg?7nDwg(B4pFdJr4N%BqgzR$=g$S zHfZ~@7uc|xir{+8f^B}S=gRASJ9BI`Zj(K`!5=@M`UbmrAloREy2(e0^WBgQ%t!eEESa zyP#T++q_I*Z{5D*^-B+S82)q)TY^87gxz(zho`~t+WQnW_@61qK4AL|eu%$f+0H7R z@K`hzuS=F+WZ6gdvFu|B?(`B$$IfTjCoKDvRV{lq{yF>WU{)iigX|lGHjd%j$=P@BlmD3vxU-#Dstwhs_;6C6zV79voQID=F*5IjKe zJ&7j>zWZI?T4iw8*b)Iq(E`DJB#)i2Lj>m#+(?9If>#L+C-{ZnUE)6oP9(VepZ>%N z34fPruwb3IWcnHv7LpnSbdpz3>H|o;M&dL=(-8bd5`sv)N9qHJe-n=$OWrG6*UK2P;;1PlI1U3u4tgP5*xLUmLU z=1StNn^9wg)&)^0N>Wqkote@YfgL_Q!7O^16u1&$E`tx#hnI+IBauGI+#%Kyza&WfI9h5=!bdSc zn1FxHw}-4y{M*eGRfwx4;32}-oR7~fOU2puB7O_vB-TxgDFv;IUOV8KD{6-f6^M_+ z=io>2oPk(#V4xl?w!RjlG&!<(WS|60d!cNjn5vBTqm1zgMaNq39Twk@2izQ*s{e!2 z;t@begX%}8G#q!HV>XYvNLXZv=eYveL(xQp#302(CSGnu+12%9T$Wj#g+~lCOaiKk z_K6B{qi|2qb%TnFyvrtp>N%X8K6nu2iyq7I9gxHq_u-#W1=7F!yt8FcR48)P&=eT! zOVPlXX+)A}Csy}lscb3k`gA4>P^(3?qEOV>EJ7Aj z3{qM=Mw^fzaVVqF-f-G{-+=El-_Anw^>brgwh?u~=NRbvC15GRy^Nn4J#&p);9ozf zJn^(H9^Bb6CC-=f;}JUxx8P4C#&hu#+KPK=bZCqlXQ?xwqCx~rHZnTS=8$PCzPt54 zGVdMB(M)S`?ph&@A?l;N$h)P^3I1N>GOVtuRp4gk~e=lejtJ z9*8?5ZV+FDp)JJu5$8#q8gXL8SQ4if%m8PHT>@nq#M)BZiDx99%$_N(OQvjr9C66R zu@Qqy92zn3#8DGRMFK-&S#f}JT&Dch?q2~4`O?2F;eU_f$6d#y*DqCE;K(>*ViTb# zY&R$*rRE@t;*3adrWBj;;gbS7gU4TFq2$QFqaI0-EC9333?`5fD@FNu{$U;;5EYP) zkQSc+_%BRM`vWo{UJ`0HQ;eck5-zGYOGw~Zd>GHzNHbnf8OKC;3YJkw?}1M$l+3~G zt`l2-1!R_(DMKuas9xfH+D?iaXr`QSsiqc5um0k4vrJF5GnOC_vSlbL9M5tm%2`}XQ7cfmhg`sZ13zbf zkJ$Q?@nfb)afc)$N{>Z}R7OuVPbnRWKZ!8l&NF|9jI}&AMfir)a%7;!aui-z)ImKe zm55PUDeaM17j6K&OoJ0BXZ#c>mqOmSbGso5uVrjO%$bO1^mt`SkO>ba63L7jM00pV z*E$&Sz39)PO1%^p1LINX#f0N(u=>dw$`l|u#p&Z)B9RF)(56>uXAG|vPu-gp0Eu*@DXm@z_K7(}uZd;>mO-AZ$^#r6$mpFr> z)At=~Em|n5+LgNQsUAjz7M<#{*xi=@Pw3!Jq6^UnxA+NQq~;PP$qWT zf5cAxpDJ7a8}S|k(-*XEhiOStwoAeVlDF%U-Kk>4G{Gjbkh%*(=aTS=cq!sPiH9Wh z6(rmvVF?NEhcmLgLA)i& zPbRb|p&3cIMZ&#Zx8~ldnW?qKCnWA5<;f)cBjFsODerc_Kk1mg21tG}3A0FiL&8xK zwl%t&ymlOe^Pd~?0f`($WC%jDlX{Z>8?KSM2NHgh@RWp+8J(k2om%T)@s&e2_g1;v z>H`REd%dn~-Opn*aJAq0l*&DBw!CU03y?6Ch=M>8{{2P$ByWxCHfL1(KYBlTeHUwKoWWx4|iS4m#5 zvS-btz%ZSyzK6&-q^^aOf0O)TA~O;B@#l(35iO3mH_U6Lt!{$InY(w)auaSVfaJl` z)9&|SlHB0l@B53Rmb=;H9wH0aHy&HWx*2Ts1|?lu;IEv3F zv;vX0yhqjC_^kY&Of!6yOWxtbdWg9@<*UmTExg#f>Yj0{+E!+17ghahm!bd5%O!cI zM0T=X3i4l6;08p_^~zsyV{&gdAayh(PVay7(XpHgoX^{k-#p=MWJ0$#xNf0=9w+fP zkw?k41ti~ht*-E1mm99IYNPwleFwY2)rF$n7rN?fbt9XHENbPn9dAFdpilSxRjxql zEr?vZXF5|gtqGR#u7@;VvER)`-wa=$DVa3_=P@_b*ASV7)E$v}86uk#xob*}--2I# z^gw7FQa47bYya^?PC(>mQrAW5g2wN1D@nbhhVIuatgAu?Ijb)8(`2h4FW-85sRhfL zB`eDE3$^e%Vnm1gjM`Q=Lh`5gMytQJZfUUPv6DRK+Q)A@zVtKL>W+xqLS$r8r+DR+ zS^DCkV3UbR6i}YS?Ova(f`NIK%kRdy!?*dpK8-l;Zp+{QM~<-kTaF-&5v2btwE%t!d=w1hE3#|E(|$U}U(%Rnq)d|lQN0YoGl6taa0tz`kn&6m8oxv> zX@+*NV-Qcb3S}5Zj<4IA7TGE2Fj^7H^KHWUwlvSTi(qJ}GF$|aG_7U$s1^)wM~fTt zbacH!5#NCi)zKYkMlR|kPw3nQlly!kos`VeUAxgDWeS}t#g|qxyl3|yyB=vBaEp5O z>e)M;rc+(|^yT}RGI$43&rDCcQ~yR;od*m|!EF+CXcPLKj;EPupMf;Z4;risNY?QZ z7&4R|N)H?s*H$!OI4ufgM$jYWOtxs0gce$Lpy>`g?ZDt(Vem6b@Eayz^cZHuSUY+g z%?FQfOQ$AIm>4~2@)SCB>NI}XbY_M_TbgFt^CH?jjNzFav7G79o91)Hd9*0EbGkUa z1w+$4>0k#YphdbAUsprtXLqLYmDLh{CM{wZ@hsnDEM734B0F*YW6C?vX2L~tWZ#QM zilUkLBAyY?RnqftSJU(9V)=re>d+E8o*BU}Tom4(&d@EEEm>+;x@@^z!b@hXh#w~E zxf0h*tzuR){F*WmBU)R|&_fwUE01IP)9X@jpRK1i&>YR%NoY>GQS8Et@e|Mtk0%SW zNyMjn)0@i}E-PgV?gTlaw~Fk_evr^Ed?$JvP5+47vAr!LVrWlVO!GU&FBV}~&8PDc zMuhtdUuEdd4xM-LBWZp&!*QYx49^eT1N`1}#!m_okw`R*5%DAKXkN09?l7rYG9N9c z*LK*ib2>mf91NxDL%K4C5s41dKhdE_JZXC1&-^dLCQ0%R9;JCHZCMyxp~KzMYk&h? ziF;Edk7P*Pakz>r14VE3rlM*hK63^nF06-MIv64EaG|Q@|CMD_)L5+ z9`}44XUB*c+Kz79Awx9c8eJ}>ueTI6#m;5JQWZwoEQB zwqx${az@@kL`N%<@xdV6HJzDc-huXK?%|VbMG@(@Y0*)hyZ@kmqR7P$MUQB{f1FtS zSORnbGf_SaFRn?}fJzLf*hO_cZw_w8@rX*^#u z(T7D$9m6kGE_{P$TnD_*(OWzl8U8oNckji#Of>pv?uSHXsA3__{Fuv3;zcPRnPrzn zyvVLIBbEer;6j4+02D;6i{P2`dO-B>$ zo}gF~Xb^NrP#*~-2>Kvpf!TxiI*qno1hNj z1+mxoZ%!z=xgaGYQSUYWdlZlA|IG>IVlwpcR?ZoPOhehpxe>dTCBo(txPoq>I=5z84AB zx)4!Rd{-Z-W>82$UAUF+C_?G-4LHBhuEv{-zML?#j!W*w7YY+C*V9F<23ZZV=Urzei_xQk~z#IvW$NBL^#XLlz%VN%HxDV^5*1LVt(6w;|ORI8@bg_8aM}Zf*5e zriyQS%E;wqhorl#(iu6IvXHV6G^08MvjKjzVOXURonJRqWE#EXk#N?CPT?z-#lGa* zCdY9byZR|;v@nY+uq(D2>?-k9ys5Jn;^$<`&R^lI7r3fgL%ho(i-DtOh4k}|QSr(W z7sqI8%fuRKQ$8-wK;>oo&n;eyXufhoVN`yZQ(a8%r$w8Ci+<~2K5x+9y1+$=9qzSI z0Lz_K|J*M)-ii_uW$3&z*2&0O?Qkln!7Ao%1at5%#yZAs&^!OAb-V>n1xdg&lsjcl6W@f-TrgmJ z5Z6cScNV9Snp2{(!qLaYa3xz57-A7;Rf?qEvGHfE4s^Cb)P}1>Em25_)!g>6F*`31 z8=#Q$Z^QB3FB-Yd;~P78hF>&h(J^wXF~o|>O5TL$1Wk=z2hnu;J)@x{3TL6Vw5~(v zd1hot5{!4eb|J-mZ1|j%5KZ1^PLnh!QS4wfqq_sQo;Alg(A-&L(&-lScD9f@n55?y zQs?XZZscTH1CezX-pVK;uO)XOX|R*j@z=n#&R+2y#h4$jw~$H7lmw-$-ah)RBx{dY zMPe=MjcNUh*fG3>D_P|!_FpU)IqBal*ME=V>#P;oST5&6Oez|rW-+EkO=iFZBf4(3 z!z3;yb`>~Bh2m*%l!qv{_ro!%i8-u#hK|R&iUINs99F|}Srev-MFz~Aa+VM&PVzpAAy9(Jr^1mZf-KDYj4e7BofCm@#BCFc(K3%cxgQ zSV}PBgHmLSHzWL_c!L8bTQTt}vN)IlmEwN&Lxsr1o8$H3dM43~@RmW!I+5}j)-T%C z&yG*H)wn{!wpk6C8^o89f&OO>QMS!Ni034^yRVthI$#@80l!5M??qf8@nXc$5(i8i za)UQ>Fx6$)0TFnK-z0Jc@w>#25*I~WAaQBL#S!9#xG3Vs@jU+`Q|8kAr|Wz6Jd)du91)$^64nEH^Nt`pK1saoB_Y1@Ov{)OAR?xrqobB zlTBi04lx$JjDKv#(3D<{8`M~AkV(-j+}tF@EB!LeMzNXVcn1OLc~zkdFB0T|o0%SY z4AEGHZGwave24luJqsv~g3TFHzZko9c(vBIpd;la#?vfPfgCwXhT;&~DyMk^XRJJe zA1j*oEW*pd2L+1poHxt>6qt|V7Exw7lJ-ZG2pNh{7pW+Q1!)FC1BG&&uV4Qdj);QJ zxSwXx$Y_veMI2XcY$K~O~2D7M8`jlLSFfpneOjq zGN^EWl;=5^wNVuA3C=H8%;yP)e0;QPJ{4uG^~BxgoP+(5VKqKx%H;uxu&yHYDm{pJ zPqQ=N$LpDQn)ejrQN$gMa3|EOL-|Q8wv7fX3|;20NJT5DsCwZ?CN)S4vBI67OdCDS zldusq^RrMbYsAgSH>L`a`Lu?{cfzWv@r(;C&A?lON+Z!NJV5!B3?mv3HRo|`JHBwe zW{c94tiiw;tcc350|Bco*a(!3QEnZRpxod!6((e)VH@64DLDY#{Coz7?7BFug#do zFh8fCHF>JmmL_ZZIg=W?*8@m8Ct2RSY{!haecm=c1kN6R*kq3f>@1_bcDHH-53+m1 zuv6|}7<2ZIubaF;6>1jEYORNf(JR|McJ>1a9%r}R2C&&$R; z5!hcjsL27xCY}&kF|fyhXWro8ru)=1&jSb&5Bm9w2zI+eUBJsF+ws0gB%Nu?hxv+V zUtg%2m$rQNYfrdfE$m&I=?!t+PrEL9h4(3G*km>I{QILlFL}Z2ec|dMKk6aO#F>7N z_kt(C^m2_p=V#-Y7Tos!eSEYlG@G<=-Py)IU_W5#-MVZ~NItV!`rBJiSo%e`=W%~; z_)usl+j8Cj<`J5CH$HjUc-nETCx7*6>j^_A?3lLYF5VX`b?cm-BRnBuM{$$cqrJeh zG`rgSv=^NDea4&HM|>bS?s1`gdmmWc`}>qbT|I64tC0O;2z(%AAY{Lj(5uZ|cHH)W zQC-K)d?azTDLX{^IMQVHmb=gOHvW?Mj0d?I<-RE%P~EwDT&u_K@auDZyWA{y+x`)# z$Ayj`{9SGPdU-?0w*$TW!KY79X89{m+x{?Z@0MD(Zo>O{{JP}%Z#}%AvHDb(?J_sG z{@QKCsO#ywi!ya3(%qpi;b0}M(*7dnk|g^_l1`W=b)fcvtOli!pX zVBeKa`Io180JbZCzpgjgSnQ+mwC#_gezMkuY2g7uFFH>B1^4rYu%z-%U)>?8)vDCQ z5ALvFi7uS^;$cf)ewDCo%g)oT;FuOUdbphzOnBX_k$e-LZ*<=~hYopznY+f%h%-QK zf$ItWx&f%Tz?=(s-kqKjx^keu4_wcgXTRx|9$L*Pp6k=b04@#-y!^Zy*|G-Wisybg zaN8ZGzY#Wn8|VwpYXTFNKlg*wkMDxcIC-W0rHZTgOBOmA0M_|6dQ*4Z1{H@dlU zRGt^u-QGLDyjTxEZYT}=ev}8uMn2A+QLTk-WBZjXraa)%fV|V=&7Sb`r<9hOSXgxDU+wsnL?gkGx^m*`MJwwqH@ctRc*2Rh$9pu!^T^n8L;9*nPZ*q# zo$)rr2foa`)}q-DzL2C!>p$%WFWdfpT^~C%i`i>{fzt;**>uMZRz&-re7MX5ZXNu3 zBOl-2nrnLf{U6>ya=@uY?|yL|q=(`Y+C9y#c-Z!H>-J((=-lN#Ao=Tk$+k#u*pl;; zdfbl&pjZ4jbRo76MAuj>tzLT>j|AMvD$VXyd2>$rp2`z4a`pK8mo4)dawh6<^ zw)=WQe6#L5ucmpxqVgHdwzO&tyZftGb}Dd%P6Lldgmv}6`-7x#W-A`I>Bon-uEX}e zVZS1xtC9V_jxBH9)UeG5MvgZosJb+Pyls^(seLu@ur^>%n;^Uo*Y4o3^Ly}qJN=-~ zl65-UHp*l_rDlKZ>=SoO2YY5VR?XYs3meyb?`}=?w(;tX%$|e0$LL^M{Y_QisH2a#+=o5o7~l4+y76hKRbNUYAjiseug`zF+Z%o@-|v40mywWi5VGIby{|EOIY;rnjbD5IxvxuO7~J(}No`ak z_%+Gr;sswljEr1ATG zrFytfa^UPyJl`G5MvrLS(E!{0??lZQZGd58mOh=l3)}yTKd?oD4|GmejjVX@1-;z= zKg!-auBoMK8=jqHhXev95Fqq~1PDb11Z=276Hrh<5L8r9R8Umx*b_hmMMcHlz>XCa zJ1QV{RP5aY9=oTY;!%&~eAmW<_jAAR^ZxPqbFrqZS+izMpFLUAZp52y_%62YhW@}g zCC$$oQ2Nltj=Fz#QvA6N^WN5yW_wAsD^EpaG&)fEtaagkT!)^|&)pa-a->^(9BVff z+0V2W z_q67noamp9qr0r`3HyTonl)`&=%CyY?nEs%g+{J^pr)o}trnent)UTFGj2pffA1Hr zTi-gt@uywFgtTS*mSMb~;=a0{_ZSUT*4=4;?reBj=T__Qo=3lH*-N#2pDg%1Y|WR}wp2VlYHJh5nU?QR<};6~ z{~qf|TkJ*^FaCDt3g-Wo?|%8;#b3t#>P$zi>U`R%N=g4AJ|hoZR#Ji65yRCTRW#}3 zIYIF!*mHUPqIg@f2Kw@=55I}|>7|2EIYdQ24ca@bF3g7R)_*X{or3SJiGAGFTH8H_O~tFn$+g{>6ebwzUJ|#>yeh!>a=HPldkque*f*X z%vxKz{=%`bbh+x^U%kUFkK{xZYi~ydtN#&unW=x;-});eyiabmGwpxXIBivf1-)Y2 zJJHJDjp_zkt6q3xF1?VGjA zl5QH`|Bka#LwE2$l!?rtw}0)Sl?^+wwxm!=FYlgq*K3T5o;tR4QIXV!UOnY=J-xLv zy}o5p$Axl?=d05S3eR9&cVYCXu_X?4<#zkGL#iF=+FEl}GK2B`-+L0T)T4P0t5tM% zuaRBu;pbshy-xSNeFpvG8t>VyCyrD#`urj-&K+CqVfj6X4DY)^MJMp9CzKR9Q{PU` z*RGGmIwSjdX4k1MG_~wum2#Io?bY`|^~k06)MCRa*TUWQ^qkbQ%eszAy0G0F=6*En zn2wwld5Nc?Rb|HSkFEHR{kxW*LAHFKzc|>gcSNp|M!&P|`ZUmyro5=pcXd(!G*Qs{ zbf@jFOdWsPA^otE_x!$%hE|R`z3z9cZ|-}KJ{cEdhwrfC*9`CELg!rWRJLxe4c&A` z{>P>cwmxh$38gI<8yXi>V8K_&yLRzSkUB5_2!d1ZRe|~rZnuYReU9Fxqnif zru)NbfFr$l>igo$4mLFPbOTfO*@3p0A$IuYds~9>e#WS7SDu`6peKr-CAF``&*}cP z-*(gPx12#fN*dB{{-Y^hupX~DKKSEDCwhNj6#*wAXv<&bQkM{Tyj+*|J^>)9h#uo%`qRMw*{i8J?H4zTEYVBQ0cVH@|uBKmmQmdc68yr=+bu$U2?zO zicVdf=|bbv{!=ntXu*1)`+Ya7f7*4-`Zj?C>D07OivK*D^RUC2sE#S_r=kNcC&(7> zcBGc0&*%L)LPNzRr%aFTgM5mUlegVa(lh5jISzGnr1RVgDm-fK>0WpH4#AE1xkGm6 zkArPpXzry+le!F2(eE8L*Qv3d>bB<9Zzr5E{`L5+)zZPvRK$Pjc)VUi<=+}-eOu{B z*BATtOY*X&%S~(9dufie^#-M8q?eK=1X|tc{!B$pw*|i?Utu?JO6u7TQTWyTzxE0h zcO#DUhh52%qQK_^anf?VfUL1o(-u3uE%xF@ z9h&oaS(6>L8>tS;Hn*b(JKhhBK|2ZQI{Dn~6i0fh)L`N6V=CHmpCcynW@!9)%}+ad z!|iNhwk6{p17mk%TaMemUta9!m%r{$ml~t}KXe}UVwpAF+tF~=)Eka8b+$iTdoJN|6FD8?q!{t{x}MR5staXd@4fKG&tkxvcW|zbaM9(9?VBAZTXq+%cwoK z7D-^QIIqLrt0R;&mY;rzRV#nm!|R*9&-BJ@%*XBeEIn|*mf8e-9YjZCpZc%8=bHU% z=0){&qUX!&Udpels7jiJ&wu7&u^T#uBK+Ez8kbc zJ3lnHvsH()jBR<3o@xr{lXUjmJiq}9;B+~Z(IN*8Ew@shKeN`E?ml|Dt=~vH`p4Xn1qS9Cs?vC03$Mk`rH8oYw&G=O1%^J>ZmzzP+=3=&n5~>iXw>cja&;Z7QB;xqXzHHb|Nx)4$_q-@e_; z`J**-+~T;@*mXEBvK*Uy)7+kBdY`VJl4wo8zll&@I-;WOub*lx8sSKtZfC@ww8efi z<>bu4AJmkoob-6aL)e#H*LO?<#+Mh~4z5x6m9*8MsIIen+tY$!@k#aId;W3|vkCju z;KzS{3caSKHMXrfq&;$^Cm*he(xd%%kDW2a_OK&ux!2^np!T0XeVyo?RLAY!15`Aq z@AHjeIIoD9RlQ(^y(677>)nSywKH8AX5>GN???xPsr#9UDuKRM7#M=N}-(zWzRpN;%e^X=%Pw?uDZrldt}HhMjU zes&*zE?IO0E)sOFTaO&07TH0b}qkm5R$LJXvy3nn$lfySP zbw4$4szsg-rt>1k70du>Lr_#>g7z=#TGkgJY0U-4=wW<8t1+o{p+G*hBIuFAB0^~m<; zvl1IU`p9D#*mYfH^y^jVrRBb0XWMVHvSDwt#hA#zKX=af_!#q?*PeC#om?ml$r*pK zQbkivAMz?Nwx$&WzED&2-BYpC8U6qu*{H%LeE0LmDwZ~lEGYryn#nnSftKkc%{zUtgGYM7FqT+z^7 zH3|FDiSM7-Dc$H^)x(TdPIk20CAH6fTPHdw=Jn=FgJ6I5Uo$0NFZKP<`kRJ6Dt8@q z-rJEr6P)00R;lTZ=eN7<4Ny||rREG0}f9+7~V)WgkbxJz*^uf|u zH7c4hXjYXb!iuiA@Hj#cqN3N9DzlkAYC5cat^CXk6_s>3C?>m9n9ut!?}2>}%loIo zDMvvY_eR^DUy5^s*{!T!)ZmE=lN8_tr z21vG9Q@?lpwLO0^r@f!<+*SLZd(oVQ8dwceRpsR0~Y}YBV&+?ef4! zd#veM-_q)0oEI3&%Gu?)_B8FCV)qQ}iw0FH|Nd>KirVh$|B!UGqq_HhRRnt5(`{XL zofu?-^OCMdH13NvwAUbmw~rsFem={!2a8x1dNIj#>-%`AC2cWlF<|h!%t<(>**oa$ zAMgIw(3|~i9j26G-kkg1Z%nR+wko~7XXa%MZ80OW&0GAUG}?~ty>iy4Z+|B`ZrR?A zZ~EB$w1eGh#EEmWFm9-SY5lbk-xJ0rIo&mS<4QAaX!Yuujz8ZW`2B8pWeQPKo6I?9 zyfZYkvFM)ldi4LZR$rpB@2hC%QKw{OhtS?T1wDIbsG{~UPAQs!&eUqthvEHKI?#2_ zjc2ChYJa|~VHnlBcCeWpz1%t9`yK2z&-}I~OZ(J;2L5Y5d*;H#)qP$&($VVhJnsn2 zPje$hODu$sxY9lTUB_3rJJH1vu4f!D4t_QtKX_aljBDHP)l9zTNW029b$*KP77K%O zX6SLAGS=u-llE6fx^ef#+i^FQRM~ISqHxT=E$$I%Z2ho9LlBpHBA+N)n z=^;Op%16uWX@|Pflit{$=h{W=KDSX#@BL*k%?tBnO^o zw{?0}s-y=l?)W-b+1HSfi+2_;S)`^Jj$YbRE>3jrn!U=D&6uyU+x*>YtCHSrC^b6atD&EjJD2sG zr^P4!|keDJT`?WAxc#pNyz_&(6p_v!GFu4TpYO%<{Ol+qF`0%8r`4t3^D{bg#u)U7(@cuF61I?Il4H?^+sU?DtR?WYX!k%Ai(Vzv4r6pd=tz z*4B{R^#F0a^WS;Ba+ z^QzSSVwZK9@5I`YJnxG}n~R2Abltw$JIih2uIe7{dn$N6J@(fI_H2DfkYUv3=*#^^ zZBG=`Uus)fAuaGcEo~R*b=EdJ!uz7f>4C57D+iMHj z|DtOb*x^Y*P_K?Ku-mKC>s{(fvxu@A3p@W=X|~A!eO)%~^4G)c-d+Fx?R4*M-@o#s zD9^Yl*lKQBKvaOxPQwI>UCX6G#vPla!Lsm)HDa@9pU4mkuW^e56vO1Y?l$9YE++Of z1uy~Q9-ge zxmkBRa}pEo`s{2>gzqz0!96Nl7TYH}ZdqJ>^0MH*{YRgPiyt(T?VI3dr^-qgx;Som zzY!(NmiHgE@78VE7*(T1V(%KKJBjhv;w;T3pBQgBXzHtjmV;-0{$QCT5;)%#XUqC3 z%yR8=6Nac<4=IK&==hf+W$^;#y_By}eOC=zaZqn%#u=xLSv%?Zy%EK8a`RI;^Rwn# z*X8yfxnuX){-gHXdT*V+?}DGr=-CJFO}6QECtt}MxyoGalRVAx)F=7ct=pf>^EmYK$wZ$MqM-%eSHgxa@Ozv$ zbYUm^edejTJ)uV)Ghp!oPQv71@xQiWKY$o1Ld$BI_ zdFhMwGyZz@VuMcTrnSj7?Z3TbuH!tqao*oGH5>o&ycoP`VOPVn&Ac+ztIb7yN50y! za`=u{Th~s$xM16cEbATHVKKH(=~nM?Zae(8?0CK7&wclI?A%+uI(gUrn0D^F58j{V zzUS!cW9~LCjTgJ`J^9@*y{y`#XZpUg_VdMdjB?Gc{g=Eu2OhZ6)o672^yiO`j=tDjhJj?O7o)onIt!uhS6Xg@wcH?UxvJ3elfXaOFoBSYlQjSN&Ad3ZDS(muJgjNC z+|hDjt>vcg=s4MErB}+Hx(tq^KMA=FcJJ# zTQJ@ym=GAkC35CEOa#YpCW3E9yXGYOS4ssraS4PWmUT(Slw?U$7C8Fc7ix6ZVItVv zz(rJGD#?z~2AAQU*+ktoQbh<=YW0E2%3@MI0(Ve*R9Xmi26;poMurDBn+S%vVV@w} zh>j)}I>x|Dx?l(y`ol!luyP35VkQZlAgK1l&*+;?1PAySQj;3aL~vMerdHo&X%ou*szb1mKq>J$z`ni!&`Ci&keY1&R(`FOF#!1ARhOo@PqnWhN_Tr-Tj?F^#?gd_p}2Bg{&(%Xf*O-jgg{MiJ&8(g^3 z*C4@Hk4#t{BBa+pe6j>#$8RY~J0W-5l#rA;Xe4kzJTijC?a+;cbcTD79U-^g1d|XO zLMDP&1^B`UE9r}TMj$>}A4XIoY>5@(jwSGkP%w~meP9gB6ND%c|5wKdVgx)6ew!DV zBjAPzcn-JO+6yUc$0vWl?*<5Y30oY%tHEpc6d^H$I}YFgSjB5aLXamcsgYMb3E9BHhCfY7av~(+QE!;gikR2^n~rA+O8`2?w2X zoFVCL0No*NG}1bDBe*n+as@;YJ!CineZ<3WiQa`G6R3(n#pD;UD@jJW5b)?U$`qzE zV6q7As|YgzMqejkfIdh+#a2o#oaPgVL0rJV67f$2LgEKp3>}QJ9YkLG_9ErM_GV{+4we{sDbYR zTu}c|4>^MZCIXKHzm33Y$oGK09kDBi1q=B70rOD7*(fMR80@BO$r#Y?1;cY0PQ)3y zj76GJh?9zhr0o_FDXmT+-J_gH5#kmh{5&7JL7F`&C?CXa^8j1CKtdKGYy=vGGidfF zGUT~EY*L}(eBj@QhTAdJiu{4JRnt94M}+09pDxmeHD^$xIITsA^m{wK9P}hU_;1t z1bAM&A4!0)*(k%>Gbj-LHz0f`U>nN5yDcG+a36>KC zBQf;U$CGp`=|tA9H6m{=@yIabf9t-0yaKN>2;zuA<}eyvn=L38W<4$Pil2=(UhYpu zc18a}{T6`V<{k{Os4?Y?i;+{{yA5=4Z5ZN(KA;3s>i`RKY=w&0#X=wGXeZHmKlf=* zMi`+TA|sg{qw#HlU(iiRZuAh4NJG@wYMAv2 zg1nHgJu<2L=0cW)67t1cMj#@2h>6b;I0bRuDC^r+&^a1xVm|tw>uAD^jwW4D22(Uv z24m)ukgggrMn@HodS;CgvB-%x{|g&tIbm zxJeZjsPGRznEW3;1UwTrJrzJ-oH;G=Y{C=45(Z`XtcfzL7za~AW5W*G#$qOiC$kRI zdX_MA3@zFuoi8q_6q?vcGC$SnsGi4q>qwL`I9upw?UP!U6r3y6SQjaho&@WK!YChY zVc;1s=bG4b_HNWh6^CXEyIT8b8#gh9ynq~u zDyHVVOk=ggM_WfPm^w$Um8T}vi;H-yb?{>EIX#vM=`KX+=n{9<8oxwT@|W}amHXVS z-V&g1!&+yiHEv;6@~o=!tb(=%V1Z?r;@PJ@g74FQNJ`l0O#yu0QKE-QH_k@pw$HGZ z=G{eUd{|n%i~OcXE+# z3J@}Sfw5a*NkBF)$I$9xRDBdbIA89YT9_Qo@4f)qsNYWYp{&w3RazRL=UHiFTF+8u zOONFqiPc5neX=9hT2H)Kk0{}WOr4vwM{KrmledpDq&Sx0ZMBx4&)5;bk2N-wYU`BU z-Qsp8931~)2eT_-|L|d{g(b{x;lXs@)TnxkJ;I|Ce}8gor*7|HRwolV?+VBkTII^z zhr=N;#^ayMRjc+(SZj}=w~PDb3XQEb<8Ifla!I|m*&M|Q$WAl%mZwHll7qZk)(N8; z-A?d8{P;X@W8+bdf_qu1B3R>%35HljPX%dWwFj)@HLu zp(-d_;?_=jzHG^`o-5iW56^RLcRIqGO}$-y@Au)twcV_r-b_o{woT}7)RbO-0JUN~ zYdEoveOYH?44LssCwddR&@pny#I$T-#2PG($dB2#6vy1yC zFS}n{wQ{GibxNx4AnjXZT<&-GzHXF$&mbe8)W%!nZkd&#{CrfgKB4zeo5I$k{_?ml zOuMz`Oi>B*0BQk4i~iZdF~3x|md5{)cx;l*-4mmV1Narj))ga{9$xVHMDeG;%nPf= zW}jk-r6^Gul`YINHdj2Fcur*Y+LG9*B@{N3=DvnV8*#)gSjwx*L zdU~EU3>#BdT=`Vk-dnD%D`tlAmrYG*Q-`K-$+%b2m0cZ!3N9OWX#cXdYC^VfgIG@N zj_F>;C0Q4Yp~uQ!#cew$O(lX!*^<&YvxLi?pw-<2M`-KneShQaGx8}MnB-R_F;2DI z{)lY(oo8iTRI%VV8i3IH>FpE81DMArzWFu&zM^m&&&t@}_mgo2&1f(-EEfUg;zENjjgQeqkn0q2C7h0n$xC`e=k>_9Hb&R{|V` zAvqTLaHIAwpzDP&kT!33?BU0(LY`xa<(39-5bg~@G-i+q?sfnqB@>V*w?xA0K4dBQ zfi>|$x>ta0;M*R4tQLt}`D3Xy7=8qkiGVl|Zv|EWuv#D&AlxV9F%0fDfB*oe)dfh; zZHLAKtU0-`#Q7cNRl$D*dcBGGGjMkWhRVoyD9{RSZfRKzD1}_Ffbp}_=4F=;+$n(R z;N_tFv25k`ksb)k18~cQkpOO)aThX1wkQLxsYiH_XD1y0YElA+*l2eBK-Lk zH20vJF!(pak6D>yfPM(@dhoDCUh#-`g}(#R&V_vM;64d=Brvz_b%IRGLE8xI1e^z+ z2N36ube-Yu39LpsBcv(d_yBxRz!AU>fI}P&FjNkkl34D--yXca0g~W8fjqb+s2IE# z0PhEO23-WO5Ih^<_D5oF%d`t_bI@~35pU4$1U?Gf3$*{h{Sa~7vJ|V7=B4&$=KDRcwPjJA+QO;+z@{nU;%$2 za5&;F18)ZmMVJmW!-1`lwl%_z0TuzCqw|;{j@!0+ps@J}qkUqGs6)EN zpuK|luAmd30byt&O99-{`6O@@;5^_H-~}KMbuts><)ID!0Y3$Nfgd{dpgmj^Zt3~)+Fy9UTX1F{!Vo=sE%6PN@G$ zz;+1hjDB4UIR+taI&^6X`M1NJjdCX-9y?KDj{GG6BgB;>Y*9OGm5@Fa?ofo^Lq2M_ z2LXZsgl;kLm0xV+FGM>}E;fqNI?tANvyz75>mqG&DpGDX_Q@TWo7T~Ib`SO2e9kp*0% zQ3$wH+;;UpJ_P*#xiW|NpIsb1tQQi+TA z1*+WTL(bdHRmKE3&hw}aQ!lL3pHmm^lIClcM#bbit)NMKzI#&4dC{uWm@4P~%?}{& zB0aPlrNw8oKdxNtQiiz&Z{Kg|zI#{wMegn6o^r?9KqKqsw~txR!uf5EH|`H?YyRn- zk!)g(H_vmtKwax;Chb$;b*?rmLVm%2W36|s&*|)TS80?UZy&2K``nB@P%XNh7S8GWh@>tm%R4p;NkXFA~R<0~Cs&L~`nXOD*lb^fD*f3@9P z|LewrceO#iyHwphP;Kb-<9>#jkWs&^>fPLg(|)m#Z8TXjPn5^ zr_F`NM!PGcSmTa@0Jc?t{F>S{Qd3|lk4w20q8PUMT6amtO_|`wb&cQ4s@u6g^fC=U zQENqOh||A<<|{;Vk={MN{`5|_4ItCiiq%j6PqC+=Fd~4SHjI=t6t(LeA~Ot} zol4`XIxh-#x)mE6H|$p2)TBwFY(L|wg1*wH`^@75C&lUG<7S2!$jWsGdnOE7aLc&g zFLhDN`yE_6$3l?SP?*zy)VIpM1ICYEcRljF3Kh(}){_l~);(;99jflY-3f6D z(5EaFhx8jZJz?^_P92hTR*PP2{Y&A$N$@jBP+p=o1^~lmv zi!&p49ejS@DXKy^AU))Q--Yz@dr@mf2R__-%MjN@2C&CpRSjU>o1Q-y`%W>Z&>}dN zNHVGp7FAkw6ScP;cjnPPp2=Cexx(=mWF@vC?(+S%6Wo2`nSkRR+FzJpPAvyoUbpkJ zn`9@8UN>n`Y=)in-C^6-jWAEQG@4>wb93F4UuMcLnbg}!AKN`ya85V&X+ zE1R#F7{2*dxxSO5l!;-ZC*HJ|eXVE`S^sh3h2@O57Ywe=SR)7=>>l_sI$-9oyP!Ci!DB9 zH;e>a%C(*RvSDtp?g)>sdcp*-QknE&n&aelj`^GF>ISg`inI&!UHWdhW~kko8sz1+ zr$hht9)~{7pWoJ0EiZ7d(f(Snr^8T(1zT^0S$a&no2gznEpz!McgL4Ueih`(qZku| zU7j@-)9VXmZ9g=I8Z7!6VAgw))wJMP{h~Dw->M5c3tTlayWM5K6b1)IZCFo za?EfY5%1!GRR?C06PU3J5Pk!z1U2v!tZuj|!5eTIj(p5SC2(UhCly%f372E+%^QJBciAo*!V(inrVP6*=`9rFQ@zIg+A1o87wq}T8l zAT8EVHx=Mdh>3L;9w7L!fN3TEMbmr=!tG#cjiZwO0mdSRWP$NqC`^d*Oh%%W zty47n5#|VHaYVdQaF!8!3amup3Q-YCMWw4zz_G@XyJe7UAS!A!m;f~|_l5w+paJ@U znHO?CZir3LFT^)~co?5JMnB(RzBq&FwjY z;U8t@bczj&`T{=tL46ZJ7Rbj2w4N%7KUQlj6#W9x9!POVm6HJlq<~3xP;wi@CKT^1 z!u;SK&U4MvG$7-@kvy4*D+I^*;wCBh5?`i92kC~x$t|toLC_Ik4mY>0-j48{X5mr9 zKqYA$fQX@Jv0uTGTYJ4i7a0R>Oot?>U$PAGS0If8!v2Pzv#RzHihBun5ybfe=?suA z2-+?JHbsGkA&y(OEmoxvBXRons}SauGuD7myf^4OdZXbWejwlww?+kh2f$b3 z(9&jjW&^mbpA}f8!+i-$>~z$aJN!rBUk|Y@;jUV6SF;ohK#J{Dnp~TYz%OW?*WF2o zP8ow9coSOanOviUK>1LDHA(xbX@ZI-Ac-MAylmn{q`v?nKgcx!`Eaj!#K1iYvbbr) zW%37D6Zc|Vbs7+o0mxv3LH<|rPe4^Vc;-TJd->Q>WjEuRA(ICl-w9# zD=-qK#cHY%QUwmT<@ptw1EAzifj(KeZcpWIMR3O}*C7Fg3f7|V_$bMJ#hydSHGK`T zsw0l0Uy?Q|jcQ^P66Xl(^R7y9Y2n%;tcp|v@1b{nD8LzUHLX+RbX%T`o)~>ZFxyVR>=J*6m zs-dxVApR9{)-!48a&CXNnV;5}XA7}jL6nn-Ee9pHd6@t|w^djVqC`l2UQ?<4vDLfJ zT#$PDppY}5uS#d^sY=Qz@>m8*xb0>+aFaBxNqGt$ZUS>=j(C9cZx~3qt?QGjl@u}i zz@Y+Vuy^Ek@Zu)H+*YMN0*QfGE(#S9_LF8gBr!&vwPx~zC$3eaaYFE=U>*(8f{=F; zxI72Zc=HQ2#IvQ$)Tgh^N0X^2WttKr2V{JW(g!l763>26%XCEELVkj9 zaYg?UgFAUIb^RJZH6@^*3|TLbwDT*uIV%vg5QH2yfnh(4QKO-S7jSPu*6qOMBSYo{ zN2$S53F<$QNiyW>f=T=V&V9sb%Bl)MyrA?qpAqPS-09vsne@1U5keR3|xU?Ti;?IyPuM5XhZ_ z>_RiI(2GQv%uL#gJabhThA?qAAZmR;9TB@0r2GZjw(MCI!I3QwP;v(=-Ozf}@TyHM3PdI8 zK6<#h!_ZJ9m+)|lVzNo5i0jiI`QdAoH`+jJ$oH12*dK{Mfp`bJuTigaS|^eqYpJ1p zF9K6VuhKooqvcs5cRQ4ej@A)gRhTWDi@@1EKtqISl_q&&u)_dnk!aZ9At++RbplhS zG*J_Z@=ZsbwDwN>D$M{x+#^r}c5o+WDhna~8w9;bK4OcIX^_dU%E!1o zr85FoLF(BEF>*sI$2{TbiX{r;Dl(B9X=G@-Cy`=;#6lo0Df8scU@8$-1>uxcwrCin zGeb=4#Da8jT8f~-=t2cCG!cjd#>DiYxMZcMpOA#uN-H4BQT->WiaYHn4GxG>zC#VY zL+VYc^pcxI9zH`p46HY^;v6Y%A`l0Yn_@W<#bXL86Kg~$<9C3OQQCGAVDd>k5gkJc zxy~R_Au8+`%Akik6mFbhY`JUFWaP65Ex-@WQRR%8g5+;knu5hHaF;iTJdwAhHCi(8 z7T;HSO77G~47ERQ_!Ll}M5@nVf7;FUuBI3A;?BRK1f`885^>6Ma2bHe9tiV-E*68> z8W72Iou~|e0%0|eybG9N(kN1b`&>i~lDVb_Z$!Fzs4(suk{bf=w-VnCegY=kf!r3P zDTHV}4K2b9r5DlbTuol$Q6tx)h76Nfk>@zXLmwm)v~ec#X8G5G{b&f+T_Bdrxr;BW zO!Lpve2`g!Iu0tyL5c->PdReNmmkO9MDmM}udUD`*ih9dI7}>3B(~?FvIKxhf`qBl zYz3P*s3D87kch||Re7=x*9&^1*-6P3ZNLmV(iek0=((GM9l)*5WTluQMQ>zcs79N{ zc=*V?lt}NR(e+VnXENpBiKm>{43kA7fo&U$uM)u|UO3g?6!xkG|K#bQzHK}2?hSoa~~HDDj`Kg)*8 z1qRa6+N3o2?g7?8DObSJ!UZFM59Ws7g9T=-!hNKBAmT)mCXpO`yNJmaDs4c>29vu+ z9!M4nH|7B{vq2$%fVCo%3ZvxI0J&TN9zg<&MnicG$mUyE#2N+^N_#@6coT(~+dL$b zk{Wq60{mSsc&NgpMsWVRph@uD&_W}U=;14om^?KpX(Uheh1NP_Vwn7iTWghopSPhn zo!~YpibhN-#hRuGx`g$n!B; zJ+4oZdSuJjVnxS$RZfPO)U@K3Fx=^MI_i}B@|W5c!#xzoed*aCBg1wH30q0f0YXF@(oeE+^x%-tZLz(B7Lr54Zpq0WkeGe@;3M2}9sk0-~9mriBawP*KfO z=TzXo(0nj{G;fhnUE~g61t14>+=Mvo|9m1Rd$p9_D3&1TYx!or>7utiy z71$8GJ%J+u!GKkOE#Q*@a0bm4_$j~@{>8wL0fB%B05|UOA@?oR%UJjy0JzQO2;d~Z zG{mO>p9Ay)>;{Moek^ZQaC6_0b^`kXbIY#@sBZ4QK{%He{0k610P#8i_dR+P@LIq+ z7P>>8o#4I?;MyqQm;m&t$5bN=H4{R0tq*_S)dX?cHz zWf_(c;w1%b7WvtF3M?2i&?6TC-dAM>JcuO0lPHAFsW1fk$*i$^WEH(ewYPA9otKp-2$u)%VH8D6$vEkfAt z0(Z8nToP)=hDpMiF37J3+cQEE$rs^`lU}{S*`1B*9L$Wgf(Mhog}Qgz>Sr} z30O$gmu2JSa#kSViBP;B(g^G%f&`@P+)u*xVf#x20!Cma8DJnwRE^FP$lheJQeMIeyKC2d$M zfi3s?3(6w!WWBlz*b#2r<17ebLQ!?8Y0!YJ1nOr;B2?xE)prriHe*Mnj|P)5$QdDh z$4azvkg#|e#Z1P^Gf+aoxbaRb9(s{VIMw5+lL@`qiLAsIDHw@l5?7Ucwl~xv(N5;# z!A&xSac8`^mVp|{lzD+Z#E4{I|$mdW^ywbBb(07=*gQYn|cVj13o?h9FFitQp+P{jatXHUTq>ZM9wXF~H9sf;k})We~7lW~^;Me8M`y zsUMjNib`VyJ0wncu#shUGG>fxgu$Q=k{F2<;_&t<+9>PE?n?eU#Q?0^v%A?nVAWF~ zvDhnPywIj(Y$(${0!^n(##+hDEP~Pbp$fsi{mj%P^#OsI6RMkKe4X0+ffW&yV{~es zXUojYkC{c7|0dw(*}LLKnt*V7%#ALX8-U1O05>gS*dq6We@vMxFhq5MKO2DQp!qJr zMPN4opHVa|5n!0YSV#ug|CkGVQ7i`G?+Iu=DFf!_PmHt8a~;NaQinR z0TbhA^MU|T%@+u`kDVAhn^)4@gme|aO%UFI4v6DQ#eD?F7~MR7f5NPi2lpVvi2zs( zlMwLb=50I7DBS$c?V`ECnEP;@2?!p_E;AAJ17X>T> zbVFp?#mYc45$4L@Q3bcu* zka;`8XG1BofQ=z@Hh64-n>%-80C8}03kqb_d?9fW+>YRF0R;=d?+tp@Qp9Znv_(Ph zApQyBxlXYP?mWm93GYJW^#x@ag8Jt!2u?xRN6-X=m9qcUH$}Zqs@U#K^0-8eTk^5XU z817+!YVhBR3>)F*POZ|>_|JiMB51gSyjxsZ;O_%JccH`x?py_Qjsal<(pVt=AnNBZ z-2dx+e69igXR-AkAL#$L`}jINUu3FHNYVxH4O&SQI!|R*j#%y%R+d!H%avIBWq2kP zXB+SxXqYEa<>bjUJyv>V@InklZhga&_5}nQS(^5!(2<}ly+R^^A<3#riM4O)-6P3_ z$Jln%QqQDHU5>GEqM}fhY>;DNnyDzPJ3TkYfkr3_m8!f#Rq%L8VN}Xo89%g8bFYeu z^PD;=Dm;~{bA&Hksd$-0vh>bQYyI`6A@dliaI3AjL&3*O7+B$1xJe-4o1QQ7(($qchQgI$ zo)fzBtwsFnG^u#_Wy0rPfJo9^HsX&qe43$dSRgPH*4HqqfGnnCN55JxrM{OP-&A>C zrwqzs_-zL%boJFbJHGUf`g<^am+L=G`I}c%R;!%W+Q25Sq)KYXS7s?Z>*rR(y0O5D zFb!vwVj`(f#-1-^_;V!+PbITB-!k7%;rVOm;+&9zL5f0@OW$2+dqK?T1I5xs$`J3Q zB)+vUKp94o>2(di$jz$EN12@?6SlFcEYd6$;1g9kkKyGAdad)f@>ISw+a5KoR^r*X zF=u;p+puL>gb6edsRliKCEb|K^pPvWG8=*+{N`R(dHRbwfzW%2!qZcEYrd&aQW53E z@bYYhefN1oc&TW&9+73#pW>qWN@P&#F-i7=e0bi+6kmUL~`hnA=in=qp__kIjXE95q`1L2MP$wOp zv{G*=%?r>G$1tyY6gF&@U2?*9o`BwNqB<6w)jS>N`0boFxfM3j?Ggkx-&Il6zUl@b5`dmwJX( zFEo)$6nAe|Rcb{KH7j2auRlXXk5gtWt*avLRzgD^G2rDeq6RdV_SN_vW9q3VUJKXi zEln?8&=F>iKHao7T%jyk$cTiRFkSVVkUge+&DwTlOtlgJrE+th_DOd00!$w&k}CJC z>nt{X9PXJ!vs&}pDyXL?`i8hMP~l02RQd`#OB8u8&gpVA(oPeJs*2>uW<4F3p<${k zWKAhFkJ-4si{VFQ{Uw)xEP=Rv(+Qn)s6#igaEQV)!=NT_)AP1w%cy>PEwv*#@o?uB!gNSxk^Z@Qj?_vj zQQ(6-4HI=7lvk9Lw3)xeDbmn8!?Y%ZuT@FBNi9Cyxpv&{Qx+4LukcQ=CX7B_7|=S1 zz9hUXW`#2S#EiGRtqgyR#s`%l$TRi|P|(yQodkz;VTB!+^3X_W9e4cNybP3@%Oh~= zg5grcecNeX?P0+Djc4A(`>!7`agqNSF#qF2@FAx0AjV;Cd&=;?n=h}dU_uBbDJh$RY&ipBy~VvNqv!4gC?*Z~{H z60il0Wx$3VYt&f4*kUxn5~GPR_qPwsnbiP) zcf5Ovjn@nBN>Wz{7A9HzoZ8+`+u$yS(g0AhvG*k&${NTZh)RLX z8ockxBEUMh$>!MeKoipMh;Y2th0X57uAPTC*I>l=hwN?mMNn`Jv^PNPk7nrI1^fwj z1j1lW2)591P$VJP;W_62ZL9K z@E3@`2z(Ee4=Sk#(0>7RGAOEyS_wH~S5+Vm%n`vxe+f#ql0>2$m2g)>&kay1(tsMl z{)JN*H;~F64!0Q88*~Uz1Pp-xG2n$v!33gqz&#Xt2Ei>tS}Q@P0A!hIDQF798=)NL zvM{zt0qqBy=N|YOaGwGK0VDhy9Po@mZ=kKDqpq5vcN+4Gq6%|^Qs_ssq4JRS1jzM5 zS;xa)hj@2D4*)kI9}QZK@NGak+#5m1fYu{VUEoeby!ntD0ymj>{Ri>?hWks%OoD#| zDliM~Sn#$%mTcCKhkGQ@4E{`nBRbU$^cUzXK^$V=ksr(v@VY`DOjpVoWgz{*c*tnr zCyP~c5RnHZv+AFLHxkG|ImtLFPrvU?HsTArzkdL&f$$6!jC2Srf&ebj5)9)~gsBlW z6!aso1LzKaD?nx~BjIlaP|swqgD^RZ^%h}}7>|TM;3-!jY!X0LjtW3mBjE(N$ti(_ zkR1Se0U!&o3<~rZg~>xcc0$$!e2GGlfoxZ}86S1AsL6$;O%CKoMH(8Z>&c>hc$K#E>|k?;#U} zG{^v`9q0t`{gB`Hpj}b!$M}`BgS!}5j<^$0hQV-aklqrwiGlwQ+zXNJ4G8)n47NQr z5&js2t%jQnHr|5v1P-DB{0@H&>gpNN?*pA=hxR(8^)MM(y})9Gmm@3)VTtgQ zQyadBdlGIhgq=s3<{&;9l#WK2814X24s-)#%77KXEBG-+5l)nJMV>=Z&P>pH@R~sX zfUa+lpB;$X2f9jFbjGNwBDirMhOn@ZgFIY<{6*xCOgJ#m=?MAH;ogmQbQH7!yk3x* zhB)7W9szFy5Cr|#LFa-egF6&7AL(`g4F~QKKgxLz@t=bBfd6yU(?qm!8Pe6mzXkD6 z!My@$o`Rcf@97WZBCHDj=g^l7nuj=(ke>*o^8&nTw*wZVCul)DN4T$n zPbO&|0Ur==Ec~emt4ACT{x0~M=we-6|iVPrMr zJn}FKVdO->1w7Yaq}Lr~cn4lTpgqzcy{a0rli_^ohRz(aWMCTtek0s{k^fx8Bd1!< z!+!}h9Uv18WO;cn!s3AYh(8i^J7gGy?L^owKzHy8pvwRpflMR9+`%K8rCvc+3W&g) zio7m^dn(c+CxvFieHHR#A)1`bG(bKJy!AjP>SQhC$%5f!$ozotE2yg(kogMye-Qr} z_~g_L*>mBD{`@p5mcw&+fcn!R><#$%U?G(OnuI=p><2X=-eZJiLSG2t{ta0&xGzL{ zG^m*HkoOxv6<$2v$hQOd!=U3j;w1yA2s;jcKj`ZKB;#3=twwUxdnd>*hWwXEXB|)i zxiZMF0?k31x8W{;+5D2Z3eF+zp!5IeBuLtS+^6YRmeOEDRg`4gD*un~)9fFqj-rQ_=%Q3f zqb*S`Bd69!xsF*tN4t$H(d2V!W@A1%1QIQpva>$gW4feO=9$^ZS@C%yQ-RmKR&#;q zi>I}xWeeW4oc1{!iLQBoQ%040+DX!N%<5ZS7?u>tVT5wUo z+Q1s-|Gs0>w&RxanYKaOs~;4IcGT4m=rq3Wm2KzR#$dZH`){^pclo}#bRc!;d4pZR z5o5EQI{HBruW7K4h}WJf$*>PT6S&ttb-+|b*{O3QTtoEp}x0SxNY-Ii(}tEvQjSfefMzuvVMQJ zUj5qRC?|U~xxxUI_Z|tQmpY5Zg-6to~ zG`V-v^Q-FGf*5ZVyEx#LS(%{r*&m{a`%^g0ky?5sP}gVE6~9ik*RD9l)V(PU(45S* z#Alw5yz1HgR_@6`{hP~H4DS8%+R*rZ7G1qoxRuk-J}S`^?Ukpr>E$QQbs87AU+Ep+ zU1}a`Gwr1^(G=HRHSAbo-cnK0XLH0!BPQoHCiV9`j!Qbbyi_Ik&GWyJoVId;OSc{C z@{&eQ*>&=Noz(Da+}}7l^Rj>RXLIjH)%#~X+VbO=MN3<+yDDnU?BcQ6A6~jjBk9M{ zQj1NPTOXE7N*?*zZLZt6krztK$1T>n(CwDK$h;c9tjKg?{7hU4FnD=f*y?tDj7hgf zuKFy0#KbkzZpbIC|KhECdZlT+g0Fh7z3s7iWx&d~t?M5%Q=S%o<_Qq|8-T$=S zj;%Qv;K4;LL&&+i4zR>f}bsl4mP+m5d<9c|_xjtf^*W86vihl0x^?SVL-Tk6qsmFbb z>xL{FmA1XB>Rs(1s>f}0g!JXMSWbu#Lt*X#(NxEZE%Szl3 z>ere*t~h9S4|u zPogRJ%_Zv{;vTk-Y8MwB7IUg#bMG~N+x>E$$iMpH^BE({Vzn&a(Qq zbwyi)RhzdzUZcO8CSJR^kf!>5zJGiETDsch$0;)!MntZgc`Zl@5-c-69uk2OF>P^;n5!GK6_IlQ1^Qv}~$JPzSQ@;K7YZUw0pVyT&IBJ+3fiQ^Bde<>FP_=kXC;0r(l zECR80Z9o-T?Li>wzd> z91sH#gOt1wKL<*H5x@?>1DFOR0(h?qs|ewsc)trPcm;05LZD0%Q<` z_pWfO*8tD}Kn=jY7GBixpj`oC2#y7Y1JOV|;t}JBJON^GcY-q$Ca* z)BxT9F;4Zs7@!(>3j7M$A3$dUvw^Abr-OC_bbuGI02l-uK|04l7XhJ=I|xdQsLsd_ z5C0(G9QI!%?FrsO&^X{9gcZUc3ios1OQ02q08GGYU>0Ql03`zpBPcQSuYi&R6l4HD9{wiy z$rhyfpxsfPa?pW*6|jJx2Ko*t2JQiR#K{9437iGC0vhnNpb5Zta4$hTGC(4Ox&6Q# z@Gk;`!2cFh4&Ha5BwXjwv%T>xJHdUwodKwl&yyr{F0A)w7 zt;P`=+OSe$x6`j~rcSiV*`_S=OsQ_5C}>n&eEH>*=Ug>5Wo1u|RT1S9yX<(Y&qQ4M znpWL8aQxO2?u-{-5x1#XUo7>%HoLXv)cIVAp5JFQZkBj3(-=w5pYwI{t}_N?St2$? zc?M4$(7C$Fu&l_@%iP%*EH}t|NnLc+S5FNt>h0{(T&a&*CU^1*;v0SSLkjwOnHM~5 z-4wsL!-BsKw_bfvFX^AofB1!>jW$j;ET4Hhi9HlndM!BYUo>E_JUny6%`-(}dHx((UUVTPV9ZPX5>h9QQt>Y7H2834W zzI`al-lF-&);8;c zhV@R@B`@D}Jc#k?RWp*VP)Vd-ej1VL#Pv?eOn{_F^^jQ;y+^WcyXIHASg|kNuXX4S zu_S)c06xCLG*PxWiM?VSka999+vfX;t*LLUwvuG8!SSst0vJ_0yNvy{r2}2nOrG)i zgYH;|l6Oh+eER6~`fkihejVj9U`ejC&C^8I`siw|qB0SP>i9~RRlP!grRrTplP(3$F-KQMgi3pdzFGb@C{f<^YJyQbv!dN5 z#f{zi@}^&H57_uO>}!msUAFR}0a;J^`b3f1Zr`-Ut9X5ps#{~Ap0~)p@8I8S_Uohv zKjnH(%bslxqes^{8Ald=E-H?0=P)5)wlR1a+jF8b-`KH7YQDSVvEfW6_sn`w;&r}r zIz27hJ$g!eKPua?p-92HBy&xc{AwF~6{A9JGtAvTftTczbY0KRu{o3*JgfPvq+8sL zM=1q)>sQb9R@8lYrRA=KF`0F`67!{8MeE0@ts3=)!$T)jT&~OgT*l5m!Kc`~N;MQX z+W5t{mIT?a{eq#?$FJ897LByQI+E71p~OZ%GPyd&*CrQ>!c6VF2@NYHacQ0F3ceHP zE(m?IGTA(%KF7wu#OnCGrlSKV8ToQP%~Cn=!YnG*M|*|xo;ti8?{xcPXQW0%dHHMPGs=LXyD z%A!t|n9A~aw98dn!^lO=sN|g34N?!P02us)g=YczY0qLwxDtV9qVI8)yn+G${Mj+K6R|0 zd|>aDya^^VGh}H^vWQhXD~BZ&WV0rzTCL%@Om|ML9m-iO>TphO;@q@Z!xbSMrxmL> zF5EJ-lAFM3Yct)rz*=>t$GjX)tJPX^I7OZ-=f-i)99Ns_!6j&GhiSie*3zofOtoBP z@^I_Uv5OH#XR0;$S>(9YX3k>2w{UcAAvaGe&e3v#u3U%xst_%g%CVfQ+QUtu)z-O% zuv*tz&e<2q7&$mNwX2WTWU0;Mv~F2yXSqwQ)}+c*XS(HEw4L^FZqEDR5f?bmOLf+U zaeLj^y(X=z!m?N696~G1wJy#o&Mn-Z>*1_b1#t@VBL7TNEyt-jj)iKjrq<%7aCI@M zJ%)2xChmI=lPa7W<*L>ChjTKu%C*+w?4~Y6Dfi}ZVHP)MXE)?EQ(o)3$HXz2vXH_r zSe=p5-PzQ%A z*jXr>g;VFaqL!UadpQM{@8+u3s47=j@!Rg0#BQ7tg9- zxHC6in}I0d9zL0=G%7Vy(ZeUtO@+tioDBuqOohqKg6#M@vo6l2oN#9@m~(blq;eh} zT4!ekmy^kozsK~GXJwL}d| z1$<)R-GX@^0J$%KsiC1%cif;urh}ITi>YM}25MG>onT$7u$$eLcA^EdoR~S|5WxX( z1c*&S#v}I>V&M!r`6)5DW(awt6tESSBJ&XhjV~LK!ioSH(jQ=*X=yD*xYJ!c9jgqhOM{tJ=m+qz6IWP&?PPr#?seGoUB- zZ(0~?M8Ulty2ubE5!j1-{mD8|6EH#Tr`|`3)ej;?ScsgiZh9jkYXRPsQpyJkCn4}G z?9DEpqnx*Jp|2Cxj1Z0_&<@(hfOp`22pk1}1n3RuCuaRrfUMO-f*yqIi^-^OEIchn z*+!#Yp7d`sFKwahHU^&QC{xdQh<_Xx8e;+G1@z5IX*0F^{|Oz?`vkl$&N52;Lm#2H z?Ds3@`$8_`RumSq|K&~s$595P5&|O*KPJN%+He5Z52Gwj3QH4d$)M~`rpK31*Iej6!6>&xZ z?_qBTAc1`RDz>jd*~U9idr((o9@Yopjb}Mw*cSp`M@KRB!X0C9H0s2wVrn}Q?f@Bc zvORSaKNK3jM)zr9!X`eq-55$fwG)QV(U5t!2+|QB9Mp!EH^%Lmg<+Lya{cJ4SDau0T!Ed6ykzog_T-cx**{f|R z(+^=u;B5rDqAtIm>_XMzN4^oqOO~LlGK-Xo`MYgCT#7oJ3VAdcss)kgGc<0WilV9z zcMt0Q7V04Y?Mn&&kCko1^RM6@q{VOralVX~Q#|~y+oP?D!YB!NM|xsdjC9Emc09tu zpojEp3Xq9NtDQnbHC4h5UJH0{@w+8!IG&|#b0opY(<$&1z#E3RPVkfUpIe9<8mgoo z;aM0Er^}H}Xv1=9$NL0oJR1KU$V(s>HBwED|09S>KzkU4d^jT=SFGG4Th!lZjAWf~ zBiiq1H!OO8DH4Wz4E$5!55M1uIx`T@3D5a7^m&YZHHerxq;{)`Q2k$rwQyYsB zmWTQ!m#5D~8+xtAFf|#vvM}U4C#Oy!O(iOS2P!Yet{v6wEF%nsEycJj9-W*DZJ^1} zHq8+aUEw_H7w!JHcPgqDdgo4RTO&214sQ9N-@|V_a*%?W8Y`k!j7DFJGP8bdL(eF< zGf_8WIssXv65olbW2mo9zAn_tTkg~p!k}Q!h%r1g1*FvOm$dih})uKa?AI1Z6lhL1y$FLrGCsR4;18K_S;!9Pd z0elOYV!-|>euEw=N``i^4fX4bJd8luR=vVnp3X*?mU&esrK;EXPyuM4XadxaJ|apA z*?mgrLB07vckL)Cb!#Zv5f;<`>u{b_mK!RMyh;KkpL}5a55svGi{ZSL%8@y?*J;># zi$v_~Y1A0&EqQis!Ra@xl{p1YykjogVm4!QVb~HX#hfda`+J6GG+R%|A+(YfLCS22OJ>wi`+8m#mVIH9BG~6@gOw|NCS9#z2{nTrU$Zuy20)^OLW|I!94Yl*>|~_ju!m zZK_sTL;?H9&5YyqGP+3FCAg;Eg6pR}``%8WN^@dM1A1oESW0sStU_&MoH5h!vf!Q> z6=&)L#2(?Crs<4j+mH%PuA+N!Sx&-M&vm!WXZ1nyZx_DN)D*82%Xfu^XGArxq(wEJ zZa3L;7V!v2dln@<)p_LpsdpPzp0n)!?C|_)8A!C7{Fu3CMhai9ksmKqh0L`d5j^2s zIhX$UyhSYc*q~n=aKVz};JDSa<3RoG{SG%h)2=>F`AH^s^bBozT;UNkd{xr!vw!ggp2Y zH(j>G$Q|t$%%*}Ls+aqEm302aTCZNwe{ehAd}S3aUz+gk=ren^3>3>8BeN!_h|iY? zPr4G?oMIRx5A!NKR1~s}Uf6G17=5^xz9MaLldV23_)sO$Pfx#Q;PRDA9Jji zhPt6ou5}DsGN;+RGiS8)+;q*a*7{rR)1BO7;b^zt(Q|4>%?;|O^^UiDW&GN_i>}Lb z2+!dEw2nUHfnB$#&Ce3&dfhp>cKGjO+s9N*a2XP`?>>K^e~S&&D~f}YF8@^WwY#^<`dmJ5yz;nk1K zvz{FGw$J)_r@lVlp~4}Y>2lkgbJ?t3KDVZF-!E5X?JMRsTXj?9y~3))nyvNE#5))5 zgTo^J(J}FG{y(YWr8gbZdYAuWIUttrw{ffa%46PdBhx*f&aGKH@Ar{Me`GUs55LcG zu;w_k{T85BPb{9H`K>v8rud9QxbbL4&yx<0xR4Lw=W#)j?F~!4}ZJowV(&p@32^WaAr{taB^Ng^eX!| zbz#H`2M@pXJyNiEF8}5Fck^25mGoQ3+duSgy+?m|_iFX|ZDa3${7U}LE41A>{$IH~ z_)YJO8hjnk!7*&zYtp%sagy0XRqPS3YL<}^z188(F}8@(@uURczv~$QP_J;oK75vVvI#tCzZgSD<@(o0;AT{N-xAxC?7!rNIMehW{KQAq&FLF9?-?4{|dH!Xz)i zcSMjz9Kv9&3$yNy2k9+!J7$qNL!YCGsG)M*QNbHAg7p^`Inxr4t8Xu-3(O~Qb+_%&@j zfi{9AwyE&T;xME_evw7$L@rIe2xwc$n48o#WWIz(duSBu1TrU(A2_Mb!ELKE^P%@F z^utT>Fgbrl*+f7Po{TsF4@v0eFVs{SDqS=!l2A5pF&37qA#W6$q;^T@f$` zd62>9bME?bPD(@MC>m2(St4BwFnU&xT@5waRK z6!~5VItV(**3vm>i;)QL^%}o>{1#WDAzbxB{Uf|R{yaiDQ7D5Q;*d+v!@+OtfxITP zO;gk(+!uOUkiSDH%dfp4;Dj>S;pnEbp8nWeV6=XU>=NafSks$m?G4`+{#oy5vk4xe9B60ey%w!r;yZPC@tI zL8xIY0p8Kcc5&}XsdHB$ndQi z)H^ze&S%g+q1*?Mjsx^`h3pf^knLY&OD);b_X|*tJl;VaRDpIwI(NY%CirW_3qyK0 zp??hWJ}M6Nh4|zuz_Z{_NBBbA?z;_P>)HPrJlq)F!19(KkvX@|#vc>mShCmq!%bN`bMI{ycApPYBIR#}v*#Uo9hTot%9&1ljayU0 zNjpZKqN`>jPAw6KwwFNIDrZ#v*lN1|l!K>w=2IT#zQn6n`((zX`8fL zXDyXxuj(?IpKWQD8gjdNTXWCsp+pib8??YJBEUu>^_#jNnH7n0gC{a2g&DF71))=T zHd)*f!GulY6Ej}ZhCCUB-B4gF4SHyHj&aQG$v#E7XoFX8?>l$uSHxVBhkCz_ ze8-9!>8LDi(m0a=( z#^4+Cb+}GZfvb?>R`7xESX$)ItTaT{JbbK>FzNkt)<|odR5YGXd{<&4k_=+QxMoRx zbcZ1ub$N-ub#DvL?j=N&Lu{SDRl%te(1v-KRHG zsUGd7hwYg?)Tqww!KjZ$6;kx*@J#Ono!d8go)YE}U*3DTnmIJvmaiTqub1^^ym`;` zC%<_e&Qd+xq6_I}cVxcp^AW5DC+!(>uL1#Og#} zhHfb6q1LJVN~C3aCRJG;9xh95uvIw*8tYoc$MYQr^+}}av$YJXW(or{$4QHK@`2T@ zE#h1!Re$zf%H{RD7rTWlY^r-HJ}p&+&rWQ%{w)7Y%`cFA!KXz( zlp@;T;>hv~%*Ly^gOb?k2CI#Fl5~CVL1+rEbwfsa2PM91c5b-D=&({1G&{X76S=sZ zs+G>}N~$H#Jljda#I5W);r6v(hF071kt^q;9e>U86+J`#u)nV5loecSWsqdY@Y;!e zzwM418%1Znu+{6O47*$RPExF5H8$_cWf6tCSoagZ%$3endSp+g!W8#k#v_2#1Vi zxX!pY#IT1ovyt6$oxXgpc>3#~sMS6n7gF}>ylh*GG{WuqvWz26Y(gS_@WWbcz4_SC zofVXXk@KF>>)f&*oLsWQP&1-?eC{cC)<>7|p{}8QBdZLzP_$@GW2riR>(rgWxwh#| z$w%#xq4TTN>5jGUBMP0ol^MH@slgIvecwg-tdBw3#2Oa&)3g))a%Jn+>!R29ifhk& ztIoACrOsg(zvKwBX6yc6o!EYxvtWw|=6+!pRcV)aRh1nv_fNRIiLfg+!8}8^$-_)R z&nnEmp+~0P;Ll%U+cvQzp^I(7tMEPe84{83ot38nFw=nk;H3jYrox9FwO1TW_EhF$EzE9zC${ZBq99U4-k`{m^#aVdx+l`l&ly)R5;GxqnsA*EBgr< zUdLl53IW#;hPRaP%Fe>;#Rji~8;E<>3$IP^$*Thsxq=z}1YtDt@)i7-3~fUbOe_k+ z30IWy9P}+jdQ;(c10Qb{VKd7PUE6DPO3ya4ar+U(hh1v-Im{HlwoO}6!`e)lr$k>T zWF7sFqo!x!KBKCVpt=BiARP&UGb2yFd$rl>xVdA{%xDXra`7V z{Iftg)KMhp1>hXgv4t7(c?al4x<_MB|9F;UM?IO{HR~}82}*7V-3*$IINnHS8Dz-` z3TOBa1I>Pr1AhzLsatLxf)k?^n>i zpknCHMmr0H+XUchL8@XahOEe&Eh5+|38_>A=K>h~mxd+lP1Ea2r zsK?NK4HZvryC!BXxiK2qrM^SnoFU_Z@SCu;i3xoJ;kWVNP(@S*Dq|W^;*kv0RFBbv6&S{uQ?4Y@Y~Xd|-$*v=>(b=e!kXXN_| z@-h?hyYO%pBaPpJVICVW+yrk7kC>a7A)t1lZ6reP1IR?9%R7g55Z0+}ilG>Cv%%|#aHtnfe34ChgW&EBJO;?> znm_7aFBAL)Kpa4ZU0c9&L*G#n)HZx3Q!JAZ{}A}y;9dnCJaxS^xT8&C_JN~@E;=SK<+r?egXXf;fs;}0Lb5henQRq=_F{fB37wuR}WIy5l=L+g9YrNg)}^Hh72NJqh{e zpl5-pX#2C!Aa)~c+;9x@z{4gX>J{=c74B*M+osUA!o3Ok+6DRu;g!hC7jTm!(_P^H z9n=ox%tt&Lc~65s5#`B8ULGQC^6i;o)cIV{wTL$XI>_mx{WVyj!n5oQ9jg##M%X3f zg+`+$SJf;<178ZB8tyBgR@8Ci4gl>o6VHzfSIKEUWF40gBORoj3Yr3b3}i=uZ$=){ zAuC5dP+aOy9_IE|Q}8b!{Q&4YysT~2c0AI(j4+HYsRf{4!|#H64uf1OeoH&?o7x8bVLj3IKsTc; zv`2g&q}u`dG)U|)(tHq)Su~{o7<#@0zpf+nqe3oDLY+WfhQ`qgatR14f_^Nz3Dc-A z;r2qDZx9xbwsISJeGQo#TOp6Idw3o>$kQ5kv>~L~)fagkjD8g|4D^l%&Df72F5J(M zp`OT3GUQ{xABX%FfX+h&$D!Zf0)8g+kB00I;Fo~-o;l{W zq^{!GEhk-5aDY0ueh-xaDn-Co?P z)p;-cP%q{!_Ix8RW)lk41$=3t&tlD$Lf@}-4KaSD@rF46Rmu#TfYs@HY}yWziF19< z{;w|w*_RXt?Wnm@+-bz&U@MC+2c7G@@7lO?UFsfIo$Fd^Zynf8I7243NAYox>^vn_ zMigpK+neKq57}3cj|Tm0?{rD$e1W_nT=UR($8O!a*aRdK}*iLfjtB zxxN?MJ{2UkHxKRweY(JBJC9#R|x}3zV!ri-@ zhYop_F zEf6LN6Z%d@#q_yMf9qK6vZEYH&b#Q zG*nWla-v(rB+vZham8IuC65;iU;lC7Z>5#F=a?px-wd`=jrJ+GCZLXQQLDWwZ%te` zC(Jx)BS+t+K7IWsVDr}7Q^YklZd1FD$WBr?QuY%iJ|Df-NqlYMPt^Bcm`6<)M{XHK z|M2q0+8M`a*E`c195ndmPtmwLnT`J2?#w*jy@!>$*w>YwEspGPclNaj%gU+7oQYd`8Ss>aQ24$1W1vH{V|*rkESJ-ZZe;j7r7Cn}hW@ zHB}k7(js>>r)1j}AK-HwWKWxO#5%VYN-;RSff5_Tb$P;RvLDH5GOx42<^u0*w+EEZ zvT(G4l5ky-`26XTq7JgW2UN#z>wFe>IrPqF$^4Ub`Ab5sByUaTRim0S5e8!quUpyl@4&Mc}T^F{et6Tj_jlGgu!tW zRwj+HB)wr?L>RBia;8P+5h5RtF`df%Z!Y|mC#vvXJr{^^%Tt0tZ`*oJ(IdvxJhv#~+eTr!B zg4E>cT^X;2|HpRa zPd>2!U)z-x&Po#(p;9=HAI3(hO$iYuABCRdIR6fu$wfiCa6Zy;oJqxM#4IafO{oFH z6e=}GxheciS`!y-@>8WM_0A@#vokkL#VIwMnpSf2R8o#MC2+KY=Tb#%s&-9&*}DV=wM7C9l-_&~w!alggCIQNEl) zEg#ND_;ZQT!Afj%c1f6&sTiujo?rh70jyF_t4t=9QO&7joICdbW5$YeQFCa=;ba@?$W97<;K z_eT=L_()EwF!^!AIF-xr@uozPuTG?%tzh*U(`9+u+T!>CHg=lnB=&&p6>qj98~&Qzoh=gh;n2?|cdsZEKrv&oO1J50eT zGF=l?*_m#r%qY4$t@fwY!*F^-Sf1l7?pl+Nise$(+%OXq znP|>8l*=$#SYICdcznjq)T722)=E&%qA|eZzai_FTDXD=&B*<9^`69EKCr@8&P^T~w zk(p{XQxXxa;}I^hMDi63BciQ7Xd$8{Ix+du4XGVQf*lEbD%q7b{8l16Kg%DS#1Rw5B$*g!9iM9L@!bz+$->bI{> zCuaN&$lZbPjm;fsXwi|1Lqh7IC@U?G#NQN(mq_v>bzC#5!7_qAP)AWZKLsOMvdD~t z!$l(6Ou5?_DN7oU&ufQT+;NX3sTE$tbQU8_TBW0OYzj^R>gXm(p!DJ-9i=|uY1W|< z;@9f@yLgfx2P+Zr>i5X01q*{NI(mDB8Bcqt)n8+emcVqU2c>X2ds3&Ab!$7+2B|lE zHj36!tiFF|R85Txo@QG{LSM}=ONB z?T04mMWHQRR;o^+kgm%T%4QIE(x-3QGJ)vhDG4e7|Oo~pB+@v0Kx+)0Jw8*e$rt->TF=_7DT zL0I5e3HLs!P&Q#N2dRbAz(N2b!o>V;Fn@uY^q&s_jDv+vJ|7g>q%IB|EF7IHm7{Q%4> z33s@Wet9c0kNL~s!3RbVg>4je$Z6ZrmcHv-?m9|w9KyeU4Up{Ag~)U@u1`it6)$+_;WxvfUW@j9`ruwUBCdD2cTpTf*hsj1V5Q{ zzkxE4MU-sl=Mi26_h!(Jz+-?MGfDu@0y-Z4A;4k8mqPv;_`SiO4jwsHFcBaY;ji#_ z1*+k$hRi#-hXdYl4+Gr-eimpy;3{}8fuqPz4BFlkxQUHL?7VBB$>8lqoeV>qY2dv> z+BI;$1(kssA=3jg578Nr$?(JQhan%t&glf1Q}BNes)c_8+*jeg4w{d$yCKcqaFa!o z(?BD_FeN4&?J$Gy3%&iopNn+5gC>CY0>BG|+60n^_?;0p2>vmUO@_=z_{p81uF&5Z zGCbTe@b`ccJL@6nTJXulr&J+a?K9;Xet;A=?0&1-YyEEt}w;1CURMYN3x@ zE9QeRvY;6W>_Hfr09_7b0shcA0MvpsZXt|J&i6*$&xe~V!2W}9DZ=+dM?B~l;CF

H)M_>JRfd1hqg)KAE2Wb5CcR4Cdf<# zC5xTY5%*8Xl1114NOw8-9>@!^$=gFN7C%;U5;zF%hd?@sk9RS#i<)WAeqpM_7OdFPz!9%< z;+#7Ssfb)2oHt-)U{dMmdXdlKRb9H)eR%rdk)4}s>WL+p`mIY=hooPrPBo@Ftd-c` z_RE-+(%|80bF|#Df*&mEKJ#&6tA5)u-1&U8+PX27C`j@UQl)}g#k-xPC)*r^9=KW}gtb0pn!d$XOsYOFPTm{Gmc;1RMnzoR;=s$3g# zx*zY{++nr-1dmnPwb$*Nx-l0w=zq=&T4SrCHV+!F+ttoRxzbX127zCL?<5FZj~wA+=#NOcV*tifJoyQp*7 zNlnqF>5Im;OG=hC791~#=Uw8P0>)+AD!#H#kyTzek=-RQsYGh3SmSLUR6J$;%Lm<- z)Q?NM);QTWhVhzg|MFd?ys_j~} zMfO?mpxg1wYfCN6s)8VX>Mwg5&IM}RlYQA0^?s}ODLSv~nLTms8vA@>O;Od!3$hs* zkKaUyb1r%}1~E6!?A89k%QCM%9fe<3`oT z_(-PV9;cSK)}JI9&f1!G2Ml*67Vv(BKJ&W9sbK0!-J~6HGo+#Jz=)uc#y)sopl6h*nrQrwSA~*kp>&L4Fe@|`eXC%c zqHh)k0_c+k;}89Rk?QmF)`5z0iPx&KKZ~tB5l1#@`8y8=_0-mdCDm<8W^66&@pr_(rw8#ifrgI z%4`#$WN}tcupM)ahPE+>ubI+Oyjf(R)P7P!Y$u5kB4$<>s4f#3Xf*=VJ6Xy;P*S6_ zrD;l{V9VWXP}fa=9|?Nt4pKJO;n0HkP|UvQ-(yHtDxwLH@9Hl zJCvcW%rsP2Qnb!ykCfGkNEAxHL^6^W6LYCDw}xWOWeNi$&Xu8rxyYr(ekf{KVnp6B zXMp@t2Buz8p$ilTYIKYqiNKWkXuR z;@RY~11LIIVj$TL3%4gx+csqQ6i8EI5o#6VPk%F_x$~56 z07Ej(NOMtE3JMz`XkgIr#FRdi71{BEJu8tF)AqTnfvTsPbPQjH%;JZ}tNh|s4EdR{ zWKb#m``{2-2EidOO;KL`@|=?C%22lhtMoAzXOmHZ+^iz59NCFKq^jWf+nO$m^S zltveOY9f0=+5MWUJmPZq11BH$embuIQe(u49HXyMRevWZQEy;%*T$K8UK?R+U$I{? zg3GIqT55L&$CO(1+1;ZOwAbkql3AAX$}=hLwNm$%4Gp3Z5g&#*D~-u7#7YAjsY-NT z<2%$uZ@Run5?kx{*`0d(O|!L1%b+mLeR0TT7qxxD(59Zug-J7q$0|ju_C!T>zcnn8 zyR1|?8+&FPh_pL@RY|SY;k)+ha}V1b|7zxI|Gu179z*RVDWG|Jv^gm3Oblyi? zC1q@$HFDSqhvv_<@pROMsO7V5eH1VeXQ#O5K&HW^+Q~G5^}t{t9Owr01;}7%3ormclQKJ~iXHx= zNf9NVjNVT^$XjJ^`V(WEG%4949nTne`)rmu&SPbXu^1)!EI6LoJT8V}v&~GALeju8 z4L*#S*F+6vmhsHjynQhr8ex)T^MMd6fh5boVK6DPjmjJ&+?1JD=J8Ap#WWBvvpj)` zP(wb}QX#SMN}W$^1OBRsj1Uoj;|*#?q+&!G#$dDoGn-eI8kxKlm6T^JI-6`AQ({z# z_}FaYXi)%z3^(vhl!8RhZdTH~GMi!yVM>G6&!AykjOnF3)u6G@t5Kl{kwVI(#%sN(?&F2o# zN|4Da^<#-MXq>K_{=l(B&;%j50ySQa0GG4M)#ib$un*CXjf$gj)cscau5 zqOam@3>r9;?j-BHau6G8K-I9iy#K4Y_YRBl=;DUw-oDgbU>6n;@1>)NOOc|ey9kO6 z7X<|?C@OXoR4mb577&dE?1d=Uf<_IN7_3>)7_32K*Cbe?vBaQ{`WRz;-rw9yf+l>| z_2u=C?^_+FoH=LCoM~suJ##@4lkEUZ69furmPsK{PGDQYFi(}Fh z5OGa_Q-2nZba#t2SZ$*$O5#{Wk1`4>V4W@pNMh=xl$y+`z{g2@o@~*RRjkdiGOM^4 zX*DbP3=HTcJCK$hB`4{^#?NPMcCr5>SoOf@p`m?VQ0)#m- zp?wbRZ)kr(`xx4{(7uHB88$Fzv;VxkiUOM2Y?BYcf7=dL%N=Fd!BnIVaM8*T8GYv68|#No_Xqi~Uz z$Qc)`Xik=^5}jm}=fnaX@}Vk`QwwC(D^e9(Hu2Rz=?o%pL;kY}JD-m{o$7r0c5~2 zd<2Sg#vE|q7HhFdNQyy+>L#%;k-*!EqtF#t#cjd7Y3KuFx}iev$nt@WLqw!-QaU!4 z`w+Vr=pI=8z7D)fgwwv}3e0YpDi~yydq;)N*9O46966YTso91>pmT3CL(T-?ej5<& zfILsJbL19wi;><5@Q|7YUKWc;KdhSn0@^OfWGHB??#FNsIJHH*efSi>?Ph^r>=Svt=?;;S`2$u4JbI*xS805R~GWH6zSZ_s` z9r|5w#F>o+&BQzx(jozCr|^$LSwE>&afh!z`81GI+jcDD(a8X}UVjxdHu<4#7zp=t z%vBWaFSQK$Bf^>6TcXb^^rX5X`tu-ISxNzS(3FLH+$eiuQlgrbGDN<*H~CMn4Y^W+ zwRXJH{uJRrL z2hyfj+$dm=iNiYUZib9h4}W=QnVPUQY{Owfi4xx@D_ zvxFoU@jSzW$?q$oiOOtET#xaH4(Z2W1EmVITv2a!k6}np46t@(Xi_tI#20C?v*_XQ z&V+~Ndj)Nfegw4%m2bA2Bex&25p>HDFWiqIw^4uOgZZS>c_leu3?M(~Q5I-hN7WM2 zdVeHgP%r4dY2FUYT7I9gN!*^&@EFu{JI!dUFCU_?Rcvq3b>cCvGUO<^qgTR1Mt!jCI%h(W0cb!n-*jWPVZzQ-m9Y` zl7ilQIr@Op4lcw`%OhFc(B1TK=I*6<@+6x$k8~jJ5dKocKhs%6s$vD?1$3A6&F*A# zf2^&8Hxm-EJ{Ukw#X?S(` zU?AiFxa&xa(uD*rb0*oNv8Qo`Pk4|I-4|)C>O<-)+mX@el5-s#$-?$XPvFnpyMTUy zWQvf+G3*;`2_@y;kQ35UO|&70F104TXJdpxoc8Fedtu{;MfoUT?u7f2wzyAgSS0GK z0v{?^q22aD9Rja65Z_~xhOGIVAse?@_7&1<(H0L*A%~Do3d$7&6d4McnlGTN?8CSz zS9m`W*^WAosN@I8de18xGSfpuK1(8`-b%#X`49-$+m%r4h~ku^;-cew(=j?!HqG#x ze86dL4?@fEg?4OwS(%w9vbBozZzyB(d2-iye@!`qkH>@3YRk&aBD)qgxv%OBS|d*w zVjy}p)+F+D4a=-ci!Bs+yDoQ0yB%v3iS%Lq#W7!7@v%>ld)}Ze6bVCQhVyLULRHw< zt5rs?Zj4*|kjMUdLpPJCqidLd{ifGx zqn=tW>RbVk!CcZx=o(gA$C_5~22_UCZrq|Xwh_8!jj4l!r#d{Faonoo2isa@xb!ph zGKEA8&(Q4Mq%(zPN^bfWckNx+ZoI23^E=kG4wRj8mzC>`HmZ83%(^mdA#bwP#p2LU zwfy$B50S4j<0lE(uo-1tLFj5y<&%G zcgER`$)6c^4iaX`Yqxx+Gl^8wo<95u4jbD!3bInYy3$7IYU6deETvFn>*^kSxju!- zIJsPb?C4A*Z9|+g^=8~bdDb;@Tvn@Np_!_X*m3MmEfcD;a>~>!8u$h8vg_b+`Z8n7 z@z=Z+MP)mY#0}T1)^%-;sV2>}J=zWeB2`(z<|4NNhQS9!9nL8H>&nbgIjRfo^x~~r zljxCaWov!eCx@mlaCI_VVY?m{sa#!(2c!*UW(pr(J2bED25f;?#roHM4$^O3A&zog z{#@a3r%Y0*GovC(#%qep*5`@b++(kn8Q14`a8k0B#Ysld9GCE%SF+*9c|x1`(iE2e z^#Wzv;emB*%n6aJTm1Ff-6NPKE!_-(#p*658+E9xmYw2#a;a~hQQ9>jrc)YW|2^YV z&yFly)ydVoaEx}8Q50%jH(tLNrD8jNR26QRI_GAK!l?Yt<=geb*>44|Ntq^5m-*rT z`hCXpo2cyS$QV<<$4f`)ua{L{;PraplzF|3arxBNH6ycOAGx^1c4K()^|Z0f_GIg@ z%(P49qQPkehPBI>`tqgOyWSI2hE_bU} zZIDEv&0Om+;$EfYSDX0qiN)oWw~h&|*omm(w?z>lPADehaQ?^BH9>Vq;)HENdIy(3niF-|dwR!E&HXCEN<5{0fA6U%0V-cS6bT9(;xEZbzWLFXuG(;iaY)O|GQ z?0dlb)H+N%gne<;#x}`0<@M8fmE{bg1;6BqRI`8)CX`;6MJW<=N5t-T}2VdCOh7A6OcII?4 zVs5E8fva>IxXDPpeToLbgJC>j(qYiYl0_;aWS$=rWBeh3(2#yYAnlYfzH(m;wT7Jq zgYko##5kkV-#l8#9ax|pG#wbNfO8q0`Mz(_DPu72+re@WWG)!_FT#OBGD6gk}Co!pjqZ2ak51wxC zupDA?0PhKa-x&Z!-qUi>dQ&hCZXkR&h*M>s9v+#Ax*{7R;100Suhlyve2O>jy9G~g z;Ld&s*}-NrEMMO~5+Gd^Qb*uELU;lYdcfX?w8wytRJfPIZ=;K1G5% z5Vm3%pKOAhauAPxIr-WID51z9F84`<$ zNhT_tYNHi7SI!Xq7}OC@%U*`t9>^GSh1f{`*OsrN!+l$Dlf4a)UEkx@+@Zw^&>8|h zI-^ZYK|bg^eCvCnk3@O6qtDI;@AQlIB=G&^F*}m*Ovo(*#i1i~M%iryeh2W^681nC zD{s`z?&$k~b0kT~eR)kMh>yZiW}xkexCzL^2*llr3Zh5&iC-A*4&gh<_ZZ~qBf##V zBThg$_d)!8EFAoVywAsDp(Cf;lNZ2O0k*6KCZC`wnuh~XgU}}hS`K8k0sc9_qLKeI zpg9HcpLpS5DEOG^ivw|xwFK^2$kPuER^&b^aK{3a6XMf_iv2n_a>SeACQ~BFub{V- z1oXl3myczVOdl?mrl7r|t^WZ!$!Kerz;`#ua2(RDTxB`P*LfX7YCc8Z*wu1)5Zx_7 zQzDQ3LF>4XTil>u*`s?U{;uf5GSPOx1Lm}3I|ORWbL4J;2mp>6X579z&Xk179&_pV&p~WSHPnhbR_Li4v33+JGXY#fcR5z;;$DP;+0;!<|jk6 zvum0RHTi(s++@gr*J|hmT4t@~`5VnGM#xuqq*NJh;R{N)$ee}-CRQT%vMcs~YA{Io ze$izljs4mrZsif3+mKc;PaNp6&!zshaG_W{JX*t!5G~@jbH7@J$n(UaXqovbJ8y9d z&)nw?Px+D}4_$PThRvuoiDNyY4f?xAIlo)6ccN#SbeXS5Y_z7K@xI&{miux&=zY1T zOT=BP05TYgfN-8>LBuPG2gjmWb8ejx#TvWL*vi1X}Egq z({K5m?cX9_^-P)8qrpWMR#ZGMrqIsVz}_~B8CK>KQh%$OA2&uB{H(6_ys29^wqtI6 zdL1s#g)}ttml}JB0z2l`-LCfGduZgE;s?g9y-UM$o;{adH0d{bEPSSYsM{vq8f%Cw zXm!aX-X0yD5@*1DxjQ{v8tNZbn+Dk1$P6#oZh@(LGcWC#`iR*z_~5h|x%Ic0&&5Y( zcg$_DPN@{v6v|tVdhD_%^TdbIY(qhilj zM)pP7hOg#&oasm^PMA$%rllk-&0MR^Tj}8x_KN+cTI}KBu3fD!Hx`KKY({T;yvV_? ze_6^?kXE*IsrvbrPPkB&ojJSmDf5lk-X>>u{nJhAVs*NQ#64^SKQcepeJ8drotf+EG&ZTFJqm-J zdLwDOX#2n+S&By{aq1VHG?g!yD|-9roR1pJk4%GjU(F=H*XvSb!);YAztO zchzx|c&V!Q);DE)nA7&==+!UkpGgmRYDQnSK^?VU7u7lC!ZkDh+uRl(&8cUe=hunY zqB#v_^UvZ=(SzAP>U9tJTjNT*{(&Se+7GQ5+NP$9-DUfMowM59eqj<xVv!UL2`{Cu5 zgTGlnr8tSY0Prh%N>-_Y4lf>R*u^}RjePa^e{$|-+HgCD{nf;j!oeghw zGhaMfS2^j|w;kVzpSIi_FkE}INE~smbFTKQqaWGZN3TAFv4@)s)q5x&dh}9Uwf?=II4vm!U$nb z>_m#eO&sXZ9g!#%GzX+N9&lan7-H;d&+TxWgKC~QzaJ^Lw&m_a@&bHAYAmt@1HwK@lWwL45AGIR+cD3~P-TH1R!+6?f%iZH$PU1^FS&6UN~HW)(=+4j%hn zSk4B$CB0g6+AjuZB1Qhzs+}4JAs^?#{OQ{mnX51>VBxpINN>W3iS3f#zlR2Th9L}) zQfPjzNV!+HW58T8=sfIVnf0vi(VaW;O}}%5qC#eZITe%koW3B=sUqWU_;BZqlR;$8 z2syW<(hBY@ND-qxw}(LYA66>tN%DR^r;@J%vKQhEx+LU=;F}P{FBtMuGy9V}-7!5) zvz#TjGl{w955%DJ1O_84_pRS)*m{^npi8Hg!(bkuprc`zfbMVm8S)(Gjp$R%c3KGG zQ-<4$i9ot`NbAj5du9 zE%_3Q+{ciXZh&Q5Z8Qq>;4EkE;+kRS{kiG&K^)Luja@4DKxdjbiLU0lt2Vkjy?P;=ToWxm(74 zGn5RTjsd0|7R;%>ZBP@dP+on;Nw|w-9s{-yhEAaiLNT3yyBo?l6ZXe2C6H_44q8Sc z@+f@__l?puq(2pLG_XJEje3MU&fbwqzy|3J+Rn)LVZfnL5*dW_8|;ZN!#>4y2{P^h zJnH}nH_iQZ2&T1fW4Z4s?2tZvUL3PqZmM+$JRJo+IdH$k(!(4F9Tuh z(0!2S$l#)MsEvrf3*nIni$prNVb>tcD~d4`Z@gel(b^`7Wa<^=} zn2WYWrx@76B2nLalPA4U|69qpsrW#2EVPi^m~UCCs`&|*h~@FP?>~A%zLjw|!P?qOQiXFVpbNHqwZ?hH|`-PJ%EMq8F>Nh%*WD z4Y~{bPHnl<2_AULCjoWvCSZfY!?}CX{aV;g~-!r zkdk|8YyHPw+M&{9oi*~uTb={ahEKTRo|Vmx>k=`^Eqr!1IcH!Z+-!=b$P#Ww^6$DY z&rUNlp4s;!SFADM5fSkN_lnTUiO1Zg&9%Eup93)*njThX{&=+ZhiGxX=wO2NIjZPQJ}9P_#%n{Ij{5UD!Fql`VU^f)N*mPkH?FQ?GbT zZ}OeSq#cW2>eG9DSbZ9=hd7``R^J0lw-{FjwK!~f4n%|JKxB?(XV!#`n^-v`n}04$ zH09yVsKxgS*LQJ$^=1aC@E7ZBB~vvQQ7U#t6aB|N_wUO+2U480_QDp?>hP(rowoDE ziCfxhG?$o5+o|m8&D;5@uXjx}KQ!wudkhq-u0Av~uDj@SAa$1v16J7`ZBHJtJDA-g z@EnNtr8af1JO@&28(9>1&0spY+&Ot#W%aX>XG9(u(@p z7M=syH*ON>yqv(VvW={@)laXnwVUQv|BHF#Bs>SQgy%c3a1x6Y?Jjj4DwW z@!S}j=T<^YV(99j8b${<-MyHANXa00w864lbRR3`a`@@WawfX=PDz%P>2J{GQxyla z$P_hHT?};#5eEyK+`V>vkuXMP%csl0AJ*Ek@)?G3@IX#s7)ir05e0Xp&axU!Kgqn+ z7OQy+z%clkITX7_hz|{mn7pClU?`l2VXp*!j7r>zFKE`>XVfOxbc#?4+YP{Ouph%f zYap*N1fK@pRq(h(1$7R?AVxBh2Lm=pnVunAAcLNW7YIL9;U%NU~7B7Kx;9KweJo(pps^ftiX5t&;8 zKfRMQ2W2oG<&lRxEQ1_pf!^hjmS--uAusNr@d`Nqfx!%k6aY5_I6?4Bf5e>6A1Xlz zPQUG8$bc}=01x5Nf!$$C`(QT>vOR*h-GS2{_I?xsvPe<^r=LRihkG^Xdc$`0g=&cS zGUOjxEooSZ-3{)laOz=O#5s?AP8-M&G2HhMzI8Wfg9&7TyPn`2cyooCNO!CX5w-;QGr@x| z>gn(BpMw7^?6*kA7wYqN5N|yMZ3VnchubK ztPdc*0|YY?!3E$2LEMSRwy+~%#_F&$fbi?c-z4~3!=!@tZW!FI$L#=F$x&w!t{x6L za8HCA8aDSy_fh1DuGSAi<4Q+(Ji?*9l9k<|+Kt1s3b3_MV-o>;5Q269do0Xy&^Jp^ z57CQ#jXbUf-e%-`0>aNAU5JpJLEh-q0IHVgXV6}PkQV*y`4(UqFpFTG!F->Fazukr z!`&Zc;tAUb^E1p6m^P3Fof^^m$m1Y@W{(xo%GIQ5Hu-@64^>k_STn%^4R?uw)f%uP zjU{zfXCMroNvLCuCc=0K@U??BpD^CNB&eMQI8K#9WO%4R;Ov0!M}Z}9LF8gJ9D*=! zJX6PK>|62-h>Q?5kH|_82j3|b`=@(qiGv?cpe^wPIzGac$dHx-&#qJp@ zjRUL8^OE)#XqRTh@qB!6X+M(4!_v!giCLgE_$D|Iplc0&dWTrN0Z*|u_v%hV6ik17 zC$^;rueEd+%@?yWkl|%stJ%^MweT=U$IzDH8B*mSs9|_TQdwFrUPyF*?|7M^XI{uC zNFz(s+qE5X5iet_*D9D&A~E|KmxVLDD!B|2Baj&4uP3u#3qa7g0a&11-^UUe&5@giO`pKKv390c)%HEf}x zg9BJhl^{M#+RtFM#-XZvr6-k-z#>DzT8E?*IpXx5D+M3L21mf!&v-3prL7P!u|i34 zS`x0B=;5Qe^dKouP~ot-?-y$GcGRTGu`4Jaj6-gg0*9h-vHNiz+q0JH(88)qUf{mU z;qC<-@;3}Q3_c)*&jr%ifAk=MDF#wQxo35_IsKUpUmMtG6*8~tP#CD)Ls~~`BxQkM z`gALeH7!EHSqDkhON2z%Im8YEuX)HAfmjXu#xNDa3MI|qWm+fd2jT@N2SIIDij{yw z%i8E5se=Hexqay%b;z-JC-~`%Ps-#V9m%1xD`toA$ivIRv{kI` z5R#}u>eYt`1RXCci@`<4Ja5A)_6MsOOe^nr%@WcvhUtINI<0N>5%S96?sv{CuAgCE zK6Rw^4`O-Vv%W3b!~b~1rta(RS|i_47MQ8g<(Z@oM7vs6j!!C;yjKo1J2q~jpYPMi z%<;(Ct5Hjeq@KQ#V(st(u+eL?3$4(KHojFwi3xe+j}ugwUi?L^IiAfY1ZWTSc*z}C z%kpyGtVC^FBIV7tLDi%!-phJbJ=f$fy$3cO9 z4QoC{JX3r#Rc4=^L^@Q2O6Gc|1>5%IL$5%O%QU2gRVVtzFB9nx z<_K2_deO+V2${9M@%7KgP|C|OeBlRG^J*K#T|7mxpL>epvGVzG1|vSVey+suPgj}( z7|Sq5yWZI_0qDYMmyRBsyN-H2>{sqkfzVaAM7OJhe=@pW1d*5M#%+NQ6z-Oi>FDBD z!QB?-83@p!78ul3Rer+7Cd)ix6 zoS%@+VZ_6kC?Ztvc)n4J1Y3b2x|B@E;hnJ0!H$N#2mwkESqs0gQBQadH(d_Ku*>NW z7^bbrTn=Um{ z9j6!k{>UFrSaYug&jKtN{*_37D%|u~`4+@g!Hk6)2ZT61oZjP&Xxyvmjz}vHp6T$5 z!4o|>lZ`Mq$xsLuI~=44Y2Sl?J@Ac4*NFHk7^ryM_DCt@*$*%S{5ddKt>ZpNoI1E`VBdzJy8JZ6EkIZi zXrsuvr{lhX?Fe2l#pJFm)55JsovugyN`+gBybVE|m9QTo4z~G-2;uaTfME!yy7mLu zaeyyFxzPE~PYBCL93RNDH~edm*j412&RgiIu-Pb^@m>~P8BK@u20!$jl47{uz&wSC zf{F7$oj~|3$c@fv=t-*YLF*XOS_t?N;LV4<9cDhl96>tt>p z`nJH{0oYcU2=FdJ*loD85uOSDLt)eRZhT=!Qa8+7(76a26Ci^K`28TeS&*|5@wM>N zxy}KkSqoDIw-|Bhyhj6jF5pWM7J_`m!Y&2g7jV;U#c0@{A^q3rcz3|h2mBV|t3h`P z-1NoqdiaH)a|`f5gk6Lg27boCp9xqMV1q%&i28s7g4|mbr3kwLcq_oa0If&xTLJGb zWJtGkx`M6`l?B{=kf$qvv!Fq@h`Q0Z!08594Dj)F5_ej00{DK4G_(lMLi$?~HyyZM zh(8herhC;sh^qq~2e?sW zegXdt(6&Qmp>sRB*!2c5`q5+x;Ge;L0d@`KoQ(8;rHun&onT!@dOYOc4tOKrUxxDf z8n6V=&?5XGjfec~1Kv%99f6;Iy_Z7MgTFKEyMSfE)B)cFdnMvX0V@M64qw&ifXps#2EzlDwt%z=|{Ho6loXm zWDQx+=SG(Swg6#m05ik5fF@lt8;Ni;i~%$@0GF;+{R-YT!|VgzQ}~Ste*<2xB3?Xb z(37x(LE8&_)2+q^#65s8Z-l);{4t16PqJnqjIOQBLVaHbBZXT6^CRL=O%rPq|9rE8 zYOhUSvp4yG((IcR*zJ&b$^n}KN=ht zN8Ty!w>av4*?)SrgI*Ws6{|JX%8t=(jf*46d^@epkJ?$ zk3zm{rOW8j&%fQZ97kDv{qkl0?SIK<`s6&n`(2C9%!)X@R?^NXF-|qrsc&~rT^ILuig>ucBVw+UrGqS{u*%w6^B zo8xoIbw$}Mo?U#Jaj|@OnXTA!by=SEi4tP6ZJ#UY(KcF=o?qJC4mOJ#mz$ZY4NM)9r;LdTdiIY={Y}ddFJi;D~yKW3tH`}<$v79?*2wz+ZvZm z3ul~-AF=4()m*Q|;-4z+EY4_<^jY%qw^v@p-Y$-ti@P|aZZ7E-RD?Gsf=*^EONe>p zy*#l;YW0GCeN(rr7{D`bv0k;4NTO4>PZ>Fm$;4|DJEuPIVTa|-I1!od>hIfW#iCr_QRke5Q=u!Q}Yp?BNjfGvki?^;Fx98f{b=O+qi9^p;H%JvFNj zecxTSzHhKJcKysJsv^zomk;jy&Rt64TN{?{jwyR3Y46`oAsbjx-b*<3Sb51p#-Pnr zU+=n+d3?`#(t@C|f=!FszxLl;(xd&h&CC0beX!;Bt(^H0+B2pxTh~rJHKxVKQ@1a0 zUcdjhZCICSWi{-h{8kU`F8Uk3t=K$MzkS==iYcwyRs=ohzg@Mx{ebH2J9gDQbScu~ z;j9NPF7rM!9(}#Eb7g-`(vCgnTzz*wxit3C&Z_O6y732IE;sB-`eIM(&p-2)#(r*k z^?F=;v&hZtR%6$5{O%JTJtcm%zMnnbb0+-JhhWbXfgMn{-tmSR-8;R1lMlg1gwGH2Xu_6D-srtLOVTG$}?Gpw4FvxJpfnH3W!kqPvk5-{A=pSM6Jw!urcY5}qH&vVf@>3Kzc4Kfi1 zE4GZ_GjFZTQzYZrumXJ0f=GD9BVVt>C@a%Cse6$w1X<|n0)TfBn=k1paVDC%F#^wg znWt2pPZDsyoTSX)t(9q`<-EyVidde^o0P}nF%ULZ#=1aav0%%;l|du$XJm4Np68;@ z55W=;gdoLhKvtVc0WU_P&SPT*IxVA>q#M{SlC*_v3|3tjg2;IH2{R-ky<;xMMTo^;heqH21ONA$p>m>aIgr(nX(Og1Uyag#6i&!gioX*lv0`Xug z-5~Rkcos^)cs?5^lP%CEqOK60M7JwA{0Qbz0r0?+ZJtCv@Jog;&xY?ZBNjK z-)T=xJ_P@*Jr%J6$d9*x@sr5x$WO$OAYm8EmRhL|S;vQ$Z>v8ZRbM(iHu6@!xjvHT zE{~DLFj=u3)J0jb5*{i%7CV$Rh@v?sX;aAN@zw5GJW0(qM_j#FR2CCC+#T`iOQ#K# z#Fxqv5XN6DvE9L(W5oM3b(0x^=Q(K%2P0=Lu6_L zL0Ba}U-ClAp#7O4)l};awmD*b|kqpUl&+6?i zI}vp&-xIl!WN9OBNz5)Xwi5l5*Yejxh`dkG;3v>@>w2VT}iZ#w*>yYNW&tpgh+Az?HI}Z zFuq)}5Z5Y3v8A%b@=teXo2BJplNZa>`B{r4_xE|lkZz?}=%-2@yP|bs@$xphkM>5X zY%vOxe>@5^8lL2dllq+WK6Ys^FOb*B;|#1hN{h0P*q2Vj{g48t&p2%rmujfhq^0V#ypBOYXQYJs^ob(p1i_FxK{^qFD2OJI7qn#L( zYd&jke|v{a6iG^tO)c*OWIBgT!) zAPOt^cw;nwI)eXng#76U{nHWlr=#7Uj_^Mn5q~-&|8zuI9Q-lCjiljfqzxB{Q!aQT z0JJy&vpD_&Aze!d(zQ5{uEl|LEe@n>aUflb1L;x+e*{gp(bY&BVU5J$YNQTVBYC(Q z>BH5S09=hJz}1)pTz{nz@>d!mf29%fR~jLIr4jO18X@h7av5WHb=Wb{Vwfb3+-Kll?Mm=HmE^+-0HAX+EeV` zX#X>`IojLjyh}U8Li>%Q@~)%r_Bo*4dBF3*32ySg(f(&>bF>#PW!@zoY9W3iSb03y z7cfwNWV4{(As6-EsQ)vxIqDaVy+=LFLVc;bveexdFi`*6VO+j-Pq)8O|7U1()SvwL z9`$w>>ig`K7wmii1NE6RTHn8n3kcsY(SL?EN8SA7J?h~W>W4+jH$q>)K;5gy%F6>Q zto}y*pP|iBKm7bX>Jfj*eSfeoV4%LQi}Ty4a9U%2je7kyCg@&gS{wfv+8p&~Ti&bc zk&V1NDUUn(0tV{cx9!^QQ)&57eJ8Lk8gGQg-Z4}!T&R~Ir6VAyidNd zsjgqZDEBO2d;vxRlcs5UDHB@%ErEZAHkZKm@A*wFiuUA<;!!BKD|`V2`OzzQIkusH zua^G|ZI1lKXCVJ)uZZEnLj87#vLVD5Fm#D;0&^QXK~$J`e9ciizD4jZwMJq55UqR` z?F$&FElzw_|7-F!M{WOY3pGM}Y~F~*oS%zR)^+d&4AiD!x1?!puE|GK?$ACl9--Uy zEnF{rm#M}+>4z4|x)u}$GFzaBHj!!aHOJKDL+?>*?1NtWDHr?u0tRaOuJ2N7@-;{8 z?w$9jHTF3#`N}+jFJPcXv(Us_ldm~y_wK((t+9_e7o)rz;|mz5UB;?u6SXE^bJR|4 z7riUD#y;htkMgaLFJPdSg=s<)wI*M4)N1SAqt@7mn5~rOtb73jH7pFjL#@fz9JQ4< z-lNvoXVio#>%x2i1GSQbBv7NnF0HmrzUHXiTOw}CDfErTR&c7V@`tv*0D|1pb&_|; zHTjw&cl@jO$u%~EdtH>TyZ8bKa!pSkQ|_94&5=85dPi{qca80!!b-W{$`?S8qf@k| zf@tzJNACHe_sKQ3hlkF}rOv(pg4_w{vQ4sU@-;`UaLfDT8XLrdVCDK?UjRYQ58D+@ z+%@@{Be(hT`{Wv1M6Ipzf~_xrAlI79?4KpukzUIiC zc>F%O##XUCRCzSi7eJ6}`o@ToYw|TmF2Bs`-OPqGwu(~$%F6-10D@f8IZ{fl$=4jY z>nGnQ*Vrod$12an`T_`YO6ohqanshIX(Oj( zkC`;lMHm_s927!a0{#&rd-C`o%y1`99hnm}WzzJZ2_tjTGtzU?T|Rf5<(V@hYoup; z&+MEjQ%B@@26~PfGje=JwrBf6vpgrJPoSX2i7;S|amP%|899376a-A1I(~fm@bQQR z^pSy{e^T~rKkK890{@~gM$?3xF=;AA_E)>H~0tKd54TNX-iVfT}g(9j^a%TN?2W*Z&^*9j^a9@;fc!-y^@%B>p|}J8k0M zBfrxq{yp+Lt>WJ!ztb%KJ@Py4;@=~`+c5qwus^7dz1uYYFVg;?S{D34)hzgf>RIpy zRkYv_s%gO=RMmn%sIG;4PX`8vY;yH2?qr diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/._SUCCESS.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/._SUCCESS.crc deleted file mode 100644 index 3b7b044936a890cd8d651d349a752d819d71d22c..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 8 PcmYc;N@ieSU}69O2$TUk diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/.part-00000-b14c1424-bac6-4e03-9935-e969a5a05f34-c000.snappy.parquet.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/train_small/.part-00000-b14c1424-bac6-4e03-9935-e969a5a05f34-c000.snappy.parquet.crc deleted file mode 100644 index 3b6f24a55dd932fbfe56c7810f18b5f6af426d4c..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 1408 zcmV-`1%LWua$^7h00IDWh7Gx8Z`}@$AZxBd!>-Wr+;7q4418JjMKNCzCnAN0j6=FN zAb+Zb4Wmo(E${gW_P@Say;eonynj9%EFPP9arS>$_|V1K_#~Ze)oBNLE26xdrFYv? z)V+Ja8B9St4BQ!6^K$SVoVJ6%X3w>^U6^%BSQPyT=S>~7;lhLX6oz_{3EB^@0cgLfIEw_+3O3h5H7lvbHLV*@H;9VGJLlVjwBF z$RvlfvhY68Z!6jk8*~|vF3{SbpQA5cICBhE9Vs;#f=eXAWs195Klf!q4$YveUpo%t z6sJR!!nr~A7Oa^Yrb_&J0AVKHe7AmPkdaLMdqJwAvI>rbc|wGe8r2I z;rk0zX8e1{aVp-Al4`tIr8|V8(Juptdq4>Ml{To;wK4j`q5pb*gx=Ulg5a3`PaTKKmfPTUrLP6Z;=> zGKxx3BI?7VH_Er`-8wme(uar7K7NawuQ623yXP#pSD6HLpO_N8(M3#Kv-%8YWG^yG zujjc#idY*)v=fQe_F~RD@phB{9|z(1tikp6hPz1TcDDtWU%5pjHL`!*mK5ceq82Sy z)@&JsakZi(#f7YRicxm&ci-Ht>p$D|1_dw2p%&_Dm=FaI%vu872}jZu8ug)YG?fWO zJ{9p*oEZV|5nnC@Irg-(7>I&#Rd#b@>KWb1J};DQoJD<5zAxf+x?bR}d+u5=pZ+lb zV2NEIC<8JQ{@2VdKg#lCfnH5m-PFN{kSR{O zieLLXQd6hsbTxbQOVM~|b=hs!`Y#0^WusZuD@*R1&Nc9^{nJkdcpVRRiA@Kheg!y6 zi!*Dbki8u=7@Zw7l>% z3CpZacei0~8ru}iNz!r&cPwGa-ek=EkA>1iveXR;BKWkNS|0rW+~6@dJ&SiO@$O%8 zv2xw`nu+?#{@q3R$AFc082_?I^vrPH#gR8hmh1GgpFsy$=QO#uI`AyXq}AvtoflL$ z(Q4et&|}VRFB{v5hroX#yq3qS7QSA(m;IK^K<}|QDJ9$g&9>I~z00lrfX*zhxpyw6 zPj9D#-tP`z7#^5G*a|Sb4))N74?aEM_&ru3+o`ZdKP!48Vo92z5lBu+rLB!=LMyHU zJ-CeO&8>iT6TrN-18$nt2Is++1VZ*UIE&&m)`h#RA#02Rf~EN zgS~1yNRFuVtVZeO#V$HJcRk68Z)2;Bkz($fjFT~@6p~TX(2Xbez|E+iGWw(9@9!u^ z=g!Mo=qGg^hoUTNw+12&&TV12bLzYTL`wJ83v6s~q zvAeE|9bH#LQL%%)i(OaU#j>__^}oF9&HKOq_p1mblRLMZd*+5sO*jg_ z5RAVr;Ln76;~z5cS7$_f`QYzcsn$VJ_`4N<#ULljOX=jo(Nr@2HN;g&jX)Qu=ANPW zw^;mjgmOhOE-@Br3Uc!D_QaRlIwL%iVx{VXdz`9L&^X=#vGvdPpT0!2dKb3k*Q@GN zdMBtk)@kyDLn1(~R6}S&Q9ujfY#}u4srzT9$_3PY_WinRqyYL22;4c&+YNT@9J935 zKoKl@Fn)T(duJH`Q^&B~r3fVS&(nTiLb;mLzlOCx_iM@VdKt8y|MGpf{bSgO2_N=T z{S@G00|q=|y0=$vcY-;KMs}F);p}Q|*zN)|f4q2DeUFC7-k;k#b(X?UA>JA0DmVDy zisa+wHWDz!F26Ehs~F~3*fPom-nkyk{@jLz#5GHG z(*jg5@z?l};15!GSGZF%=&c+^)|4N)cu)di{oW?`(8=NC6`!|%vvSaJ51uYsEQ5Vv z!#>Oyr3BW!a&p!)H#qjjEpfnD7WOw3`)kiiK_Sr`etg&+Uby!k`fjcQx_3T)>|rMv z^k4n+dX=9HK5TUU{$aQRtYZiLed?(k)|Q71T(VOM#d&o3-9ciQ7dZ6R4_4W?`CuXK zNd4FXtZ@Ucoynm~IvBv?%h}Vx4PwZjRz2mz8YR?~Uw(V- zg9PsX(6-IZB?`!Sm^T064msFcM7-QFP6-=NZkQyQAcf@I)&s6RRX|I*`PJ$=8N|dE z-Pqk<30YU(RHk|Q5_Y}T zuA7$O4zCXMN;HM4q4~hzV@G2UUHZ=wZ)SwO_b1W&#TykcJ8oJ{jw%?3m(c3jQbBCD&!$S7< zRzcfsy#~cjSA+53`2G2(-C^#h+U@*5Dxiule0i45!4u!tQv>4NVN-|JHCxsyAj&r7 zpMZQhv{Y|Y-%)#j=L6NU4gFQnkZ^I~vbHK1x^}Z*dWjsqjCV?% zdG*2AvkF);v|&l|76nXJ{eTv3c87m`l@c~B8!tZyDzHo2{Z^^az^bELCin4Ez^4z9 zrIY=X-+Yw@u!le8t-9p>|Mu`A(iu+F=;a&#U{C-5^D2I0ll<*Q(KnwjnuRC`7hx7*8h*&wTq$P3> ziM!a-i^s0tGKW?tg& zCzH|=DUymAu~_7en~_Rs10!Xmq0v&L6nADNG)vRGi8ghiO-6=BQd)@bg)c+GXquK# zE=Vb4#WImHTrQ0f`LS%*SdoJ6Mx!{?oku--NLhp@$zts3N}Ciso_>FeN+?yD!i1C% z$#~XCQ^+J{@G_X5CT)^`m7-O3@OfEU9rtWGsrqbA;DDik8y6!bho8&_arq zBa>7ASh|BrsG;crNNO607mE%@$O*MKvUEEZN&S)~{%UWU#a(J^8br(KC>NtxD(%^5 zAuJz8rwpc9i85L=052dLXTp<(;{?V+$Kmd?c$rz+C_!wf)P#G*QmM#9r%2Oit7r(G zL!(km8)@1bNz=usaf*i~BPIYZfR3@Sh)u==r-#wQooT%IVjap57-TY&2}$I1X0kLv z#Sh}~T*L-S@a)kjg&x78SR-=BYvbgETW4t@o`N8Wz$A7WIf_SgGQPQ(=8=RoF;Z+@ zqZ|K=mhrTdr`6vzPOFAR8l_Mw!S~gVQHoebNDGk?aZ*M$SZ(36+-Y9gL5^*NrJG5_ zz38zzMnW4sOl{;+T0D+L<9P+%3Aj~8LF26)Bl6HO{?5n`_eMz@O#Gloe3uC{oh+w> zCfruz$_Zi>td!;P7-^Z&B=*OaFO|B{v_S04n8ivih!zcEn@M>oij+i4XNgl7y0Odt zG9=W|{>n^Fhez)(9fOUViG2T5`R@IT7gYe*cVBAnUpE`;^^-cGNj~NArqp- zVwqGS?j)5+YaFX*{+n8gFQSm6!=eVpmMR;(b6XqzYDPa*E?cv+-)l zoBPE&VLQQ|R0#$-hp=DPP)2MIbEM7bjxHwbzNBi3&iBTx7Py;e)vUQl#?pm&rfHrx z&uesLF5)zCbGis`(o9N5x7SSTz~BkT!<8^fRukCDG+*J5my?f7j~1G+$(oc#S)*GW zDyDU`Gy}h7q9jsQzF>yQ12>C@gT0fKZiX8WGuSooakxFaVlpverD6$X#0yJBV<&>> zky1QQ%_FB^Z%mIv;)O<~fp&M7B5^wrE0r{MQiL5l-W&{_5+lTJ+bAujrDCIL5gw@s zH;(r}5S|_>Jp^CEVr%ZevbX~x21%m~_^y3*N<@!h8M#J?H*zt(m}dpdI1cABCcN8d zvDDDqy@Sbwok6TwNq3)sO~N1*BY)OkPD#zCB_^a7N|w?{ybNzGsiYUSDb^1^kBkaG zyf_MM;9^?JVZV;=h1U!%TJF(XslyH(?+yF_Y#i&bW*5UR27k3FE&h z@j8LffOk9g6xpVgCLam@5l?C?ZE?ceZU_pJ3Y6GU;W_dbni$?+hu!)dI&vApmS#$! zL!~S>KFO+})iS&duDM*C7 zA*J1oQqxSKRJfLwMlwH}ObXWWpON z2s;TRlhHFpjqVlUN1IWJJqC~6h?0uMZR5x9x@08^W9Sko&iZU4R5>H!R3)yBS)Z*< z4N0x^HY3epp=ZM{Y z+uh9=bC!2xBD%R9e!1nt!_F>$_L|JPJ0j%zq8ok?YxtG}x`1)l!^Yn93l9F44iBq{Ryoq>G2B8@|V(>y#&h*YjG4 z_b>6Dz$qOG8c7g0-JkVVJWC4)PHUV#TmPGIkQ_f*awO>ocda9lzFhWhaOQnIEZsWh ziTfxII9^madD2le?7hB!O@42^BXJ$MGUybX@`UnV1?R^*YvJs}XPmU92hcHXXGl0B zxV_z(_%e_KlG>Amy8p~SqKp1gI}+rbhKt_KpD3Y;%ekahk2DVWpoKxr4^LIV#S?n^ zhBFVlJ}h{~ffBfRChdzhj8b4w`F^HM*_Xpxa`Oep&CcxWt$lGwnJ03 zBf)*uV^`Cvb9x6b&}!B0KL>r*z?)CUkKMYV{x*M~!}es2e=}f;J5*F{5?tx8aR3Y1 z&%BP_@2ZCKi6uiSWzwuSRvU@QwtzN7D3wS66uW>%i=T?{27| zTgMq)m1$atY9jT!D_1+9oxh!0XjggYL8WQa;%trvo-MDQ+T(`Kk?=>i8#%l86AzGf zyym&8i4Oj5-Fl}clXn0JWgis_ykGJVs&2C5Q#A*3mvwRSsKx7X)MfwX{#plM(&7a7 z*T#EFIP+k`KhRtauUAUG6#c1z{ZmT;ybTVZp{nlCdxq6QY=>Y-oA2pJ)U6+%e4Ovj zI{K4&a6WQ1{ng>Lb&tVPKb|;!kD&g%Vbu zQXDGTse-%Dw@mD}Mg?Bs!{<)?A_MQEw+?*#&Ip5sZhH`#rGwvIB=+dJK@IH>&bq5= z#X)hxCim|z8Nb1Pa%exf_XFk=2Wt-eG0)(lfqwHJW__|7!Jzs3;$xiwoF*7r%qmwC z)DKESDCbqrbq+LebLDTxN7V2RAZfQ(uKC7VEnIv%tbE==0}Q!&`0$n&N{IRW>JjNY zB@`X{^G3=%4NPJO-yCMsg8Prhj`cilfQ(X2lYA8i3li#IY-w(Q1@Emfqc3Y57$*Vh zZY54q-(JPTj}y1vuz0KCTJ?)CH(#9t?o4U^*V~aE95DWUf-+9(;rz4vf9@CR91u;( z*M+MJ*W>;ln{)Zvdv_c6ZE=N19mGcgub3*$L z1@4u4uFExE|CUJjby!HIO?kdwf`5y#weY zfanhaaS`R$3^=UGzx!d90{(pHY}r?#hZhUZ?GC%30-0Zc?%Y>7T-aIC@4$8)@FTkl zieG3QK2nis#y4TwBA=h!cshdlx+h`pSUG0wF=H_0( z(OTO52Yyf8L7G2nvuv>rwq>2I%UFORujcD6bXDmf_ubLQ{d06Mjjh`7?wA(l1ROA4 zjn}}n<=4V|kKyO*H)xOm&lNG#S8hfI*c0yTwzyaeGk0BG)?+viE?RzYj;|h)Q>{De zM746jRWd(!<43w+_~%tD(trSwsJ11AMt->afzw z!vUxs)d!psb@g-rz{{Ha(;uyKcL3B2Ce6wTxub^RBOgcFU5WqHIv~(M&AQa&Icj)! zv8LzLFFJ_)W81RP=@=rVJDp>t$>{tzS^H=pd7wiE=9li{UoQ$6nSKkCF zPT=cXS(lEpxImb4M|gf80(*cmfoW9Wh>%k#7{EXFn(N569*yUS? zeF*V@j|29Gzi`q*zqHtz!L4PspS{b5JH*D+yj^fB{e9 zx)^e`kojwI=DzD3oKKI58?udqef;CQZ|`d0)S72oR!`Kyip}e{dK=X+e(BDcE_Mw} z8ND!gVj>Se$J}^4j^g0!@`FR}-{U~Aa^2rCHq|%(N;Czh= zK6cN=6^T#rP;hp%daREQ{uwrH%Fy#1Z2o7fN7FTGD6AZ{ z@X%Ec$l3l#wxpL9@_XFx^Fx}~NrN7o#zRj&1Lzm<*&w@2t*ngtoUDyg8Eb)BwG(Mbzm2p13MDsaF za=+g1T&O3UZ=QHl{F@eL&;7BJ-b?E!jO7}Z_wi2fa6s;Hw>L6TJG8KM`=J7{7Y{eS zoPGZ291q(@tmXXnX#i3xBVXe5uIY@cbyZz7(4pIH_ob7K(EQ5J3eif=Q84;e7K90@ zPX&jDao^%{4Y*f%wbZQBI7$s8+I=Ur^-)9pr*ic3EDoZ7sh_jxFbC)UPP_4JfdQw7 z_x9QE86Bk&-t$=B2TnXBuKM~QUax^WNel9e-s9)&rw2p7Bx<3@x%lcW85)>=d8#Y2 zD&f~sd??-#$CIN@z7kL;{_fZ3_LZk0& z9j*nN+xxtfHX0x$&DA|W-nD*J!@BdVbjbxRJUOrVfD6( z$iIG8I|`g9PIhqF^wI;k!G|v_=&Xe2>AQ1Y@4)u)tw0y)clkU$TLrJAeX4x@HIC9u z?>D0f{Dmr+&|Negc)v&VSM>@YR2Q9~J{{Cz$9UQe# z9zVJ9;QspblX!yxBD>zv|It+kKZe&8_K4--*GIeccQ@lW+0vo=?zb9U+ZATT%Wdc8}x8s&+HDV`*~O-YT4pFVjo@u(Vo9lZ>Z73y%s|&C4L&nd2n=G zc25q_rSHa$e9AjYP21KzE^9GJ4O5Gim%CDGh&&%YElqBOvL8qFO>Uus8)~O*=X&yx zR$kV=@+JqfT7G@eRip#f*0nG#*c0x%xjieJpobyxKbODTu7#>;SNfg$&Hz`L{Huo7 zN|?O1$=8HBEo>2Fot(K&2TdoGE#;>h;X$^-oHaxRHI`o|6rIKP5a{6>f5X#JaLns^ zX3T&V21vXzx9Ebw9pe9d7xu(vfCr|E);}KM9i^^@W+#kJnH(JT_<>vNqIQ(99tjRi zT6`bxujdbJzbw~4@N|W=zLg%f>YEH5dQ}Jg2Uo@nNWyvOx68@tyldvF zd)SX%ZE1D+faAZqqvNB7X<^guV;c%Ca^K=yT=4u>ApJKkFv2e_jKNV2JY18%<})X7 z@aa(Sz^~JFkiE8cFrTG{QOsNv{F@Q>B~P>V8>NP^%YG?+o~VP(&)((ryr~73vE5~l zDtHL)c(Hr6KgLJGzUz9=3Fn(>txjALctDTIxnteF^MEgX)P{N2coi zT8xgudy!Yis*i_x2y-4V)2W{UL?;h7y(BQev!t_A{+Pmn-RZRNFJU0vS&9Cqi87E0RB7C)HJLsw~Jd9Ou0RO~6OrkiV_@cR_aj<+f> z=MVL~w%iC^ozc4YpabcY=6&xh(SVmvU|rWUTKJec{-5l9?l6to|7cY_hTq!#*=9g1 z9y%UEKX>}VgI2J#o?$&4h2@l8i7gJ6=)opx{r#JVI1c+dZ_!6y2Xmed?ih&om6z~# z{hQB9I2)P7Kl-48{E(Lp&$d2)#?1h0>lLy*nE_tL?bud!+TbYVj%@Y!-3uqx zaK2T1b=NJ}j#2QrU2-Kj8-=~AFSx_sr@b!?^fADWOG#62CUG#dNdOgkngdP8@{Khw zwU9CW&ahH}2Al+64>!r<;9ls|5v}`pz^M$asWL|o&1~M8eWP^XtWST`X(0#A?j)?A z=%fba*;^;SJj45ZNq*rfZ>^(LywIoTnvM&#kk$X#WqVT{WUczHXN{eMYtv54obT(P zH2Uu|lk>E&ZKUeU)@@qw=z7e!;ere+a+XP)*C=EviA+<4-PKg zKKf4Niu2s`J4@OI>0$fHHDA>Y9?+5f`umI$yl=jhnAsi8cC;9ygDrio?rk$#3kzC5 zr*0&0@CUqp`TK4?tU2GLD^sX;5KSm$!J9AtaPWHa-j0)|d%?BgOULZ|nS)`;i`s`~ z7~rybRO;pfD)`=@+4TAm2bSl-o=@NFz*v3f!-eknxzo4vy15dZCmvYPes5C`U?)ar z_(ytx#q;Brj$1JPVE?V6$zwfSospF%-f4t>!?u3-L~|gVyKuzz0v(L*wd#N;r-c^h zp1Sntp@oMdd^`M;?+&}So=D5_(>VwulV69&C3e)opKpHIXnCW9vo)b6ZG-`~edt%) z;-DVx)N^xsdh3Dj^0(HfgBF+YUu{@1$pF0D(heo5BzPi4y=(4 z9c=G-h}{4C;x_ZN;5D*j$*?@VgZSZm{e1dOffmNhpUS&0Q9*_N$d4Bf>A-s)^u4-_ zgI|k^w@lxqhQyMx>mR>jzkaLN*ldP#5Q&a$UA(AYtr6~eM?E;yQw#S$Zln`d=|Joh z8gVug`;m)T=22Bz5QIMOtIILMcf+rx2uJH+Lx)puW-P<;*`}2RP7-Qzno;`Y)9ugBJy-Tm*eO{8S3_q)eHP7d#%rDZy;TChZ-Fc>mmigVc zZ99#hzqfqePl_~r!>!dYC9tY~aicC|@@1loUJw|l8K1B~f7v@iHa!3g) zYdXhk>viz@!*>f$mg%6|mDd~iHhKrK$XGC9+gp_eR&2T2C1kY$PQ-7$@O>!Gw>uV9 zPCx7gr$<-kRPV$%g?j9r{d0AoG7M^-D9`~RcrCmrn|CHw1H5iz#){F{PuX^kn58g6 z>D`dk3;aC4;p939{F=@mE#YA6h^6h^b{gP(kFoKCBaP5*!q{750`;J*V!B8U8lcn6 zxZ6GF>fw;Ia2J)2f);o1WE zm3qA%BzDg*|LGho%pP2oFhdKYU|CApG7oUi>Q?dHOdR(Yl>M%j>ERczTUl;R46v;G z#So9bwO||{<$dWD#%s5?d}}`80oVG~pFHtI2d7egd3~fE2h&2hx;C_@eXy@N}x_0_-<|C8I)cz@k5&OY?zFC#4IxYRdW zjO}u_OYiSf@N?!H)#un6YRUt>2VC6o zIZ^)ELIv>->Jg^iEN`JIY4JbQ8?tEsOTGEOui{eFY1P|Pm~iqRx}|s)5_;N^P-(SO zjAyY;AhB41mWH5kp#ZZVom5F#6vJ~R6^wpDeTB1Uo-9XXDvr-_X;xC4BW8Bkb0|4y z1xc&JK(PTe7TUGVwJciN{%INQ)`_dfv_s*&Tv?|StVlOH zy}mQY9HzSH$DK(LVP zF_2>uEQ$&2$}R1kW@}Q&)mJxBSr^Z3`a{-*xy{xE3u4Wl1%YDUl}k$z+Pr45OY_2w zrDD&Y$}Yr8L(1=0wJ59ho~I4H6d-B2@7g#?E9PP8=~jo|-ajph|Z0p>h2WMK>Mn#Iv7vdu4n=U7fcWvvI9@&}OmtK0d z?X6ptd4hdh?OEo|47x|KS3&Cqt`C&O(`JJ+$nj=F>} zHC1`ko7%+lZp@VRg>H2PY3Gga>)nqBeB|nD*a1)XxP|@m;f)(mEyw$Afy z#Z;9UA|g&&*GGp5efP$5jO9`>CG8YNMaeG@u|>Hj^p?xq%xQJ3W>ro?XYI!_c^5<1 zhjm>%U&rmR)`KDHFSYtiO~P@3L4aO_(j4)4RVpaG6tw_&)J{`o0{e>f1l_^4Yk*M;+_a zaZvXmC_ZIon+UoYXAvY_&uh|GxwL5e?<(`H*u6RXCua`q@!7~=str$Fu zy3$iQp>9iu=3PTp`vs4c819g9chASyZ zzZbV(A!9f@J5=aZD@Cn(AI}@QB0TGIb8)IVI%rkq{#8_qO_pPRbt@lSNU2BEZ0VZ0 zb=TQ|sclaTFPU3f;JyCQqDy`9=MF2RHZ1D9Ix2PLW>N5#^>boJsAD#+Zu*m}Jvv~= zzIRJUR?e{4M>28aYg&{YYkJe2*&$P^Uq4K5gfPdzs(50V;*k4 z`Q71rmwp&?l)BnCB2~UOJWJSKxxiEz9+1pce@r}=actSJHQfO3=Yc19hzgG@PD7(i zekSp_buR+CkK1g1Qs{G8kyI^TJHWlJYr8?chHw^oqNdOA+Y`6W zPD7K%aSeUs*E_Y#opg7HJ&(G{+Xqc%ILoc!H^*9Slc^c+PmjMlSCBI0MZt+Wrw2Tw zOidbP&7LZsJtV*7ll7XO)0nOOT>74;mYtsVf`>lS6~&Y0QkObG@pR_!WRawgt3oj2 zbDaA+?sfaN9@F1G>a~vQdHuv(pY}`BZS4Dd&MT)dqGf~q-MCG(>C?*-gJ*pi`}!_B z>oO8u5K)hzz(y;QJcl#J4^BC=?Mq6W#8*;*lZb~@_$Srbt+}YZ=y)yz!CmsU#RMmN z74&cIHTy%Kq{WmvrN(UzKcd_#-!Lu1o?n=utQucvo6@zQob$Y&`lvi8&CTa^pVGO_ zv?aPi-zysy7iR6KQKE#hnB$XMzPtM4JpVLmNZ69RD&Dh75`> z&T(mTqec*`ygrsc0T zXj)pSjc&}w`? zSElE9cBO|c%Y3{FMD;hL(WT%M>QK&#R%@ysoSJ&pH`69$WJ@=%9;vkt`(b3syN|1H#{af>glouVz?A{q2(@jT14#k;l?@9G0+;Xe%ra|X=3Q1ieR zKDNG@e3lkvl;k{CA5YA^(K*AstVx^h>*rLqnLkKk7-3fxRBpDGcCwW|EiGDo$vk7h zxa&Di3!4iv>6EA?OR1lbBGbCKN9;5I;2m#IXPoZ6dh4dId1HMyx8UrsS)Z{!v(4@o z2Yk2u#9M8YA+R=6XezINwuP~cuub+H{==3nYTXY5-R zn%YwEbp5!|v&2~iqxXlT+}L966w;tVOvskeV&+5H&y-u1BpZfI25A;#y?ZA0Qb@4-grWUZzP94SU;xb_m zQOJBH-E4183!%<)WjmE>%{+>sFW#Hxe6;nBQKDvX&cd_h!rz0$1C>3SO5FDhZm%<+ zw5XU-R-4_ms?I~LowB|*V?~D<;mNzS7On6l-(aa;xw=j`LmpO~TP^<__^ObJO1BrC zeH1bFm|BxsU)YtX+xOBGo_*gbGQKZw^12nDrPP-guxcPXc$vEcISmuvd zi?gbA&WjqQTVC9wc3%qg*$UHvUbn_uqM4Op{w1;Xc>@Y<@opy-OGoXdRN=~X)Rov7 zyQw|v*X(vXeeE8NsNf5$Pfa>BuHw{)8L9S#DP=`lsGmpG?lvD0_0Bi6EKfdtTDR3{ z{F%Vk!$98pqCWa;b?+gN)OP&DJ=Bcux#L4zXD7;}?RCXV&oLkBf1x_w?X_WZyVtk& zoM+C|O22QVjn|Lbm03T4JMdZWT-%n5zdScwXIU_L=He)55akZh1$|S>xNdE@ zE_0Bshzy6wMu^OX$aaXVg2+q=Yk|mIh@6Iqjz|@s$YF@QhR9)v9E4PDiM)nz;7FC6 zh?H=KsEmlbEmU+wU=*{Xf|ZGYdRL zbOOhCA!nP+g+ix#A%Q2tMBCUZwy+ms?wRKX>Z>uGvV;W%VuJLxK$fw{>b!g-QsZn5 zA;O8hv3`xoN@4+3HYDeGTauV4+c;$NR^~SqRWz_wiRS7(6tYZlt2vsuGc{g3WU_7X~4w z#4OGdp>P>)YH17#l@B`T5G z;?3HGbm!J6Av_(=fE$w9yx9{dy*Mod&kTd-tt?O6w4e+46qSf@J7*{sqsMjY)BC5H zDS6 z%3?bQne7%7NnsKtrpbx~WeBH@)f-r6P}o6+0A-i>*p^4xyisg_8RLmgBUx1fLM1M- zKF9^>7vdU2B@!0%x$O~HlI#KTRV8}+HnuaPze9;mnWFL#IyKfQN}xpIDE1Y5sx^z3 zQ%td^JVo}}Ae$VMJ-NKLvMr^k%Ayxq%=wEu4X*SQyu#WBnaVRNUw~X?A+{1EDq&HB zxyy2tZ8c!lux-7?o{F4g%g)oHZGq;h^=Pg)TZQkHimDU*=ty+if>1oFvZhz1BAa#x zrYZv?stWWwA0JZvPUH-Deq=~s7TcmCU$Oc1zD<$7D&7arKrV$SDRaBa1+SR$n@wSO5dPIC8FyU z6AF+hkFxw6$mR;lt46vyt&c`SUG1e-TfDwdU}oZ{#I5(Kvxu(8$Ji{WY6F{Jimvkr zS(Fv=GED=jqUk8PIW~liw4z)K&TfT*&IlFzq7r2@8mZ%10Ww!uP_Dq@q!b9ovo<}7 z?JToXY+MAJ=Pk`0$Htb5gkG|ov1ae}zQ31k0aqXc?evF{6u2$*zdggi=Q-HSWrSog&jMqPu<^j{(r zkEf3l%hBVg?CX8lgVr#O!La`gu z3%%oP5@fUGc@9Ix?wWo5Vmj+vR%;UdMhh?CCRNwXb)tAd}6V6TFkZ*S!|u$ zZjr^l)@N^R^ly=rI-N>% zaz+`s7SSn-XyN#DR3DPC(c-*IhDyv%fhgb0Ok3hND*SBW$R2<=FSah4i}VaB3}mY; zB0(gwZ%C@DU>R&iF4*B9Ra<3V0A73Z`SmPzU%;@{@fJZ=ROE7l9c#Uiz6hE9uUJGv zOHghp8;LKCXJaeae5ABxiNqFtejB!^{!(6qPk3J%n#yPkT6I=bMfv3i$|N?ueFL(M z6U|m+zDG$5$C`63cn758YpRf0E~EN)YTSvDUb1EgWtaNm@h*u$V&wBAKxVfn<#;FJ zf9)Gd=C-Wze1WAoh;Rf_)iqIs=AyEq{W|F9es4R)9lf)%NB}`PKBuXNrihu7b zbLb{XSV2gTq$o?sa74#Q$Y+FPNYt~0R6+ET|3+!7BkCgLR1!~-q5&z&5mFh6?ubg3 zsEbMXLAdmUTuzGnq$o&K%0%r-$OVLCLUf@dTq5BY0r^STL}E9h8YZMM67LaG0#VHp zk~h(D67?)0fe>=bzxLqnAVU(hE#d4F6*AG05|W-eItwYf+pH8o+WxDHC#xOh_-}OQ z?(o)E^k2yW3C9T8krcld88Tn2exP!woC6N&n%$qMaFA(97)ruOqA4I`kr~H#-Vwj% z9AtG;^lYnj+3>1FNPu(Q)nGUHKLLyBv2Bb z6Osra2NMz$(Ix+DNA3=CDiH;c;twGU5S273K9cbJ{~MkYwf{}ih|&{HaZ&WujuCUt z>m90g66O;T1Q8RE^nqwWh}MIo2Si0r^vHw^OLW$REJ;KRM6^IiawJV5(7cpY{-;V~{c6O}$8_Y*Shx!ZdZ zZ_mZW^>0OWLT(}C6hcBJ`tXW3>&F{>^p3=mkef)+d)(TdirWz&}*Q#we@L@aP>=nIe4m~=--!clAL6$j_4fRN>7ZlBXi&*F7J ziR$=8Y6t0a=C)<+26p0!3g1BjC*(#VS|LS$qMs+H6%aB!A^n`Zls9|gNtJ`NL()qk zwm8%FiMY>gOrHHl<|brTQl$IyT=jlcf*t}h7fq;f);q|5gv3V3>dO~?m$iMi#!=)Z z`uRnrbnzddxETG7ob~VX=f7GjLXIM0g^BH&4&66Y<2apw6c69biB5_R)WA>k8^+C8 zXoN>j%ikSXp@L@4zJI43)jLR{yMLKu#$av`FCS%$Bzzx$4d=VKNJ zHNj*aLPjN|jK7Bz8eKkl!-j{m(;|l{9VEfn2KBDIp*#?A3Msx5GBY6;k#h_PiIa#B z$f*y6Jd`jatY-Qcql4T+$lDaZy5IRaOh))d?(6jFdFtj1Mp*M9a9;K>4(d;ytSj_#^bS1)j&i`M4Uv5wAl-m-yFV!2d|T_ z@`HUjIH>PGx~7Q+2sx5ym1vq5;o|H!aT*a-5t4rTqw#y^cGQ4>-yqZLx4eTSM#wpY{6olxgj_pExUdu}lzV&Hvc0GR zWx%+H*_2ZZ%f+MtqP>|EvkUG|b`xf$pQX0iPSK%j&=kS!+1X~?`Qq1}P>2$@_TDw_ z7+UVfs57p=F2x;7#IliB(JtF?y1Q}?iL zh@BNO(^*agvwIe6@GbC+*(gfJa!(&@nVlVG!yixcET-tTtSGPnWm6uREE}8Jc=ryT zoG4;zE$#*jHc!;Wh9qU^Q|*QufI zXCGlWr5!d@i6dWpbA?{x=(Va5!U+I*#li) zq|Q?lhgr-a46Phi%RYY+i;ER=Cm3B;H<+k3Z-aXwg57 zevs!+A041a>Kzfv)JZuQ`|`5WbRb@p+K5UE9r%v3lr>w@IOA3eyttU-mBBu>l$5Lt zpm8^X9}g*_(wW7)rT)?4>{z^(_33ud(atPbto7j=)eQT=ZnbwqLp!k8YVG#GVfdPi zVV?8%VEHsR<@ibaVok>$dvO8WE)Yos91MY64PDDVEoeG=z-oUtY=3wg=;$nxLv&cO2gXoCoMHP>37jR#mO%%FD6r|4nW{_=`)sUA#V zs-Ht86*BP}h~64&x9O0Y5D-)+ejv~Fl}HW+smjUQT4 znH#{cdp#}93x$~sTRbqn8V=GN-g`=GZgv-jUD?`NzlM^ms=eNII1JL#vlPObq^z{H z)TGWVho=miLPwwAk_*yYyk!M7@c3MAVAns7`(+RJ{P8e-mc3@jCMouo&4{sB7N#gg zjT3}FC8gb1;Wc@E-o|MdH?d^d=1}yrV!mv+l~Q>yWteVKflGwK8N%}6_Qu`pHwxQ0 zUfm9?Y-%Ka3-?~xeD*?jik1aGyx45`V7Kp)HaH-@NS%yYye2RAWy^(p(bS%uu z6gE01GzTqXXKX8|Ky;8>^Q0i#&z1N9iY%_Yz!RGb^UmeNFg$g`+@wJnRy3qDE%3n& z)@NtChYBFD3?6i*hrP`Ts;$E=Wbgo?rM?a^bflX5xROb3LWc^M#{PSEZN-S*k71VCs;DjVrucMCSE>r8QvK* z)ttA;a6jA<8cm@-r*Sru0_#tLkBDJ-i^{%$TGA}EPoULv_9~}lu8rp6bjrZ^WqJQq zV_UV9@#IC=k!C9wOMT)ll;&nTH+S{J?VP2l|JatTFnih86t3abagg)~WXtjzBD(76 z%{$|;SHJ^fSf3!POCd$KWIvbK&*1(D4+E|eW7}%^i{IGHdSTv*39L1_wz}`U&SNhG z)iz)gS6dppQ4h{8Zi4FMtV;Z;zb|l>+DcoKRk-uhqN40^bg-JUWCa#dh9K95)@2FU zpk45%EO^TFjAc!+x@2{>__CjMx)tSQn=j4~x-_`1mKZv+kDqk3Hw>xRnF45t<#yT9~(Chz9xBZCN?`mzi{=#OTHT-=DAQiaSyFq z@LSmF)^C_Er91b){XsdD2&G>em1Mzd2PNnfVZpTK?2)LL%c6$k8ERB+-<)OI;#1`#Zaq2U_Mt6mR~IP1G-<=%_VXOuSlv zPeAIy#Wc>Q1izJ0(W{rtn;8(5`Btg8v~?I8^H(Z>glXpb)KcqRBf>Ym6=1brwlIkU zYm%(U*@=#2<1O`L!)4n$;s;IqUkOgMFLq!u`v?j9JDdDlaT;Di0b7&BRN%QgrseG0 zD{a|38lOt`lS_p^V|>#tQyr4UsS5sc@FB*1afub9l|)KI&`pAl5tNdkW(18S=p;Fl zj-ZU>lrkcrAgCTe*9gi)&{0w$CFmzX69@`Ns;@*cMNm$15+gw)2)annOoA@GSF~4q zdhiZuDmiG8piboMJ%Xwdl!c&HL>fuZGJ*mU^n{>oBzq+&6+s36olh*0{m=1|3{*{7 z{{1>NmNtEpbds|GN!CQrVuBKrqAfv>$Z2;3Z6-%@5OjbXfk04Hg02!YiAbagDoRi^ zf+GLBUaaG&0)i@$VlzQm2I?rWlzg>85iq)d^@zKtKW(63~{MKtgKbnW$mA%yF&; zfiMZwOLU-{lb&U?3*#MnIFh;&D4IZ2gcnXy^3U{_J*Ri+zUlBe$8j+P>L&*!5(t3k zLL!5@-JYWopF)S z*%e6qH(-HtJb;T&pYE|X_2n6B{jn% z+yuT>i2ovIXGSk%)IuDS;a?DoFE--BBEt1S##77UOc)_ng|GH<_BQ!=vnu?1lg4(M zB4-x2+6@0Fz;8Mm70$>_h@8#HT_s?Bn|n1j=j_q~_Ye8uw()?dQ}}&~QM$Km>Woa3 zn8LCz{5tFIjC;}wxgqDK{|{T=0T$KKy+8Nv-QBymzyiClz{1|U1r`OfA}T8Ap@^WU zfY?zN#on-^v0RFX9kIriwf7cFjK;WvEtZJA#$ckc#6)b-7|ZXFIDF6d|NcJsu-v_O z?#!7pXU?2?=RK_4%7mqHN|iE%5ZrM6jKv!G*^wYl!K@Fj+W=dq3P%z61T%Hhs%FW2`6Ek0?Fmlagghe}ymBN{4T45{(j7HDwlX z8ZSnXt7IdZVPW`2r7lw8NzAN9t&n5oP%O=v6>3jEViJdklNjQ|dDSpIx+@t6@nnKZ zqjV^8HSt1#m{MVkKw%NHQXZj*RgxB1SvBFz(ZuRL&}%B*rS`#_b;_0~HD9cRQl-F_ zfp{QV5l7;^L={nZ<12Nn_?bnQU}h7s0xZkiBHq)S0sDRo|nNv)9w40q>)1CrG#Bvy&N zkHTrAh`?&JX-ljDLTZg-wG@?J@(EF-9WncG*o*!g>WaKeIAM{#5p^tM?z=cJ0OBaBOS`>=_k_AS5n3N2T!aQKaETY@-_c-M2=M17a0A1$ym>*F{Y@M55!u zIHHdG8d>UyN}4nW!D+8FJQ4zr` z-jspmdioIGRvvnymMaw`l(~(ar3#xyyyDtxv6W`8j^c2RcrlBj{3CpnnQDI(k#pF! zjJKsFN)20RB%PSEs90W}YLbAmH77E+EHxudg(?xEW2VPo(-fSdvr@saN*^*+DFRBy zs>ti5CKbM4rOP5JuBm4LVMXtjs2Q!WgHd2+LVB{KmnRdYCvAFTP0dUxf!gGaLR2`2f(`S{LN!H2#_qxo*=m1nEzHEN~7=BxVn zkiG$a*bar9<BJ&BEJjz*67F>*8ss847Sv?Ksq?=^xWxgLu22u_h57d4V_DpcT6 z*uA2uU%r~eF`W=fW7O4jQeZPgQ)Le{$WfVCF4`=5<|k-SQY=}$2=#vxGeSW6HWdy( z?DIH-vfgNvYeYRJ90@vu(_#@t5P*Gx+K=)fy2NN7BFfL|b)I8z6nTkDxj=Sxsusr> zNmJ&>@@m9AeaVegu6~Lbt86?0Lqz{^zDl*O9hy;=_^!^e6C@hN`GNS9NMkC;tLu^Z>15N$U6)(gK?imJf7$;qg6A!rE{Bt&VNfX^s=OxXuf z0j>S@N?jk86Uq7$;i!=;@lg|hC7BquHcEkFC7+{8Xgo>F$@!;jqm>F34mIMZ@?k!= z7`@PlqbWiA;eoa$0LPnLjrv8H(fZGn_y!U${$NL)Gi%6{*r`OPix87+DJrFgNIIgL z%-ubif-nK6BJbz*+BLQz0SU7RIw zHq9V)%tr|ms%KGWBCtc$TAX+MNulV$lK@5bx@gX~lcFzLD6|d=wN9D8H(6mOk!TcZ zCRsCa7i*+hgWi>?sPFpw1{=G*D-oE)M9T0((Txy694ZE=A}Pfi4NC z>q(ao4duY8K;_6$)DqXxRR&!Zs7k9h{|D+x*EV#GKz&!bHlV&TUGq?%pYHHcCzY-d z=ngYo!_c)3^_l6Kf;z#}_olu*btmcC1-*g~dfhSYfB9YX<^Sz>{qI$j;SqJtC%;SK z1p;0m*w->ZxDyW|Vn9SQ?WvHb3j`ex2LbN}OiT?F$B9bmhAtwJpEpQ27KqZDs1~Q< zn~5t9N1b3GO?(Sb}$r;o>C* zi%iCbAwZBYzaxl`kZE$Hl9usAj>b>!sX2j4Tq-y6YfuW+L?id()3gq+tp*0$fz{Wm z4x%KCglFXF)_Ca=0i_|K9HX%ji9?rCk0naXZC>wUm{2i@R5LLgFzzuLG@nYWlRBQs zl&lkxnT<#e(wZR!)mWt%Pr@(;7j_sBeB>_kkx3y2rifXuMOIMxLV@|(G9Rli(`!h! zoXNyaabz(T{!gq+s1Sp%b;a?-Ar5SW*g)nBd^E>~O?AXz%OP9K?7;`vw73j)VLCbq zDs*#XSY09!y&S9_mN={e)}5EbmBf5u!P*d!pU*_O zn1j|=Y8Qjg4DGb90kvt}})lOoxK4Pw;3TTMjTWla_wAnnWNU>K#Lc%u_y3qo0PFEs$a+E=S|yiIkr0VtO%K#dQqRZ-jNJ z7@aNFAZx3&{mv(90M*PPD2N?@&qUoC$u!n@=NcfJ=`yS-_7+ja&Eg58wR&&^rHF5t zLs&z8IuqBa<^dz>SUSs+fpY6iW^5GTcX}zES5)D17N#xpg$AXNq7eI#82OjUsP()H zI~NyU4H>{mh1lcXicbh1_AMvz%sq}|Gx<@dpDrAo4&R!VnHf)UzdajON+4P{*p-9?Xk;Q64Ne{kktulZxT_!_%Td&JbH2qxFVT2S^JN>FUVhn z69r(q^g&p`e)1g_)Z|KRu(s7RW+&(7U|MEhR6Ee5h`$QzTzs6s-GQy@Vx=5KHS5%(+c7fw}GjP4?nsx#C~Rk;p2Q_(qw&Qus2bJE#~&Np<{qGp|j z$m+_K8ZoJaL^Pu{nosbmfVcSK&}hsw(1hTG ziyx7nAB(6%eBHfkoISmlOz0aCY*#bU72DzBd|!xUn9!ysuaE^3Cki9 zttuqmau31O7`Ifh__}f&tWhe1|1_--Pvr50*?=<7P_?$8mnV}EB*6AzDl{Bc6x>Iv zjuC;Gq`F;Wru0lBKAvb)$29_0HN-22S;5JYRUW7$N{)$Uj;jfvmN&-Yyyex5R?RlX zmDU*|sB+X&GvY4yLjf?~5W8wM4)^}Us}+4! z3|KHjQQhq%K=n+G%LNq^uEu(s7#@qVYg7TuE7b<>pkD565m0KV^sFxtBQ*q_a5WQ2 z?CwW#&C-*ZMNBE<;##M~h~I@Z5J;tg$Pxr1w3^5fUhIb@x(P@#jnzc2tR{dPq1zCV zs=NLVK()$u5(To+jee@jRBu(9>aNVE0OX%7DHjmcVyf}f>!Ja~oBhTF=WqeFa6hX3 z6h`zZa_8RF@oP)UD@jMfC&$KJC{fgMUQsSh>I+hsT0{A+>OrbnGzIn8DAg>bq@!pi z8q1<64@#LxeXnDmsK#iZj|TW?EKIctG_`z-pCFg+4_~U>e1Ni;Q1_3fd7;iE1+L6K zzPr=f2L>1(J^OTfWF?^fD2>X!kyR%AnHUT-q)J1q6!1yiPns5ox_^{ShXV1a`$<_* zXxbO*K2lac%8EeUR|fon7dOo2`` z6i-9z6tH%u^W6!@>i7d?AEW?88f&Io12lwAfj%^`3`XQnuOuH*`)}QR(u4 zZWYjwK4lkKbmg0ydygAy*+VISkFvg8?R`G8d=IkPd}3Xsv1+_eYeGAR4lzjL5(EdY(O#Zcfm1zaiK7k>V*j}iX0C~Bb5 zZC$qu6B;xNtY!bDfL_XaOQYA6eUJiee(FrXZeQW##B-a6DRi(go3b>;zne61d zJ>_Z0D)V}OY5cO_T2^BkeXmn@%xp!lP|HS2*&!(ajRKE%u1Rls1fQo{JQV0`8F}Hx zU%LOWm=9a&Q+V*80TST&xa|6%Q;z%aV^P;n_T zY~l3aT9z_%(efJ;djtbz*`>?HzBlh3%Rh>2f1lV7DJu~LO47X$3Y4d5uP7Vf>cEnp z+TTDns}07(y#@ut)djMzDl-CWS!F4ki*bI>&ijuC)dKq{aDUGf`SHp15YT-+>a*qh zgKM|ahOO(PEFO+5Y@gV7Dd3i}64L_&^Z*3~K7XEXoB!Bq0J^0{wwzU-Nm6S=2w1~_}_lf*8+xV7-3Dm`m1&6zRr<4_n0yrrElOAZGTYLYG^I-Vgnr9w8EEq=rynD3EjSj=~bZcw`~{l*Wv*JX2O_3T$8HY}C!sAfPre z72TtwdvbKojRNfd_6TVIY?BejCQt773fo7wr#6V!(;F`_*0Pm-U08PZT7eOw3hHmQ zbqua$E2gYqlqHO^o;eC8g{ABass*UFxY_@4_Co_~b>F$H-Sn}AvX>%aa$AjsW=uEj{mN>~-Xr+FkEq}cLH%!Hl6K-tIW7CHs2 z)4jsnxs%S^&k|}`>nI?$abSl5>R1D;X`b`t#(RcZc6rLW{;yx*50w2r?W=~(&hH7V zWkaKE^_1O}0+=Zf_i>fqy?rtx(BvERfD8rT;v(&T0kX8Rdj8*O@z<6$3DN%dDmv-^ zUw|ww$UJzB1W>@Z`PyxjuA?$uWlFX=9q|mWRqB!k}#5n@w+O;TvqOujIRL9KjodKaV8MCK_fh=VpdPbgT<5H*#r_N50*)smjDS2 zA3s!EXG@M$@ICjd*k|I=H7hs0OdMm=`yVlL{;WZrO;o)8_&#p`LvO8HF(@CSX zr8%)VrfsK^bLDNl8M!9sLRr5$ehj-M_2JL*azA^v5T!3|HJfMJo>(DVS~uIjF6+kY zOLLTS8wLuz&AzV4pJ4@O%AWjI3*9vyBz;ekD}d>LUH_Sr4ry&3Pi9l_Ld~IG{b#WQ;ez$xO=C&11RD38R$fOJgSf$-9nj z^yC^(aeFtYGC`8q)`D6?O4>2Job@VA6TbIlG@O^-;*gvnS$yv1bdaQQwm+VAUZe2i z@D-;7NwXq^b<=8c?~)WdA{VrOtWZBf^rMvt~ zr(IfRVVmiyGf8=98s;wJty?6ik=$)ysbif>&#c|VYtp7IlrmU7FO^nFM8T(eEhYI9 zVNeR#@z}zR3aE;YC%B=kFI`>s7#Jjn;nNxk%%)CCE>+rNJm)x$zoN zk_f-^NoIf@HGt0&3^scepjZXItE^tig07l7c$j@F1_5McT8SJz8!l)DjtrAnrWDbB zYDY&0DQcqPAUdrrl*QCv1A0>&Y_jZc9CN_xWa=AO?%qwZ1rSL(Ms?jvl%ILA+|oz# zqkhX{l#07=tu=eXu8?#5{%lt%+x>KuMo4w#voa5Z#-6Haz%(n+Z8gDk!m2pEPi`_+ zRTX&_G90ro%H^#E93N$UPn8YxPlFp@aV*E9W@iTXXHUNz2+|p*2|H0cFln{4X8=28 zvP~i?)~m99s|CfflTp0h*`IX-`=hT|*uyI*D+x8@90A1xV6K3E(6aKl#fzjX?N(nZKUb z*d4vSdlr3FV{csf%)7VlV9$1GrlxT3eA0wC#^6sfk_F*=Ip2tNLvlfsxU%d(SN7;B z!r0u@LtWDf4$GVYcs4!XC9!OoCR}h<;qFvgnwPY?4bxKTc27#HI)NMQoF=+dl5@!_ zwTCS&4I&sh&)e1}00w7ytyEP2tQY(C`veOP15U{q!ok^wu}tUr^6RXN_$T``}#mR=!L}`aY8RDiPIk)qf0c~{Au)B}m9Ka3L zOI5&3kcZdRSE4ashvKv#-z*WepM2LF=Njfjr|lf79V8^pNpTbMcU@@3n%TNq8%8(f zbLA&;QzZ8LVp-6Oym$O4Y{d$NMK3sAMNFnbd%e097N|V<4X&v^QDphubrRAEkz9ehqfSKeL)hUN4yX zF^go}(D|k7^Cg@_N;JDNG~8kwSQ-ImuKx0_x&HWi4HHpEoo8}Fy@qVKp)&8pOo98^FIX?b}qgu9Jl-Z_hW_|FSToQp6% zT$)#@PeFSoJm8d}%bu3?}(CD=qdlhmcuu+CG0TBtSrJF)Cpy5pql_Ui`?ci zDS|p6&Dkm6w_>m^xh`D$g2kMrUCmWe2E!f*55npDlCwi3uc_R7c0q_zVadJeL@Um^ zX_D>hh}_P4ENqij6_&{l4;~YUFU{X1U)O$RgG6b6$jwc@o0{2FrD9x#R&sPAl@aA` zSvE&v*L*R>&El1YU8|CD3paOkR4{>`Wg2qB1l(YZ3FNArf{?OkYgaj(J{=#d>B{bP zyMB7#keO^Raj4B6l2XXBip!@mB(j4|Qdr)c?xPB33b30|KqO68U4q?H9LRXPUEXY( zEsqBZVf+k7H7XQ9BxCqfslmOU??6Gx0yC@9E-Hb*g%oqBfBd4du~j zD-Ds+&=-xS(hwjGZPE}L4P8+z|6V2kOEaWS%r+#i;p(`e5@gZyBvPqK zsW7WuiOdzVdvag@@=LaBc6E8R`hs1J8y^*=%(d!)i}tp1pFSp`Vb+biDH#pPsU`Wx z)B43XOuKl^HcO_jsE(4wCudlB|AA4{t79rONL-TTy&eH&stXo%!sXOy)#~()ni74U z>w1=~$-oLh{bhdX1s4-Ph|CKM1G~Dz7>{42*%`7Zf0ug2d{t4Ao6H&Y$Qk4MGp3@N zKd(tIutydZu9jYsbGw*!&sureQ?C>E3XQwWWtEkspYK2BG|4Fmb1!@z zb*fTLjyIn1j4$pOYp9SP*TkN-s|$0ZvV2ws+SNYJC}$LzdMXM*GB#EiT5c!j*G`f- zMlHUlKW8VWu|#L9Cz{ywB=v?28}8vO$Wc#Ml~xF)NFB7Z%d-DMpx$Jkx>wBQ@*|=zR2lWomlW@;iiVO z|L7u}7Yw&5)$yGBPmQ#oP@nTV+`D0N1xfATM$YS6dD_(#Dr6TDDme9xhH7|`STR~P z@I_esT4WEwoU!2#N!Gl)SWVR^(pvqi&`QSI%g(qP^V~X^TUF!+CA@S$Wmjit8+|V` zxI(k8*~tkZti!XIY4iK-h*bCFZ0DS6B4x(s#E?H1!IfNDgD4l5Q!e8zt&-1GxU;!} zthu_JG$v6|6;kYddv0Na5?OWB`R6hC_KS9PyK!~hO)(ekIc%bLg*~c*ILn^JK?;c&}ykfjBM!FiR6U^VupO)w;PEw>DbBb9yl3Y-pUExxldu=PrRwtPm zSvB~Rlq<;5Qk`5eX5|f8)ahNSc|vAI(v+E-)Gi4XJmsN7{Y!OBa1?Kp)DIgP6nk2* zO_EP1O*)~|C3K3ZSWh}cwQwDX4Q;G18x!SzG3JrWy}+D2Jqmrvg(vK(r!{$%t_Hs- zlVy&~bHBL%l&l^W&&-bEdS6)T47JUPN-QKT36k41;4?V&E#X)~fx4Yco%V9%iUwU} z(a~oaX1Yb9H+X!ET+P>h8+}u&zH+m z=dfze&?uKI>p^u4Z;##BW0C8Xx{yn)Xe4A6V*PY!vR;L+)fZkz%`a1Ja3sw%xhGss zbYB>Iu`+9(cdNq6L_BMSO0>MGx*)Q#zTTulE?J5chBegwTuI_D>%Cnu&z!pwWKptH zvGa1>U48Wlg#qPl`HhcQud2G26}SnHR6gp2sOa)(tz>q-{KkrH)q4{L^H}DE&|M0L zTesCY6=pk1@YhC?r-rGps$_z?${uy@FLi>CuHqGcuGFKPjQq)NFJy5*#}sbUSCl4K zjBQmmzui20jQ4eQ#jlLZo;I}bm@G0^)=k~sMyl4WtH@TfLSi0g#Ll}&d|$<$x05F? zqGZqWF530w4(Ytk9i_9~$Lq8#(MDR-K;;s$M_yKh-sLO%ygGtm8pc6lJ z1gOJ+^Wk%~?ydU2Fa`AH|Hc&j?^T=+zfl~h*;+0X4QnBVgbBt2LmGTWs;Rq%q!Iy&1T_&H1quft@iKwv1+^;*H@w}6#Zk)P zDyWVO9E4MsVskOcbq%ab#?~Nx5S4)7OQzKR53DOuk`V?GF$F~ohaV70BRE)mgk#D9 z^aLalM>v8m4*B;(4TzZ65S5DnRt4t~LKwZ^!1CFeD-I&5G$gR*MbQqH;PJaSL_d%w z1Q)9aOesLn8IMJ&Dg~wtKa)E6QVe&OOG0ZOoD6~ot{FQW*{Ff5`o6xpoAu*b4lf)H0mZ^w&B^o7w2 z{Ksengc0+^LS!y?3CL2EtBsTphek>^aEuH8B+10du-GV$AvpX{AOea`&IJLIDT=qe6Db)v1+prMqFDLdF zUkJ&Z1!I^RVkb*c!UEx3HON1X)X@vsD68d?sxpKRkeEs=Ap`})5RS(Z5HH~p_@zZ& z634M}EHHVgKwO9%vu9y{v4kzeYaEaAlWGK52lbnfY)(*n*C-X>db5x?P-$IQXM8V1 zu<}S-Ct-~lcL}?g3>7$X85_}j#)as z|8-KC+Jv!msX#;fPvz0ops2+XQFon=U+T8gl?7dK&=trh_ubu5ouLAH#ELEyC`^DZ zH0Z*C`sCE-r#?LO>FIWR7x~iaY|q-9q;yq8Q4@4sLS1^g>Y-=~y30>pe~KcYOAopP z_}9(f;{RV}jTZ9XX6=8kVoxEPXk)fUHPNskn<(LN`6vl`LL+6?1c=GKrgQ`F?tp`Gey)oyn!z_@x>!i zrFaR53wz(LmsaaJ{K}#BAo}vYFdt2Z6Q9yxfdzL-O__pb8sRx1Mp~ndUv0xH1x_?Z z7E~V8WYll`UzA>>&;4Qw7x!h*(S#>%8&&D~Jr zYg$C)gx5KFJS>aQbgZg7Hc-a<3Yl0e!eaw8&w4~>xIAoz9#qmtr? zN*NT2f{+sqWH?1IB(|LQ!1kwEQN%7ML5Z?V zG`^J;c~*=<>2Lxef_io}Vf)tHe8PcO^eDk1h`zZWZ%3xZkp)CwP*be_gv<_^SY;Bg z97>$(0<-{lAi`-YLT$(<1y~f(OmmO|7irJcl;$N67D%}{j;~HiLLp*9P|AXyHD?jf zpro+2_(&0c<<#TNC`2&V6jD<$lqu+mSkt?b7lS>4@50%mRgQ$!&qn*A!8W0wh$C9z z;JvUD8F`=sQlO4p(j+3dz z&(0U@>Vz+6WpO=oNJo`I!X{}7QM-ja$zeNz&#b{4nWY-ctaa2lI0BIbP=A;OD28}*2obBGW<+rSUl0UV-dc|6UZsZ7R4NiXbPO#xhN~q zhF@~1xLyH-R~LZ1KVqIYb}ew~Yt#cYWuRwwF&+*)M?#7iW=(2=peZ8iHTZ2nFC zj6H%wB%bs$N6oI$+@%uEdAT+$466{&@+f%JSxJNAUC+da6Ma%YY&nsjW}x$Us!hJ_ zA@Iehk$7lKsKL+9#79u+&;=1}GYPK%8%}U?8JaF4*^5v+B|$R>KQlb4QCxG>iDI$> z-3RHPK`zC0EpUhrV%(~Tge9WVB1JHcfVdSrnN6}gMxj%KH^WgJBV-zhiz~%?NDh7x z8dX7ql0%K-K2cJDWDh-=gW8GP-4D%2A@*1N%eGQSrZvtv&{Hh@@e`?g|ZZFZ@Cj@Bh ziB9*6?`%z3Gsp}Vn!hUUbVq=&4$r^-MsI@aE4p|;>L|hx!-%M*%`ty&_sAWiOrB6D z*rS-pgJAx$$9o2^GQ!BqXS=u+8*1}`s+eEDZF$OEn;*;Csm{`n9%dNSZSsw~nIiP- z(BY@%qwCh@O`?aj9f$icL-vZb`P%4Iu5sHrHEExv7V!e-PW)1Dj|jV*tof@Zq40BV z4;Xsd2*T)de}C9$uFVgam$0J6eJ>lR3k!EPSSP>~=N7Yemk4D$KJR{duDKRjM3*S# z1M7Y5QO^W%NBejA`k@8fg9G106pBE@jFE@m%HS&_REIxVyyF4pNB)$5ar3Kr+Jul0 zI6k-QvKdcJP+3vZV`(1?By~O$wD5P#SJ-Laq1{7Rh(7=FNViL7n6WR$Z}4^lG;^pO zuanL2>v!FQ5`M7N=9#2_v>mOc_R@be`_=8JCyVKW@&5MelS8>la-x1yfVW4#ep&M zw_e_B7(dn4)_+v~?~zOjI$zNVR)BtX^lppzQJJ1|KN@+(pA z&U_xdqJNkbuIJCKv+j38 zgVbe@Y|!b?7m;T@O|{E{P1h#7{qng0e@~zK(>AREzR+qnl-fktc|EhotGgEP>$qTx zS6vh6=M1VJF*FFuQ<^uvskgxDteunPJ%V7t3!!0fI}5Z9y}4p!p&3-S_s&~WYJlzQ zmo}R~6dY3I?M7Y$i@XR>L1WyiSHeQx*hQ2EUs|~*g!J#j^b7!_2 z;jHv__mn$EaM@?{&zzaj!frgi*nWAvP5R#3iwS+*_C0-N&>`HkH!0K0tqkOgQTC~|cX ze`@t*?3Z7UhyS3t8wdk34I}PxA<*#80Ve~n{#oBYnG*546=G9|I(LMaAh~|$U01t` zuyD=P`kR~7g|GVht!O(v2-@~P(z02Gi20#2)lvoa+msW7gVv(G|CFzuBBw9C?0;a^ zydXHXtZ9U>%?cyN*;9Sn*Mq`sQ6yCF-q3ULTAFuH1r#Y(|LuB z>d?nWQC|Z_R{!lkOa%91iK?q#k-X>G~RDjXv z0y<925P*X6dBeG33s;%J>s~`INi;!yruuM)Vlx!EcNHeRz`TiXH=7zX^994IIcF>0 zSmEPnqcF>8f(y5w`(*C7f~I9g;|_8W>h0TV&fa5zlu-N2sOM(bGh zvq%|B^KdpFJZh<9uNHp#kXV?1#0atv-QMkMUl#^t94V`c4~55R){B)P1{jr;_weVz zM#%r8eQ(?MA}ntfcE^995q1YU=Cw~3V5NP;&a-Vr7}M}X?AUXDFuZ=xc>xzJaIdR+ z#VO1WTCuz3L4&~tx*eZ0P0@a?NnZW)pExfDEFSb>%>`pEqAj)F{1f}Hgu>HC3o|EI z;(W*iZ5h%~1ZmAJ`J7H6@MBV=Cg#&-kk2x=--gKLV}t9y+_%&Km1SR_JA(S|;T$!* zX&V8yh5Z;mb(8=@M=yCWaW~rki(3`5^;T$??mOb>OEYvgHXQKVMnpcZyp+G^B;vRV zdThQO8U*$Jvg)6%#CdPS>P@C#UpTw;NNO(Tchyc=nexX)l=G?SYZ7@AY-n?^;RLiZ z6M{SbU)a3ZJh}Byp_bxz z;)5GDT{9~@H4Teh);0*f>wNWI$lw0(a;{O>l41qlwXNGNyJZINU7qufJhnh;!K6#+ zD8CnTSFVcaY69=z2zzs{Am}=1(e6cP@5k3$)-7_l1%%3LO>SH^K$ck0|C{g4aPHnC zy+?!*X#U^3#rIpCJ1fFBBlcwHmV^O~pPXElfBh7WI~q5k2=v*1^;`ZoB4AaYr)_wN zc7`I2b(6m_za3$!rD}D~e}C-qA=QJ>ZM z#>1}zV4?m)d#g@_m!<1HuROKFy)(bPyztfl8yxj7Ry;HTMZEe~*qeK_2nOxVXA|?z z8erA;2S>nS@l(bb%)_ldd{iDB1l+QZss=u0py8%JQ&Tz?mxt8m$Ns^+LzaI`U66YE zFU$Sf4DG%+@ucFZ8RC1%s{36xL+06`<35`l2B9xY{#4Bgg@y})c2D`j57v(Ael0|> zz!ur7UAzwEwqbc>7quVk>UVg>>QVvDZJ&6(!Eh0d99%GOp#~9~N1`qcjR=8@>*qC{ zt3`XhY|!k|v5tv2m?C`9tGd?NT~_DZ*%3`RLUPL!eQ!kP89MFr3ubV^=m6YV#Ry8$7Yy8P-yZpr$7& zDCIdlfpNNbP>0lF0n(ovTHK2_LC%9?`7J`tKx1AJ70ot1@-~6bTGto5j|IT1t?aKi z11;bhQnB)P^lxrP4*RZCMi3(HM=kH)EEJ}lYqo3Ubj*KyT>Hn`XamqQREvqJ%fVM6 zaA?}rGfCG3I5BEQ+?Q9; zRv+>HW;fPP|J}HamjpO|>W!(d$pka&&i*$1?0@pYKPhbfy0;+|iqDK48{12S57Fx? z&FD|HT>j|EVJq6dHcvbk^bP@D_Rw^w$^zQ=)l=RtH33D)FZMnwzcI)J5nl?H!3_lH z8t;EC>Ancw8xxl@-s(;w(9{$ZTawmKT`Id~gazk(FGV~vgCd|?r`M?>bUQL^>-Sygz^&b8$maw@{j?kTroCpkpL){&TVM1evo|=8H41Fu%nCAlyboYnVs~5)q+EW1j;%u@!$P5uZ11^<0gW<17@BdD$3Vi|T%Yl?1`xf8P9D#{hwG?|Q*7T&Iq0`LbDvFC6=7`OLJ= zRyeh{@}c&k2!ZWC4!s?Ye)F4zHRHpzQ1@%?G4~D@n6Rb$iy1MYFtziu(>^6;_+_P# z*DX>2k^8ag#XBtwe%~EQ&do;3 z?yeF+$nee7COG4Pne*Mr`O2`=s$h-PMnqWx#`o1F*#fbiLy)o%){v)9b-J~1maPhc zB?o72>#*JmSBw=WF4Q+c>Z^=C4RGGxvA(DHyO*JsTKz!>&pWb30vJ<{2QOHqhZ{D< zmjTm_@B=yfV^|fQoCqy=dtZ(6ag0kDdYmMOZHK%BpcLTs`h2x}bb$c3 zBbNL)&uD?Y{=%u_D?(uVHx-{X9vlRJOdmX3sk4A+iM)_h`+VCA!fL% ze%Ws52TbwMC~2>3m<2}8?=&!TCB}>VMr2>s1=r?f|L|L?aOQvrO)eg(UO2!6)~mT) zzBAx@Gv~X>ykBqGX7G$2^rH#ByS*eWAN4;ebJBRj*QVNh?O}7yetg=<3fBgjHbwRjA))iH zYmzZukvgS(&XQmgOq=rjRlGR_mL}JU=_fNmk7O|>_L>NjLwX&$Q6~`e&iBW&rv(9p z(|u@`f9d|CU@*v+6pWpO_GM(sz{Gt9xY)@%Z)Fn!&OCaT@f+&9UHswD_LCy$d)?!g z=nOFF`jCwW+uFc-y-fzYz+&9*1mRF2Yx_$#s3}TVd3q)^mbio51Gje0~zwd1m)Z=i<>X)HNPE zy5(yNJk<_P@pfUHuYKRu1lNCezc}k%aR}F+$_>WI^+tI0HfLGbBtz{9uK9P%|9tPX zz|HM5;2`=(M;^+H1~v$Rm6=YXB|H>ve>=U|Uk~)KE2?j&dW&&<-8|fEWqJts{G&szPp2xqizfy-YB z(D}O!4f4X#51U+k^<3qDPSjn_X1P$K4Icke`NkL=022SpllDU~z7#N{Ucy@e%p3E2 zH{T{e_vrS=&P3FM7N<{cp7|2Tt*zCEtrG>975v3h9|868i#)$aKN^7Um97czsLfyk zVBZ&YemReFp(jF{8{SVTykP{IIH>2-t&?8g!FjI1j+Nc5p#ZIlMxAzvkW;b0!EE;c z__oL2;Em&#!a<$G|M;?DjEM8}FR#~xh;XiI{oVAmAc(lwd^_N}#^cQB<3YOxcr@^^ z?(>;uXnncPkiVOTf%h-Nj;C}rgLI%{iPQr39WK7R+rA&3gj`xYz5YZKBz-n=d}fvi z9`gpy-1-|n2PMzQaP)6>j96H|2M;|yKWW*2)>@nLAoEf4mqYpq@ZFNTN#a;smyUVy zbC6IMc8a%iJ*`2|@{Bp^D}xn!WjtPYrk4R|N}_jXI=_l|Z-F28h7CCtX@dLQVc9y- z3|oG^+Hz-{0QC+XDZhC+1TudAq4zy6j3-PVne)>cEl3&pN$HXR6Dsy?o^nhCdctnW z_jgjcRw7(jAQUn?%+RmNS?%#jBB*2csmL}F=kxB1+u*uK&VKyXTBL{So#{cR7GT_9 zs%OB1V;CnNF!WJ)rWum^jhjC5D}3*^%IA0HV?3aGmUXrm1YM3kj8kvK)DF+P+uHu5 zgAVt$Zae#TC?t<5D*IR^)}|U!v~FkHUM@gWGw0Fxm<1B*p6mJJjsQ5(Xmhy};|1}+oVMhNH6~UHa;>KHpXr{+{**wB`pqE>dm)6 z`(DatcW#NbklP*T#L7`F9(i>;-&x=XG=)u%-p}*KVw`4YuM>Yfe`|ru-3-R@n{nQp z{-W{lVhea~zPe-bISbH~Q5z#w4>qR{unNcj3ID&-3U7+g ze8>^6UHehrnu|QW51!y` zJ|pt^@4+zn{qh3aJtM@+(xS=bAecNiYgxy~CKzT;DTz$A0A*HKSmvwX4+=17N#B$E ziqNhq*DMQcbsx2Q{hr-Gvf3r&n4cPU+=zDYFWso#BkQAG+jQgDxC0jLn^-g{ALA(_>O6XB`^5xn zwx7P*>9PPqx3%+9aQ>wyRL{>Fx2^;39}Or?j5UUtVXs!37mI$#U)}e{J&^}Ms6KGR zt1T9ozy8JJo*w95Jo+Z+w%r0g>4En$8<=6@hnA(kd79w$_}KkqfY7Gc)+qrQClg9SEuHm+wmg5z+|;*rY0(7zjY;|)0e|8A-=?79?ztiG+3mkp{fcLCXlfU)`CFZ3^URQIYG6AO zYK7^`cM3V{aK0+6|F-=G0j}TOT<35j3;ZQ)UDS4_4c8G-h4IVG(D2JJhjDihY^&TB zw7HcL7B};<{El%XnyTpLfjxWQZ3%+<&DQ4knSk@b{(YNA<@$glrH=kwtP%GIS~NO; z3**ZBw;o;jg#gc+88?J}ZiDt|IZ5qto;XNRRLA5D~A||YO*&pRYQ*ebf+_qGI zBnWiB8#^w>d0BkVpZXsCf~}jXTj3E?=Ziq%&v&@C*9dRU zKFYZ3G{ZLXs_CL$m;&g$HAOMg7sigPcXP`J6Wn-qqHzSq7dy!EY?d)NE<;ZS%LnOU zc<(c^%26hGYKsnO*WCoq+TZP9+GK_wCUyO4csa(yKAp@SQMjqW6kJ!1fA?|W$nbiQ z?dbK~IzAMFM<<#tKl6u2bJp*ZjYdB&;G3wbqqbURheZ?f=l(9olfobK&dl2wT6<#n zmHU20AllVwCr`X-f7l3H^MBdv)MA`_V*cosoedyVIe*coh|pzW`{OgO1wl^pgSzIp zZ&CF_MOHD|^V0C&=cp%|A?Wa$A0}KifuZj&EiN4jgkHhxyZ<@U2%%$_T#ML(c8M8U z|BvZr7;G`gzd-%@=*Vc$!4KCtU$y+@Y6qMjCxt%rI2jB>o)5b}4dW@FH9EDiKl z0rtb{BdewcL2+DE%8%GjO68qri|z-3b=&umpP~Mxm&6N=F`i#t)uj78Zvn=vY*{~` zoeA#9Ke~V15sWF*lJ0pn34TN?GZRALEcteT?7kK9SM7h_zrF}9za8^im#N6)5jK17uq2E>O+95CYOz9|`g2VT z&To{dW$@KEGy9|dQ04=gB5cLLFH7oeMP`f@%-ls4fnLzqf~lu39LOkoBYd)rc*T1^+!vu;N=5F+=9gQJzmJTP+6lRFd8kKI%@zYF?vcW*v9 zwBV@;GWxx3*7#*G$P(D8Rm1ASYUA(z!8=75-n}xp^%~r#Plg%G%XVaHnyG8q^W#`TPkz_>@>`&CQOKjd?MUbNm1`?bE$zGt}q zcE0fxdEQ{$5B2|PGZ&9I3IYuUhoe6pe<+Tn?BYAx1_%%lF(4pV zH*^p%6a{-gQ0&;T5}F{QB6dX$*sz0QZ=u*5V#AJ#9=lkN^?2X-|D1dO=ROa^w%OU) z+4AkqZf1vE6@DBFeW}RTXU_R+uyElsZccukn8ux%zeypIQ9E@f`$tvwbo1lPPllOR z^yq~yN6va;UB$aFZOn0;OURE-DY|4u_0D;+S|ESpcaJCB#yNsv@Amva1L)l{i^U;N zJ5WEC=;#>*EL>=Bm>eD>p?pp0%;bDm$`m*L^CC+`jknz4uYU}E-l2mJ*0e(Z{jT=d zo)?a^&EnC6FVjc#TH{J*wp_nwjq~sS{Orh%YF7KZkYf9dxLEpk()a%+oYnl;1%Q*<^Zl4V+9^b&a@5pA!4W-I~F3CI`b7{AP z_BnL=(&}jv+V+&#UtRp~@DAD0lT}*I+U^oMt?#NeC-2H=@xtmIjqhD)^XH6J4GO`3?EG2gY(kepTp*MY=D$wrUSHa^KyTJ|0kZ80);pD&sLlA!*EdD134AK11Lh|+{Hj6SJ4>TUHPO_)rjTX13=33KpsWFP`l@i+U z*NK4@avK`g@8OerzCB&*9)3Bt8uuIy#v4k-mUQ@-aZxMno#@Jy7uaWT9^)5fI5X)f z$q`Z5AwgT3(v9D9@huowbeI>z*~WSKkXf^APfSneh11UYu8t zy?6L*iUsZa#Qmhy+J%<6_nFzt#F;v$?)W|k^H7=7dg6G(k!GCKJNM#=l-`@yO?Kp$ zgyzQtw;VicP4%`cip~FJMf>G->MQ@|Ku5tK?+`0jdRTPLeQ0+#S`cU9#H)nGqx}Y= z+1R%QM9uul>M5l~y)%ywa>F^@zKi!(M&bPUxAoCMQ!FX})imu%Lr2;^sBUydhkYNBlD%0}>DfEX3?YCY}(=S66_nkN478X!MVx8`os<9&h#{Y#ilCg^Zs)mxIMLb8`z@|`!<0^ z{y6=~c2wrZdh&U@43=Y-Sv*{fdj>m~-&)cRzy6Gvm24g_p^-18T|XUmpyhP|IjyNu zI?rfHucyBqY0k(+(y@!|>438hDH3Pgzv2EY&`fcpVxQbqRhV~YElfT=6#I<#GX-O- zuH&B2{oY5WtPs;S%UK@Q){-5=Y-#w;X}u2nI-^}u^Cw{ZteV<4^${2Q)i-ASHcfV> z`_`?wDwSe>?RC1RHOAw%KI=_e<0SNk(JroSmJK}_+BIeiWR$N*wDG=iNnw0 z`?93KVEa3y*VI2zpTB8G*EO37as{?Dpr|G@DHG?EYtpA2U0_cOEPB;yu;kf z(CHH#J~*d1(E*Nrnx_7i^xeljo8%vHE_Lqu=1W>@+UuQ7!x<^oyEpa?p1vFU<6E6n z246+A&h8mU4SnHK%ahHSV;tzO4m(u&wNlz<32jpK-Na1r_3ZMN#RD6qwD%NFtk-3H z2ZN6FcJ#)%b}L)AUV&ctzwb~4-Q4ob3j4F3TYC9d zpLL=6zx$!UKIgypT|3f+j?NuF?bSZ4JHO@4ebC}Ui?cp# zc|J}?ANHY;b7t1a!UH|usL?jao4_|%8ocA~28MYXezInZd2iBFp#_rLGE zPSTh;(>6g0xr=F%#P5?~59p)ibE>|DxYEr&i+69r zeZCJf9rLQ8KXsV$GEZTwxcW8r!-4Koug}Il!S-RW za8U;uZ*@v=6Z)QC5j|ZVL+|)LZrJd@vCq1Hb85y;FX)^5l4R*JYbqC3)J&5~sMU^! zAbYhvjd{7@+l)e6TGe2kaCwLmJ?+-}w!57poiINyZ`=qQdgthxTeI%iQrY?Bd3Pt< z(7mKwy+9zM343M9iFz`z0d6$fO|NLY%EGc z`#I4Kb(e#09kr)(${x8V;X9h@I&|FMSa&o;G#A$6TyJM`YK!ki2fDT2t!kffR`l1y zxv#hju&>K7ZT^LOaWC1@1V<|w%@0g{b-CJ+wpmnqZ?-vMIqoxFnPBU58vD8K?&Nqs z16!JQuix;)xaTnPlq|XPX*asc;?3Eltzw$ia))KnWKT!hE}Yab#F`%2=drcVL`RzS z!r|oOa0|Nd#U#zrxsrdMn7u8TY;_gme}eDUUmGp)o#+1YEji^%*}3WcSAK_{=hqBb zF!T^EA9EV|20PP-)^4$3&u}lT)JS^XL`tpA+ck9m;Xs2ropkPnd9G9Eb61{Y-!tdZ z9CRa`Kh55IWD&l9za}|EP4%;+PhF)gX4$S(;kGv*Z@QG4@9;77#l3`J_U_p~Y#gZb z_#+)}?y#X&OXm3ZhTdS{gp14jV;whHR;`(Z?|;SbrtP72&NM(h;!A&wH;;Sc@6SPh z3J!l0b2ZM1E?9K*%Klp1A6qfBlJnMu9%*^CNQ!ftce@sUWF9)w7w^~4>GKBr-Q;Jz z4`N@sZgNGM?=I+NGe&n0!1^V%)AN{Z>v7IdW;5o6G0w}ihYYtT%IJIjh2uiUq2Iji ze*G`5{lBmMEWPtN`Uv=3<$rX=n_3HM&|%tH(*f8A+-(;TH_(BGT`K22NwlMpSB?%h z8zrG_PXNb{e77`er#&sZA@0h?c_r_trP+L634QkVSAemREA3?+eYMMO8@hQ`s=?|X zGJ5Td4f~FsnErj|Tz{MK4)jF$(TFAkd-{4(byz6cEjP2%o>|~;&r*5kJL93R|Ngvi z-ez-}ab=Im;O)4V`^r1H+)+x;hrEeC*bC$9zn1mJTy{5@w8VzWn{pETMNYKafUr|> z!(cHhBxpwd2y5E*58x-Txckmq|YwOsk4wp^-}Eq_NN1OSX^6*n zPo;XinTPLL0)JHJ*)nPveJEFe`n!0HUw#@XfqiK1zK1V)C zXwPG5>{6^>e7}!7d3=wU@;>+J5n=2~j~r`#(kauLzSXN=x*iDoJ?%Ln0aAgdq>M5~~|5|XI zn)1?TtDOV2Z*aKy>=Dkbo?O^@a+nh>t32{);sz;Q<X=@`7sfCyv^Ln6_FTs+;tuI+=U))(g=f-i6Ihd&`>q^NuVQbvuJo|)#vpw zN_%>v^2@MMk8NmLQi%7rG<=tLtLF@XzG~n+vpeHvxzc}Pd7qzR-}$VM+iNT6i5&iU z_xM1gJvDr}Dj*`tnZ7^OA`N+OLq`w%TbBCTiM~7icE+AU=sms0+;MM|{A-bLeBI15 zUoiir-YY-s`V;##1?TCL1E3c_b@Q)K30>G_*OER%q;%!hTcJJH*wU=w8#jIE4t;dH z&P)Ebb)qi^9r!ipwgb&)^__n7j5Y0)AGK}U1?-!)m)4iYVm&kK^`28Y|zD=oX~3%W^Y`S`Fd&FQ#*Q@Go5$R|_EnZJ1S z_5y2K-?*Z9FXmTkrYZLz^y4P^nOg)U&|@9^z1-Evo|?Ix=wf{W`br1q@^9!1SHAAO1N*WC zAGY2W&63hfkqc{2LO;FPzAAg*3Rvwand?!!R!kqJUVAmM){W+_uzi}}!I`c)bN$@= zAQ`=_bPV-P#eT2x8SM@|Y0a(v#e5^&TikA4+E8sxL;7~_z&Z{+cuCWm7_`H_g3;G1 zaUPn`gG{!^x`%oDcETdG>zw^Tub^G`_*NLT)CbTW>BO z%dc{!m1nBM)Nicmt4$a6haIt}ZI(S}#GZ%l#E#~P#7FI1r1T7XRQs5p4ph79`Q6K6 zN7`n&&^T;I&kvh%FRerMAea5P??L=7SD6ZFo!+p%3lm+a}N)r{_}c z+7^4o{%i5G*UH9G zzhOZ(siykM5S+j4_5EJ*9{cQF+EMEdFLk1gw*&f|R=Cpa?N0?uW36b~%at|9J3G?1 z%HD5N!<}ed@a}9c?296oj~|zgc4#cOvTiYgp5yTq$5lA@jbHfrcgFwq^^ zu?b_pWB<^4dyU0ar+=TO|7hKBP;mwB&F&pMP_L6Coz}X#{0P=L`}7)5f7iF7UG9kA z*5aHnIQ?_;Un^YczS1eb&){AL`O%|)0~h3SHcaB-xbquorXV*eT@6E zmu7suSAqNJ%8JIhy{u^Cg6P5yxHsGO7~?)y&xRv7m)ka}(aae0AoJ@{a&vd=XDFGx z1p28?6SmB~Gxt>KpYP-T#+7}J zz1^|?jatC=JyqdMrN6E^ecFoek>7*C51?m#=5b(!yPZA#&rf?Tsq5wOBbsE6^tiSU z>t?hIy_UogweyqFV5QrsV>mBAJ!9;GaEzBiY3>N)Nw##`iF*qsxI57gsa``3Fn%}w zb7=LRnvV2a>pP>BHBwr?dtmvozo92Jei}T;$bmLn#%5l==0JsSYwTwPy3#YUUxOch zbfiBgOy|yiZ%+gF-k3H4{YW*8r#Gb7m6Fhg0V}RZ>4EC;t9puUXxmSb=lau$XZqnj zovsnu&gxnq{F?^Zc3_L4g{-AjmRIY-Wkhs(HTJER&38wnRTmKLo%1U8dz& z_%VjDnr!n*4c8-sF;14`h#NFK-$RVaBu$QOt46QaS4NO6$#oEv>4*5S%t|!5&hj#Y z=!^iO5pX+1W*PRYtTnGJ=5`vJWi+I<)>13rc@{ASDY6{#W%WGoiX{Hnv>fXPB;W6B zlF5{c9NV|*{2qylcC(rT?SHoFQBHs$M-t>vswxPSIGQ>s>m5Z`3j+Ken-13m*howb z!XvZImRHt0%a<5Ljm>VquC?Bkni|FwJ?3tb<#mY8DvU3p=2H^69S1%tOwc-7>|Mp} zG&*SkxyQ0R+;GYxr*U$TMs(Vb=T%Zxlq%mSzMR4HE_YZsO1aVM z<{_T%-m-<`(w}g~`UP}7_MV?!B(Zrc((^x`v}m%%$@XPpK3T8jOslT5eWwoX(c;-| zrbJ`+<&a*l4`qwzv~INj=c^uNITmO2C^ODiu@#2N#W`Wb!64>rfT&TB--F|5y5y{B zwA{2Xa-*X~Qf;tt_L3qFb;8?Up`7L=i`7!8qu3xkBDrL#M(XS~z@X2-$0aMZQWvk) z22rDvm#%FNBK}v;MQ0>ut^b%A=YE<5EuQqgDN^}QAcs-NnQS7-+{ zf5<&_Hq|4ctj~~Ds+9@%xSeNQy)g7^qvgq;T)Dn}kt!M{M}+eX=J^{Zo3%GPCGA(6hK=z0sfkQ=pS;>vHP2x6)r%vR)vmsr@vMu+fbSC2#j0`HX~Ql4{L!%+ z*W9Sw;TM|3^*V&Mcqt93Ic)UVDVdScOJn-*!P z|AnOJ$)z7{o(F|?yH*xGb?0Q;*D0ah?><_@J@RDTJM~EBk?EC;vvGDG<&Szi4_`d< zX5IQPhyLo>niM#@rHlRd>t}lXUDJ2&r+xPSd^*$nH=|T@yfvEy&-J-p^RrCqIUMIO zg;BCHC!|@Ur;r7h?XAs~#XA@c(GL_iHq7(8?$GYn(?E&gl7f(+aV%yZP63!;x@4QRRsCC#Xi~; zza_bLn=*B2{I=2k-X-e$zMEHO zJMT;~-H~{@n}y4BSfO<8GvGq8o-d zZgp1_*`%#nG~@MfiP7q_%E{SFmh4P%=`KDWyJfHG&Z5*#lW$*8S#()_sc6L5iq)6K z&)etR5;?N_lL1#|f9ay(Mx_Nh4ZK=3&3lt`)Tlmvc-NK*)t26uQle+wX{WL9*%q~M z^povtZhW2Sv$LvzpE+Q7_RRyQ_wSy;?>vk>sHxidK-H36W0jTjZ(p8wpxQrV+?ai= zyLX-)I9StZ{Du#?_hxtLdgMkFciK_w2OqX{^?ki?LcB8ZVM+7BlkdZc+NiWS-P5mj zj$!}2F83a}P34FkJSG-)tnX)W=Fn;Xw-bvOl(x8p9zH+7M7XkU@Uxd?hcB(ppSmP1)S#{tM;GZqz1Z>W;vGMTcsR+&uhtYUP4;uSbL)z2jd$&FhHm+eurG z-d8M|e!P43yXe;L&D_2jb;H^34P%a(ir!_M?X&*F_}bj3o_l6oo@E!UIkWe9_=NG- zHV*x~b9&F$T*<6E)-_)S)*gR562 zT~B_Skv;eGzK6eB^G}$z^v(S7WZ3VYf8#|+rJ5~OG5ie5aZzR&+1xM_ot?+))|w@V zXWBc;YTiZ_XPZ|yb3Ion_~VOnY(J^C_0q2u6sG4&-OCL67Ssy2r{}qsh8PX`8X!6? zACf0AXx~J=#CwzGdG9RaPbjFfd6}NyHP3`$M!4E z*1L3jKVK>BFWl^RYU%Zy!hZGh&G!_Xavwc$!Qj{BmM8U3%L^wKrMPbtUnvObxG84g z7-4(syJtCFPna&6xa^6IQQ(Tg76u2KKueLYc2i_?es(3D-Yt zt!7?vo_CAGL-pC9mqANH6QxepFV2Prc$JitZrUdsaPIJc4<(s3o0fWQI~O(S19#o0 z7FUHhBIc$C*(iOwFJjdBxSP!OuQ#qZSfA=K^>Ck| zUnX%*{B)Mz7DOhQd~~aK-{M)8anVvT+4x-iGq2U!izB*yT-{K##d~Y`rO^Z1`;3-e z^r>1MHE#UUwVC%nJ?mO??o@i=QhuY^1HW?vq9?C!zwSl6t95i`^t9Nrb#G_8_INVN zbH?SR2G7by_Ixv-VAkU<8@}Ij?Y-w_-^_nL>Jxqijp?F%C#cr&qHZZnM=#BFn^I;x zuHuJawMYJumNLP@iXhjBtAzuX8Caf53-LKWZ_N7F2G&p0LVJFXDK4xmbTEGr7Cx}i zbk(O#vZ!qlbN0rr*uHVI$D9t4!`-eGU-Twd6w;_Mqpz(k=WX@B@gm}GW!!qNEPl_= z9oo+|ysj~vS`pM~d(7g(>zmxBZi^hZJ#NEGX@!N$_SjS5Nn2*-1}gV&?|I&?Bpa!sB`?DaY+VSb``-B`~2ey@{P zYnx7YyBWARZ*0m!m)qwI)q9r*t5Z97x4k%`|Gu?P$ByjzV?d?ax4Jx)9W5Di#@LaO+l>bfTzkJ`oau}~_nzJCbL4)f z3A0|^eaPynR_gCg&+l{ZvDM#)&i;y@wA`rRsn>MQrKxWxGtB+xLt~Fz+dO{iu0f0Y z4zWDi-!EXAXYAlN<5%{*_h$F>lSU6(3#T7*l1!K}WcY)RURefAtE+Xx+6P|SryqYk zZqKZTMi0N9pMK)g@|ZbqW(_;~xGQlwyJzmh1H(#-)F*%S%+CBhi$nT4X;~J;dZw>x zt>BQB*Grz=erGec%b^+*lXv~>jFZH{iM180<$0H4ADI?uYc03v&FeCo!=JFK&ekI+ zp<@Q8U8bns!Qy?v#uuhx#fR#hS1p`S^u*>> z#+e>(t0v6(Ioy-+C!G}*AByJ>PI0pT#tn%NiVY20>{}OK7;<38N~8BriQ4~SSM!gnUeOV;i!>KU^y;#vZ}AA9 zJ*zK`d$4-#!$^C-t}d7TmV7LIF?i(Krf-)sPV8O%adz&=QxR8QHFeqW!&txfZ~wk( zlWL7#)boH@*BkOf+{)YUdLG>6$kl7yuf+2V8j zMeOa|YwNyvPwTzVSUI8F^>RC(ZGC>R;;vje?$*<1d)%&<{q`NX(P84}9T)03iB1LW zt5$s8IcmtOQ+KQ^4xXO6d+M+3Av;VNo!wXi^Gybk<}2Wb-82B7X-#Z13DIWxsm&r( zn`wkL69#RjoZ3uBv{_whv)0sRDxl3=(mOnv&7%e?>HmG!)FAECZN~WDA4{|uS7CGfPfZN|y*%D#_^Hj1RO-4dtXUe5reO&BcV+H9qKh`EWnEiVRzU>gP?fIv+OB^?3W0STVH2?R<9Bt2|U=zB@ z&V0As|7=3rkpFiR`v1pb?^)9B(-OV^ZbJ1k)oLo22#tB!B%Mg~4Om2zC?v*eLelh! zVd!vyQb>5Ufi+4St6V}fFoH$GIFi*cX%(CVYdZSN0)rKDk)0Zshbo15QxtEmddvBQ zkq9_m{5(zBZ5W;lW)o$Yq23~@RdRUjV1+_|EFo0GZk3TN2IgP%g$$QrL^6`Sn31HZ zrRpdd-iiz&YRb}z9AUmj;ul6>uE`U&t_lOO%v2G*T6Kd`L^iTia*>Qf`V6OdC)4mM zQ4yKYP^%ykfj$Y?D2WviQ>u~+Wcr4bqY=sM*jkE;aY(H~P9!Gt*&V$6^o51Q(k*d<+HjMpN|%1ALUmyPHAWYXLQg(=L_84{{u3FM|~ zmZTV?oCZx4l@j&otP&EW4^ucb4nisW6pKN=OfgpJ-6essG zTui1E2+a6~3PBj7zmQEC$ugmEet=`Rh{fV%Q6-*WWKr0&;uvxr9L)SUW;e0~5L>3r zWl5zYk>)bAmIcc{ij4xX%w(ZLAC_?J7%u7~5E?Q-l<;^LDI+o_IV?i7#yoH;fk8dO zR#B0Rr$^7>MOj2L8i7o%?(fLbHT=>n6@i5xrdjDH0i`gFMxTgCvp@jMV3>RiGiKjH z7x9*pT1^*`%!K46tBQ%qdKT#d(@q?QX#AEr=5h$<5b@yEsx&(5PUu=`gjbkFi73N{ z)QtfP#R&z z1X8s=^_1|@Iw`6q8;%|Y3aZPYWoVI{06I~yOz21?Ua&`m_LqYRQz&YP%tXy%qak=X zEDg-MxE5M*M=rAb6M zqA0*gAvWgBS133bN$jlT^kNa&7R{g?43{XfD2qdKs0nRW3Jve88VX=HvW9vU3mjQW zHoAb2sLQowu%Sdoq5BD!WU=H*VwD%clcd@3$PGe^1=G}Ql`>qw<8UX){cL!JxdBw7 zug|Je)Hp2@<_)C|qli0OtFz+7Qa0 z9O%U)VZ!}PFexUEdVgjgeaqESD&P>On!Erd8NoKvY^o&0@jUg^a!d$nsgxPBX^=uL z6X^vp;Fa*SFhM3`aquI00b%t}Xe6jFFE7wj86@YO3L+|RVk;O9E1-s?Msv-9kbH$f zl0SL_=^)n-Le!Y_E}F1ev{6ZTnHKaV@e^YhDYRet#)JkwVhi*QxTHZW7j`(;B2*$r zAWNc=nF#YJuL2>4wTcNNxmheV+K|vtMkc|FqeLPxHq5V+RA}_|$tkMPC&GF43eOVn zX{1p-G0m8zR^$?ikYhMMi=~v9kSrD+v=*x8DLpx|2ok_lTI<`eBZE98GMQoCW1HDXLU>PNnf9l01f%X>2G{i#brlGc?DvyotlklfbU0 z+?g7};;0qBQPn5|pIVAH4D{Cp%qJpaeZ$kul9mou=uC1Mv09kr$g(yj8|xexrG5bs z(}@Kb)e1JoucKODrNXnk9Cd)MXJVEuBZ-cMYNr5(xaFLNJw#(p)?)<=RU!Mi{?flpKf{j@z5 z2nf1?Mj|&BvI$j)I$-F*HYwrdDz-Tgn}O{4n-~${2?=dP!*^a)Ln$$~Vdo{wWyqms zHpvEa^cW2h*ytN-o73ecJbukpSFym%G~9?(>g%($L^9uplfza|R2u8E$YT@_))Y#m z((f!o+RJT(?3!lOQwmI&(Gv;@SDnU3i#N+<`uffov9akwHA7TK1jLX?#Az^1TBD&D z_=cDxVCxm*0HrT;=1NLf5)KxQU%Q(B>>6qQ4_~)%{AnE|1p-8GgEF5E~OhqJOhV3F404kdQ8z z^;z(zWl2bXlrs|PNmC6u*qAvZh+wD9IO-w zSp!GwQ7d-N!4A5q>dpk+7l8EJePikq^}-ihrBV!>)4x+j&MgRlq3s09D+O& z5VpjqMU@FeMId7G(4YfJLcU(`^LgTpgQ$4dMy{ zmPmih;SpcB8pvRb%~0~(Cz@0T5mGRKkY~VaLOe*3Cjb}Vg}^-wr~yO*#(*y7A2I~c zElUU!##jjeZ~jh(+>$fo(M-q!GQe+RNFCBnp*>rW=lyU(4$KD=Jy;l@XkR6PNqNY2 zAVaP}h)KX3YpqA-^zDb)3G#bCmN>z^4RA&KLp>bRIXLceIh=%h)@)rF4M8l0hXZ1wb*@iqt+@{B-WGq}m@O21oVS+D71hYA)L+L402!D?dzXPxpb>Gz) z7M|fh3jR?I(h>5ST#m7eLEQ1`RM>AMADp5%Oyw`Z4lsLVRrqAul;-XQXXFTvQhp zi4|Cp@!&h&k0BqpJxNx&KKY!?CFs(`b`qB?1D;`=ob)d1MoLSK$g2x1l8W+g+~JTH zprx}R>4-_@AUd7LX4DH`OBu>a$V4Bn?meHn-L5ZauRg60_C-cV#oR)(?2@Cc0EiLl%>xx1eez}s8P(prqnG&!_?j=Hoa8r=x zg}T0P2brV84xW#(*I^uC#>J4HsDl|gD}y<+B)AtTm}*HJ0xU`QF&KXj*<=**p-Yhq zifEFp_D22Mk>8DGwTwY$C*cm>2OvxMLKLG^5{NgWnN2;SY_8$3Vykeg7qo zNA?F3g04?IqRmP8r*^~{d_RHw(h;XFWfL?R`34!9y~XzovN1s)>T4#1JzsoxkoI;Y z_!eOehVY;}gv0{pXGeyVY!{ODdW1}X921ime z8avVjA3`6SwnGpf%os8WX||70KH{n{HbkQ^cg_tZMIVgFYsg|G>N27QeYgVi#<9+1 zS~j1|T_+*|uw1JsA!Hot;)D8OZG(4{FkL~m527Jc_`5py z8s!AxIRQt^6I&2p1Aep@vDiXJP6XP`tux8Ft55oPGvxei4taw%TJ$=K+<(9!chDwL zDAUXd`J`wo_#q;47BCooBk&fB^2ehiR)KClWSnR*gzNw>ClLSLiA^R0x!4DN3vpeL zr*~%wF&d73p{qY|YVg7O4L3iBLoOR)Oo7f_)NMR)9|F!VXOVXq7-ti)O``cVo@~NlTXNO_-~r9$S4mnY3+}>Z3(n5#xjzLc!!vH@(Roc)yT*X zgwu|I4(P7sbS3jXvdC?evvGzM`DYH+VW4e;x%E?D$XKVr(bW+jKLg0f-vqKkewS_r zWCY?1ZG>cbQy5vig-^O_MvzXRc?@`80DAz(N_pg;-Ogmt3_Y^Sogu@X#gduGzX^EJ zX}w4!X#7*okXb16DW6X+jhRkV82FW1UHje?EQhsI&vt3#fc5JFPH z=MC_b1Bg4xCgV^?Ht^NJnL9{VKIW(CrbL*|zydYCn{SoG5M$~m>XV7S@Vp)JqpvLn zy++Vjfr-J(16#K3JYolice$WH_lzgP6>h{3eD}jVat-t2wOo8pV)e+isaQvW&USp0 zmLvb2AHB#(%yTWnSVV#HW+N>rS4g@btz`t(d<%@o^fz6|28^|fr!ltoqK=?jg!D(Q zXj|0%JR1Eb>Qw@sPz6Fk2SboNMxXk=!ICJ!bL|Ys&Z!-_w6-hBME=K6joE|V*K_7X z_qs^R1p{J%zV<8}tYlZk&k^VS$GwnAh-*E18&#w!pmCdC3UU!z-2~n-c=Ih%>+k z_;+z&qKd{G2K<5ZgydxphGZeF__ZThvBsIK?4>jKOi1e*&_rLz0KbO)ur@oP(<~8k z$uON9H3qNnkK|!}b_;Sw$K~bANI#5cAH;tFKhIy9le=;j5gf*v9&-H)a$H$ClFWcy zTIL&)wapk$mU=|^jfZuB`HGI_DrNYxDo*<-zZekh!2~m0 zZ$X|gP8k!-rir>#L28&AnmHwVlZB>vgCR<2eXHHW3?^LbvP|b0g9L} zEY1>hORo~EuJy$Vs~+ABYO67Vbhh=lLrZF`)4eIR;ipJKQHD}$BL)?oxB=xNn}V4t zROZ-D7d8+(e#=$Fd27ztiCbeJ2&CH2{mF#!yuFLFNS3}=7$eqICRdmo#^c&F636+n zM#>huHxj3XNMJ7#Dz#2rint{xgAs=XP-dw&4R>CVm~P;*I;~ObQtI6h&RdUE_J&q0 zkje^xyfLMLbl@zDCCnBbYg@e=h#Ox>A%ptjLbn~2jfEZec#}TvdoPwK*kW(mhrPcE z*|_(z`>+o`-)q$QxUl&`XD$h(@>+*|t)s-ofsvl4|A@{ej(CZs8zXsK?@Hq?eD9?S zRIoU=3%|z`1MjP0aj2ztgVvj$0*1IE8pYi3Rz^njwwGs=P!`XM! zuSGEryj!E#TyLuH_ejMG;XG!>f9j|I#G6JlPg6AW{4@Eb*K|@2kY>5Gb~w7s~kakMx0>&JGK zG4K{BxaI-{!}CE7Js+Jwy#-7Fw;sG2_-K?Us8Y!`_G!rvZ0AE_g81Ie`9VD*<8cyD z6-(K<@hMk>MX8%&7_O+&G?bgtuq4zz3+8e7L6TUulaJaU+vZ|~xz(Y)6!;p`sf4RP#VV2I8Cxr|XN z41BKh`MQ=1@{d~^S$YElYZY~ z)cyG0^3(W-L6m4-Y#zZ+yP@sRPwz()hMJ?&!^EV2q8Lqp=98>&9qvQ>4;Zm7uRnX# zw*3|^VsCAKNDXX^Q$XzFk8=~4iRXMQhfMWR-5SC}FB;1CZjG>>vA^urP)+NNl|=mY zhISa2^rtE=2OTI|9II9F1^sCfAEV2SFPgS$fQ?X{h(1xQ;LSI0P$w@iZy>`L+CENX zi+k_}q;Q3j0T8=<0J|%C41;>CW|qHK4S=sfo60X$4;Zl~RZusApMH~$w8^-MUT&%+ zX=Ub;J8mj(`9SujHpHZ+oPXY3SIeJ4e9|_iHJXw;ke#T#A32ImV zrmc4E#EHuk%&V$f)c1|J`GG?>l!kHAYB&4+xvr;Ydp3a7=d3`={({Oee?MBeVJ`o5 ze!ENzz73gNG%&;a2^0>bDB_D+bH=BTL|hF0?y15&*hI7VLX||O=Zm){416^zHm4}N zKASIZ(&UJbDI=LaJrYT-sjnmna>691Yl~d2kS2{2$ET_D_^nE9p2)Y@!H=8Pq@8Eu zi_&b*WA?L~tDjuJFYtRT;uj~D&lh{AI~MjPH(=D#LV$Tj*q|+R_eDK)qFdk*(x6=+ zKX1CR2>nr8#L@K-Z=^Dwm?ath^(OVguI0JIVKZ{o#zoxMXNNBqfBouIEJK?WbM#j$ z*nwsPQrIDOhYd^k7;7aF9=9Q(6m7~T@-#ePKd_=KUsqpo`aH98zVr@dXM#(0`2yf<6pI?Qd3oc5;$Hgbhz)F%Gd81*JTM7e1=tORXdF?0>HWwozn6q`GC4YM_T%F9sZT`DTF ze(oBkLQz?RZ)Wil1;fd8ds%_c>ga7;$<>wHw)(0^Z=e4YcsGTbm)kL!I_*fA*kA3s z3$@z6l2TJ4>>5@$VIm*?r{g`7wJ=__lVetbush zd>cr+)@cpkitH_Q#+TQp#|``d#iHTXUhc6*YJAb6VduUp0oJ>! zuf-0c`>~8zvY$VAklLmRqz+&bI@K;eMKg|lchVqw@PTi0DD%*Ql0&={dB~y1;N?(@ zMT52T+@2d1T%CCMk{!i~e%GVB}%=-Gfl=oF~>cf%{7k1 zKVfSGn`=Egozb7ZR2S5=&N8}nlho-ZQ#QZ*&vZuc!?dcNpAI}e79;HTaf9EB_};4b zr}&Zi6R`+VVN9mnQ`=ijxHu6^wt{ht1IBjNV9K`7xkvQ4qF8#Co1#>oU7sQd{4>F@ zhwHZ{W5pCXiE&;#+v|LX9YE${X~BqhmNFOcjj$GUI*Jn*9Vs^NSdaVddBY+DVmR$dvv8rc4xjw9&x4DZ{uow(*)HG zV%^t6H*+)u?Yl{tVCy+kn6SX5)s20++^@bS_HOmQ9@FPO=9S3%3A}i{tMmrPTlM({ zS9M>_46xKp)wO`ntsx_IqaouyH6G@Q4hUA&4i+QHGyy;NK9)GT&m&(b`O?HM9zxlv zD@T2~jnDkFJA9#L8a@aTb*C}=hNy#i)o-S;A06jUXQw=GKb_&89iqJ_Zdj-A#88>e z=B6)EfQk~6hOYk8ZZ&A{XLK!|&gK)%-w$S6>zYRY`gHc(uFV73x_dOe&5!hsG=JSr zxA<ievyU9Dq#_nFbA!A9fMg zWD;yBNC&LMKOhZ@eWC?m)A2_;!IEL;0RLaum9#^m6L!;BsOuiXA%$4oTf@DJe3Ows z2JzUK|ItpA!POm*#-kkF;`|}-u$dr0{d0<9hcJ{?)$j?*&Gr*zuvrKRYgD zC6iGmHfO{byQZa}hm8dBM7|e*t)SZ#VcpJ0DEW^DcNoHmCQ|_YfV>4R6dQj|Mb3da zorWb9VGn=;0J3Bu@|(e(1hCTa1);q`eH{=!1i4;E`YHIa;rVlF@ec$jhJOI!G=Od3 z>jhjqTKGqs>kWSjU>0cEOa7w`*Ig}fM_d5_%9=mBY@PP92|SKNoDuvGCrJW;46z3f z+Ykpf{+zJfg9{R5C15DvGV%?8fOHy3-OhL+;#L53J5C(zkX~@Hp(A6F76^evz&{i5 zzHp~Y0pKkQer&kNGW^qN@NPpkVF+(RI00@t@RQ-L2MrsPm4NgP2>T&#KKR3?^Uv-y z3a;)nO{WQ50o+!&&TtDrb05+=B42m-`@nTVKAl#jNJj_YjS7y0YY#Y}!+{HtlZk*J zgu8;)FMtaE<0wO?*){;}g>d)6bpf7ElYwg^xE%xSG&1W>Vs^rhquf6lPA}l@K=?4+ zXyE>a{~pqG+HNQl{%G*Ax%{KWsfN(h!T&jt8HG4DaCE!kiJ%z=zXRYn;2Gi;VNjh! zou-0Td&J#F+;GTgGTd)y%$-PsGKf3|UINm`!fy|E8X8y&UP6(Mt3_lR`V)pK*@p7I zAdJH&Vh5V%fuqw}K(X}aG_Vdh76=!^4M*A~xD|lmh*JY+1Y9fR?S!}^fW?4k7(DHf zmWgG5BDbAS#V1L_fc<8xH=78H^k?`e+O<3!a_hc{I}sgKs*#af3$QexFx8^ z3-rMt@DT`{@hEdFXw5(-}Xd4Cal%RV6>7f86V){vrd!O5qUa-$G%9PjQBw03q_hv z1C5Bh4MyB& z;C@6Ol_Pu|@ElG3xJ&{_dW0)pgo+CRsxz(W|QG4XBFZPp`I+{tAc+%;=jS2 z4j2ero%Wdz{M#r$7ykYD?i7QjHSpIVybtaw&}|2P3Xx|F+)YRyhPXvB=>LdYi@dWj zQ12i<8+k?mc7tZ42<;EN1;AMi7y!UQGsy#uSm69dnh3I83D}PK-ALyHiU9Y`FpfKb zANZlnBg=qa4LQZYZw$ae7`YEwCnDY%?LQT+E#kUkTweqqLyH z2L4^ZJn-+2a#zAt!%ak;65!?nUZH)|$kQ2k+Q28v_4Mq}RY5 zi~Jt&>lQ_&7|RrSA0RvmvhInxWk6mdQ1&&z1fb1CnNp-{;P!_biMT7Ep$C6Y(D({) zhkpm41|UJcQs9^(ek|m995i<$Y>&Rb6>*OtFP(Nj84!Z_ao|;VvZ1>bpwsAPA}#=N zekiX3ZVk#><%Bi@?U{i62;(rCOam;HVqFA$L&UE~cna{F(672Vpg*8&Z-mvL=>UHP z=*I%DGxBF5eiy!t_rU9Rr2Bxz7^HoJyo{YuZ}6-Iz4?G>^n;g3p8@{_jF0p1>rTLq z!*vAQ2Na{dN1%*dpz$3Lh42l;&xJn-Wz+!wHp&ghe4s+yW5iXWfA@o5cUpE3xFPVn zg2x|#@d!^t|B45WE97R0w9N>og69jMRfe!L+&8Gl1(bUi_^k+kMj8KL3{v3kKp7>F zVJmQtAk7kVrvc9sG~U6#3i&R>Z9rTN_`Q!j>BzqixE_F4$Tt?{e+JGDVY1N!Ej@ZAEfM$qhzxXsAhl8$*D z^o{`fBdkFA_Z`s(!P|1=i39!w;5H!sDbi=dKMMX?!2bw3=TX-o2zNj{8~s*+I*&ow zOEAWVgXgQr;|m(oLGL~AE&vL_*B8j;9_TYj;~*{t?mM_Efv-C$>>P%^g|V>~{;_bI z;m$=`3-FxLM|3B_eGoSaw0^@cN4ZB3t_D9i;35{F&qDYI`q3BUzlE~iLw?gxMl;;a zNY_JL4&XWPw}TE2xc+P?_M^RV8<6w`uI{9GEb4U>NjOX-GJx(RaskFr3*yv}Ljl5f zQ9ljlP;<$DP9A$YVE#kgN5CS`-GO{AfKZgDyM^%q@iOF#L)=LC3&6uq%p>nW(-r)A zBkYR!`{3a+aH^1J67VD8uLO;+@KgA^0`$Ry73$v#-1CTUf`2pU#31b{Xlw01!@5cvkdorttrxXH+`0v+9H z)8B}Dia0y)z0w71f5;q{$cP>w2I;>XF~`7tg7VLR?i^j2@XtW`IiTAaX|o{j`H=HC zT^gVo@C!88BORAzNDgR40xuo;iqSrM&@NYzmJS{}AU?bo`Ze$uA?_Do5Ze5uju!ko zuoxUC!}kz)s}Z&X9tZF@pak_e3)+v7W&p?ne?r6`1KuH|J%Q^0Hx~Ro1-OBi(cr-z zG7EBoj8KLY=_inH1N^%IxJ*M#Kyxng4nh1E(7Ome7eOvg;N1-2dzd5D2)AO4Tyq6q zC|iVlm(dR9NWTWykNkls=P2^DBK;ct(-3b9+S3r$oht7@+zrId1MV7t1a0vKeClpn zeE}@Tx@0KujeSA)&uN$De^0w~69692MpoTv*Z&P60;gT)b^8U~@96(M?NVtOeW^yv zGWKrPvIRks8jdhtRl^m<7iaOT(;Kq%?A3y7eWzk&wt=grINPwJKpSA>aSYegye`r} zu1}M)Mt62qXVN3SA*Wq$Vw%ejFjfSahS+2Und$2etIWM0)wfp$Ih+y(DP!`?6I4s` zEC!`t&9fX9#Ds_>1)e;y&oV`>c%){@JgYI4SLa!cKgNXGOuDGhW1C-3I%AvB5|eEg z7Fn5ZHC;>?3r%7+_?zziE<@2UlLaz~gA^-hj^LUq2X`PO0}|$tQ7~F3Q^r;)*=a zT+EIXp6gM5(d(jjT~3!PRGHPKA;{^H_x1RFwfZ*)2c9-*imVLuz0=$p#JwxgMsheYJ+3 z|A)2z4vXsg0)OG@3?twG0}hBfG(|uiEZB91BB-bX_C8p#M6q|B0Tk@0s2EGYiZy7A zVjr+!i)iezV2vdvSYk{pc|V)n`+VQ~Jiq_${bRA#UVWEym|e~}chkGH`R6xJl{D~q zahJB|KK@YBHfG(Xs-~8TplpA6gvnx7nNv&6>fp`117^3wqI7MpFe|H?byosCIt4AN zrtALS#?F;?E~(et6*XrmlHvni7nU>%yBp!r{&dcetL;NxEK7=QRWiaCU$Je|uU6%@&F#6x{cWk;iZ!*m+iv#!D>bKQo9VAl_f*a@msfKS`>f1$wI3S4 z$eP~W)GK*j_tabASrOTK>4JKbHG|9UKI}F)u-OOwkY&MU`;ZmRvAu`R=r#Fvi)L1v zkNcYLc}s?^9e3mQpbh5KE42$}Zgon@pC9QvV#}Jzz9YA9_dY#x*N@Nc1Y6jD86A5r z^4#eCw=HYGiMqS>x~Ayq*1pOkFN*sr!`?spW$au1+-&cdZW5Q&;vaJy-fh)Q{l=ZX zw^!zNrbeb}{5ki0zt}L{KEDZJjeAPXN18P~H^IwPt$($vH6m+Fs^Olve$vuzsWp6W z4c)eWxYy`vRi=2Iy0(7GgIT%@Zsj$!_iH>_eAYJhNq5VJ9?#6#j%m-gY`d>{^~JHF zMSxbCq)eQ6t)~0uqwm$ezaRUx8ha~FS7xqNL=6m!dY)*WHS|_o*{qNE*jwozRQO%> z@fAJIbG{CJGjK-F2*#+SgJ-$gOWn+1SNg`EvRnOg4b!vg=9Z?p^stl$IbZBvtakO4 zEl980L+;<}Y(O`g2^v(9UF*)P%wfbR2bLUO(mUp(sP>K1%Jip1$ zA7;kbiez&CM^dv=>#n^!B4Bc(fccxs$_6O==7cPnU#G{GE1Hn4DbW$3dz$rW8h+s8 z!i5by0(FbRPK7*Pw5QqNT8p<{kFOR!{npgLCDW&_+7uS>yy&rFp3Wk5bJ}G*&~WKbt+fES)nwrkj1~+PiN8vs)_a2D#VRUHBk7Cd#sTS#FKn?#mTEIq}Q2 z&)-xT-yy0nXoWU5;%rdOCg*G`xeXMr_R)zixi* z0VBQ+KFKFqm;LnZ=mS0%H0dvv&09OR#An;O30Hg9ar3;@UgA1(%$ri_l%LXmRfIj+ zUdQg}R(5j3%q1@pzH9%{XUP)Z?iE?VdFnTH@>bh)1$l8b8Wngg)&5hZ-%{Pk=lNN8 zOg#eLxtlNO=gYKb6SUoOddZ?9@(ZR-4nLo=X~`Z-ZO^$A--m4WD%%^id3om!b(f64 zW{BAm*{j2qEys3SulLFwrm=60=w4WN+xoZV+iQMzKpyHhF{6XMVEUrzXRFqHVIH}C z>xK@B9ou(&+q2%z=|9SL?(SiVQO4|&*mpL4*1dRV;hFQcU6(Juyy3seY`7ED_IZA0 z;{F@|xEQ^Rk_EdDPXCZtFDX*&txQk6qCWEW&a1^6{yrQvA}uKMl4gl@RTt&j&zjMN zkyH0)6%Kbh!nSpr$2Y8}eb<)k^Y@6fS;3vr->p6ME`wc`DoOjp zJ_o+uKiw#~qPf;1Y{idV`t=RvY16r{18%>}f2~pM-Cr{87Z0;Ses^DoQ#J3kOSB(+ zFg~o$*zz9QF@cYkbllV7Y(>+ULoIV>)bH?o>(1W~`(7y-)A4ovl#?~4cQa)i`J+TJ z_Gnvux8l0m3jaTj_Sv5AbnMS>`|LRO*UNmTgN z`g8i|*Rg(cPkFvFN4TwjYj8R;Ve~kCJ+BMNJ(W#=AMvK`s72!=&P4Qklz2vwa`a6# zKl#nQXD7@$TC3Fm)iPV@jYW%Ay9PCwI{e&3-IY<>rsVD#)2hz*CIwq6tx8f7cikNk zXWi|qyx`J}%dq|lmv@@4*;Bu{*zoev(>-UF_4~m$vhBD=KQ({law9OMo7}r!%bus+ zRc(3qjiE;CPoLk-cG;6EDXZ;ttRyX}>X#)gV(RpqcyhmXf7+E?zr_=;c4%t*sAKGz%$U`y*TD1|2W~~JYaDrd z=&MBg?ctk_rA@jRyX?b)kpmZ+l|6P{ntbKA1Fzi%jA`rtlP1je=ZD&1*PN#)6=mjA z361q0*L81K#)1Pox+?B3y}R<@{Tc7> zHC6oG`s3w*87YsZd|xFv>OzCSwD*5$Y-eM%HJS|ByVh%<&a0XGjEg}Z%Vpb5iidN5 zmYviz(a&!7=oh~gMUS-MowI9dFDA>~EkB)}`Z%oIn)NuW+uuc9U)d(x5~Iq!N|WcA zYW}V9Yn5NpVENB>dA-r+TKugUxhOBwIj3Xvh1{uiyB&J^W@hBCYA;jjp_;i>vj27q zOF7>B*HaTa-^=`?&GY82dkXrRJridxsr|ft>y0I~`aEzyd}rg*F%L9R*LnrN*s^wZ ziJHbXi6)Bx##eV04WQ2Mwfe)3EVPHt%oyE{9pTHi(Hp2`Nz z)b7#ii+-J*`TLP~ZXSL$yBEIH9D7xi_Q#1IO5H1pt6ZKId-6og=h~;M&uKNF^oOs} zZzt3}(dwO7eJ#t0nqeU&65lyj>~U+wW>;^o!@U!{c6nEB zc7?z1>HU@;xZ*eN&`>5hEHwPakNG^xV$p3PxGR&{5nz5xOLRfTG`1%N4X*{b7qAc@^~%khBIFCG&r8aSuw~vL`3?91*a?gQ&XV62u$XW@CH`P? zY)vdHz#58VWDtMgpCpebOk^72Ts*46iAPBvY~CZ@%YS)(8Dq@@ho; zc7~5><>J~V_}$^_@t;onHK2d`Q?5pwk?6cfJ{9PVAJ~!v@@qoO{_rkQ{uvkmJOduU zpHJ+2_^LyBF0`0v`U8KEBlF41$!`gm<`>nd+>B)ID7gsy3p54N@SRCpsi@Cn>~i7l zgC`!H><)bf|30)!4)nLwZ7jHuy!z8W-#~*Z7hDH{lNfW6_=&*gh=vJ0Jh6G;Lz%9S zOy^G#z9t33Ltaifjl`mm)dM=9ODYl*33r4Ri~cc`N1^u#AN$a~M%kMf)loD;Yilx= zY2aUxhogTJyJ}Q^2tL{&7aKJ1sn;2Jkc_=6drpYbCWJzsD!jG+-`kON&>xyU3I!D_+#hq5@X`WNl>96EJHekUs#o2aAp1LTDTD=^}|(EN%eSW7D5@*$h1g5SuMN@J2&lVB$TR zJ`xL)MU*#?Z#C#*>b3%VR4X?y#DeB0#^Tj5a_1tuhFmOU$;o9tb>|i$c~6}tfW_on zEa;pAN0QS7V(=uZBnf&Hd4vYB@INlJz$llQr9T>y|JHx>^d=)g2iS|e`Ir^hm$L+l?#YJ!S{!LM;-Ig zolI`$D2vA_qVc;4KfS5TH`Mi4=q&_ngt1s~3&f8B-9PY~Ou04xUw^@_Cw#FGDmK91 z;&&Fd{m~N(+w1T#65S7L`1Aa^Pw;>AA+imW8xdbDNPnarbIC_6sBK06KDm5L%s%LdO{jtBg(5pcpLHZ( zFXD}Z-x2vL_|MR9OMe7%Z?nS_hXTZcuh=vb3wL6p`Y(7t*C!_B>*%;)^AWs*@=N+@ zE`GnKoI>5khciBjRfGIZ=rsc`#a|fm0P<}_e6g4qN6s^_tH*sW6`3nB+<`UF!)ePJ z(Anhmit?}M&7?dXe_~-?PPrxgHRL8XWvYZS7RldOmumvw?u@bH=uKek?V;?TEH*0) z*p0$YY$S}P{186rNFvCwH@O`p?jdZx`V$xWExfnLHvw+glrbKLf;SVBC-*83Y&=7+ zCvr8uzXDb8Ie>Q168|*1*#r<9DR$^M=zh>k>9a`2jel+K!Pt6Ww+nyb@!M*QgFoPH zX@Wm&oXPDzdGN%K53!-V1skzB)scM9a~;&hZX7(STKR}Wck)_i;94P% zcKE4Ec@44VqaZenGSFKrbdbFOiw&0s_&x}~6ra5Su|O{#MM(p{LN5hb7hojyo`U=o zzMElJM&8ZQ6B`?vK=io3++$qa0lK136)F!LxYIX&RB#gdP4F3Opk0VL5kLFT>CZU5 zOr0(T^1KB?6um~S<^i2-_w<1g7x^m!q89o}3M=Rq0K>uIC&_EnBd=)w~;2oj9N#uL7 z4!{;E>f&ctj*%y#&SCe{P`sweh&=!gxeIOv}E=nOUiUuts=V0V)|#70X5 zwAc(52Z*|mZ$12ci|tCrYZ>J>*j$0;spHCnED~Zwlg|Y1L#5bUA%+XQGnD^EryB7e zQ&wR25MLMZ(E~ky%2TORTjYzOZP+E^XFF}NoAN)%js`I2LH|4YBoWX;pF}^3{NEbL zjdpe5>jZhn5aSy3F#J?74i@0&BmR1WCHNWwYDc{y@UaA)p7cQ`a&eI12k=Drcd^f= z96|0IX~W^zJfRK|D1fp0nld9heBxw zY{VvCYxJ*%@V|wAD}$Dz)0Y0aMmr@@eiy(!h;kbIZRFA(TmfG^#{Lf93xQF@5gVVS z#N0z{v6-eKS8sIJQjX^uUyIELuJKZEE@Sg7d>L}F8F&^SXVFOkU!adW;j1q?L-6-6 zae83$i-F&U=qhP@XZmsgI$vm)pOD=EHzdaZ>d-#iSh9*_1=O1S@?bjy#TwDv=3s*V(7d0n}_^2`nM6|?h=0D0TsMl+U+KF&c!yK zG1LS9V&i@lwrPM5ZIXq~YIG}rgU}VUkJw1fMlKGG^rQVY5ibYdP08mu^_g0edjRDr zq~P(5vY0!RUk{Zv<~9{m>Bmbn4y|`4#wo;YUf#kAeK}Kz9b^ z`@}6oCJvu9rp~`(GnR65>NzBcbrtk`l8ZR-cA0i6MW36%kljJ`UL99XKbecG4 z@$rVZXMrU0ABgS`_!^InI5_hgb_39PQinP~2a>mV1a}!@wSd^)!V`xk4q$&Ay9L;F zBSsg-=}vT?5Mv(o*hajI$Zn$Fg#21SdxOORqNV7q$EP@iHj(x}fv+s|{KLo*+77P< zzH`WLGI${QxZ+P7E{J5T48;FtWZft)N8SQ?6a2P?mgBn#b?U`96|WRI5AO+b7x)L@ zPa}>LyEep6Le?An6n_fr7eY@#=NEDihs;hfUKY0Ge=@vw*nfck1e=YF+t%chO#Tvl z?*>KD7g@-b(H7yvb%I|+oqgejlZ&46_uv9}PeS>fMjql&l6PJHze0BbjuOwC-0G4~ z0`2&OcCcXg5ePtDKz`y-Qa-Wz5#vYf>)?Mpve)F$nm(uvod>TV5FgkbLuWSr#*x1h z{;iacz}GT1YvJoOy5fMcI4t=HSsd-~J6KEX!Nhq&JKQCfH`n!F^q({SC&8PC{VVua zD2oFvtMFAyoV!3i{t6rOKNp?pP4G|LQv8dBT3(PR`3tfM^&En2IPoT9;{p7iK4PE{ z|J?p}*y4XBeEh%sXn`rsBez@;5^vY^FiE}lJCqG}tGTKsJCa>J`pK)`E;|!hbj5Y-Ou64f?b&9fiEb0t z$!ol@oNaOIirbW<@|r(DuKZ}h9(S$XVl`wL;>|AO zwHZM%{#D*cqJ1A_XPSZnJl3dVLkBHeXbqD1Tq$i=?pU^DYKBKGY5Vw?h91lH`9Zat z&-b$|_gJ|rBe>qUa~*ZE6}dChWewMyQ>7$%uDz?MQ~A+?Bz05u#yV~4+8QX{dgdu& zL!$jVBrdv|y~z+0~Mtr=PhR~C35 zkSX>|JRLSr+OZekFVI?S;X@-X^e&4^+g~uW-slkv``+ItFFN(qY5bZh{a+4ReWbCx zLD0E{13r|jKK}7(gUgZxYl44nv39Gm^7{pwaz}~p7bK?*t|?zr%J&O$wl5mGYMjr- zA?+HieV8!3)jOZEjCPI3`dkW%5B&CO>FLJX%&yA+>-zoyJT&x%^(m)~3h*c1=wS^s~BTHai{BS+OL2-ILL=%`f=NCw%*O-LJb& zhn3A=GO_X1^cR+GEp8lgo4jw+`qzexmiONLG{xarbG$+6{wU&9g>zy&7-JGEKSw z_r+N;^GtSShamyI*QsOcCM8;*6b5+zSQ;A?QL^x;MH;>9ak%l0Y0;3zn}(GYw9^${ zS)7^^cc_yU5$Pn%b_6Ynsu z`~t$zSSjx6nFpo zF2dC7VFSNtdfjtgRX8tp*P!MLJkMxK_Iec891WoXD+qQar(6MN9`)3CM2PLl}+y2<&Hwbx%}jx z$KN`slkL?^3?AgMw%3l39vc_*4iB&PE=OTp6|p$jI(V#IdA7x~y-UZ*hRjv3Db+_d zT&~Rfzdx<8(x=2TeAJo?15`ico*O-E^Tyu(BYS9?-5Omj_^{7Us%4GVzg{%F^}E}b zZM6e7EB>EfSs2{s=XD<%$D8VnlxE+#R?wr#&NU|+R}1)gM|{-0oyqk^^?8-vQha3L z&G2w(#hsf=B$1yp77xryz1Cxlu>Wn$&S6=t(^JJTlvqkgD2W|bn7Tzr_Xh7 zR_r>adPdl~hi;igdyL`Zk}T`$icc?mb9&rTx$a3ookQmm$EZH-SXbwXwRzkAZWBV! zuX|S1J?qlAJrg#BovZu`!;8TaH;1kFOZaQ$&nsnBU3oAb7#$AhY>A5^5httdQt-`Hisr7&CFb$_*bzRWQF>e`xrZkAMee@m`tSFqvF zJ(_UR{rzx)Q z=LXMu*|*lGJ2$HtQclnMBYoiK1pgC%FHW01);Z?OZ&OYT8+}rj9DS;3#p)A5;T`9! zyH)GoQ`g%5d*#hZLlJ(KL^QrS1C#-QFS?X2&exdQ%!fP8-)eHRw zSTb8adHB!t=X~^GuTPqKqb#FYOmjbJcue?4_oZ23fAb)#-C}} z@XVs&F@t@p_&aSV7`J%zW>fXdXYE=Y-8(zT7I@-ONZf`?Z>CPvb*+&EXw$gKhqC_y4~>5E13O&7=$29N^+?nB_OVSysa4fTxA=nvBKE z#x-9ki+Z%ZU5kA|OEWh6rMS0m-+B4+GuxkNh7N8&d|HQy)u)2WDnA>syv_O{tLm(N z)Ba45+W8O3P~TCtvkzX2m5w-XQbpB0pE!O&&X&ec>n5)0@Xg{5+8zCZXZ7M^66YVT zEDVnhKWOmo{Zm8vgh7gW?~*RGy7P8b(Z!*cLQK+zlYVV~IOtscX}3EL{OXZA-nsVJ z44*a09$lv$$(JnNlW!a3+jYpn=CvEv&C4AUI$@1pwBkhWw35oNO5<#PV?Wqr4-~_joo?RQe`LnGh`QUFU#_bU$!oO!WxrpO zZ%tb~`PrCi(SgNH?*83*>Y1(^+}74<-RN=C=H+=CJ{+wRxz>Jp=2vTn;qw=@S^aMD zthYZjee>J4wlgZa*i`SU*U;an_P*zWrRr^j>%8% zUC<`>%>4Ti`}28CUbI6-RoBG@sHQ41J||~ zrj2l#r~Elr6SLJ>>ytEWWW8^1@Y5qQ_Fkvo2+|-v{^IL2w=&(}JwTZI(jIP~x4)EGJ zO}#?4Z^!lB<5#vB{d`CE(SNRcCrWlT)K!^Pa{kb#`9BWp^3u`E_08ggG4o_u0i$|f zn!b3{IWV^7Fn3K<-WD9=~l_A;=;_>(SvU0-#Xne(){m; zUEZ?ix3tTi#LI5qto6BP=GpTqkHY7QA%S7H&m|q$$N7_7cdvEs30_-y4=qzl^?Nrd z(+~-?gy~1+ekW5Hv20kmU&S&&<+%j0w^yBcNgQQR<=F>Mj1E9EEs-$AseBlWX^VuZ zN97(D(;CTQoQVeoSRSi2nBE*@PS^p= z)Ku~f&Y0>{?qNrRp90f?nE>XMdl~h?UjaM7^ty82oatfZo^Lt0Hb9ulvoIEL889CB z0cZs*BYEDo80=cug;E~C1haDItqwQ`V6t5KXyy@W6bo$t5~UgMJ;m||vqecDFb(*? zbdQ-@w-1-HiA0=F~AyN z3w}}oG4=h4vI(e5c^UXV5CtRvV#`Ks-Cd_&#!~(T5XVM_gRQ`HcwR#su@FlM!znjJe%q|&9i5e{92+TiGb=`OWh|tJ zR9NjsTWmUZM3e+H_kUj@7JwAg;77^@zzd>_#Y6G#K^r4rF+6|la$H%cLbnC<7D9;4 z$?4UwqwJ5(QuK-dv2lDEyqMNn4$eiMir!psJ0Zu%Q1D3fH26$|FBYg%h}jzcXnJrG ztyLdh4P=AiX|Qij`3bbxP`LpXi!WgS3l0^vz5b~k?o}ATokr!Q_R}jwv;J?v;eRFU ziag&R6dQBm=?>>P5}8_W$}`zzQjNlBu{op)XLX3yWH8y3E*fo0dAVJpb`LUIwRt9~ z%rit+V9n>%IZAautHB`S{r7rZh{F(Vm-%XRYLlTv<>o1yXf@`WBvq@ov8l}_h234M z$u6+u#Yki>dY#qeh>^-%0(7|!5!79?&g5QPf**~^WHy)<$O5}*t%Yf^3uOwKE=22y zwaFT2a!iSN5`JH)d#Ukkmnk(ygEml=DN`tnAtsxBkx%21Ydjx z#6Z2I8f7z`+F~Plca82=v5i;!h3d5-76X3#)Vk*nAIC|hE;e1cDNixi&77grd*n&n zHHzA5gC);4H$b^a+bhxGq*TS#)|pBS?QJ!QZb`B_d#XCA3?_6|)KP}$dL>HEF9}g< ziP zl)Xl8y)HM&R7FnRwYd)K1-rVRT89p6$qHGjC6P{{?i1fc8kc^$QWL4lczs=n z)h<~ii&&%$No}W0BZN+CF*w{+QcYg_lXjET%|#y*Vlj0hL_onU8ndcmj;Cf<^3U@m zcG(zW6y{5$VPo}qd0NpuP8waVHeaG_7OdA9v~iv1%M@Cj&0*pgghHd!8-HytZK2d( z6TKo)xxA#C^Bp!>7n;l=nY&)-&~uXXmeL-ItYW%QrPNp)p8oAGdd6{DJI2)(Tj*0I^`?m7jN~#8#JXWDG-g0cB z7NP3!!^J6bZ>hA$Z`9(XLdA$Ax+ySliAGU$@?oM>mJP>Z@DM{>XEkh(k&;-#orrvi zoa>VdY&&fz8)FHvoVywO%5HbXB-10!-!Cw%fMJs<&}3 zPqd~ngfwbNcN6{P9yR|_!~%&uP#LLX_?lEniclki%xsr!={6d|R#&D7(Pfp*=eXE5 zwW6YHxipkc(W+6Vf|?w3xSU+nx-1fN5~)5{P1bv`twkW6Lh{9@(m{Bd;B;QJ~EwBdLzgP&)|Wq12=rY`aWS z#W}q(FY!@3sWeU>(zgfWWtfippUFRp&)jNaLQMJpT_KD}lYLmrb?zaCV6EL%s^(U0 zP^EE?)aDgFj<;9mHWO0uTYGz;Ory>+af~e`EX3GMyPN7L_1q(EKchvTaR0jvVhJ-BoY5Hw2mIMVfn|0iFx1tD06wlSU0q@IfwH9L9)pvQ614( z3>F4!OJ#^D#2O|`cb{`p!?)J_*G8)Rx~W4WO`iEC=67C zu_-fJ3m1#gDoH3R-Yr4vuzQ7fIvfR+ci4(E#*XIJT5NOBb{aL;99I~A3i8s-5^4Du zT|r`=ZKbQO^7dP-mKvwVsOxMp**qQzjzLBUjV^D0n%S9uYKvAR<(uY9pPctH9^5Fg zcUEW;iV`IZ#F;6^TYDe%tGt>GgK6lAe2gi}%&lJLwA?xVubBSa$;Rv&TsbCa@jQ#I ze`R&D3^viM9dy}ARL4uHvAv1TTVHt*YYb0SQrUHKPMs&olqxhuVJ1V=e35*J#VSd! z5ga0Js5F99GbE&9iOo~Ne*vq3rtj=oemcxxGuvb?21`h4VA@fvj3zHcGG#NZAvMD+ zQF%|z$?a)UrgOt6&*D;1^y{c83pCjiq~3mna6D|^TIK$mSC+${lZjH_-65$7xY?J$G*mDT6`q#>2l-vz5nI0^ZNEz9w(GEB9pR162|8d!8 zy{Nm>+}YHE8!C4WKQ*tni;LqHpdP|CV`cz_q-rgBj(HMg8h3F6A*2fH9dn*UE>)^y zvK-~L_z~r!vpOVa7E`YTwYJbCkv4D%*_FlrIi9h#s82CSm!!&j62qZNmym0?gj~~< zF8n7qloY%91?a4)8QeLV{FjGPs#yLyL|fiYs_>GPhLmN|tV)GpUA9riKL2E$<@r1* zEu|L2&Xb=b{LA3~u9E-6;VxXM=`JnRx?ZPk{!R&8b1A*Vos7;zke%tPtSux0l8HFewf(m ziiu#d>Qx>#13ZVwrg_FeMmnoX0h7kY< z5>U)Hsw3|Qt_`44Ip-2{l~+tSO29J!vCZzrq$Cg84CDX{f$R7Z^P?kFnv1paSn9Xn zB=p7HMf^$+1`h{Nl~myuzL-bRJe5b^#c|xp&~4D`MP!~I(1hGA?U=Pd zm(Vznk~4IyJ314g+XEMXUC4TZ$BHuTR|kBJJf?#^@G%N3=BB9;j7jn+qHL$mkpa}* z#Qc;t$p+rR9|?$Mlz8xTM!PtwUx&%jYR1G9axQ>BhenwVb|vR@d~AWvz&|$>Nq1;5 zXC_qTd{!J|3c$BF4XnW5E3T>)$Tk5DsOU}PkC2PCoi)(nXiF!GONjM}x(uTK#rx!@ z!21iGD0IGo7IXM_bb1$P@y?7xleybzmjX~(oS+=KAZ9KA+h zam?r|eql>=+@u!aZw9fN)24&zpFH{vcajkDzJ&f0e6*k(05qkIo`QqX7so9gs~P{) z`7nBe;qRpGW583<6OT{u0%6He(|^Zqwi5G!-+yaP@1Zr^jKz__tHK}U`d}~oC}@MA zkpI?|{-oT+_}?+IHt76BJaKGAypL}ixB->#8_dcAgRcqshf|jX{JcYV5xU|%J0qcg z;Tq~~W}OI|>5RvF_@Js)4<9Zr*=eaY90 z80+xY72i$aiKAx^X^&9)dOu}x)a)(zFt8cDTa1S<{hO;g-zR+4O zo9E&inQFA=r8~)Mnc|HS|BNj6pbojlR9UP>9oi$_y4M_4rJ6^Fqc%x&nqBYWV#<~l zJ6wF5q}(b>mdK=j%|lE^tHYMzs+y?J_D^=o@b;Lh&n`QenNiD>pwBk=XJz}xjCaYl z49Rqt$7KiIE;c!51vl3pH5&ZSG7-wvKetNK?6rf}wX%D}E|6+fTlGd$tV$tQ1$A47 zXQ^}bUHa^CN}1ZZm&=f8d!wslxvLJO`jjaZa`}Mcgpe*$sFPjdwS(~!p^7?c%-*DM zk$aTpMA&3$3XLi^-Z-J1+*d8XYO>}HyCjio4KB=pFIAC$qj{1V_;9hpQ&oOS>Tgby zHg6tzF~VT)Ttn_*D76`))1>kS1N64?5?c+q_V@DJMqBZ`R?`i?MOf0RX4DIbdLLnR zm}bSur4$}?T`MuT+O{A%+f^~T3>%Q9jY4bW#( zFMB(c-#KTgoo~1-HN-ZwTIIefvmsuRY`PjG&k6M@Y-~u+a97p$apVN8P-wq(8O<~z zL(zGCD<7lbxo3f8`b8IG#m0<+#0K#z(jED36{#T{8T;mHY9nidbdlFZ-vHNEjPHtXIBieNo&v9q%js5 z{8#PLYlp2gns#Po^wAEw)lgDmTi>_A0BecTe|3GiO5dzuwmd^2Hw5V=$>nqH{ikd7 zWv6XD8~7ZbEnT5qWS7!~HtjHLuDzO;X^bQwK4S2m$S3M?7i}4Ob3gy;{{CzB4K?KY z7>i9&ONI?wcg|QCJ#R%rm7&#C)g_yc&lN*_c4Q}+!dX?&y^*2Vrq`yq(BH}Fcy{Tv zBHOH0t5q)gqIs8WQu%F{loiJKk|l0B7yYdp#f}j5-Jsl;!^%%f)c1$XTv1jm3G-2D zY^*?JNYxJ+E=@~#NY2A(mqaXCXRqdQ{+vxBoogTMak0JLkiSH#Rt3e|N?yh8@sJ0t zYg8yLsUm-F*xa?LwZ;Oo$6dYEv1fftXOH{sjaE}yJ$VDY$!O%-aIT2b8zqArO;jyi z^jW{2wPgfpTTGPr7xPZ=*-yr$21!efy1yS{%93u}&|34Cq5MJ}bDF}r>HA|g?ciE% zomGSM##EUfp~^R*u!WS-w2Dlcr&+$EjF( zh`&oi?&fNF-R1?23zMSe>l^m+l}PP9Rpxrprson_nsl{c^s$+5WLu^3F+q*#3`Le} zgjsJ&vD#dmwfgw%<|||jQd8Nk5sgksbhlf?>&N|^s2-qV?qoPAslQI;Fk7_^w{@1c z>|N3L>dz9jw$0c(?YESewDOc8pL1-^QEom47s*^>NQlB&XQ5r>8Pfc~AidREz9gI> zr8hNdoT*4KAJDEegvg_vRqdMjmbWA5)F6Gfu|%TvQ4P==t%eM#A$GB5dAWnhP@JnF z)}oeWRBOMoL!Loea@C-1p|>73Z?tdKy2Phy9&RVr0Mp`;rX31-l*<#Nv3r!WTpolU zhbdCsZAN^-%d??s&*rLT%iSOCP&gZg#80*VXmV5iu+LZG|1j;w?tcCghn9CgbF-S& zoZ%Ig9Ih)+mAW-7>)h^kz2KnHA%h(f#T>)M4Y6U;JgIYoW+^MI21SO}L$bO1DC_PF z>F8g4Q%9BWw(I3V*5&23Ppx!s(9E&8iY()YlBLC@37f5J~bmQ>)sJVuZYsU z((@{3YFd%jG~>IY%J)n74=w8^_qgbi&6rTj1C6g&YSYuCK61bIrn#Y6+#`eH%SSm( z1AQVsM=_Ed^Xdgo_4!yus;J|siqubCb`mp}0g{@!=qRhYfuUK$iYTqJIKWk}56|~d zIL`?&#EXHLX>_)vSfX&w zj6PbCu1}kPssVQe>uH;`kv1saYT2lWlB;x8D~4OM?cS;=eRkp0bZOj}&=yIyCEFEp zH=pV$pEs(qJQ`eWF?+ORUw!8WK}U_+Lvr=G2DQ^2KiJ<&R9^?3GUj!P8hRl&C?{L; z=(MVz!6mh5olB!o?OszayP?=LOs*PWG+LtGNz@)gMn4NLCPkG>Um?#|C={v|9c_}5 zAEdQCTxLdEC5^Y1@lQnST5MY5njYlh>uQ!ME^e+89=^Uu+KUvAAjP?4{&Q9HFc`BX zgQC~FZwnq>E|INJs0+Gww0t8uHBufZhMj}kRe|5rTUHZ|kT|e#OzVP7X+p5UG;Qzc zNtri2f*kja@ln#Gz5Wbni8RY~-|(^8q%^x!JM$NUevs9jw3@nQBfvyaN~e3gMNSEHrd34a6pfxm$kjylt z8a`SMEu)vEjRN)DRAv@&ii69*aLT55nw8 zFcM0-I6E6gwl^&97d2k4O*2`J`=v>nHZZi%o04sRtJEF_y|wIabA?tpq*YU!MK)2T z+E~?Sn046MIlQ2w(UO)X)tLu$%d9Aw?kpeUa zyWcrD;l#4;X$q~%Wn$Cv*7NvBv%$w?)-D$R%VNHKm7SKvHE>KZYVS+bvpiIm?D8|V z1F|otmd=rySEDnCJF_gt$N$NNuGv#@XQsu}wda3*8$#cGb z{q$v^ht&D=pTB=KNL@dF`t{TIU$oMyU&lV3^Yy_!ob3sa%J1Xj?XO30cl=tA)cL@t z6PG=tP6sakf$X2gQs=K@ZhnGs|HyFjsUf95_`ukt}OVsLBBpTn)0##>D`{lvsIWzpI%^#mg z?7p{D{*oA9byCl}4K^G&?*FZ^A+9`|5X7A0JLm?0 zc$CK<+>v>kn15}9UVziuVDWD0Hzf2eI*24zbi~~EIP!JS6NqyWC?kGdX8p!fS(&+B{6VQxuynLxfUrJyC<|9TnpRF9NV7LW0L!TuBU40MK5?o9(ug^q_O)*{5Cz6sEMfO7caQ7OzN4Ztt(nT^dX%Ho1K z2CqK;m}W~nsl$)h4o1gFc@OrJFf@S0{J1~7K0qq<6lE7sUWO|c$Lm8o5!WBvbm)EHs(^SG z!jIT?0mO@3#R5+(F~kBw2D~HimWz&r7K>zg@Lyv04Sr8Ri{~&Opnn3M4&7e`k2qo> zIUITlw)=?x8hR}}70{k?HFP(D+h7}l?KI@yafP%3@1@)p{1jl#LJ~#U0u~EU2C#*4 zbLf}A9?Ig7R3q>s%2&Z}fz5z;M!O|E@dEF1;?@R+P>uxm1o+}!r#G7nWuv-TH0a%DU7nxWr>qa?- zyaKU34P67-Md~yOd$G{n51AagHrO4!0i7IR1@M+~HEl%4Og`@wJ+K zc48}@o66R5GiK1whwg=L7<%dCa2fm)`H4*oH9o~Nk)xpZFpiFcOW?IY=NoLk2OopC z0SLwab?{_(D(J@GdBm*)W<9I&K-oO%c^~`dV6oUWigp^t7*`S3OnD3TXP{RQ^9-~P zy5iZi3}hQA|AxO_;JMfgC!c8IyoOgmE@t%dDC>|{0mL)*53v)Air3(aji0B$XY2-2 zPDWOYjXULfTr)TE@eclWco)H;$d{7K8_MF{6f?nvVDT($Ai9~*SEhl8Jq3smV+B1i>I#7DSt-)Z~S;dbGxa0hl6;Y-i?0B zq2I&?jo1wP1(|q`I0jk?FOc$Yzz{$zhQ5P;0W21j#Ua9rN zY*N8JxCb1>E)lzD$j0GMyw~Rwx?;m1i+ED7T=2;K2C&hCf70ab3cou(u4C5=NJe&& zavS{B0eaEb;ypc1w0ju(3(*(P=dJ^?(aS-96*!%kcc3%TdqAA;u`R>jLG*5cR|EHe zqxg!$2V26D>*O^EpZnnV1~(wzBltQGy%`t*y%y+!Tm{}tjPvBvjy=61Jy67DP z!tj?2o(%6Y;Emo^>;}N!Mh?S(ENsLk!aVpd$+H#y{y|r~VBMX3_iz&`K<_NP?eM;$ zI|kj|__f1x0Dsa4D%!m|v=8trI&$Qf@O6XyOVA$-PdvlF3^-1kY=a+%|I@$~Y(CLG zEwRy~_aiY~;hg}yi1`WocI5B~+Y5k|Si$gyBR`0I5B_3k!`aA|z&{N?1%5T)Bt8ct zYXd|=r{aGIF~xJ9Eul-u;}zqvjCMGMZ3tt)K`wI2e<5#1f8^k=KeprXHxyh(Sv(7T z9{dxq9lKw#353@e{e1FsBB$!;zGobYj}(NXcb4)H`Y9K>2D&rwzk+yGDQDqBir!6l zE|hn}*MJS=8i}ut$UoA~XYs!Tm`7bZqu-KyZXtdTqI(FP#n8v_5rOVEl*OiSdvG-T z!O(lC_Z{#&%3{+k1o{K{Ucy&Adav zY2cmUnmhz&Kz8}UCK`yA>p82TZ)qbdJEdv}E%kKRuDdJOVE;Ku^V@ctyuEbu}6 ze+#|FDaW8jN-*$uw`d@5*&4l+oun4`L;8ns8Iaei4H+YfMZ5CL(96p8XWCDFM2!9jM>kYW# z;|cPU#1tFM*U5Pr<@4k$-oxO7pT79@0CFgc=cu>ft0}lXypce4^nb?ZR`5>1!Ppr_ zoc-tz1p1>>1k6V#5`PznI|;}~*9raybXq{?5x*mLDe&r3M+>wWn^0up{UW<*gX`!P zVJkiq@)`amVy%IfOHQ2_Q?KEv$o)Aw;@xkh*t}v)cEHaZ{Pl(BOzwTq+eBHsUugqn zv03a+TYN+8UHEznZ>z|cvI$vzU@iLMJq*7?-vUB_Z-7nsTueI`qw9h{1Nn&eVC~0V z9Fh>5sg03UgPsik20Cpir{QlU<-O$Ei~h7x{~quk1Fg~3gU5jr@b3#f3D}R#YW&v3 zt~<~N+L!CVjXH~WIE_Q+Ir`(EkK^|xvf23F0WSmHeB_fEyK&TUI(4~$|5EhCyEl$g zzDpaL(HHMf5gWkg@N)vYN9gk;NvTG(BN|;yg|^x_|bw_Alr?NShSgl53vdT z3%pp$yYX=ny@%Mjfuqp>9e;NzuSF&{e`^xE4Z6wLzC+#wNJCai&i{ayVrKzT&?!O3 zfZUxJ)3`rL;0;4I2EGe;DZVnv<$}-!j-oP;Tx!AF1%8HJ0Q4SYc5-;lZ|Vp5stx}Y zy5gNKli<%~T>OK-+3&&Qqf#c@^m)@%fUj2C3H$>)bG_f0aJBWYrFr&uw7y$5F9< zkx8Y^DRvodiuU!$o7bc;-*t@IQN3L2)Ldb8Gv!6s_$}3`X1Q59t?XpY$p8D%{uqfO zLLH?m(Po-XRrScviY>Ccr>Dfo{LJ<^Q<`j9_Nk!RruiLuJ@UvcJr&e=ud^~d&2xRl zsX8WiP2!?7-4^5Nx|U^{?jOz4ovHG$J`t*(M`hl7vrmVoBvz?@)Zu;55nErD$5Z|? z&trMET9WdG10{j_61^&7L9&YndsOEvXBy^SaT(r9?t3NsOyhz?*HQm}Px&7$uO1|c zYj!HaZG6s2zh6z6va3?Xq+NkE!mV*FmppXqWGSyp6?Uhwse^r~=N)h0`tTg7i zdD((i=`!y_|3A9k1gxo}iyxkw+^k@@VGVo28WAumYQXI#EFz)?M8u^Q6fG)RRJ67) zYJx!#Q6r+FMH^gk2UoPVO%ScM*5X>V)&@jHt1T{VwY6`*-wn_Az0d!7{-2MBGjnF< z%$YOGy>rgo$wi^2O1>t`Nc`JUhj+A!`aiRW2KQv6<5X@I^DZW2=GUpI^Ve0?bcCtx zNogsR`Gfj=_g;A;MlLO)H=j-N(5#XO^W9f&Y0a1QZm+B)^>NpybV- z5izecmvITh#tC65eOBkC)2*#FL+<4Vtd%FqgF;0YJ(DBXufLps!^XdqH6v!zY1bKj zcW(LawW;5>7neU^J^W_X(9Dh(=L+t#Td$>_58D&JCe*N8ma!|P|AD+wv*$Xt2A`b~ z*05?#VY$J4r*+SOlc#&koxk%_=S2eZ&Ur88*E+KYyq+Nmb-m7@5+LEj*UL-O8V;hE5-F=1Amz;8nhI*YT=nM; z;m7Ioi)ZONB#DNM0GKGk!(`&_Sdhy>VaqyubI!Q z^NW45bL8+X7u?Ri4%f^fK6&ofYt*_3_h)sU(?cl1<&L%e>PGl_rEb`I%d`5^+s09= z89wQ1+%#aHeH3LFH97lLgw{(ndj3|AZBO&}4r+Tc`r~WYx4(HEu-Rbr8@n@fot7ymz-0$8_-UQ;GjPSsI0 zNk^yF9h^R4XY6+~nJV`X;f(&Xg;&~51Gftf6+FBUNm*_kuVfG1&H5$ASaV_2CpKo- zt`?tLXKsZzgqukI$VoqLO^R;186!E{-s?WkcFN`zJ8#V|{bj20r!Ox&oMY`3_QWqa z_(n2smUV^Tmrpzdw{O-j+W1Y6ujl(HK6w$l`21|&ms@?lcsl(^ZOMZv!)%**FL(E@ zyGMugR$u+{&CTA+{uwDOAClP752L~R=#Q7nJXN7(T+TB4+&g2yx2@{Ae=NW4aP6_W ze8QC*jWOH2@;(@xIFkBgk?Uu_=ktU9@@*}R*cf~}sbIOE-&IdT+|E($1!1lHYgK#V zNOU4~lh@MkpzD)k$PLqQ!LCJ>ebU#=`nCRU z%E3kb-OEi`Ijg@5lNkdQYeHs!_?M~2{PrDnBSy@gbY1krnMWs%m|_a2`upFxB&7Ol zO!SON7w)_(J=wBr)STJV{HsRa8gS|#$DH}bN%ul_)!n{0XYMk;r_!IE&KP*=ryd_p z88J@&a)n2t&864i1M9+Wao;nN_$XxF}&Ku7pJZu(jmJHIN_RnlTT`c1~KE=z1J z{i0T$S~ua>`BJObqY6v>!s6rwXYSr}`^zDWf4B0z+MVoU9QfsGLm(af>-)+{#)d3M13DO!_%HG7lFETgB-kf7~J236NUnc*VaJx^0*0X4f za_SHMf{U?zj_rK!`Mumh(yU(=vEmAR_9wmfaJ1^okK6n+?d1ONS3atI``*2Gyup1| zwTtW?K?9!lAKdQMd%y+$^%sj@tUt^=7WZcFyA|w~xOeF&Ilkww+I#ll3FF7#Ex7;6 zI?#83WTxBI4O0sD4FBTkX_Nj|sQve&jK{O-z4^W&=08qqB-iJx`_E6Wf)3$>5#hoM zeSRJ(o@o2w;9>KalBtUK^S1kVzuee6#EehX*4B|%+dj-Pjgb7M?ppqO--k;+Yx<1mAc=N+B z`#$?JueZUN2pc08AM~I+t=YoGuDn^7y=)=&KGIY%|7Dx8TAzEO^_qI%J*7!HIrksZ zYPqM@3Y5@Rm?vC=Nd?D7p1vp%vDlG3bJw~dVsK~JN7!*okb-c{wg z;*VU1hqdGkxs%Hu{yTr&yw)VrX%)G=)GatJG)p9P;-A=nuTpo1godet(^7dJqkoOK zu%P_wr>3nQLQ=LWtxoEN`<{+AlnuFfC9SE*L*LX@cCYKgPsWpxmwgR9O{L1Oq0z(l zN`pjDmnY&G68&ejuaGD=as*?wnA6lsY%vE4^6JFk_XPK4E3W{ElJ(szFDk{7_gomon`a5&O5J8%P1-~ zSa_9j$x*YS2NY=aJ<_wzcNuIIAFUoycsSKu~_ zsaa!+zx6(SJ9&quW%c`XsAu!-$UbZ5@#iY1`F^+f!f|V(>er$~zxOmf`XA1q3JXJB z)NL2SHILQ|D_DElQE*&)Y2Mo64!)ndb#FqIZS8wap+TqCe?9Q&dhOYszTVqUe*HA8 zW$0FQH7}JB4gE_X-)&6__HP?5e>ZOe=O|WqRVd&n7CIfpu3ft#@#=pD&=>GAKm%A0 zXu`GvJ4mO`4!aAdD+Rj>ryr0ri*P1b>{tkbPM<7xFiyW3=NF3tWTU(tcsGFCx^XUz z69CQ)fF!4%av(5g_Sgmjw?%G892*pFC+IXuV|U|p{rFM^ud_M(Zch+6yCJq?PN!!n z@MeGtX`DX`TOy}JwLdVoR~`#|7!UwZ0;U7FJyj#pf`DrQ+}0B&2B(vg^Dn6Zw*bch z+W^Ucses`C8OqHCo(-@7I2+6XfInakAPWF9jng@<1;#ebX*1+(B3B@{9S{cENA?bl_M3XMcYmFdmQsu%q050M`Q-0KE{L2dDrq%i#TU@hz1-5TnBs$dM+?$)8h8(oKt%M;=cga0mc9vfFwW_AP4!g z0Gxe{^Akk_9|FAyd+%Mq@t|>bgAo93zh91c9Kz24{{eIX5&;>2Er12c^E)u-&oKaV z{*`OM6^L_wQ_dFJia2Kv{sg!`+EW8O5?}+EK+gw$1E>Jp2k20y40s~o5?~KN16m*8 zOu+wZKYR!p=R-RISP1$Rz$ozB56s!=jsWw4{{>70+(q4qz?{9{OF#(H^?(Bivw({T zn*p2+>?ZI-KnCbDfd2q+2PZBA$AC5qcsZaBa0u}iz&``V0k#9a1iS$KDqt(Z?*sn@ z+ywXrU`BjCfI?lb05?EOK>WYJoZs_4!bMydb#4cIfUpU`*(TosbAIquz|Dxy1YQiV zqTE5?X@F&*cL3i5UI6+Mgt_(P4&V&H6YvvgUjd9r{~Gb92>%T@57-NEfK~xGkMtJA zuLB=LobzGz1eQXEjlfor&?*OeCe2yc04KN14*_;=F&iV9zMwqiD zs}bhxll6!f0sgNC`?(45KReO?V&L`vd$2#u&|u^a_A8StmRx*F=oP^>6j6ynF%I^3 zI@%I>j4G*8nNez_J=_y&VVC7qNFp=S4UMJAEC%jYRiNl}GwkZTt&5&9i6V9>W9; zrQb-q91Lrk&+;~TNUD>*sbWX+q9!$^*IYgSt&c`hUEOKekyt~!l&0H4X1LPg{Q7A1 zv^_1p;y|T!#7>8RVcKF-;?CrNzBAII z>s$3}SIGj6(T2Vvy(mH8&DLMPFnZM>4{t}EE_toUEig)XF;q8Z<&Z#QNoUv2^wp6i zf1T~R-fpLd6)4|5A(TPlCSjEGuIfrxv!&UcH5#$WSI`*gt zw4A6iq{%)7(X;IJu5}_$za`=z|IrbTr5t#T1Q(XOy40j))C^JeVNNj^0MXJ9y(IH@a1ubN4+RUzsfJUC3%&1 zxO$AwUOD0jdX-m)cx%d0x^|!D7plVjctKd#*aLhzeOa0^-I_5& zxGS5vW=qRGpIs_BHKQxO|sM5f}Y7 zP1U<7Tf9?4426`B56-%39<|kY<-5qjQU~n7;qshkN@K$g9_^=#5F2g@n~w@E2Zg1! z?l`y6ds9N(FU0P{``~-^LSsr@Vw_-5-0Ss!L}iI$uV)(g^R0e6-ESS%)wKR1Jt+xq zK7KKU^4_D2i&)&Lv}f^DF30Dr-lWv6^6Gt2ty7wWry|1>ieF{7|7Z@FQ(9~sKuvCP zGfXU>&8tZ9>oGl|*wA+^6FA=g;1=O5U-;`NFVWd>n zyvm*N&XKp8R@6%ZS(Q~K8Rr|Gsic=%Vz)61C1=ci7dS4_y+_=7n7guU+m=Pa?oI!> z*7g%E&M>m9#rVD1z3ab)T^iN)vty@QuQr)y3z^~;Wv=99o_?iF5|-X&iE{n)V=+;k zyJ;WIn<&9?_dcfW7Kv_RPW|vuiJ8wR#f=|LZ{A3c$d7JXd4z8+iF>^<$M~UrxkN8c zWtC;EUyl61psZ2mo9afsyH*@^)lFX^V+O~Cb{r9GmnFU~elwnz%M-i2JLuB6`r0b* z@pP4PUfCU+ATaItdS;K!>?KOO%#=k%qmHeN9bEOol&vC5RF63K$e5y%Ch2aMTN4w4r#Cs`Glaaa-2%t5wjFCPl!gXTsckQ9%XiU%sg;>y z1$xUm#YltlDwP#r@u;shT2nGp-2+DlFkAHP9`p0kY}W+#o6Gb2MO21`wI#!h;)M%r z1^Uve@r%N9TH7zJ6hs`m`es4j)Ux=PchyYUeBK&KT-xB&5j&dAA1!Q;Hr&zY?iPF( zRNUF%xa5_?G#&5KMY?OpANZr*h8XtV!Wf;quvs(*42DG z-DGhW7i=|Icb?--4w|o1jD1z{oqN2pn#|uITqDpXU$s>oJBLH}MT^9Vd8MPpF{)?B zZ?yg7Dvn*em9_2U%QtWHPSS+;ORb>CN3sZ9G`TseC33(0pKJn^t2 zlQYz|%c}$trEHfb@d|AXtm^ZiZ=O!#x6I>Ujfu&U^$-XCcbD?dRcUe$$!%I^nA%L& zCCayqEZWVdN%*a5BO7NgHHa$~8Oei+%UYNO9C$k=hgru;-1_swQP(Vi~l=@+l& z%@Lh!ykxnp@2?|`^1Fw7%`>{=nm8qER6aH`8Ds8WGy0!OTqzl^Oz&#d$C@R~jLSFs zJYfCZ!Y4+PkdBM1B)xmdNRyhu8U2Wa@``Iy^{d^BM^LjpJ;IG zYHfecOLJG=j)|vAKbMKNC`~sv9`sd8l-1gz@m8B;@q5vZsrwQo^oYx9ljWl{(HG&G znl~PM1iXl}kiph#b<0=FQk6A#22uLe@iXQMCp5@PMQP!0e${94Hl0ZC=U%hEh*);J z^H!$fZB+lWtBbPM*s9B1nc<;*8}nj(`buv%CEkhi1S{Mb@8dAi{XiqK+Gn&bzi<%|;Iwo8Dz*v;cs%XYrud4O9K=@^Ho_nOZC}~1?r94G! zHxs=$l5XTlL-2{@M0F*lS45h}wpd+h$kyu2{cO6>T93=(yc&6Pj@qcnR_E0!_3SiLpJoMBP7FB_ zl?J_7ZOup$e^AM!NYczo9=j~r?2(qEGBZhHl~JP?>&zrOhpJOHOCrqfEz-Sa<7l<2 z_Jm#?Zk0DjMM5$10&_0Qgx50JY^ar?^(wQbIfq}Co5HFqH9V=x$mq2q^TN`cI9PwV|2Q zdy0ITfN7TN%1tZ8%1RH=Xiq)E--d=D^-_+ioGI0*Yndd4&WuhEsbQKGDzitaxX#+I zxu;4TrYB(93{{TRqc7x1hD0<~A==hgFFt3cMvFtt#tTxt*&`h%tI=m6wW=hYx>}P0 z_DX{o>{GNM=2DccWty2#V{Ws!&eePY3G!y~vJl#%S=!6orx|QC2Ca&Qrd6CAYO{x4 z9&S|%#gS%}UTm$MKU!?JGA&V|v@u1iGA|!3j;z&O5%XO=SY~zubfT&>ToAW$Wl^U= zEHE2+nbXW6dTpXvSt_1wRyG?RU|?YMYA(uE<~)N$W$u^K$4g1)qs#-xSsq-{7 zi}NZOsq~?lf5Gn|xUd2NAF3>8TE$8;)2y9l4s90m4>9z_NJOJTqdl)^+t33!v&~GJ zT4kOllk%+#OC`F>Jj@2JSV6hF-uGdprW67(w{&WALlQT;M&~S}4!W0$cT_W_+L5(r zbspW%RjM)zEb_=ohV7{`lNKF>xuM7-p5DAXt9!FJ+-ho8hnCA*`l!radf$RFrdbkt zP(GSX#f%m|@buJcRKzDm98#`HSxgBOEBYmxy|Tr5hupIj?dGCpX=F8y9)<>B08!f( zq9e@>7~7Qwo)jH7n$vr86ov?ok(L=RphqEUT^U3Z2tAXus!9z80XKTpl{gIL>}53R z0+r{g0s~CfjPP1hvu`M!Z&rjTFgkWt$`jRfW&^jnFcvXS5a-Q}*-}M&wNkIhH8Z@4 zDx*i5IQ(E=9xo3qLX~nJ2DscHNv&p5#Gx0tD$5tJV!ojG76~^Sn&TgEt443IVJ1da z7xDb^%pRe`|u*u7q^2i!yHgw*=<& z!t%?R#W=H_0RSqAuZ4A_h+CN5@d(fYPX=&?h@QY_qwvI_n6A|bp9F0m@FC>mo(d~b zyge|Bq~me01s0W~pqZC?kWF}Wa8H+gu-Nql<_-dJPaZ2OS$n42xXKFypX|P*QUxOv z=se`P6VPoC{TO)*lgCn&op22zq9doC7 zIZIb1i<6$vKoXcuLEcU2-~&8ykC3eRH-U^nKD5zkZS?i(Hj8tQW$1<+tPLWwQU8bF zllnL1v?3=X%>Am1H`22J#~|0AOb;@BHJ^m3j&sf83{a~E3&>nm>+4Of&`EHefP{eI z2S~h>2}|B=v=b(=0zA)mA{|vYtz?6M?*TdhUxGdXm^*pKS!@dd+}96Dz^75c^O?~1 z2+DbJ>162T@vv^op%l#S!l%HU{EGhw<#A;3ADH%@gWrPOZY%1rKfwchAA=SHe-Hoj z!OmBZ_zu4F7k@d+>>S9O2HXoWqAI8L?L2TD>b_YLNRD0Zw)Uf1@(_dYPnb$w5x%WQ z8^HS+lxY9MpQxcz&MIg^+Fl$%zi|WB%=#pfj+;>%kah(0HIRclapnn`-vQ^`kdr#l zR-xan8(p_k}SKP_w5TswcBzIc$`+?R|#wX8x;aX``AgTF)pPIm zZtM8D-U9MRfY52RJv&t9Jh_(#xqd{R)$1vzcj3MFF;3AI?qvCGj5p4r43#@i9VaDp zTd9X4EgQ7Y0I|^JshQrS5tID0KV+m5Z586U-tfP>PnZj!!$Rc8kRfd-M14b%!}4UO zHS;L+eg}Gp!1&_c8-J+l_Pi`XcvK%)qEY5Q=^~;;{8bRfDsKScETLb-!{dQ^Iq$?Y zqzwQcZe4Q+nt{6f+Gvpwh!_KRCT+*`a-4)pl5={oziqeocp4JJ3Sc} z=Sd!-FZ3uA^F=R=VG%j-Hj_-l;ODH%H1Z`+RFP@FN0Cg7he?pb1NHdKp`9+UzcCmi zK<9o1Z?XawY#hf%Q-~PxLd3N{_afhnL_eXQIV-e3jv88Erk#K=cT)Wuhy&24?ua#UHnMzOJb*&!vs_K51-?eA7h|Z z-|fLl2QRG>`o*~a^^F&41m8s;bX%ki(7~M$tb3T_Nu%6JVJeSon2fa+ZDzu{y$Z<) zb0=Saf!q+0WZ|cmzJk7XhI*5YcYK`}4`WFsef^L&j3!|iFVFF5#I%%duiZ@0UtrO% z#{%z$`nc1~0gz|?=qxf3Bp^J240Sy@(LwVlVU?3K=G#ZJS==6e=rmdfZ;($b0?P5a$V43<2^(2#*Mm_c+`e z`=K|^+t7$3)OW^W98DLI_gY$PcfZQUqB>?r$`Y+aNJ3O%MA z_<8Pi`|xh?3Cf`Vw?n4J-!@b`I&`Ghj8!uex6xp`~FGmuJ-0CGJH}DC0G^!GY*Ie|)xq*1TqJ0NZ_P5_CG7Dp1Hh50Bh4le>8qvO2IXn_{mq)e_ z!I(gr8TvklI-ELr|8s-pWvq2XJ!0*%|En&BJd)DS|9zZU6@ko0SCN%mVuPP)n0nfBi z$)v4cx2Ko){tyy~zO#7*JFgpDavfu=NKNMBB}0k&rfM<%;lewOx*msN&gWvC!veGr z^1P_$k)J^S1Z(c!sQdMGk<)YgC60Oj0Qn~0>qoAFM>)WTx_Rio!@${<0x|`CF~TTx ze)*Ez7VrFOQ-SvO8!K^saTRrfa(X_~XGzKK5WIij2)Y!<()Xa=|Ke!99`%Z9(5F+N z3-GT){eQEV{|GM!pVR2qMebqF)A7l7xd*nGcP`YM}{tdshYX)28KY|8nIwU1GM zD%!RdGKy#5T?q=P0-p)teCO9hWeDHJTuOU^wxBP*!5k@tzV)Dcp=|;9OzAJYROQ?e zkOk*44x!60pr8oo!hTsy($lfV4(E|xenQTKxT%-dj$Z$V36Xn%E0CGn-l*yS#X$Jh z>ot$lJ!e9cE+e$kMrhonO9_=0BhN))WBIbd_+(J7RhlRdEo-8@w7GVHBHwBk1{6E& zB4q&f%Q6Pn2?+}|JR-C>jQnsd{>W+?O#Dc#v6=L&&o%Nz2OUN#`naQ+>TP3|yUG}( z3JY1AtE|Z{C@Yi|c9l`N<~E~ZnwCxR6>4)= z@ITNRS5W@D>Mr;dY8|YIGaZ5!NRqDmCT#Negx+K5s{w}YltUR3&b=3!=nscNP2+BxAsZG(xd zQXeg+{Iw1ex<>o*qEN`Tvtd=~DB*8tXTvvfy4tMB#Y=5IXj`=nt0?~>y^-3cb$k

_^FHTU&6@hdI6 zj{3b&xpK%d**(Z5Qy9k#jXPNP{ZL`o^>zGVZ#IadWbgO})?eIVV`nR%C_3I?p@d9c zt8R-nm*{1!77H3yWYoL#$!8OV+Sg2yd__5 z`(4roN|tWez#kB=yfjMtFyAA4Bb> zJyLS=Rs^odnOYIwpqM7YyqG4_T3iCxUVWj+ACeTYh4`mGBGZLgGmO(WhhyB;44KN# zkQL0Z&5)Vf*ce&StqD_t6^=U}1Zo@XLaVQXE!g4fuoW0}`mKEb>KS)u3I`jvLhY8V z{Dea5R?OgryVSvdTDg$JI9pcVz(g%3A6hw0yox%qSP`@u!L3w-cHFe(}T4SdWUq%RE7*DwwZi`*Zo(Q^IVkIs=wCvq3D{R=yFY(JY@|Pqy_VQ21wb?#1COBAY z>3=(HRv}i?0wHroSGOXesGcg1*x$KhB^KtLvbb5so$Kc2;;a3nS!AG}pToF|YuhfN zVd6e&)0C&S9$30&?x`<$YTHvQySi`hX9*6Qh-dWMPYKHtqW10P+UtMuA_Y zw92*aApcSHw}r=0@0w#DeKUhZeV^bU#{-jk#Zdn5`XAy$F?Qw#gl29|`~@9%K?L)a9Wuff{Rg(@=vYL?x`2Mx459bGJi`X+q`{T*0H9s_- z`NdD^`?;{Ao%DF_=lJ#Wt_!_>JNx?9Y~vR)1#|rind8$BgZ{!;{t`>_1;$cnJHr3x zui3V*$e^Nfit=ZTHc?^21sgrc!P?=v|MEGKTs0+{0z*xPOi3-KtB6+LHvz;pft zKUhK5@!t<7i*Cybm4DpMAH=Tb_m%~;rrmj5vt&^^a;xt8b59TGj=ej}4XfSkezud; zoc}!dYHsfs`|4DT)tQf$Yb5{(ysk&rq>+cK3PUX2ie1?x!5qvUc$CK-`2ni-EDxA_XYVT^t^PFn5o_ zMx@CAN&q$u&fUvc>|}hftAHVe{0h0S8FE?@u!(V6gkf+ew>H7*QPAxn=mq+E6|82! z+%A^|7J^?sFn8Y!Hm2kP+77V@41(m<9#{*au-ilYJHR%0bS6VCAB5+HV7Cjbfo>eY z-=YviaC)7hpqu;1H-99&0V^rzokrLgJDqA3z%r!8f-iTkMo+|tg9m5Q;(o}$6=ksb zBYiRu2A&Fd%*DYo5uir+k+$1YbROa9$YcgR72$g5<02F}912fG`(Au1CJrRrjHO5) z@J>QLY>bHp_%q-tbow_4&xQ_{K`)7Dz)a{GO>^GCGCheq=S(@jRjzz>mz>d9Bo-vr<>D1)j<3F=vbPF{uh zkN&VWdh-aJ2xLBZEP$-Lk*7E6<}Q!_83VTmI`B7i=6uj$7$rtj%2}}%K&Ne>EjmJx zWMB{Q@&%nc&)$Z;Km zKo^ss6Xa=uJP4BLzOV)Yb9Xpg0)Iq_64q|++kej56NNtV27No|?*Ss9qix6=30f$4 zJOiz1Idq78t{8(m5I=%3umt#1m_Gi5&O#CX6VMO9-90lLWk(}igz_rL;*o|v1nqCo z)`CYm!WR+N0saE420#VQv;DD1SO^(DLAlPM-Ik(uq#XzCN9cYa>dR4Kj)3We zgq(L{K;{x9EQJsv6nPGyj%dJG$h{PJ6nJp=#4U8eI7NEGE6jV$#f|8b>w(Ze(u45l zA?is+8(dIkB(N6rivuBRX19mbj&#nN*9Q5{pe?^7AVV0=)?@DGgVqzg*Mj#Fr$F{eBcLyoFF^TApwC76QZ4PY{?#IG%)&Dvg-3QG z{4ex^raHZy-(w7DVCF(Hi8%-zg0~uNxB)$Xg*xF(Asx}^6F+nV%5nEpaF(qj$d6`` zCd|L*kc+#sB@6AE{1APMy18#5JZhj1cf2jVM1Cyw;#!87QDQ4du}8&mgBe@_z%x ztwa7+=^@rCm1~D%3_G3*!JQ@5cVD5gA z1;|(Pkal`oQq*{kp!_sI1RxiD9mvPs*Z3Cj5#k#MLO+nB5#g(#an`+m5Z;OWYRKD) za5;ec7G@jpJjgC|r$`(4Ohg_Z&__eQnFznbxQI^0Jb(^TkasK6R+Qph1!)67OU9fR zL%!bNk?{e%AIM+L@drK!{a!)75F?%g;4O#l^hmpcewzFf+6LM%^vTztao=q9(qY`9 zT;(3jMU?vs0z|r@&k^o}bPMnu;F37BI|yqe>f6KBk2cK@!Sf2~S&+K`>(tlK$v4`{d-GtM-G6L_i zc;~qZUR$BFwPBDA^;%KxEo2%Cy}XC|D!}ifG|VS8#sGeVQh@ZK;3b9}ekgkjG9-dl z09p#ltU+A|py$irF$lCRfN-=g5VCQecq8I-(3d>q-Rf`}W z9)Bb!3UUB*FIVRwPpm)nf48!8FOL7Svi~oJqW^zZc5#^1#&eBx*!WD6(oRcRR)4+k?4X#Fwc$tbEC!F2*DqQo`s3L*Ib`%fcn2Vwog?RNM#0{yg(q z_%dW@|qfET8+g)~^3RU{fU|2ovNXir@m5Ch<&R8(6DNBxhL(z0u5=!sku~gMt!5MbO#|ikilWwgq)WFok*&$=q&T z75SOby+U2UYNS1P*Sth+Y>||%--TlP4>n8bLrpKG(Tx}Ta@KggEvAXHvIlqUfJxq| zI<=MU9sK6yw;~(MRB9O4S6l-bULVHO!ya@&U6d{u3c>qA#rQeT0PE$xm)TZV2xKYk z7hKZiO1EY)-|>Pwe3`(QTLH1zM=HaGeo*5O7o?>u-k5xh3B ze4U|(j$ym({wiZ8LrpMFW#~M0ZnJKhvf3c<3b4X{zrZDl&Ugv_4De zPKWBOgl5!T_8|ZDS?&^s&AldylIJ@*~I#*;b+!3kO?h}AW$3}Z?hQkpqSQ+|(Z zukkYnta2>fZwb2rzszb8h#)vc_urE1(Tll9Q=^%VEYs*gThQpifvp}f!C4p+Lv>wa zX;x=t4f-DA+~_2)>D45dwYqRx^Q2RsW8jYHdBSt-sQBMKv!pDuF-wF|G@N0L7ktNV z)7@0a)y5ShI7?s}H$HFU&5Vi3U_Xg!9ycDp8;dTROxYuu#nVd-suDqVjvSg4Ot)Qp57cO=Oq28ZQ~D-`g|QGd8fcG`p=7G_Wh+xp!>n^ey4Jo zUFZsvL}<_bmC62I#OyLq68yGx4yK)QeV)`4GK<(E#ne?g>+PwP;{>Kr&ynP8mqk)_E<(jA8t?fx(uB)eA>VUisdlySj!9=!t1w#5MJ!pT;pf zNpR&N<426SD{yg}PC3Ql=xQDIq#jghGtYTx!fMrPWQ! zCk9h6SYbi(lR8Jq9k+65C6_qr|A=RV%HIECv`F;9mdfNdMQ9ly)&Ne3^kmib|N8n@3Y zBlhj_&nOcq`D4|J&z9|=Og)UkOBL4T?h`xT>-RjbvyM^THSA#2X9~nUHB#NqVAhf> zE-i7W>2>!7Gj~<#@kHH_nPyufDzOOG)a!_D_ogXQ3X=w3j6{^=Qglt}Nf*Bhxevzf z*{ZkraF3(rJxtNvp4{j+?Pbgcoj_h9rRwYSn5S48uZmP9HWP1$9)j|;_(vl*hL_}QdqGCa> zXb8#T=XEhw1n1V`y`jb1MJM(mnWjdslA`FN@{-)dqueZ^Cx{JRcqshRa#W@1W#&l( zZbs8rvI#{65B^(+#h%qOay4U=v~rCRCH0ypzV=A-yqXDMH^+iKb)se|9tDh==uY5S z7elMEECTw6AZyr3ro?tV=#JjtM)zg{j4Mv|EIhy_dX-pRP6cyM4{qf+mGMTP6WmYe zifL;5RrPCA$EMl8o(^VPd1pS}<$`ske)R>>hMt(RG~4iNkXM6?oqE2L z9us?tTOtnJFvQBXkYFW3`F0KMk*M*(@7j3TGQBQkrhBz|a#nV0&)1)MR%E~`D#WfC zyCd#}nLBTbmum7FfBt$OyHJF)LF3N*yhXT(<~er)oe|jO1BQXd?FPmacE9ESjPP6R z$dU(QXEYYORJ_%5XE_I97cda`2xrU7YoFEp~L#NLv~UivsX9qz%DtiMy5g6?R^2pj`syEI)}VSn$yy+*x02Jc$T- zW+MEZ3wE|h?~lfB1pRLp9{CDs+^!uPCFeQS_fgLggprlheAw-Ad4=@*kneUSc4v@f zH*~cPJWj8Nyr6RyFg`GMqd1yIdZM3Jj;6>V?7GZgj148x0ffjGi%!O;0Av9ADGX%- zq1+Wnn*->N_yS-#bd&^)O(6Le^+>TpoE-_isQ1g^&_DX}6V%0>=Qe`zQQ*U9$1dPf zlnF*XYmxUdWc5J&EWiCIUW`Ad+8`zf77&^hZ* zFxsDtyni516QBol^;QKd9>SjhxE**uu3i9VEqD&BMH>^-!3SYJ>bnd2b_}k;$bSoZ z9*8=OfJrb(Jp%6=Q2fuBgPe8w2=YQ)as;w@Adf%NZ)3;IS+2QTojL0qR78rPj5)9j zxS|eUz)kd3CGv9?sk?wE$N&+X9wRi%`ArdyN;+@i`2tpkE1-P_xQl$RBQQpa0orcw z#?@eWtspmdhIT%99zy4=MjgNQg;iP)FAr!_Q1%wm{|n%}6`Y6cBxs`%k3{%5#{W9R zw|0-yidVVOdD4$?4moZh?F&ScUjdt}N;@qraYl{tB`Wsm5A|G#Pkt zHx6;PTq}`J0A5?r=~n3P0@8+}+&s`r03!gyA>VG$6j(bfQP3C4a-Pi(P@c0W^+tFT zcr4-KkcYDXuRxjCh+jhI4$KFC;xaqf;$O)G#2qQTs_El4*8w{e~$Fks6P$)?;t)Oa18p^ zqK;GOgSm*Op-l05^cQH}pgl+2dl}Y|{-_g^Y#8D@KyN}lg^=mqLDY|OqrqE1H0rv`1r)F5t{FwJOJG14jrfB^g@0LF3W zwQ=W>{~5@a0EHO)3oszKv&vJ)cUzD@#yETlc?yv}XBgID;5~qykn0dIjubn+E*~Sz zS!QD(7kBR51?^mcayX1Y@)6HMdsaY}4%EHh6>9@@z6khJl$#D7+%I^XXuvlq=*wvE z*n~7A(!Pf*+!^t&z+(*t_!`hu2wwxXLB~l402sIP(0`nlNRBj!PF|yL_M`4R;9Ss$ zBku&zjgX-Lc}0)|%_V;-F(H@uRtz)4*4e zcL(q)z)A3{0yLsN&f`7<`EMZq3bZ2{vT@#kVB{MEc!;^a3~lAU(R&OXaMo#vNakU| z+=sHaQLYYczXaR~`gf@R|6%J*z?&+%xbc~roAfqK;oda2J0-VGR|=%1>CP=S2g*gk- z=h=$#ZN%+_3{C`qb`oTYd=&h=f${4mcu(ttUFyr|r}60P$gAumjE4Na2Hgp8w*YS2 zp^M0`tkNoHD>liHA>x-nA5y@RHwt4a;<3~~(g!1t5xXL2+kTMcIq;<;3;HwKL_dI{s8s(78pYW zaiR`efxCcC9`YRqABrVNw^X!0bg8Akip-sYGSJ@2Znr)bZI1LqkfzG_%szZV2Ko&6 zdlxeJ(~UNQ>`iF%GKBR+o)Mru54^5IcvtYX5AM0ZKY*vl>F6h@w*h&TouOaBvj*@E z>i;SHD_X!KXe|S8e?u>n&&ZV`{$UKpd&Ex!d=GwpflPitIjKFIS93ojtke z8=!Fs>F1(u8qhxm`71kc)m_n!eKAg?L9eG{_X~NIFFV9Qjsw;{v#yy2zVCq6pQuLw z>K_N5p+aO8XzfBdH!RS9xRo9MEaV%5wCy3QT=>DN|Epp4RD^?v0O0dV8Chrx$T4yG zvt6+u=-5%@dl$67?1Fj91nf+JHjasq=_s=RdZ+BfE4yQg#mqF&z$UlLg?9NsQU%vlTlVO(wso};uJzGoiX=-`+cNW&VOi7 zMi00TqRwEE^g`H5wE6o;=QN?c;8%8`lpTvD7)Se~E!9ZB31JI{qR%0IH1Y|+cM-N3 z3@!w|3VjIP2%SaT1IR~%w2M*30@UA(c;#HsM(FK$@Olk?JGQOf0NrB9cR2F!z^9Q0 zM+N=6S>J=+6VN__w7U>rjq+Xt9%YBlppV8N{VDJrfXco<2y;=$Tn%28^I@%tc%Fgw zTcGzL{9ndm{DXfQbayIfGy~cI=z?Sr^2|X!k)1q28OpBDhv1(BU zaQMf8Hkz0?fVI#sWf#34+zXL^7MSb|_x@DOdys!jE@TaQzd;^#KjT>jI?B0?!N9+w zlPKrUi@|>%q}hqE7eRLbWb`HKp@aXkxd;IL0^_q?JY{E9fZu~WTcA6wa5r~-wsW`> zGHdFMa*;n1v_C-FSn!ew5;!_WPBfuDkkc0U^Wkrq2)Tkz49Y$Wea7w)kr1~H{H3G( z$&kAbG?yX#E+)Q1Oh}7#*`WC&;4i=cq-`98F+2_YqW(wF_LZPv0`JLiD;8>95I+cI zC|@a)f!pw0XaU_a(0ypdyaQ>%y%?L&Hjf~$hMt(~V60i5kFgShK96+oqn_`A?iSE} z6Yigr@QerjY=o78mJ75Uh^vQ8RssJ9_3RG37!UWQC^I=0;|l8f321FV{x*a!M!6qA zhq93Nha+ecj4K;KQ?XpCK)Y;5ea1oW7sEdgZCN`4vVmNNfR193=0Vwcpxqf5j}G!S z!geCvedKi@Fv5tj9sQvT(p*73*4xkzkiQN52BS~4>;VQp!<07=+^}(199ge zgRO`wWGNYE!uSkc-b5Y0MP4n+=>|}~-lbT!ybb<-K%J(bZ6<>cCv=jB9KwG~S+-=n30LuRy zbo-&ce<9zipmhy(T88|~5Pw5LJ0M;ii*`U9h918~p#=SQBmGk3uX+yiRPgu$Xx3HZ zEI0b~9<-}+cI;K~`Z@ag1jsFG9iBJH&%&=*@Wi04r=ct(XiY-62>g8y^n2vV$IGJ= z{{LWsq#x+sJq^7?`$a;=y^z0T2PO63>s#cT0lXD>8Oj)dycWbO7C+`%%nc!@bv+oe z7rZ8dM+bQAgt(@zkf{lJggo03X9bN1C{G3VB;a2_=f9}0^0l*d5tRH2`cNJ6HQIFd zcJvJ=Jg8q^&{WR!%{PNr1YLo=&!JwdjCml+sf8S-fuBI&p{U0=r1>vs?*$$Qnvp{= z?x0SS!OuIOl>+xSz{z;lT|gQUZa4UdM_H@kKLpy}PQ^16ZSytazC!p43C~}|)u0UJ z3w>-Yp3BgUI^;7U{qKmIfwHDlVy=$5y?`=!#P30P3Bng1K>vVloJ>JIP~TRBof?b0 z$lriEyz@Tlh&~jA7$e9&#wJHKG6Dqf6+(hB$}jp($4Ls zCJPO6T2#?(gv+upA=n<%I6Xm5qbl+y3D7jt_DI_i>-`#|SE%x_3B4K!ZafzcyVadb zC^Mdvg*Q1h8FilEIc5@l&k~@zN!vefBORX-PR2z`8cTU>_#G}M$E)8`UrsX`0!O&5 z2922{=X$h`BaOkD5_RfiIY?!02t8?bcUf{L$jO}{8skb@=_37&XUIp+mEC+&u*!BO zQd7UO$H_avC9BJ#?^{;&xp}AElBTkl-^}>Np0EA#C#v>DSWUT!yvmp*=}NgQlT}#f z%!-SC#O1U}`i)!J_!QR~W-Jr3t@&(1ua>|O%NT=-t4JCsug%+f*H9O3Nhx?sJMws= zIBLl`EXS=YYMK~&yso129M8J34 z=zB@4dS6a+Q(s&Mg|4-B!@?tzbUzx)``)H6Eoqt*^SJIq^04%!POWhr{|vA1|D>h; z3Z1dzf5UNsZfuo@-)q!F)XSPSrd(%~)ZuPxXgXP$F`1}ZJ()2-2d~b`iVdl4A}JHA z*Evmbk)zHI?9x!ZVadHXW8ejnmA;YcoKY&{;K3T_#!X;SWw}7|tmU-E8n1lvXY9}V zt!J|m7Hth2He+H1y$QM}1BcJsy@@_7Pkb(-o-9juzj|vTv3MGZH@2o$=T6FwaN9K{ zhP@|^$wNkI^EJke`*ronBOWyn4cT0mGbN?q;9AGzG?LcVnxd*7GV*x38$5Ix``y|? z&5_Ntz=ijzp+#rY-EURxOIn7y3h1Kshnf2eTacVNRQXT2EF{#oOK5yk2V?x^6QMyTy-N=Xi zH0jk5?#T(65tE#I)3+WuM>OtAT68}hbf;>nw#5}s?Y85)i=^K#5wY&6q*l08oRc4U zb%&;VLeBabBfF6s$ET7vmIlLA?vmKYU@7)K_(Y2Vt=PUt{#H-(HY)M@$2WzX!VloJqT}<@bs{+wwwZT5C|2sbmIw;@y z>9Fw}>GxRTD~d^MWD7w8eXuV}wY7a_?t3n?*diw?F7QZ-o@Ejqg=Mra%~fXShrvKH&G~4D6%dxN+}Z znmV22&e*tV7rT#UO^?pouHSrU^1e>NWay|XSGJtIwvR6PZm2WTozrOA4?QB2V)M8C zHfevi+T>v~Mu)tjY4(TmCHa#yZ3(^34IZwlYuxdm-~ctB9qu}Lb!1yj;&Z{y5z8Xc zr<)T8{1s?Zg?Rd<4kfP@5a$~=tW!Iqb|+6am;r;x-x4f zxw1X<#38j|=D46SpXIH4`|WeD&lxw7-2U?hsTbeK)LF)U9s4PH!&X6SJ|6q6weZxn z6I~WfuN(K%^I@koeAlJZi^o5Xv<%VMx_&$BFV|MI`gkGr~| zNA!ga^_qb=(ByM!`i3{|-e_KxG|Q!XFY8S7Z@T%qR+q|MlpC9nX34FbC?30c&b;L< zstP3v1PJtC94Xty;D9C(!0q;}km(JyyVdd(6IWEm8JhQ#<=>8M0 zm#*i=t!o@GtM$Y~T`Sgl$J{*IqsP&Ob+e}SePzUB_uCZT!r508^~LA+-+rgz#~!6) zR^QSPuDh;Pt=bypeQ%}j5Oc6!}oNbO}-qtu1wXu_e`&tj5#E$wjJV<(c`SIbro9CYeR?+XhK z{BlL=bX;sNzlWIDOu{okSP(p}wm z1-$chAqRAOD-i5;vxJ?hCh~EWe-b>88s*>CyVjMP3RuwR*!Z`ZPV88rta_%Q`O0$818yw=;HBanjhVURM2<=JLc_ zf_B>GM!I7)r?TDA2Glpw<45MWBium~dXexe2`fXYB|&38Gp+f^${wescJu2pztK5Y zsajp_Uwo2jyt{gl9PKVH?}chsug=c6D^%yaZc1s%7&>`kNNsD@>3+gmd(B-#fP5~c zos*2bcv*aFYj)>}6W2My>&Kof_I7#x(YgdODLlZKo)$ByQf2&_SiaevzWq_9s!bDl zweEcPP-DidS$m>9jhlKlmXgwF3|MB;dwcPQ1&8-^_&2wOwx+%G{H?f-|LH{r=mJdxal;o~30?i@9_b(Wk!|g~ngrvN96T^W8^by4KA{qAj5llZW06o?<+^|{DY^J?tg!fyWFi=D2^x+|^y5gDL{n-4AGe*xR$^`0-=@sjVIO>;kK^6pi{743K3p*E%iC+xmYn~k=;s~Z{{CRpCx@qa)~Z^YgC8#aWPfY7 zSHF&S_g{Ks#Pa2DzWTS)E^Q;+ng!&n@W2w-$L)=L?Bj+#Ai2I~nrblUI#@D0{AufG zSwOn1EiN$iv9BF@ZMQ1?L&B8WEALMxqnhdl_Wb;9T2j-a!}ZTezd!BwCkO1^P*m34 znzEAC?b|+G|6R`D(RrKNweE!-Lynl6E9w;^22&+|2worvUK}vn@-NB|yiE9aD)D0D z-|5FbQmQuv=6Ht+_5w+JPxa>K?yJ_LNqJs!y_1aZR#tdjI02D^|c>O&?u_-x6Z zmuZjH%Yq=pCkpmZJq;CN)e{A~$eUF#vE}Wq1czRf1QM<{+0*R8K)XqF8RQVVIwVAJ zh=Rc^NYo%K7S#f^=LuAA6kH7NN}KA6wa3{FVwhen#1ArtgmPKDY>;G8rll&C94q7r zb}6%G0Cm%lQqf^B8q#9vB1vx-?WF>V6ZBF*p)oUFC>WS-@CY#+%{=k(D8gaP64ZLTNpJ{aXyGJ#0TX9oqy>6jHrp4( zOM*Gn6)?{w>J#$>T;ZQ)k%aV~k{UI)#tD)n2o7ghPn(#xQiv}toL{2%2vU|rOZBco z!R-*H=mk-b>;*K$Zla4EdO=?rmM3~k!y(LU+MP=ARC4foqZl9NkR-i6O&`vO3Pxk8 zAkwrvA&;|*&cX_PK2I0A#GXcvL0usjM^Z?Ap?!X)Rj*&7&l48L*?Y+Ld11UTHB5-b z{nmounUrRa6?wrW2@X35*{KkhA(YrXe4J5GWyemOCrkRc()oOv%VBWY1VJx^CYFSl zg^A9If~nL+^-~1Fl|Xr$M;4^QLJHZ5k{Fx4Kw_LFdRK^jVLUI8M0p|=DMS<-A2LZ= zEa{8HxG=pOY7i(7!3$YdUKGOcsZ*L1B9x{H-2_o&9D02>dpu%!AW}K zgMsFk#tHFcDi1MIM|XXgkY%@taUN0N?cGbm3?PODK!|W^sF1}AVF7l#K2}IX3xzIp z#ZlUAWS+esD=i@1<+5?{g6y(LX0?M3PBb_c7D^#PXn3B|0BmfC7?v0}QZ+FYdaWKA zPZ%Ly2$g7oO=9e63+;j&Cgd#)vt~(CEvSxc>nYhG{&>bU(3w|C1*_6w&4mlm8-&tA zfyUaq+2hbq*>Z?Qu-QZ64fc2lH>9-0HE)VJALn-Lp?N~76zZZviGaR^>&Sz|9YML` zeMT9=UVgS^pzhj5<-?Kgls0yY800E~bfKqS(P0KN%W z3ZWf9+AaVa{2741QDznVQ{i?2jsO+`w8&>ixCidDfL8%nM)U9KVEN2%=dca@^n*JS z@E@dA>>Pf8TX_V%4u}Wb17JDMzrVQ)csHN~U`ARj$&tRGkpcI9KrcWR!X&_Za4Y)| z@4_7kP}ZuIeMDt#d?x(+08;=k)AHNBh>*Pn{&YYc;8(y^zQmW$ua0DsPi6BC0Af;L)fC(P_4As$KLL=FBL>&XWnD$hNhW;xWuBBFL$F{ki zCTCF!9i%iwKsG(H8HhSGTEw{*goe@JTp%V~%RsRh!bD=@iQ}TFl?b#GN*Kmd(jkTk zEaf|*zZt1d{aPwy%up_tA#vbDPkXWqRR>VD0R@?G;wVMEit_4@X)a|=P+v+Dq2N>s zph>g}&GMZ(D2pUVq5V)ms?t}xbPYDsAF!bmoJOZ8dKpD&dN-O%$DsxpbUW!Hh3X)a z_H+Y_@6sq|q)2!AfZ~uI7R5Q*Gd>y3UqY9M6WY6vKp3erh6xRQpF`mimV&sx{pc6E z=O8L|XSF&UQti(S(9{-=8L7msOkm5-pO7q+}HNHEqX@ zOGuZd(%mc_FZVV~pibf%DZQYh>WSUdi{vekda!x|J9-l30x6Cm(LU;#Jk^F!o+d#R zm_+3Qzv*N$jLBjCc1|}%3#%0a&IS(Vf{U@SLCcj)(`jJxbRPQ;G?@NQ=a89FDEh~& z*@Q6!cErcY5(7(gbT0Z|0$QDxNL$#_P&!cUrEkzc^i<^}Y&ZHEtDZ+II8-nG4>n3m zd(k9_eLkV{XuD{LRO#8V!4qg{_Q&CL!9u9`B8rvxbUHK|EzK~CNt)!Ly~z?;O#|69 zD!v?BLxgt&(Sb-PdXMA?JWSt8v3A#f{CBrbsu5 z;CVBgqMhkFj*dhsQW;C%)s44E5niJKmKI-P#+!J6!oV=sqrJdZW50#x06* zZa<-h12hq8y%S&0L*o(Z`WK7Ovh|Q+0{6*dO+;8iXcve-($xnH6w)p@@TsL^=ymp> zpiZZG2<#%)sA+bXG!lna76;x72NCe7%}!(w8RW=tpQQ26`5umC9qC zzWE{})#Ks3h}NQC#?t9a$dSN2LiefFS-Hc>TPXCXQXOE7oA`%`*~wI~F*R4*5Ts1Z zc7#5T3L1duZve_Oe;uAw&jD`+99KV^kSVzp6%eX$DP<$Nv38|J(*V;ECcth5WAo z<(2r^d}Io61=5ZJP68Ht3jl!@%i0A56KnP$A z%6$!3(I-^FKi_;2Y5#_-CSh{*6k#s`wg7qpl)YaOSec(;u<_foWy1Y8Q;s;i23KW~X<8Z$U ztk@wq5%w|si-Bu^+XK+=$QG1og}WmZK-sfB33m^K=KzldYzL^|9}RpOvQupT-UrNr zUyE>MxKV7%egvJ72vh8#4#BV3JA91v$}H>w;s(NR0d!LU@rn)bMa2CGoC16mFdWbe z@HXPxBRn4NCcvBU4+g%7u+9L*o+}p>P;9fK;GYb<81d@?9g%h}aA&|kz)-*&NRtbE z5&S4~TNC_cz=|E(Cg68~zXJXeU`3j{z#_sNpxX)lX;7dWs6!>fyr6GH{2I9T0w)9R z13o}}9>P4pli(i#IF0;jq`!u6WsW`vVK(5Y0Obwu2l%@H>fo+JnkR4<0y@I&0N#i2 zCBXdwitWZDfU?g%2)g$z+@}z(ytiEgE<)HFkck6%W+P0ow^Ho8egoD3+mNOw(%i#f zumJI=;m0`Xe{bo8H0R-e2RIFJ$~(qYxUU1RMBT$tW?#4!oA(a^O^Cy;yWjr6jqo_o z?T_$9D5pDc9>RVED1+f1pbF$qMVw-*I38(>kmhgrw2)72|%FPkVd(%DO zR}ijD@XsNi7jESSpmo4Lz%Haw-ksXuo`y6YKoIiO02=^pa1R1L4&b4qrQlbYmP|%? z4BRomimiPm@+-HNBpROCc)H*}2M9pgM&Kn#cNKlv4);R9qIQrG=nVrev4~U7qhtY& zB2KYig?WqLjx8QEm3KK0%J>X%ifwgY$o_e_mGd)-T^44gwvo% zU`F1Fp#5KjP151g$21l>j45XAil_+N-$33qrf-Z6pS1C2g_L4YiP^8Ps$ScP=T z-Q&L_%`m_Klv|DPDDa}ZW5*yJu9YXJQMVMh?*WRH{NVFG^5JdFZ-cxK_#=d`0W`tA zANXB>VwF5LE4H|bjeG;roj{mkk8={Vx&k^Q?h}L`K{$ha z287*0+GM1`%*6jL-iQZVU&zRVG@}sqCE^c3=IxL+2>Fj8d`B$SSrB&${tfW|g7`5= z_XE;AfPXJ=1mcZ=RDg26M_DsbZhrY3?v5xs6Iijw8wuME&|?(G}{pN zAEf&p{tWonql~ZNuR@7NRtFmRuP=Y-vRFa zfD3T%1kZ|n;uiQPg2qqCE5p42@Bz|4g8#O{17JMdEbs%sJj4$IEJN5l_~YQNLjL2( zQw;Yw(0mW!0-zIkssJ8}xTA>Mfpq(j&y0G^Mwl0{6Mj4JX4K&k@*V+S<;a7#5K@b{ z9k|yZd=%OkpYS0Y0Sw>{;2Y>$Inv_6VTC(+sfmrsw{yCJKR=n3U6-E;!<*k;8OBTb(bbvgD&Hm^GtBBf@k-U zm+1nYw5fQRE3N0bewMRAqH;e=3xDmWfGetscbmePC~hdZDdlRmT-|4aDfFGp_EqL}$&BR$7cIRZ6t?LvFPx zPiFFxj&gB@b;>O!yiskc&WUX_)zsMr#SbW&ccJ5&x_XkZt@!9*eQZ`keb|l#cP}KW z&16W@?#kUvvRE_mqxLh3(;JhEeH+)NgdA=h(kV9U&Jg_w^0PML$XRb$>M>l&l6w5w z#E(0lytliNJ7qj_F8ICN5>?mtn@h6P9~i5ey4JJ#9&KYm^U8>0x;<=KoMBRB#D~k= zm1Maot}Hz&^~}Z8OXTMu_HsW}aM!x5Jzg!z=@zWIR#2v+t2PZWd{gNh&UD#PHoT9n z?pQna*paIn`i{KiYfMcsRk?!>E4P#!JSly`Wn3&;E7_yYa`<>~d#Y zfhUy@+gU8JVH03f#7#T^wzB26LJ-n5Lzf z*W?~I9cj*uYrZycm`*2qh9w;@$yd#7t=ZHu!|A))zNx@iKfK?s_d-+y!ISWL>Y+<_*hssAJx>JJc!n zT-P0!4cFEi1{9QNM}{fn0Ox(+^ghQH52l*+0i?t_0ILe6t{!++|88_ zDiT+BA1O|LzhF!F4^N#pM!5@`8^enC?Yl8TJiIS(jQ9kf1)TlXo(sWqI<$>sO5z*c z4wr*3?6%5MWiiaVl)X{A;K$~bB=%|ZaP{EB`JcAGaZ}Y4HtpuVE8~{j>7G44u(@G) zY`{soXZ+ZQ=Yl7^_-OO$2@X?RSVS?F_?%O-q@r&>ahkc`1z(FT6$!w^Dgd|Cl4r* zKBJqKrm3gQDQF$YjBTs8OxZH{Sj&_F&i#yPOBx>T`MjChxBa#Iv#C{QZH4N5vspK7 zr(C{4yX(aSRVUwi{#w`CHB+@QdtSf7Oixj+M%OhR4V#gT(`YwnSXsJQS0mr_%XTUtt+(yDgMyOH|) z;BEuVpGMCu?ltW!_lYY`Woho<&h64N_`n+Ns+08mf)-n0&cd}tJv#)4L}yua&BJID z{WRP2C7Uw&z_{lQU|0?LVpQC^pv;m_H8UR+kQ`}!bn};nmB+tcwfNv__sb#fWz*IM zx!qyAmVAA|-4eC*uX=arJz8?!#8*0pF`ZA_ZcDSaCN?j(@p7J6ZK=#Ei3pJj>=xuBmT# z>||O;)#Gu$mUaF$aI!ve;JicOIzeJuOT5_UYr_F9!_}eO}wb+#~C>D;}J+r~{w; z{%ZU5i;V&9%j!C-nz_93lBCkF#?2E?6VJHRBc0CJhu6-Y^JH)})j@$7^I31P>E;G+ ziu0JUY>wGnp*@(f`je7Dy_zi9aYc`f9r;s2t@hTETB||-cbiHT^7-#)q6`UkxgvCU zk~Jo5q`S6b#Eg@7`o)s_s#QG~JaDB9^|>lM56njTTt}@blbKV{rs@@VOEqzI-;(?W z6Tem3&0ad$dVaO(%7>OU38(IyU&EO0GODE5O}p3jFV1UN+xf_ot0vLxYiz$lJYJo% zuFH&{&#W_l9$Pm0`#NDyWnf0EEhPnaAXR2WUJX^xS=}~beTs3ncYV*4BdWd&?`+N5 z(C5@6DLACny^@`t`$(_qyZg~#b=O`kOb?f(anB$aHVu7=J$`48IAEfBa#hHJwlJ0T zRCRsTDXyni_ZPRIL-h>u=rSAVoSNM&`%qh1^`O|^R@-1x?}k3&sLkaYbp^QL#cuv= zulCbf_kEj2SbJAkre-DY3(AivHEebav~y?d8a?oZG&cPY26D|fgAob8slbKxm_1H0j~gN>sm#Fu`{E$Opb zRu4a2{p|$3`FI2Od`w!UHl?6uAd`~&&NMY!_vnl%?cSX;`b*~e54qWO&O!Q=w$Hvz z9nt#8^J;!U{pYXhOzswLXdpQo=dNLsW_Yw~!`L;~DuO%CHKjl3`_<_Nck=cVapl_3 zKkC;WZrM>>F(?&;Edy}gU$tsocyRd`WE|skV16SN^ zba#(i(rxG7ORcp{oMp zX97=l>7A!u)&}g=SoUw9^X~Kw+jVK`13RBTb@71jt}p{iGrED>vvKqc_4p^w?}h$4 z>7(S7$wxB{`NeXcx@$%>sb6qNsv_G?HQd|~ajd|(S$p8Mcra&vEP zn!(_bneVyRpFeeGR|syX766tFvBDDLLZpy!4{i5uqLn3QX9nopcdc*67L{#&Q{3^(Yufss-WuAE zeHI5(_$2VNmF74%u@Ix1u@cFo zw&rwVZAjwgElE-hW2F)zq{BSXC9y{=TD-}!7LIij#)y}D3&$9Y7JQkPCrQro`>Zhq zHy?0VDz*^fCRW1K@Q4+OwFGQviH{J=OiAaoVDF8`k2?&@+HRf{PsV9w+{S8K>6Qp@ znM~cy#3?1=E5yo83anJFC)D>ihha!?4dmxmHaBYtwFDkj^A<+QLgY$zv{9ujlHqg8 zgmc&Et(>Y{gBq5DOOGxeQfF=84SNmX7hf-KV11S(Rg&4F+@}R0R)txsRv57+z|q`1 zhSCaBytS67u&U(NGCFKSSqXLPwOkK_&7HhgdAn2}*ISazsJn7Q=nyUxCFRr_P)`qk zvoTn$G=Z-Y*|Z$7CJ|nbg57*0Ug&tV4Zc)OXgO(>8-Su6D$OKfehLZIap=!41aFULwJTut-#AVtx+W5 zCiq%65iQ(VH_U!jEM`h3h=ZiCoYEM`Z&W@(|DNJ+fa@3W8U=tErIVhfr$Qe8nWc06MvYNG2htE1= z>8RPlp-g;y8cK@~a)T|B1bH$nPV7m=PS7WOUJ{5}i01>w4KG|0tE{U*Ejhd!Ta?;H z#!0LluQlb+1md<0;c7vHBNw5J99wLm602dbWv915zp$9oASFTbZ?+Xl2HxHIS!K#K zsH#D!{)tdU23T)4hg+;kMzQh&`U64W5EJiA57sl!u}LlnyWj>m3ju1`a}Pc@+0OSQKR+Le;Fp zgA?2gX<(_fp4Bs3eI9fPC^NATgDnz5xn{*TSukv%F>`p@o#iAt zzikzPib2Mq&~&w%6dP+;3++nWj3!WG5r}9eDZWl)HA>~77Mh?mzvK=iIVS&ri$O0O z?O;{9eLBTH=1%)O|YEwAi(`Tzd!(*Yy*eNJrS{>NZOiTr2e{>O*lW9;K}Wx+>TL}6BBnO2M} z&$mysFLF5()QrIfYmuq^Swr`0VF8&f-QPZUukVA21J>Iz&z9NZY+}Q$vI5!4TdqyC z_r5kttMi@Ej}j^xveyS)z_%yv$lmVRd1=?_S$4kXqTzxwCQTi2XICRLD)Xr$#9%A> zQH3wiXNd(7+vD=>bkFq_Y|dMzakmh4!8*%p3h`RTwjFV6cV{y8BnV34wwIVmvv3(X^g zrTAC-Czg)yhp{z$MSYgzY;fz$v|O5fDZ6@scChWi9oBeekYfcq!C<+P-RjOOm>tl2 z3ak3On@tQHpEYjrf|i^%dX??2Av+BrKcX9o0jmqDiLuw_#d+11@pN*@;49s(XFL(q z;e)Z}9RIHEOpB$r24>Y~*BHX@(W+F^b}8R-oqW*{O}mW=)ad$$Nshx}70(J0yU$|zYuRSOa_;v}uipvCs%X{pCg*Ys_(ddp zvf=)5Q*Qt09@nRhGUqR#*>NR;IUQ=)#EKuWx#C8sBo>94w!hR+BSn=IokS49S|qCjd-%`Zev9y#}Rg2CQ(qEk=&hFtWuQ&T$o93(p%E4aS3}c8tej z;|(y;vR2tx#w%NlMI1{!ZhNtTZRfGH@tj8M@uejh7^IYV4mP}LZT(pmK4X$W%gD86 z-T)t@!)etX3ofW(y|QdXN|>RVlQ<=xo=;+^$47EFlNTsSokHVSua%}`BzV0Tn?bG~ z92Tg@)Paf~y37}8)o!o}o~TR&6y&zV@`f%CM89lKFoYh;bg@v}Z^<%x6z5<9%ExREE*6a51+*acDI(cMca!@yJxC#u~I4vsg6mnQ^J(%aT z5sHL^bn7iXNg9$NlRR4n>pi~)EvHpUYs?%-4OC?AZE)IXK#>>CQN%*zr~<1(t#Y^= zuX~@g%i`VSa|WWNm_g-aNR^(|N>2@3j&`kkKkZnj_V}E=13_z$8SJTLpX~^zbz4<7 zy@7;zoaXR4wt~&(L9-Lx5^i8q(a@Z%>L;5y&J^fzHtV?p#xpd1aK~OsB4)iJRhG&! zmChQGHUfOUY?0EE)E*O>5i$FX(#M>;K2{!#omUILm1T-jjYdw(czniAIjF&IDTPye zj4&~zbUDxI%j$FG=W}A#xQ!gtj?O?+Fm5YNAla{_+V~``TCO#Q8yHrd#^ag1LPfQ@ zW@w^|8OxTTt@#>u;~Hbh1u&Ow<#~37-lIOM^LXkLV0)F;){oOx6io6#PyL!{m;>I8 z{0_FlOL+bW%T%C4u&k%?ppn;UnW43AJ2J9uGNkjMLHvRKUl!lYw-s*XuNLIrMF#F`UyT$}(@1zUpVRqkON|2n}MHg8J?h z*9*ImI-0RSxpZ3nns}caV?pbdSzUZ9%>B^)i#bNh=Rs1v#>E$L;3Ae|wH}Kcn*{x} z)=D@oVxY^3FL*#Nt=Hp3kI`0GQf&NVP5fz3SMvyCl8skGZJ!A2TGwRPd4to)lOV4= z5`rvqTj+8lRMD8kvn$k7_R2!4jpG>Tnyt#fWyJ3q8%Wn?;s-acm0uYb3@gi_4tE zVz~05Z?fAM*%r=5GM;QG8r~+L4LWqqSd5E`n5C1VznAeGx7N!bkbyjH@jsi5Ja34G z5~Bk#!SdT`p+=YzlzFp^#=&gGZYcvJ zmn{9kX+venHdgCJ-zwIHhI;HqA2$}_w(vHsw=w?ISY{nW&uNEZ)IoP(={l$*$L_Pz z-bO~{vG~G^SUrt4VW^g63<``^YTC-PiSi@@_UY|vTat|{gYqR6vy9tk;{rJ-43Ckz zqO9S?ekR7_^zphp>P5#PY=v}~$XT9BLa*pa*j zZzc5hq&z9yDR5eYEYSd>k_&EPOi%`C1G@ojjV4*^Q5yx0t&k5HeMu(tew#(3-H7@n zp$w0&mTzV^$VO4>p6dlY&Zw4MMm{4F`U@RVZ0U-{S-E1QGS$dXE`lQzpav+D3xY5p*If5gjI+_ zh#hA)WEn>`M8Up!b1607sF6)yy$RLD~D`w zW(hxbb#e)gia5eVy91#PC2R~1hzRj^!ETqP@(xK9^!93dyeNpgER2j0Mi&-Phm?o& zDOFTZa^a|qz@i-WD91+8C{uejG7F;$WMQdYumr+ww--eq#9iTi}X4nbe)5FDcndQn`c#3(FN92E1jXS3Hj z1WEDOM5Q!=4^z7Y9?pe=xLFJX^V@I`2gld=Fy5{PR}L2EfEIQaT=GIuatKs_@R1MF zmSkZwAAw_K*%8$c8iJ_9&gTiCVvTVWL{%adI0QS77@W7WxtMC1mmCH=E8~Eh!h_8o zfjl@!wpkF2vLG6S2&9$m4qKQ@DF8*thPDw<3=gUcf(8gs1Rh20U_nH3Nw6D6fjTdR z;Y5#J&}ZB9Y4&7j(!wyX6R*&)I~?&i4krlJXx)WEwLGY8JVgx*NmPs|6zpMvAnCyQ ztj%grMf3CV2Izul!+AF_fhIU-hc`k@1KUu^G}H&wq<9A$NYC^8gvf$yuxz%A5xj_C zYHl0v(A)KnDFRgs+1Z9bxg_6?Lt>~M9}!`|j6o2r2Em>t*kc8;Bmk;aDnz0f`@T?z z7}_18wOb<`3q?rQE`*Mfd6C9Pgq1=(vS1Ow&h&JH-D$APCG?B7Dlt(+-?2kL5R?O~ z+eI8o6KyiogGWFu`c~LryMX2-s1migLeo%Js~CwqJk5`XGVo9pQI8W+qGWfB9x3wn zL1Kikr@C72aD?WGddUEZiiQXW3dwT_A%+k&xZZ|_Mq}7r)tjfIjiA0b{bskT_omV` zFe4edi?tgU#vg0zXLm$6MX|eI*Qz%=7N{#iL_3v4UMvuCB22J*>K2JXjgajz?w1Vz99Ql(!!lz!I$b?p203acZJ}rFS&kKLI91 z!RR6W+0Zuw_34NwFUbP zmO9d{v+9QVM_VVd4TAB@{~c}DBY6sKZu>M<<+p`ozG3}#oO8hLlLZ?8sBH&%<;|!Q zJ}cFT;=a#;&Cwvdj=gO5zbz@Fxf|741AGJY)x9Bt7TDM9hq-+R*!94WCDE-S_b#IP zFrfKy7xkZA8aqczLQoYi@(x4Z;@WJVbtcu>) zBn3wT*#xm+?DoGk|97B3$8>#M!08AZBNQVp=LX9%4q8_@=KbI zd|C~2wp;D|CR;s_=DTT_B;dYK#q{(9Y^wk4HJ=wn|pjC#jH((0*1Nk^gM&MgC!?HD-wG1)^tjSV(e(=LzjAmxgNk|E9w^_ks1Uz-^KQ_sMYC@25=w}g^+J;~&@4Q+wG z^?}5ZPH*=j6nYVk{NBUQOmj!fDDa!W-$mH|0X&hqN0K@y&SvoQDdfCj5on{!=v^>7 z%nT#};P)OH=HIYUO!LN)LwM!ujl4HzQ}W_ejGP(IRpGBmPZ_^? z{*wS9E9B z-e|ISBur(&TN!jb=u|TKC<}7BF8EiyRym*-DEBqQeS-cq8;=9iK$!NIqy2uHPiA*0 zAd%p|8VX$v8UGS36DtmprEUr%^QXZ?`BN2PARoodxl_al(t4yjnT8>Gi9Uo>_Ca}U z64?m)7#B#f24$Rq8SuVtq}BvEp{$5GI`ZE2PGs0JJYkTg560@;MGP^beMG?5JrYRQ zNG-t~AS6zNd7u{kb_8??yncc7F>}pi8*B-8AHKz1_fSp|+7%Bd|Fxv` zSI}1NGyJP@J@Pf=5Of|%$!*B`DDEPCK1M@cgWk7lHU1CZrXud|Eg~5Ro9Ty0t6Voa z17Wt!5C-__l#Ss%T;;!3_5+mDh_6vDgbctUktbs%FzlJx=lE;S%xec=IMz_nZ#w!n zZ*0?>FF<=qEPTiKBW;TfkKxoMsqMaFy+PJD`9BF_*M zvn4*g_cLVQa*PESzcxb5cA_4k(3wfML3ghNc!c?{yL}BjPsZ5xIm*Xlg#2eT zXoBv0kZakC6GiQk0mO;?KSS;drUsC8$m>G- z0eaLK=~~`-X1@I^+DOP}$mK2}WRaPW|3lY%$5nN7kKVJ-KIgzuPC-ErMLY;7C@Lx- zDCkD8qhjxhii(PgHCUn>D|RfgYp_I(QG?wWlN^mEwixU^!IoGPtT9IO-0$Ap_w#&y z@4fer+0)jnS+i!%%$_x^fH)WOb%uN_^)vMC!uwWN5sfPNiUIUPE5NZje!Lix?9{jK zUbB=Jo5>@H@Ryi*(QJ>0mQ?a?L;pD*Jl|1n?QzX(OWKJV(@T#U%rYCq@e6+9P)D`| z&ohc`YJ|Rpe#^|xBK$Vv!tMzD$iRnv9Ls>Fv6JFN%_jzNj65=4_zS~Fl5m6jKgix? zGBZ@+TpV#B=%w!xeuBR8XK0w$)*?C){@p@WsXuBd>bI*Y&K)1BUo*N8KAym+7>V~j zR;;cnKAP$w7SW!jckHAeQOYClr$ZI}s9SyZhj#;aZoE~vu9@_0>Mh4OL>7D*6XYot z&t;V%b-aG$24$pZMZId~7%)7rCEii5{y%#Qnej>mS19eL zERCTyZEhgEUqk+*!Sy5QN4$}QBe01Wz@R?2KF6=aXdjEah)O$q>Brvh(_b8@DvP-* zd_=GA9^%v}#%AzTzFc~&tjiTe1b1R=>0;22>DMG~(62uFQLTCdXg6P!70bVhK^;WC zXXzVuk~e&qMc#*7alB_GZD|t!An<)0G%QoT>f%Cm>5!1=TyBT95c+RGk7kBm`+kg3s^Wg4XiSo8F@Jxs# z{#E&3dP+MakN2{t*!3_>-*Ud}_pzrmQ~?;#%kW7ZT&|K~P!jqv}ju>RLap8wZ}Khspn6v&c%8J|KSTYZWZ ziII)TbTrzS^3e)Ufc8?8%>F)wl1C+H@lg+}BTbP^8H`(|8AXa*C7O?Qetwc18l84b zR9%~<$mW6~MT*!~I89`BRv_A|Ww0?#Xw)uliD*&d|PcTyx%bcxZYeTzCx<;H1RtRp+c*F;*gH6y*L z)HVIQQlUq5n!AE2+TB#{9Sx;^InPbbe$hp$)9RCd)M?5;ulUtJo}cU2FuKU?m+8n( zmWFIweAGWHT2TV58O6=WBh4M)M_R7pBwvyxNuzwyrU#DkDH4^em(CLwo&IAbzvA{V zg4m#mPunZz=;-`hVdCLW$xkcHl=o5#v&nctbxn6%P-H)!3u^FejaPX-X-XASIAQa2 z`l6aB(t_yXlOg%t9CJdKrd?3NmPco|G((0WuY5`oR%HUbCZkAHGmh;br1eCYKaDOD z;Z`379vpYf4d0aCVQ$3MXth=K?K_qv$$ru9R`Sk6Br_c`w3bWX{PambQ`1!3M5%Q+ zn1?_8o*rvm`&*rL?>mSnKVwKLSw?x)vHC1cqJY^m>R1Ciin^!5J5ow`Ro9vUK_;g= zRr)EqI91-7QQ{Ttm*Hq5Utkvy8W>_Prgdy1U5U1MRM zjdVLBdsh9a*2xz&u8OvCb=2TQd6S0Wo%j!5+(D72L|w{HwkP?tmrPFA`4oh-ebWlPXSA2B zDf#VX{}|V)W`W~6sm&|La30bx13?QOs3_(t3sO3?th#QQ)GA_NK?kR4$MFuWFCSWV zv~{Cs(J|G0vXdg$^Hn;^F)@%~y|(OVo45y?FIufy%{BDZA5bM{Bg0#fL`J&R1M+ZcVwYcCw~+7M(l$ zQs^#z*}h$ZKhC7~@;ggCVhVk`_MY&%vz$INYi@&`JSGpsGHxHAINt|;;+-f8N<6~5~AaFBMFR}cT;dic8BBt>qV za|KDyZKh;y90=<-Enc1^S(gp!A#Ek!p{C6T+L^7}y10j0Cm-)Yy}R2F+of^D99`m{ zwL2zF&DwkZvKT)0Z`$cpD2yqC;FzEM?(~v=PU@=2=VOXz z+f6NgOp;4OCD1B`fk%_$fX6>aU>5*5iLIoJ^yv{IQAFC7CY)Vx-|at&$8=n(UQV<`vt)Vz>pMPg3a;eL1L&>4uiMomJrQc88`Bqi(S zYwFw@Q;zqS1D)44&NChH;xxR3>vsj~&fYbzNeZsiS-;~&SJUTCGaTa@_j8XU?f z3CTAaBkt#0=U-5yl-RV*iJmSn!qBDG=tuXLT9sAJWRs8Mvt`zd zsDW~)3TcYmIW~QuyfyH=`;%@^y1d7T>&%I0$?2xCt8!QLjpYz#zq#>MS51V)tE?-# zE7IUWX=1gJPOZ*sNYi<>+O+MfK~mO%>%z(q`P&+k`?|7r^t&i_S;rO$4}(woV99iA z&fxVE$wTsM@#g$`Ysqy*M(om*Pp8Bdxj*$27nJGNXm^sN#yT=JtZISDCn|h{^A^q>lHY7~?qANP>0R-dR%TYI+bqDY@Y;5O5Y>eVH``K^Y^){OjI z`)9F5s(s7)8&urO-I@fU@$jxToXg}t)X2)FlDNE;?uuT2~#`xUQ# z(#u5eyK6}$2HqIwW%sTl6{5O+XYz!8`{-e%@a72Fbm$*G?w;=Xe#dK!luc(_^YO`UCBMEgX{7YF%Tmo-Fml2_ zyRL}u^pWhtyMNf1^TfN*ZOsPG%D)Il9C}4L8Tw0(T0>`N^AD6xn+(0B29>FOHX9;K zAY2o7Yr|fOY)`%=JWQg4a@>@Wrt)!6Hm%90dn)~9YicTsZapX0`N3}(z=*Ms{Ib?c zKho>puveNCsE@gHWs}#gwY#o5_MEgj3&@fl>Ldpf7@+fSDW@0>N7FBgdzf zjDi=ZBkLEolWSX@g)Pt2`p#=iQ!?Ir)=wKe=sDbHqvz4v#oU}cMv4nry7yeem$&x* z>=#{9uPCYPZTc0j#IEKP`Mh%87@hv=yvcQ2m0DIT7)#*_qc3W$hBDk%yxLYq02$4M z%RIOw+F@00^M|92j#eMX{!7->-iq95K==KZ8PQ{|Fcyr{hGDfvkCDBVWOMfIaq`s( zAI8c3j?3eb<=*NwzxnHuYV$WUUN&VeP6A6BorcD&fme&v>x1j3A&){Ge`9EX=DNRk zyqr~E=`OQ`v9f{h`Ua`KKiIS-jQN$iMe&>43sVKt4}+#aEbtR1>D5RZ5F(Oa_6G#= zhtIB2eyjPVuYsM7!Kp8ORAg$gd9X>pwcsRS%m73g(p=%!d>?bnfBE(A(2!{e;ZvEm zXs>#bL}aYhwZ38=i1=IAPlW$HvGn$YdBado5;iiN6SV(&>aW*mwaQK(cjHOCKIp^- z)+MNkwj0EslzR%(KxSIvQaSJv{}g|3?6d7lH>ed;5r5}N`b}}#sqoswas9KtiUG^? zm5@zVZ+%7OTkvcdM%l0%l`Y+nHwc(G()GF_i$B(*Vkj@`C*!ARc|hk3>|n}nj%C`# znStu~t3lU@k!&U<@frLdm||rC18KUt-~+a%wpm0NYe*stf6sTQX|P*?(;u^~7B785 z=V1h6HT6}P!jzu)Yhxr~qRw&=mhI6-eQMST91#Ocmj*5XlZbz@hHICs-zom^=bXCW2Gve5iKSCmIjI_{sjL@ zU*xJja^yn2I))_x7{3bnph(QA%jioKlcD|CUrdo{geucpUsTgI;0<6R{eg$rhNBUM z4~M3^J4$ad(QYMZOZ>gAr~s>!-k`9l4yrA}cY|D8BKQaQL}bM=#Hin5qrEuVnDEh| zvM@u_d)#9l!#iwO2CIBVmR>O0jTwogeL{F!612kJN8UrAqdV>;m}&6+*i)%{p*|36+oJlxVEA6CY0s4f2v4* zk;WWq(w7>v8xb1e-$L9$@6yeoXih{S^b|rX?Bzu)TcSbRD%Mah+KooPlh>F? zNu(ganad5r4>iWQ4U$M3f{aut-5eXR2Oh&$O!*Wq|sT?MlZ zT-s|`jcF6w3tXCtd3|g8Na`byK6?zbYp;@ag6@Og+eF(JCVla^DIKBq!q!I8Yp49_ zF7#V~%7h}DE$RD6^Gzp{{(7ditn?(7IsaO^HPzW4A*hF-V`5cquYlK{xF=DjUrNe|-x1)%nbZ^T+VbXsqyX^^x~ab4F~hf+ zZ7d?99gF5+rAupU;TM)}v{%~t2k>;JtzCxh=J0SB`4+CA&m?VQ)Sbt+(l<6My+MfX zR?w8h({OMdH|a~F+DoZ)uOi%^J}i^A0}aXKxgCaD4dwNhd?QE`j2ZX~b=%FNzeL#| z{zj0l5oYf1q&X$)OPDTHRo;2@E6^AW9?ux+0a#Z1^cC+C;77laMJf&PYN|mzrA_<- ztTvdg#afSf2OpndTS!yWuXH(KLojs>Z{9tmtz%Cnei;=SPM^Sz4RHmY7K|=k_DMEy zho%b|2hK_-aRu1;zfAh_>P5oVQr4N(kw?l@hVuTW0&vj!Go5w?jc(}ufPXw@V}U^| z8YGFT0p)Zx=gXif;tlQVDEWDpm-HKiKK+9+hx`_PFNvqLm%Erpx&GqNRK{!6f%lN_ zV&rS#b7T-&YLM@EY%d5qOr5OVhHM~o-$KiC^3-nTSQAS5$zwnMQNY4R5mii|PMxot z$Ug;g_niw``RVY6Pudc0eQ;^7L2V<=Z46>5%Dtp*lmBkg#kP>dZqnVx&$aSmGx1fX zOZsxcyQ}M zossornKw-(p#WbKGbY_AD6Y7Lc}Q741FyF8jT~Y zb$KS;EqR7&w+K0lRN1aLa*gE^lw8R-A)Tv)68`5^LV-#Xi`~KVIn{Dhjzw-Ram&>c z_}F(8AC)5$ijIj|N5uEC$MF(Xs(V)XUW$q1dLg@mSaXgdZ1(#F-`lE`6iv4`7E%*? zQjTky)Wqw#TTV$R5yqwo=`*C}+Ioy3@@Pu=pggeH=RGL0RXsKdOP2NTrR zwGKbMdsGfeaG#OCc}ueIMESGwF|Xv*IzI$XPpx}8GFjC7Nn4%?ihJo5eO_lB_Y=hg zbsDh1<7$H1Cf1&L?)Fh!qiL>XVyJd5r>s;LZgtT+=!JPDS z@j*H2Ir)(@-E9ckmV8=%Qh3pAd6rOoPBtgx|In}`XLK{ubCzd1d%j4>o+iD_5gv(C z?U!D{L1+5UiSgTV+ch#j-21a!r9?JF*k9fIxpC0SmqHopgi%tWD_=4@>o}5@C#2;k z+3#l;QLt>$#1fI=ZerFKRz8>7r<7~cNowkwNQw%H>F%aM329O@zXt{9<$y%@c`_kZEH)lopw72>^ z$Zg*=A={^eM`+X2ax1^WOLA&r(Iwd)_uy#9q$J-@>}0NbbQoUGx3js^z{`fN{a(A} z?n7RyQqM$p=Wu&Y(Pi15^V(h0@bLqwn?1o%!Lz?#e>bjzAI$ay8d1i&viy9(FTtMY_#uzljQ z6J7gG`C#gnJ}oiI+0TP|?PpKOo)aZ$D-nivL?{p=r%*pY`A_ph% zGqd-6mz$9XK2LJX&2GI>Jq|r+rjGb}0=z%+`nTMX_V?zs(owR^wpc4J_OP!UAV%4X zJFTVJr7a!xWAI;Y*&~7Ld(I@Li!ndde4~z;_gT{EF;ngNFT~jMey-bN?P))rM#2la zjk}VlucG{=N(XQ4StmiD_~>?G@jB06C%C401O-a#CG!jr-d)iA7r9D)e`SJwy+=FU#%Qr zH$M2(GpOKxuC(sMUu?q(aukHPwBBHNV#z|uVB2QSjrYlAZ_7&i*%$7W z8I97mtXk|>;$CHUs)JUW^Ixc|gLa%6w8nnu@2YF<$0L4}NBgsEV$VtYUB2!tx+jls zl>NJWFt0?cpU|j8T|c$tm3#fzI zy3rVU`eCfMe~Ge5JJZ_i&E7vqM4Y1r_PUfB6{MhB zzR&1kij%xAG%8WNFLwBciaUEZX}`VOq?!k=5B++l<5r`hodI zpAqmx4$5nt-`|yx?LM?~PKo#`A^WxR)o<&+a2|g2%L~Q!*xzyX@Y4fN{`k88(SR?H zP?!rx>_t7l^nCNnKjK>?u9^43ocurKcYh2M-+gG5o+th5ueiVS$SE+prN$+yTQ2|J zZKlprj)qT2<8Ps|*Mk1nf4W%Vn5A*rO>H=ucFZ1mwnUSD<$L?s3{~13_ul=zqcQE2 zo^rQGm7K!dNPqhXh!4WRse|v&D=A3=))|Zxsld|0wkCOLlaNQ_Prx#gs?A5>3sRDX97 zzdmEnZ_de|ex5pa%R@a~_hozFg0UBxhJO=1EVce{x7;?MM9?sw<$Bu_l(pUtrIOpi ze+_*>%Ex`YJG_i~y~7?@RPQqAmCNQy3H3j%x${e4|Pk_0tYWgFYG)dt=BK-^AV|w#m&A z-+iE8aqnE|F{<)&x5b#?`s^X}w&*qsGmN%30w*SsuI($+RE`dhY( z;=g}iR9U=}?c2QH$r~G&+|br%9>)2;h)eZdt*_7Q3+z>u|JywLLu&8Gq=`H@5ho!#Ew$M@YhT#-0d5Qe5h$k_!V%+GnpAqep#eR zYSTpIHnZzTHO{eG(0)!wv7xM0ziKvw_)oj1=m-0lH|p0OGbhp&-A}<)2X{a%S-%Fm zJnp3@jkW;V>kN}K%X z2Pu~O+C}FBvIxe%f*Du{Fg-6bGsV_s)z8A18D(}6_n1m~r!%7j&NkgczoVE5q<)+z z2KzYX3?>b;0HT-x>Ke^QFe?G~V(|TaKoYOmfxDK3HU;>tl76P7KKa_n>-|u)4{2r* z*~B0^kuJ0gvsu#i@6Rd}Ogh1=H|DxoOncQ<;1qNF^%wWBM1UBOBu{~h?X zjsCk1)Dly^E!9#hgdLzF=21wEPuT{4eFHH2y~U*DDq=2796%bB1ftJ%lbGGYQw*Ba zU0mh1Sd^ps%8LwLEG_GI32Q4i2k*+=qDH_Zj3FN`&+h{5 z|7)6RLi>lGn1Hn*sN~|ezV)5Yw$Wl)AyvU(6^4RjjxF$YIjAq8|Epr z4UbQW+lM(z`DfNE)!sFyjx!0Hhgl3?+waio$Sj`p8=}9RaGm_e0TYG2t_^ZT87J@P zE+9j+0e3~peS~-){ElVXwHT#Z?!H^mT)^X2q$?ZYsjs~K*_)NNe^YcVvW@(;cjZ}d z(^r4)L6df;GD;P3aE>IVlrxC3;2VR0o+9iv890G`MFAJ|Lz4}>re%mDERKBcVjm+c zB;Fv_mvxE~_#e_t68%@kqA~FlX^AFL2+W^tO!_M9^}-ulXxrjgqXO_}VN zeu5l5?=6emKYhf-MF!CtjaMVevVr*N9qWlU$VENUH$Q@wgRnpRXzBPVw(#;sLwc>E zIEh<(i)$o2zC4Zkqy5|+hNkkgr@nEw3iaiSuw2|wS;!?8edF{!RT2wndwXddQOFf! z>Z>2E=+$o`14mZ*i|c5*@?}|HLBBZ*jUb)>pAXRtz48^`v^D4}fOp%`k%u6+&{Ups zKY8a6$tTdx;Lqj3wJR}3QL!xj#~7ZyqOEAF9_Ps{{&uMNBNh3t?$B2Ud-O%a0}Tcm zS4GOKP{Dhk>nMRUPYxD8Z)_^Y!TTx4fU%)5{Uc5U{>N90KIJRE9F5lYJR9#xcZYoU zk8LJO>eUi!D%ixod%Zi%JLeJ_zV9MMg$U$}yaKuGe9%`_MZ}!a z)$?NyByoM3LDz1#hQEcVl*WEjMeJB^5ycEt>!5RHB}sJbPW@57=iqIST|)#Pl|-NM zXyK6c`0Lc;&3>YmKPzC=vkRD!@VC}|(l@HDAF~V!H0y^cZV}frHddU0_th$SiF(N8 z^c1wbH#iv4s&se2=I_c2nW23-aZ&J*Y{UkZ2(z&})8^dpX8`7V^7_SU)V0+p+eGt` ztO7#ATX=KqL84@mb$=7oNLmck|#q zgxOrs#e)<%#BF>^{rf=&vhf-`1uGQsU5~P26J^n~k=7FGcn^Kg?CPTB4_@LK{rT?l z9N=4nOpIWxqwf1c(@XN+)`>FX-UOXd;9i7jeiI(n;!q;xok~8fzsV4020F%O{qV;# z`k4;EHN{_qeSr$C3y;U5ZSPZs@{;ZoPlIS|;SA;|G`MK?wN;xm@_7+p7mw&%0+BWh!`0^bqbl@xa&M2->FSE$+0W@u?Mp?;U z(>}k#q~Puk4PA(@GmxH`)7V!9H{Ag0cUA_l$FF1;c`oBW^*Hf!qK7~{ z#Cz(ZQBV4Fa7+h&+EX;U^tTT1-TkptdmIIC{z@nDdT&9uso(E@k+Mb6_Kz&=p&yR? z;ZHwtZb*6I?AuRNiAG+*Refx4u_vU0c(j^+8hnrDd5i7j$M1y*1>LU=SS6w|sanw* z{?gn`jd?gL5$o$cZWlyPw#%S1hZJ1{{OEeY>wr>?+vzlfXI2v2xa zPTYi!73USf`3TW$Xm5SziU+)Hj^P(TEKWCzf!!*Jvh_SfLwL9D-3$%;cM?FMm3QX6ezrQdw9*sCSg5kv; z>VCK_Qhzs~E_6KerZ4D$EFu@#mCFdKO5brZ0%1FgY{YCZ=x;myr2q?#Pg)~?(E1By zn~V7yUM!)knZTDxqK@dFYxp9c13BkBNz&h`45u#(jh94x8Ds@{8UzhAZ~gGz9+ul3OIb77pg z!oR>2#+@`^Vu^Fbme+TT^dH6~;sXB={Aj+TtlHyV5#LZYc(I(cWopolzmP;y9{iym z_K{B?!Xa1R#na=1uYPFxW-jA)9h;cp9j)&&`R7j$ag7e(>)t-%2=bTG)S|EW4{poq z3^^ge%zgjgL6`sEN{Tk?`|nE1 ze|_Npf32jLUHPh^tkbQ?wgizYd9yoODj%mUr^IQ?DH#Pv&4FV%M;?qEnSs8b`-1n85fBs8>V~N9K@Ql6t|bHC~dm6esSr$ z4av4fStZjs*>Xpfo5U5n<>WYpm-n2bjOAK}?>3eXh`ysrw$hc9ejrUvYU*o_OF!Y; zEn~w>IVDSr9Kc!$EGf*DCOFmU zL6e-tqO$E3tCr?#xRI=#?RZC%b?ceR2z$7%CMV&zTm zi>6DPmjS#btJoc3EMO(&bB(m^P+#5VRNz68yH$-{oM(yL6Bkvs=KgDYa^--y?0NE` z`y?|z+%r!;^6Ksxo`48B8)bGRD|LR*R#F1=g%zE3kpo1%farT?&E`1HuGmuc=2F0- z8PT@XkTNlsyA4pKt8v957UqC2Fn>Yp%{cc0c~4f+g8BhjB@5(YXSx~?;B?KE@8s26 zDBX`sTPU03)V%oLvpf7?e5kLaJc=t=C_Tw4F*lrQ+jkERI*ZRWj4qJcC74gvTO>Cw z>X;X9bEYjy3}DHzQKl0{{T)}ZNHRNi+Z!*7OII4(ii#I$1#>qRrVLdvd-3#xxe_-N zm+^}_+QciK6xMi+p>a{U$>t(xwa2q>%jR?}mdmw?_H61KpMJinEiTHlS>uchA^CsP zUzPK+j<;_f^s!M}NpUP`fmoMo8MbQd63LdTE|DYR-E&&i*qx!Yt`%RhL<*n^%u&M? zx4DiKdNDQn^1j?Q^@pn+{mu6`Uu=7?WM5Ld~|bJXQ!9or>6Q04Y5AE;8tc%^e^oxiqj57fwaz4l98Y;pOW?LDmh z-MCb9R~zCb_x3CPq_u7G1JTVkW1!k?fFFg^3y5>9fNPL3x;<+E7SmIag z&RABn!zwwT+jzf0ETXM~?FFmk21pDoxbV8P_CwJsT*c~O+qM$F%niep>6y0qzlkB0 zm;Hupd#AgHZ1c-sU1MNe!D{)7-B(uE*tH=^l~a!V<~A3eXvUG1;qZRnCzT;lJlwCAK@okpNC_5$hb7l#)eHwQ#FStpr0{jSPa zde2@bSI+CNjJIVTye-{|FIxA}uXR{wxihE!dij35deUKD_E)Z4cO}5TZ&>jQ{ZYX$ z6QAz?{g+84CkCtGwv+XLwFhMH%avYT{@q>wO{MH#t0Zc@0qvykly}c&o2N#<8m!9y zu1Z$r|G-a9vWFL|Hpj_!x%5ZHxn`HPk`kJ!%0}9vzb!B-C3{GCrhA%~?Lq;BKU92e z37-Az-VM^#8RZ)&8)W0kV<|Ij-Ex9w1)R*EFSX0aWQnDLdjou;lhcYi+w3e39vLt> zN95Vwrz?3?8boc3H|Ia(kpZws)o#%Hg>Tt*cdo7QS`~lWp|@4$2gDU6&rkMwpw6%7 zA4NYykGLSF0p-x@c0v8N#bROnjScq}B9CH`F%AhyBvy*1mt16f|B%I&!=any%9(LI zc;PeT{^9`F_0%P`sIw);$ggtc)YwOx<#tUTwOVG&Dpr?u?C?mHJC8_z@QE>f)o06X zhwifI*uXt-MIV2V+MFd}E6sU#m6h~8zpb?8ci*zgw$^X9Y}S@osDLfL7!nR`YLJN_y*ZqrJUbB|9$;*X#UjpYKZ#j)Dh{Tz(}ta zZSgNw3be8nn7vwUlVt6w}&C23@a%q)gNtMrj<8f z{%;*Vvvqr{%2RE$%+FRfC|0%vgx^*2Y;h&I(&`3g<+N9k$EnESkS-$bvy?_}7&B%SEpr*N_6tn zjzYBKnC%G_cW95a+vYRu>F$$Nzj(UmY=fd5dw*`E)o3K#E^1a|Cw*b-opL~@VLQ_o z#b>+sZ;D~$jZ1qV4qW$ltvp~pc~@9(`g0WJmnmgO9J;%3nD~l;sl!*cm6LW=dI$p# z(+U0Hn3q+sOMbFvnDX@>4Wd{Z@>kG9WvR`MynvP?ul$QeS6fz8$~S?-5iIkyHS^Q| zy1V8}>0N`O)ks%i?eA=_o_wiEzxz9z$WnRL`Kc-y8q!Yb(@V_tvy|+k=7tdN5t23h zm@>LQ5)%0;_gK@&vxS^}d&(yvOQ{#21n!p2EfV-RUGrFW$=WSdTr^$t=GU3x|MEBY z4*^d1Zn@H=_q!#Rz1*IYw#mTRkRLf@X|KBebmA{g*|KKu;U_4YHo5t!+g1I`vwO52 zWtv=;aY(B9b(SjE{{E@k!yMjUIcugHJi9SVnXc8jDrb7Cn`GPB)Ve_MoxGOzI{xt3?KP<1Wrq6yxzmiw;nt4FQJL0-AF73c|^V(-_DKjAd0EH`fb3+!KKui z@MO4X?(y`egYx6o&ko8%-o892nZ*dDIKcDUq`Ed|)FIhCWA{<8q|<3=<)3k{Sh+K+ zVfG=}Ce)m}b1SDKnSuKb$@3egt=3jj@~ZmIt(xk4%%YuinNi+oKqFg#K0pl4U>g&5 zQ6dv`CJ2LZGcOSQ$BSxAPU87V50JcGwY4}(_f7}%H=cx>t%&+QH|=l!+Y-(xkl=Uz z>a`aPPZO8v&tE^Y0DjKJkIa-bZ7R6L=wKll0z4m>NDK;J(SeLB5f_DVlfG|_(tY32 zghPWkT^21DfBj4#MPU-N2W)Lte1}<7;#>%Zo{3DCQh-OXB&LU=O=Y$=n_1ps{FN~% zY4jzNF!R}7H zw)d|K?v>yT#rCg?78-aa>jDM3C|S19n_!Jz!5MD$X zYM=?^rX>9=OE~GYy{fM<6ifUA4Ar7*qH6gXqH2$Bk|0SQQ<yV zs7LT+61EK!hWVQG^?_Z7Tic7+10jiMUAmIN7IOVH&5CW&T;l#6djjQrbQwA6QMx3G z_~@;F4Kn>nI5U3uS`NkxBzPvY5Tx%xu8kds8JdJPl<*srZzTR2nC{@-jrk9ZT7tif zH!_PI+#fu+N8m=8ukWG!mNLzT&Ym=`euTFm97VZU-VzPyFjjDgTRpmTRp(J%+5s>_ zG0VX3_CyZp#ZFMhm89EDxrY;emV9BM_H2dzITrKgam7((iP37cH#-!1igrp_-(Kd zF6{fHs~cB(ey<(=B1{ZrdkOqh>U@89G)I51qCYjGw|2e8j6^e?4A?L1%m&K;1fD;}oU4iq5kCw(?XW)_ zE7j0iIjn-bf)9LMzHQ(W@)`gT5sg#9F^%k7S}9 zb=Vp^j578j&9~mA=P#e&Z%*18l;@nbd2Ava<>Fbe+@h(YJ zrre!~o4*ZtAn31 zsKjY|$dho~c2SN>rCR0y%9=y`Mc`gXFn)k*BK+)uokadQ@R4IPA_O}R`T}qt1($Yq zWg&fe0^uEirwbJx*tJQsh_EU6YhvaAe}wwlfqeo03~)Rleh_ezu~F2C?q_NH(6NvB zThz67-Xop(d%&U)*H^n|5En<-D*Q*V4`Y@AH`+yd=--SR(G?lUz(LAc8$Mhm&-?JK zY%}0O;p1gVj3He!;A4QDK;3^z9SPA!F><}zmHyU}B^5w@~XG$93H zoX1iy8Xdw?jZc{f4GS-o>RGzWNJe*)vbBsQyvt+EcbBmk3!8YcRXo{X z)L)_v%}*8$p1L_P^-7Bcv#6n^wHS-PFVk2oRvb+g~MWynWyN=8>RAd)X2-V%^#$ieVe?&sGmG7V`8~D2i25Wl)6N8WI{- zj+{BlianlnG&O5Ecg;j;VECcX{CTwyOLwg!mYUH;tqqp9FIpSi#_|e>ftKW0LLI7) zbe|hdkKaGv)FAl`I9unWF+Ww*$Z;!7Cr&xebaJN()6=-0LS1UTpJ8%PQK;jmGGS}t zs641Ox_*k5(#k6_VfERGRo@}?DlcM_VvVsz>0{0XnZ%9Y@B+(NZ$PuYZ)3597PS$- z7)z{icZ{yKf~R;D!-JJe-DQ3cb%+KQsctvR=A{gBJIafOz_ulW;l=?T-46+ zuMyb)7#Yud$9d-~a+rdGHZ0$rWTBJd0jJGrLW(qMGKq|P#rPdOL=#Sk`Ww{ zVo6y>ZM5h_i#A4iHrLE~0tx=(r@w zSaiO=1^H-hF_yG%8Y_f!GOC3%W0_*8B1J8U4*f*xA#D$>y6#d_>fWFjB1U@^7?oC* zGI?XY)mF6S4x&ooGNrY2D5bTq9Pxn)MZRdGQkSNVmi9#%L!-*Ki3v-;*oIq~f_Hf$ zaZNw+Y};Vx%==!j%+l{qN5e3OXlLq4&sDUv9kjUHDPe#mnUcP8c*b<%>eu!;lB07c zS`jUVS&Hh>EG&Cj`4(ZmYKPW4-AxUtQr#qr%OFL6q8QpH`bxKXqfAJOuOix;T%Ac0 z)mcbszDnmVy+2VzTSxH^&VkOc-N>a&TVuiHF7!~Hd748ghTaoC;ooYqujrOEtDtqi zFo)Vrn!o>8nV|bAT?_&~d0QL~rMuPzbsuahGWD>~X<4P3GY=;87#daxjL7fQ)lzu5 zf?W!C_N-wn=_0aC+a2^<9Gds&Q1SJ68(t*el(LDNTJ4tJTH2cLB{ z^xIp|$6|DgzLr-HuJ(nGjC;m>)hUb>s6@}@ikKdTtiUIwYgnsrWT{&}=}5-4exl!~ z7I{ROq_+;Gza<<g-g+{FpcS1A=3Xq9|!JKXQ%37jg5TVX=vaCoGbWr*G== zBx9h`eV{O=Umqy>_@qdoQO-e0XL$r|NB*ioYr^hiW>-+1ma!Go!IsGf+8YXH9_R#L zT|EqovK&eO&fFB0ueh{6ITK_Q5==Rfk^n0tQL$;a<4MWA|Ej>j1 z&gEiQSY)pn#-bi#mqb}CN6bC@NXMaik149>hB-NkFcfvUSw^~6!9DyC4fT@p7Av_b#rrzU-E*X=i=!?5x7@E!q_DgN&v#PAwb>s`3$jD=I~s1P z-tKJ4QBfO?(s~&rXGQlYYEg_f73Pc3it6YyCU>tf=h!4L7M}MO2}W0MgOplPjI(4p zlyQF>PgM_xq1`_6riEqqKKgT@BCbJ|$W6N0G*)Z%>&D+SITQvAckdH3dKoP97n4`7 zjCLPca;~;BNRunlwnCMD?Y8AJOQuGJG{Zy9xkuT>eG>|b2dh5nBOZccqGek}n$eCQ z`-tEnp_AxA`-lO?l0L!jj1?zu*qBh}xrx5bY;yG#FXA4;y5x4YlpN$GyH_i?%_-@;gN`L#B(*A0R6|wd>9v=W)l1L9 zq+H9bay)FEM~7>EGbY{OSrrCL;fK-c1P6tfW34YO<)JR?mAt70-{tyDyylys+_FeD8~EmLXY zp(cjP(+CWnyL(z*4P#V)slX`a1i$j+38dVqom>O&&IuEk!_k!AYRt}IR7}bTQ2>#k%F=p@s($MT4u&9yQ;a-%~E<7Ju*qq;s@OE zZC+|Isu%chjL@>9I7PH?6(82wnC7P#YMasq8gf^)_@t}3xSf#F{iytm&j%W6czP#U zJPQYk&sAk8Jkx~>76cRmbcJe(8Yup3L z=QxIBq7DE2RDwP~=!3lmvp9@726;^a{v`fCF~>0tF$`3qgaRJIJj7iOB%`ngVKjvz zN%XmXDDf*PpPBf^&=ElRRQ%f9Ef3QH^Ag}r*e#%?8*tr8W5U+-I`@HnPW15RUx{qiySD zeyA&FnE&evPG}c($g~S~35Gd~u9TdP-4k5w^b!}KG#dXZ-1;OB_Y2$$urn~-VBkz_ z>P56CyaJU|0e5#yFH9MP?I*&ACaQ7m;ra(%? zA5QtIf#V78NyKpuT`VX6ak#Zf*k{1{VTR(?CfMf*-%mVXVi>lzm1G*8kMMgylXfY~ z7{YLhJ}{P@>LQQ4f5X3?^tt4l3%nnu2Vq??YpJJ>#HqN)V%T*l_Fx|YHUX);N&E=H z-h+27;R`Vl#I?tMg4u{^j9-vXRp63wYLmx_7;OUF68k#gb+9!>pQboog?l6>no631 z-5Xk4L#sA<*AzhE!=kU2qEo0+}cGp+IG3a zRM=M1YD&~{$WAZ}QQ_BaV8#>n3|xb#&knf1!_aYypTM~gvmf_f!fHd)F>u8LdzCOv zaXp3bNZbl(Hb<>rX$)wPkrL@algkr$HZfrQovscp9J4Dg|T)?57!%u@5yUE z@!ybc4)%7;9Ky=U`i#Q8nRsn$o2CGNiQNiYQ}~?0J&*Xg zn2D6#7ke8flRUKZFngiDAuu+KKlKw29qG_@i}YoPt4rMtAl*dbFJL;8rUvQT5dSas zkKnmY_*;yduo{@&xXXg)4`9E7h6cb5!~Gfd4&t_8>O;FHVRvzlAv_cM>tX*)o>j5q zG&km7@LU4NaClH3e>HeF2|iZ>T)OxvQEg1we> z`*CZ>LlUsRAb)n93C{KlnfN>43kL6K+(Z1475paf+#x=auuGV}&@%*oCUJ*|>jj=% zjDfi+fK*8PeT{ha0e)fj3O!1@3l~NmF!bNwxkF+7ckD%O7@rMDM1fFuZsWS0|cz##K2Esn|rcSgr zN?ZsyP80tF^hDzh2gXFWi?Bfa{jjx5i*AD3hOlUgb8RK@J#l{n+l}}ya9_Ya2A?~V z|DRgpAgmGA4e~QkejDiq;9p98oghwAUMqxa%D+aGhn;=;5utDJ{{U<^Ek9ryW8Wt( z8&gF3>DbzKMoqa~KwMM8?qT;Md&*uqbX_9i9ZVui%GYLysr>95qwifn+ohZ;yaRO3AT-TtpkjF|)zDAO9)(qpzvo)1=u-9qfhw9Dfs&q46l`A7f?!_a1u|_EPe+ z;_i>^rI6+#^n3@tGw{wy{36_EF<*nL0r8rWdkb{+1n1|3Z^!OOxpx7326sDPdg5Mz z=}f%#>QfF3vkB7{t|lSxOEDJQo|s>O(f%~G zMT@HN{QzEV!DBCVx1KQVSk4Q|*AM*9FsS*&ADG_Icoe@8*jAVkm~Q0%j`U}VKZyAl zm{{ywXnF~*Q~V?RL;Y%vFa&E5X}S|%4_Yq}UJo8?3hLR!9njLj=k3_qg^DMjQM)KD z2%{}9q?2|g`MdBNN#hOeR_L4rpE?kpsL2WGv_*~*U|$eE6}u~GewDa02FX37-3qQ#z|F?J zA3U=uXCh%Kz&0m5h49Y!*TaWX*vs%Q#Q5Ug0sYmXs|9dz@a7I-ohtKx4gS8k4->wI zGXIQwDCPZM#a($^6W8{inG7%qixZX*6m=3H1VuhmD^=UFTCJ!7+-etx zIATDgfYhZAEueKPw&>G}OZy^4Tuaesty3oo_cX{B z1LqLz*@5zr>5!X{4i9S{9%(m0HW9pS$nPAm{E$Z>;%Zz6Tx=F8OZAt!Y;cm`dc~Zkb^=n|R0Bso7>jY^|qVF#T zod`Yq=8YV--i19EkhadQkND5vFGYUuf+vD)1JUok2aiTsXkgrjz7OoRzr<(?aBd*J z6n*|6cyUPgHR4*}U|CQ6iqHYvDX2&LK?;B1C4sjGdV>%jg7hYY7U=v9c65OL62T8) z4e~#Ma@>XPpOJPWY*&DH3%WLhaHNR`mKrhjP~)8g)A02yKLB(Fg8c~oCWH@wjbH8%M?oj!It%fSVYdY3w|}1|4QczMy*Gmn zg=`&s>Uk_YTYy!8cp2pL(O<4%Y}<)z1IqOq^11?B%)onqz@V-=QLl?&n;YooQMUgA zj|0Xj=rgz)P&N)U-sed4Mf@XR|Autlz*-EwBapR0hXUSIV7v$U3GgN(ej0h%kj@?Q ziO~5Q0zUUbxFTKw*?$o1Kjqtkv@ZZF1-ezRa|`l1kF;+={sr`x!cTty&4ZqUkcIT_ z$csn%kC9G>>x*c668s~O?*qmzT+agY0P;Emej~!4fw2&_#ew$~zn zb#*5Q^9k@WfpHn>4?*@GWI1TpyU>w976|*+fxi{<45a%f^frU{E#&y62yp{tY=e9? z@;V8g8)UOUzl|^hGIwBH1HA&eo{%pD{?CYig|fVg>rV)mfUQQJEZSU$GeTUG9^h1Fy1MLm$T%_?p-qEmW8u&YxJHW+e>XAslrpRuasrIKz&X3|cV}SY2 z|L(W$u+{!adiUi7!xOG}Ix24^m;|1Z*?1f(Bv~s@tMvJjlvYZ9f_II!<$En{6>&^H z6R)>;Z)l~lmnxZDN6GftTq1dcN2W&9_q@$@gw5c!uue4KuFdUv!pI65TIqX~8Lc;Z zSJcs}VMoO;@J6ih>9FzD#AMFkS8H|&&osEtXf^sD>2%Qu29FGGRKOXtD_f=Td@V)P z&%4ES#1Yafhv5US>sQ5IZ1XbMMh&=Iw`xFVb)UEIi8xAOHLx{ofzCv*WlUVSMY_gJ zvjfP&ghqpR;RX|>-eVb?((b+CgrMT<#EA~D1C9d{Ho9K6jDL(#hL1i zfHSiThHfT3y-lO~{Lqx{A6krI(%07%-&n__H<yZTeNi&$ zJtMXK8J9uHWv3?Z*t=pEeRNPpy<{p~=C_+j9qiLaO*_>7?#Fyc_(^uP?pKX$Z);Wf zteDk7EtD{OYuu2zY1E9%xxNRExJ2ZXot{~2a6feZSj3W}<6geI*Z;G-$08^HGA@|7 zy53f7(5z6Lkvx+u|2)uDyL@dzae8@`J9{HtYgN-3Q#&h~8mp<2*F7?oTcjt)H%0un zYJ66Bp6unBu0uDT9Zz4V3((Ua^sfw9A&s5n_N9KM`h9Z3?91GHXG>ipKhSDkaMUv-H>l5)8?#0n`F_oUw?%;*y*;EM zz$>RHRcM!Y=uV6&$zAt(<#k<0OiQ82zb0tY_etAhFN|qkWZ^f(W{w_dx#*?Y(9r*Y zZ>adljglq7otq+P6Wc0&XKA};z@3U!gRaN)S$1yA=6}^~e^wxPmn;9=Jk1vR+?|c@ z=-Tz~|9Y|GIUgu12jhI|HAyqx9@1U{f=*DU< zY161re_^d&Ql)f_)nrkZ6(&v&V5`(|gQiRSq@1s5t4|;!Ey=~173%}e?ufr$cXo|= zVQJv^vqxvPN}pMlIdI^AnS@|Xe5o)jSm}2%Vf1viynO4{5be$}iI$eNRlXr%Q&Qt5 z)l7W1c3}vYdeUY6izL@t7BXe#&f#RsxpnpD--~!%%)UbXHK0kV5*3OE*2sM}zLutV zldT>(HLDI3EOY?Vy91NMV zd{=Iw%hY4L{Pw-(VXY$A@=`C+v7=M+mwh$vKKY@=yPT6v1RM5`^DQrlN{Sl$%1ZBO;qj0}Bi z%D~v`d$!SWL4WBydt5JzDqEB78ay~4w4L`}y5VM~dfdiS>~Kc(OGZ}smW0zYe~#J^ z#?2}zeKF8CxnkoQ%dB}jHh%F*&d|!ZCSBZ~@zJ?c-=Dv5+^Zue**;vlt!VQvH(%8c zjc?g;XF#>*n%QwfFCX5JRJ$eYRK$HY;9Pk;^TAsLJuYK<@QIdvAL~4sOE((gEuF&- z>nCI-57rOd8a@0*Y5r?d1`8bDBKh!B5glLO_rl(7`*-I|VDY-Zua6Y$dp@;eZtB{z zgBo0gHtRgkvX;viZ?r}34XDnZ_2D?OS?0N~f5^NM6Ti89@n=7d_+Z}V+;6`5l{ip8 z$2foTFP~qzF?9qnc}t&vN138qGY$mb7&BR4ck)}4Fv8m-bitZ3{=0-G;nUkgi0=!> zyZkC!6Ls&W1^0-VW2jJFR56*dqF;&1t7UWWZi~5yYVa(`4L-1cr@0{LL>s$acWg*W z&YHX{S2?%*=wbODWgiw?lMOw1I_aa_b%!fAY%Vx>hBV|Yx)|6oaoCo&h0S@(hfX}* zq4z&@rf~kkt6}S;38B966(5Cfdt+jG;@6V%+C=5fNt-TDJ$~rIK`)%Y-$bP@S)*%g zR`31OrkvTY?!3JFQBmbX=7H#96 zSuj77AMi>|=(E|ELcRa$BmGx&@~6=rF6=zb`2NGvJ{>nRa?Hik1Df`IUH8+x)Ztft z-2Cs)+&=4^Gb?s|eP3nczXM&0{}FX<@cX~Cn?Lir;{KK)wTR+sitg@wNBLvMD}k4f z1pO63L!9m;d-$bc|OUkxUIbv26+-jEK4R}rYaZKS{V3sbO~AItC;?QaeU5cHfF7-Qg$}NqG^}@ZDnKdAZ@??4DW9mE?E^`#%@hZ_nFq( zxcymeDghQ-vT$OeW?f`FGn6>lT z?Ih~8nOFNZCi_Nza#q|YC&P{EjMo(@OT_p5#$QXxk2$9mMT)8d_NbJxqtBl$S(4p< zz&{h-y^{2IuVv4CH^7CYp8NUiJIjOJOvIR>3G_L=CHt>jnAFoKJ6F0w7p(MoQ4tqW z?ooVmRM1cDCq^5+7ngaIQMTZdV94;$t!s}xXSKU$G zvyK|{N{i=|k0z3}*;($KQva3JMW?z(-xrXi8}VKd5G*S&1Zia1?; zdfKf!vCVU)%kDOf``7qPLk%%y;0gVzmm`{_yDtinp|{6LiJ>oHv)o4dHId`}H1@sn z)XrD1b|CEc{8%&CH;xH#39KCmtS27s$YOo}aPtT2kB1wnSgSnT_``bT;RA83-yZHN zV{P|vgBI(Phdbq1vp(E#!Xo6NpI^IQw?zmRE?pKO&KTG?C3olAADr74Auh`~h7_<5 zW-w`$jDk{E)2zU@)1*bMU^qh4z+{$Vo1NsnDY;S4QdW*&l{5}^x-ua`%6Oi%uoP1x zu-h2I#2H!d3RVv^%~2wm*O-E{eVquMPP9Tg- z2+dH0!pa))pq(^?DKNM*20^2@vVzuF8iZ4KE((j7w(7^G8VP8m5@b1RvU>AW98K`v zW4D55;)4aEhH(+>76>f9(IFw@7?w^_GB7w^O%<_jI48s?Xu?Zvk!yUDDC%q6yCaAy0cLQCU<`N{yA15RLXtJhVUp%u3_g5Jp+Rz;J8N;?w5IYLMby~UIV-E@NkMJENkRsdK@(|3$X3Y^ zlM|HmEMa=MHOa&&h$NoSTa)+{3*$qB!tz(oXvf12r65lwL`6w@W)QE|Gh7i%GExiP z8xw*`z@s&_fkEG*7@|mRvO*UkXO+H0F{>cZtQ0*_V2{$$B5xDAH5${!$`$%5^r!CSkS4sttvb8^k|?-d8z)P@9~_)8y>>5aCL$;@YHx>7ek_B5u9G5^fltq z9TSI+1vP-N6cI@gWCdkn^cJa+QBrcHT7ft*G!e_=ccdf;Ugt&6kAfFhs;Lq*2_8j5*^54jK$xi9)4;k{YF$5~@hQ zZI}|&_9-E$^M%LL0b&oQ0{c)eM!=&l3`LKI{l~*R9z#8xHtf@deTuM85B4d+{#Xi+ zV;`Q6>2V6M3!TrQoH4NfFa=mS8ZJ*2k)aHBP5w^si40fFmP-`8xiP(ZXKQ0jYvmG? zu1&DD>Zm}eku{QL(@2HYY+@*MW*py;H6V$mnHf@mU)d@G%@otH(}!T%tW`!`dLYuZ zRxX~-Bvi7A;E75Y&swsXblazC!4XMiv)E{Fu{NvOB5yA~>*b!mG7n>r)w@9)TA7zP zTY>(|TMO}x)(Apsi%|rI zQa)|GteFh8<_PdIZ0#BZpTrnLC0>qWAh?UOT^XV|1|HQc4%JId%q`7gLDWnc_;bxMt%AnLEDx<*GLujeZANqhbD()bAlnqv zCMZ!F#;n)1F*Z5N)xqC`DzwcpZS~T`9FO9mUb^FTqIjZBxSg0vdXU~r2h-9<`2?Y* zFT+{Qr*t=YsU@Lx*w>fEoK^E4yG7tAk)n>!`?S$&O2@AWO4PXt?M9|!m`KVL^K3&5 zSIL%0x9`cbiK~a@l&}iHT*7qh3o;U;E6tc%D}CZIq2M@HJ7&Dtd@);s#uPQi7)XpQ zw|o`N;trZL$tgnGAdTZWTZ|rU!StzItY>go|Ao2wN}@q*TjK+l;q!uZ9ASQ#N3+rXB5_;Mlpq#%+FB{GZ#=nl`Z`2(0nr?ZzGZJDo=PZ%1Un; zv)nDPl@f;vd0y&Uyrw}+3g%{U8$%dp8;Gg4n9~P+c=uO*NwllL*<#ykSyvrV`MJPs z7t0zY`Lwx#Q49;U1t@q9HS6JzIbRT2bc#yp2EvWU(Rof#(o5Sbb4<7+z?*SG0~g!a zpLjM=NAc#1geOhviB`HLF|`9f#%4&yEHJG+fllS|cS`3;EHTNCyT}sNWFR{;27j7k zIx4XrK*F*0?Lt$tm=G4*q%MLF;V!9TQwVOe!l+BDziRXetz@snz$!w$eG~fZtU&Wj zwO63bLbw&130(tRC&sYB#|xGc&7>%>rGZSP;TM?F@TD1zTLGb@eH+Ccm8lJ854a9~ zspVq~=nPa~d}D%|#Y1@WnV98n>ZE2;QHf^$fmqTkR`O;eN~n~J40NcME<(V_qYy-T zktgnlz=m9#bF zVoC?U`;wyq6=y_41hxSqy|jp_sWTHyq@Zb>^iwfQ=?t)39bBX^&Tb8Kg}dT5Cnmp; zrOa(YUWqx>3VTEAQK{E?b0SkMW}9(h2RC=G(q}C(Brht3kv_DJ6X0lG#i9m68K|+u z;@+)6K3d3YKsU@u)Ne2LuE26 z34gDC%D@~WQ@x4vN+m0$l&)i+rjb0}9}`7~MrxV6Y7;U(KEZ6%ak?eEXtXttz`V^- zItu-cuumRrC@(UlhU&=X*9kaetXsXpRTs)EN0o-l{l>y-+0;|W*G`Bs?D;w<2R3*P za8M3(P!4!d4t!9K3_v+@0OiO6)bDvj{hmkE?|DT1o=4R0c|`r5N7QgaR;LUI47jgW zF@b2H;WXnK@OyLkQIN`h7RfG)RLnDv=280*1p9=m#touG^CWr9)#8PKO(aw)XF;r9phC%HYL zSKRG}KJ*c~ZIaA3Nd+0u|C3QPK>Vxn59m*FdqO{doa$=(ut(^-hRN!+D#(C-U-aP5 zr}y;x1NxKPp3sYb>4rYsQ8NQ&7y7Co1NySp2X|Zu@%;n(liZ%r+t+sMGSQFFH+aeJ zN>q>m{o{VM2hNS_^9S@Nxjms@*xU_$#3S^UDKgs>6=Xm+m%MrU?=v}||0Cwt2gZo& z&)a+CliZ%r*WK-gjoU1@Q3?WY&!T4 z%%a_#^+|3|@aG!4!#muy%8K1vE2V-M8Ekn_zwzUvga44hliZ#%DEPwFSv&U8{E_{4 z)v`Nk6@-BQN}Zjy?Z6)$_DOC}@b~@&_{Sq7rU*ynXUaBbsvyI#ct3opV<5B-i_Tb2 zXzMP!bwzVjM$=r`<+&=zfOgH?b;;t4^@P@WtjnlPWjIQHvyhbWMWhN+;Jxr%S3GB| zN4zh^U9EErPSzONx)@dGmtvrK1$0Go#(F|4D3o+Xa|}i&;$>IjRgeKKDZVS3Gu9JY z`Vx!k)^V8OI45o?I)bCa-un7J)xC; z>E5-Zj=`n#d6}SBK?XE4CQ2uoGu9JY#XBBd(Hw)xEq~bqe-&gv!*QQ3XwFzqXyx0x zp*aSRPiD!QW~m?pT3O;`pxNhOd;fLDdP2Ln#?xsVZay6D@X1TEGcTzi1l;XEF6cvPkt5kNi&Kc_o zu8C*6S?BPHX1VN)Tm>QE20tw9~yzk00BwRbl- zhhIF%lvQM@AOxKAy}5QcXRIf<8wEby;2d7Dd7`ZJ1r>yVbH4Dx4(E*Z1b6SN?r;vT zXna$4`ArpsfO8)CdN`(pJZ_kt;Le@%?Pi_BE7r+n+vF+;0q5MjvBNoIJ;B}kp*x(z zD}MHu706W(0?zp$&<^K}^#CWU-ROsVIY{L41-Y+Aq?yyObd7kpij7#Dm76zb!F;*P z&%mnv<2CnWv1M@rH7K+C00+u`Y(pk#^4fg;}p=<$^JPQFeA(dNxu)Ju6)K7+D$n z##?WN|Bf(6<5bREu*k0Pzt`3FLN}@xxSfwqbu(?R`kA&@9ZlP-o~G?pSJU>YuSNB0 zIE(64UyJJ1fELxOz82N1z83ZLeeI>U2>DpYjogrVxt!z9kJCnIH4$1)oxW&Jb|#mm zi^-g&n-vo?G%7thYgTmh(4m={XiaoX)^JTmO!|nJ5t{U@^h|9S9=PMDEdMY62`e7q JBpD`Z{|8Iqx*-4n diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/._SUCCESS.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/._SUCCESS.crc deleted file mode 100644 index 3b7b044936a890cd8d651d349a752d819d71d22c..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 8 PcmYc;N@ieSU}69O2$TUk diff --git a/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/.part-00000-d22ab04e-dacf-4c66-96cc-2f5cdbaa6177-c000.snappy.parquet.crc b/examples/ML+DL-Examples/Spark-DL/criteo_train/sample_data/val_small/.part-00000-d22ab04e-dacf-4c66-96cc-2f5cdbaa6177-c000.snappy.parquet.crc deleted file mode 100644 index 1043f863a0782a63f202d237d18be961a93be109..0000000000000000000000000000000000000000 GIT binary patch literal 0 HcmV?d00001 literal 748 zcmVhv8s_SMgIFi)Kq2iZGxyX z5wa41%Kjd-J7-is>JT|{@ThnUHlS$^)5+>{Tl?y70I~R+DAbg=cTXtD@HBByD>CRX z6`%$4H(n&GXJ{@B`6ny8x>R-n$R@-{(LH&=DB7Wr*172xJ0z9T!Gr9?x*PUFu9G_A z>YwoWKOdNamcWID6ObeiurJ9aB0`$iRcKV6Wam1=7%05@=pIE#s)-$fswh!9_8dEI zsOG}pSx4wJ@|=vvegKPSh%YY@!4FT-+(X$)%h#EftYRsNK4Q)riihK!2*QB?N9UYl z?QnO`xg>~*+K~&O$I@4=P}JkorV>|t9l5s4neQ6f)_`qJ^RO8lQyzm71)}2$9Uxly zgyETuKuyJ!TXtGFXo(Qky-dLp|KjC`G`{i{uc5gIyB{hsYS9jub3^+FO}~4N!8_8k zGP~!|sxmee@`B^v75jVwN_zpLErxC{U7IttIakh?yJzaSqX1Ea<%l1HJ9fa{Sa!Nf zV-cXv81FzzVwWOCfH`R~^yh6R!1jpVJAi)8Qqg`*!OdY!`>PO=F(?Di?QSTmB0f1K z0xmgxHG&#A9;_j_Cf7u*MnoMK5`*`6)<^FE3?Bwv(uPy_>CyOXGGn{t1h8g1uMGcc z2OE}`QC$r7QHu%8RNXkv00?YdXey44ojYRV+6T6W-0!bQemvsNml9!*wBVbUAlQGw zlx@taWCF^}|EQsQ&GWkOG2S}SADHI$vo{6I^=CIxwh3`7$|#9p<{o2YQnO)HWCmb9 z%%qrqnyv2rrZ%G^f5=skQbilA+or)Qu9RnM13PTV3deJ4XDMXZ#Rn7u9hrbMSt0z?gBq2LDkc5CJs6kOtQQrVE1Qiq%Hz;nc0mX?Dh5}A-Z*gm@ zE$&^z61TXmTE$UEYb&^_R_k}LoczCj{rHK%&AsQI{XXyWyzhy#_6k(c3W-7LpUmkPz- z2K=3XzqR-~81X3k2>gp0e@{X}rl5#IT%iG9hE|Ac?TjzCz~9~QH;cI0_?s%COlC6@ zP!hTazLn}0B|$u^VLk_cWX9hCh!>A=%^dFdU##Li)lmOh0laMg@$b+U@4EEu-|G8x z)0ZyDm8z?mQ#`iA3@-t249z~eeD|qK-M-78XDWm+bN$uh$_HF%z2Nsht&R^}T)4ZZ z|GI>NcdkdWKeZ7<{QN+FdNvIczw6j#?R6hTyUKTE@Mb#;dEA-g4u>EE|c6K z=kd@5k9SGIXdPLY@wWt;_VAW>9WRBkrw{*l^@t1nF~0I`>vtaT1;u|!p5zYR-Im|z zze5Bw2XqP9pP+y|`pj8og&f*nJXUh5Rsuihb{)DB;|~7}synQI8L(6SRtr_H-Fx>> z6E_YzA4-O`jxEpD!uDe~m1kKVbdNYy^|+G+R-N2FB{4t-$Fxh=9eF8%_2Lx=<=2!T z*tW1&{%0+mnHCgxeN4)iJWbdkYo!vXgvPZiL-Q;UR?Ph8>D{PHQ2Pb%TJyG`<1 z=18Ewe{s~ssV;DB_&cHB5h?uM|6+dRBm?wYy?dh~KmyymyWI{dmq1{|>LcAQ$iQ`+ z?6-n62^jsv9`t)XT&SNj%bc!;lU{4o>x4?^eWP&x6}<;U@BIE-pSA9Au&$`3_JSMC zYc>4tnq&zmRBik(zz~R>JM7c}_&zGlLcX#oC!cSLk>)k(jca!9twsWahVOjT*`|XhElsVzX)1*QktanT zOJ%U<{le#JkVEfPUmnG=D!9qdzo~yEhp{dGx_{-268!Z_&BzoPOx*KBVcc{n?5cAt z96Er7kXEtzZpl(`_=oqu z%l-e}l^9ZKHG_AcuU~j~`u|+TA6*u_so^$mRDvu!0;HCR=5WiwU}i*RImS^en|~JWT$oK_3COcM(#ukV7C25xgPCBxd#&WX8aPqUYLT4g^gK;-MNfo@N3() z$i;w4q_XUaMJd4&S`Y@w5=5h$<JSN0o0Q@g>&wCz%M ziDCfpPhUbS-Drw>I7NcYS#*_2QWAHRH%Qqzf^dVM zL@pQ1Pp-M^Nn5K^HpOI7I&>}g4C=wyH=UX zy0LWkID-VK=XFExHK%iSLfkgGD8I_&Z{b>kvH`z`<}(lGFK1@u_)>Hd-|Rv7n&}kWaABJ4!|nuj>$4A+~T^I63wY?B4OyQZe@AF5)+4twMm#f z25r`-OSjp1$Y^KWI0cUGz5U!!cbj2q1uu;%d%gLzCXW{e^D>ku8`4*LNH`RQYFK(O z)rmQcXtgy?DZkc|U$uz3MFr)ELrdCA+$NXt3~2?zHrdEn^s|(cZMFFc5!2FYk}xQT zGkj#7zD~ngZUe59 zw(hnsp8UK^pn&mPh6?6tq}*vbZ~uMaw_h%5 zoX~)5nUhkUagL5q!|2qvQ(HDsz=19!-e-=JL)5P~e{`EChaoo)48A&54!A$Qes$^) z9cW6{G(r^xl(e5MdbB{}gfzrNPHS5IVR%moTLY!SU^|jl#s35oJ!vQCz z=-}z0U4elKY6v{4Yw|Ed22=a&~c0mI^UAAa|(76R%Pet&3@hZ739%xgDo_m67m+UarTrH?Y0yvK8K;?FAR z9mt@cdaInKmOw&XRqqLOH!VyZzbH7Px5jDm$0iBlhpq5%nlwR6%eyD1jBteQH~zGb z$_WkMcUhiz|CJ|POi8ML{ga0iBK1g`5mCsI3dBHqAjxqr0Sf|ZoxjG z|Bv@&P6)_Zx#6!UyTS=k3AF4nQ8HtBl^m}BZfAabq=r8Rl^sesr3BHJ)?;4W(>S5j z`A3^SLo+38+;Up6=!OiuqN_ZYtXDfB2Z1gR*R*YOXNk-S&1yd$M!U1rVA{*9uIi4V zl_#B0dBp?nY#5nV_?;T4qAPzt&&KAm5rQ8WI6b-VI3?Vv-hcb%L?v_`{%GI)l}cDL zyl%{VV~g2sgH~nB2GLX1DB;vs8b*H;g=WP z4NeHXdS_YK+ui?zdh1Kt^h*xZI$a0?5edZIXj;qK_Nt)Wq_n#eTCwoLqu=m%g)$(n zjKAvgdEPr6yqMzA?uQ-t=faD7yIfJg-{0!n4bW&{M6To7>kKdOJTmcM{y7hrf9`=> ztwRgbLiUYwKf%KLm|vLeSQ)I?wsD8aQ|W}zlU{0DH+8Tu^v1qzW$jpScl6%MQRDH8 zdo66YTnGIxxsG1-Kx0WUM-&Lc84paQrUpc6Q4VT1jORi{P##+;+gk%hv!;&<=yjM6~ z2I9)(=2hHX;ZVS>zO`qnpXxvu71HMSP>s{22n)D=i91^XkzFT^=6+Jc-jPb*Z$&!D zXu5RC;=K|W+N0@?zr_lu|2gL1@@ZP|?yzKK!BjmE7g2q<>V5e!Vh=Q6EXkHzFDRX^ zPoEaPf!cPSPM1l*rvB1tks8)#?6_?)DZwh3_p@Z51`LlB%Qp8@z$+NJHTAU-=6Cpe zMA#G+cvKjht2U^h+FB}lSdLwS>lqy_=`36wclXHYR3*fRa#b1>rt!0r#a!n6Ii?{4Pz==!$BfPx-aqZpv7gG-~^gJ(V)J zo4@Ud=LS!By7$eXvOdK6 z=gw)*!rDtd(fqkec-yxd>ie74=>m@&`y|Zas)Sc7UH+c`QU&D^$M;^msD-~jeisuw z%+m?^=UiB!NeWQFxhw6z92ur@x|ol{3$p%5(ZDafu-!J6I6!Y!`oggA(rlwmqZo zS_MpbWsU9KQRj3m>zY)1@6qnnQLTe*dfvjTeY8&3ckO0v(%DlQ*gGoy#Fq;! z3~u)J%~&tB)5UD{B~^2>1ouZHRk8katDj!S>YXlaTdi<&eTf2E>Q76s!BfJyrr(sZ zpOo^bJgxwC*rU!@kLiGWZR5?(vo-L3i(uAcs|>8V>~?|}7Gi(i!Vll2g_!MglU&@? zu*mh-Rfaw~xV-DqYx8&o?0nI0dgoURZOL{)4T^Eg$(inItT6p4)214GJ-J3sH0n_fyeoB z+$T>BZFlw>)NO_muE&)3e_&KYPIccwA7kaPDO$ESRS8SfYUMBVYEKBKB}n zH8Awx&Basj`WnYSveu71G56A zulc4<0bwt@HOa}v>-N>YV8>o9{MEYk_o~qv_{(i%m$I%3=r|^QW%7PZ?HtLvuV|r$ z!ImY8jazjPbY;O5pQCaoMYH+w?4e;JFeQ-v(_oi3YA8*PZFjJ%77jT?ksE$fI;o+i zpEA3An1JzDa0<2ip&l0gnH)9#x(aS5d5&0h67M&OO8vZB8jyK5w{(>1p|pB`l>K)d z=tEZ~XLQwp;OBXJ_WhxO@;SQx2}wFwwQ&8I^2rKVcQ|CglJDhC>Z-HSXV=F{HI#Yh z`5}|SNg2Jp|8TNu5DT_~)%9s`WqlER=%X52l(?CW$-{A*_t6)gXaX4PCg2!W;cKDp{0bTmO8Q4RI*M)=I z$-b3s+>bqA085}<+~k9#I?U#Q{4q70*W-;M85;;ZK)oq4HL@)nUJA;Mn}4?KAc$ zVdjO75tEfV82V%FtH1Xv8~q14wEZ~#vOl-5V%c1>10 zsisGFd!=Rb)qpO3Ji>Z=|9&bnsO|dSv~w@({2-2Xc~H~XYl zqy3RNsnpzc-_9Jk&kIK1@M+;vtb(&^pKo8Cp#$Com)7H}R8H!PEgAnb;e-kX&$_XD z=K~f>*N^Kn&>z3AkqZ1Ptt6}aCB>^^d7)DEYEz)!dCbnAE;QfyY)gTyPlp^$YQR>y8d( zuX;lCu?eczlm>Qud$d4g)L?2a|Ni?dnUm5@%(~Tgm=*5>jnraU#a7OZek!Oc+kDG0 z6pwqK8;^be(m?J^+Q^Zz&|=lzmxDg3;6e1PcfWtpIw@Zt;l-pDzo=kZk^FizrG(Wz zKip6LqJ%f&Lq#?#3n%@OoN+cg1Y2luZzAt*GhTT!O zpQKZ2IP~6d2IK*28^M z_@kpeF@9EWxGE0N!=&4rPfKs9z=s_*U{kyXDq`hB5;x&>y~hyU=dc>`r&msWzg7+_ zns2#s^lvSQHoqSnQ6&Y@tW#t3n^}n1dVBcW-}LZydd#A3nFcs_@W9S=n+Mb%>ebu3 zvl8mw4WCuJQ3a;;|GkPCgqNZ>-|!l#Qc)J74Gu)hlN}Ue zE^%r^}3c^;Trt7j^cE9;Rti@{0W6iLMtt_w5vLemPPyRp*^|>*VFR&sQLoZ$b3rdo0(SDmUEoTK=mJU7J z)N5R*!#%=KM~QcA*>twquKf?s3Vv8g#RPOXo#P1De=U7>^Fwv@+5E$ghi11pW+{tl z>BUI%S|+@xKPPa|x#fa#F_&lXlJt%>coij|S5+I9%x`sWTzPEkimAKQb-lf|r@-lEABSVqwUj+Ip(>>+=-d>Fuq}X9O+o=JxFT@kK?? zE=}HhpAwiqdC))!E6)kNP@u%BqvLA?De6f@T_^)Rht`?5)P&~0A4c=CZ58-~Aaiz@ z`|z+bfg~{18vZ=$T9v>fKB2g)YMou`m65vTvS3AK>16?%@%Xa9D_b5BWeRL9lQns^ zv8$h1-)nJnlbLpz$-3p5v}?1%Y)7|%nMjP9A9*8-4LozLmn19Vd^qYp=jq)GI-ka>s5o9x-wO3uNPMo7Us<_DtVUCz)$wdl&nm)i6d4H=p-L;OUGpHxsc*v zv?mRnd-;GmVZL#gqodcT%eMwB5Is-!&%C!G9@SWa=qZ-D4Wx{rA-76D^_DwsLXuB&o zedd)l-MsN}e)|1@>Qmn5+X$9T^a>fdJiVrC^{EL{qT3CUTuY1BclNrrsW7AYp!`9T zZ;!A3S@!d^KdrKFM(68eLNX66XkEMYwRLK8VLQ)hzf{%cPHS`iZP?_e8&%fn5Ah&R zZ?*DOna{o5)$2PiinI5h@khqBni;X-w3kP>qEhY*b7hnJBfQQ>4w?Dx=Rb9`J{B47 zMShqmacS%2x9NV&U-dWd3p9Usk{70D*46*)gFaWsxOQ=DR@y1i>BtTjgWJ~X>GD?; zkLMPuwem$vFJv=+EH`+GS{zpAdX0KpmOdl1rgjuv62CateJ_=gwe&a%^S^So4RSV5v6mOCNcyT~b5MhN9YH8e zLU|GDmZ;4{jV6>NQL~Bq+^DX)s>6j&`i&^t!lb%he5cb!^lYLt6aAU!okSleBoxul zi7rmaMi-u6-KzR7gu^3pI^k4^Y)m*=B6kznlW;qP;~+9Q;r@ucPUK(0nGsHo$niw} zBr-SA1h8#f=&D%h`Y+o^9{#s&{O?sfQq}x712~Pgk)H(yR1UONsuoBLc{a5pjRu)S zgxJ~f=$r|abJ*C1VMM5ui9x}O(&%!lB?r-B8bNAQ4wvz;A$cguM@*!TWljoX=M6+{ z(JfADs4cjgn+^l2fI9DR3%@svJKnQOqX-;1uXHlf`RVz*Jbza%+(?oOnvmnyT(fS7uYn)*5#k<|Fc;7sWX8z?+Sbuy^7a zH@kji@7S2h0ay3MWsh1==@Xk+ik8}vspJrc(JwqMHGEj+Ee^veLH4wS>c{QvrDz3W zmd6RREmY|25Gdt=J%uV|?2@65HYgNH1bmc(Bn~RU9^Ws7g zG+JS`;Bm-8qXJ^0(W$h7JyF07PTZ*!R)EGiaJ^B;%~9$|W3u3Y6x*%YfX;E~b7>43 z#*5*wj?ff)ylZY65>v@5pTyat*o=#L{U291G7_#PThgY7V-s^ z>YUP8dpPalP1ys57s90|BDN2n`;k;vlzS)4Szb7e=-n!fg>w>D}D#RfFD0og6p`V60qS8nJMh1Pht!dR)j0v~Km>?2ULN;5niIW%}Vy#Fl3yGm2 zn=ugxi4pj>6%#rIx_|nc?-V{sj0lN=A`T%jF2pzxf`r6G5y8-Q<8^t8QRWm1iP0dA z8XrQq^MmO=Y766+2_Zh!9DHSRxb>2c1|DVpECmOk!$U_6hQS^+w|) z+6gg11Sb*$MPjFjKt}|Xb3MY}Y*}D%3XLSDDqS=F=I>c5AOt%hI0^AcVxtJr{d{@l zv>vy0P9d703qmj^%Vu_MGT7)8wEP!ETns%YcM=qYkRmZpgs32xq5quB$Zf8AC!s|I znT58DZwK_2I|bOC8MnKvS)>6XY!ab{#3B)aki<%@j%+nq-B$xK`|7*JxAOo(Xg?pP z44&{r>l6eDaZUth61zoWmq_f^k4I%p-BP7fu>WS{t-?;(TyFoV!RrNuu6zqBK#3y^3%El z;V-d3M`E-HLA7@DcWtMw@OH-f5kiFsZU103922&v)7TRawa`)g<=4y-97ESgApJf^ z`0eZh6|A#gpYHy>2av!C601iDJ0eh!m^u;=L1OEO07U`?{vI%QWYbbDyjb&S*pdAj zr_fD=SVD9vI~dZ%GgZ*`Re!&j`~MSQiQq#7OSnI4fHXqwBqIBc*zx`&R}Fus|LG&F zQb63^)*UYG(>aAi7l)xs%Nc5?Ku!n~B3u#T<)8gq1LJ$GI%H65;h-rH;yZYPQJwPn z!q5K`wn=Oo2~;4&DflYB!l*E(D~o1*r45E-ZY~cK_`=i zC=QqA@db=fD0LkE)f{3A~Z}D&UDo?5lmzhen&K8iB>UP6y2g@7^WE$#poJd zqEp4<=NP6tuLmPydNNF0ybAD(Rifx#OmBuU1U6$5#0-NH+cAul>C=W``X=>b`VU|f zGDgM>9KaY`<4-k%^n)1&7t9R7Z%SrNDMOiI40fZL)P~YcUJP}m4rpdLGlEf#9ObQN zILv50Gp5~G6VPG9#xdi+={bR6R7@hi+iGJteE+m`rsu>-dVL0N>txFm?bK<^bgFB} z5d91$aSHCl%t3m_Hj|;+T4rT2iPIUnbuh!|dr&@xG$x&~GhMQQa;^K!h)oRSFgDyp zt#Z@ynAziJ!yLUnzaTSMD`xbCvfO4m#uUcPou@Z3L(){L`B@Bah?!ZywDV@-m^5Z# zCyHSf4VxvxHG`t47!Fgs*lo$ED8@UBX|YtxV>r{70W42phOAh*O3!pi1df(Ls~N^M zZO!zx%({m5_vmk2ABM}?An(th5~f)bP%#{lg6XocS*Ioqy@m&L$|j~I0?y{n3f-2i zEhuIvBksU>E@JR#4%^m)q1R5^>cd0{@fh{AGKwxnJ#Tteu=jM_}ax+`Sv?p zLm4g#6ilaGxGGwIYkV9Y=QP~2{tDji@4Mqk_np6*hfz zLo1j)dl_aQuFv%8CT6;eo^jDK%zncG29M^!hI;P61u%!0t;~1@Vh%Gxx#CDdqHGxB zg2!FapJ9&T5zJwZ4H7lc9>??I1jGD@pBlzA%zFzi>!b^=jiZby?+^xxqS{KEyF0qQ^UxVlCcyC^E2udWVjabG1mxCba znV?c4Ul0`B@PdXff+7g2Bv789Jc14gN+#%+ph;rw|0!4K46`68o=^+~T@th#?G|>p zS233LVs*amj{j+g7@9xT*+sP6 z86HI_5E7Y9P%nv?Cn%pI%ndH|(>f#F3F;;2k)T?F@<`YSahZrWa`@Cw#vmJ(6&u4` zNJKtyp$J<3Lr}S7Lj;yB8Y8?3$|BaAFh2xU6EBKTGbEB;lAo4(f0Nu9MnbG12@fRH z%|GL>a)!6uZ2#hH?M*C)G=@)+FhU}G67);FB;utJ^h8iQ@g|6OL%afl(g^w|5%L5j z{(mFNNu~a6mH&Gc&+p5Ey5WsR83&ZxlR+&P(G^s2lpiYOnTq1X>IG14WI|-ZN=~aN zv#c}D!9NI1)3bG;#`MPYsE zW0LNb$b>wjHOee@4d+;rd}O&de6yn@d_~`(MFz2~p=t)Rq_8r%DC)SRw9-%7~Ky|1xMKpFk%hE1JH{-daA6iRzkv2GMiSg<4|Ae$t!ZO%RHbYqZMuyA%3Ir_;eGof`~q*a zSJRQEvWZKlONM+cWk;pIRsD%yP>KJd@#CCjYJ-ICZQ5uHu^$i5sWZrBd5|NCmB?~W zp+NlFEL?VWl(^v)52E~Jd6m9nx% zOkNmXUNiM;tF30SSiv)*e(jl}@L%e==J|PojkuyBVfZEr%$|9sGONXBa6#USg8c?{ zVV-wcT%K$p9uJ#Dv>?%RnOUXH{@Mpx1D+1}wLer=6oFaEJsr9naO0s>aolQVZg_ci zRKO~whmndlBT;CfEn31CGG8Akq>CH+wXkmvM449?;=*hpvIP<4^=k9nLTi34?k#4! zsdy^xyUN~k@Lz=v@4!+?i4fljW?9QnT#AI*Yn4mBMKWP%d0@1erJHU<-S9v}J}btR zSR3wboM`43itwb6$nqk0w(4$fRv134w!lY%2atMTMuny}RJS5uVZN!jsHsfUqu4$w z0gphNVuM+fM>k1z%I!dtpivIj~ZKEch3@R88SOEdewYz=)BA z3Q6VL&>SgpwXu$5G^ZH3VVX4=@dH_8z zAG-@@FgW#sw@5-Gv3;0pvKqgg54hxb2_{}yF2$!PWyA@TY&<;u*Ny~9x;(F0MONgCfWq^Q>kR9KV#HYd=xMEhr69(}m zw2LiDfvaR=QL<5r?7Zu-4n$k=aPh^CId~*&xN97gkCDNYeA8z5$=P_c+hP)Tk3^7+ zPQ_Eb5+Dr;;_!&$<%r5saM$C|4Wy^EHWZnHduA$)Yn{wf;d+*Lzfq zq&g)Cl^W}4N1SmJwG>HsGw7Nmp1{~JmO%oG-q4j7gh!Vz>3|=?^9;8%Ccpzfk6Xi+ z;J!A_5aZDV-VF)huE(_zn{05(IFMRN*HDx>0QVhEY>mM6MQnqHM=ADFu?ls=){$%{ zI|tb*$euuU608jw$nNoyXE5`f*^5HIRG~ATmTW9!3&E@J9Z&Is{@3awDEZ&3@4r`Z zJOAP&HLgB9j9dyC5dOhI94t@>@LEu#hTsn{7!ajVbMZ8g;8a`>3%-PBD&EGCkmge& zEMgguP{|9$tJN0?Tj3t)jeo`Mwpb9aIRc?O&mS)e51QxA6Eha%iPaBEZotLzIFtxa z9x4Zyfgf`ZmLqAydh!0cN(^?MlErT`aFBtAQ-cxpqi`LbZU#SG*E^^M)raaVF*Ni# z<%jnSbFdIUiqnGWxQ2Z|K)YHgCLHGthvLgJ#O3000J+dqJ6w_r)sGs5-zrDEmDF)0 zuNlZsx{yI7nH_{s|6J)cZ~twTGvc>#dv^^^e%FOeiX-Rx9qijr zNwOYX4XOM_m*7hmGLeWm5EeKnXBZj@%Obd$;CF)88#i^=;5TRZQYU9hI7fn}$rexY zZi$yiGzP+juRZj~JiQPHDK#d2kjd#fb=&N;{+>>+g4jR8y%Fw~SkWP4rGc`=dZ!ma zG!kOU=5OdL98LfR~d$}{2ig4M4`zPLJ*7Vi) z$Gu~LB*_r(jCgGaR&TQ|bjLxZ!zX#B(pqPd6!9Vnw@f%-;w=)+mY7iDosDVtjhj7D z=?o$zLKiX7M3WNybSd=?N9)X+C5V6|&k(PQXci=&mw1P9-um9^>7LHuYLeGYv;@bM z@Kq~g4RE1$>x1|>y))R7;E@pni`#b|rFSNG5pI|yRS+%XuWx^?$=3f)g)2%&X6hm6Mt|#*!(MQI^o-2l zsahc3GD-R&+6>X4?CyW&4Q``y=IIj+j%X2tlPAH(1Yg#?`?JLI^nb|~Zd04}xwk~+ z4BF={SN-6A#Q+g&g!S9~)zEk3mV@7&(?QF}Yez>YJi$I5{&xF55gQ6!)J~01=At_ODedGH>sT(R9kvzx1Tijm&#BwQ_Nd4oK4G(8Hze%kQY2LHR^0AVL2m*^UIC&U(BvT50}Y&^ysYh^9d_ zl(o_>{L3Fy5L}ftWBpN;GZ}>B@ykz7>ocpz|B@_7usC6fNH8b~Y#~Vrgxw**s3h2% zus;vzxhpR0#mPHgZ(ldFDRbR?orZ z&j?mIHN3E97Y6NF9kR-*d?vefRkw^|i10$>((Q=8#KL6;; z+k@v}Eovq^V(SuovOont(&dOAP9((mTEbZ9`Pb@c{pxhixwPuj&dCB9V}b;X9WrcICJU-I1F}B6StXaALDi;=z%N zL?R)UTR3WsP$<^wSiPqZc^QmCHxtKOB{KWyechEJ5o&_`nl|J5O9F%vPV)wJMTlC7 zgsnL!h|`9Hq(XsEp-4EvmWI+N;#vemqs~IT`y}i+i865GT&0Ms@Zq9v!qmyQ=D0B76k*Td zC@@|$RjNXw)D>_O8!noWDHH|@b;upHRv;l~CVnet7MBx&0!3LkHDBn?;biCJ z3Wa&IeK~!QcVxsIZoX^tfG{LQbGC0>45iLPf=kL72qB9-*gb;u0hb9wQ7`DohP(y{!FmcM(VCDr`Ga$Q9yN z3c0}QSMXLMq0mi;I~lDKDpm`N@raCA!$DIx&4p|I)^S^{-%#Sal(TUYVgiMmw=~}> z+=kG0QQIBegyLCW58}~Dg-ALAm!d%JcMe3HZxQD^2A98U_jJ+M@%RJ3RB zzWqt)0OOh-evm<~uAHS`>v2eU7?Cn^z9RukJZ|lPE}d3eP#TjU!5} zKJ6KErlAlap7j_di`;Nex#Drf>qN-e>^7Q%CZ2__bNC#m^gKtnLl}uJT=cvotl@4z zoIDhbKf}G`9dY?eLyhs5M8sabhUn{JH{p$&xcBA@Zwb9O{WKrlMycLPC2kLkJcUBb z*UI0)4@eJ6?v6pi08c!qOSwW8*B&vc=;uuc-IH<{t|z+RO(?>SO@yMB!$G1467*0g zW%_c4JbH|F(eAb4rp-0K$c2deWOnnWxCa=#*xm3f7LM^nG3co-gNyK=&$>yG^m!o5 z#lv`AB;lYW(XX6%#PR;^g*%=m?VBr7BYzhr#o$RV6vUuE+!QbCkejd`A0~po8r%lH zViP}Bk=o!C7IEv&5U+tiP$Ena_mDtl0>uerBdDK1V*=R;^d=CPKz0Jfi0L3+34zYU z;~g?Bz^nNV6pEg-l6+mHVSgpx|B88TK4_T#@-@%Z9^ z&s#>{OsGf zJ6ES&L+HGWLbi<4f^eOLa#vICD6cp;na|I>ggw;~^i%8k@r#Qecu1~I5+~58_oSr= z;*o9XjW{7O;-OZ-6mWsHw}f=#HeRIuP{}#Ys1gQ1J@f*nkw|S)b+vO)8Bc6~I6nNE&APNhqIA3jh9e#dTgu4|IzS=uSw3>~ zmWWXZDjMEHnJJAsS`i)22>nEm`nzPhre5wSK?uZXqMypz^;$Aq4?KLimoKe#{XMAt zQflSg_Y6~q1|OzyHEwRE0=iC(+PoI{*uO{5CsAR2nxO;KWn>B0xCtc^>5b-YIg2-9 z#~*d?%R}5eSFR;~g$ud_M}W3n&JDa&?{~G0l(i(5$FwhdJ8&?~la`>niJk0R91uEx zzIfH}2<57pw;?}Y@7k{{&JzK*7lkCkRklIWR{Jlv9nT$(99+(#>G9n>x}vlZ_n5e{ zQ`F^TSJ$Gz@UD`6X&LgV#h{*qipHn-VhS;mk(@w(nr{{ry4%FtqIvQ3z=$o$sUD~b zrD|+c1*WttV%;mw3kd}d#Z7)}Ib)HQN>N?Ns`qh`L8%Ue93#3`T$jjE$Yoo+gBR|I z8;q<)7iv>4py>i6Nsx26wsDtvVkpW8Yr{YXanv$TrfxX!snLDL%VC@kWXmns3Q_r6 z$930m9s7p=G-=rYWt9n&W^KAgyqhYQbb7XLl}AZ0bP!$Vit!uAEO9-f7$mI=cjt;P zJ~C{;``PPnc6E^cG+FOrj1_kXzj}4>?b>hb>Eqoc3sk&;KqYI6MyQH7(meLQV4Pt3 zPHr!^VQNSn%?6Uai0oBlZ^O&^JYR8x|1WNg z-288D?7vrW6}EBTY$c&K+$_MPU;{U7;NmH1H(2dv#!gZAHk_-%r%&5c;*gj@;INM_ zLp~HTfSn2}<%QbC0}QCl;sY2(DY0S0_Z#s4(Re5@Pll4q@pTJk(hR5V_+80i_y&uC z!fQfepzLBCjg9|Ar5KCS(SYx#F^`3okHS?!IfgJ?2=e3d1ELz@!I70?u;d|1oQxKu z0$ejg!~IZ_j7r5>jM#t;tKClDMrMp-@yOsIgB&x1moqMfV=lnVD+gI|RqO`DNfC1B zY$?*_@Xq8Iq#Oey!PkwH9ociba`8+y;cA(|jPE?(K$Y6z3_hlb6K=QTat#!2LlFfW z2a5K6qy0Pj)U+)LbwMRJN^_w9wu8cS!c#wKm{?l za4U!Qz+IJVr=b*KtBmhs47d$AD7%5&#@wHa!GLFrou~MOm72JQ`QqS&kO@L2gHTc= zY~=Lm@#I6w|`;up`+sJpG zy+CX`3E?ERnb>w>&WJ51ww};O#C#GnOUxQEmqa`#wx5_&V&e%mAZC=9%m1$#B)<5+ z*Uf*g;x7Du&7e38$6BR`tK;Q@R^rG&17(vV3tL@eu1I66HzEiAzZI58#1%FP*Jc)^ zv(*+9Wf4~(OSO%?5Gc2|7UyEGz{ZwQ0S=283n^uRbaijqfn2#YxL7gQCJvKO_~AYV;Y+~i46;6 zBQ0!2S^%;IRbdgRHCquV4x1>hwy?Mk6*h5oAgT^@y%xw;2eJ*72YGcM?MO$}Sfh^P zg{7fdutC{QA<^1v(@-tS`hB5u!*b##a_W3h^uWA zpT}>ppo%nc7Jk0sYoWO4iajj1HGRg?phMx(t8p_dL3kJ`Io;5_ zAYsG*>}g6|jhn}j7|ZKvG`DR+SsDtn zG!%8ow#3MncJ#Fe2P zHiJXLQn>zU_(gJVD?Di$p2Zd8;<3cDFuobS?OdQZmzE1Sto>$eWSRx{wjfeH+uPwf?(HqvjZ#6G_gcoELKAc`N&j^D9pY1l^FoI{{`)sSh z!ZqK{lvO`RfAoy^RoiHZP&M$^Zi$gZ%p+Fo64x z+ow_@d_Wj8uDZUtH@sfk(`QeO0o=|TbH58VI+NC)yf|`O-rEezW#@T6jW$7gT9cTg zlT46#`uWu4Wu7oHY~Y5nHhO6F?s83m)Cfb$>>81W8b+QBqtlOgf^}`P?sK~tVa5XM zLfP*|C_E6N8nYW8LUUeWOrZ?USbp_EkNtFs2?Wg!&R6bNI}c~+wd3c0g1+8BVv;*B z(Mtk<^K$9~B-Wb5fRDWxAWSc2AxrkCU`ssy5|MIVWD!-6oKna0}wvFMkC+;*I6T+?H7Sw zW|$zf)@+>{<>NerV&>Bx)M9H>5J!F2>D5**=iv|p3~_&Ic`0|cH?+9a{L3s4AE&*V zYw%f|_u1goC$fia-twxW9yn}^=1a&br*_;pYuqQ+dsM zRd~YZagU$Pyxs(!9zU{SSRxC5MIP;?_{IRP<9jOVq`q)kJdxQv(*S#(w7>Hn^TvmM z9FZ%Pn_xojj=)(;6Xd0~to}Gh<2+1{7^3pAC(l=OGC7sa1&*R&EmMtfGWYqrg|Q}R z7TBue%C_FneA?PKBX;8YHy)N_((IX`ecA*{KU`QbX0Qo9q(zSkKfnUvxtI23XYTpK z3#PfQ{^3Qj0Wy4Vw;OxG1RK~*o96sshE>O;n==L(;Z#!1iR=yDaBR;I-@toj=iz9B zf_!T{@B09AEB}vHn715t*H3nEh!KRh-l#TKnw;nU5<}YY^2v$eBec%L8J6wNPpUYh zgrb!UVh9T=kI144@k0KcutX8wd|i4iB08ZR^L$ zBAhEA9#y}4kRH1B$vQOanh^+}JM2%TI?-kV{ax3cs?BD&bglXM%h$Y}htHVa{_w}R z8gDrMtxQ}M=L3JWZMkz+XcOllUAxEb&mWfH1v3Ks-eouY!GHyq>Nu~k-ZkNhwTZ70 zvfC8CZPQE#Q)7Sgbq_Vc%+G6b{2qHjD*O9xO9|$4m%jc{KZ*skB!BKIlNRv)^!1D6 z2K;^?`{)^eF9|Lqx{fJr@AksrJd`k5I(ycSyNnRASGMuRJCpNJm~Xc(OH1i$f_I*yc9)m? z13C1pC3SxAqd>gQuPrV5X@eg6|Cktm_oNZd$gg?~xrysJ`PIW~%e`RU;^MHJqXuXx znDJBAC@-KQMY6#YOz@@mw8Ra)y`6{d-QK?P`Yet&WZeiXd@#WPyQW-Ro!s6VW^Gu% zUi70EwEgZ*uJ)c0O8$)Ab*{TNeCMbx8u{J?zp_h0f4uAIJbZ)T!V8+Y_j|aV-I@RnCdp3<- zZ-j*GFPE={YC#jFO1ZcY*MCXRoP=N>*gX1W|B+ig8xQL+0m)&BbFCUM^qdKL9&LUi zOkf20K+Ti^AMl|O3-^^w&(OlU#cN9P3bf!q;L^i&!%dCyvjLtB^!T{;pdR|P-rIEg zFfGJST3&MPAPb)!eRF|tG{K9MZ6%d$@H%i@5XA5F0{IUS-+h_s3(5NrB%VLz0}oh7 z|E&EcX!G-wd+#@x!1!hB$?;-u*t@~E=Ff>f@Iu*d59c!r{#=*8Ms77i?#JRaJ8^rB zvRR(oMJ&|AKB1`I1XrTvAFl-&;aAVkU2J2t&O<##x8rw2_Qg8ph8N>$ixHmpb6W}( zEd1W_eO#;WO>kogcW+HE9juvgFSuEV83r%abrJvW2|L1uDi%bt5Wn}g%;W9`IBhvL zY5oN*TsYm?TN|neL(H9iJKTKXhiTknBYNR^*BI5?yUpwmPp;wleQ@1;{X`Sk`c++b z`060<%iUglp&FRz?^nN6>f!dW)i-C{*2B-^5B>B_UlWuM@@{?`=al$6o_(`VZ*J7# zyx{%dABNXN>EP4y`c8Q^)|p#I4ke_U9Tu%_Z*-pbOmb#2ZtvEJY({8N6B#;po+l*m zZYM2C^a1(p|3le($3>L{?ZSQL%nU;w@{lJHMI3?%E@~46K>-0HAcA04FzXtIpn?Gr z1DF9(F=NiV1Lh3oEGjB%#JK9Z?)MzrVefnI`_G5Jvb(FRtE=^5~y%hO>B1-NIcm`ZQ+Qz%LDMbU@da$@}z_RME6-!l^Hg)TjG~ld2{K z-FEs#g<9rJ73MwGuEBWy({c2SxyP-kPUfL=wf{W_e|%ft2-*`UkColVFuaL`Xvc5i%gWX{)sK$(oRnErsa(9)(1|y*g-=dVIEfh zR&+nR3eV%e{;oqizpAm8$*AA7r_M%t_OxW-hvj<)DCn9=em~Y=-Q!F2B9oKlR2ZX7 z%oyNA?`{29J}=IZKH1#shY06WNlKHb)B;Wn$0St_JT9Xsm5 z+21qo?vzpO{ol-##0fDQW%RlHw;Sa>?WnGe^`KlgJ8CT%wZUqtBNfeDWP5Iq6`eGf zmnJ%BO*c0FaeQ@#Jw4N-^M!0GqgPc+N{6ksrStMru1^@_*yf~AYafv9+bM55o)eRV zBP(2X$mrmn!HLEJa4MJd@WnNul*;d~e^T?wuFZ+ds5M^hrPXrUaIQ?bFT;@zoR-0)8yF<6Z>Ds@3&E=Dut8RMR(A@skWl#As z`e}>Crv8MI9?#SH@LVFNW~bCe%l?wnu6HtD3~sigqvw0{2zaif@64t?p5mo!b9$(s zQTm_-`=DU7dd!bM;LL8|z|uRRO8Up*GfPbiu&;l7XW7M6Mx!2tZQEbuO5+RscU~SU zrSp65m(`j;Z~ii7(b*bXdMV+k=YeN(s(s&kwf^hcUrKH0ox79rO@4Q#kByE0sF`3# zH(7t{oCN)6`?8bk9<|7+p;ukZtaJACwySWR&0I$+3Ev*IW2qfIt6BQHZIO(=mA!5> zcf)?-nX$MaNJ?dA-_7-RgEK(UlUKb)LC@Jdn=JgxuFYBI0QSsa=~gM#I<3_>U7h-H zi5>O(=f(b}g*LSD%uAEeR&et6ub=eFvR^*0-sIHgym-);74DKTwsiW&htD^ZV%_}L zS?_MYZzb<$JGMDbTD>r0rA@Aq4)|2{vK_^9aPegDymUD&F}=sH^l+qG66R&SJScCo zJbm%u&(kxoj%uB_YMpdx-@)AC1pW2 z5B+(l{Rw};Vj0!wN(33u%k~~y^kzf2oPOvYeLV>Ma{l@Lh~I-1^!1qMnWhXr4h!{GO72t zLpY~Y59r$Qih?dZ)opuUVn-Lxo$*(}BUzi1J6BkQe4DRqb1o?(pFgX1NZags9?edv zxbs#{wf0rH-@d&53jI&(WYfYv**%_TOGo^eQ!xt9i@nufSD)G1(=5UBnJY#>Z~oVB zzP*J-)w>!6?Y2s|GZOPe`_1jyALC6bp$BX2CZbw4q)o?jO!$-U)?R`>bmaTI?lY}v z!vYhT6V@qt?@bkxaDIE%@k4t3XBnMj%|8`aA*CS?-JaGd)~3lDOQ==-hs~hWOU!y56Q1q+0mj6&-GWEInXa29bHQXxX|3&rN_N& z-RTdN!qwGJNkv8`fgk1ebX;!O%!h}uU;O*K8M5b_T+f_ype>D^1}uUe-E{ut$A)iM zpDQ1pNbBNAOFca{J&mxZf$pr$zybDj^ZD#M`Hl*DA#DEf5!ffP4}b1CE z_fkqPyT{+vJ7z=k|7_@{>yQ1fBwg}5oO%sjJkd`v#-6HP`b(St#5bhOb5$Nx;(I!(>n+E?ESvQo{oBiB_UZ!lf$;RW1uGqj$2+#=>mPR z{XefFMHshy-dYvTNp}ZY>Xcl8U58O}==u)O7X_N$r>9xdZ7clqUw45%{;%^$tuy1{ z((B$gw#(_8*`+Jha@f;#T9X*_$+7JsQESKY@W`cw2e7}|nZzlVW!Ta8OPUt%wvf`G zPnO3PJ1gkD{m-1-B#!j5ossQ5oCCGaY5y+D-4L=_(e};k&VT~hw+i_{ajC$F>PKRx1;xPW#OT(OK z&n>pA>-XByFU`?^huw6dD_w`3E>+8@-ES+J<_xf<(M}(j=skFT|NT9U*~PyZOn9rH zQ7;A$8+=?!^G@$}?Do{X%~`CCxo^$b1q#~IF8)xKMoLv`pZ$~LoM=Rk1$TD$H>aze z$9%Xn- z1Yv0~kay(D{ep}nvpr9KX%WeCYE9j~i)6K;Pov2vwWS;Rr8(Q&q-LHoo?Ax5f zyJbGMc^~qhJ>%PeCWCY5Fn@NtHV#jh(W1Di4pGnn z0!zt8>|@&Z)-i5#2V}g)KILE9KlGdvWn1>mtq60cJEP}4)xrH#M6`Y7vJQ^4_Z8u; z866!c-Cl4jZio{d5)vO;QG@Z3T{^P;w2WqaHog;GBcncfhZiQ}e&Ordb)f_M+0$jy za*AFH>}bc`j&*ybPPpeVEt0>6^Xiko%ymB_rKO2YTjDOmIp-;lG&!Dw8)tVWwL~l0 zd>UAH|I0?%*@j+Ox_k9=4V>vFF}V(Q(8Fq*gA6v=P=h!1{q%9(tC(Bl!C-$n@9(&3 z7m?C^ey@+|=*ejP^WO$k<04e+Yvka_Yl+UY+tKW0J1bwt+fv~XE7L+hDgER0(ybHi z;LP~sjy`wl9O$`c0q=6s;B2#tWlW+{PFo6wJ+3`zOBZF|-TJwcoF3bGcEiOA*unkl z^fmH|^>cn(lw2y;(W0^y%IWid-PS8HfR1? zA0wYHmMsr-a-fOU$Lq}(%4k8S&*Gl#?C92l#oHZ&mDIXpe%Y?wQrLwlZl2gEZ?gxL z=hf~n@NuD?ew>qRS>r%ME~lo7w>Y*rab11Zk3TEjiJtLu8Tyadh2A)~I$AVMPQ83T zl=sTVx+1I4O?vM_n{RI!GP9ZBNf;#0BjwmC_OSB4lIneD%wAxcwLI3l}_lkT#hr>G@w) z{JH(8J*`{veekaCa{7A%KYs6N1-)H2_}B8D_B3JciBiYU4u71or!mX-J-Yy>)48Kw&);-YLOTpz zm(gXiJ>63>)3bP$HT|UXV&l+V*7Wwni-woWWV9ha?{_8cbza0eU8#4rYja*5uCEw+ zbQ1Qzr&0Tr@9e3;+s9*XV||`!Z?)n5QwhELu5WVZrMQo_oxgZ1?gz9^kFBLA`#cd? z)0dJ?%N%W_^h8kojSh}-YEdNVp0h2-#Bsec@TH%v38}lxc@y8bx^p;H@S@<)Y<3sKgz1ps5`(3bE zhxQE@FHz9ZSqa{rpQN;u(|O|CjmMjc(VzV_TEr$^4nZzz?xr;Kq7A2Ucn zhZ}uK7`@4g?!MpsTUNQW%_*_gj&r~M{OmQXD-B?3#$M`bM<=gw`X{czhNg&`mM@k; zpKorrU-y85p6hhT(&vDjo;tBfq2r2s9;J6fdX%GmOP`!P^Z@tk-}4TauJW>{UykO!5aa!T)=ppR zJl)~iarc+OGJ3kPclA-|ucaYZU%W_D&|LvJH@EF^qTQ6KV{CZ#wEdz~YPZ^+9v=Ut z+TyT+zUzEVx()Yz)7Pw??2db!vv)(TW_UZb`3ezVZU5rkD@WQKIrUH19&jG}uM^*< zb5kB~_m$EYzn`l(byh(mmb24UUleqt<{6!e`_CJz-h}^k9qaA4=6Q2ASWwlmDcOFN z+WQ`3TI3itMS%Um*P!E^i!bcyAHPSgTKUzQt~T0r=UqO|pF=yX9zNWe+F9-CrVIT% z#@%a<-BTCpn3nU`vM#pN`19e2mXWqJ_+e&=@i|AD-{?BuYOstd%LjJyzb&J~j}#Bz zcU#itg!}J{6#?PTWNp4*Iti4Q3*6=O(1Ucip25A;RwI|=(ROXlixcZEl|}wyN9TDs zmzR8%(N`x`j_c4*^xoN>FVMcV<$*d^J7M45w1WM1TS{-ebr_R<%aKk_y_%Gc{*XSL zxjhW`7a#8rel-NorS>}r+cP2O#>2UA{m`!`LZOfKIkbK0Na%0c-}kCfuUob}*@-%C z8vp(AaYs7)Y{-nGd?&h5b}P=W)R7jM^(;CxRZ8o2p4;1!D5I;U+~}Q%d(??vKaR~9 zsiaz8K(UI%8{cs+wRqN{xQjSvS$+PxrMR1vcE5R`_#y83-BbKc&eu8q`=cjtx_&fo zy7-fVc6~5rPX+W}?RN%M6OZjk!Muw4bw+3QxPq=fY5r!tzuo`tTvvMu{Xbun|G!xB z|I@jyYjKXyHmg2I$5AcL6)FC8uA8gZZkr}p-}5L5G4Q@XLkvA`WwAy9%{8oXmoF`> zI7sBx=2DkAVH)lG=!98psO;qb=~8#Xqmx#t`La1|dU4zw>!Bo@u^C>yOK3a#;5(sR z_8Bi7_|VOs%bU_vaoS<}$493f)qMFGX})>d8QB==<8b*rkGcp&tLNMj&S~!Qe3P?I zWkV{@Iz_RJ9@>1Ftgk^b1~RlBC;=yx~k>cUPB z)n-NhPm1G<0-l#IDeC;P=4#O|Z#8C%0zcHpFY0plUY@b|Yx5rCZhwDCKhcc{l=XD6 zIH5R5N4B&$Sl{bfafoqHQ=zR%q;G@Q#8}Q-Efc2`ZasW&gEQx-w!3t;@=Anq0}~qQ zyrzouaNE4sH0occw7zCNJKnA$&SUQ7!wK!{6Y()!H-9vX4Z1G7CN47wONi@aJ<+^( zq?>>*hU-~#PwJo8iysqYk!auB-Z!yZLSn}C#C{nYuEWjj)9ZaxA6545m$ophPybBA zY|8<|H}A6?IQq~d_>euBI5%nh_0Yb_lkPvAV>{*PhMOtVKRvxUNG))_m74DsTQ+#E zY5GCaR}5Jaw>&swdGeh8nJc^0SPz{!;o0q><+Gjdw0e3SUcF&X;fSrf zZmb-+v(|Fes67pRR*jx@;L-9`V~)JLv1;t^Cc>nwI>YWs*{AI1CXGAS{2><_&%M&MyY< zcKG%6p+6m_zuPVyWdHY1AFFfMk+1vsg)`w`-;VdlyaJI-dV8uMEKZ*}&$0GBlr?@V=BJN3n(=eE;tG;CToYa?+LQ@;DKg?Xj} zT%G4Qe3Mibx*v93zp(Q+*Q!Nf?ru>_dWQ|)usmhn@Qo|oYuq-i@qYHlrgHoYTXkho zj}earo*vdwJA-}7>InDxr>jLbN0OS*iK-MG!x z%FUv$i1`~~mJ-^s;}cc=SY3W(qM;ZoqAuRdI+I_*E!hgyx! zZ|JUAv-b+y;o=0UIM}fFYD|dzzH9OE$@{MN{U9>G(SPKzjyL;EOrCplP@et%Tj@(? zMBmO_w{X&(#ns3B?v6h4x8FUixUB{iY8{I&u))r1wG@Lj8=UJ-)mnmS?F+RwSXvt` zt*MvRG)!xYr8P6tnucjj#k3#mYc0*RCSh7TYOPt?+W;m@BW$~I)tYi?O}?}yU|Nf_ ze=W%j3t9&L=T}#2mZ7!d(!O5QzIN4Gw`pHrYmZY}J29=1=XYLF!m(DEAdV zAuXa9engxJU$|SGOO&ViM5Bz&<%@)BvaE#U644o{I4n*?dHvwS_9mNJpiaGfTotrS zB+~E&>OlILPvDQN5!RNl=8;Cu9(F+($rBYwdE{}}JmPT%Gn!{dR4FvK*b;`4 zyZRHJM35#WvC`mL5;2^V?&F`I$QTSZw@8(ROUpD<@zTAVCo7PpAhniMtXzt!(^aGXOaGa zi}n*iZfqP0Jj*5sdrL)R3VAFeBy_+)^D{Du=vsS5%HLc=jQLXCToElXHx@}X@yWE- zAod+O!ISa|6E(wV9=Hj8 zVijd!q`y}3r*#aOzOLs}?M7>Y^V7G_JRb^aJFKr<~yQc6G`5GR% zZi*%`>R9tUGN-b3f!a0TqtZ2h}yT*Jfv(A-L%Hz{_gdfWoiy5`xjBJT{aEpZO zvoo$>)JvrKvi6#Nsz|u-N|o?(8I9VYeJWp_YRlx@>phr|_km~MRil$&r}o9hA|L*H z9|*a1^{C-TB@cM?Js}e$gg7E}hwUpeGuz9W`ckd=rS z7~lgOq+J19!K4eqg9`{5fV`l2Mr7)50^)5COJSr{$omA)bLod^N61cNLzo8>as!p^ zhj--BTa8I3(h!4;nZzge`xBDhnUK952*G3_>5C;q?k?8YAVg+K$P0v69TOI}zsVK_=klqHh8!c_ca3jx+@gBuml8 z@pDzg08h)B_Jo9SLZlJ$59FO1!?{o)6@+X7;JJ9w* zUU-WwK^Ky&9)!HEK^^9Lq(*`IK;wk`T|+vP$A7Y<4j!$etO$wvMUU(N?HH6P6caMV zgb>f+7)x2x#}YmYKo+vV7)ZqFL<`a}2ZMw7T1d8}Ih2^~W=KEAnR~j3CxkFW=mS{0 z9G&)zPp*JAEebwE99iN7{5TLeqIdg=Cz1~{e8?1(altIOjmB?6<4qN&B=}|&DMDxK zn1qv&-3gJS^L-zp0V5P-KYA<#9q#3ZhGVed&L0-%;BQUHN9T0T4j*4%60$7AjeJK4 zQqpdY4gq_zt34(!I-(QeHh^R1Jkkk`UWw6>A)ST}eWM|y<0e8zqe1(w;V|efB;UAv zl>3g}o_9ZioIodKqVs;Bemk_!6J^^0DnKJgC_;G$_N{BLzhpkg63X4L+;~g+BJ_y+Ph$Y zqOeY)j9-grnP~ejB)zmj&zrud{POV&9f}>E`~?`QnJMRcNK|6+bS?oThPuGTOCLeXs%CJk|qd%wSx3P zTjsba$Uop?AtmI#kCG&}q~j|}j4yD?YbwI|{s;@g_@KW^?y%%?Cm!hyxtsCC&0C6( zQ8CV)z$;Kr$hKG>X+V6hyPR16!IFUwCFJT$0htG0IvDpOOZg<`m^V2xD3aWLgaxIG zC)tm==?i{=c(~Mx5+P5Cki;CeAv(hec?dam z@>y~xxjS)t=s@nE?!_Kh2vOHqLw$0io+Wd@Cjd8?w&XfKRjtC;9eNl~etjAV zP$|i>0?6_UkDNhUwPK$uNM?XzQ8IL*6qy^7F5z0QtJcZjGvLEBRu^W$!IbcC3 z`lNFXG^vvzq#82ZKpDGJ0@A4)#s=wA&*4G-gd-V_vZw8^aUlQxDwc@*j3lYZABwcl z$DE9U%y01^Cxib9eLVMPO-MDyx3Wr)K)XC=W^v8z|NMH0&n+erFu)p))%(8`5KnbK zHgW41DKlYoXJMZctJIWXb@ZeW<*7`b(7?_-l{CU3jfo_pj50*6Cy=OWvX~H|p}-G6 zsibD}jEH24YYP(!|3^HUDy^hBCQ8Xt74wM2TJ<4VBtPJ#2YLh&M zSo`RqC)SfZo?rw?O?@IPvga8;#b&FcS)4W?`>RkQT%5&tU`kiE^>pW{!~z69AeRF>jyNqz+PaCk|ez#LX1Vk*Hi_)j3Ky z6|yK#PzO0hm8t}(vFada;Yze37HTL@;FtXPT4Bzn7z4;dwh%Q+<@4(3wQ63Kgt*3@ zOUQ|@MixrtBy2gMa;@1yw(`;?d&eb~Qzk}`;-$9GS9=JFo~kTtD{VjU0H&~}k!6z- z$9bh{=uJ=I(P>|K8qzn1_q(2o2)VDcYV#Rak}BDicB)ABS8u7c8Xpv^NclFBmm!c~ zD7UTHGqhe3$`X3VmjF{8IvNkjbxFT=eblubN8LszlyAp)8AwL8i&Zn7go0BG{&@D< zmKDwt=&AK}sGU07K(Dyn&^LC6dF0CG^jJ*miGo}E#-GN%B77^MM57Mkk(S4hLmgx| z)j$um(o;uyY%^0m)R;0t^2S2bx14qrefyleMF(4gP%I&hH+N#*3%+|vj;G%2rfwZD zbr2Qubnt~2mR`b0%=0yx)SNt#wbDQX#B6Y!(J?9xET*G=^`oJ(kYi^c}3c%zj z)la=-P_E8In@0(Y^BHmp>qKhoW*;In*gGw=<#v4OKm&=|lSubAHyB8ZGh@qrF@K}2 zQlSRsT_q9~U9*zmUtgxTEi)ODT_})D$RXtuyWK<;uIQasUH_oHMV)=L#SR^A2e@bS zaiESlGN6eO7c8e|vFu`XC(QtEd*pQVF<2U-5yy_#x>b)tPjj8ksRk2telFpDh`V6x zfVR@AHenYdSPTh@lWU;iwt+?1%ARA}`hxA=4|)5+WEXg2S0a2cpA3QIpc8>l1aO@J z4ggNA`T^Qx#M=X^5Z{mR5uhi)6Tq$P*aZl~(IUi7hLsrG5diE62CP-J^hbOhAQI3O zGE7If8C&LC6n0149nX>!p(~&iz^NJvgip{04f28z_f--65*s0t5Pt~x2j$l*p$cOA z0h;)rO=x1Pig^N!b3;4=d@2ymL|!n$iAZ-s$Zcc(i2s4O2jC`P1Z4gjc=&)Iy^)SX zKBv=f1Kt$y9qHGALum6ruJPSps&v%Zv!A6_4pti#_>SnLpXxAIy zKO_ALVK&0MkYgc2CH9XU2-gE@!7B&!Bhh9fjPC-dBJYq+Mft_Z?~k@|=UqL3E@<^2 zgCp?Q5syN+40wBh7;{2}@@|N4z<7Q|-cZn#BTNTS@C%Y+4gyz)v={2LL|>*TFlI=n z0nTEn5TK7{gC+qob87nEz@LKL#(+_XcL!iwA$I6jPAx(aQi$|pgws)X5|@vohZ8+WyMH;L0!X<&O`nRz#D)&()a~~*6X+-h~EHREbxD!eGh%1z9Rksb)=gR zavXfPV}KoGg)&2~Bku*k4;2@2apWg@<01oj-N7>)0}u?H0_6`ObOb&CvJQ{NT7@wP zMS2d({pO706XM>W!758+sN*)C34O%VF~5cZ-wkwY08VKCc)%p&snLJ9@FB*iYYO@p z%_C2MPXlfe%CrNn61a};;Dh?Y5Z?&=JCx@fh!z8P81z%5KkqYC$d>|l8sSsOFb#1p zjD0ZpJw|_wLwqsj9kR%NPt=Vt75up4ST6b>-9=tQrc($vfJlhE4~P#!{sGkE27Z%~ z{)YHL@G3-n3t%+T&j9lPc(lkz@HmLj3H0ZIdyVps(Eo!mo>EMtz3Bh(kUtc3{qT&= zL7F?#mP5vgsP_}%?ZAH`$~d7Pr-Ii_@Gt}{Mf?`>v%ohLbLBqzZYa_#kT(syz9JOK zu_mJ~R8Ll;j`6@*faWTmf7$nhP6Fb}i?0k?rOhP+V- zGeFZ0d}M(3pzDKtOYkt~>PH=FgkVpWA-@oE-vP}j#6d>lkVGIidX> zk+~kcX8^7uJs)|U5$Eo5hJyAD;#*L!Gs;Jz%m?uJUymZ(gp}|>-Fg)HF9pQ^eH0Pl zcZbzEtjN^0pN0mpI)*T5mJa64*0c0XJySlIooghtNowH^9wv&2rK*O;P}bbdrrLE^ zZkWDRhtw0rUdPEo8$X+S{yFI<7YYL=yc(tn2{(4^rhX-oH{}+}tP0G%#_=Of?RzZe zr(QV`$+9u!p@-^&&zZX?=Jz|4>!e?#Ghlz#AKq+kX@}H0-(k{B1M7AfLjt|V3wy3~ z8DX>fYt5XCONEj<2dA<+k#+&&J?l5`IbM|W%ar`kGwX*Muj@K_+n3wyW8-p~!Z#d2 zDx=uoV7=E~$|td`OM$0yL`(MuxtWusRXsYYGBoE4 z2D-b47^dV8FMoA*_kasFzT^j(~wxj6Q z?!Oy8=il}l6LYv@^`p_}){Whw>`1J7-SZbTc_z3`u3f!gd~;Ih!FuVM&Vj)!4ZoU`l(Zc zcL$Z0SV<4&DSFP0Wcj@+qgO;_Y!|lczkkBn=qpins-WhGfQ>=XX8tLSO9J*dT@;E( z_-Q5ut+}|$aEQm?NkPJ1*3kI3)$Q4Id0;nNvOTqOZHPrshbFyxb?JPcPx&S1e6dn@Iv>*GuMPx)zjFx>+WlXeeG>d zu1qYrQ8h3q>$Us(wFcoS8I8kJACIgNI%Lp;6Cat}685W`CwMgamHBQfPw}df4EN2u zr<6a~n&Ee|zlCTcRW?nvRqoxxI9mPm?^I|k*zb-v+a7XyiQkI@T<~jf93YaCl}ZT4zIs8 z|A}ystW$x<)c4oy_Zh_Q=zH6nZ@ur0tH#HSm+vA@N*bdM*kduX#M!sFqW`I9PM`ck zrZn9CP;{B^8L@tPkk^0_hIDR`PPlJ=gE*qp&;H9tGtr~66?DzC4vPtc*{ZG@$~6M(BZmHhU1Hu_VVKS8TlIG*can7&akluK?U!@< z9fUf+m(R9UJhGZ&HmLW#FWF6oS<3G3m6n$BbEQ6|4M%eg1eY=zYeTmN&3<0LKCjrQ z-zkCh)eiSI(_`PFUy41&oQ}|X6lrm`_~smKaZi^!iX1fictDp^yChhSGlA&nhHVDv zq1Yyhu%u%3Z&m9bA;jw4daZp9v=g!IJ0U$Ev?vBI$JibbF2nL%kFW;IGq<&4w;~5X zABzw>5xI>xr?S}q@(h2fya`Z+Dna`jmioIW&>ivK*eB$m;kL3d;K|)Kaq9aqEb*LL z3ZHx=1aWRV;ZzY$h++hvkk=F80BqHFkk8#f+Iyi*z`X+`VSBiNIwl}~9pOdf#{xPb zy$yVXXrwFR6W!4{s2A0cN661c$Q_H8faU`r2XQ|@9pX<>rUUg!Xb*{U8kqAapVB486}T@a#J>yd6eM~gN{Ax9>FQ_Tlp%N~XN zyMO>}`?#2Gy-hEN8f1@c`J@xJbL7GG6!Am7wP*l$`^>3LhY-#IpLyuZKagGv=!UI( z8W#eP-FmF^Kz}uYuLfXh0@Ve2{a~nQF_4FX#tyuDD4-G`{sIsN85f~0?u|hQq&ama z126_G~Jy#T!z@Sj0<5j1j4 z-T+LtS;#j*{(Q*6y;|A|{9S|}F~$t$)M-4klfb_-%I1P@9{8k#R)#cp%gr4t`$NdX zp!Wow8QN`u^1G4G9m`D7rfX<#Fv?V7o~0nXg1oONvmNopXe)Q6P!2iF(3f+-|0?oF zqb#QeTcX|1Arl|tbpn-UArIBI9%por2bN@z9PAY6eC|R<4azS^-k-pQ zqkitF!o5jK0Dd9hGC+iK-vPOx;f~1YlGZmsKoPjfBn!c-1o*31uo6($eFr>aa`YK^ zO~e>-S1NMI&K=3PwGUD%0)*ke~gFX** zT>wGo<1&(QPl&_n=t1LN}qxN%6I1+SanGavZQ z;PnRWb-^6^gb=@;w-E8Ufc4-xAL+v!fKM6VG4P>i_jKS6f_??~*aL?tMtUIM7vb-~sUhPo z#IK;uqmkYSx!xil76h%w#Dj=CVa$(!W-rQTAlw1ExuAQ1^a8+9(0l~`JfIH19f=A+ zlZ*Pfs~_%4q8M>~v~{!e=P@}3{3|fXA&~7J%7h?)1!Qr?ytc-C+lO)TM1TE2Um2i| ziLNMz{E?uY0os9(iMyi9LEC=??mFm{nBZL%KaWYy;6Kb0a}Tt}py7L99e^C%+od6( zZvws=;b%ZL+8*qJa+nv-fzL-c2>6?TJfyQxrY~fXBK-=_CwDDShKY*boF?-ild%lX z5@<>>W~rz*4fAF?p>Y^Xqz+_eFBO|u65eiC`R!FwNgEat|Ns}p&~;I9U47-$zjE+4eh4C|&0 zY5mUN1>88uW`gIuPJuNH4diI1s@H@!vyo- zDP-cz5K0kG2h9-hu>_y7h-ahxY1G4ALkVkVadlvX=l<`I% zM4%n35dRxIxwp&XP!`AB2No917XRao8`p^cj=BG(!0WBv$1wtw&~%8Ow>T|@G=%;5^k3hYTCo2mT%J2{~g~vF2XBJ zCm~_*NejKy#j`DaM=^|5@|1T1K1`}lNrF6RxV2STwoq$Q-4J9wR#QRk#$5>NZm)MM zTgPGQ1d`)m^QyMH!+DDPh=7~<-M+JdaJFqf2{4K5FVpbAF8+ zo7M~OiG1tje2XEmRyu}xVttRLi;IK1EQmi9Y%t?$ameUEzKL~EDF1Xf{UP!O7qj8V zMgHb)aWLQ>ymWE6t(zvUyTc5A?+E!qeyv2gOj!_l#g#;ux>PK^(%xOLhqK~tBK(}A zrnONjUDGAeK2NDxmyVx~M|JQE@IJ-sBv{N!{B=u~^co`FWfs%rD=fPcl1!JzhCC%f zZhGRxrE%RG)aLvZ%1?{gSv}gHOo;E*@tt`>T%@2j!7f%%&^zH?a9HAyeiN^IwiCU!L;oyX#gu`d>cXl&m7lbq3hvFifZJf%5aebZ8Ral2|>J!VcUbzHD%^-JE`D z2VHMmO>py9QZ&}9jyv&?Y&gMhc{PE;= zyLBf`Ekjjm%a!3Fg?=lQRm&#j4Bu3-+{R?f_ERf;w=b^fKXgUJlRG2dj{0mgD&T~0 z?x;Oa>A=zM25GiB2Wo??#teA6(N<^8t5d569y62|O09G&t@*!Md|2gMxzJLSsu2wB zDXZ1J8Re!n?6e?U+!zMi@`;n|#sxWTO7hJ*vCod*>HA4${Jw<^b{#G)mYoogE;`8* zoFlr=;axozl031oNwsLAIB9P3q_RkMC2P~Ze2w&OkcOFjf9jL_ldW>H1yj5WvZJQl zE9~Sj_36{plz`_aHcJ9}h*Mmwb^35{oBi-&E@sH9iQ~V30lFVU6a~^8mot`7ks@Aaf4<65+ z>*ydzE66ISUMy9l1g9027L$TPm&&rrdF^(WN%&&BYnAh@j)~G2cwdT0*U>u>yMAG( zEiR&>faMiWigH`3HGy5eoe45p5E%?}_GjX%VxuNiQ8x~l{}G2SFCUhDdxKfZ zOx?_~w4xPCJ3Cr@e56}#kh3)7+puRV?91J5P8$9!%f!wlp>Wa4ywF|Ft89|5ZN%n? zKiK(|>swUg*Fu|l+=07ZP=o(lkAK)P+Kyb@s*Ihe^>~7no|s^n#}0sB*fIFH7R!F? z*}D#5DF9mvX%7NyBdzBx?s|3rU=-4FfD3?o%?DMc)!HK*A+}v21+)PA0I0Z?OF&#UVZMgo)oY+>XCT7~Ve_4V8m zw2a#`qmW*MIJR>#3F(CZ8RA|5XFw-FD1g&HJ7CX6)#NDP5CGeHtG-l?c8y1T3}7UH z+bi#&VaI_#4S;&ndQRZ&5Y7U=JM@*|i0=kq z>m^G7N(hjOupfApgSIQ=U4XP3U;|(=z#6z-2x9^1fcAhFX!t^eLjaEv=X8)J#98Q} zobJ*U@dQ91pg&*@AO^4$;1A$*{C%iz21fin(usgM0Pa;#M}!*@a<6bA5Pu3V1FaX* zeG!Hu>;jxA!W4v1Q^5xn7DL`Tz%~pxch*?XmBU!QLm&ErW(D9jAOkQA?dSAn z7`e5++R6eh2tYu84naI%2fzt%6>u7piXwy_f}iNt{EwfJ;B!p=(?kACf&Tyg*$Dh3 zH^T~8R>0mJCCh60w)ii}uR&sadjCaftV5D3f!<}AbDU4s zg#s%*M#8ezHij%~Yih@^ENkz;hMf?L@e4@L**iB#;Zzu>yf1F|~0(#f&MJG-cYG%1l|$4lJW* zX0P&My?q2cQ(yg#JOS}zeGPFAWjf(k?s)zI3c|Xxq_dU4&rrbpf}j2tu&OR#)Rkqr zaZ)h?#?X}d1nC6}O!?vvNYvUJL?4A%h(kizFjO0ka<~Rzy35e)2t5Joz_O7&qO8E2 z`-|?$Mw+^#e?+}v+?iMs$1+w9tbp{6XMiLEK?0j-*9WcfC5(s-?@O#&n*k}92YUePDC(- z(HFSKvy)J-U^1&>-54;Qf(#jIVT6o+FO^`b4Z0GNa^s5<3U(UH{yJTNOSu^g!h@-ejGXkqOvV0ocx z1g0{b@FEVqgB9#dW(j5%{)G!vtf7uBCO{2a%I-p=Fei5l_F#G8_S|YSi`{0?7BBeR zo_kIAV{z+?KdgV`v=WD7&!4+3)?0EHNN%&ktZv=dRwB(U`dHgqH(0EPts8DR!c_on zGw2Dh1{eTNVIjp{(z>DMVKqm6t@a^a;8TQYUd1iEz+o*Wu&{02thmd{G$U+2V9p)t zIv@}GM(ZVQB*O6kJFK4-n2+2>*?<*Zg|G|Caf`hx4uoG259Q(rxlKq4m=Au~M@cPU z2p|r1MzCa3`T zL!)^M+TMU`NKX#Jr4|~#9q~zkY-k})FY%vW8Che4@yw>9H0(^7Kcf~T_lYGZ2%gd zjIb{{=`F(5AwQJ@6eVeB%xK6gN59WRn!AKUcIyVspdp_SKLjWMa4&3@Ashpm8z?sw zZNG)I6*~PAI=T{ZPB~0NI1ca#ZRTtia)47JT?oME9jzwexrk52nEt?E{)2q(vZw;> z;S`P0$g@FSUxXWw4u#y8I6kOvBIY7zr|=c|)o1|s5`a@q9fP4nA>=Nm?g3oT=08!s zBVaJV8}J%115gAQg}S&)=rF|P=&yN@l@GuQLGq1$Du4N?GYI*OsON7yeE7j8G8%k& zpyzCK?qJSjg5DYOG@$>ui>#i2zfouu%E1zxwD0~?@eD?KENEu{JisFbV^)m0eFo#W z5p%l42o#!igGt0=LNT)iZ!Yya>&;U^-e)t1^Ro4{|X+@G5`Jmt_Jb9 zn4eXM|F3oqTm%18y#7mp{(rM`fSRf!R>sy4+Pa<%Yb>v2MfjPJVpUEs%VXSCXa-M> z3p7|hFvn*Tk)FS6O%AI@6EP5sM#n%JTp%%#aw{M$7RB<^g?db{a#1mls)?a5zHdpz zkb2nhHAG5sEj?2py9RA==lLHbic_&SoH0>akzu5Rt}q~ripZScIqs_LtlCWh7NzQIB!;-0Klrqq-Qjj?`%OnZ5g%%x0yqckTkZaR5SaDTd~L4jiXnwW1{V@HPm0UCD4ZWq>*SkVc??~;#vwCh5{98<=>-ogU zcUr?EJyyL?WOHF0QK#ec9sC$g<2%iMV$G20L%{KjeF`t1FE!Py14I0fOR6%`(5Yvg zf1!7VgfDWC#vUrkP%p;?K$fnCVM|g-^Fi*#FD4+~18Z^)mXhD3l#!y1CB$DHN$739jIwTs#(Lx0jTbM^9z`7u^7q0jw^5|Cq^#(rRLZh%}Sv4(8J!Pa?=Ma0Q8|H`G}P(UDQ=DbQ=_YGNW% zt9guCBt;28P9V|I(Evlu_76l@%p~d3*#}IcBwyPdUcCx~m9ZkoN#I>rR zQsfN<8Q@2-^X8?&ay< z2*H{>0<6HknJmDb3H((E$LVMtP-Y*1+q-j+J_39d%3nY_25HXbn|s0Ji})_YhoU?d zSh5eel?b^#mYeWAP9i0)zq5%s5(MZol8tVc%1mY0XDM$Pf`1zwAZbAMFxCx+(06k|& zfbk#^;Qa`7+aMi;^aL~j$^7SMG?h?NRYIw7e5pvZ7^Fy&yJ<2v1_{1jysg9gD&DGTZysc&Y<&=PXQfJ7iUB?7`#g%hXm=HXipgO?jY@rJWeM(hx!@-U64N< zdC>qC_z>{AjXI(b`h)ig;IjeTOIb&h=k$2)oW~hnak}d!z)kRo2TdX3{eb6e!G|HP z1`bLYVUXSgSc>#2z*~SNAQyFH0=$t|hBRj|^e1HHUZNj@4BQJ>&d&FD@aOEMIs5Tn zLDvX6A@T~qdo0pI)VT`_i3j4{K_3fRC&V8DxX*CM;#qu$_!00KiL%>J&Jk(uTs;o7 zS5f~cq-E&W1kfx3E(ZJ!5$Dc8A5n%g3P=Jy9*4Gb<~8sR2QK6PW9&`fn<~2g@wrQG zlO}C%(sWB$l5V6>AZb%5i+Gc!8x#mzDT|nvwiEu0xpP} zma@B)ML|U^2)JuSd>-_1`G4p3eP901?|uHC-@hLYvz<9}=FGV>XU?5F0R)iW7dQ+c z3cOb$?{nnkqwYzBdjRwW`A)!8#Ob#N3gFrhhnIt7qV3y=Uje9qL-)#ep)cPdy$G-i zdEX$f55kjx&k?_m{6ElldQgY%0qL3T#R%y)52?_N-w{>=?t&ls0vSuHd@g+g+Ik5x zEt=Rtoq>QYDdKal<%`1^pf6Y*S>y$;+CgwrA4rI3{$ zxbPCmpNhYU{M~@PNcTb5g0gJX{TS_h2Rb{DXNG<^Bdh~GHR{{Z&g%%Tg6>|>r2FQd zAmacQkPOrpfp-mM@N|;Cs8@_W(!J+vh(8WEf%rny*#NvNP%yfedJXhENVfs(p!E{! zd_CG+{g!pc>MfcqFpda0*mO*dtq1*@B)EBY|v}2K zLS0y$1_Htp8=;OoPZl5B` z^Y3@84V9d##BE+@aPNbiMBVrGPF7<(+t8x1U-6s_F?KYZWCy?QZVetX)ZNM@cmmbx z|GIMR=YZ(a7q)40;+ty35!Q<};iKb;A_yl1YBj;`F|`pfQ-3CrliK{JxGCiqYoi`c z_Dh<`B}`UyQLSBC2UOg zsF-IxuVjU8DZ6<}zNszb1+Q+UWv4|No-}du++ds@sFF_)obR(|C^JHT_-s`m`RJ9R z3w^^n=4SU(f4w8nPn~=>Ae^|TtM0E#mQMF?BHrTa9wf@ZEM8OeB^J)2)nf$@F_V?JZ*&QQw z$pxKjl4{z>sPvm{?WfX18{O(bx0PdSq9Wr9>xDDh!j;PP{tcrdzjYmcKe$g@VAPNy z_VDT(y(MezTCOVgKs9y!PS0 z$vtlrqbfcl*(~MwMXtW?h9qIjT+yjYIvU_|m#{5P&BqsUSKMc0U6gjkk>EZ$-;Go3 zg+IzqMuvav7?T+sU3f9G%!88$W8z=YX79V+=}icpkNe}KVoWrvYT7l7n`kKS6}`IBg?#?*u96u)Ol>hRWx2{!R5!CU!8>7}F zD}u~>X8#0n@ZPDeS{a4pEChcojz?n<7l(gtB zY*SQ;WxIFhYaUB#k0@Bx7RaA+?OM&6DFf?jPEQ$eolKmXblrSanAdb;xz2iV!c}4I zwFOaem7h84y6?Mo@k4I$xg8TV#h*2_jeY9ph`b(4em%7^VZ?6{wMk+6U!y!epJIgB z7-K5vUlwgT&!t(8wRkEPJFfMvO(Hdl+tCXPauQ5?yzGj?Bg=};Uk|)j6lTq;V}5M2 ze#GucZr|L!{-I{y^tB0GO!U6l=8R(7{KA#R^&_(;mF&6h$<=IHu`5urIkz#!wzd1k z3#HpWzA`ED`KMo1mNh+O`h?xtbeGIDww0e`cb{rrHgnJX3d5}Z`~MMOUpzdZCG^l6 zr7M%hwD|)eA8mf6F?HIBQZK7(i8Lx7Id`XZ_H~bBEI8I=o5H^O**`v+ozp=t*DDM> zr^@WO^y!4R4puDh{`Q~$(3A`QG1=u|%DrChKC*CO*g!^U-Z3{%S$ixFYn<_Ui0#B3ZFHEWyvLKncg4@-7-`_CK-5pF$Th{9zwgr-^9L{f9Dw>Cu~f+4f})D-Packt+TBdu*3{0YzUeiH>kwkOk!{G?h-V`X(~Gw+ny&c^fBmnvYb_3snknS@Mq666ZE6#OFtB`dUum`XUuo`d_fR&9Xfm#E& z4JbtVApk5Kd5bX`;ZWocX8ySM3ANAMNKkt<9U)!AHv#S-t_Ivhc^cAh0L}qY0quZm zfPVr;0@8qY7GW-c+S3&XI|0i9`G6k)j{>YHyN@*poB_|p+m z`-ASw%KlF|b@;$AS7u69wxDBkjDjHK8bjFO*&_tOI6T{^ z$Qx-KHCk;PqIMhmX0w(AwZQ7K)rwSI4_paB5UI8c#-6IMu;fW<);Of6k<|@Lm<;A8t2Am>(bK5bu?mZT{tLnsyD`Tm z^c2+W)U-#Ysf9;9g{)eL6dnd+MbnE*QrJ>;;xKiRFa!8ygVjcr0BH!uBw?mP%@zu? z!W2F8bb?V}g~w(qSkz(#ySnEbqvCN&bfEBrs$7@M>SDoLLWoX1x+2%;vdz`y3qq`* zPA*WZN6(8l3d!>qEHtXJhYPj@VNsaQ$O>pgEvPF)Rg0grs0tQ8m7f&`Q6%%098KpBxf(xg-=DM&H^chBzpy4m9aQjtzIe!`Rvdnl_D|BSZy?B3wBjaN?5H5XQ7j` zEUa1=uNHfTKzc?+G6rP`3o&HQ3SB1fQ9;XXb!eFtR-hl^9AoHmQN6NX$cC|x`IKo)L|IVB34*$*&sAN z%4VZG8?!fs3KO0ck~gzkd`3D7bBrv>RR@J_V2h18g2K2}w5Tj$q9s?|gDq4iTLimK zctoB2+&1GJD4$MOWE^BH*q#e9huK(_l4{TM(*@R+^+NJ^<0!StpKcMFj8BX9 z4ys3G7#9nnYRe(ZVnOwikeK|kaVoEyCFsUK54~ZNA8HmB3zoyInh3%`p-0#&LRgkX zCFsJ~Bt?*zEetoHg;{o^C=3^Mj9O(B5|5~ahPe>J(aGv^L02fuIM$Q3ylM;z#Yh-2 zCb}4~^_r23S((#7fm?&5*>~W(mk$Drk7{=;Oyd|(JFp%Pe6hV<3 z_Vzo1Q5*pfS5p%z&-%orqCbRa2+Z0f22*rLlDU8gG}mgGhBpo{d-?`a-pDtY-- zA;c^vFUfQY#q1@!yn+zYrJSx^QGhT2ofjtD=j z)kZB!AJk17r;Se4a^d0n^o*EThfP;C*RIu?s`NH(ly5iQ!tUbFmp$J5}o)>Dq`odsK=|A3kq` zsCAfa6}H-Nv&#{_f37ywmO9X`tqwPZb6Tq{)n|)ZT4CFw&)H#5wWZZKWB2;Hr>3W- z+O##{;T4m#sdh_scWruAxb4~0C>x^<53(_-T5H7ac}}HG>#(QCXdNkftv;?gD%D)! z1Q#|wJi}K3W_2!GIa5)g&9J3s_!ygZpgktq9v)|zpS=LAX?@xRgM*Fnh3oY7d-XXf z`c$({Ya5v2E3iFT9<8;fhp*$LxKv$At=1P2wZS|yDqUPrm%>*#wCQnmOfPM^HmzLi zo2w0HYHaBP!{?*z@bFZvHX{OZOx+)?t+Pb!GDSJDJjIN0YlAAZ*^465=S7FFn`hH% zH(a(4jMlD;85r)g+2VDTVic2Fks2Po+%~W=TsNL6|?BO5;>5Y2(r zNwcVNH5_mYs!SD;8XNmyIZ~r(&Q2H#Sm{@ye9L=kGB8d-&c<~)`>8{mF6g7256gz) zD+9WWjEl%OgZ62BMpubAH8el##*;m;G7iCN8HtMUrI6-`a8dvZVGJItAUsYZjChK` zKrk%XKVYe%3-ZZG9?zt|p}*{itVd_2;!(pJL}H9%NGq(v1;9(c06Hl1;?vA^gBa3= zN0Ay)<*>rsqv2%!GfOsDzlevk3?1tPO+<n>aqA#5eG=L}2OiccNsj|8nF3ip3EWe_8-rU%oH&N+fF*VWgYnK?fgA^Z z4d~UwTRI;+)klCw@Z=fZU4D6T7WEP^2GsGr@q$R0XTcxhKNVvv(^AN|zrx9Htqj>! z-%U2~R)Bvx`$>SU4KR|ScUvLjdRULCDC>*-3K4um=(Wqolb;SH$__Yg5v+a4kbb>$ z_L)$kTQGop4Ez${KeF6LdVt{Hpfex3^~(j0jDzgkF$ODBut9-b{)rn~nt@x5I(_gd zC)AFZ0pHywvLkLG;!QDd%ngK53VFDYPCsmroywh%b8qy~3!1%W-;48qZwcvc{aN%=&)G(+Aqn;5chz!2HNoQZTabm%H>YP$Ou?g!iwMP76%$Z7D`vqVpR z!ywYr$>(P=BsUrNSRwu_@CUC`ki4lu)Cc% zdkGxLZ;B)SVmu?jKL-77MLTQYp`DA6ZU$aEZX{o#E`8}R7jpe(bddbggz1lG2!j*> zWl71)CbxkPGGxYwF|w2R?kG%Qm?MsD=g9APlQszb$rY9teEqZ;bq+q&NCS zH*}@w*A0}>!;4>yWXbsMJgMu>$QvnRY}cW|D3q@S{xO`uT74*j?1T=tVGIgKz(I{? ztYIkT6zJx+z$?Xbvl4U@aq~(6!nG*-8gEn}Qqmu|jnHH2eE$)A2P{}C5Kl*Z4)}N% zGHOHlDDVQcl@BHkY*CV_h9DA@3!3U|a?FXj61#racPy!Rmm%v=ulvK;5I9EqI0#cv7~(PIh8^{)sw8Nec3M9@Yua zxEqCe2z=4Qcf;c#AC#-%wQsqtCON=gjPy6aqnqnDFea-(e=XLtM;^gEct=UCvj2UD zC7p<(QGveWvhWX5$oNkOs=T;3MuP)YUispf=rWvo@+ozOJioi8%BvO(_CSN~vH|hiL2# zww(+vm(lQI`AG?f=F6334H;)bdpxw{52ADB)C6VJ>01ihyxzDR-d@%aU$s6V&k!xP zx8X{>(FSQnY)SA&VZy=a*Dv{*P050x?Bmu`UL4pxZtuLS$cyHRPB&=Xr{9gS&%B~6 zYZkJ(0duaO@Le{I;<&j6WtnyPsA@rIyK;DXM?J%a7^1E1P%|#%?$;k*_KxnE_>ATc zRXZ-IWqf>Ev@55|>s-d$(~HTNSVm~GOuphB6W6W2hhvt>v_76;6LWXm^E(nou>I1? zyh-EG9fRHK@%s{)=h9=oF81T1O21Q4hMaxEPV~YffmI>L*Sq9EOVaod@Y8VKOHgZH z>?Kb`AMTJrY3=xSBU5nLaCR1I`6eBG-;SGTynVSc!}ZpZfY&!pn48vqYy>V_!#9s# z-@Xv&?`bh8#ded6E1bM6t*qT!a9B9~Qn&DSX*0u})!1|P9CUEZh0Q9f$xkn;+>skM z-D61OP+fGtCvlGnhUl{LkSPP^d}=8F4%bqqGsx-G*Gn98)3ExfQa|&?+&d7$^7k=b zA%~DCT_sC|yWf0zRg$WO zKMby~uljxL(!X(6q{+|JdqXr(ApbInTLA&241ZfR9WdU!iQXNwj8{Opd3R(#0 z>-NA&K`;%FF8d2yE93$5x3mfRK9f&u&hrw6F?d$Dn|6X{<7`d4cc-_$$HP^ckNrLf z+7%o<(_4)39zMXjc&yhagz)~nnbPgyT=JCTOIBo&cZHCm^V{}&ORK3g_az1HjO5bi zeY?8dGlR2f4R%O#Mz!#eF}m~P0C_`r*e65`ZY&!!8Y5?YQa|(3wh$f{T}t1KWt5u@ z7UsSd61ZvqO%~>DY8ViF-m3i10{b zt6vYf6}R+(&@$%@y?GWO?vgX$vIoxWav8?01?bcZy>f0{Otv(lGnRsCJE+2CNH$_FZ3R7TN#+PWqN@qUVMI9B<7?l@sQ$csXZR&eDEHyVV(~=?;&I%xonN{{5 zVkIEen3CyIcNEj`%Lp;c%hzjT#+7};)XbuP%P{?7W|q%+W9BFKQ2Dzg>_Cv10GxLa zS0KEC<;#Y08{(SVT_(R7=@+p4-~c1hl)_{{8WsqNT#u`{$G}WRoCjYfFa{Q7f2SGD z4+g+OA$4e*UT~0zeV>94^&?}_+ORJNd_{n1t*q(1=MfcY>J;b_1w z7MRJ=*gmKk*>ubw0uu!JXh!y@!#a@9P(6%gHV*y5N>4t54Y(Fd8>}tayt+Y`PzZvW z@g-QAJdguDGrk$+yU^BQ#0N@UzTGE~Hvr|C;ORc(@dncL+`x|rb3vyMO!Z*&s|fVQ zBkv`EcUISOzUaS}>T2XYJ|9c@;4YI5mVoTz{`nyM*>Aybj&v$aVp!1R9B4tr^4a)7 zSYm%h$GS(t*NgURr+1ko>%q@8jL|HVo#+o!3c}1qe8V8{fU-&F;a~38_1@s0uqA;? zJ_GL)5KeVy?k(hKBar+dAb(E>1Ol{6!Hy|G2qE?Y-8|#fUSWms^z`nJz5v#AA`0RTDb=CMnE3g7!73)M>)n> z{(ztuA*zyd5M&eZ|3H}q8gNX{$rpbv2XBiph$GO^8Hk_4NK+d<6Y&JpqkFLdFW^82 z!Y05r@Hh(^)qyxYK(-%Y*=r05f{B`(6tYn2)x=f)InXoA46sV?`a5ZJ01}F0}9l( z`x9FEq@9&tdIW*5An+c6!6^sMB0MO&vOyDhCjoxo9|un>5z+%{|H8xThLX0Sj9xlB z5xl%E3p0sy=6fgvl} zrMEf+qt2huix1HkdKd-U7xEn*-sa`lKLK|VpcQ%aBGwIPFBbipj5<4@i!%}Kg1(46 zOWuX?_pPG zLEj$(4t)u86K(zj@kqoIGN2piPd9g$|Db6&D@^R_B9u<3AXVg~cT<`oTAt3AosN#>H9@?WKWA>kz3mEZS{IjNi1s$PVDpYJ=yAp3 zxed6tJzBct_cbO72KWA(Xp{>%Xn%by84<||NA=$3+7VIl(;B2QT&z~z-&0Vdy^J&e zT(O~XraO>@HBqy9&~!XKT{f?24XR(!``bMs#&}+HRMj3BSv|1)roF(lH_$C){A2E;sGyPU;upF-^B0c5nj1{YCj?b2Y+iGQ7z&%$GUk75-W{2%4Kd}ocOxz*Csww3 zcL^KN3y*g_Y>wXM!}oTy>_+QSnfIKO2#cqTz2ph+#bq1jr*wR?fpIq(+Nq`NV|N_4 zTdn7DBrV6#IJg)#?+76;Exk6_c|bUzu@{^=FZG$2V~{F8^g62*<2|r>O`8r1M;h9z z+C4D)j%n;BX|ID*zWTVs>g^N77>`f;zPHCak>1U1_jX>8I1jaX-CoIBc+w#59Ct9l z;y2BsD_vfRQw}ghA1U;=*x0is*v{|DHg7U)UIr#qgQ@VN*TslTR5t{_K^p>jO&J+x({LVvY!Q4rjjN{{S#d_Z&n<~2OK7`zTPL? zoE9BDBR~eJ)|@w+O-;Tx1f5}9#xf9vuL&!ZUcAMG8>5554KH~)T|r=usVGR6Bb zbv2$AAw=`zn4KM-YC+W4rOoaePEHX$ps~Fp6JJ15n>SEcE$|S>wLsvoAjUq2r2R`;b{_;%C~oxb7~$8fsqncZdc)_>1j^z5cKZ!~rS%b88WkW#1rW63#EIpB$#v)z4Wgl-=~ZC>w;4+O=M0ryo` zZf*C&<`oCqsm-eq=QO-eZQhk{mwE2(Gb9K~dztsBPsinMG?Yo6q;Vy(&Fi08&4x_V z&z%ezCJ2UZPk&;1j^W&}c^hE!DnoV{$~;o_*baS+qo|pQfS;fN9tJ5#D^HRrQyekJ~V_FT+KS3_5Zec8~Q|S?UNUAE1256XCv;N3GR;R{V&)}^RR3l z%E7XYX>~Q0Ev(S;`|=BzZs}!L)NaBoPLL$auojF)_zCK6!L&XB@xKAPma=3amXE7g zKHfu}Q&=9bT9AXOu*I-6L}A+RjisEL0(rw&@*CWwC@h(Mfz}J@cfrqZ zWiYWopW23Xpi=~%&QUVRTMtH`M!XSrZv=3ujhBb?CD4Iqoji>6I}+pr8NCEtbVas9 z(X@O<0xL1e2cKzJf|emp&jZi{AEyEIY$jbU7lG~+l+8yRsPY+Px+l=1{4Ml}o>_1r z|5flsO}2611>%w~?6V;pI2Uxl>n`xJ34Luw9@vxJgV9Le2UB{KKLO$^kpDIc<3KlH z!u|rZBl}~yMgA`E{}swAApf$S_=y+D;yxOf4F1;4f$J7^o&{b$+8GFX@rYCN;#0sn z(8elG9;1DMi3E=+F(h@F2G@~K&y*}e{XK|}0*rt>4uJj_p!GY_Z=t*m1mT?}W23rU za7U285a}NW!|W;Ta>b^hFL;YVhT@g-bEta>g17{{i9-OOZ$Mr#>bGTfowb0sn#==l z3xQ(?Y@8313yR4BzK29KR!NQU6g?|}w33cd&Y(0U$27P`KWzT_6dSTibyNtBGz&(*psw9@8l)ne^Jb)13ke?} z9s98;yYv|Lq`;p99H+I*e1{nEX&>4GU-QuCHl)X)fpUai^cy6|x8R4KV}A#D>k-dH zd&7W#5M?hSJOi3@pxCoeZ$KZ8{Dk%m&`lfKJqmg3h9XP>-eL%4Fv4Sa80fk15Wtgw zCeQ}DY_98LVOk=OPsFo>_QKGQiKvtN6#5`RF6e^;1hV8_4urzXJUz z10+Enr_tAOsDBe7y}&TS)V0^`16q5~FQ~YDR{Jf4+xh?(VK*@JG@hH~0=6E&OGaKU zXruu80(t=yIw;k0Jj5W)D>L?I^QAu3w-;) zYccTq0~bePe0V6JfA4P0O8C;zvx}*^!uStfJ=Q8 zbf3M*i?KtW==VrpqW;f-FMz)n;br7sFu}}^gd8#MF62@3Tmkwu=m-5qVH{{JLH?AN zkw*UWp!qx6$RCI?gkoXZlKmR=b=v!g{~g!mJ9!O#_!(;pR8+oz<<2aYd;kTfF76HB zlln2ffxg{>ERW&gqTdi`FmM^bUk!K(^aSv78S#sNqZs#Y(Ak}!`Svu1YydAwsIwXU zJ_cI!+om5OLx`AMLA^QP|2@Q~BmM%Q7V(>C|05`A9TbILZubV-k3v}@$_@kWLoOG+ zkTJ%QexL9z)}{EFjO=^)8s)>$#w(EH0JKNHIaz?b6f<-&9xn6 zOVAw`%IND>OiN@3`b1xuu0;LekX;(`V$n_}Li##di}5G|&IRE73vD$)2Yz%yH$nF- zaBd-83H(ChSYQSu~sO+j6Hjx7^(>DKHN>KBcLEU;p8zh~eB zt>3}(X4H!V{E7U<2z#Kd-$4&=r^rggHNfi!neRlI4uic4`Ex*jHm!&7Pw+`!Nqh_X z*U-;)@YC*tKMP|y1T^O(?+ik)O7?*keGNpv9q$i0R>VN&knt3>^V4SNAo_m=czxj` zq2DxMS|C0f^zL2gTLSC{==?*uunmx3g7WpKhqt4oXan%T*Q6=vBY5|s&uY}$5B@$t zdm+%3mmrJFh>t~_x?TPRaLCi3&BvUO5opqHJhb5HRu)_Zz&i+?djk2L;P(fVl|zp7 zTeCZ;`zhL}L!JZerGf4Y#NoOlt>~8-1DgPx(U8qL;91b`CX^q5j2;8Mj{x1l+w%xt zK>law!#uP%19*1yL4`UeKx@z@JYT>&kBNFSpdM~DAwAH>qu^;U$AZs8fB?xO2x ze zBwe%~96)-I0w4dE??V3j@<@&RU5M4|5DcDXCa8O5C&OvHVwEz^`rzY`fb+j@khJ0w zmo%5Bnj6^BP#voAH*>*5t@s7BVb)Gg)bLD|sL?oF@(q$=uH`TvJ~F)}5bm~$r_^Kf zT1Z5+)ve(2UoTfgPO=8Pk@CkOk9u3AXpPl$I=Z;g=Zl%)U$@Ngm^F}P9Bb{scOf2e zdADe*HHe#krSMGm%3Cc2TlB+0JvH}koayQ1W0hRBIJVBL>DEfPy7(PuV^>?->*6#+ z+1&W`d6&2Z&G@2o37fmFk-T}Xmp@&^Hy{mTS0?TCuMg%99Bdul=Ot@^a4&ZQ{4bc3xW5{~Z#(+ImtPx7ud1`cK=Ynl@ymXe{FtoF@6ChI_BvCUBbc zFI!VJQus*rl079P?L({Qy|ioP>q59sW}h56@N;YDnwXB97AgH^r7d)TreR$Dps)NJ z>IZ+{QTS(Ne*XD%{`|WFbZ{+=7!Z@$; zIdPb+b6jtU(c^kZo7Bi%*Oy!wlasLf%GkWLwEA&n*3R+CZYg5p_;F)uofAeCEQsJF zPe2#E!E?&XEuA#;Sj5Cf7XKQ-d1`A}uE^#&SMYXcM*gJI?X~%nXB|3~KV_4(_Xs5$ADSLBAY1Z+e);|BPkUFkU3%_`cbKSc zqgri&KzZAT0jc72_cJ8+Y{K5_bFW*kZkzXkBWioprMK+e7kpbeW;?!8sOrvLT%C}+ zFc-dng`e62+Y2-~m$onZ!bYZ5-n4a03H#C}O_0v`L!K$Sb;kRQ=KEfeOaH7`zhdd%OtizRQKp-G ziWEG;1J?i<^D6 zaCwih6E?>5tg>X*#nzuCD-yPT{lN;$o_#l0CcnC`epUb0vtG`2K0R(tTFOc9^Z`#+ z#BrCb-Z)MZ&@P`o=-ab|8*=yB^a^*SSrIZU{~uotl!QU`4H>#gyVkwfZGX)AyVgM9 zi6{K)cCo|z#l&wIIrz8u#xW@YX-bCGbh~kU{yFc)iA7s>ZxZ~4bu|-apCivc^5i!k zJbRTe^p?il(k-RWuPEI*E2a5P`s~(1!p%AUTVn8pK+N84IzQO6Ev0?`-WRG2 z2ln+@GrYH9cU9oI{ThD@iQl_pYj6DIUGsJ2ftMz!4a*Kb$-k&M`t7$b-rW-P*g?#= zn4|fKoQS-<2p#o4#M8qH1QFS+$BHML1DNUM?SBwLtbBA@|KI0IX~BbO{Xq)Z|Hrvf z!g4A45|N1vBDg5TWEM+=xx86qil+A>j#8@-Z-NiO6t0jwl8ZP6?d))aRA&YQe zZK6jA68N!+BvufDYE0q!vP>d+;@rYKGQlH~`7`2UNr{M+$>R}Bo|N$<%Qx2Hk&0N7 zpNfrl5V7VL6CuGZxUGp1VkIAMT115Lc4lm(RARy+De{s)(om|?5z$FlK_qUs;83{P z_E&p`sZSgWYuGN9Fqs)bp=mnYGWnv}B!*jyB~B})_DX~p z=@v^^u#`9jymb?W6h^|A2=hrPwmgX`k@!lL(X%=aTP`rAtfG(+CGamYPARKgjP-a} zHU+mqIKl-_saR~ne#BlXSjU%Gl|(tCXu6QdieyHj=oU=HjF)K3-9g0U^$5ZQkC$;5 zMF``9m- zfJ^U!771dZi6Odd57D!9FXSPn1^C7G6wb{G(IyhNh%i|TiNKbcm~kxLQ6e<&7)$8S;ic2_fuf`GxBqgy#X<0kC`JAFiSss8Yb^0N6URGYGbz?95t< z$HoDmFDU6oNjg#_)WtqS-e|z~l7HR8gzzfz z$06L0kUo8n0>%Tb0WK)I&iI9+4EDDC!BGuDGhi0-4glg29{^Ya@B)Scz60P@o4hgp z9r5=7e*u;Pr~ybfVbm$m6ZHEbZ!&;xRA3X6HsqZ~JQ49*2wy@7`%>Oue}r%hU>aaJ zAX-5Cz{hN{BP`;4=)avpr-cvR{X9sa-o>DMxHb|IoI(#;>h(&dXeG}(940Ft%J@ts zrIM}knoN?CuaZn!w=$UZnM5TYxmwB)#dOvunM4sNl37#^Wosp~TPg93&*=pb#sN$v z%Qz%a%kz|qDlfRvmFZFOd=!%?ip6%&Y*z8#H~ABk%Bf72$pq3>l4Md^gDIbsiUR@jhqWWYqU6~EZ#?pR%#SYM;r(2l znP2J6v#OM(8@%R3caBezq;N3l%>ZGZb(utqp82D_Q>&cilN>UuV53>Z4umj}WE=sL zk}p>XPB&7-p+XKFk1q(C?yjjn;I;D;Qb!lR?3O-d8G z-4Uec*`*i+x5X6AFeWknSH88$g#NE$zl?(v*v+)}O1`#r3~hliw@~(clKFX)(npdY z7@t!SD*DI>lW6`xu>+(P5#l*-#|)8KD*8ot@H5OQy^>G7;59MhB{ma7%44+AAO?1) z$vm{|U9aC{(O{GVmNJ259g;hs`ch&#A=n#dsvwl!}LzL%X(=UFxMmuu|+Ae z4o3i*mCq!&ncgNR0aF&HWrBHywP2Y^tW(I!mZM~v>?RSP+55Z>m6By!(wHfVuasrs zRm_xv*@~$?Q+q@+9d^j%1mo-Iqg0Aas7Ta&p@V61vCLsel3!g#oRIzLDtzPCVe(1d zsgQuq$6PWec9v58_IWX~^bz>D8&WYRGUOSMfFEQkDzG< zY6N($^s>Gx`QYy*lceD>IA{$b?$Sa$0|b9`Y7UR+#PyfI%hw;>Q+2ir$lnC`6?Oyl zEH6i#PQ=)l;qmi!kj?d_-`yiprLnN6Ice~Jo0r2>10jKk0qFl@J~J{(2NjY zSjpac6DpPh8j&{#2pmG{Md%5j6QTqI;L(ZR2Y3VkN0NN=3!U7u z0oWkRKVd{Cy}e9B=PHC_QOAk!C(u3*I1+^2G}5tvzJRw;PAC32#1jE@g6;u$7Wuj8 z$Xf97BGU9{AJ!wpSz6MHkWS1e0Ph2C0O$f>0X&L&5^$1$e+ub!h(CtB*=ASgD#QmO zk1jlPp_mAu9u4~T#)|mMkk3xkqn^k~NK@|w_5Ra^j2>Kh8+c!#%!RZYK)nJdkT({C z_ZHH0k=u!MI&f|x?n0a{4h_JgZ(N>1JPUC(;`hzhhazwQs6&OGAILN7?|sXnPBsRe zdXA2xU;^s=6M59rFb&~6gm;m@79qV&hc4u)NEab|1iC;M5c;c{hk<(%@f^Tk;O7V6 zq$2Mrq!+^L&<9}(;6s!pBcIBq8vRH`UL)un0S)?r#0|;=1U3Wtx1o@eklu;-Lcp`= z3q9;$M|=&!Bf$Rv@>C#BJ-PI7Nfyc`fiCs1A42>LfF3|!fso#u@)N?|(1~5hO93P! z-3RR)MMw`U&xBy&5jv2b4tN7Jk0IO(`ey*gp?qghPCY9{sDA`yCWI9Te?yyd5b}5^ z(tukEoNd6RYi9?-t-u=yPuTAW=|Sv#01Le5fj1ZRs0VTcLO-BC>P$r20`jQG`%8rM z5PB@)pQ5}I=|u={K~@={K^OOzp_FHlUyt}TwD%g~C(u{w{r&`D7WhN=h!62sP>!?b zL_(UL3~L2$CE^(fUqL&$h`$PW8?YbvL1=e3U<=CV?JXMA!I>u#k9c?R{|@LC0(T?o zFGYMMU>VXdp@|a@b|d%%n*58S0?Mf2QU!j}5oRLY6FSn4at3YfMqWJ_{TbmXz{6;;_tfbmGvTWqL@7FA>~a3$K>jXdgE>xuk%fOx=@;PW#0{*MP+=zu)f3Oz`H z=Kt5hmjC({P(?_$pu8c^Y zjMFP8rPaC=!@Cv-b85Aa8o#7W`Z6=bIIw)l*`HfjRrkom?>olqSRST&SjQ6_-R3wP z-9GGZJ-a+EZP*fNY@A9Fl-6h|V83KGB#wICUPcmDHinIxrfC}MU%Amd(V*}2W}aLw zMAa8xd}Vjgv;AzzmA~C})cK-4!z5+go(r3!ZNuumx!Xjxq~yK3ZDwa-E@$sKdw%XO zMVXv=R`UFr?v67Cop9}FMfjKRiEQM;=sE{Gsv8%1>)ocy{`W)r>JqQ1$c<2bXfQb; z|Ey@(({{VE$eXKDgkQVTdAZ|*6CMWy2%S9AYB#3aZVK)0WizLY!*~+g8T>i>$yYf~6|WtwA60%c|JqhNp8*-^zG4 z$f379|`piBtDBxM6`fQ)l!Hz7l=+V2iFSvd7U+T63LtjvtWo-0AAc z+k~D6Vwy{nPNxO$7?!g+ayK(Tr!RQ-{GRs$uL@zWr`<1hL^M1eGA+Kj_(tt(QD3ZQ z_TLEJw%v5YP`6WZ`mBmClRK5|-m@#&;IqHxw(j>?xr$-wy`#=tUp23yJ!$yW+ttT~ z@2(x&;0e^fX-@mRW!1#*p-GXqR{U-aBb%{#-@Y^Go0Cxs6vM9U>~yxM2aK8Kohh~U z*eRq<8>%capMFb7>%9Fh)9^2XG9r`He{Z;z@xs%dj>9WYuFZZ}p&T~UYHIspXVBl3 z?@JX+joa@Odl<)x3UQmjqK z7(8a()xxQvzGK_{e60|f+;;YI$H|7U44rdDQ%9zzc4QArnLqGsJU1cu`u$FmyV?*E z=`6bDb*j3(I?G;M6Km?e`~!n#rdWOMB+lRrXh>gob9q>WreLgCe6BjGqR2va{?Jlw z4$B`u+ap{EnqrH$R~G(!>J%Sr9p+g#=F82C1-`s>@8t-koxY(mm}o9T4M>ag4Cib7{$U373Heg#yD6Vw}mlUGbB zIa^h`!DsMyEAm~e9-cH}{!>kNPco`Lk6P~I+z_jdQ5p-1elvS(ql}s>_dCCHTo8sB z8r!X>N*cnFZ=R_9S$8K$oqV9}s5?Vv+!9%ODbIa*D}D#oa_t-2E@_P_ectKCjt#A9 zMZ+|2(>On)*uJdc>4wNJYipy1^lkH#TgwMLAC{a)?GV{QtYadUF?kWObnoucW444T zr(&+t^#aqWyaC4){Xe!Irc~Kh#MCa^jhNo$c^Ff$Y!hOx{XICMM*VLaNorg^*hoG| zA^R=Gy%TgTq#H@aQdsuOa08TixW!Rts#3<*nO2LjyjZ7n)`?D&Nv~~FnQO!vWvpLh zgX0?{r_LcZIYmbe-YYox!!9wluDmsPg}BZs<~EAFBeq6znqrlv=@)sGZ-rQ8 zs;Y~vGWlvuS>Vsy8VgQQqlWUVjN2+!@rhL;2!SC{o1={v9aW|{phTN_P>j`}sHj%V z0nayTEM~d!8gaAI#p9>495wMy&rc#^yG&-Mn8(MuOd#(x$D#=2*ST`cN^@0C4sUje zX3^{nb}Cz4%B4=FBPYhuAVuq5tTVZos$HT>*$aXZi{n8Cy{QtN=$F!^jH@x3dBn_C zGYHZ)X@`{wb&ak9vl3TX#ny<<=mc5=y>J1=SEpoFpodAy*c_FEkCl{8zNJpAt`mpL z-Bc#kMbs!)C?k2TS=4P39bnK>qeQ#0{5n?Egf>i7T5VN~OX*}|P)eKBp_EFjsz&Ej zf&=tX98;ytX>`|!g}lj?;#Y_{7*-Q>fH(7IXWc6pwnh`ASR=A=Ai!!f>l%11 z`r(Xr)Wuhs5c7&ul*%RuB0AP&MqaWG?9@12%1m%YJB{wwL9t@>x+-N%tTG2fKQtCN zd|Yc429j5q>l(l%Z{Ca^nzD2dpwp6EV|9v7$egMslu8LJ1G_9!M0{R^eDSI{ls+`b zmH)aPmWa3ch_n2^JrK0u!2|Iih3psDdp-W!v%)Ujwc`!l%+k^wksY%lmgi1*Y~ch~ z?TW^j+gqM1wfh<`+|SqV*(HqL@!_6*>vqI8EO@qVW7ha@59~fPbIal_4ZU@`$>-+W zzIo@7^_zsp_e?5H+;M5ogg0OH)yytV+_-Pqfw2`^`W)MsU-2`&lS(%=JvXy(@Uniw%!o<*KH8K}GDj$hxikL!tO#M! z@REHSU&^eX88PwM} z4xOv$JQWA%1_%dW3m`kqu$>?~0KEY)Pvw0cEJWEkNB6mOzUvM!1E@XQ7XWi#cC1l{ z9i1b40(t<(0Q7)#Kslfh-~~_{mhOf61Ns1F0xSRxm`_A#0?_^DV!#~$-6New*#v}` zSL;I}ZfgEbjcDNm8}>m8_-6z=RV&P@!cxgZB*JjX4lCgqJ(Yl#FidAwxx9OCpqJ4H zun*B%`F0+DruUhlq=}bErUd3idNreuCyYCfkwgw|Bn5mAxJy&Q_9x)cN>&Z?$hC3? zG#Ix9;#Jsy+>L3_g16-?pDkJ-OVq>NuMC+gAt8$RA)0`V@v=;)9eY%13~{*85^oTh z9kT-h&xyp*jOug{Sw9Kjb8@kqDd)2pUGse6$EK@W55hy*K@v86-Izwgix?Ch*W|Mj zF-kl>rOKw;Ql_A@b!Cd;B%@(Op1~(MVAF5Uu%dIk$uHkz)FGcg6TyAAHvCWcLMszM z+q8MyK|prQT`dXS7*S7DA|nyW?No{yB5EX@?Qt`-Q7kiV4M7tmeTqne(9=S20Z%Q% z2ht!E`IkIF4FyCTMf(rg`LPqtXs~#pg0xi;eUzfQIj9)-K_M^-xXa%0itq?6Rrtkn zCDHQc z*nF`V2LkU^J9X)37!#E)V*?g3XOeO=9w@70K)f_Jpr@VVBxYD8ksQ4xa#m`F1T+eC zp2HX=L+GiHh(ydO(5BI1_ShVWZlEEpsTl15a}jzLVD!PawCHib0nRl6H@BiYWs9@& zF4}coVl3d+)xba&7;iZGC1i^@GHIoIOnxBYGr;{UzFC2RX)KiYa|E8#|NYvH7Cd-P zAEc1|f4p|XkKKqYI*u+&B`oWhFA%ST=QBj|EII+1rTSkeb6VNeaJ)J^ez z4u@;4gx!S}29x~Vl2vfc0?QweM5GhDksb62)?UYy5;G3B-Xfx#lA zcL03w7-*JvlLjL2?t~Nx9%DyFrbMj88LkvwGt@0f*349BW~JWFU}qpfPFbuph)+q= zP9RdDL^hcu>p45>GrJ&1d3k-3YwH6RoVC#~V^k!l&%61mYxq zX`{;#BPn1kqLVHn?bW+dC3_YzAw%G$c?ypM_4#Z}iy7#^U{fX#sc+X1ao2#?ZUWWV zqapW>2n2tKlO{N;=t5MFRf$FTP%$Hac{B_0mjJzg>5YdGjw=*KBC-RTOqDzl@H7Yv zMi^e#^~UJ=mqW=x+<)E!D<+*e=)(66;KUP?U%*iy!GOM0q4& z^<18;$cJO|07q`4q7He{aWO>wDt?U$PtqDZJq1{qsYCAvsC+ZLhA#srdvFXH_M(H( z1v6tv2F8CoW@^ zUJE83n+Cao-)VVWM>*>;6PSQU1-=69{sVG!RAb>Uhg^_HCyA>cF|s4<(<`8djyqB? zX{-n)9B`MTeD`op{!;8?SPG#K{uy|6CyaiQWJ4CzKqv+M%fQ7!ERs67n`{^?#Y46F zMJy4S!K5Iz>!`eda&mqMx$rYbYLnFDDG2`9IJjwmTZW>4!Fu@y3N!XqUVd{*j}X(@ zo*vbs&b+_QMvxDe;DrF%qTbT?tuFE?UP}(J_mU?$46AH7Sy8;_493T#kgv6#l>Y%@8e6e$PO2HL;L+c zMzbHpkx3YjZIJoiUYJ-h-cJ-mchKh1)= zHP}{ZSn@LZHYEsSgf#u^Vd$F}E9m$q?_-Sm3gmT^g+smy2qNZu0ZGPl(g?ZHqxFAL znWLTsP!Ak4Lh5wAhI8k=X0YVOQxD14t2aE!5aW^(vKjP8qFe<0h_Ose!z=n7A>?vR zPa=M+AaPKVFF!DlQShYZpuZRL7-EO9@Rg4x%?YSGT##RIOhf%7=;OQFlq9>zEIZim zAnyfqEOa4wc?^zo@Dh4bAv;3*p$sZOc7fko#6t@i*$Lej>D2wa>}bxOH;+uu#+i!l zXc%XP=*xv|(9xyn=hG{Cl3)5kx2GqN6?i@-gGL{=KKgzvphpgp`*dFd!l7W^4Orm!~oZTgzgVWhx}lM*9f4nWZVd}b_} z4DbGZ)W@Sr4z>tn0p#@%=7+z2D<-}FgiO)*xADd&24i&%{ir~C1-$WFTf33R(6^Bo zz!%Y(&l#3H+aE6(Ho{2_8ebpPlbL-O`Q_H)eHbdpI1O#Qk8%1A&+a(P;y;4t1uq!M zqVd7> zXFW&Wgza+$dQyoxKmFB<hH+Ajq!aSCrf7OBgsv?S=jy*PiFm=OP)lZ z%x4tj!ce@VKz!>B7zEFm0o3xQ5?5Yy^^Oqu|JH2{>sgAfX2aEupQ`P7X zt0SqHH`zCWsloIgZd$#v7f2k9@5=168b|j1;&}o(}0YX#V#d7r8*S zFzgx9q}}ChFuO={f%}#ZU!6wkNrNlb$Bu}!GVQ!~gJQH_U-ya!U!5u<-TRAnOFmZp zQgUE@=7mk{)Z>**C$3zvO+O3D%TBYYGun5JIpTS*ik%%v3ffPZZG&5VT5ZuRGf&Ka34eTk||YNO-~s-p-CH5lWAvDbQ6j4(3W2CNPjr5cRPJEFCyg@K@`qR25< zYNo_@80w1hH0~fAQgJRH=+A9uw?Y|?;rIyi@a-T0$2?+Zby#TSPO^(lR~*P0Y1NyD zh$eR7yj{87BH|KOk+e(SW!#4tVwJWd?D!FAu}bxty`qoj|H4+1(Ps8Dm$1hoV-<_v zd}2b0{*pHRXbIDpVpno3k`r#XEk9GF@Jh8#_kDlTDMcIx!&q>(3NLH$3>!<%;+5qn zV|@2%7x9sg+k^gcRb+NH7|jPoqMG8%wR^7Si{22q%!f)P6=!mFDfaKTcl}2!Ikjn= zfew=#J)YVm3Jv<}H7r%s5-P@f8`p@b*NV9t`Ls3f zNNhKbvFbic7FHT>vf*tMXie^Bz9_`UOZ$;k|ADB(uy;n_hm-~mK+l<+?I9;hU5Qty zLH*7k(rt=@cKk^e4?s`s$nEgeK-X8oNu`zOHj>vj>kp7@!=^s2rhu^zH=W+%TB-;w z9Wlkswn5V$&x7?XwA3qmLgF-3(9F&O`2bKPXa-zlMMFi2%d5QvXx_r>>79z8{zw&wMUY z{4S~_CNpb>=2ZO_J%if|J{X#fqM%4 zN;ib;&zV^Nk>{Fmu8R5L#NO>ry=%MTi3VdN#&5Dus{OaB{4+!mrhV;|D#5vOm#w2F z7^~3V3ey5&{N<$!$b#}74i;bK{Qw#p*YO$~54b(-=0smyV8M%;49sIu&_4SU5~W{uR>Ix0U>vn+%l$=Rw{H z1B(ppV^P@pr^CMoTk3nD6JVioDHE21J$@s zQR7EWEpuFA+=MiOL0Ba*SPr5;{y<*pn-11?4)S5K7SlTt@8fApKswq2?(G9n7F6u> zxeQ^!viJc*=`80(0Z-)D5B}qr8owdGZxK&}_Nf4Su^HhACY`a}Pwa?01sEHi7<|@5 zZ!!hx2BPg^0QL*wG#LHKWq)Tv*TfQ}e_exe?Q^`C9fmfK!kB49pAN!6JB9cUSd6jm z=nFiHp;Kh68g~p({}ph@Al}Cq@GsN$!_N$%SxG09>(o_-S7bLBeiVs(hPq#a-4%7F zljcv9c`)YBGQ_2KHYi(d?1OPFhxmjt%}_%mxxkW-_6tc5ut#V<{_Ge{LIxpz7uY!n z^!2tVPnMl-xP5e)acr&(eIZ5j;F$ZCWQK_1g) zL#&6tvj%ZcrgIqMeUW}axC?oJa23{*(MbaSE)5lLDO)_F5MmrUiN1106^I|k$!*ZC zB)ajxxZ4})YCc9f^zBQSt3j7p;(r4#n2dC?1gXf z34J+^I8aDHkYum`;TUJrjrirppD-6NZmg&?Wmiw3)9X-<@ozcvFY}TSzs?79A7L|) z{_aeydtK2MC`UWgqXY8W3XDkL4FsLOpx%$V(h1!c?w?RT3%t7#_F#{I_(Y>U5PlEi zZx+H;i1%r|2Y*NBI@Y9Ggq=q@rqp1ag8KyAA+U#`K3@W#zC2#N9cwf$t+exH$sOQp zf%hRy7~;`8ER?KVzeGX{!QZc3<8DfFxx(8w!=GEGc z=(~PsBMH{h!4O?=nQ2Wr?jgZH4P!G4?fe_k?m@ao?Ql{FTu6sx9I(Cyemd%KMvd_U zdewIf|2pqyFK}zP+?FBsC+pB(+dw-Cv9b^H8;kVxwP6A3-w)~Uhd5p!Q&D^D8#rD8 zZpSY$r?EG$L%IbpqoHW>B+|{r{AfVD280>PM6HV$bR%mPF`9iy^G^{&qSRZte<*Y0 z72A0F861)Y6x-BSn)^7l5x)dod?c|zF83?eYV#AFJ*i?FQ#HqUb@bbw8jvPjDwdBu zl-;GHg$kIog*adE?E~XN_$(hQ20! z>|AdjD$w)F9J5(VLXp~`%rQxPJS_d3wJfOJ3U$&{5`QLG!i5gr`Os?KHc+nZo?Y7i zZ)J{Enjvq;`999HGTRNq5~*UFs_o*fRI!bRSj)O0;-+_cP zw)33@20t9Bc3#bldEd{@E4GO_aHdI_9V+?ysO@9Se zPn9`ZyFq!#A+h+}_WtiSDRbn;9osu0a-K~3NrBJMZ{h?GzrQ@qh~EHrD03tURGDM) zQ)P}~sA*x^n0duE>O~!(%rW5^WsV8XuD*Q(LN_rMD7J~rdt6Uy@XHBNhO^d+nkHqA z%u%s-mx(pW>LB4V#&3E#bT~5Nw*K>__4XiPX+YBQV23hCYkA}pdnWqZ5S6?mXB!mT zMDCwH#dd3;K$`&_j$-ztST;3c{|-BpIifji&H?WZ5%gT}sJz}bxgdg9Y-68XAlCaU zC0A@v=9sX^lJ5n~t)KF|=?0EJa$$F~TrfRsr@L}Sr*i}oHZtZb36kQ*|4Tij_UG>kl#g z1|dhkQlcTiSkyN5d4i{#rF%QdRlh79O|R(R*`Ok2;9YeQvz52Hxcue0p3 zVBsvI{;^3=v(!Jkeq4g!#xeg${f1A>!dq5p*gT9)s@SHy%r^d5pP?-k+uZT@e&CNA z;`~>Hhq8x1i$`CNVCS08eAODwhpY%4e+q6$H-bkY!uf+1%IfTi~qk))#x`Kv3~ zI=K`1-qmppy)$^jrG3GU{C6tZGIA_`O8lA{d82aEQO5w_?Kt9iLqtWT|01jxwl2{Y zY|S{PEsFFb*=L9IZ+^C}2_r8}$2D*8Vqc*kce5crpxnbpI@k{SW3w*-!wHyi*up!Z z@mG{$D_@BC2t!n|Z8yVT;ZZ)@O=?(fl1hnFD?kXI~4T;PjzgcGkHzpV5jL7>(fG4Vz?t9jd(%s19th| zF=rBMaIiG*k5v+U;w3l10<1z`Av<0vz)6%l6KNY+FS2hjSXH<;uSPk%^kn$JAd-xG z?*~Oe{MVy_s2{q47bpD+!S;PBBvQ2BUF2~Y?Gp;x8`##Ds?nzhvq^5bmb{HLaWlZK zp)o>G|3nXW(ls=Zd=55d9O9egy-6*2pGm;cXi>h|YO(}aQ zfTc?w&5H;alH}G+h=ORJDR6JVF)o^zOw{2T9Kyhzkgul<=S5SkiX}@>_h|H2Fv4rm zw&pLvYNPEJBCe+$tUfeAq@nIz;CDmA|1f7TuSY%#?f4qx%D+&KVW5LsCp)tzl)u_t2pPU{@^I1%{W=rzI>Gz_QRXwf7b*KpO5&!g$cG<_$a&D+ zS1F0-?*jfg#XZPHZtd|!3Yfh+p{;zxM34N;NWT*8vjV^J%Rr;RB!npur_ZZ$@($YS z<$RQT9!@|IK6|x@9ELp2JlLXUWfZI+Hd3gYX0fM;y|#=ACk3Re7t1SmO74Yzc^m9H`XUKfchDihiTL^j_xqo=C%P*F zk`w1ce*8qlv%VKFZua72ds1~cnV?A^Bko~7fcO3j<906Eg#KQD=P@7tN48>+w@;P} zSy_v+XStJJ=*KM?XulB{^YfKtvI%uY{nQHt#5FaZ+}gme|xQs0YMKPP|b&cDI@<3oHY?CZET_4Qho^unC`4)Z!)&hkGX8;kOYs+{>BhrW)* zX$#uO1ABu4^&E_{okYG}e|09es@zD49&3C1F=SJ007)yu@x@(;$o;S$4Zz%6At1XD z=7+X;4e3^{2qIqtYYWm-B`oyo+zRw>ZW2qzqxAWYyRpf4;F;2sm!X1Et2pRF)Iqc5fb`vWNgU&fOPL<5E1Ns1P~D{T6MZ`u?H0qjL`S)8S1yy5D+i4h~=Xy zv+E%u_;gj)Wp&YUVe##b@=<_nr%uT>mcB_g;JHqYQjoY|?#6^}Rp5+i=#p zqJ0N>lfHL}Ssf{l%w~lNh2V}e?YJc=t_@B(XLJv0yG+$MzS{2_Yy>ecZY0viHZo!cJU@EB9MHrXo(B_l6J;-98N_9({Un1 zDr=`R>Q$WtyC5RicCKPZzvpM0N_8Qo?yraL%P;ZGbBf=&{aH57oFbmt-L}d#e=lWf zFCG0--}U9s{q$VDK2cyCmk-^S`b(8!+}|&#haMlnF=%vL{ZvFC<}uwSe`QVToT2x_ z)hCDuTIhS93O*{^aPms`>6iVouZqp%dQcI;esdXEy>I=v+)38>=-D^ak(}NkB9uc! zfL==RnXNI4!YAeO{ZoIrm2^fV)3Ew700etqO36%l^(OXk2B zvXUo{;B7#1;xE^|^#2!(} zXN?urg$~`9%n`AyZNmIwDY#?CPhVcI-pnla^fyTBt%1U&KDtTgE?KGW%culO0YgW?^d=Euo$1~c+b$|1 zl>Byu>^7q_6O_D&kRdCbVTc;vQ7|cBeW8)02oA{3Bp7%RL4F}2+f=e=`N5e~M6h?c zCZ2sOiqo!{IpJf72#1!ArXoV^%^B8|e-(4N*j#Z$2*fOZ_aY zO7BZW1lu(#BCM6^&z*q2_mk`W^LP>AtBnENO!?SIp=66c1}jE3ukT$wf$DpIN4CDN ztV;hq>b$+kzLl|@ry_!Fad))BiGwrkhtE~KEc3(Xd1mhP%d%iSgrF#l-)#Tv#<2+n zSLA+?m9Kql7G7H~y?J4VLqsSkBWXPnzG*2URCs!?!z0q$LVD5YgtHgDqQc^lz{9f) zRkTF+L}`ylLflfla%Ewbi6JJ8P*5pW*}cIY0U zylM@a;C+ONv6rsXIi9A;kk>KnLAMZp8}_iiz@|FDFU3IaL0rmf8DVhgfILL{mw@Ao z_!`i_dhl`mvNhO{*cqyk1!HEAgp10AI03@dZ#y{N5&WCu0NR&-o3>&u) zNx!)a;Siw=SoHGIPd+%gLlwM|9j{+eV-n|yrU&pvm|T?C0-on(#BD&l&S=*5B^VwE zzX#k!XzO2rowpm}%p9=SNIwVs#8%KcAZ}0KPeIu`AlwIGTDT_wcPIQ`BAu!$nhWk? z@X_E7`HNWz@MF{xL?s=8@iAS%~48!%+P z!jJnh5K{FJ&bbU0|Wot3y_HTOHx^| z(~)^P?6YW3SJ3lv9O^d)BdiO?SMNS(GvK_B4BSv>sI?-bQ#jrUyM89)PfF^zQ}O=obF#q()D6Pp@sisy)wb<3=`;#W2V zs@VC_jSUby1BAtL?R6W&I0;qiVb?k0*+D3ja|sAxQzX&WbkR~p_(Ypr-lvFVx(VyI zr}eSPRBVna+M40Cq8)OV+ixtQxfAEWOi7u5T_Ta2>|9w8C8-loW~Wk>T&-S=IOP(u z&(hzM8M1+kt`{6$xXH;a0n$5lU^@j+6u=z zoAfAH>V5zsj*>l~x)jI_%nxUU^MA|HlM26(YDskImV7ACsgWpy>>P>6I-!bI+fUFe zkjhThMY884p_If-6AD4%I01@k46-gm3GuT-JjuzeCPv-Qrb4QElyG@lrkC3_cdo+< z((6?>v^4A`UXd7Ot>2EU&-hfM9|Apt4p-w{1C9ChbP-g1@ z=V+95$8grLEoF`#k#@O-8s`9r*)#rAq}R)6i$|Mm7SspHaT?AE_6sEyAtH}lIwsK2C)N_?E30$y zT>TY>>FI{nq{+{^Nvv~eG0yLHPMtd#kN43EXEhmb@#99W=HB9F3O{j1OWArbtgX;f zJyZ2jj?;;@w9H&P_S9=~6PXY@=Lez0=(FkVkLRK8{Mce#+$5aOPh1>&_e4)LD{A`6 z!cFt68}bE?p}B#3l@;1O$#sx^6W-}rITZEk{kZT>2Xw|8PQu?kO?pO;2PiJla--1& zIOt2x3LL(}$QrzlkZ6N-t`CxLaQ>2pXhjH8zr!W_Et}UsA^~&^8>$h;rSU1z%?Wk$C6RT=` z9B(tPP>blev6)L*w_-0$RIV&|AWEpWa6;CtB5nb#sV~Z^zZ^unN4V810O?WZ8c)m~ z$ttW9$OA_#POnR%D^pNsC$~y3wRIaDUgKlbINWDuVF1}us+gYIHmc%|KkFkglIYl^ zfEW{MI~`jXzgXw^%O}Nw-YWwKc~|of+br%63na&}gujmMW~2}&2w2ng@DIhdFc5z1 z2K)z5?A|>0hiK$K`0pXMC0E45j=(Fzcpdg_Yyl@=FUImrmtqeXx>OItR)Q5B&yKOB z!p5${|2iQ3Fpuwo{GIZ5VE=&dhcIuoad0h}aQ}#<{U~gD4_A*k^c1QO(k(=Ru*>tO zTK5r-KVpZ;kmBS4Ta^WIx}uD9i&7)aXw-*p(F@_H_c^KR^-9$5Q@Dp9ECzND_`AVv zg?lM5Xp>bT>`mAaFxU-wg%gvo1!FfSzaZXss2ly5`512OJmd<}(T}}>aN{tY=n+US zOB{y37KH(c7!V&2{0H2Nu-73iibE!X7z=wY+6l4U>xOug+bscRDC&oU zVg3~G4U};v;vWSa)hGC7Ph8TPKGTHD~ApLisX<)oSD+A6%*ql};>1`buEO!JdRR+6a3DXzO6ULizzHFFhrqr<-7;`4hz3up>aD+&^Xc z-k|M|ifJaXY zZD?o89$kYGf<6lqZ4l`9L0gQl&w*2bwjB-Zd+^g=T>KtmfwKA6V0t5LD&h`6p7dTf zJ;e?|*a?)0UPSm7^-F|b28>|PH^E$?b%7ZJx*Pl%pbvy;gwX+$ULc5uJr(&-cF-Sj zx&t=}m>bbSM`0JC9Q_f#3Pu3`FvPnA_bV{xL0g2eH5Tp#2!9oJCj4roT?&6WOehRx z`!M`SD6l_4ez^a^zb&E4Yka^Dr=V?KLRlzlT!c9Dk3!{SI}{L)!D8gY)En2{s39lnFncW{|fK zHXWut+C2wxIfM^IK2*(cf20$_{tIOo2&@Lsz?JigVRB)Mfnz`$i~{W=`29d{gq!~2 z5Dt|2uR|HYI0o8An0FCIPgTdj-356(ggc6c!%bCipM!fA%3TB79~h5eCj*nJ|Golu z9?Y9aa|2;*VSfN~4sN_$0W2hKd?mkGNFHvOV>AK~~kBabg&=<8JaYssr4Szor zG~yo|4Ms2i91WEf{4eQKP=F|3LcNpt%CG3({#Y?|wqqUbv^g?1KAE)UyzHSJ8Qa z@Y^Xa{2#;6uabWvY(COmgeif00MhNj{9FLq6QrGr_0J%?PS!OevKH3c$1KZo{T&Jtuxa0fd3cJ z@)1^zc6o?)nTIs=!XOR=$g7}9QSV@crvZNv{8aS2fU*pQF~dIu`E5sA3o{6wWFnv)DDbn{w9^Sy~iTLzV+kDs)V5k@w0{?$u zLu7kiT{Z2P<_DI|KH&ae)Kyn>)$7OV2n%wIHOizQFaR-|+@9L3*FKCn;wOJ)o(&Mm{LA zp~lk?EEhSY42mz5j!c~`Qut=xhmz_V+fl)U`S(RieVDwjR8g!G`(}k1Ykjk~R>e!F z?jDxpHT^(Ct^Y`9%2nl>8f{|V`eBRO&a-c_$p+lqB!9X4`o z-_Xq^3CCsIDso&p?XYY*-f2wbnI)ayv+eKeP+YxRpSINNLwmkH{P5lCfnD1?e&DKg z6?ztFUE?0u#7E?weRR%YrXthQxkf(|9!2t-R8;=RL1$S zdOc2jbHz*9caIEJ>VL27+uJqn`d5m-v_Zv@ieSc|-z$lfcNTUe3Gw2#7DIwdmxrW} zET;TeA6=+P;34lKckk@6FTy>^d&~iwU_d!rm885?R@T@5Yg<`J+Z~=u!`dxtIK{SS zX7}+?i@a7Qr>S%v{il^@p6Q8!_UGlvN`~A1(D7RYS_pi(Run@a|J) z>V7O>ciw%jTVHv;OLX|P`c*ymUbCMcZEWyZojR^0X;gH1JGtH7oA)mWmNi^YmCkF}CLFyYzDU}>tiR?<&G^9@QRgB8lKA@dbQ>_+nqarT*O`XSkE zis#m4|5{_X$nFl)k8QWDS7rQ^cj9xeDEH5Rt=cCZO1{sX}hmg_LuId8c{gy zy#>On5&Ht-OQyf?ope?4!R1GFGY<7Cy~-Zm@z6HYzs7Wg{p6^<@2uSm8?Mf>iGH=Q z)v_K{ZZ+P=Tso)J7>>%msjObrUFr+<;_cclQb}foe3zedv$1mh_!E0Jjb~5BOkSVU zKh9}F-kHJu-gfT$IAy}vnnRoV=`T!}C!2eEx4GZkHrb;K1y}cZ2o_>4Yv|!tS zcHeeqC(d71Vk($_qipns1>bGD_=TX&i8nXAvUm5fiLd@x_H#R@kv8(J;(nE)bm7lO z^)J7+;L^J!=GTS~t7MbgruTpS$=8+b-*CNFzp=CLpGOug4rj&Pfb$jeoAe*UMUBL9JQ(4@H6fU&V-S?OqWWLwmZ75QiQio4z`;Gm$pC)p_)Ho1}JTF;LIzo795Q{x8?P1g4r5tP){JB0h44zY$!48JOX3XEM!A8Y% zLf8SGS208*Htzt+YAXVPO^2(6b?&}reOj@y8$UwhPz9ijUzC_MKZ;^+v zJgFvt4P)4VL{$JM$>-Fz&;((;(4FxLtWgIF10)i2v0f+-Smu$ayl$4ejR~>5Uo6pc z1}N{5q!9N+==YH~S{Mn*FHVAbqT)UlV;`ZuSZ$HyNFjk0m=CI7m_T0BTy2U z;QoVjlq7%?=3J0u5XEYVB@D`Y@+HH7MYSebR373nfyI?|sX`(04}hv2hzROrISv<+ zC0v>IlnWh8RGW)QVnAZ)zP|E?Vr{WHM8dH0G_Cx&gyE8EYkvK zh!h7|$Wl3;wp5owZxNIT)CAdIiEcSb z;MBtCcsVO{58ka8`r3B~qD`FDb?(7nqyC5aMCTEhQ(n3SGtJK_Fi5=AOXm=sUtqNO zxdrBm|1v}87??O-`uBwmA&7ER&(9}HY@SceJ_P?`J_&Vop;=1931=s3Mv3!nrKddN z#(E>iXi9QV=b1j5m^zDbIkV|)L3R9{^}6NG zRnl&5+FDD&@|ZiqfR^+IvC24$X&IkG;tJhme-*|fE)%u_l%NG;WBLhy?xHvD9K{Ed=~66SVfhArZ@ z(pc+!n`A84iFy^Bi2rV@dHI4`rSW*o8yTS)CH*Hu>x5p-Wt1|tVY#-L+v;35?aJU0 zL$pq7b2;B2WyXoRiHd&*&P~BcmVGxzgw_!i=TNcgl=% zol{AglpM9XFORP!nIz(vDzC&j%s02Zf2}g3Wa=?x#%f(dg?zd14NHMrtVU^4#eP>Y z$AhgS!)h6681%QT87|SCR9+VysJ9b!WcZ;~=`%s!-Q)QG4bE?R2(S}r{asBToi|Qjfs4`CIzEF}= zy4%V;w}@IxhF)i{$U7B{UJ_Kt7ztM&{hd-cWWeP0o?K6-(zBfIy9#qjg43n~eFRq` zsMdY2@*EOsBpIh-ZdVwk5qByuMZ8(x-#aEtb4_VE(_YTa$j+LP=50V|2&;6;m_8+A zT2?0Uc7czbqJ8SnJ#|Dpb#!~`hW7xNyyg`f_xngmd zMTr`uIHknCpk3YuYoMNft9Sgvi{@5BTf<%+)Dm0g!2WZrV&yo^@*rS8&`;i$`E$TO zu%8cY4cq#9OY8^-_FYfK9Z!w*bzpnku~qL%asLPQ^P#O_7q4Vmf_HO(7lkVxcF}+a z^z~DAMJ-qp^bhpsLt8`t{qtwgBOU0QRf>Zu4QN2W7<2cy{i5n0=+B3?hQ9yWGw9tN z=*K-2kK`KAfIcnNX;{V@&wrplAKDuF_IuBuM>){XNfe(rX+Q&dw`KQ!jkh`f1O55X z*3fT0d!|Bk&oL)Nzex~pK%E8o9)pGSW_v^Dgdho3=@aiCw2D6UB~paDI1SI^%2 zHh=9+_e)qGX3XgxlKOfo}{Gkia!Z%IT<%Nu5 zb0MPv85ulkm%XRDy7NCWcs{hX46a;lvCPnwys7-&ioM<%5CNZF7kIcE_s?PZd}wR% z#rFaKbXCOm;6ShLs<_lu0~(gZRQa5yMGym~g|9UW!%{8_qTC=Y;v`eL;mSt;Nnl7|e+-a);4QNwwq}t4z zHv3vbv+aEbt!XKG&_PiYssRmXUHY{|YxcEpfxQue?}=vduTudnhlJ1Gg`B+HMGrT;+E~!w6uKIPEp@Z0~*kBATczfHTzma zd+^>fXiZDWB^SkQ7Y%4Y!`W~Pv}RvxXqOH@gVwZkR8bSE0TFP`y6|abn|-apHAXg~xUKAyCIYxcDU_vrMqa80vfe^*6qR}F}OYu0?k&x&R}NUgBB zpO~Fn4&#WXS+QTIsMTpe1YGkgXA0NsYprzo?>`IIG%NON6}4Ioh=6N;5kcXaeXYUO z-FOzRX;xhCp!l(a21LL$-?XD}&A!&)4lZ?hrm{`5;&!y+Nwfw;z%_pbqHxW=*5E2@ zo`q|g6{RwTRi*(EaLq@G6t3CV8eIM9XW^P=g#!*mz%`$!P`GAaD{zX(-?%{f0Y#~t zl`}a!&6Ea_HJq1T!{=t@eR^8@bi_jPtgyhR$bqr1zV=$!-w0E*&51K-&7leY-_z<|AZ^48r0wYV=dx^##+R` zA8Qj{Bgz3yj9ix)IqD|PPpu2rX~T8u(DXS|re~_tqGK{AMNf)}=@yY5l{G0Us#~{A pZIm`DCab$PBPP8^Ob=~(R(htcBM#beb@u