Skip to content

Home

Jump to bottom
Nthiki edited this page Sep 9, 2022 · 18 revisions

Running the project for the first time

Pre-requisites

  1. Install VSCode and get it running on your machine
  2. Install Docker on your machine

Getting started

  1. Clone the repo and open it in VSCode.

  2. Open the terminal in VSCode and make sure that you are in the folder: nlp-sdg

  3. Create a new python environment to host the project.

conda create -n nlp-sdg python==3.8.8 -y
  1. Activate your conda environment
conda activate nlp-sdg
  1. Since this is a kedro project, the first thing you will need to do is install kedro in your environment.
pip install kedro

The first time you do this, you may get some error messages about missing packages. This is expected, do not worry about them, the next step will install them.

  1. Now that you have installed kedro, you must install all the project dependencies.
pip install -r src/requirements.txt
  1. With all your dependencies installed, you can now build the docker container to house your kedro project.
kedro docker build

Here is some additional info regarding kedro-docker

  1. Now use the below command to run the dummy pipeline:
kedro docker run
  1. The pipeline will start running and you should see some logs on your terminal, here is some sample output:
image
Clone this wiki locally