Skip to content

Commit

Permalink
chore: update deps for feature store demo (#12897)
Browse files Browse the repository at this point in the history
Signed-off-by: TennyZhuang <[email protected]>
Co-authored-by: TennyZhuang <[email protected]>
  • Loading branch information
xxchan and TennyZhuang authored Oct 18, 2023
1 parent de2b856 commit d7e5772
Show file tree
Hide file tree
Showing 19 changed files with 1,891 additions and 1,409 deletions.
20 changes: 12 additions & 8 deletions integration_tests/feature-store/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
FROM rust:1.67 as feature-store-server
FROM ubuntu:20.04 AS feature-store-server
ARG BUILD_ARG
ENV DEBIAN_FRONTEND=noninteractive

USER root

Expand All @@ -9,8 +10,11 @@ RUN mkdir -p $WORK_DIR
WORKDIR $WORK_DIR

RUN apt update
RUN apt install -y python3 python3-pip wget ca-certificates
RUN apt install -y postgresql-client
RUN apt install -y lsof curl openssl libssl-dev pkg-config build-essential \
cmake \
python3 python3-pip wget ca-certificates \
postgresql-client \
protobuf-compiler

ADD ./server/model/requirements.txt $WORK_DIR/model-pipreqs.txt
ADD ./generator/requirements.txt $WORK_DIR/generator-pipreqs.txt
Expand All @@ -19,8 +23,8 @@ RUN pip3 install -r $WORK_DIR/model-pipreqs.txt
RUN pip3 install -r $WORK_DIR/generator-pipreqs.txt
RUN pip3 install risingwave

RUN apt install -y lsof curl openssl libssl-dev pkg-config build-essential
RUN apt install -y cmake librdkafka-dev
RUN curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- --no-modify-path -y
ENV PATH /root/.cargo/bin/:$PATH

# Install .NET 6.0
RUN wget https://packages.microsoft.com/config/debian/11/packages-microsoft-prod.deb -O packages-microsoft-prod.deb
Expand Down Expand Up @@ -49,11 +53,11 @@ ADD ./run.sh $WORK_DIR/run-sh/
ADD ./run-mfa.sh $WORK_DIR/run-sh/

RUN if [ "$BUILD_ARG" = "mfa" ]; then \
cp $WORK_DIR/run-sh/run-mfa.sh $WORK_DIR/run.sh;\
cp $WORK_DIR/run-sh/run-mfa.sh $WORK_DIR/run.sh;\
else \
cp $WORK_DIR/run-sh/run.sh $WORK_DIR/run.sh;\
cp $WORK_DIR/run-sh/run.sh $WORK_DIR/run.sh;\
fi

RUN chmod +x $WORK_DIR/run.sh && rm -rf $WORK_DIR/run-sh

CMD ["sh", "-c", "sleep 10 && ./run.sh"]
CMD ["sh", "-c", "sleep 10 && ./run.sh"]
16 changes: 12 additions & 4 deletions integration_tests/feature-store/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,9 @@ When a user needs to make a prediction using these features, they can provide th

1. Build docker. Kafka RisingWave and Feature Store.

```docker compose up --build```
```
docker compose up --build
```


The Feature Store system performs several tasks in sequence:
Expand All @@ -40,7 +42,9 @@ The Feature Store system performs several tasks in sequence:

2. Then we can get the simulation results for Feature store in `.log`.

```cat .log/simulator_log```
```
cat .log/simulator_log
```

# Account change feature store
#### Case Description
Expand All @@ -53,8 +57,12 @@ In this case, we need to calculate the frequency and count of user account chang

1. Build docker. Kafka RisingWave and Feature Store.

```docker compose build --build-arg BUILD_ARG=mfa```
```
docker compose build --build-arg BUILD_ARG=mfa
```

2. Then we can get the simulation results for Feature store in `.log`.

```cat .log/simulator_log```
```
cat .log/simulator_log
```
1 change: 0 additions & 1 deletion integration_tests/feature-store/docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,6 @@ services:
- "./mfa-start.sql:/mfa-start.sql"
- "./mfa-mock.sql:/mfa-mock.sql"
feature-store:
image: rust:1.67
build:
context: .
target: feature-store-server
Expand Down
Loading

0 comments on commit d7e5772

Please sign in to comment.