Skip to content

Commit

Permalink
[ISSUE-4351] Add github action for building (#4358)
Browse files Browse the repository at this point in the history
* add github action for building

* Revert "[WIP] Optimize geo module, the feature seems less be used (#4353)"

This reverts commit 29607c3.

* Revert "[WIP] Optimize geo module, the feature seems less be used"

This reverts commit 71abab0.

* cache thrift
  • Loading branch information
kevinjmh authored Oct 5, 2024
1 parent 29607c3 commit e0ac69a
Show file tree
Hide file tree
Showing 4 changed files with 58 additions and 29 deletions.
49 changes: 49 additions & 0 deletions .github/workflows/build-test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
name: Build Test

on: [push, pull_request]

jobs:
build:

runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
spark-profile: [ 'spark-2.3','spark-2.4','spark-3.1' ]
name: Build with spark-version ${{ matrix.spark-profile }}

steps:
- name: Checkout
uses: actions/checkout@v4
- name: Set up JDK
uses: actions/setup-java@v4
with:
java-version: 8
distribution: temurin
- name: Cache
uses: actions/cache@v4
with:
path: |
~/.m2/repository
/usr/local/bin/thrift
key: ${{ runner.os }}-maven
restore-keys: |
${{ runner.os }}-maven
- name: setup-thrift
run: |
if [ ! -f "/usr/local/bin/thrift" ];then
echo "build thrift binary"
sudo apt-get update -qq
sudo apt-get install -qq protobuf-compiler
sudo apt-get install -qq libboost-dev libboost-test-dev libboost-program-options-dev libevent-dev automake libtool flex bison pkg-config g++ libssl-dev
wget -qO- https://archive.apache.org/dist/thrift/0.20.0/thrift-0.20.0.tar.gz | tar zxf -
cd thrift-0.20.0/
chmod +x ./configure
./configure --disable-libs
sudo make -j4 install
else
echo "use cache thrift binary"
fi
- name: install
run: |
mvn clean install -DskipTests -Pbuild-with-format -P${{ matrix.spark-profile }}
18 changes: 0 additions & 18 deletions .github/workflows/github-actions-demo.yml

This file was deleted.

6 changes: 2 additions & 4 deletions integration/spark/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -145,8 +145,7 @@
</exclusion>
</exclusions>
</dependency>

<!-- <dependency>
<dependency>
<groupId>org.apache.carbondata</groupId>
<artifactId>carbondata-geo</artifactId>
<version>${project.version}</version>
Expand All @@ -156,8 +155,7 @@
<artifactId>hive-exec</artifactId>
</exclusion>
</exclusions>
</dependency> -->

</dependency>
<dependency>
<groupId>org.apache.carbondata</groupId>
<artifactId>carbondata-streaming_${spark.binary.version}</artifactId>
Expand Down
14 changes: 7 additions & 7 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@
<module>index/lucene</module>
<module>index/examples</module>
<module>streaming</module>
<!-- <module>geo</module> -->
<module>geo</module>
<module>integration/spark</module>
<module>integration/hive</module>
<module>integration/flink</module>
Expand Down Expand Up @@ -625,8 +625,8 @@
<sourceDirectories>
<sourceDirectory>${basedir}/common/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/core/src/main/java</sourceDirectory>
<!-- <sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory> -->
<sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory>
<sourceDirectory>${basedir}/processing/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/hadoop/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/integration/spark/src/main/scala</sourceDirectory>
Expand Down Expand Up @@ -701,8 +701,8 @@
<sourceDirectories>
<sourceDirectory>${basedir}/common/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/core/src/main/java</sourceDirectory>
<!--<sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory> -->
<sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory>
<sourceDirectory>${basedir}/processing/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/hadoop/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/integration/spark/src/main/scala</sourceDirectory>
Expand Down Expand Up @@ -776,8 +776,8 @@
<sourceDirectories>
<sourceDirectory>${basedir}/common/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/core/src/main/java</sourceDirectory>
<!--<sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory> -->
<sourceDirectory>${basedir}/geo/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/geo/src/main/scala</sourceDirectory>
<sourceDirectory>${basedir}/processing/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/hadoop/src/main/java</sourceDirectory>
<sourceDirectory>${basedir}/integration/spark/src/main/scala</sourceDirectory>
Expand Down

0 comments on commit e0ac69a

Please sign in to comment.