Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Have Docker use the makefile to build the base environment #504

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Have Docker use the makefile to build the base environment #504

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
760b11e
Ok, it builds most of the dependencies out of the Makefile now
NCommander Jun 27, 2023
ea98e4d
Ok the environment builds properly out of docker now when using the M…
NCommander Jun 29, 2023
ce6b138
revert change on how main.cf is handled
NCommander Jun 29, 2023
ca52b77
Actually fix main.cf
NCommander Jun 29, 2023
b1dbca4
handle perl version
NCommander Jun 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
141 changes: 20 additions & 121 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,17 @@
FROM ubuntu:22.04 AS rehash

# Control variables
ENV REHASH_REPO=https://github.com/SoylentNews/rehash.git
ENV REHASH_PREFIX=/srv/soylentnews.org
ENV REHASH_ROOT=/srv/soylentnews.org/rehash
ENV REHASH_SRC=/build/rehash
ENV REHASH_PERL=${REHASH_PREFIX}/perl/bin/perl

# Perl version needs to be set here. This is also in the Makefile, but
# for bare metal installs, DBIx::Password is done interactively. However,
# for automated installs, we need to manually drop it into the right place

# Bad things will happen if this number, and the one in the Makefile are out of sync
ENV PERL_VERSION=5.36.1

# Mail smarthost
ENV ENABLE_MAIL=false
Expand All @@ -22,26 +29,12 @@ ENV MYSQL_DATABASE=soylentnews
ENV MYSQL_USER=soylentnews
ENV MYSQL_PASSWORD=soylentnews

ENV PERL_VERSION=5.36.1
ENV PERL_DOWNLOAD=https://www.cpan.org/src/5.0/perl-${PERL_VERSION}.tar.gz

ENV APACHE_VERSION=2.2.34
ENV APACHE_DOWNLOAD=https://archive.apache.org/dist/httpd/httpd-${APACHE_VERSION}.tar.gz

ENV MOD_PERL_VERSION=2.0.12
ENV MOD_PERL_DOWNLOAD=https://mirror.cogentco.com/pub/apache/perl/mod_perl-${MOD_PERL_VERSION}.tar.gz

# rehash uses its own Perl, make we need to define that
ENV REHASH_PERL=${REHASH_PREFIX}/perl/bin/perl
ENV REHASH_CPANM=${REHASH_PREFIX}/perl/bin/cpanm

# Open ports
EXPOSE 80

# for ipn
EXPOSE 2626


# Unminimize the image since Perl's test suite requires it
RUN apt-get update
RUN yes | unminimize
Expand All @@ -51,102 +44,16 @@ RUN DEBIAN_FRONTEND=noninteractive apt-get -y install build-essential libgd-dev
RUN apt-get update && apt-get install -y locales && rm -rf /var/lib/apt/lists/* \
&& localedef -i en_US -c -f UTF-8 -A /usr/share/locale/locale.alias en_US.UTF-8

WORKDIR /build
RUN wget ${PERL_DOWNLOAD}
RUN tar zxf perl-${PERL_VERSION}.tar.gz
WORKDIR /build/perl-${PERL_VERSION}

RUN ./Configure -des -Dprefix=${REHASH_PREFIX}/perl -Duseshrplib -Dusethreads
RUN make -j8
#RUN make check
RUN make install

# Build Apache 2.2
WORKDIR /build
RUN wget ${APACHE_DOWNLOAD}
RUN tar zxf httpd-${APACHE_VERSION}.tar.gz
WORKDIR /build/httpd-${APACHE_VERSION}

RUN ./configure --prefix=${REHASH_PREFIX}/apache --enable-mods-shared=most
RUN make
RUN make install

# Build mod_perl
WORKDIR /build
RUN wget ${MOD_PERL_DOWNLOAD}
RUN tar zxf mod_perl-${MOD_PERL_VERSION}.tar.gz
WORKDIR /build/mod_perl-${MOD_PERL_VERSION}

RUN ${REHASH_PERL} Makefile.PL MP_APXS=${REHASH_PREFIX}/apache/bin/apxs
RUN make
RUN make test
RUN make install
# HACK ALERT - We want to still support building rehash out of the Makefile
# sans Docker, but simply copying the entire rehash folder here will rebuild
# the entire dependency tree, so just copy the base makefile, which will prevent
# Docker from rebuilding the whole fracking thing unless the actual Makefile
# changes (which should be extremely rare)

# Install CPAN Minus to make scriptable install possible
WORKDIR /build
COPY utils/cpanm /build/cpanm
RUN ${REHASH_PERL} /build/cpanm App::cpanminus

# The tests fail on Docker due to a connection upgrade inline issue.
# This is probably good enough, and we shoudln't be depending on external
# servers during building unnecessarily

RUN NO_NETWORK_TESTING=1 ${REHASH_CPANM} Net::HTTP
RUN ${REHASH_CPANM} Apache2::Upload
RUN ${REHASH_CPANM} Cache::Memcached
RUN ${REHASH_CPANM} Cache::Memcached::Fast
RUN ${REHASH_CPANM} Data::JavaScript::Anon
RUN ${REHASH_CPANM} Date::Calc
RUN ${REHASH_CPANM} Date::Format
RUN ${REHASH_CPANM} Date::Parse
RUN ${REHASH_CPANM} DateTime::Format::MySQL
RUN ${REHASH_CPANM} DBD::mysql
RUN ${REHASH_CPANM} Digest::MD5
RUN ${REHASH_CPANM} GD
RUN ${REHASH_CPANM} GD::Text::Align
RUN ${REHASH_CPANM} HTML::Entities
RUN ${REHASH_CPANM} HTML::FormatText
RUN ${REHASH_CPANM} HTML::Tagset
RUN ${REHASH_CPANM} HTML::TokeParser
RUN ${REHASH_CPANM} HTML::TreeBuilder
RUN ${REHASH_CPANM} HTTP::Request
RUN ${REHASH_CPANM} Image::Size
RUN ${REHASH_CPANM} JavaScript::Minifier
RUN ${REHASH_CPANM} JSON
RUN ${REHASH_CPANM} Lingua::Stem
RUN ${REHASH_CPANM} LWP::Parallel::UserAgent
RUN ${REHASH_CPANM} LWP::UserAgent
RUN ${REHASH_CPANM} Mail::Address
RUN ${REHASH_CPANM} Mail::Bulkmail

# Disable tests on Mail::Sendmail because it works by sending an email to the author
RUN ${REHASH_CPANM} Mail::Sendmail --notest

RUN ${REHASH_CPANM} MIME::Types
RUN ${REHASH_CPANM} Mojo::Server::Daemon
RUN ${REHASH_CPANM} Net::IP
RUN ${REHASH_CPANM} Net::Server

# Time::ParseDate is a dependency of Schedule::Cron but has test problems
#
# This fails in Docker due to possibly missing tiemzone data, but rehash
# assumes and expects to be running on UTC so bypassing the test failure

RUN ${REHASH_CPANM} Time::ParseDate --notest
RUN ${REHASH_CPANM} Schedule::Cron

RUN ${REHASH_CPANM} SOAP::Lite
RUN ${REHASH_CPANM} Sphinx::Search
RUN ${REHASH_CPANM} URI::Encode
RUN ${REHASH_CPANM} Template
RUN ${REHASH_CPANM} XML::Parser
RUN ${REHASH_CPANM} XML::Parser::Expat
RUN ${REHASH_CPANM} XML::RSS
RUN ${REHASH_CPANM} Email::Valid

RUN ${REHASH_CPANM} Crypt::CBC
RUN ${REHASH_CPANM} HTML::PopupTreeSelect
RUN ${REHASH_CPANM} Twitter::API
COPY Makefile /build
COPY utils/cpanm /build/utils/cpanm
RUN make build-environment ENVIRONMENT_PREFIX=${REHASH_PREFIX} DO_APACHE_CONFIG=0

# DBIx::Password is ... uh ... not easy to deal with.
# Just copy in a pregenerated version
Expand All @@ -157,11 +64,14 @@ RUN mkdir -p ${REHASH_PREFIX}/perl/lib/${PERL_VERSION}/DBIx/
RUN sh make_password_pm.sh ${MYSQL_HOST} ${MYSQL_DATABASE} ${MYSQL_USER} ${MYSQL_PASSWORD} > ${REHASH_PREFIX}/perl/lib/${PERL_VERSION}/DBIx/Password.pm
RUN adduser --system --group --gecos "Slash" slash

# Copy in the rehash source code
# Assuming we have everything build now, we're ready to install rehash now
ADD . ${REHASH_SRC}/
WORKDIR ${REHASH_SRC}

# Copy in the rehash source code
RUN make USER=slash GROUP=slash PERL=${REHASH_PERL} SLASH_PREFIX=${REHASH_ROOT}
RUN make USER=slash GROUP=slash PERL=${REHASH_PERL} SLASH_PREFIX=${REHASH_ROOT} install
RUN make ENVIRONMENT_PREFIX=${REHASH_PREFIX} stamp/append-apache-config
RUN cp ${REHASH_SRC}/httpd/site.conf ${REHASH_ROOT}/httpd/site.conf

# Create the slashsites files
Expand All @@ -184,16 +94,5 @@ RUN chown slash:slash -R ${REHASH_PREFIX}/rehash
RUN chown slash:slash -R ${REHASH_PREFIX}/apache/logs
RUN chown slash:slash -R /srv/soylentnews.logs

RUN echo "KeepAlive on" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "KeepAliveTimeout 600" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "MaxKeepAliveRequests 0" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "TraceEnable Off" >> ${REHASH_PREFIX}/apache/conf/httpd.conf

RUN echo "LoadModule apreq_module modules/mod_apreq2.so" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "LoadModule perl_module modules/mod_perl.so" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "Include /rehash-prefix/rehash/httpd/slash.conf" >> ${REHASH_PREFIX}/apache/conf/httpd.conf
RUN echo "Include /rehash-prefix/rehash/httpd/site.conf" >> ${REHASH_PREFIX}/rehash/httpd/slash.conf
RUN echo "LogLevel Debug" >> ${REHASH_PREFIX}/apache/conf/httpd.conf

COPY conf/postfix/main.cf /main.cf
CMD /start-rehash
Loading