-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathREADME
executable file
·36 lines (27 loc) · 932 Bytes
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
takibi is 3 layer epub generating framework.
1. Model: like Rails, the layer of access to database.
2. Parser: Web fetching, Scraping, dicing, and slicing layer
3. Formatter: to make epub, compose epub article HTML from parsed data.
takibi Framework does as follows:
1. Fetching WEB articles specified by Parser.
2. Store parsed article to database.
3. Compose HTML as specified format of Formatter
Requirement:
libxml2-dev, libxslt-dev for nokogiri
ex)
aptitude install libxml2-dev libxslt-dev
1. Setup
gem install nokogiri
gem install sequel
gem install log4r
gem install uuid
gem install zip
gem install msgpack
gem install mechanize
2. example
2.a: crawl registered rss
./takibi --action crawl_rss
2.b: crawl articles of rss feed
./takibi --action rss
2.c: compose epub
./takibi -f jbpress,nbonline -d 3d -a epub -o `date +%Y-%m-%d`.epub