Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP finishing Feature/ra #9

Open
wants to merge 55 commits into
base: feature/ra
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 52 commits
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
d86ad05
Bimp gems
jsuchal Feb 22, 2017
e8a2bcc
Add datahub connection config
jsuchal Feb 22, 2017
b2d2b03
Initial working example job
jsuchal Feb 22, 2017
e61a940
Add test coverage & better test reporting
jsuchal Feb 22, 2017
177ea38
Add badges
jsuchal Feb 22, 2017
4d89101
Merge pull request #2 from slovensko-digital/data-upvs-edesks
jsuchal Feb 22, 2017
8b9a173
Bump gems
jsuchal Feb 22, 2017
115cc05
Add instructions
jsuchal Feb 22, 2017
cd6c99e
Add docs badge
jsuchal Feb 22, 2017
a580a00
Add code coverage reports
jsuchal Feb 22, 2017
df103f9
Add code coverage badge
jsuchal Feb 22, 2017
5c8c8d1
Add staging config
jsuchal Feb 22, 2017
3502c9c
Normalize quotes
jsuchal Feb 22, 2017
7022f05
Add newrelic
jsuchal Feb 22, 2017
89a34e8
Add newrelic gem
jsuchal Feb 22, 2017
a0fa76f
Add upvs to open data
jsuchal Feb 23, 2017
15fbcf7
Migrate after deploy
jsuchal Feb 23, 2017
d382c3b
Add license
jsuchal Mar 2, 2017
1a10eb4
Update license formatting
jsuchal Mar 2, 2017
11ec000
Update formatting
jsuchal Mar 2, 2017
8e46428
update gems + Ruby to 2.4.1
istana Apr 22, 2017
ad04caf
Merge pull request #7 from istana/4/update-gems
jsuchal Apr 24, 2017
133218e
Bump ruby version for dokku
jsuchal Apr 25, 2017
17e11ed
Remove .ruby-version, use Gemfile
jsuchal Apr 25, 2017
c866336
Specify version of ox gem
eronisko Apr 30, 2017
49bb8b5
Fix when ChangesBatch is recorded
eronisko Apr 30, 2017
b16ebb5
Fix parsing of municipality changes
eronisko Apr 30, 2017
87bff91
Adding consolidated model stubs
eronisko Apr 30, 2017
4502b67
Add relationships from changes to consolidated model stubs via objectId
eronisko May 1, 2017
064d3e7
Added most of other relationships between change models and consolida…
eronisko May 2, 2017
850ec8e
Fix associations of street name changes with municipalities & districts
eronisko May 2, 2017
a715e0b
to_i -> Integer()
eronisko May 2, 2017
e920f6a
Separate out change_id to reference Ra::Change. Use own primary keys
eronisko May 3, 2017
7d8b135
DRY-up Ra:RecordBuilder
eronisko May 3, 2017
59c5f93
Unified codelist models and tables
eronisko May 3, 2017
716ee58
Remove commented-out puts calls
eronisko May 4, 2017
6125c1f
Added timeout to Ra::FetchChangesBatchJob downloader
eronisko May 4, 2017
a064cae
Ensure Ra timedate data is in Bratislava timezone
eronisko May 4, 2017
4250eee
Test for BuildingNumberChange.street_name_id
eronisko May 4, 2017
da5ff8e
Remove pending tests for dumb models
eronisko May 4, 2017
9f0e515
Only schedule missing batches for download
eronisko May 4, 2017
df76532
Ensure Ra::ChangesBatch is not created when there's an error
eronisko May 5, 2017
6cf1bed
Wrap Ra::FetchChangesBatchJob#perform in a single transaction
eronisko May 5, 2017
2d4af04
Shallow testing for change_id and city_id in Ra::MunicipalityChange
eronisko May 5, 2017
c9ab4d2
Merge remote-tracking branch 'upstream/master' into feature/ra
eronisko May 5, 2017
263dbd7
Merge structure.sql with master
eronisko May 5, 2017
c6e2973
Remove unique indices from code in _codes tables
eronisko May 6, 2017
217315b
Ra::SyncChangesBatchesJob should fail on failed HTTP calls
eronisko May 6, 2017
bc39f0a
Add indices to Ra::StreetNameChange{Municipality,District} join tables
eronisko May 6, 2017
7b29764
Consider Codelist items optional
eronisko May 7, 2017
af4e9c2
Set backoff timing to default for Ra jobs
eronisko May 8, 2017
9f62108
Add effective_on column to ra.municipality_changes
eronisko May 13, 2017
e17f1ad
Do not set time zone on app level
eronisko May 23, 2017
7774ffd
Replacing Harvester::Utils with HarvesterUtils::Downloader
eronisko May 23, 2017
0f502d3
Job and Rake task for importing initial batch for address register
eronisko May 23, 2017
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -15,5 +15,8 @@
!/log/.keep
!/tmp/.keep

# Ignore coverage data
/coverage

# Ignore Byebug command history file.
.byebug_history
25 changes: 18 additions & 7 deletions Gemfile
Original file line number Diff line number Diff line change
@@ -1,14 +1,15 @@
source 'https://rubygems.org'

ruby '2.4.1'

# Bundle edge Rails instead: gem 'rails', github: 'rails/rails'
gem 'rails', '~> 5.0.0', '>= 5.0.0.1'
gem 'rails', '~> 5.0.2'
# Use postgresql as the database for Active Record
gem 'pg', '~> 0.18'
gem 'pg', '~> 0.20'
gem 'activerecord-postgis-adapter'

# Build JSON APIs with ease. Read more: https://github.com/rails/jbuilder
gem 'jbuilder', '~> 2.5'
gem 'jbuilder', '~> 2.6'
# Use Redis adapter to run Action Cable in production
# gem 'redis', '~> 3.0'
# Use ActiveModel has_secure_password
Expand All @@ -20,24 +21,34 @@ gem 'faraday'
gem 'clockwork'
gem 'sidekiq'
gem 'sidekiq-symbols'
gem 'foreman'

gem 'typhoeus'
gem 'nokogiri'
gem 'ox'
gem 'ox', '2.4.12'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nejaky speci dovod preco fixujeme verziu?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ta povodna (2.4.3) mi nesla skompilovat a najnovsia (2.4.13) ma nejake zvlastnosti s whitespaceom. Ak je to problem, mozem sa na to neskor pozriet a nechat to bez verzie.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rozumiem, beriem.


gem 'puma'
gem 'newrelic_rpm'

# Use Capistrano for deployment
# gem 'capistrano-rails', group: :development

group :development, :test do
# Call 'byebug' anywhere in the code to stop execution and get a debugger console
gem 'byebug', platform: :mri
gem 'byebug', platforms: [:mri, :mingw, :x64_mingw]
gem 'rspec-rails'
end

group :test do
gem 'simplecov'
gem 'codeclimate-test-reporter', '~> 1.0.8'
gem 'rspec_junit_formatter'
end

group :development do
# Access an IRB console on exception pages or by using <%= console %> anywhere in the code.
gem 'web-console'
gem 'listen', '~> 3.0.5'
gem 'web-console', '>= 3.3.0'
gem 'listen', '>= 3.0.5', '< 3.2'
# Spring speeds up development by keeping your application running in the background. Read more: https://github.com/rails/spring
gem 'spring'
gem 'spring-watcher-listen', '~> 2.0.0'
Expand Down
222 changes: 126 additions & 96 deletions Gemfile.lock
Original file line number Diff line number Diff line change
@@ -1,171 +1,192 @@
GEM
remote: https://rubygems.org/
specs:
actioncable (5.0.0.1)
actionpack (= 5.0.0.1)
nio4r (~> 1.2)
actioncable (5.0.2)
actionpack (= 5.0.2)
nio4r (>= 1.2, < 3.0)
websocket-driver (~> 0.6.1)
actionmailer (5.0.0.1)
actionpack (= 5.0.0.1)
actionview (= 5.0.0.1)
activejob (= 5.0.0.1)
actionmailer (5.0.2)
actionpack (= 5.0.2)
actionview (= 5.0.2)
activejob (= 5.0.2)
mail (~> 2.5, >= 2.5.4)
rails-dom-testing (~> 2.0)
actionpack (5.0.0.1)
actionview (= 5.0.0.1)
activesupport (= 5.0.0.1)
actionpack (5.0.2)
actionview (= 5.0.2)
activesupport (= 5.0.2)
rack (~> 2.0)
rack-test (~> 0.6.3)
rails-dom-testing (~> 2.0)
rails-html-sanitizer (~> 1.0, >= 1.0.2)
actionview (5.0.0.1)
activesupport (= 5.0.0.1)
actionview (5.0.2)
activesupport (= 5.0.2)
builder (~> 3.1)
erubis (~> 2.7.0)
rails-dom-testing (~> 2.0)
rails-html-sanitizer (~> 1.0, >= 1.0.2)
activejob (5.0.0.1)
activesupport (= 5.0.0.1)
rails-html-sanitizer (~> 1.0, >= 1.0.3)
activejob (5.0.2)
activesupport (= 5.0.2)
globalid (>= 0.3.6)
activemodel (5.0.0.1)
activesupport (= 5.0.0.1)
activerecord (5.0.0.1)
activemodel (= 5.0.0.1)
activesupport (= 5.0.0.1)
activemodel (5.0.2)
activesupport (= 5.0.2)
activerecord (5.0.2)
activemodel (= 5.0.2)
activesupport (= 5.0.2)
arel (~> 7.0)
activerecord-postgis-adapter (4.0.0)
activerecord-postgis-adapter (4.0.3)
activerecord (~> 5.0.0)
rgeo-activerecord (~> 5.0.0)
activesupport (5.0.0.1)
activesupport (5.0.2)
concurrent-ruby (~> 1.0, >= 1.0.2)
i18n (~> 0.7)
minitest (~> 5.1)
tzinfo (~> 1.1)
arel (7.1.2)
builder (3.2.2)
arel (7.1.4)
bindex (0.5.0)
builder (3.2.3)
byebug (9.0.6)
clockwork (2.0.0)
clockwork (2.0.2)
activesupport
tzinfo
concurrent-ruby (1.0.2)
connection_pool (2.2.0)
debug_inspector (0.0.2)
diff-lcs (1.2.5)
dotenv (2.1.1)
codeclimate-test-reporter (1.0.8)
simplecov (<= 0.13)
concurrent-ruby (1.0.5)
connection_pool (2.2.1)
diff-lcs (1.3)
docile (1.1.5)
dotenv (2.2.1)
erubis (2.7.0)
ethon (0.9.0)
ethon (0.10.1)
ffi (>= 1.3.0)
faraday (0.9.2)
faraday (0.12.1)
multipart-post (>= 1.2, < 3)
ffi (1.9.14)
globalid (0.3.7)
activesupport (>= 4.1.0)
i18n (0.7.0)
jbuilder (2.6.0)
activesupport (>= 3.0.0, < 5.1)
ffi (1.9.18)
foreman (0.84.0)
thor (~> 0.19.1)
globalid (0.4.0)
activesupport (>= 4.2.0)
i18n (0.8.1)
jbuilder (2.6.3)
activesupport (>= 3.0.0, < 5.2)
multi_json (~> 1.2)
listen (3.0.8)
json (2.1.0)
listen (3.1.5)
rb-fsevent (~> 0.9, >= 0.9.4)
rb-inotify (~> 0.9, >= 0.9.7)
ruby_dep (~> 1.2)
loofah (2.0.3)
nokogiri (>= 1.5.9)
mail (2.6.4)
mail (2.6.5)
mime-types (>= 1.16, < 4)
method_source (0.8.2)
mime-types (3.1)
mime-types-data (~> 3.2015)
mime-types-data (3.2016.0521)
mini_portile2 (2.1.0)
minitest (5.9.1)
minitest (5.10.1)
multi_json (1.12.1)
multipart-post (2.0.0)
nio4r (1.2.1)
nokogiri (1.6.8.1)
newrelic_rpm (4.1.0.333)
nio4r (2.0.0)
nokogiri (1.7.1)
mini_portile2 (~> 2.1.0)
ox (2.4.4)
pg (0.19.0)
ox (2.4.12)
pg (0.20.0)
puma (3.8.2)
rack (2.0.1)
rack-protection (1.5.3)
rack
rack-test (0.6.3)
rack (>= 1.0)
rails (5.0.0.1)
actioncable (= 5.0.0.1)
actionmailer (= 5.0.0.1)
actionpack (= 5.0.0.1)
actionview (= 5.0.0.1)
activejob (= 5.0.0.1)
activemodel (= 5.0.0.1)
activerecord (= 5.0.0.1)
activesupport (= 5.0.0.1)
rails (5.0.2)
actioncable (= 5.0.2)
actionmailer (= 5.0.2)
actionpack (= 5.0.2)
actionview (= 5.0.2)
activejob (= 5.0.2)
activemodel (= 5.0.2)
activerecord (= 5.0.2)
activesupport (= 5.0.2)
bundler (>= 1.3.0, < 2.0)
railties (= 5.0.0.1)
railties (= 5.0.2)
sprockets-rails (>= 2.0.0)
rails-dom-testing (2.0.1)
rails-dom-testing (2.0.2)
activesupport (>= 4.2.0, < 6.0)
nokogiri (~> 1.6.0)
nokogiri (~> 1.6)
rails-html-sanitizer (1.0.3)
loofah (~> 2.0)
railties (5.0.0.1)
actionpack (= 5.0.0.1)
activesupport (= 5.0.0.1)
railties (5.0.2)
actionpack (= 5.0.2)
activesupport (= 5.0.2)
method_source
rake (>= 0.8.7)
thor (>= 0.18.1, < 2.0)
rake (11.3.0)
rb-fsevent (0.9.7)
rb-inotify (0.9.7)
rake (12.0.0)
rb-fsevent (0.9.8)
rb-inotify (0.9.8)
ffi (>= 0.5.0)
redis (3.3.0)
rgeo (0.5.3)
rgeo-activerecord (5.0.0)
redis (3.3.3)
rgeo (0.6.0)
rgeo-activerecord (5.0.1)
activerecord (~> 5.0.0)
rgeo (~> 0.3)
rspec-core (3.5.2)
rspec-support (~> 3.5.0)
rspec-expectations (3.5.0)
rspec-core (3.6.0)
rspec-support (~> 3.6.0)
rspec-expectations (3.6.0)
diff-lcs (>= 1.2.0, < 2.0)
rspec-support (~> 3.5.0)
rspec-mocks (3.5.0)
rspec-support (~> 3.6.0)
rspec-mocks (3.6.0)
diff-lcs (>= 1.2.0, < 2.0)
rspec-support (~> 3.5.0)
rspec-rails (3.5.1)
rspec-support (~> 3.6.0)
rspec-rails (3.6.0)
actionpack (>= 3.0)
activesupport (>= 3.0)
railties (>= 3.0)
rspec-core (~> 3.5.0)
rspec-expectations (~> 3.5.0)
rspec-mocks (~> 3.5.0)
rspec-support (~> 3.5.0)
rspec-support (3.5.0)
sidekiq (4.1.1)
rspec-core (~> 3.6.0)
rspec-expectations (~> 3.6.0)
rspec-mocks (~> 3.6.0)
rspec-support (~> 3.6.0)
rspec-support (3.6.0)
rspec_junit_formatter (0.2.3)
builder (< 4)
rspec-core (>= 2, < 4, != 2.12.0)
ruby_dep (1.5.0)
sidekiq (5.0.0)
concurrent-ruby (~> 1.0)
connection_pool (~> 2.2, >= 2.2.0)
redis (~> 3.2, >= 3.2.1)
rack-protection (>= 1.5.0)
redis (~> 3.3, >= 3.3.3)
sidekiq-symbols (0.1.1)
sidekiq
spring (2.0.0)
simplecov (0.13.0)
docile (~> 1.1.0)
json (>= 1.8, < 3)
simplecov-html (~> 0.10.0)
simplecov-html (0.10.0)
spring (2.0.1)
activesupport (>= 4.2)
spring-watcher-listen (2.0.1)
listen (>= 2.7, < 4.0)
spring (>= 1.2, < 3.0)
sprockets (3.7.0)
sprockets (3.7.1)
concurrent-ruby (~> 1.0)
rack (> 1, < 3)
sprockets-rails (3.2.0)
actionpack (>= 4.0)
activesupport (>= 4.0)
sprockets (>= 3.0.0)
thor (0.19.1)
thread_safe (0.3.5)
typhoeus (1.0.2)
thor (0.19.4)
thread_safe (0.3.6)
typhoeus (1.1.2)
ethon (>= 0.9.0)
tzinfo (1.2.2)
tzinfo (1.2.3)
thread_safe (~> 0.1)
web-console (3.3.1)
web-console (3.5.0)
actionview (>= 5.0)
activemodel (>= 5.0)
debug_inspector
bindex (>= 0.4.0)
railties (>= 5.0)
websocket-driver (0.6.4)
websocket-driver (0.6.5)
websocket-extensions (>= 0.1.0)
websocket-extensions (0.1.2)

Expand All @@ -176,22 +197,31 @@ DEPENDENCIES
activerecord-postgis-adapter
byebug
clockwork
codeclimate-test-reporter (~> 1.0.8)
dotenv
faraday
jbuilder (~> 2.5)
listen (~> 3.0.5)
foreman
jbuilder (~> 2.6)
listen (>= 3.0.5, < 3.2)
newrelic_rpm
nokogiri
ox
pg (~> 0.18)
rails (~> 5.0.0, >= 5.0.0.1)
ox (= 2.4.12)
pg (~> 0.20)
puma
rails (~> 5.0.2)
rspec-rails
rspec_junit_formatter
sidekiq
sidekiq-symbols
simplecov
spring
spring-watcher-listen (~> 2.0.0)
typhoeus
tzinfo-data
web-console
web-console (>= 3.3.0)

RUBY VERSION
ruby 2.4.1p111

BUNDLED WITH
1.12.5
1.14.6
Loading