diff --git a/CHANGELOG.md b/CHANGELOG.md index be3ef647..1fb8cb85 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,6 +1,56 @@ CHANGELOG ========= +0.16.5 (Nov 26, 2013) +===================== + +* Improved + * S3-API related + * [#103] (https://github.com/leo-project/leofs/issues/103) Able to change password on Manager console + * [#105] (https://github.com/leo-project/leofs/issues/105) Able to change an owner of a bucket + * [#106] (https://github.com/leo-project/leofs/issues/106) Rename *set-endpoint* to *add-endpoint* in order to unify it and other commands + * Multicast *update-acl* to Gateway's node(s) + * Multicast *delete-bucket* to Gateway's node(s) + * Other + * Revised that manage redundant nodes toward the multi data center replication + * Supported that manage previous and current members in a cluster in order not to happen lost data during the period of relocation of data + * Able to recover that Manager failed to send massage of relocation from Manager to Storage(s) + * Reduced costs of relocation of data than previous version + * [#98] (https://github.com/leo-project/leofs/issues/98) Made a bucket name compatible with the AWS-S3 naming rule of US-region + * [#99] (https://github.com/leo-project/leofs/issues/99) Able to set log-directory of *leo-redundant-manager* + * Supported Ubuntu-13.10 (include Ubuntu Server 13.10) +* Fixed Bugs + * [#94] (https://github.com/leo-project/leofs/issues/94) Happened an error when parsing XML document with S3's Java-Client + * [#95] (https://github.com/leo-project/leofs/issues/95) Could not resume storage node + * [#96] (https://github.com/leo-project/leofs/issues/96) Happened an error when Gateway is requested from *boto* + * [#97] (https://github.com/leo-project/leofs/issues/97) Could not upload an object when including a bucket name in a path + * [#100] (https://github.com/leo-project/leofs/issues/100) Broken records after update from 0.14.9 to 0.16.0 + +* Used libraries + * leo project + * [leo_backend-db v0.14.1](https://github.com/leo-project/leo_backend_db.git) + * [leo_cache v0.4.14](https://github.com/leo-project/leo_cache.git) + * [leo_commons v0.14.8](https://github.com/leo-project/leo_commons.git) + * [leo_dcerl v0.2.5](https://github.com/leo-project/leo_dcerl.git) + * [leo_logger v0.12.5](https://github.com/leo-project/leo_logger.git) + * [leo_mcerl v0.2.7](https://github.com/leo-project/leo_mcerl.git) + * [leo_mq v0.12.21](https://github.com/leo-project/leo_mq.git) + * [leo_object_storage v0.14.7](https://github.com/leo-project/leo_object_storage.git) + * [leo_ordning_reda v0.8.17](https://github.com/leo-project/leo_ordning_reda.git) + * [leo_redundant_manager v1.2.3](https://github.com/leo-project/leo_redundant_manager.git) + * [leo_s3_libs v0.12.21](https://github.com/leo-project/leo_s3_libs.git) + * [leo_statistics v0.14.6](https://github.com/leo-project/leo_statistics.git) + * [leo_gateway v0.16.5](https://github.com/leo-project/leo_gateway.git) + * [leo_manager v0.16.5](https://github.com/leo-project/leo_manager.git) + * [leo_storage v0.16.5](https://github.com/leo-project/leo_storage.git) + * others + * [bitcask v1.6.2](https://github.com/basho/bitcask.git) + * [cowboy v0.8.6](https://github.com/extend/cowboy.git) + * [folsom](https://github.com/boundary/folsom.git) + * [jiffy](https://github.com/davisp/jiffy.git) + * [lz4 v0.1.1](https://github.com/leo-project/erlang-lz4.git) - forked from [szktty/erlang-lz4](https://github.com/szktty/erlng-lz4) + + 0.16.0 (Oct 25, 2013) ===================== diff --git a/THANKS b/THANKS index d96fe34b..01dc2018 100644 --- a/THANKS +++ b/THANKS @@ -2,7 +2,7 @@ The following people have contributed to LeoFS and/or one of the related librari THANKS ------ -Ryosuke 'Voluntas' Nakai +Ryosuke Nakai Masaki Matsushita Yohei Sasaki Jun Takizawa @@ -10,3 +10,6 @@ Nobuhiro Iwamatsu Loïc Hoguin Hitoshi Kuroyanagi Heinz N. Gies +Hiroki Matsue +Yoshinori Oe +Satoshi Egi diff --git a/bootstrap.sh b/bootstrap.sh index 7d1b906d..3246a3d2 100755 --- a/bootstrap.sh +++ b/bootstrap.sh @@ -39,6 +39,7 @@ package/leo_gateway_0/bin/leo_gateway stop package/leo_storage_0/bin/leo_storage stop package/leo_storage_1/bin/leo_storage stop package/leo_storage_2/bin/leo_storage stop +package/leo_storage_3/bin/leo_storage stop package/leo_manager_0/bin/leo_manager stop package/leo_manager_1/bin/leo_manager stop if [ $1 = "stop" ]; then @@ -54,6 +55,7 @@ make release cp -r package/leo_storage package/leo_storage_0 cp -r package/leo_storage package/leo_storage_1 cp -r package/leo_storage package/leo_storage_2 +cp -r package/leo_storage package/leo_storage_3 cp -r package/leo_gateway package/leo_gateway_0 rm -rf package/leo_storage rm -rf package/leo_gateway @@ -62,10 +64,12 @@ cp priv/test/app-m0.config package/leo_manager_0/etc/app.config cp priv/test/app-s0.config package/leo_storage_0/etc/app.config cp priv/test/app-s1.config package/leo_storage_1/etc/app.config cp priv/test/app-s2.config package/leo_storage_2/etc/app.config +cp priv/test/app-s3.config package/leo_storage_3/etc/app.config cp priv/test/vm-s0.config package/leo_storage_0/etc/vm.args cp priv/test/vm-s1.config package/leo_storage_1/etc/vm.args cp priv/test/vm-s2.config package/leo_storage_2/etc/vm.args +cp priv/test/vm-s3.config package/leo_storage_3/etc/vm.args ## launch if [ $1 = "build" ]; then @@ -80,6 +84,8 @@ sleep 1 ./package/leo_storage_1/bin/leo_storage start sleep 1 ./package/leo_storage_2/bin/leo_storage start +sleep 1 +./package/leo_storage_3/bin/leo_storage start echo ":::" echo "::: starting storages :::" diff --git a/leofs.mk b/leofs.mk new file mode 100644 index 00000000..23c9d4ae --- /dev/null +++ b/leofs.mk @@ -0,0 +1 @@ +LEOFS_VERSION=0.16.0 diff --git a/pkg/leo_gateway/Makefile b/pkg/leo_gateway/Makefile index 80bee6cf..c25ebb6b 100644 --- a/pkg/leo_gateway/Makefile +++ b/pkg/leo_gateway/Makefile @@ -1,4 +1,5 @@ -VERSION=0.14.9 +include ../../leofs.mk +VERSION=$(LEOFS_VERSION) COMPONENT_INTERNAL=leo_gateway COMPONENT=leo_gateway COMPONENT_PATH=../../package/$(COMPONENT_INTERNAL) @@ -17,8 +18,8 @@ bootstrap: cp files/start $(DIR)/erts-*/bin/start rm $(DIR)/etc/app.config cp files/app.config $(DIR)/etc/app.config.example - cp files/leo_gateway_snmp.config.0 $(DIR)/snmp/snmpa_gateway_0/ - cp files/leo_gateway_snmp.config.1 $(DIR)/snmp/snmpa_gateway_1/ + cp files/leo_gateway_snmp.config.0 $(DIR)/snmp/snmpa_gateway_0/leo_gateway_snmp.config + cp files/leo_gateway_snmp.config.1 $(DIR)/snmp/snmpa_gateway_1/leo_gateway_snmp.config mv $(DIR)/etc/vm.args $(DIR)/etc/vm.args.example package_list: bootstrap diff --git a/pkg/leo_gateway/files/app.config b/pkg/leo_gateway/files/app.config index e7e9ec4e..fe853621 100644 --- a/pkg/leo_gateway/files/app.config +++ b/pkg/leo_gateway/files/app.config @@ -31,15 +31,15 @@ {leo_gateway, [ %% System Ver - {system_version, "0.14.9" }, + {system_version, "0.16.0" }, %% Gateway Properties: {http, [ %% http-handler: - %% [rest | s3 | swift] + %% [rest | s3 | embed] {handler, s3}, %% Gateway port number: - {port, 9090 }, + {port, 8080 }, %% # of acceptors: {num_of_acceptors, 128 }, %% # of max keepalive @@ -51,7 +51,8 @@ {ssl_certfile, "./etc/server_cert.pem" }, {ssl_keyfile, "./etc/server_key.pem" } ]}, - + %% S3-API Properties: + {bucket_prop_sync_interval, 300 }, %% Large-object-related properties: {large_object, [ {max_chunked_objs, 1000 }, @@ -110,7 +111,12 @@ {log_level, 1 }, %% Output Access-log? - {is_enable_access_log, true }, + {is_enable_access_log, true }, + {is_enable_esearch, false }, + {esearch_host, "127.0.0.1" }, + {esearch_port, 9200 }, + {esearch_timeout, 10000 }, + {esearch_bulk_duration, 3000 }, %% Log appender - [file] {log_appender, [ diff --git a/pkg/leo_gateway/files/leo_gateway.xml b/pkg/leo_gateway/files/leo_gateway.xml index 57ead80d..60d474a0 100644 --- a/pkg/leo_gateway/files/leo_gateway.xml +++ b/pkg/leo_gateway/files/leo_gateway.xml @@ -47,7 +47,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_gateway/bin/leo_gateway %m' timeout_seconds='30'> - + @@ -62,7 +62,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_gateway/bin/leo_gateway %m' timeout_seconds='120'> - + @@ -77,7 +77,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_gateway/bin/leo_gateway %m' timeout_seconds='120'> - + diff --git a/pkg/leo_manager/Makefile b/pkg/leo_manager/Makefile index 19c81cec..44ca7500 100644 --- a/pkg/leo_manager/Makefile +++ b/pkg/leo_manager/Makefile @@ -1,4 +1,5 @@ -VERSION=0.14.9 +include ../../leofs.mk +VERSION=$(LEOFS_VERSION) COMPONENT_INTERNAL=leo_manager COMPONENT=leo_manager COMPONENT_PATH=../../package/$(COMPONENT_INTERNAL)_0 diff --git a/pkg/leo_manager/files/app.config.master b/pkg/leo_manager/files/app.config.master index 6e76cb7e..5196dbf3 100644 --- a/pkg/leo_manager/files/app.config.master +++ b/pkg/leo_manager/files/app.config.master @@ -34,7 +34,7 @@ ]}, {leo_manager, [ %% == System Ver == - {system_version, "0.14.9" }, + {system_version, "0.16.0" }, %% == System Configuration == %% diff --git a/pkg/leo_manager/files/leo_manager.xml b/pkg/leo_manager/files/leo_manager.xml index 285dbe31..d64e4d82 100644 --- a/pkg/leo_manager/files/leo_manager.xml +++ b/pkg/leo_manager/files/leo_manager.xml @@ -47,7 +47,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_manager/bin/leo_manager %m' timeout_seconds='30'> - + @@ -62,7 +62,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_manager/bin/leo_manager %m' timeout_seconds='120'> - + @@ -77,7 +77,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_manager/bin/leo_manager %m' timeout_seconds='120'> - + diff --git a/pkg/leo_storage/Makefile b/pkg/leo_storage/Makefile index 9979317a..a5eed465 100644 --- a/pkg/leo_storage/Makefile +++ b/pkg/leo_storage/Makefile @@ -1,4 +1,5 @@ -VERSION=0.14.9 +include ../../leofs.mk +VERSION=$(LEOFS_VERSION) COMPONENT_INTERNAL=leo_storage COMPONENT=leo_storage COMPONENT_PATH=../../package/$(COMPONENT_INTERNAL) diff --git a/pkg/leo_storage/files/app.config b/pkg/leo_storage/files/app.config index ae8e1c19..55317230 100644 --- a/pkg/leo_storage/files/app.config +++ b/pkg/leo_storage/files/app.config @@ -31,7 +31,7 @@ {leo_storage, [ %% == System Ver == - {system_version, "0.14.9" }, + {system_version, "0.16.0" }, %% == Storage Configuration == %% diff --git a/pkg/leo_storage/files/leo_storage.xml b/pkg/leo_storage/files/leo_storage.xml index a64c9d39..bbb97259 100644 --- a/pkg/leo_storage/files/leo_storage.xml +++ b/pkg/leo_storage/files/leo_storage.xml @@ -47,7 +47,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_storage/bin/leo_storage %m' timeout_seconds='30'> - + @@ -62,7 +62,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_storage/bin/leo_storage %m' timeout_seconds='120'> - + @@ -77,7 +77,7 @@ Copyright 2012 Project FiFo / Heinz N. Gies exec='/opt/local/leo_storage/bin/leo_storage %m' timeout_seconds='120'> - + diff --git a/priv/test/app-g0.config b/priv/test/app-g0.config index 309a8213..bfcbf1eb 100644 --- a/priv/test/app-g0.config +++ b/priv/test/app-g0.config @@ -3,7 +3,7 @@ %% %% LeoFS Gateway %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_gateway, [ %% System Ver - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% Gateway Properties: {http, [ diff --git a/priv/test/app-g1.config b/priv/test/app-g1.config index c4db9b03..36d88013 100644 --- a/priv/test/app-g1.config +++ b/priv/test/app-g1.config @@ -3,7 +3,7 @@ %% %% LeoFS Gateway %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_gateway, [ %% System Ver - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% Gateway Properties: {http, [ diff --git a/priv/test/app-m0.config b/priv/test/app-m0.config index 37a26968..3fdc9616 100644 --- a/priv/test/app-m0.config +++ b/priv/test/app-m0.config @@ -3,7 +3,7 @@ %% %% LeoFS Manager %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -35,7 +35,7 @@ ]}, {leo_manager, [ %% == System Ver == - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% == System Configuration == %% diff --git a/priv/test/app-s0.config b/priv/test/app-s0.config index 0ce1ae5d..1dfdc9c2 100644 --- a/priv/test/app-s0.config +++ b/priv/test/app-s0.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_storage, [ %% == System Ver == - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% == Storage Configuration == %% diff --git a/priv/test/app-s1.config b/priv/test/app-s1.config index 3d4ad8b0..17993716 100644 --- a/priv/test/app-s1.config +++ b/priv/test/app-s1.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_storage, [ %% == System Ver == - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% == Storage Configuration == %% diff --git a/priv/test/app-s2.config b/priv/test/app-s2.config index 9a5cd24b..97b3d53e 100644 --- a/priv/test/app-s2.config +++ b/priv/test/app-s2.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_storage, [ %% == System Ver == - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% == Storage Configuration == %% diff --git a/priv/test/app-s3.config b/priv/test/app-s3.config index 60c75331..145c80ac 100644 --- a/priv/test/app-s3.config +++ b/priv/test/app-s3.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -31,7 +31,7 @@ {leo_storage, [ %% == System Ver == - {system_version, "0.16.0" }, + {system_version, "0.16.5" }, %% == Storage Configuration == %% diff --git a/rebar.config b/rebar.config index 7b3f27cc..c5aa7920 100644 --- a/rebar.config +++ b/rebar.config @@ -23,9 +23,9 @@ {require_otp_vsn, "R15B03|R16B|R16B01|R16B02"}. {deps, [ - {leo_manager, ".*", {git, "https://github.com/leo-project/leo_manager.git", {tag, "0.16.0"}}}, - {leo_storage, ".*", {git, "https://github.com/leo-project/leo_storage.git", {tag, "0.16.0"}}}, - {leo_gateway, ".*", {git, "https://github.com/leo-project/leo_gateway.git", {tag, "0.16.0"}}} + {leo_manager, ".*", {git, "https://github.com/leo-project/leo_manager.git", {tag, "0.16.5"}}}, + {leo_storage, ".*", {git, "https://github.com/leo-project/leo_storage.git", {tag, "0.16.5"}}}, + {leo_gateway, ".*", {git, "https://github.com/leo-project/leo_gateway.git", {tag, "0.16.5"}}} ]}. {sub_dirs, [ diff --git a/rel/leo_gateway/files/app.config b/rel/leo_gateway/files/app.config index 7521c3fe..df1f82eb 100644 --- a/rel/leo_gateway/files/app.config +++ b/rel/leo_gateway/files/app.config @@ -3,7 +3,7 @@ %% %% LeoFS Gateway %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -122,7 +122,7 @@ %% Log appender - [file] {log_appender, [ - {file, [{path, "{{platform_log_dir}}/app"}]} + {file, [{path, "{{app_log_dir}}" }]} ]}, %% Directory of log output @@ -147,7 +147,9 @@ ]}, {leo_redundant_manager, [{profile, false}, {notify_mf, [leo_manager_api, notify]}, - {sync_mf, [leo_manager_api, synchronize]} + {sync_mf, [leo_manager_api, synchronize]}, + {log_dir_member, "{{ring_log_dir}}" }, + {log_dir_ring, "{{ring_log_dir}}" } ]}, {leo_statistics, [{profile, false}]} ]. diff --git a/rel/leo_gateway/reltool.config b/rel/leo_gateway/reltool.config index c358561e..323e6d12 100644 --- a/rel/leo_gateway/reltool.config +++ b/rel/leo_gateway/reltool.config @@ -3,7 +3,7 @@ %% %% LeoFS Gateway %% -%% Copyright (c) 2012 Rekuten, Inc. +%% Copyright (c) 2012-2013 Rekuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -68,7 +68,6 @@ {app, leo_gateway, [{incl_cond, include}]}, {app, bear, [{incl_cond, include}]}, {app, bitcask, [{incl_cond, include}]}, - {app, cowboy, [{incl_cond, include}]}, {app, erlastic_search, [{incl_cond, include}]}, {app, folsom, [{incl_cond, include}]}, {app, hackney, [{incl_cond, include}]}, @@ -88,7 +87,8 @@ {app, leo_redundant_manager, [{incl_cond, include}]}, {app, leo_s3_libs, [{incl_cond, include}]}, {app, leo_statistics, [{incl_cond, include}]}, - {app, mimetypes, [{incl_cond, include}]} + {app, mimetypes, [{incl_cond, include}]}, + {app, cowboy, [{incl_cond, include}]} ]}. {target_dir, "leo_gateway"}. diff --git a/rel/leo_gateway/vars.config b/rel/leo_gateway/vars.config index f4508497..eac54e20 100644 --- a/rel/leo_gateway/vars.config +++ b/rel/leo_gateway/vars.config @@ -3,7 +3,7 @@ %% %% LeoFS Gateway %% -%% Copyright (c) 2012 Rakuten, Inc +%% Copyright (c) 2012-2013 Rakuten, Inc %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -21,7 +21,7 @@ %% %%====================================================================== %% LeoFS system's version" -{system_version, "0.16.0"}. +{system_version, "0.16.5"}. %% Node alias name {node_alias, "gateway_0"}. @@ -106,17 +106,24 @@ %% == Directories == %% -{snmp_conf_dir, "snmpa_gateway_0"}. -{snmp_agent_dir, "{{platform_snmp_dir}}/{{snmp_conf_dir}}/LEO-GATEWAY"}. +{snmp_conf_dir, "snmpa_gateway_0"}. +{snmp_agent_dir, "{{platform_snmp_dir}}/{{snmp_conf_dir}}/LEO-GATEWAY"}. %% Directory of Mmneisa -{mnesia_dir, "{{platform_work_dir}}/mnesia"}. +{mnesia_dir, "{{platform_work_dir}}/mnesia"}. %% Directory of mq's db-file -{queue_dir, "{{platform_work_dir}}/queue"}. +{queue_dir, "{{platform_work_dir}}/queue"}. %% Directory of log output -{sasl_log_dir, "{{platform_log_dir}}/sasl"}. +{sasl_log_dir, "{{platform_log_dir}}/sasl"}. %% Directory of sasl-log output -{sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. +{sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. + +%% Application log directory +{app_log_dir, "{{platform_log_dir}}/app"}. +%% Directory of ring and cluster-members log directory +{ring_log_dir, "{{platform_log_dir}}/ring"}. +{members_log_dir, "{{platform_log_dir}}/ring"}. + %% Log output level %% 0: debug diff --git a/rel/leo_manager/files/app.config b/rel/leo_manager/files/app.config index ad82d0db..4ea97c95 100644 --- a/rel/leo_manager/files/app.config +++ b/rel/leo_manager/files/app.config @@ -3,7 +3,7 @@ %% %% LeoFS Manager %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -84,7 +84,7 @@ {log_level, {{log_level}} }, %% Log appender - [file] {log_appender, [ - {file, [{path, "{{platform_log_dir}}/app"}]} + {file, [{path, "{{app_log_dir}}" }]} ]}, %% == Directories == @@ -104,7 +104,9 @@ {leo_object_storage, [{profile, false}]}, {leo_redundant_manager, [{profile, false}, {notify_mf, [leo_manager_api, notify]}, - {sync_mf, [leo_manager_api, synchronize]} + {sync_mf, [leo_manager_api, synchronize]}, + {log_dir_member, "{{ring_log_dir}}" }, + {log_dir_ring, "{{ring_log_dir}}" } ]}, {leo_statistics, [{profile, false}]} ]. diff --git a/rel/leo_manager/vars.config b/rel/leo_manager/vars.config index 12cde29b..88a12fb8 100644 --- a/rel/leo_manager/vars.config +++ b/rel/leo_manager/vars.config @@ -3,7 +3,7 @@ %% %% LeoFS Manager %% -%% Copyright (c) 2012 +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -21,7 +21,7 @@ %% %%====================================================================== %% LeoFS system's version" -{system_version, "0.16.0"}. +{system_version, "0.16.5"}. %% Node alias name {node_alias, "manager_1"}. @@ -79,14 +79,18 @@ %% Directory of Mnesia {mnesia_dir, "{{platform_work_dir}}/mnesia"}. - %% Directory of mq's db-file {queue_dir, "{{platform_work_dir}}/queue"}. - %% SASL log related {sasl_log_dir, "{{platform_log_dir}}/sasl"}. {sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. +%% Application log directory +{app_log_dir, "{{platform_log_dir}}/app"}. +%% Directory of ring and cluster-members log directory +{ring_log_dir, "{{platform_log_dir}}/ring"}. +{members_log_dir, "{{platform_log_dir}}/ring"}. + %% Log output level %% 0: debug %% 1: info diff --git a/rel/leo_manager/vars/manager_master_vars.config b/rel/leo_manager/vars/manager_master_vars.config index 7651ba15..f3cbac3a 100644 --- a/rel/leo_manager/vars/manager_master_vars.config +++ b/rel/leo_manager/vars/manager_master_vars.config @@ -3,7 +3,7 @@ %% %% LeoFS Manager %% -%% Copyright (c) 2012 +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -21,7 +21,7 @@ %% %%====================================================================== %% LeoFS system's version" -{system_version, "0.16.0"}. +{system_version, "0.16.5"}. %% Node alias name {node_alias, "manager_0"}. @@ -79,14 +79,19 @@ %% Directory of Mnesia {mnesia_dir, "{{platform_work_dir}}/mnesia"}. - %% Directory of mq's db-file {queue_dir, "{{platform_work_dir}}/queue"}. - %% SASL log related {sasl_log_dir, "{{platform_log_dir}}/sasl"}. {sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. +%% Application log directory +{app_log_dir, "{{platform_log_dir}}/app"}. +%% Directory of ring and cluster-members log directory +{ring_log_dir, "{{platform_log_dir}}/ring"}. +{members_log_dir, "{{platform_log_dir}}/ring"}. + + %% Log output level %% 0: debug %% 1: info diff --git a/rel/leo_manager/vars/manager_slave_vars.config b/rel/leo_manager/vars/manager_slave_vars.config index 12cde29b..88a12fb8 100644 --- a/rel/leo_manager/vars/manager_slave_vars.config +++ b/rel/leo_manager/vars/manager_slave_vars.config @@ -3,7 +3,7 @@ %% %% LeoFS Manager %% -%% Copyright (c) 2012 +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -21,7 +21,7 @@ %% %%====================================================================== %% LeoFS system's version" -{system_version, "0.16.0"}. +{system_version, "0.16.5"}. %% Node alias name {node_alias, "manager_1"}. @@ -79,14 +79,18 @@ %% Directory of Mnesia {mnesia_dir, "{{platform_work_dir}}/mnesia"}. - %% Directory of mq's db-file {queue_dir, "{{platform_work_dir}}/queue"}. - %% SASL log related {sasl_log_dir, "{{platform_log_dir}}/sasl"}. {sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. +%% Application log directory +{app_log_dir, "{{platform_log_dir}}/app"}. +%% Directory of ring and cluster-members log directory +{ring_log_dir, "{{platform_log_dir}}/ring"}. +{members_log_dir, "{{platform_log_dir}}/ring"}. + %% Log output level %% 0: debug %% 1: info diff --git a/rel/leo_storage/files/app.config b/rel/leo_storage/files/app.config index 3dd8a83b..c9219d76 100644 --- a/rel/leo_storage/files/app.config +++ b/rel/leo_storage/files/app.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -57,18 +57,23 @@ %% mq - queues consumption's intervals %% - per_object + {cns_num_of_batch_process_per_object, {{cns_num_of_batch_process_per_object}} }, {cns_interval_per_object_min, {{cns_interval_per_object_min}} }, {cns_interval_per_object_max, {{cns_interval_per_object_max}} }, %% - sync_by_vnode_id + {cns_num_of_batch_process_sync_by_vnode_id, {{cns_num_of_batch_process_sync_by_vnode_id}} }, {cns_interval_sync_by_vnode_id_min, {{cns_interval_sync_by_vnode_id_min}} }, {cns_interval_sync_by_vnode_id_max, {{cns_interval_sync_by_vnode_id_max}} }, %% - for rebalance + {cns_num_of_batch_process_rebalance, {{cns_num_of_batch_process_rebalance}} }, {cns_interval_rebalance_min, {{cns_interval_rebalance_min}} }, {cns_interval_rebalance_max, {{cns_interval_rebalance_max}} }, %% - async deletion objects (after remove a bucket) + {cns_num_of_batch_process_async_deletion, {{cns_num_of_batch_process_async_deletion}} }, {cns_interval_async_deletion_min, {{cns_interval_async_deletion_min}} }, {cns_interval_async_deletion_max, {{cns_interval_async_deletion_max}} }, %% - recovery node + {cns_num_of_batch_process_recovery_node, {{cns_num_of_batch_process_recovery_node}} }, {cns_interval_recovery_node_min, {{cns_interval_recovery_node_min}} }, {cns_interval_recovery_node_max, {{cns_interval_recovery_node_max}} }, @@ -92,7 +97,7 @@ %% {log_level, {{log_level}} }, {log_appender, [ - {file, [{path, "{{platform_log_dir}}/app"}]} + {file, [{path, "{{app_log_dir}}" }]} ]}, %% == Directories == @@ -120,7 +125,9 @@ ]}, {leo_redundant_manager, [{profile, false}, {notify_mf, [leo_manager_api, notify]}, - {sync_mf, [leo_manager_api, synchronize]} + {sync_mf, [leo_manager_api, synchronize]}, + {log_dir_member, "{{ring_log_dir}}" }, + {log_dir_ring, "{{ring_log_dir}}" } ]}, {leo_statistics, [{profile, false}]} ]. diff --git a/rel/leo_storage/reltool.config b/rel/leo_storage/reltool.config index fa7fc98b..c60e2e55 100644 --- a/rel/leo_storage/reltool.config +++ b/rel/leo_storage/reltool.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file diff --git a/rel/leo_storage/vars.config b/rel/leo_storage/vars.config index f76bbc20..638ef6d5 100644 --- a/rel/leo_storage/vars.config +++ b/rel/leo_storage/vars.config @@ -3,7 +3,7 @@ %% %% LeoFS Storage %% -%% Copyright (c) 2012 Rakuten, Inc. +%% Copyright (c) 2012-2013 Rakuten, Inc. %% %% This file is provided to you under the Apache License, %% Version 2.0 (the "License"); you may not use this file @@ -21,7 +21,7 @@ %% %%====================================================================== %% LeoFS system's version" -{system_version, "0.16.0"}. +{system_version, "0.16.5"}. %% Node alias name {node_alias, "storage_0"}. @@ -52,6 +52,12 @@ {sasl_log_dir, "{{platform_log_dir}}/sasl"}. {sasl_error_log, "{{platform_log_dir}}/sasl/sasl-error.log"}. +%% Application log directory +{app_log_dir, "{{platform_log_dir}}/app"}. +%% Directory of ring and cluster-members log directory +{ring_log_dir, "{{platform_log_dir}}/ring"}. +{members_log_dir, "{{platform_log_dir}}/ring"}. + %% Log output level %% 0: debug %% 1: info @@ -84,18 +90,23 @@ %% mq - queues consumption's intervals %% - per_object +{cns_num_of_batch_process_per_object, 1}. {cns_interval_per_object_min, 1}. {cns_interval_per_object_max, 1}. %% - sync_by_vnode_id +{cns_num_of_batch_process_sync_by_vnode_id, 1}. {cns_interval_sync_by_vnode_id_min, 8}. {cns_interval_sync_by_vnode_id_max, 32}. %% - for rebalance +{cns_num_of_batch_process_rebalance, 60}. {cns_interval_rebalance_min, 1}. {cns_interval_rebalance_max, 1}. %% - async deletion objects (after remove a bucket) +{cns_num_of_batch_process_async_deletion, 1}. {cns_interval_async_deletion_min, 1}. {cns_interval_async_deletion_max, 1}. %% - recovery node +{cns_num_of_batch_process_recovery_node, 1}. {cns_interval_recovery_node_min, 1}. {cns_interval_recovery_node_max, 16}. diff --git a/releasenotes/leofs-0.16.md b/releasenotes/leofs-0.16.md index 252ceb8d..0ab27c9a 100644 --- a/releasenotes/leofs-0.16.md +++ b/releasenotes/leofs-0.16.md @@ -1,3 +1,61 @@ +leofs-0.16.5 +============== + +Features and Improvements for LeoFS +----------------------------------- + +* Improved + * S3-API related + * [#103] (https://github.com/leo-project/leofs/issues/103) Able to change password on Manager console + * [#105] (https://github.com/leo-project/leofs/issues/105) Able to change an owner of a bucket + * [#106] (https://github.com/leo-project/leofs/issues/106) Rename *set-endpoint* to *add-endpoint* in order to unify it and other commands + * Multicast *update-acl* to Gateway's node(s) + * Multicast *delete-bucket* to Gateway's node(s) + * Other + * [#98] (https://github.com/leo-project/leofs/issues/98) Made a bucket name compatible with the AWS-S3 naming rule of US-region + * [#99] (https://github.com/leo-project/leofs/issues/99) Able to set log-directory of *leo-redundant-manager* + * Revised that manage redundant nodes toward the multi data center replication + * Supported that manage previous and current members in a cluster in order not to happen lost data during the period of relocation of data + * Able to recover that Manager failed to send massage of relocation from Manager to Storage(s) + * Reduced costs of relocation of data than previous version + * Supported Ubuntu-13.10 (include Ubuntu Server 13.10) + +Bugs Fixed +----------- + +* [#94] (https://github.com/leo-project/leofs/issues/94) Happened an error when parsing XML document with S3's Java-Client +* [#95] (https://github.com/leo-project/leofs/issues/95) Could not resume storage node +* [#96] (https://github.com/leo-project/leofs/issues/96) Happened an error when Gateway is requested from *boto* +* [#97] (https://github.com/leo-project/leofs/issues/97) Could not upload an object when including a bucket name in a path +* [#100] (https://github.com/leo-project/leofs/issues/100) Broken records after update from 0.14.9 to 0.16.0 + +Used Libraries +--------------- + +* leo project + * [leo_backend-db v0.14.1](https://github.com/leo-project/leo_backend_db.git) + * [leo_cache v0.4.14](https://github.com/leo-project/leo_cache.git) + * [leo_commons v0.14.8](https://github.com/leo-project/leo_commons.git) + * [leo_dcerl v0.2.5](https://github.com/leo-project/leo_dcerl.git) + * [leo_logger v0.12.5](https://github.com/leo-project/leo_logger.git) + * [leo_mcerl v0.2.7](https://github.com/leo-project/leo_mcerl.git) + * [leo_mq v0.12.21](https://github.com/leo-project/leo_mq.git) + * [leo_object_storage v0.14.7](https://github.com/leo-project/leo_object_storage.git) + * [leo_ordning_reda v0.8.17](https://github.com/leo-project/leo_ordning_reda.git) + * [leo_redundant_manager v1.2.3](https://github.com/leo-project/leo_redundant_manager.git) + * [leo_s3_libs v0.12.21](https://github.com/leo-project/leo_s3_libs.git) + * [leo_statistics v0.14.6](https://github.com/leo-project/leo_statistics.git) + * [leo_gateway v0.16.5](https://github.com/leo-project/leo_gateway.git) + * [leo_manager v0.16.5](https://github.com/leo-project/leo_manager.git) + * [leo_storage v0.16.5](https://github.com/leo-project/leo_storage.git) +* others + * [bitcask v1.6.2](https://github.com/basho/bitcask.git) + * [cowboy v0.8.6](https://github.com/extend/cowboy.git) + * [folsom](https://github.com/boundary/folsom.git) + * [jiffy](https://github.com/davisp/jiffy.git) + * [lz4 v0.1.1](https://github.com/leo-project/erlang-lz4.git) - forked from [szktty/erlang-lz4](https://github.com/szktty/erlng-lz4) + + leofs-0.16.0 ==============