Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix max log length in loki config #777

Closed
wants to merge 3 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion charts/tfy-loki/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
apiVersion: v2
name: tfy-loki
description: Truefoundry Loki Provisioner
version: 0.1.3-rc.1
version: 0.1.3-rc.2
maintainers:
- name: truefoundry
dependencies:
Expand Down
44 changes: 23 additions & 21 deletions charts/tfy-loki/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,24 +12,26 @@ https://github.com/grafana/helm-charts/tree/8b9ca8240e4e412f72af2df42f833c94142a

### Upstream Loki configurations

| Name | Description | Value |
| -------------------------------------------------------------- | --------------------------------------------------------------------------------------------------- | ----------------------------------- |
| `loki.enabled` | Enable loki | `true` |
| `loki.loki.storage.type` | Method to use for storage | `filesystem` |
| `loki.loki.compactor.shared_store` | The shared store used for storing boltdb files. | `filesystem` |
| `loki.loki.compactor.retention_enabled` | Activate custom (per-stream,per-tenant) retention. | `true` |
| `loki.loki.auth_enabled` | Enables authentication through the X-Scope-OrgID header | `false` |
| `loki.loki.limits_config.retention_period` | Retention period to apply to stored data. | `168h` |
| `loki.loki.limits_config.max_query_lookback` | Limit how far back in time series data and metadata can be queried, up until lookback duration ago. | `168h` |
| `loki.loki.limits_config.split_queries_by_interval` | Split queries by a time interval and execute in parallel. | `10h` |
| `loki.loki.limits_config.max_entries_limit_per_query` | Maximum number of log entries that will be returned for a query. | `30000` |
| `loki.singleBinary.replicas` | Number of replicas for the single binary | `1` |
| `loki.singleBinary.resources.requests.cpu` | CPU requests for promtail container | `0.03` |
| `loki.singleBinary.resources.requests.memory` | Memory requests for promtail container | `250Mi` |
| `loki.singleBinary.persistence.size` | Size of persistent disk | `50Gi` |
| `loki.singleBinary.persistence.enableStatefulSetAutoDeletePVC` | Enable StatefulSetAutoDeletePVC feature | `false` |
| `promtail.enabled` | Enable promtail | `true` |
| `promtail.config.clients[0].url` | Loki push API URL | `http://loki:3100/loki/api/v1/push` |
| `promtail.resources.requests.cpu` | CPU requests for promtail container | `40m` |
| `promtail.resources.requests.memory` | Memory requests for promtail container | `100Mi` |
| `promtail.resources.requests.ephemeral-storage` | Ephemeral storage requests for promtail container | `256Mi` |
| Name | Description | Value |
| -------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------- |
| `loki.enabled` | Enable loki | `true` |
| `loki.loki.storage.type` | Method to use for storage | `filesystem` |
| `loki.loki.compactor.shared_store` | The shared store used for storing boltdb files. | `filesystem` |
| `loki.loki.compactor.retention_enabled` | Activate custom (per-stream,per-tenant) retention. | `true` |
| `loki.loki.auth_enabled` | Enables authentication through the X-Scope-OrgID header | `false` |
| `loki.loki.limits_config.retention_period` | Retention period to apply to stored data. | `168h` |
| `loki.loki.limits_config.max_query_lookback` | Limit how far back in time series data and metadata can be queried, up until lookback duration ago. | `168h` |
| `loki.loki.limits_config.split_queries_by_interval` | Split queries by a time interval and execute in parallel. | `10h` |
| `loki.loki.limits_config.max_entries_limit_per_query` | Maximum number of log entries that will be returned for a query. | `30000` |
| `loki.loki.limits_config.max_line_size` | Max line size of a log. If log exceeds this length, it will either be skipped or truncated depeneding on max_line_size_truncate | `20000` |
| `loki.loki.limits_config.max_line_size_truncate` | If a log exceeds max_line_size, log will be truncated if set to true else skipped | `true` |
| `loki.singleBinary.replicas` | Number of replicas for the single binary | `1` |
| `loki.singleBinary.resources.requests.cpu` | CPU requests for promtail container | `0.03` |
| `loki.singleBinary.resources.requests.memory` | Memory requests for promtail container | `250Mi` |
| `loki.singleBinary.persistence.size` | Size of persistent disk | `50Gi` |
| `loki.singleBinary.persistence.enableStatefulSetAutoDeletePVC` | Enable StatefulSetAutoDeletePVC feature | `false` |
| `promtail.enabled` | Enable promtail | `true` |
| `promtail.config.clients[0].url` | Loki push API URL | `http://loki:3100/loki/api/v1/push` |
| `promtail.resources.requests.cpu` | CPU requests for promtail container | `40m` |
| `promtail.resources.requests.memory` | Memory requests for promtail container | `100Mi` |
| `promtail.resources.requests.ephemeral-storage` | Ephemeral storage requests for promtail container | `256Mi` |
4 changes: 4 additions & 0 deletions charts/tfy-loki/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -24,11 +24,15 @@ loki:
## @param loki.loki.limits_config.max_query_lookback Limit how far back in time series data and metadata can be queried, up until lookback duration ago.
## @param loki.loki.limits_config.split_queries_by_interval Split queries by a time interval and execute in parallel.
## @param loki.loki.limits_config.max_entries_limit_per_query Maximum number of log entries that will be returned for a query.
## @param loki.loki.limits_config.max_line_size Max line size of a log. If log exceeds this length, it will either be skipped or truncated depeneding on max_line_size_truncate
## @param loki.loki.limits_config.max_line_size_truncate If a log exceeds max_line_size, log will be truncated if set to true else skipped
limits_config:
retention_period: 168h
max_query_lookback: 168h
split_queries_by_interval: 10h
max_entries_limit_per_query: 30000
max_line_size: 20000
max_line_size_truncate: true
## @skip loki.test.enabled
test:
enabled: false
Expand Down
Loading