Mackerel external probe / aggregate agent.
maprobe is an external probe / aggregate agent with Mackerel.
maprobe agent works as below.
{{ .Host }} as Mackerel host struct.{{ .Host.IPAddress.eth0 }} expand to e.g. 192.168.1.1usage: maprobe [<flags>] <command> [<args> ...]
Flags:
--help Show context-sensitive help (also try --help-long and --help-man).
--log-level="info" log level
Commands:
help [<command>...]
Show help.
agent [<flags>]
Run agent
once [<flags>]
Run once
ping [<flags>] <address>
Run ping probe
tcp [<flags>] <host> <port>
Run TCP probe
http [<flags>] <url>
Run HTTP probe
MACKEREL_APIKEY environment variable is required.
$ maprobe agent --help
usage: maprobe agent [<flags>]
Run agent
Flags:
--help Show context-sensitive help (also try --help-long and --help-man).
--log-level="info" log level
-c, --config=CONFIG configuration file path or URL(http|s3)
--config accepts a local file path or URL(http, https or s3 scheme).
maprobe checks the config is modified, and reload in run time.
Defaults of --config and --log-level will be overrided from envrionment variables (CONFIG and LOG_LEVEL).
agent runs maprobe forever, once runs maprobe once.
post_probed_metrics: false # when false, do not post host metrics to Mackerel. only dump to [info] log.
probes:
- service: '{{ env "SERVICE" }}' # expand environment variable
role: server
ping:
address: '{{ .Host.IPAddresses.eth0 }}'
- service: production
role: webserver
http:
url: 'http://{{ .Host.CustomIdentifier }}/api/healthcheck'
post: POST
headers:
Content-Type: application/json
body: '{"hello":"world"}'
expect_pattern: 'ok'
- service: production
role: redis
tcp:
host: '{{ .Host.IPAddress.eth0 }}'
port: 6379
send: "PING\n"
expect_pattern: "PONG"
quit: "QUIT\n"
command:
command:
- "mackerel-plugin-redis"
- "-host={{ .Host.IPAddress.eth0 }}"
- "-tempfile=/tmp/redis-{{ .Host.ID }}"
Ping probe sends ICMP ping to the address.
ping:
address: "192.168.1.1" # Hostname or IP address (required)
count: 5 # Iteration count (default 3)
timeout: "500ms" # Timeout to ping response (default 1 sec)
metric_key_prefix: # default ping
Ping probe generates the following metrics.
TCP probe connects to host:port by TCP (or TLS).
tcp:
host: "memcached.example.com" # Hostname or IP Address (required)
port: 11211 # Port number (required)
timeout: 10s # Seconds of timeout (default 5)
send: "VERSION\n" # String to send to the server
quit: "QUIT\n" # String to send server to initiate a clean close of the connection"
expect_pattern: "^VERSION 1" # Regexp pattern to expect in server response
tls: false # Use TLS for connection
no_check_certificate: false # Do not check certificate
metric_key_prefix: # default tcp
TCP probe generates the following metrics.
HTTP probe sends a HTTP request to url.
http:
url: "http://example.com/" # URL
method: "GET" # Method of request (default GET)
headers: # Map of request header
Foo: "bar"
body: "" # Body of request
expect_pattern: "ok" # Regexp pattern to expect in server response
timeout: 10s # Seconds of request timeout (default 15)
no_check_certificate: false # Do not check certificate
metric_key_prefix: # default http
HTTP probe generates the following metrics.
When a status code is grather than 400, http.check.ok set to 0.
Command probe executes command which outputs like Mackerel metric plugin.
command:
command: "/path/to/metric-command -option=foo" # execute command
timeout: "5s" # Seconds of command timeout (default 15)
graph_defs: true # Post graph definitions to Mackerel (default false)
command accepts both a single string value and an array value. If an array value is passed, these are not processed by shell.
command:
command:
- "/path/to/metric-command"
- "-option=foo"
timeout: "5s" # Seconds of command timeout (default 15)
graph_defs: true # Post graph definitions to Mackerel (default false)
Command probe handles command's output as host metric.
When `graph_defs` is true, maprobe runs a command with `MACKEREL_AGENT_PLUGIN_META=1` environment variables and post graph definitions to Mackerel at first time.
If the command does not return a valid graph definitions output, that is ignored.
See also [ホストのカスタムメトリックを投稿する - Mackerel ヘルプ](https://mackerel.io/ja/docs/entry/advanced/custom-metrics#graph-schema).
#### Example of automated cleanup for terminated EC2 instances.
Command probe can run any scripts against for Mackerel hosts.
For example,
```yaml
service: production
role: server
statues:
- working
- standby
- poweroff
command:
command: 'cleanup.sh {{.Host.ID}} {{index .Host.Meta.Cloud.MetaData "instance-id"}}'
cleanup.sh checks an instance status, retire a Mackerel host when the instance is not exists.
#!/bin/bash
set -u
host_id="$1"
instance_id="$2"
exec 1> /dev/null # dispose stdout
result=$(aws ec2 describe-instance-status --instance-id "${instance_id}" 2>&1)
if [[ $? == 0 ]]; then
exit
elif [[ $result =~ "InvalidInstanceID.NotFound" ]]; then
mkr retire --force "${host_id}"
fi
post_aggregated_metrics: false # when false, do not post service metrics to Mackerel. only dump to [info] log.
aggregates:
- service: production
role: app-server
metrics:
- name: cpu.user.percentage
outputs:
- func: sum
name: cpu.user.sum_percentage
- func: avg
name: cpu.user.avg_percentage
- name: cpu.idle.percentage
outputs:
- func: sum
name: cpu.idle.sum_percentage
- func: avg
name: cpu.idle.avg_percentage
This configuration posts service metrics (for service "production") as below.
Following functions are available to aggregate host metrics.
Fujiwara Shunichiro [email protected]
Copyright 2018 Fujiwara Shunichiro
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
nless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Content type
Image
Digest
sha256:e6455320f…
Size
12.1 MB
Last updated
about 1 year ago
docker pull fujiwara/maprobe:v0.10.4-plain