[{"_1":2,"_161":-5,"_162":-5},"loaderData",{"_3":4,"_17":18,"_25":26,"_140":141},"root",{"_5":-5,"_6":-7,"_7":8,"_9":-7,"_10":11,"_12":-7,"_13":14,"_15":16},"currentUser","primaryEmail","siteVerification","6LeIxAcTAAAAAJcZVRqyHh71UMIEGNQ_MXjiZKhI","toast","enableDev",false,"incidentStatus","theme","system","contrast","normal","routes/_layout",{"_19":-5,"_20":21,"_22":21,"_23":11,"_24":21},"username","isAskGordonEnabled",true,"isUsingNewTemplate","showMinimalLanding","showHoneypotTrap","routes/_layout.r.$namespace.$reponame",{"_27":28,"_29":-5,"_30":11,"_31":11,"_32":33,"_34":35,"_36":-5,"_37":11,"_38":39,"_88":-5,"_89":90,"_129":-5,"_130":11,"_131":21,"_132":11,"_133":-5,"_134":11,"_135":-5,"_136":137,"_138":91,"_139":-7},"canonicalUrl","https://hub.docker.com/r/fish/prometheus-am-executor/tags","mcpServer","canSeeDockerfile","canSeeAutobuilds","namespace","fish","reponame","prometheus-am-executor","cloudBuildSource","isAutobuildsAvailable","repo",{"_40":41,"_42":43,"_45":46,"_47":48,"_49":11,"_50":51,"_52":53,"_54":55,"_57":35,"_32":33,"_58":59,"_60":44,"_61":62,"_63":64,"_65":66,"_67":-5,"_68":62,"_69":70,"_71":11,"_72":33,"_73":74,"_79":21,"_80":81,"_85":33,"_86":87},"categories",[],"content_types",[44],"image","date_registered","2018-03-20T13:16:02.995302Z","description","See README.","is_private","last_updated","2018-03-20T13:21:19.238714Z","last_modified","2024-10-16T13:48:34.145251Z","media_types",[56],"application/vnd.docker.container.image.v1+json","name","pull_count",1488,"repository_type","star_count",0,"status",1,"status_description","active","source","collaborator_count","full_description","# prometheus-am-executor\nThe prometheus-am-executor is a HTTP server that receives alerts from the\n[Prometheus Alertmanager](https://prometheus.io/docs/alerting/alertmanager/) and\nexecutes a given command with alert details set as environment variables.\n\n## Usage\n```\nUsage: ./prometheus-am-executor [options] script [args..]\n\n -l string\n \tHTTP Port to listen on (default \":8080\")\n -v\tEnable verbose/debug logging\n```\n\nThe executor runs the provided script with the following environment variables\nset:\n\n- `AMX_RECEIVER`: name of receiver in the AM triggering the alert\n- `AMX_STATUS`: alert status\n- `AMX_EXTERNAL_URL`: URL to reach alertmanager\n- `AMX_ALERT_LEN`: Number of alerts; for iterating through `AMX_ALERT_..` vars\n- `AMX_LABEL_`: alert label pairs\n- `AMX_GLABEL_`: label pairs used to group alert\n- `AMX_ANNOTATION_`: alert annotation key/value pairs\n- `AMX_ALERT__STATUS`: status of alert\n- `AMX_ALERT__START`: start of alert in seconds since epoch\n- `AMX_ALERT__END`: end of alert, 0 for firing alerts\n- `AMX_ALERT__URL`: URL to metric in prometheus\n- `AMX_ALERT__LABEL_`: alert label pairs\n- `AMX_ALERT__ANNOTATION_`: alert annotation key/value pairs\n\n## Example: Reboot systems with errors\nSometimes a system might exhibit errors that require a hard reboot. This is an\nexample on how to use Prometheus and prometheus-am-executor to reboot a machine\na machine based on a alert while making sure enough instances are in service\nall the time.\n\nLet assume the counter `app_errors_unrecoverable_total` should trigger a reboot\nif increased by 1. To make sure enough instances are in service all the time,\nthe reboot should only get triggered if at least 80% of all instances are\nreachable in the load balancer. A alerting expression would look like this:\n\n```\nALERT RebootMachine IF\n\tincrease(app_errors_unrecoverable_total[15m]) > 0 AND\n\tavg by(backend) (haproxy_server_up{backend=\"app\"}) > 0.8\n```\n\nThis will trigger an alert `RebootMachine` if `app_errors_unrecoverable_total`\nincreased in the last 15 minutes and there are at least 80% of all servers for\nbackend `app` up.\n\nNow the alert needs to get routed to prometheus-am-executor like in this \n[alertmanager config](examples/alertmanager.conf) example.\n\nFinally prometheus-am-executor needs to be pointed to a reboot script:\n\n```\n./prometheus-am-executor examples/reboot\n```\n\nAs soon as the counter increases by 1, an alert gets triggered and the\nalertmanager routes the alert to prometheus-am-executor which executes the\nreboot script.\n\n### Caveats\nTo make sure a system doesn't get rebooted multiple times, the \n`repeat_interval` needs to be longer than interval used for `increase()`. As\nlong as that's the case, prometheus-am-executor will run the provided script\nonly once.\n\n`increase(app_errors_unrecoverable_total[15m])` takes the value of\n`app_errors_unrecoverable_total` 15 minutes ago to calculate the increase, it's\nrequired that the metric already exists *before* the counter increase happens.\nThe Prometheus client library sets counters to 0 by default, but only for\nmetrics without dynamic labels. Otherwise the metric only appears the first time\nit is set. The alert won't get triggered if the metric uses dynamic labels and\nwas incremented the very first time (the increase from 'unknown to 0). Therefor\nyou **need** to initialize all error counters with 0.\n\nSince the alert gets triggered if the counter increased in the last 15 minutes,\nthe alert resolves after 15 minutes without counter increase, so it's important\nthat the alert gets processed in those 15 minutes or the system won't get\nrebooted.\n","has_starred","hub_user","immutable_tags_settings",{"_75":11,"_76":77},"enabled","rules",[78],".*","is_automated","permissions",{"_82":21,"_83":11,"_84":11},"read","write","admin","user","storage_size",6786146,"orgData","recentTags",[91],{"_92":44,"_93":94,"_95":96,"_97":98,"_99":100,"_50":118,"_119":94,"_120":33,"_121":56,"_57":122,"_123":124,"_125":109,"_126":118,"_127":66,"_128":21},"content_type","creator",3710,"full_size",6782734,"id",24173746,"images",[101],{"_102":103,"_104":105,"_106":107,"_108":109,"_110":111,"_112":113,"_114":107,"_115":-5,"_116":96,"_63":66,"_117":-5},"architecture","amd64","digest","sha256:d79b5f9f94c3a055e65930228f92ac9113ee4cc7dffc27aa6467a05a1452368a","features","","last_pulled","2026-10-13T08:59:47.746129858Z","last_pushed","2018-03-20T13:21:19Z","os","linux","os_features","os_version","size","variant","2018-03-20T13:21:18.851128Z","last_updater","last_updater_username","media_type","v0.0.2","repository",4900218,"tag_last_pulled","tag_last_pushed","tag_status","v2","sbxKitMetadata","isPotentialSpam","isHubSbxKitsEnabled","showSbxLogoOverride","sbxTrademarkText","displaySecurityMetadata","tagAttestations","tagsHaveAttestations",[],"selectedTag","attestationsUrl","routes/_layout.r.$namespace.$reponame.tags",{"_38":142,"_149":150,"_136":159,"_160":11},{"_40":143,"_42":144,"_45":46,"_47":48,"_49":11,"_50":51,"_52":53,"_54":145,"_57":35,"_32":33,"_58":59,"_60":44,"_61":62,"_63":64,"_65":66,"_67":-5,"_68":62,"_69":70,"_71":11,"_72":33,"_73":146,"_79":21,"_80":148,"_85":33,"_86":87},[],[44],[56],{"_75":11,"_76":147},[78],{"_82":21,"_83":11,"_84":11},"tags",{"_151":64,"_152":-5,"_153":-5,"_154":155},"count","next","previous","results",[156],{"_92":44,"_93":94,"_95":96,"_97":98,"_99":157,"_50":118,"_119":94,"_120":33,"_121":56,"_57":122,"_123":124,"_125":109,"_126":118,"_127":66,"_128":21},[158],{"_102":103,"_104":105,"_106":107,"_108":109,"_110":111,"_112":113,"_114":107,"_115":-5,"_116":96,"_63":66,"_117":-5},[],"canDeleteTags","actionData","errors"]

fish/prometheus-am-executor

Tags for fish/prometheus-am-executor