summaryrefslogtreecommitdiff
path: root/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi
diff options
context:
space:
mode:
authorPaul Buetow <paul@buetow.org>2024-08-26 23:07:44 +0300
committerPaul Buetow <paul@buetow.org>2024-08-26 23:07:44 +0300
commitfa3426b5d9ac9eeccaea3aa7e4eb44e1fa2eab65 (patch)
treef391aa531e8837ffe3ef0601d2a3aa8135c9fcca /gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi
parent87d2c5cdd30fbed688eeac23e173398e95edda10 (diff)
Update content for gemtext
Diffstat (limited to 'gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi')
-rw-r--r--gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi27
1 files changed, 12 insertions, 15 deletions
diff --git a/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi b/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi
index df9a037d..6a4b8816 100644
--- a/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi
+++ b/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.gmi
@@ -2,12 +2,23 @@
> Published at 2021-04-22T19:28:41+01:00; Updated at 2021-04-26
+This article first appeared at the Mimecast Engineering Blog but I made it available here in my personal internet site too.
+
+=> https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb Original Mimecast Engineering Blog post at Medium
+
+Running a large cloud-based service requires monitoring the state of huge numbers of machines, a task for which many standard UNIX tools were not really designed. In this post, I will describe a simple program, DTail, that Mimecast has built and released as Open-Source, which enables us to monitor log files of many servers at once without the costly overhead of a full-blown log management system.
+
+At Mimecast, we run over 10 thousand server boxes. Most of them host multiple microservices and each of them produces log files. Even with the use of time series databases and monitoring systems, raw application logs are still an important source of information when it comes to analysing, debugging, and troubleshooting services.
+
+Every engineer familiar with UNIX or a UNIX-like platform (e.g., Linux) is well aware of tail, a command-line program for displaying a text file content on the terminal which is also especially useful for following application or system log files with tail -f logfile.
+
+Think of DTail as a distributed version of the tail program which is very useful when you have a distributed application running on many servers. DTail is an Open-Source, cross-platform, fairly easy to use, support and maintain log file analysis & statistics gathering tool designed for Engineers and Systems Administrators. It is programmed in Google Go.
+
=> ./dtail-the-distributed-log-tail-program/title.png DTail logo image
## Table of Contents
* ⇢ DTail - The distributed log tail program
-* ⇢ ⇢ Introduction
* ⇢ ⇢ A Mimecast Pet Project
* ⇢ ⇢ Differentiating from log management systems
* ⇢ ⇢ Combining simplicity, security and efficiency
@@ -18,20 +29,6 @@
* ⇢ ⇢ For the future
* ⇢ ⇢ Open Source
-## Introduction
-
-This article first appeared at the Mimecast Engineering Blog but I made it available here in my personal internet site too.
-
-=> https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb Original Mimecast Engineering Blog post at Medium
-
-Running a large cloud-based service requires monitoring the state of huge numbers of machines, a task for which many standard UNIX tools were not really designed. In this post, I will describe a simple program, DTail, that Mimecast has built and released as Open-Source, which enables us to monitor log files of many servers at once without the costly overhead of a full-blown log management system.
-
-At Mimecast, we run over 10 thousand server boxes. Most of them host multiple microservices and each of them produces log files. Even with the use of time series databases and monitoring systems, raw application logs are still an important source of information when it comes to analysing, debugging, and troubleshooting services.
-
-Every engineer familiar with UNIX or a UNIX-like platform (e.g., Linux) is well aware of tail, a command-line program for displaying a text file content on the terminal which is also especially useful for following application or system log files with tail -f logfile.
-
-Think of DTail as a distributed version of the tail program which is very useful when you have a distributed application running on many servers. DTail is an Open-Source, cross-platform, fairly easy to use, support and maintain log file analysis & statistics gathering tool designed for Engineers and Systems Administrators. It is programmed in Google Go.
-
## A Mimecast Pet Project
DTail got its inspiration from public domain tools available already in this area but it is a blue sky from-scratch development which was first presented at Mimecast’s annual internal Pet Project competition (awarded with a Bronze prize). It has gained popularity since and is one of the most widely deployed DevOps tools at Mimecast (reaching nearly 10k server installations) and many engineers use it on a regular basis. The Open-Source version of DTail is available at: