All Collections
Coralogix tutorials
Loggregation: Making Big Data Small
Loggregation: Making Big Data Small

This tutorial will explain what is Loggregation and how to use it

Lior Redlus avatar
Written by Lior Redlus
Updated over a week ago

Loggregation is an algorithm that condenses millions of log entries into a narrow set of patterns. It does so by automatically analyzing each log record sent to Coralogix, then separating the log constants from its variables.

Let’s have a look.

1) Below you can see, 166.80K log entries from a certain query:

2) Within seconds of clicking Templates, the 34 logs become grouped into their original patterns, thereby dramatically reducing the number of entries:

As you can see below, we went from 12.6M entries to only 710 templates. There is also a display of how many times each pattern arrived, the ratio of each pattern, and a full visualization of all parameters. This serves as a major timesaver in terms of log analysis.

3) Have JSON format log data? no problem! Coralogix clusters your JSON's into their unique appearances while allowing you to graphically view the different values including an automatic text clustering:

For further analysis, you can click on any of the variables, which are conveniently color-coded. Doing so will immediately display a graph with relevant information. 

Here’s a closer look at the types of graphs for each (colored) variable.

Blue variables are categorical (text) parameters. Clicking on them will display a categorical bar graph that describes the number of log entries for each value of the selected parameter (displaying up to 50 different values). For example:

In addition, clicking the pin Graph at the top right corner of each visualization allows you to send that graph directly to your Coralogix dashboard in seconds.

Did this answer your question?