Jafner/homelab
1
1
Fork 0
Code Issues 15 Pull Requests Actions Packages Projects Releases Wiki Activity

Implement Loki Logging Properly #31

New Issue
Closed
opened 2022-07-13 13:23:19 -07:00 by Jafner · 9 comments
Jafner commented 2022-07-13 13:23:19 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

With a better understanding and better personal documentation, we can design and implement Loki logging properly.

Tasks

  • Build list of services to add logging to
  • Document process for instrumenting Loki logging for a new app
  • Update basic webapp template with new logging instrumentation
  • Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable?

References

With a better understanding and better personal documentation, we can design and implement Loki logging properly. # Tasks - [x] Build list of services to add logging to - [x] Document process for instrumenting Loki logging for a new app - [x] Update basic webapp template with new logging instrumentation - [x] Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable? # References
Jafner commented 2022-07-13 13:36:00 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

mentioned in commit 54124da9d1

mentioned in commit 54124da9d1330049be7a3dd37c2dfdc4d2940646
Jafner commented 2022-07-13 13:36:13 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

Re: Build list of services to add logging to
Fuck that. I just did it. See: 54124da9

Re: Build list of services to add logging to Fuck that. I just did it. See: 54124da9
Jafner commented 2022-07-13 13:36:19 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

marked the checklist item Build list of services to add logging to as completed

marked the checklist item **Build list of services to add logging to** as completed
Jafner commented 2022-07-13 13:37:13 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

Re: Document process for instrumenting Loki logging for a new app
See: https://gitlab.jafner.net/Jafner/homelab/-/blob/main/server/config/monitoring/README.md

Re: Document process for instrumenting Loki logging for a new app See: https://gitlab.jafner.net/Jafner/homelab/-/blob/main/server/config/monitoring/README.md
Jafner commented 2022-07-13 13:40:28 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

marked the checklist item Document process for instrumenting Loki logging for a new app as completed

marked the checklist item **Document process for instrumenting Loki logging for a new app** as completed
Jafner commented 2022-07-13 13:40:51 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

mentioned in commit 241d798f9e

mentioned in commit 241d798f9eb94b762b189d4893ed7ea22a53b98a
Jafner commented 2022-07-13 13:40:53 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

marked the checklist item Update basic webapp template with new logging instrumentation as completed

marked the checklist item **Update basic webapp template with new logging instrumentation** as completed
Jafner commented 2022-07-13 14:03:25 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

Re: Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable?
Ran a docker stop monitoring_loki and then waited a while (30s) for errors to accumulate. Checked sudo systemctl status docker.service and confirmed error messages in the logs. Applications remained available. Docker still responds to commands to manipulate other containers.

Re: Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable? Ran a `docker stop monitoring_loki` and then waited a while (30s) for errors to accumulate. Checked `sudo systemctl status docker.service` and confirmed error messages in the logs. Applications remained available. Docker still responds to commands to manipulate other containers.
Jafner commented 2022-07-13 14:04:20 -07:00 (Migrated from gitlab.jafner.net)
Copy Link

marked the checklist item Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable? as completed

marked the checklist item **Find out what happens when the logging endpoint is down. Does the application still work? Is the system stable?** as completed
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Jafner/homelab#31
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?