<img width="150" height="99" src="https://www.codingblocks.net/wp-content/uploads/2023/09/coding-blocks-episode-217-cover.jpg" class="webfeedsFeaturedVisual wp-post-image" alt="" decoding="async" loading="lazy" style="display: block; margin-bottom: 5px; clear:both;max-width: 100%;" link_thumbnail="" /><img width="150" height="99" src="https://www.codingblocks.net/wp-content/uploads/2023/09/coding-blocks-episode-217-cover.jpg" class="attachment-thumbnail size-thumbnail wp-post-image" alt="" decoding="async" loading="lazy" style="float:left; margin:0 15px 15px 0;" />
<p>Get a behind the scenes intro to some of the <em>interesting</em> conversations we have before we even get into the content.  We&#8217;ll be jumping into the meat of this episode and looking at the specifics of tracing using OpenTelemetry.  Before we do that though, we should probably find out what special 2-liter containers  Outlaw uses that can somehow trap the bubbles for more than 24 hours after opening, find out if Joe is alone in liking flat carbonated drinks, and maybe Allen has fallen off his rocker for suggesting that the ONE THING that is metric in the USA should be converted to empirical measurements.  Maybe leave a comment on the episode to join in the fun.  To see the full show notes and/or leave a comment, head over to&#8230;<a href="https://www.codingblocks.net/episode217">https://www.codingblocks.net/episode217</a></p>



<span id="more-40721"></span>



<h2 class="wp-block-heading" id="opentelemetry-diving-in">OpenTelemetry Diving In</h2>



<h3 class="wp-block-heading" id="tracerprovider">TracerProvider</h3>



<p>This is a factory for Tracers</p>



<ul>
<li>In most apps, the TracerProvider is initialized once and typically has the same lifecycle as the application</li>



<li>Also includes a Resource and Exporter initialization</li>



<li>Typically, the first step in setting up OpenTelemetry and in some language implementations a global provider is set up for you</li>
</ul>



<h3 class="wp-block-heading" id="tracer">Tracer</h3>



<p>These are created by a trace provider and creates spans with more information about what&#8217;s happening with the request</p>



<h3 class="wp-block-heading" id="trace-exporter---these-send-traces-to-a-consumer">Trace Exporter</h3>



<p>These send traces to a consumer</p>



<ul>
<li>Can be sent to standard out if you&#8217;re just debugging</li>



<li>Can be an OpenTelemetry Collector</li>



<li>Can be any other open source or other consumer</li>
</ul>



<h3 class="wp-block-heading" id="context-propagation">Context Propagation</h3>



<ul>
<li>The heart of distributed tracing as it takes and correlates multiple spans</li>
</ul>



<h4 class="wp-block-heading" id="context">Context</h4>



<ul>
<li>The context contains information that allows spans to be correlated
<ul>
<li>Example is Service A calling Service B</li>



<li>Service A will have a trace id as well as its own span id</li>



<li>Service B will reuse that same trace id so the entire trace can be correlated, and Service B will also have its own unique span id but the parent id will point to the span id from Service A, so again this correlates the parent / child hierarchy of the spans</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="propagation">Propagation</h4>



<ul>
<li>This is what moves the context between services and processes</li>



<li>Serializes / deserializes the context object and provides the relevant trace information to be carried from one service or process to the next
<ul>
<li>This is usually handled by instrumentation libraries but can be done manually via propagation APIs</li>
</ul>
</li>



<li>There are a number of formats that OpenTelemetry supports, but the default is the W3C&#8217;s TraceContext <a href="https://www.w3.org/TR/trace-context/">https://www.w3.org/TR/trace-context/</a>
<ul>
<li>The context objects are stored within a span</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="spans">Spans</h4>



<ul>
<li>These represent a unit of work or an operation</li>



<li>Spans are the building blocks of traces</li>



<li>Information included in a span
<ul>
<li>Name</li>



<li>Parent span id (empty for a root span)</li>



<li>Span context</li>



<li>Attributes</li>



<li>Span events</li>



<li>Span links</li>



<li>Span status</li>
</ul>
</li>



<li>Spans can be nested (parent/child) &#8211; any child span should be a sub-operation</li>
</ul>



<h4 class="wp-block-heading" id="span-context">Span Context</h4>



<ul>
<li>IMMUTABLE</li>



<li>Contains the following
<ul>
<li>Trace id</li>



<li>Unique span id</li>



<li>Trace flags &#8211; binary encoding containing information about the trace</li>



<li>Trace state &#8211; list of key-value pairs that can carry vendor-specific trace information</li>



<li>This data sits alongside distributed context and baggage</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="attributes">Attributes</h4>



<ul>
<li>Key/value pairs used to carry information about the operation it&#8217;s tracking
<ul>
<li>Example used &#8211; shopping cart may store the user id, item id added to cart and a cart id</li>
</ul>
</li>



<li>Keys must be non-null</li>



<li>Values must be non-null strings, a boolean, floating point value, integer or an array of any of those</li>



<li>There exists semantic attributes for well-known attributes that should be followed to help standardize across systems<a href="https://opentelemetry.io/docs/specs/otel/trace/semantic_conventions/">https://opentelemetry.io/docs/specs/otel/trace/semantic_conventions/</a>
<ul>
<li>Some examples of &#8220;general attributes&#8221;
<ul>
<li>server.address</li>



<li>server.port</li>
</ul>
</li>



<li>Some &#8220;database&#8221; examples
<ul>
<li>db.system</li>



<li>db.connection_string</li>
</ul>
</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="span-events">Span Events</h4>



<ul>
<li>A structured log message or annotation on a span, usually used for a meaningful point in time in the span&#8217;s duration
<ul>
<li>Example &#8211; two web browser scenarios
<ul>
<li>Tracking a page load &#8211; what you&#8217;d use a span for because it has a start and end time</li>



<li>Denoting when a page becomes interactive &#8211; this is a singular point in time in the life of that span above</li>
</ul>
</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="span-links">Span Links</h4>



<ul>
<li>Allows you to associate a span with one or more other spans &#8211; indicating a causal relationship</li>



<li>An example is when you have a system that queues actions based off other actions in an asynchronous manner &#8211; you don&#8217;t know when the queued action will start so you create a span link that can correlate these spans over time when the asynchronous event occurs</li>



<li>Span links are optional but can be a good way to associate trace spans with one another</li>
</ul>



<h4 class="wp-block-heading" id="span-status">Span Status</h4>



<ul>
<li>Status is attached to a span &#8211; one of three values
<ul>
<li><strong><em>Unset </em></strong>&#8211; this is what you usually want to do</li>



<li><strong><em>Ok</em></strong> &#8211; the back-end that processes the spans should set this for you as a final status</li>



<li><strong><em>Error</em></strong> &#8211; usually set whenever you handle an exception/error</li>
</ul>
</li>
</ul>



<h4 class="wp-block-heading" id="span-kind">Span Kind</h4>



<ul>
<li>When a span is created, it is created as one of the following types
<ul>
<li><strong><em>Client </em></strong>&#8211; represents synchronous, outgoing remote calls &#8211; this doesn&#8217;t mean that it&#8217;s not asynchronous technically, it just means it&#8217;s not being queued for later processing</li>



<li><strong><em>Server</em></strong> &#8211; represents an incoming synchronous call such as an HTTP request</li>



<li><strong><em>Internal</em></strong> &#8211; operations that do not cross a process boundary &#8211; things like instrumenting a function</li>



<li><strong><em>Producer</em></strong> &#8211; represent the creation of a job that may be asynchronously processed later &#8211; things like messages sent to queues or handling of events</li>



<li><strong><em>Consumer</em></strong> &#8211; represents the processing of a job that was created by a producer and potentially starts well after the producer span has ended</li>
</ul>
</li>



<li>These types provide a hint to the backend span processor as to how these spans should be assembled</li>



<li>Based on the OpenTelemetry specification
<ul>
<li>The parent span of a server span is usually a remote client span</li>



<li>The parent of a consumer span is always a producer span</li>
</ul>
</li>



<li>If no type is provided, it is assumed to be an internal span</li>
</ul>



<h2 class="wp-block-heading" id="resources-we-like">Resources we Like</h2>



<p><a href="https://opentelemetry.io/">https://opentelemetry.io</a> <a href="https://opentelemetry.io/docs/demo/architecture/">https://opentelemetry.io/docs/demo/architecture/</a> <a href="https://opentelemetry.io/docs/demo/screenshots/">https://opentelemetry.io/docs/demo/screenshots/</a></p>



<h2 class="wp-block-heading" id="tip-of-the-week">Tip of the Week</h2>



<ul>
<li>Interested in tldr.sh but want a faster, single binary version? Check out &#8220;tealdeer&#8221; &#8211; same info, faster implimentation in Rust. Thanks for the tip, Aleksander Andrzejewski! <a href="https://github.com/dbrgn/tealdeer">https://github.com/dbrgn/tealdeer</a></li>



<li>Don&#8217;t waste your time hitting ctrl-alt-delete and then selecting the task manager. You gotta go fast, just use <strong><em>ctrl-shift-escape</em></strong> next time and it&#8217;ll pop right up! Thanks for the tip in the comments Mark Crowley!</li>



<li>Sea of Stars is a new, retro, video game that hearkens back to the golden era of ol&#8217; Super Nintendo/Famicom games like Chronotrigger and Secret of Mana. No grindy battlepasses, weird mobile ads, or zany gpu requirements&#8230;just a good game. Bonus, it features new songs from Uasunori Mitsuda, who is well known for their music work with a bunch of classic RPG series including Final Fantasy, Chronotrigger, Xenogears. If any of those names make your heart jump out of your chest then you owe it to yourself to give it a look. <a href="https://seaofstarsgame.co/">https://seaofstarsgame.co/</a></li>



<li>Fuzzing tool for a kubernetes cluster <a href="https://google.github.io/clusterfuzz/">https://google.github.io/clusterfuzz/</a></li>



<li>Foundational C# Certification &#8211; Partnership with freeCodeCamp / Microsoft <a href="https://devblogs.microsoft.com/dotnet/announcing-foundational-csharp-certification/">https://devblogs.microsoft.com/dotnet/announcing-foundational-csharp-certification/</a></li>



<li>Leader board for Chat Bots <a href="https://chat.lmsys.org/">https://chat.lmsys.org/</a></li>



<li>There&#8217;s an AI for that <a href="https://theresanaiforthat.com/">https://theresanaiforthat.com/</a></li>



<li>Use <code>kubectl get deployments -o wide</code> to see which image tag your containers are using. <a href="https://kubernetes.io/docs/reference/generated/kubectl/kubectl-commands#get">https://kubernetes.io/docs/reference/generated/kubectl/kubectl-commands#get</a></li>



<li>Did you know you can exec into a pod without looking up the generated pod name? Yep! You can just exec into a deployment and it will pick a pod for you, works for logs too!
<ul>
<li>kubectl exec -it deploy/your-pod-name &#8212; bash</li>



<li>kubectl logs deploy/your-pod-name</li>
</ul>
</li>
</ul>


Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Tracing Specifics – Know your System with OpenTelmetry

Coding Blocks