<?xml version="1.0" encoding="utf-8"?>
<feed xml:lang="en" xmlns="http://www.w3.org/2005/Atom"><title>Recent changes to 18 feb 2022: First TCK Test RUN Results</title><link href="https://forge.codesys.com/lib/cobolt/blog/2022/02/first-tck-test-run-results/" rel="alternate"/><link href="https://forge.codesys.com/lib/cobolt/blog/2022/02/first-tck-test-run-results/feed.atom" rel="self"/><id>https://forge.codesys.com/lib/cobolt/blog/2022/02/first-tck-test-run-results/</id><updated>2022-02-18T00:01:32.903000Z</updated><subtitle>Recent changes to 18 feb 2022: First TCK Test RUN Results</subtitle><entry><title>18 feb 2022: First TCK Test RUN Results</title><link href="https://forge.codesys.com/lib/cobolt/blog/2022/02/first-tck-test-run-results/" rel="alternate"/><published>2022-02-18T00:01:32.903000Z</published><updated>2022-02-18T00:01:32.903000Z</updated><author><name>h-hermsen</name><uri>https://forge.codesys.com/u/hermsen/</uri></author><id>https://forge.codesys.com5af59ef916bc1364e8225c50127f621d83b0c259</id><summary type="html">&lt;div class="markdown_content"&gt;&lt;h1 id="first-tck-test-run-results"&gt;First TCK Test RUN Results&lt;/h1&gt;
&lt;h3 id="sparkplug-tck"&gt;Sparkplug TCK&lt;/h3&gt;
&lt;p&gt;This is the Sparkplug Test Compatibility Kit (TCK) or test suite.&lt;br/&gt;
It is an independent third party provided compatibility kit to test our Edge Of Network and Device library against. Further details are found at &lt;a href="https://github.com/eclipse/sparkplug/tree/develop/tck" rel="nofollow"&gt;https://github.com/eclipse/sparkplug/tree/develop/tck&lt;/a&gt;&lt;/p&gt;
&lt;h3 id="conclusion-of-our-first-tck-test-run"&gt;Conclusion of our first TCK Test RUN&lt;/h3&gt;
&lt;p&gt;At least 2 FAILS seem on first glance QUICK fixes. &lt;br/&gt;
So, overall we think that we are on the right path but we also see room for improvements. &lt;/p&gt;
&lt;h3 id="test-results"&gt;Test results&lt;/h3&gt;
&lt;p&gt;1) We assume that when no outcome has been printed, this test is not yet implemented.&lt;br/&gt;
2) The TCK is still a work in progress. So some of the results will be incorrect, some not.&lt;/p&gt;
&lt;p&gt;test run by i-campbell 👌;&lt;/p&gt;
&lt;div class="codehilite"&gt;&lt;pre&gt;&lt;span&gt;&lt;/span&gt;&lt;span class="nt"&gt;payloads-nbirth-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-dbirth-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-dbirth-mqtt&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;edge-subscribe-dcmd&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;(&lt;/span&gt;&lt;span class="nt"&gt;Edge&lt;/span&gt; &lt;span class="nt"&gt;node&lt;/span&gt; &lt;span class="nt"&gt;should&lt;/span&gt; &lt;span class="nt"&gt;subscribe&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;DCMD&lt;/span&gt; &lt;span class="nt"&gt;level&lt;/span&gt; &lt;span class="nt"&gt;topics&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;ensure&lt;/span&gt; &lt;span class="nt"&gt;device&lt;/span&gt; &lt;span class="nt"&gt;targeted&lt;/span&gt; &lt;span class="nt"&gt;message&lt;/span&gt; &lt;span class="nt"&gt;from&lt;/span&gt; &lt;span class="nt"&gt;theprimary&lt;/span&gt; &lt;span class="nt"&gt;host&lt;/span&gt; &lt;span class="nt"&gt;application&lt;/span&gt; &lt;span class="nt"&gt;are&lt;/span&gt; &lt;span class="nt"&gt;delivered&lt;/span&gt;&lt;span class="o"&gt;);&lt;/span&gt;
&lt;span class="nt"&gt;message-flow-edge-node-birth-publish-subscribe&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-nbirth-bdseq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-qos&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-nbirth-rebirth-req&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-sequence-num-zero-nbirth&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-bdseq-included&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-dbirth-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-order&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-nbirth-retain&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndeath-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-value&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndeath-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndeath-bdseq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;principles-birth-certificates-order&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-nbirth-qos&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;principles-persistence-clean-session&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt; &lt;span class="o"&gt;(&lt;/span&gt;&lt;span class="nt"&gt;Clean&lt;/span&gt; &lt;span class="nt"&gt;session&lt;/span&gt; &lt;span class="nt"&gt;should&lt;/span&gt; &lt;span class="nt"&gt;be&lt;/span&gt; &lt;span class="nt"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;true&lt;/span&gt;&lt;span class="o"&gt;.);&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-mqtt&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-seq-num&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndeath-will-message&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-datatype&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-nbirth-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;edge-subscribe-ncmd&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;(&lt;/span&gt;&lt;span class="nt"&gt;Edge&lt;/span&gt; &lt;span class="nt"&gt;node&lt;/span&gt; &lt;span class="nt"&gt;should&lt;/span&gt; &lt;span class="nt"&gt;subscribe&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;NCMD&lt;/span&gt; &lt;span class="nt"&gt;level&lt;/span&gt; &lt;span class="nt"&gt;topics&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;ensure&lt;/span&gt; &lt;span class="nt"&gt;Edge&lt;/span&gt; &lt;span class="nt"&gt;node&lt;/span&gt; &lt;span class="nt"&gt;targeted&lt;/span&gt; &lt;span class="nt"&gt;message&lt;/span&gt; &lt;span class="nt"&gt;fromthe&lt;/span&gt; &lt;span class="nt"&gt;primary&lt;/span&gt; &lt;span class="nt"&gt;host&lt;/span&gt; &lt;span class="nt"&gt;application&lt;/span&gt; &lt;span class="nt"&gt;are&lt;/span&gt; &lt;span class="nt"&gt;delivered&lt;/span&gt;&lt;span class="o"&gt;);&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-seq-inc&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-rebirth-metric&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndeath-payload&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndeath-will-message-qos&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt; &lt;span class="o"&gt;(&lt;/span&gt;&lt;span class="nt"&gt;NDEATH&lt;/span&gt; &lt;span class="nt"&gt;message&lt;/span&gt; &lt;span class="nt"&gt;must&lt;/span&gt; &lt;span class="nt"&gt;have&lt;/span&gt; &lt;span class="nt"&gt;Qos&lt;/span&gt; &lt;span class="nt"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;to&lt;/span&gt; &lt;span class="nt"&gt;1&lt;/span&gt;&lt;span class="o"&gt;);&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndeath-will-message-retain&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-nbirth-bdseq-matching&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-name&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-dbirth-retain&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;OVERALL&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;


&lt;span class="nt"&gt;topics-ddata-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ddata-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndata-seq&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ddata-retain&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ddata-payload&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndata-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ddata-mqtt&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ddata-seq-num&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndata-retain&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ddata-qos&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndata-seq-num&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndata-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndata-payload&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ddata-timestamp&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;payloads-ndata-qos&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;topics-ndata-mqtt&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;OVERALL&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;PASS&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;


&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-action-1&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-action-3&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;operational-behavior-data-commands-rebirth-action-2&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;span class="nt"&gt;OVERALL&lt;/span&gt;&lt;span class="o"&gt;:&lt;/span&gt; &lt;span class="nt"&gt;FAIL&lt;/span&gt;&lt;span class="o"&gt;;&lt;/span&gt;
&lt;/pre&gt;&lt;/div&gt;

&lt;/div&gt;</summary></entry></feed>