{"id":1277,"date":"2023-03-02T16:51:13","date_gmt":"2023-03-02T14:51:13","guid":{"rendered":"https:\/\/www.rocworks.at\/wordpress\/?p=1277"},"modified":"2023-03-02T16:51:13","modified_gmt":"2023-03-02T14:51:13","slug":"collect-factory-data-and-write-it-to-kafka-with-the-automation-gateway","status":"publish","type":"post","link":"https:\/\/www.rocworks.at\/wordpress\/?p=1277","title":{"rendered":"Collect Factory data and write it to Kafka, with the Automation Gateway&#8230;"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Did a test with one gateway and collected 250000 \ud83d\ude32 value changes per second(!) from 10 OPC UA servers and wrote it to 10 topics on a single Kafka Broker\u2026 Kafka was bored \ud83d\ude34&#8230; one and a half core of an i7 PC. The gateway had a lot of work to do, collect and bulk all the single values and then send it to Kafka &#8230; roughly 10 cores of an i7 PC.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The gateway has a GraphQL and MQTT interface where you can read and write OPC UA values. On an internal MQTT topic the logger publishes how many values are getting in and out\u2026<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2023\/03\/image.png\"><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"367\" src=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2023\/03\/image.png\" alt=\"\" class=\"wp-image-1278\" srcset=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2023\/03\/image.png 800w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2023\/03\/image-300x138.png 300w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2023\/03\/image-768x352.png 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Did a test with one gateway and collected 250000 \ud83d\ude32 value changes per second(!) from 10 OPC UA servers and wrote it to 10 topics on a single Kafka Broker\u2026 Kafka was bored \ud83d\ude34&#8230; one and a half core of &hellip; <a href=\"https:\/\/www.rocworks.at\/wordpress\/?p=1277\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39],"tags":[],"class_list":["post-1277","post","type-post","status-publish","format-standard","hentry","category-frankenstein"],"_links":{"self":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1277"}],"version-history":[{"count":1,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1277\/revisions"}],"predecessor-version":[{"id":1279,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1277\/revisions\/1279"}],"wp:attachment":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1277"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1277"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}