Try to use with mqtt

[heiko1988]

Good day,

I'm trying to integrate a mqtt client that I can use the data in the smart home. in my case it would be iobroker

I've tried a bit to integrate it. Unfortunately, I lack expertise

I hope one of you can help me

The demo with the serial output runs great :)

My hardware:

Esp32 Wroom

The code where not working:

#include "NETSGPClient.h"
#include "EspMQTTClient.h"

EspMQTTClient client(
  "wifi_test",
  "password_test",
  "192.168.0.119",  // MQTT Broker server ip
  "iobroker",   // Can be omitted if not needed
  "Passwort",   // Can be omitted if not needed
  "SG600MD"      // Client name that uniquely identify your device
);

constexpr const uint8_t PROG_PIN = 4; /// Programming enable pin of RF module
constexpr const uint8_t RX_PIN = 17; /// RX pin of RF module
constexpr const uint8_t TX_PIN = 16; /// TX pin of RF module
constexpr const uint32_t inverterID = 0x38004044; /// Identifier of your inverter (see label on inverter)




NETSGPClient client(Serial2, PROG_PIN); /// NETSGPClient instance

void setup()
{
    Serial.begin(115200);
    Serial2.begin(9600, SERIAL_8N1, RX_PIN, TX_PIN);
//    pinMode(LED_BUILTIN, OUTPUT);
    delay(1000);
    Serial.println("Welcome to Micro Inverter Interface by ATCnetz.de and enwi.one");

    // Make sure the RF module is set to the correct settings
    if (!client.setDefaultRFSettings())
    {
        Serial.println("Could not set RF module to default settings");
    }
}



void onConnectionEstablished() {

  client.subscribe("mytopic/test", [] (const String &payload)  {
    Serial.println(payload);
  });

  client.publish("mytopic/test", "This is a message");
}


uint32_t lastSendMillis = 0;
void loop()
{
    const uint32_t currentMillis = millis();
    if (currentMillis - lastSendMillis > 2000)
    {
        lastSendMillis = currentMillis;

//        digitalWrite(LED_BUILTIN, !digitalRead(LED_BUILTIN));
        Serial.println("");
        Serial.println("Sending request now");

        const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
        if (status.valid)
        {
            Serial.println("*********************************************");
            Serial.println("Received Inverter Status");
            Serial.print("Device: ");
            Serial.println(status.deviceID, HEX);
            Serial.println("Status: " + String(status.state));
            Serial.println("DC_Voltage: " + String(status.dcVoltage) + "V");
            Serial.println("DC_Current: " + String(status.dcCurrent) + "A");
            Serial.println("DC_Power: " + String(status.dcPower) + "W");
            Serial.println("AC_Voltage: " + String(status.acVoltage) + "V");
            Serial.println("AC_Current: " + String(status.acCurrent) + "A");
            Serial.println("AC_Power: " + String(status.acPower) + "W");
            Serial.println("Power gen total: " + String(status.totalGeneratedPower));
            Serial.println("Temperature: " + String(status.temperature));
        }
    }
}

the error description from the compiler:

PollDemo:21:21: error: conflicting declaration 'NETSGPClient client'
 NETSGPClient client(Serial2, PROG_PIN); /// NETSGPClient instance
                     ^
C:\Users\chaos\Desktop\NETSGPClient-1.1.0 (1)\NETSGPClient-1.1.0\examples\PollDemo\PollDemo.ino:4:15: note: previous declaration as 'EspMQTTClient client'
 EspMQTTClient client(
               ^
C:\Users\chaos\Desktop\NETSGPClient-1.1.0 (1)\NETSGPClient-1.1.0\examples\PollDemo\PollDemo.ino: In function 'void setup()':
PollDemo:32:17: error: 'class EspMQTTClient' has no member named 'setDefaultRFSettings'
     if (!client.setDefaultRFSettings())
                 ^
C:\Users\chaos\Desktop\NETSGPClient-1.1.0 (1)\NETSGPClient-1.1.0\examples\PollDemo\PollDemo.ino: In function 'void loop()':
PollDemo:62:60: error: 'class EspMQTTClient' has no member named 'getStatus'
         const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
                                                            ^
Mehrere Bibliotheken wurden für "WiFi.h" gefunden
 Benutzt: C:\Users\chaos\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.6\libraries\WiFi
 Nicht benutzt: C:\Program Files (x86)\Arduino\libraries\WiFi
exit status 1
conflicting declaration 'NETSGPClient client'

[enwi]

@heiko1988 you cannot have two variables/objects with the same name. Rename the EspMQTTClient variable client in line 4 to maybe mqtt and also everywhere else in the code where you used it, but don't rename the client variables associated with NETSGPClient

[heiko1988]

Thank you for your important information

I put something together from different tuts.
The result is a small system that meets my requirements

With the following Things

Small web interface
http://your_ip

web Serial
http://your_ip/webserial

Mqtt

The coed isn't the best and just thrown together, but it's enough for me :)

Code:

#include "NETSGPClient.h"
#include <Arduino.h>
#include <WiFi.h>
#include <AsyncTCP.h>
#include <ESPAsyncWebServer.h>
#include <WebSerial.h>
#include <PubSubClient.h>
#define LED 2

//Optionen Start
//Add your Wifi Data
const char* ssid = "xxxxxxx";           // Your WiFi SSID
const char* password = "xxxxxx";      // Your WiFi Password

// Add your MQTT Broker Data:
const char* mqtt_server = "192.168.0.119";  //mqtt Broker ip
const char* mqtt_user = "xxxxxx";         //mqtt Username
const char* mqtt_password = "xxxxx";     //mqtt Password
//Optionen End


// Create AsyncWebServer object on port 80
AsyncWebServer server(80);

// Create an Event Source on /events
AsyncEventSource events("/events");

// Timer variables
unsigned long lastTime = 0;  
unsigned long timerDelay = 30000;

WiFiClient espClient;
PubSubClient mqtt(espClient);
long lastMsg = 0;
char msg[50];
int value = 0;

//Variable für mqtt
float temperature = 0;
float dcVoltage1 = 0;
float dcCurrent1 = 0;
float dcPower1 = 0;
float acVoltage1 = 0;
float acCurrent1 = 0;
float acPower1 = 0;
float temperature1 = 0;
float totalGeneratedPower1 = 0;
float state1 = 0;


void callback(char* topic, byte* message, unsigned int length) {
  Serial.print("Message arrived on topic: ");
  Serial.print(topic);
  Serial.print(". Message: ");
  String messageTemp;
  
  for (int i = 0; i < length; i++) {
    Serial.print((char)message[i]);
    messageTemp += (char)message[i];
  }
  Serial.println();

  // Feel free to add more if statements to control more GPIOs with MQTT

  // If a message is received on the topic esp32/output, you check if the message is either "on" or "off". 
  // Changes the output state according to the message
  if (String(topic) == "esp32/output") {
    Serial.print("Changing output to ");
    if(messageTemp == "on"){
      Serial.println("on");
 //     digitalWrite(ledPin, HIGH);
    }
    else if(messageTemp == "off"){
      Serial.println("off");
//      digitalWrite(ledPin, LOW);
    }
  }
}
void reconnect() {
  // Loop until we're reconnected
  while (!mqtt.connected()) {
    Serial.print("Attempting MQTT connection...");
    // Attempt to connect
    if (mqtt.connect("ESP8266Client")) {
      Serial.println("connected");
      // Subscribe
      mqtt.subscribe("esp32/output");
    } else {
      Serial.print("failed, rc=");
      Serial.print(mqtt.state());
      Serial.println(" try again in 5 seconds");
      // Wait 5 seconds before retrying
      delay(5000);
    }
  }
}

void recvMsg(uint8_t *data, size_t len){
  WebSerial.println("Received Data...");
  String d = "";
  for(int i=0; i < len; i++){
    d += char(data[i]);
  }
  WebSerial.println(d);
  if (d == "ON"){
    digitalWrite(LED, HIGH);
  }
  if (d=="OFF"){
    digitalWrite(LED, LOW);
  }
}

constexpr const uint8_t PROG_PIN = 4; /// Programming enable pin of RF module
constexpr const uint8_t RX_PIN = 17; /// RX pin of RF module
constexpr const uint8_t TX_PIN = 16; /// TX pin of RF module
constexpr const uint32_t inverterID = 0x38004044; /// Identifier of your inverter (see label on inverter)





NETSGPClient client(Serial2, PROG_PIN); /// NETSGPClient instance



String processor(const String& var){
 

{
  const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
  //Serial.println(var);
  if(var == "DC_Voltage"){
    return String(status.dcVoltage);
    
  }
    if(var == "DC_Current"){
    return String(status.dcCurrent);
  }
  else if(var == "DC_Power"){
    return String(status.dcPower);
  }
  else if(var == "AC_Voltage"){
    return String(status.acVoltage);
  }
    if(var == "AC_Current"){
    return String(status.acCurrent);
  }
  else if(var == "AC_Power"){
    return String(status.acPower);
  }
  else if(var == "Temperature"){
    return String(status.temperature);
  }
  if(var == "Power_gen_total"){
    return String(status.totalGeneratedPower);
  }
    if(var == "Status"){
    return String(status.state);
  }
  else if(var == "Status"){
    return String(0);
  }
  return String();
}
}

const char index_html[] PROGMEM = R"rawliteral(
<!DOCTYPE HTML><html>
<head>
  <title>PV Smart Inverter</title>
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <meta http-equiv="refresh" content="20">
  <link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.7.2/css/all.css" integrity="sha384-fnmOCqbTlWIlj8LyTjo7mOUStjsKC4pOpQbqyi7RrhN7udi9RwhKkMHpvLbHG9Sr" crossorigin="anonymous">
  <link rel="icon" href="data:,">
  <style>
    html {font-family: Arial; display: inline-block; text-align: center;}
    p { font-size: 1.2rem;}
    body {  margin: 0;}
    .topnav { overflow: hidden; background-color: #50B8B4; color: white; font-size: 1rem; }
    .content { padding: 20px; }
    .card { background-color: white; box-shadow: 2px 2px 12px 1px rgba(140,140,140,.5); }
    .cards { max-width: 800px; margin: 0 auto; display: grid; grid-gap: 2rem; grid-template-columns: repeat(auto-fit, minmax(200px, 1fr)); }
    .reading { font-size: 1.4rem; }
  </style>
</head>
<body>
  <div class="topnav">
    <h1>PV Smart Inverter</h1>
  </div>
  <div class="content">
    <div class="cards">
      <div class="card">
        <p><i class="fas fa-angle-double-down" style="color:#e1e437;"></i> DC_Voltage</p><p><span class="reading"><span id="DC_Voltage">%DC_Voltage%</span> V</span></p>
      </div>
      <div class="card">
        <p><i class="fas fa-angle-double-down" style="color:#e1e437;"></i> DC_Current</p><p><span class="reading"><span id="hum">%DC_Current%</span> A</span></p>
      </div>
      <div class="card">
        <p><i class="fas fa-angle-double-down" style="color:#e1e437;"></i> DC_Power</p><p><span class="reading"><span id="pres">%DC_Power%</span> W</span></p>
      </div>
            <div class="card">
        <p><i class="fas fa-angle-double-up" style="color:#059e8a;"></i> AC_Voltage</p><p><span class="reading"><span id="temp">%AC_Voltage%</span> V</span></p>
      </div>
      <div class="card">
        <p><i class="fas fa-angle-double-up" style="color:#059e8a;"></i> AC_Current</p><p><span class="reading"><span id="hum">%AC_Current%</span> A</span></p>
      </div>
      <div class="card">
        <p><i class="fas fa-angle-double-up" style="color:#059e8a;"></i> AC_Power</p><p><span class="reading"><span id="pres">%AC_Power%</span> W</span></p>
      </div>
             <div class="card">
        <p><i class="<!--fas fa-thermometer-half-->" style="color:#059e8a;"></i> Temperature</p><p><span class="reading"><span id="temp">%Temperature%</span> C</span></p>
      </div>
      <div class="card">
        <p><i class="" style="color:#00add6;"></i> Power gen total</p><p><span class="reading"><span id="hum">%Power_gen_total%</span> KwH</span></p>
      </div>
      <div class="card">
        <p><i class="" style="color:#e1e437;"></i> Status</p><p><span class="reading"><span id="pres">%Status%</span> </span></p>
      </div>
    </div>
  </div>
<script>
if (!!window.EventSource) {
 var source = new EventSource('/events');
 
 source.addEventListener('open', function(e) {
  console.log("Events Connected");
 }, false);
 source.addEventListener('error', function(e) {
  if (e.target.readyState != EventSource.OPEN) {
    console.log("Events Disconnected");
  }
 }, false);
 
 source.addEventListener('message', function(e) {
  console.log("message", e.data);
 }, false);
 
 source.addEventListener('temperature', function(e) {
  console.log("temperature", e.data);
  document.getElementById("temp").innerHTML = e.data;
 }, false);
 
 source.addEventListener('humidity', function(e) {
  console.log("humidity", e.data);
  document.getElementById("hum").innerHTML = e.data;
 }, false);
 
 source.addEventListener('pressure', function(e) {
  console.log("pressure", e.data);
  document.getElementById("pres").innerHTML = e.data;
 }, false);
}
</script>
</body>
</html>)rawliteral";


void setup()
{
    Serial.begin(115200);
    Serial2.begin(9600, SERIAL_8N1, RX_PIN, TX_PIN);
//    pinMode(LED_BUILTIN, OUTPUT);
    delay(1000);
    Serial.println("Welcome to Micro Inverter Interface by ATCnetz.de and enwi.one");
      WiFi.mode(WIFI_STA);
  WiFi.begin(ssid, password);
  if (WiFi.waitForConnectResult() != WL_CONNECTED) {
    Serial.printf("WiFi Failed!\n");
    return;
  }
  Serial.print("IP Address: ");
  Serial.println(WiFi.localIP());
  // WebSerial is accessible at "<IP Address>/webserial" in browser
  WebSerial.begin(&server);
  WebSerial.msgCallback(recvMsg);

  


 // Handle Web Server
  server.on("/", HTTP_GET, [](AsyncWebServerRequest *request){
    request->send_P(200, "text/html", index_html, processor);
  });

  // Handle Web Server Events
  events.onConnect([](AsyncEventSourceClient *client){
    if(client->lastId()){
      Serial.printf("Client reconnected! Last message ID that it got is: %u\n", client->lastId());
    }
    // send event with message "hello!", id current millis
    // and set reconnect delay to 1 second
    client->send("hello!", NULL, millis(), 10000);
  });
  server.addHandler(&events);

  
  server.begin();


  mqtt.setServer(mqtt_server, 1883);
  mqtt.setCallback(callback);
 (mqtt.connect("PV", mqtt_user, mqtt_password));



    // Make sure the RF module is set to the correct settings
//    if (!client.setDefaultRFSettings())
//    {
//        Serial.println("Could not set RF module to default settings");
//    }
}

uint32_t lastSendMillis = 0;



void loop()
{

  
    const uint32_t currentMillis = millis();
    if (currentMillis - lastSendMillis > 2000)

    {
        lastSendMillis = currentMillis;
        
        //digitalWrite(LED_BUILTIN, !digitalRead(LED_BUILTIN));
        //WebSerial.println("");
        WebSerial.println("Sending request now");
        delay(2000);

        const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
        if (status.valid)
        {
            WebSerial.println("*********************************************");
            WebSerial.println("Received Inverter Status");
            WebSerial.print("Device: ");
//            WebSerial.println(status.deviceID, HEX);
            WebSerial.println("Status: " + String(status.state));
            WebSerial.println("DC_Voltage: " + String(status.dcVoltage) + "V");
            WebSerial.println("DC_Current: " + String(status.dcCurrent) + "A");
            WebSerial.println("DC_Power: " + String(status.dcPower) + "W");
            WebSerial.println("AC_Voltage: " + String(status.acVoltage) + "V");
            WebSerial.println("AC_Current: " + String(status.acCurrent) + "A");
            WebSerial.println("AC_Power: " + String(status.acPower) + "W");
            WebSerial.println("Power gen total: " + String(status.totalGeneratedPower));
            WebSerial.println("Temperature: " + String(status.temperature));
            delay(2000);
        }
    }
    
    {
        lastSendMillis = currentMillis;
        
        //digitalWrite(LED_BUILTIN, !digitalRead(LED_BUILTIN));
        //Serial.println("");
        Serial.println("Sending request now");

        const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
        if (status.valid)
        {
            Serial.println("*********************************************");
            Serial.println("Received Inverter Status");
            Serial.print("Device: ");
            Serial.println(status.deviceID, HEX);
            Serial.println("Status: " + String(status.state));
            Serial.println("DC_Voltage: " + String(status.dcVoltage) + "V");
            Serial.println("DC_Current: " + String(status.dcCurrent) + "A");
            Serial.println("DC_Power: " + String(status.dcPower) + "W");
            Serial.println("AC_Voltage: " + String(status.acVoltage) + "V");
            Serial.println("AC_Current: " + String(status.acCurrent) + "A");
            Serial.println("AC_Power: " + String(status.acPower) + "W");
            Serial.println("Power gen total: " + String(status.totalGeneratedPower));
            Serial.println("Temperature: " + String(status.temperature));
        }
    }


{
const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
if (status.valid)
{
    // Send Events to the Web Server with the Sensor Readings
    events.send("ping",NULL,millis());
    events.send(String(status.dcVoltage).c_str(),"DC_Voltage",millis());
    events.send(String(status.dcCurrent).c_str(),"DC_Current",millis());
    events.send(String(status.dcPower).c_str(),"DC_Power",millis());
    events.send(String(status.acVoltage).c_str(),"AC_Voltage",millis());
    events.send(String(status.acCurrent).c_str(),"AC_Current",millis());
    events.send(String(status.acPower).c_str(),"AC_Power",millis());
    events.send(String(status.temperature).c_str(),"Temperature",millis());
    events.send(String(status.totalGeneratedPower).c_str(),"Power_gen_total",millis());
    events.send(String(status.state).c_str(),"Status",millis());
    delay(5000);
    
}
  }







if (!mqtt.connected()) {
    reconnect();
  }
  mqtt.loop();

  long now = millis();
  if (now - lastMsg > 5000) {
    lastMsg = now;
    
    // Temperature in Celsius
     {
const NETSGPClient::InverterStatus status = client.getStatus(inverterID);
   
    
    
    // Uncomment the next line to set temperature in Fahrenheit 
    // (and comment the previous temperature line)
    //temperature = 1.8 * bme.readTemperature() + 32; // Temperature in Fahrenheit
    
    // Convert the value to a char array
    dcVoltage1 = (status.dcVoltage);
    char dcVoltage[8];
    dtostrf(dcVoltage1, 1, 2, dcVoltage);
    //Serial.print("Mqtt-dcVoltage: ");
    //Serial.println(dcVoltage);
    mqtt.publish("pv1/dcVoltage", dcVoltage);

    dcCurrent1 = (status.dcCurrent);
    char dcCurrent[8];
    dtostrf(dcCurrent1, 1, 2, dcCurrent);
    //Serial.print("Mqtt-dcCurrent: ");
    //Serial.println(dcCurrent);
    mqtt.publish("pv1/dcCurrent", dcCurrent);

    dcPower1 = (status.dcPower);
    char dcPower[8];
    dtostrf(dcPower1, 1, 2, dcPower);
    //Serial.print("Mqtt-dcPower: ");
    //Serial.println(dcPower);
    mqtt.publish("pv1/dcPower", dcPower);

    acVoltage1 = (status.acVoltage);
    char acVoltage[8];
    dtostrf(acVoltage1, 1, 2, acVoltage);
    //Serial.print("Mqtt-acVoltage: ");
    //Serial.println(acVoltage);
    mqtt.publish("pv1/acVoltage", acVoltage);

    acCurrent1 = (status.acCurrent);
    char acCurrent[8];
    dtostrf(acCurrent1, 1, 2, acCurrent);
    //Serial.print("Mqtt-acCurrent: ");
    //Serial.println(acCurrent);
    mqtt.publish("pv1/acCurrent", acCurrent);

    acPower1 = (status.acPower);
    char acPower[8];
    dtostrf(acPower1, 1, 2, acPower);
    //Serial.print("Mqtt-acPower: ");
    //Serial.println(acPower);
    mqtt.publish("pv1/acPower", acPower);

    temperature = (status.temperature);
    char tempString[8];
    dtostrf(temperature, 1, 2, tempString);
    //Serial.print("Mqtt-Temperature: ");
    //Serial.println(tempString);
    mqtt.publish("pv1/temperature", tempString);

    totalGeneratedPower1 = (status.totalGeneratedPower);
    char totalGeneratedPower[8];
    dtostrf(totalGeneratedPower1, 1, 2, totalGeneratedPower);
    //Serial.print("Mqtt-totalGeneratedPower: ");
    //Serial.println(totalGeneratedPower);
    mqtt.publish("pv1/totalGeneratedPower", totalGeneratedPower);

    state1 = (status.state);
    char state[8];
    dtostrf(state1, 1, 2, state);
    //Serial.print("Mqtt-state: ");
    //Serial.println(state);
    mqtt.publish("pv1/state", state);
    }   

  }
}

Quellen:
https://github.com/atc1441/NETSGPClient
https://randomnerdtutorials.com/esp32-webserial-library/
https://randomnerdtutorials.com/esp32-web-server-sent-events-sse/
https://randomnerdtutorials.com/esp32-mqtt-publish-subscribe-arduino-ide/

[enwi]

@heiko1988 I hope the WiFi credentials are just an example 😅

Other than that looks great. I am actually working on a PCB and webinterface for these inverters, which I will sell on Tindie soon. It will have the ability to provide data to MQTT, PVOutput and to configure 1 or more inverters through a webinterface.

[enwi]

Changing the credentials won't help @heiko1988 you will need to delete the whole message and write a new comment, because you can see a history of all changes

[heiko1988]

No problem, for a better overview I have replaced everything with xxx.

The data can be viewed easily

The data is only from my test instance

[WeareGermans]

Maybe this could be transformed into a great example?

[enwi]

Pull requests welcome @WeareGermans 😜

[MichaelHeimann]

Maybe this could be transformed into a great example?

I got so inspired by this gem that I (although not having coding-centric background) created my first github project based on this "example". But I did use a ESP32 (future ready for bluetooth, maybe) as a base:

https://github.com/MichaelHeimann/OpenNETek

I have changed it quite a bit but would like to thank you guys for the inspiration!

[enwi]

Thanks for the nice work @MichaelHeimann. Though I got one improvement for your repo. Rather than copying the NETSGPClient code into your repo you should add it as a dependency.

[MichaelHeimann]

Thanks @enwi for pointing that out, it is changed.