Monitoring Cloudera Edge Flow Manager and Cloudera Streams Messaging Manager with Apache NiFi


Monitoring Cloudera Edge Flow Manager and Cloudera Streams Messaging Manager with Apache NiFi


http://SERVER:10080/efm/actuator/health

{"status":{"code":"UP","description":""},"details":{"db":{"status":{"code":"UP","description":""},"details":{"database":"MySQL","hello":1}},"diskSpace":{"status":{"code":"UP","description":""},"details":{"total":1073729220608,"free":1023731712000,"threshold":10485760}}}}








http://SERVER:10080/efm/actuator/heapdump






http://SERVER:10080/efm/actuator/env






http://SERVER:10080/efm/actuator/httptrace 








Check REST API Made Available During EFM Startup





2019-08-21 22:30:25.045  INFO 100056 --- [           main] o.e.jetty.server.AbstractConnector       : Started ServerConnector@747d1932{HTTP/1.1,[http/1.1]}{cloudera:10080}




2019-08-21 22:30:25.047  INFO 100056 --- [           main] o.s.b.web.embedded.jetty.JettyWebServer  : Jetty started on port(s) 10080 (http/1.1) with context path '/efm'




2019-08-21 22:30:25.050  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : Started C2Application in 10.102 seconds (JVM running for 10.741)




2019-08-21 22:30:25.056  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : The Edge Flow Manager has started. Services available at the following URLs:




2019-08-21 22:30:25.056  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : >>> Access User Interface: http://cloudera:10080/efm/ui




2019-08-21 22:30:25.056  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : >>> Base URL for REST API: http://cloudera:10080/efm/api




2019-08-21 22:30:25.057  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : >>> Swagger REST API docs: http://cloudera:10080/efm/swagger




2019-08-21 22:30:25.057  INFO 100056 --- [           main] com.cloudera.cem.efm.C2Application       : >>> Status and management: http:/cloudera:10080/efm/actuator




Agent Classes


http://SERVER:10080/efm/api/agent-classes






[
  {
    "name": "iot-1",
    "agentManifests": [
      "agent-manifest-id"
    ]
  },
  {
    "name": "nanojetsonjava",
    "agentManifests": [
      "agent-manifest-id"
    ]
  },
  {
    "name": "raspianjava",
    "agentManifests": [
      "agent-manifest-id"
    ]
  },
  {
    "name": "rpi3javamovidiussensehat",
    "agentManifests": [
      "agent-manifest-id"
    ]
  },
  {
    "name": "rpi4java",
    "agentManifests": [
      "agent-manifest-id"
    ]
  },
  {
    "name": "rpijavamovidiussensehat",
    "agentManifests": [
      "agent-manifest-id"
    ]
  }
]






EFM Agent Manifests


http://server:10080/efm/api/agent-manifests






EFM Agents


http://server:10080/efm/api/agents






EFM C2 Configuration - NiFi Registry


http://server:10080/efm/api/c2-configuration/nifi-registry




EFM Designer Flows


http://server:10080/efm/api/designer/flows






EFM API FLOWS


http://server:10080/efm/api/flows








Monitoring SMM Metrics with NiFi






Aggregated Topics for Last Hour




http://server:9991/api/v1/admin/metrics/aggregated/topics?duration=LAST_ONE_HOUR&state=all




Aggregated Brokers for the Last Hour




http://server:9991/api/v1/admin/metrics/aggregated/brokers?duration=LAST_ONE_HOUR















EFM Events



http://server:10080/efm/api/events



EFM Event by Event ID



http://server:10080/efm/api/events/9db708ca-3b7e-42bf-941a-a945fefa6fa6



Get a Heartbeat from a Device by HBDI



http://server:10080/efm/api/heartbeats/HBID



For Auto-configuring your processor, list of fields available



EFM Events / Fields


http://server:10080/efm/api/events/fields



What Flows available



http://server:10080/efm/api/designer/flows



http://server:10080/efm/api/designer/flows/summaries



Get One Flow



GET /designer/flows/{flowId}



http://server:10080/efm/api/designer/flows/46cac951-217d-41f7-9442-086e9199c044



Get That Flows Events



GET /designer/flows/{flowId}/events



http://server:10080/efm/api/designer/flows/46cac951-217d-41f7-9442-086e9199c044/events



Get All Flows and Buckets



http://server:10080/efm/api/flows



Agent Classes



http://server:10080/efm/api/agent-classes



Agents



http://server:10080/efm/api/agents



Agent Manifests



http://server:10080/efm/api/agent-manifests



What NiFi Registry



http://server:10080/efm/api/c2-configuration/nifi-registry



What EFM Server



http://server:10080/efm/api/c2-configuration



SMM API








EFM Flow Designer



http://server:10080/efm/ui/#/flow-designer/flow/4ae72206-372d-4f3e-916a-d7c1faf09811

For a Great Real World Usage Example

https://github.com/asdaraujo/edge2ai-workshop#lab_1


http://hostname:10080/efm/api/agent-classes








http://hostname:10080/efm/api/agent-manifests?class=






http://hostname:10080/efm/swagger/



























Email Post